2024-04-24T13:17:13.575 INFO:root:teuthology version: 0.0.1.dev269+g9481b1d 2024-04-24T13:17:13.575 DEBUG:teuthology.run:Teuthology command: teuthology --description rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} --name cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi --verbose --archive /home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434 --owner scheduled_cbodley@teuthology -- /home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434/orig.config.yaml 2024-04-24T13:17:13.612 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T13:17:13.692 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434 branch: wip-cbodley-testing description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} email: null first_in_suite: false job_id: '7671434' kernel: kdb: true sha1: distro ktype: distro last_in_suite: false machine_type: smithi name: cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi no_nested_subset: false nuke-on-error: true openstack: - volumes: count: 4 size: 10 os_type: ubuntu os_version: '22.04' overrides: admin_socket: branch: wip-cbodley-testing ceph: conf: client: rgw relaxed s3 bucket names: true mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd blocked scrub grace period: 3600 osd failsafe full ratio: 0.95 osd max markdown count: 1000 osd objectstore: bluestore osd shutdown pgref assert: true flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled - overall HEALTH_ - \(OSDMAP_FLAGS\) - \(OSD_ - \(PG_ - \(POOL_ - \(CACHE_POOL_ - \(SMALLER_PGP_NUM\) - \(OBJECT_ - \(SLOW_OPS\) - \(REQUEST_SLOW\) - \(TOO_FEW_PGS\) - slow request - timeout on replica - late reservation from - MON_DOWN - OSDMAP_FLAGS - OSD_DOWN - PG_DEGRADED - PG_AVAILABILITY - POOL_APP_NOT_ENABLED - mons down - mon down - out of quorum sha1: 882080b304cb1602e69c11bc5fe8479e7d2bc64d ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 882080b304cb1602e69c11bc5fe8479e7d2bc64d rgw: frontend: beast s3tests: force-branch: ceph-master thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-cbodley-testing sha1: 882080b304cb1602e69c11bc5fe8479e7d2bc64d owner: scheduled_cbodley@teuthology priority: 75 repo: https://git.ceph.com/ceph-ci.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - node-exporter.b seed: 4466 sha1: 882080b304cb1602e69c11bc5fe8479e7d2bc64d sleep_before_teardown: 0 suite: rgw suite_branch: wip-cbodley-testing suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_882080b304cb1602e69c11bc5fe8479e7d2bc64d/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 882080b304cb1602e69c11bc5fe8479e7d2bc64d targets: smithi071.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBOU2F4NK4VX1Ts4ppD2JoJBw6vciwrCucDkmqEwzDMlbtLnGGDpugrlDV9k33KjxQA12mDqT7bX+2jBQy8Iyd8= smithi138.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNzGGlhf88aO8WN61EVg1AhyHeCqx8Oxe1R6ERGnuWQ8HR54jACSJ627ocCUXG+KcUG0Lw6CH6MdpjbXF8VRID4= tasks: - install: null - ceph: null - rgw: - client.0 - thrashosds: ceph_objectstore_tool: false chance_pgnum_grow: 1 chance_pgnum_shrink: 1 chance_pgpnum_fix: 1 chance_test_min_size: 0 op_delay: 30 timeout: 1200 - workunit: clients: client.0: - rgw/s3_bucket_quota.pl teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17 timestamp: 2024-04-24_12:59:55 tube: smithi user: cbodley verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 2024-04-24T13:17:13.692 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_882080b304cb1602e69c11bc5fe8479e7d2bc64d/qa; will attempt to use it 2024-04-24T13:17:13.693 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_882080b304cb1602e69c11bc5fe8479e7d2bc64d/qa/tasks 2024-04-24T13:17:13.693 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-04-24T13:17:13.695 INFO:teuthology.task.internal:Checking packages... 2024-04-24T13:17:13.722 INFO:teuthology.task.internal:Checking packages for os_type 'ubuntu', flavor 'default' and ceph hash '882080b304cb1602e69c11bc5fe8479e7d2bc64d' 2024-04-24T13:17:13.722 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-04-24T13:17:13.722 INFO:teuthology.packaging:ref: None 2024-04-24T13:17:13.722 INFO:teuthology.packaging:tag: None 2024-04-24T13:17:13.722 INFO:teuthology.packaging:branch: wip-cbodley-testing 2024-04-24T13:17:13.722 INFO:teuthology.packaging:sha1: 882080b304cb1602e69c11bc5fe8479e7d2bc64d 2024-04-24T13:17:13.723 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&ref=wip-cbodley-testing 2024-04-24T13:17:13.865 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-3241-g882080b3-1jammy 2024-04-24T13:17:13.867 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-04-24T13:17:13.873 INFO:teuthology.task.internal:no buildpackages task found 2024-04-24T13:17:13.873 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-04-24T13:17:13.897 INFO:teuthology.task.internal:Saving configuration 2024-04-24T13:17:13.911 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-04-24T13:17:13.922 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-04-24T13:17:13.945 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi071.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 13:11:31.079381', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIO/0gdqcwHErMYIhCv8yl+7J484wSEOmI4nioV7P0C99'} 2024-04-24T13:17:13.969 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi138.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'ubuntu', 'os_version': '22.04', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-04-24 13:11:31.080980', 'locked_by': 'scheduled_cbodley@teuthology', 'mac_address': None, 'ssh_pub_key': 'ssh-ed25519 AAAAC3NzaC1lZDI1NTE5AAAAIIVhFfv9wP1rXmKZkuQqmRT5AXC/qTJgp08amff6u/lL'} 2024-04-24T13:17:13.970 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-04-24T13:17:13.976 INFO:teuthology.task.internal:roles: ubuntu@smithi071.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'] 2024-04-24T13:17:13.976 INFO:teuthology.task.internal:roles: ubuntu@smithi138.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b'] 2024-04-24T13:17:13.976 INFO:teuthology.run_tasks:Running task console_log... 2024-04-24T13:17:14.069 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f1472dfb280>, signals=[15]) 2024-04-24T13:17:14.069 INFO:teuthology.run_tasks:Running task internal.connect... 2024-04-24T13:17:14.076 INFO:teuthology.task.internal:Opening connections... 2024-04-24T13:17:14.076 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi071.front.sepia.ceph.com 2024-04-24T13:17:14.078 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T13:17:14.162 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi138.front.sepia.ceph.com 2024-04-24T13:17:14.163 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T13:17:14.243 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-04-24T13:17:14.250 DEBUG:teuthology.orchestra.run.smithi071:> uname -m 2024-04-24T13:17:14.255 INFO:teuthology.orchestra.run.smithi071.stdout:x86_64 2024-04-24T13:17:14.256 DEBUG:teuthology.orchestra.run.smithi071:> cat /etc/os-release 2024-04-24T13:17:14.302 INFO:teuthology.orchestra.run.smithi071.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-24T13:17:14.302 INFO:teuthology.orchestra.run.smithi071.stdout:NAME="Ubuntu" 2024-04-24T13:17:14.302 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_ID="22.04" 2024-04-24T13:17:14.302 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-24T13:17:14.302 INFO:teuthology.orchestra.run.smithi071.stdout:VERSION_CODENAME=jammy 2024-04-24T13:17:14.302 INFO:teuthology.orchestra.run.smithi071.stdout:ID=ubuntu 2024-04-24T13:17:14.302 INFO:teuthology.orchestra.run.smithi071.stdout:ID_LIKE=debian 2024-04-24T13:17:14.303 INFO:teuthology.orchestra.run.smithi071.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-24T13:17:14.303 INFO:teuthology.orchestra.run.smithi071.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-24T13:17:14.303 INFO:teuthology.orchestra.run.smithi071.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-24T13:17:14.303 INFO:teuthology.orchestra.run.smithi071.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-24T13:17:14.303 INFO:teuthology.orchestra.run.smithi071.stdout:UBUNTU_CODENAME=jammy 2024-04-24T13:17:14.303 INFO:teuthology.lock.ops:Updating smithi071.front.sepia.ceph.com on lock server 2024-04-24T13:17:14.326 DEBUG:teuthology.orchestra.run.smithi138:> uname -m 2024-04-24T13:17:14.331 INFO:teuthology.orchestra.run.smithi138.stdout:x86_64 2024-04-24T13:17:14.332 DEBUG:teuthology.orchestra.run.smithi138:> cat /etc/os-release 2024-04-24T13:17:14.382 INFO:teuthology.orchestra.run.smithi138.stdout:PRETTY_NAME="Ubuntu 22.04.1 LTS" 2024-04-24T13:17:14.382 INFO:teuthology.orchestra.run.smithi138.stdout:NAME="Ubuntu" 2024-04-24T13:17:14.383 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_ID="22.04" 2024-04-24T13:17:14.383 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION="22.04.1 LTS (Jammy Jellyfish)" 2024-04-24T13:17:14.383 INFO:teuthology.orchestra.run.smithi138.stdout:VERSION_CODENAME=jammy 2024-04-24T13:17:14.383 INFO:teuthology.orchestra.run.smithi138.stdout:ID=ubuntu 2024-04-24T13:17:14.383 INFO:teuthology.orchestra.run.smithi138.stdout:ID_LIKE=debian 2024-04-24T13:17:14.383 INFO:teuthology.orchestra.run.smithi138.stdout:HOME_URL="https://www.ubuntu.com/" 2024-04-24T13:17:14.383 INFO:teuthology.orchestra.run.smithi138.stdout:SUPPORT_URL="https://help.ubuntu.com/" 2024-04-24T13:17:14.383 INFO:teuthology.orchestra.run.smithi138.stdout:BUG_REPORT_URL="https://bugs.launchpad.net/ubuntu/" 2024-04-24T13:17:14.383 INFO:teuthology.orchestra.run.smithi138.stdout:PRIVACY_POLICY_URL="https://www.ubuntu.com/legal/terms-and-policies/privacy-policy" 2024-04-24T13:17:14.383 INFO:teuthology.orchestra.run.smithi138.stdout:UBUNTU_CODENAME=jammy 2024-04-24T13:17:14.383 INFO:teuthology.lock.ops:Updating smithi138.front.sepia.ceph.com on lock server 2024-04-24T13:17:14.409 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-04-24T13:17:14.418 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-04-24T13:17:14.447 INFO:teuthology.task.internal:Checking for old test directory... 2024-04-24T13:17:14.447 DEBUG:teuthology.orchestra.run.smithi071:> test '!' -e /home/ubuntu/cephtest 2024-04-24T13:17:14.450 DEBUG:teuthology.orchestra.run.smithi138:> test '!' -e /home/ubuntu/cephtest 2024-04-24T13:17:14.455 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-04-24T13:17:14.471 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-04-24T13:17:14.472 DEBUG:teuthology.orchestra.run.smithi071:> test -z $(ls -A /var/lib/ceph) 2024-04-24T13:17:14.500 DEBUG:teuthology.orchestra.run.smithi138:> test -z $(ls -A /var/lib/ceph) 2024-04-24T13:17:14.541 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-04-24T13:17:14.619 INFO:teuthology.run_tasks:Running task kernel... 2024-04-24T13:17:14.634 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-04-24T13:17:14.634 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': True, 'sha1': 'distro'}, 'mon.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-04-24T13:17:14.635 DEBUG:teuthology.orchestra.run.smithi071:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T13:17:14.635 DEBUG:teuthology.orchestra.run.smithi138:> test -f /run/.containerenv -o -f /.dockerenv 2024-04-24T13:17:14.640 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T13:17:14.640 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-04-24T13:17:14.641 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T13:17:14.642 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-04-24T13:17:14.686 INFO:teuthology.orchestra.run.smithi071.stdout:5.15.0-56-generic 2024-04-24T13:17:14.687 INFO:teuthology.task.kernel:Running kernel on smithi071: 5.15.0-56-generic 2024-04-24T13:17:14.687 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get clean 2024-04-24T13:17:14.688 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-56-generic 2024-04-24T13:17:14.688 INFO:teuthology.task.kernel:Running kernel on smithi138: 5.15.0-56-generic 2024-04-24T13:17:14.688 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2024-04-24T13:17:14.805 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get update 2024-04-24T13:17:14.827 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-04-24T13:17:14.969 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T13:17:14.969 INFO:teuthology.orchestra.run.smithi071.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-24T13:17:14.969 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-24T13:17:14.988 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T13:17:14.988 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://security.ubuntu.com/ubuntu jammy-security InRelease [110 kB] 2024-04-24T13:17:14.992 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease [119 kB] 2024-04-24T13:17:15.062 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-24T13:17:15.082 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease [109 kB] 2024-04-24T13:17:15.216 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,392 kB] 2024-04-24T13:17:15.230 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-24T13:17:15.285 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-24T13:17:15.301 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-24T13:17:15.311 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main amd64 Packages [1,392 kB] 2024-04-24T13:17:15.335 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 http://security.ubuntu.com/ubuntu jammy-security/main i386 Packages [452 kB] 2024-04-24T13:17:15.342 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-24T13:17:15.346 INFO:teuthology.orchestra.run.smithi071.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-24T13:17:15.347 INFO:teuthology.orchestra.run.smithi071.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-24T13:17:15.347 INFO:teuthology.orchestra.run.smithi071.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,768 kB] 2024-04-24T13:17:15.373 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://security.ubuntu.com/ubuntu jammy-security/main Translation-en [243 kB] 2024-04-24T13:17:15.378 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://security.ubuntu.com/ubuntu jammy-security/main amd64 c-n-f Metadata [11.4 kB] 2024-04-24T13:17:15.380 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://security.ubuntu.com/ubuntu jammy-security/restricted i386 Packages [36.5 kB] 2024-04-24T13:17:15.381 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 Packages [1,768 kB] 2024-04-24T13:17:15.388 INFO:teuthology.orchestra.run.smithi071.stdout:Get:12 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [299 kB] 2024-04-24T13:17:15.392 INFO:teuthology.orchestra.run.smithi071.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T13:17:15.392 INFO:teuthology.orchestra.run.smithi071.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-24T13:17:15.405 INFO:teuthology.orchestra.run.smithi071.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-24T13:17:15.407 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 Packages [1,610 kB] 2024-04-24T13:17:15.423 INFO:teuthology.orchestra.run.smithi071.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-24T13:17:15.425 INFO:teuthology.orchestra.run.smithi071.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-24T13:17:15.429 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://security.ubuntu.com/ubuntu jammy-security/restricted Translation-en [299 kB] 2024-04-24T13:17:15.434 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://security.ubuntu.com/ubuntu jammy-security/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T13:17:15.435 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://security.ubuntu.com/ubuntu jammy-security/universe i386 Packages [601 kB] 2024-04-24T13:17:15.439 INFO:teuthology.orchestra.run.smithi071.stdout:Get:18 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-24T13:17:15.439 INFO:teuthology.orchestra.run.smithi071.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy-updates/main i386 Packages [618 kB] 2024-04-24T13:17:15.439 INFO:teuthology.orchestra.run.smithi071.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-24T13:17:15.440 INFO:teuthology.orchestra.run.smithi071.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-24T13:17:15.446 INFO:teuthology.orchestra.run.smithi071.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-24T13:17:15.455 INFO:teuthology.orchestra.run.smithi071.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-24T13:17:15.456 INFO:teuthology.orchestra.run.smithi071.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-24T13:17:15.465 INFO:teuthology.orchestra.run.smithi071.stdout:Get:25 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-24T13:17:15.479 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 Packages [848 kB] 2024-04-24T13:17:15.490 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://security.ubuntu.com/ubuntu jammy-security/universe Translation-en [163 kB] 2024-04-24T13:17:15.491 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/main Translation-en [303 kB] 2024-04-24T13:17:15.492 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://security.ubuntu.com/ubuntu jammy-security/universe amd64 c-n-f Metadata [16.8 kB] 2024-04-24T13:17:15.492 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 Packages [37.2 kB] 2024-04-24T13:17:15.497 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://security.ubuntu.com/ubuntu jammy-security/multiverse i386 Packages [1,356 B] 2024-04-24T13:17:15.497 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://security.ubuntu.com/ubuntu jammy-security/multiverse Translation-en [7,588 B] 2024-04-24T13:17:15.499 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 c-n-f Metadata [16.1 kB] 2024-04-24T13:17:15.499 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 http://security.ubuntu.com/ubuntu jammy-security/multiverse amd64 c-n-f Metadata [260 B] 2024-04-24T13:17:15.500 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-24T13:17:15.500 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 Packages [1,830 kB] 2024-04-24T13:17:15.508 INFO:teuthology.orchestra.run.smithi071.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy-updates/restricted i386 Packages [38.1 kB] 2024-04-24T13:17:15.509 INFO:teuthology.orchestra.run.smithi071.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-24T13:17:15.513 INFO:teuthology.orchestra.run.smithi071.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T13:17:15.513 INFO:teuthology.orchestra.run.smithi071.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-24T13:17:15.529 INFO:teuthology.orchestra.run.smithi071.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-24T13:17:15.540 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy-updates/restricted Translation-en [311 kB] 2024-04-24T13:17:15.542 INFO:teuthology.orchestra.run.smithi071.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-24T13:17:15.546 INFO:teuthology.orchestra.run.smithi071.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-24T13:17:15.546 INFO:teuthology.orchestra.run.smithi071.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-24T13:17:15.547 INFO:teuthology.orchestra.run.smithi071.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-24T13:17:15.550 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/restricted amd64 c-n-f Metadata [520 B] 2024-04-24T13:17:15.551 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 Packages [1,070 kB] 2024-04-24T13:17:15.564 INFO:teuthology.orchestra.run.smithi071.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-24T13:17:15.565 INFO:teuthology.orchestra.run.smithi071.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-24T13:17:15.565 INFO:teuthology.orchestra.run.smithi071.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-24T13:17:15.566 INFO:teuthology.orchestra.run.smithi071.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-24T13:17:15.573 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy-updates/universe i386 Packages [700 kB] 2024-04-24T13:17:15.580 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy-updates/universe Translation-en [244 kB] 2024-04-24T13:17:15.582 INFO:teuthology.orchestra.run.smithi071.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-24T13:17:15.583 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 c-n-f Metadata [22.1 kB] 2024-04-24T13:17:15.583 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 Packages [42.7 kB] 2024-04-24T13:17:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-24T13:17:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-24T13:17:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-24T13:17:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-24T13:17:15.585 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse i386 Packages [4,472 B] 2024-04-24T13:17:15.585 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse Translation-en [10.4 kB] 2024-04-24T13:17:15.586 INFO:teuthology.orchestra.run.smithi071.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-24T13:17:15.590 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy-updates/multiverse amd64 c-n-f Metadata [472 B] 2024-04-24T13:17:15.590 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy-backports/main i386 Packages [59.2 kB] 2024-04-24T13:17:15.591 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 Packages [67.1 kB] 2024-04-24T13:17:15.605 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy-backports/main Translation-en [11.0 kB] 2024-04-24T13:17:15.605 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy-backports/main amd64 c-n-f Metadata [388 B] 2024-04-24T13:17:15.605 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy-backports/universe i386 Packages [16.0 kB] 2024-04-24T13:17:15.605 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 Packages [27.2 kB] 2024-04-24T13:17:15.606 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy-backports/universe Translation-en [16.2 kB] 2024-04-24T13:17:15.609 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy-backports/universe amd64 c-n-f Metadata [644 B] 2024-04-24T13:17:21.031 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 13.2 MB in 2s (7,120 kB/s) 2024-04-24T13:17:21.434 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 13.2 MB in 2s (6,873 kB/s) 2024-04-24T13:17:22.410 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-04-24T13:17:22.428 DEBUG:teuthology.orchestra.run.smithi071:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T13:17:22.482 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-04-24T13:17:22.659 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2024-04-24T13:17:22.659 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2024-04-24T13:17:22.812 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T13:17:22.812 INFO:teuthology.orchestra.run.smithi071.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T13:17:22.812 INFO:teuthology.orchestra.run.smithi071.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T13:17:22.812 INFO:teuthology.orchestra.run.smithi071.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T13:17:22.812 INFO:teuthology.orchestra.run.smithi071.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-24T13:17:22.812 INFO:teuthology.orchestra.run.smithi071.stdout: python2.7-minimal 2024-04-24T13:17:22.812 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T13:17:22.814 INFO:teuthology.orchestra.run.smithi071.stdout:The following additional packages will be installed: 2024-04-24T13:17:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T13:17:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-24T13:17:22.814 INFO:teuthology.orchestra.run.smithi071.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-24T13:17:22.815 INFO:teuthology.orchestra.run.smithi071.stdout:Suggested packages: 2024-04-24T13:17:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-24T13:17:22.815 INFO:teuthology.orchestra.run.smithi071.stdout:Recommended packages: 2024-04-24T13:17:22.815 INFO:teuthology.orchestra.run.smithi071.stdout: thermald 2024-04-24T13:17:22.859 INFO:teuthology.orchestra.run.smithi071.stdout:The following NEW packages will be installed: 2024-04-24T13:17:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T13:17:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-24T13:17:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-24T13:17:22.860 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages will be upgraded: 2024-04-24T13:17:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-24T13:17:22.906 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-24T13:17:22.924 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T13:17:22.947 INFO:teuthology.orchestra.run.smithi071.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T13:17:22.947 INFO:teuthology.orchestra.run.smithi071.stdout:Need to get 113 MB of archives. 2024-04-24T13:17:22.948 INFO:teuthology.orchestra.run.smithi071.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-24T13:17:22.948 INFO:teuthology.orchestra.run.smithi071.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-24T13:17:22.979 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-24T13:17:23.174 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-04-24T13:17:23.174 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-04-24T13:17:23.330 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T13:17:23.330 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T13:17:23.330 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T13:17:23.330 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T13:17:23.330 INFO:teuthology.orchestra.run.smithi138.stdout: python2 python2-dev python2-minimal python2.7 python2.7-dev 2024-04-24T13:17:23.330 INFO:teuthology.orchestra.run.smithi138.stdout: python2.7-minimal 2024-04-24T13:17:23.330 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T13:17:23.331 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-04-24T13:17:23.331 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T13:17:23.331 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-generic linux-image-5.15.0-105-generic 2024-04-24T13:17:23.332 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-5.15.0-105-generic linux-modules-extra-5.15.0-105-generic 2024-04-24T13:17:23.333 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-04-24T13:17:23.333 INFO:teuthology.orchestra.run.smithi138.stdout: fdutils linux-doc | linux-source-5.15.0 linux-tools 2024-04-24T13:17:23.333 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2024-04-24T13:17:23.333 INFO:teuthology.orchestra.run.smithi138.stdout: thermald 2024-04-24T13:17:23.377 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-04-24T13:17:23.377 INFO:teuthology.orchestra.run.smithi138.stdout: linux-headers-5.15.0-105 linux-headers-5.15.0-105-generic 2024-04-24T13:17:23.377 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.15.0-105-generic linux-modules-5.15.0-105-generic 2024-04-24T13:17:23.377 INFO:teuthology.orchestra.run.smithi138.stdout: linux-modules-extra-5.15.0-105-generic 2024-04-24T13:17:23.378 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages will be upgraded: 2024-04-24T13:17:23.378 INFO:teuthology.orchestra.run.smithi138.stdout: linux-generic linux-headers-generic linux-image-generic 2024-04-24T13:17:23.556 INFO:teuthology.orchestra.run.smithi138.stdout:3 upgraded, 5 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T13:17:23.556 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 113 MB of archives. 2024-04-24T13:17:23.556 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 583 MB of additional disk space will be used. 2024-04-24T13:17:23.557 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-5.15.0-105-generic amd64 5.15.0-105.115 [22.7 MB] 2024-04-24T13:17:23.596 INFO:teuthology.orchestra.run.smithi071.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-24T13:17:23.782 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-24T13:17:25.049 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-5.15.0-105-generic amd64 5.15.0-105.115 [11.5 MB] 2024-04-24T13:17:25.401 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-modules-extra-5.15.0-105-generic amd64 5.15.0-105.115 [63.9 MB] 2024-04-24T13:17:25.505 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-24T13:17:25.505 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-24T13:17:25.506 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-24T13:17:25.751 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-24T13:17:25.830 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-24T13:17:26.224 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 113 MB in 3s (38.2 MB/s) 2024-04-24T13:17:26.384 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-24T13:17:27.679 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-generic amd64 5.15.0.105.102 [1,694 B] 2024-04-24T13:17:27.679 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-image-generic amd64 5.15.0.105.102 [2,530 B] 2024-04-24T13:17:27.680 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105 all 5.15.0-105.115 [12.3 MB] 2024-04-24T13:17:28.369 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-24T13:17:28.373 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T13:17:28.447 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:28.557 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-5.15.0-105-generic amd64 5.15.0-105.115 [2,857 kB] 2024-04-24T13:17:28.648 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 linux-headers-generic amd64 5.15.0.105.102 [2,382 B] 2024-04-24T13:17:29.058 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 113 MB in 5s (21.5 MB/s) 2024-04-24T13:17:29.240 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-5.15.0-105-generic. 2024-04-24T13:17:31.040 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-24T13:17:31.061 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T13:17:31.148 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:31.310 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 129542 files and directories currently installed.) 2024-04-24T13:17:31.314 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../0-linux-modules-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T13:17:31.487 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:31.601 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-24T13:17:31.622 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T13:17:31.651 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:33.871 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-image-5.15.0-105-generic. 2024-04-24T13:17:33.893 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../1-linux-image-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T13:17:33.986 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:34.475 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-modules-extra-5.15.0-105-generic. 2024-04-24T13:17:34.496 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../2-linux-modules-extra-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T13:17:34.533 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:38.152 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T13:17:38.277 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T13:17:38.618 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T13:17:38.738 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T13:17:39.041 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-24T13:17:39.064 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-24T13:17:39.099 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T13:17:40.741 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../3-linux-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T13:17:40.843 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T13:17:41.201 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../4-linux-image-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T13:17:41.346 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-image-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T13:17:41.649 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-105. 2024-04-24T13:17:41.671 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../5-linux-headers-5.15.0-105_5.15.0-105.115_all.deb ... 2024-04-24T13:17:41.716 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T13:17:44.473 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-24T13:17:44.509 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T13:17:44.547 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:47.505 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package linux-headers-5.15.0-105-generic. 2024-04-24T13:17:47.543 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../6-linux-headers-5.15.0-105-generic_5.15.0-105.115_amd64.deb ... 2024-04-24T13:17:47.589 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:47.726 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T13:17:47.849 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T13:17:48.173 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T13:17:48.294 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:48.421 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-24T13:17:48.551 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:49.853 INFO:teuthology.orchestra.run.smithi071.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-24T13:17:49.853 INFO:teuthology.orchestra.run.smithi071.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-24T13:17:49.853 INFO:teuthology.orchestra.run.smithi071.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-24T13:17:49.854 INFO:teuthology.orchestra.run.smithi071.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-24T13:17:50.017 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:50.163 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../7-linux-headers-generic_5.15.0.105.102_amd64.deb ... 2024-04-24T13:17:50.261 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking linux-headers-generic (5.15.0.105.102) over (5.15.0.56.54) ... 2024-04-24T13:17:51.453 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-105 (5.15.0-105.115) ... 2024-04-24T13:17:51.570 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:51.575 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:51.701 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-headers-generic (5.15.0.105.102) ... 2024-04-24T13:17:51.829 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:52.978 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-24T13:17:53.104 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-24T13:17:53.206 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz.old is now a symlink to boot/vmlinuz-5.15.0-56-generic 2024-04-24T13:17:53.206 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img.old is now a symlink to boot/initrd.img-5.15.0-56-generic 2024-04-24T13:17:53.206 INFO:teuthology.orchestra.run.smithi138.stdout:I: /vmlinuz is now a symlink to boot/vmlinuz-5.15.0-105-generic 2024-04-24T13:17:53.206 INFO:teuthology.orchestra.run.smithi138.stdout:I: /initrd.img is now a symlink to boot/initrd.img-5.15.0-105-generic 2024-04-24T13:17:53.231 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:53.296 INFO:teuthology.orchestra.run.smithi071.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-24T13:17:53.296 INFO:teuthology.orchestra.run.smithi071.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-24T13:17:53.374 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:54.760 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-modules-extra-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:56.160 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-image-generic (5.15.0.105.102) ... 2024-04-24T13:17:56.286 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up linux-generic (5.15.0.105.102) ... 2024-04-24T13:17:56.413 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for linux-image-5.15.0-105-generic (5.15.0-105.115) ... 2024-04-24T13:17:57.138 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/initramfs-tools: 2024-04-24T13:17:57.138 INFO:teuthology.orchestra.run.smithi138.stdout:update-initramfs: Generating /boot/initrd.img-5.15.0-105-generic 2024-04-24T13:18:07.524 INFO:teuthology.orchestra.run.smithi071.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-24T13:18:07.524 INFO:teuthology.orchestra.run.smithi071.stdout:Sourcing file `/etc/default/grub' 2024-04-24T13:18:07.544 INFO:teuthology.orchestra.run.smithi071.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T13:18:07.570 INFO:teuthology.orchestra.run.smithi071.stdout:Generating grub configuration file ... 2024-04-24T13:18:07.816 INFO:teuthology.orchestra.run.smithi071.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T13:18:07.831 INFO:teuthology.orchestra.run.smithi071.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T13:18:08.101 INFO:teuthology.orchestra.run.smithi071.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T13:18:08.107 INFO:teuthology.orchestra.run.smithi071.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T13:18:08.177 INFO:teuthology.orchestra.run.smithi071.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T13:18:08.183 INFO:teuthology.orchestra.run.smithi071.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T13:18:08.328 INFO:teuthology.orchestra.run.smithi071.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T13:18:08.329 INFO:teuthology.orchestra.run.smithi071.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T13:18:08.329 INFO:teuthology.orchestra.run.smithi071.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T13:18:08.385 INFO:teuthology.orchestra.run.smithi071.stdout:done 2024-04-24T13:18:08.857 DEBUG:teuthology.orchestra.run.smithi071:> dpkg -s linux-image-generic 2024-04-24T13:18:08.881 INFO:teuthology.orchestra.run.smithi071.stdout:Package: linux-image-generic 2024-04-24T13:18:08.881 INFO:teuthology.orchestra.run.smithi071.stdout:Status: install ok installed 2024-04-24T13:18:08.881 INFO:teuthology.orchestra.run.smithi071.stdout:Priority: optional 2024-04-24T13:18:08.882 INFO:teuthology.orchestra.run.smithi071.stdout:Section: kernel 2024-04-24T13:18:08.882 INFO:teuthology.orchestra.run.smithi071.stdout:Installed-Size: 21 2024-04-24T13:18:08.882 INFO:teuthology.orchestra.run.smithi071.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T13:18:08.882 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: amd64 2024-04-24T13:18:08.882 INFO:teuthology.orchestra.run.smithi071.stdout:Source: linux-meta 2024-04-24T13:18:08.882 INFO:teuthology.orchestra.run.smithi071.stdout:Version: 5.15.0.105.102 2024-04-24T13:18:08.882 INFO:teuthology.orchestra.run.smithi071.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T13:18:08.883 INFO:teuthology.orchestra.run.smithi071.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T13:18:08.883 INFO:teuthology.orchestra.run.smithi071.stdout:Recommends: thermald 2024-04-24T13:18:08.883 INFO:teuthology.orchestra.run.smithi071.stdout:Description: Generic Linux kernel image 2024-04-24T13:18:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: This package will always depend on the latest generic kernel image 2024-04-24T13:18:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: available. 2024-04-24T13:18:08.884 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-24T13:18:08.884 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-24T13:18:08.884 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-24T13:18:08.884 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-04-24T13:18:08.885 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi071.front.sepia.ceph.com, path=None, version=distro) 2024-04-24T13:18:08.885 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get clean 2024-04-24T13:18:09.060 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get update 2024-04-24T13:18:09.308 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T13:18:09.308 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:2 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T13:18:09.378 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T13:18:09.460 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T13:18:10.681 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-04-24T13:18:10.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T13:18:10.749 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-04-24T13:18:10.925 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2024-04-24T13:18:10.925 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2024-04-24T13:18:11.081 INFO:teuthology.orchestra.run.smithi071.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-24T13:18:11.081 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T13:18:11.081 INFO:teuthology.orchestra.run.smithi071.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T13:18:11.081 INFO:teuthology.orchestra.run.smithi071.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T13:18:11.081 INFO:teuthology.orchestra.run.smithi071.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T13:18:11.082 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T13:18:11.082 INFO:teuthology.orchestra.run.smithi071.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T13:18:11.082 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T13:18:11.119 INFO:teuthology.orchestra.run.smithi071.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T13:18:11.120 DEBUG:teuthology.orchestra.run.smithi071:> dpkg -s linux-image-generic 2024-04-24T13:18:11.176 INFO:teuthology.orchestra.run.smithi071.stdout:Package: linux-image-generic 2024-04-24T13:18:11.176 INFO:teuthology.orchestra.run.smithi071.stdout:Status: install ok installed 2024-04-24T13:18:11.176 INFO:teuthology.orchestra.run.smithi071.stdout:Priority: optional 2024-04-24T13:18:11.176 INFO:teuthology.orchestra.run.smithi071.stdout:Section: kernel 2024-04-24T13:18:11.176 INFO:teuthology.orchestra.run.smithi071.stdout:Installed-Size: 21 2024-04-24T13:18:11.176 INFO:teuthology.orchestra.run.smithi071.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T13:18:11.176 INFO:teuthology.orchestra.run.smithi071.stdout:Architecture: amd64 2024-04-24T13:18:11.176 INFO:teuthology.orchestra.run.smithi071.stdout:Source: linux-meta 2024-04-24T13:18:11.177 INFO:teuthology.orchestra.run.smithi071.stdout:Version: 5.15.0.105.102 2024-04-24T13:18:11.177 INFO:teuthology.orchestra.run.smithi071.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T13:18:11.177 INFO:teuthology.orchestra.run.smithi071.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T13:18:11.177 INFO:teuthology.orchestra.run.smithi071.stdout:Recommends: thermald 2024-04-24T13:18:11.177 INFO:teuthology.orchestra.run.smithi071.stdout:Description: Generic Linux kernel image 2024-04-24T13:18:11.177 INFO:teuthology.orchestra.run.smithi071.stdout: This package will always depend on the latest generic kernel image 2024-04-24T13:18:11.177 INFO:teuthology.orchestra.run.smithi071.stdout: available. 2024-04-24T13:18:11.177 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-04-24T13:18:11.222 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.XijvBzlZ5F 2024-04-24T13:18:11.222 DEBUG:teuthology.orchestra.run.smithi071:> sudo cp /boot/grub/grub.cfg /tmp/tmp.XijvBzlZ5F 2024-04-24T13:18:11.278 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.XijvBzlZ5F 2024-04-24T13:18:11.394 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.XijvBzlZ5F is 10KB 2024-04-24T13:18:11.407 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.XijvBzlZ5F 2024-04-24T13:18:11.413 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-24T13:18:11.465 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:18:11.465 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-24T13:18:11.465 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-24T13:18:11.478 INFO:teuthology.orchestra.run.smithi138.stdout:/etc/kernel/postinst.d/zz-update-grub: 2024-04-24T13:18:11.478 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub' 2024-04-24T13:18:11.498 INFO:teuthology.orchestra.run.smithi138.stdout:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T13:18:11.517 INFO:teuthology.orchestra.run.smithi138.stdout:Generating grub configuration file ... 2024-04-24T13:18:11.544 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-24T13:18:11.544 DEBUG:teuthology.orchestra.run.smithi071:> sudo update-grub 2024-04-24T13:18:11.884 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T13:18:11.898 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T13:18:12.314 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T13:18:12.319 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T13:18:12.385 INFO:teuthology.orchestra.run.smithi138.stdout:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T13:18:12.390 INFO:teuthology.orchestra.run.smithi138.stdout:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T13:18:12.541 INFO:teuthology.orchestra.run.smithi138.stdout:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T13:18:12.541 INFO:teuthology.orchestra.run.smithi138.stdout:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T13:18:12.541 INFO:teuthology.orchestra.run.smithi138.stdout:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T13:18:12.586 INFO:teuthology.orchestra.run.smithi138.stdout:done 2024-04-24T13:18:12.710 INFO:teuthology.orchestra.run.smithi071.stderr:Sourcing file `/etc/default/grub' 2024-04-24T13:18:12.711 INFO:teuthology.orchestra.run.smithi071.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T13:18:12.714 INFO:teuthology.orchestra.run.smithi071.stderr:Generating grub configuration file ... 2024-04-24T13:18:12.883 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T13:18:12.888 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T13:18:13.078 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2024-04-24T13:18:13.098 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2024-04-24T13:18:13.098 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2024-04-24T13:18:13.098 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2024-04-24T13:18:13.098 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2024-04-24T13:18:13.098 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 21 2024-04-24T13:18:13.098 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T13:18:13.098 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2024-04-24T13:18:13.098 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2024-04-24T13:18:13.098 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.105.102 2024-04-24T13:18:13.099 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T13:18:13.099 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T13:18:13.099 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2024-04-24T13:18:13.099 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2024-04-24T13:18:13.099 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2024-04-24T13:18:13.099 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2024-04-24T13:18:13.099 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.15.0-56-generic Expected: 5.15.0-105-generic 2024-04-24T13:18:13.099 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-04-24T13:18:13.099 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-04-24T13:18:13.099 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-04-24T13:18:13.099 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi138.front.sepia.ceph.com, path=None, version=distro) 2024-04-24T13:18:13.100 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get clean 2024-04-24T13:18:13.107 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T13:18:13.113 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T13:18:13.155 INFO:teuthology.orchestra.run.smithi071.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T13:18:13.160 INFO:teuthology.orchestra.run.smithi071.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T13:18:13.282 INFO:teuthology.orchestra.run.smithi071.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T13:18:13.282 INFO:teuthology.orchestra.run.smithi071.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T13:18:13.283 INFO:teuthology.orchestra.run.smithi071.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T13:18:13.294 INFO:teuthology.orchestra.run.smithi071.stderr:done 2024-04-24T13:18:13.312 DEBUG:teuthology.orchestra.run.smithi071:> sudo shutdown -r now 2024-04-24T13:18:13.319 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-04-24T13:18:13.482 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T13:18:13.500 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T13:18:13.531 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T13:18:13.571 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T13:18:14.855 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-24T13:18:14.873 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y install linux-image-generic 2024-04-24T13:18:14.936 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-24T13:18:15.136 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-04-24T13:18:15.137 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-04-24T13:18:15.314 INFO:teuthology.orchestra.run.smithi138.stdout:linux-image-generic is already the newest version (5.15.0.105.102). 2024-04-24T13:18:15.315 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T13:18:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T13:18:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T13:18:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T13:18:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T13:18:15.315 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T13:18:15.316 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T13:18:15.359 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 0 newly installed, 0 to remove and 315 not upgraded. 2024-04-24T13:18:15.361 DEBUG:teuthology.orchestra.run.smithi138:> dpkg -s linux-image-generic 2024-04-24T13:18:15.377 INFO:teuthology.orchestra.run.smithi138.stdout:Package: linux-image-generic 2024-04-24T13:18:15.377 INFO:teuthology.orchestra.run.smithi138.stdout:Status: install ok installed 2024-04-24T13:18:15.377 INFO:teuthology.orchestra.run.smithi138.stdout:Priority: optional 2024-04-24T13:18:15.377 INFO:teuthology.orchestra.run.smithi138.stdout:Section: kernel 2024-04-24T13:18:15.377 INFO:teuthology.orchestra.run.smithi138.stdout:Installed-Size: 21 2024-04-24T13:18:15.377 INFO:teuthology.orchestra.run.smithi138.stdout:Maintainer: Ubuntu Kernel Team 2024-04-24T13:18:15.377 INFO:teuthology.orchestra.run.smithi138.stdout:Architecture: amd64 2024-04-24T13:18:15.377 INFO:teuthology.orchestra.run.smithi138.stdout:Source: linux-meta 2024-04-24T13:18:15.377 INFO:teuthology.orchestra.run.smithi138.stdout:Version: 5.15.0.105.102 2024-04-24T13:18:15.378 INFO:teuthology.orchestra.run.smithi138.stdout:Provides: spl-modules (= 2.1.5-1ubuntu6~22.04.3), v4l2loopback-modules (= 0.12.7-2ubuntu2~22.04.1), virtualbox-guest-modules (= 5.15.0-105), wireguard-modules (= 1.0.0), zfs-modules (= 2.1.5-1ubuntu6~22.04.3) 2024-04-24T13:18:15.378 INFO:teuthology.orchestra.run.smithi138.stdout:Depends: linux-image-5.15.0-105-generic, linux-modules-extra-5.15.0-105-generic, linux-firmware, intel-microcode, amd64-microcode 2024-04-24T13:18:15.378 INFO:teuthology.orchestra.run.smithi138.stdout:Recommends: thermald 2024-04-24T13:18:15.378 INFO:teuthology.orchestra.run.smithi138.stdout:Description: Generic Linux kernel image 2024-04-24T13:18:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: This package will always depend on the latest generic kernel image 2024-04-24T13:18:15.378 INFO:teuthology.orchestra.run.smithi138.stdout: available. 2024-04-24T13:18:15.378 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-04-24T13:18:15.422 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.mYBscq9P1p 2024-04-24T13:18:15.423 DEBUG:teuthology.orchestra.run.smithi138:> sudo cp /boot/grub/grub.cfg /tmp/tmp.mYBscq9P1p 2024-04-24T13:18:15.487 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.mYBscq9P1p 2024-04-24T13:18:15.612 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.mYBscq9P1p is 10KB 2024-04-24T13:18:15.625 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.mYBscq9P1p 2024-04-24T13:18:15.631 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/grub.d/01_ceph_kernel 2024-04-24T13:18:15.686 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:18:15.686 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/grub.d/01_ceph_kernel 2024-04-24T13:18:15.686 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 755 /etc/grub.d/01_ceph_kernel 2024-04-24T13:18:15.753 INFO:teuthology.task.kernel:Distro Kernel Version: 5.15.0-105-generic 2024-04-24T13:18:15.753 DEBUG:teuthology.orchestra.run.smithi138:> sudo update-grub 2024-04-24T13:18:16.991 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub' 2024-04-24T13:18:16.992 INFO:teuthology.orchestra.run.smithi138.stderr:Sourcing file `/etc/default/grub.d/init-select.cfg' 2024-04-24T13:18:16.998 INFO:teuthology.orchestra.run.smithi138.stderr:Generating grub configuration file ... 2024-04-24T13:18:17.178 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-105-generic 2024-04-24T13:18:17.185 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-105-generic 2024-04-24T13:18:17.491 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.15.0-56-generic 2024-04-24T13:18:17.497 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.15.0-56-generic 2024-04-24T13:18:17.541 INFO:teuthology.orchestra.run.smithi138.stderr:Found linux image: /boot/vmlinuz-5.4.0-135-generic 2024-04-24T13:18:17.547 INFO:teuthology.orchestra.run.smithi138.stderr:Found initrd image: /boot/initrd.img-5.4.0-135-generic 2024-04-24T13:18:17.681 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: os-prober will not be executed to detect other bootable partitions. 2024-04-24T13:18:17.681 INFO:teuthology.orchestra.run.smithi138.stderr:Systems on them will not be added to the GRUB boot configuration. 2024-04-24T13:18:17.682 INFO:teuthology.orchestra.run.smithi138.stderr:Check GRUB_DISABLE_OS_PROBER documentation entry. 2024-04-24T13:18:17.693 INFO:teuthology.orchestra.run.smithi138.stderr:done 2024-04-24T13:18:17.710 DEBUG:teuthology.orchestra.run.smithi138:> sudo shutdown -r now 2024-04-24T13:18:43.339 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-04-24T13:18:43.340 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-24T13:18:43.341 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T13:18:47.715 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-04-24T13:18:47.715 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-24T13:18:47.716 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T13:19:01.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-04-24T13:19:06.270 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-24T13:19:10.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-24T13:19:10.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T13:19:13.726 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-04-24T13:19:15.272 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-24T13:19:15.273 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T13:19:18.338 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-24T13:19:25.732 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-24T13:19:25.733 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T13:19:30.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-24T13:19:30.343 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T13:19:44.163 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.71 2024-04-24T13:19:48.766 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.138 2024-04-24T13:19:59.174 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-24T13:19:59.175 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T13:19:59.455 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-04-24T13:20:00.228 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-24T13:20:00.229 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.15.0-105-generic"... 2024-04-24T13:20:00.229 DEBUG:teuthology.orchestra.run.smithi071:> uname -r 2024-04-24T13:20:00.276 INFO:teuthology.orchestra.run.smithi071.stdout:5.15.0-105-generic 2024-04-24T13:20:00.276 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-24T13:20:00.276 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T13:20:00.276 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-24T13:20:01.277 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-04-24T13:20:01.278 DEBUG:teuthology.orchestra.run.smithi071:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T13:20:01.373 INFO:teuthology.orchestra.run.smithi071.stdout:ttyS1 2024-04-24T13:20:01.390 DEBUG:teuthology.parallel:result is None 2024-04-24T13:20:03.767 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-24T13:20:03.767 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T13:20:03.988 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-04-24T13:20:04.621 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-24T13:20:04.621 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.15.0-105-generic"... 2024-04-24T13:20:04.621 DEBUG:teuthology.orchestra.run.smithi138:> uname -r 2024-04-24T13:20:04.668 INFO:teuthology.orchestra.run.smithi138.stdout:5.15.0-105-generic 2024-04-24T13:20:04.668 DEBUG:teuthology.task.kernel:current kernel version is 5.15.0-105-generic vs 5.15.0-105-generic 2024-04-24T13:20:04.668 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-04-24T13:20:04.668 DEBUG:teuthology.task.kernel:Distro of this test job: ubuntu 2024-04-24T13:20:05.669 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-04-24T13:20:05.670 DEBUG:teuthology.orchestra.run.smithi138:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-04-24T13:20:06.024 INFO:teuthology.orchestra.run.smithi138.stdout:ttyS1 2024-04-24T13:20:06.050 DEBUG:teuthology.parallel:result is None 2024-04-24T13:20:06.050 INFO:teuthology.run_tasks:Running task internal.base... 2024-04-24T13:20:06.058 INFO:teuthology.task.internal:Creating test directory... 2024-04-24T13:20:06.059 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T13:20:06.061 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-04-24T13:20:06.067 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-04-24T13:20:06.095 INFO:teuthology.run_tasks:Running task internal.archive... 2024-04-24T13:20:06.128 INFO:teuthology.task.internal:Creating archive directory... 2024-04-24T13:20:06.129 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T13:20:06.131 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-04-24T13:20:06.162 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-04-24T13:20:06.169 INFO:teuthology.task.internal:Enabling coredump saving... 2024-04-24T13:20:06.169 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T13:20:06.185 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-04-24T13:20:06.209 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T13:20:06.215 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T13:20:06.218 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T13:20:06.225 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-04-24T13:20:06.227 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-04-24T13:20:06.235 INFO:teuthology.task.internal:Configuring sudo... 2024-04-24T13:20:06.236 DEBUG:teuthology.orchestra.run.smithi071:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T13:20:06.266 DEBUG:teuthology.orchestra.run.smithi138:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-04-24T13:20:06.283 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-04-24T13:20:06.292 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-04-24T13:20:06.293 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T13:20:06.321 DEBUG:teuthology.orchestra.run.smithi138:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-04-24T13:20:06.332 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T13:20:06.372 DEBUG:teuthology.orchestra.run.smithi071:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T13:20:06.421 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:20:06.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T13:20:06.486 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-04-24T13:20:06.492 DEBUG:teuthology.orchestra.run.smithi138:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-04-24T13:20:06.541 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:20:06.541 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-04-24T13:20:06.612 DEBUG:teuthology.orchestra.run.smithi071:> sudo service rsyslog restart 2024-04-24T13:20:06.615 DEBUG:teuthology.orchestra.run.smithi138:> sudo service rsyslog restart 2024-04-24T13:20:06.683 INFO:teuthology.run_tasks:Running task internal.timer... 2024-04-24T13:20:06.691 INFO:teuthology.task.internal:Starting timer... 2024-04-24T13:20:06.691 INFO:teuthology.run_tasks:Running task pcp... 2024-04-24T13:20:06.740 INFO:teuthology.run_tasks:Running task selinux... 2024-04-24T13:20:06.772 DEBUG:teuthology.task.selinux:Excluding smithi071: OS 'ubuntu' does not support SELinux 2024-04-24T13:20:06.772 DEBUG:teuthology.task.selinux:Excluding smithi138: OS 'ubuntu' does not support SELinux 2024-04-24T13:20:06.773 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-04-24T13:20:06.773 DEBUG:teuthology.task.selinux:Existing SELinux modes: {} 2024-04-24T13:20:06.773 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-04-24T13:20:06.773 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-04-24T13:20:06.808 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-04-24T13:20:06.824 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-04-24T13:20:06.838 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi071.front.sepia.ceph.com,smithi138.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-04-24T13:27:03.922 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi071.front.sepia.ceph.com'), Remote(name='ubuntu@smithi138.front.sepia.ceph.com')] 2024-04-24T13:27:03.924 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-24T13:27:03.925 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi071.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T13:27:04.005 DEBUG:teuthology.orchestra.run.smithi071:> true 2024-04-24T13:27:04.078 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi071.front.sepia.ceph.com' 2024-04-24T13:27:04.079 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-24T13:27:04.079 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi138.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-04-24T13:27:04.162 DEBUG:teuthology.orchestra.run.smithi138:> true 2024-04-24T13:27:04.242 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi138.front.sepia.ceph.com' 2024-04-24T13:27:04.242 INFO:teuthology.run_tasks:Running task clock... 2024-04-24T13:27:04.254 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-04-24T13:27:04.255 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T13:27:04.255 DEBUG:teuthology.orchestra.run.smithi071:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T13:27:04.257 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-04-24T13:27:04.258 DEBUG:teuthology.orchestra.run.smithi138:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T13:27:04.287 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-24T13:27:04.287 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: Command line: ntpd -gq 2024-04-24T13:27:04.287 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: ---------------------------------------------------- 2024-04-24T13:27:04.287 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: ntp-4 is maintained by Network Time Foundation, 2024-04-24T13:27:04.287 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-24T13:27:04.287 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: corporation. Support and training for ntp-4 are 2024-04-24T13:27:04.288 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: available at https://www.nwtime.org/support 2024-04-24T13:27:04.288 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: ---------------------------------------------------- 2024-04-24T13:27:04.288 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: proto: precision = 0.063 usec (-24) 2024-04-24T13:27:04.288 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: basedate set to 2022-02-04 2024-04-24T13:27:04.288 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: gps base set to 2022-02-06 (week 2196) 2024-04-24T13:27:04.289 INFO:teuthology.orchestra.run.smithi071.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T13:27:04.289 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T13:27:04.289 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: restrict ::: KOD does nothing without LIMITED. 2024-04-24T13:27:04.289 INFO:teuthology.orchestra.run.smithi071.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-24T13:27:04.290 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: Listen and drop on 0 v6wildcard [::]:123 2024-04-24T13:27:04.290 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-24T13:27:04.290 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: Listen normally on 2 lo 127.0.0.1:123 2024-04-24T13:27:04.291 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: Listen normally on 3 enp3s0f1 172.21.15.71:123 2024-04-24T13:27:04.291 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: Listen normally on 4 lo [::1]:123 2024-04-24T13:27:04.291 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe8f:d765%5]:123 2024-04-24T13:27:04.291 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:04 ntpd[17229]: Listening on routing socket on fd #22 for interface updates 2024-04-24T13:27:04.313 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: ntpd 4.2.8p15@1.3728-o Wed Feb 16 17:13:02 UTC 2022 (1): Starting 2024-04-24T13:27:04.313 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: Command line: ntpd -gq 2024-04-24T13:27:04.313 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: ---------------------------------------------------- 2024-04-24T13:27:04.313 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: ntp-4 is maintained by Network Time Foundation, 2024-04-24T13:27:04.313 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: Inc. (NTF), a non-profit 501(c)(3) public-benefit 2024-04-24T13:27:04.313 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: corporation. Support and training for ntp-4 are 2024-04-24T13:27:04.314 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: available at https://www.nwtime.org/support 2024-04-24T13:27:04.314 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: ---------------------------------------------------- 2024-04-24T13:27:04.314 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: proto: precision = 0.044 usec (-24) 2024-04-24T13:27:04.314 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: basedate set to 2022-02-04 2024-04-24T13:27:04.314 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: gps base set to 2022-02-06 (week 2196) 2024-04-24T13:27:04.315 INFO:teuthology.orchestra.run.smithi138.stderr:restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T13:27:04.315 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: restrict 0.0.0.0: KOD does nothing without LIMITED. 2024-04-24T13:27:04.315 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: restrict ::: KOD does nothing without LIMITED. 2024-04-24T13:27:04.315 INFO:teuthology.orchestra.run.smithi138.stderr:restrict ::: KOD does nothing without LIMITED. 2024-04-24T13:27:04.316 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: Listen and drop on 0 v6wildcard [::]:123 2024-04-24T13:27:04.317 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: Listen and drop on 1 v4wildcard 0.0.0.0:123 2024-04-24T13:27:04.317 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: Listen normally on 2 lo 127.0.0.1:123 2024-04-24T13:27:04.317 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: Listen normally on 3 enp3s0f1 172.21.15.138:123 2024-04-24T13:27:04.317 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: Listen normally on 4 lo [::1]:123 2024-04-24T13:27:04.317 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: Listen normally on 5 enp3s0f1 [fe80::ec4:7aff:fe88:6f71%5]:123 2024-04-24T13:27:04.317 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:04 ntpd[17203]: Listening on routing socket on fd #22 for interface updates 2024-04-24T13:27:05.288 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:05 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:05.288 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:05 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:05.288 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:05 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:05.288 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:05 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:05.288 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:05 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:05.288 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:05 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:05.288 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:05 ntpd[17229]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:05.288 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:05 ntpd[17229]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:05.313 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:05 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:05.313 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:05 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:05.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:05 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:05.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:05 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:05.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:05 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:05.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:05 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:07.288 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:07 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:07.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:07 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:07.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:07 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:07.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:07 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:07.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:07 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:07.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:07 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:07.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:07 ntpd[17229]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:07.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:07 ntpd[17229]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:07.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:07 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:07.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:07 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:07.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:07 ntpd[17229]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:07.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:07 ntpd[17229]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:07.313 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:07 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:07.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:07 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:07.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:07 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:07.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:07 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:07.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:07 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:07.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:07 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:08.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:08 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:08.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:08 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:08.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:08 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:08.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:08 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:08.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:08 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:08.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:08 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:08.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:08 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:08.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:08 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:09.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:09.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:09.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:09.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:09.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:09.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:09.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:09.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:09.290 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:09 ntpd[17229]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:09.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:09 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:09.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:09 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:09.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:09 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:09.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:09 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:09.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:09 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:09.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:09 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:09.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:09 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:09.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:09 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:09.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:09 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:09.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:09 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:09.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:09 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:09.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:09 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:10.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:10 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:10.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:10 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:10.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:10 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:10.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:10 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:10.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:10 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:10.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:10 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:11.288 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:11 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:11.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:11 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:11.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:11 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:11.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:11 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:11.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:11 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:11.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:11 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:11.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:11 ntpd[17229]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:11.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:11 ntpd[17229]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:11.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:11 ntpd[17229]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:11.289 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:11 ntpd[17229]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:11.290 INFO:teuthology.orchestra.run.smithi071.stdout:24 Apr 13:27:11 ntpd[17229]: ntpd: time slew -0.001417 s 2024-04-24T13:27:11.290 INFO:teuthology.orchestra.run.smithi071.stdout:ntpd: time slew -0.001417s 2024-04-24T13:27:11.290 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:11 ntpd[17229]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-24T13:27:11.290 INFO:teuthology.orchestra.run.smithi071.stderr:24 Apr 13:27:11 ntpd[17229]: can't open /var/log/ntpstats/loopstats.20240424: Permission denied 2024-04-24T13:27:11.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:11 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:11.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:11 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:11.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:11 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:11.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:11 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:11.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:11 ntpd[17203]: couldn't unlink /var/log/ntpstats/rawstats: Permission denied 2024-04-24T13:27:11.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:11 ntpd[17203]: can't open /var/log/ntpstats/rawstats.20240424: Permission denied 2024-04-24T13:27:11.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:11 ntpd[17203]: couldn't unlink /var/log/ntpstats/peerstats: Permission denied 2024-04-24T13:27:11.314 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:11 ntpd[17203]: can't open /var/log/ntpstats/peerstats.20240424: Permission denied 2024-04-24T13:27:11.315 INFO:teuthology.orchestra.run.smithi138.stdout:24 Apr 13:27:11 ntpd[17203]: ntpd: time slew -0.000849 s 2024-04-24T13:27:11.315 INFO:teuthology.orchestra.run.smithi138.stdout:ntpd: time slew -0.000849s 2024-04-24T13:27:11.315 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:11 ntpd[17203]: couldn't unlink /var/log/ntpstats/loopstats: Permission denied 2024-04-24T13:27:11.316 INFO:teuthology.orchestra.run.smithi138.stderr:24 Apr 13:27:11 ntpd[17203]: can't open /var/log/ntpstats/loopstats.20240424: Permission denied 2024-04-24T13:27:11.368 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T13:27:11.368 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-04-24T13:27:11.369 INFO:teuthology.orchestra.run.smithi138.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T13:27:11.369 INFO:teuthology.orchestra.run.smithi138.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T13:27:11.369 INFO:teuthology.orchestra.run.smithi138.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T13:27:11.369 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T13:27:11.418 INFO:teuthology.orchestra.run.smithi071.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T13:27:11.418 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================== 2024-04-24T13:27:11.418 INFO:teuthology.orchestra.run.smithi071.stdout: hv01.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T13:27:11.418 INFO:teuthology.orchestra.run.smithi071.stdout: hv02.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T13:27:11.418 INFO:teuthology.orchestra.run.smithi071.stdout: hv03.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T13:27:11.418 INFO:teuthology.orchestra.run.smithi071.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T13:27:11.419 INFO:teuthology.run_tasks:Running task install... 2024-04-24T13:27:11.430 DEBUG:teuthology.task.install:project ceph 2024-04-24T13:27:11.430 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '882080b304cb1602e69c11bc5fe8479e7d2bc64d'}} 2024-04-24T13:27:11.430 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '882080b304cb1602e69c11bc5fe8479e7d2bc64d'} 2024-04-24T13:27:11.430 INFO:teuthology.task.install:Using flavor: default 2024-04-24T13:27:11.437 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-04-24T13:27:11.437 INFO:teuthology.task.install:extra packages: [] 2024-04-24T13:27:11.438 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-key list | grep Ceph 2024-04-24T13:27:11.438 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-key list | grep Ceph 2024-04-24T13:27:11.499 INFO:teuthology.orchestra.run.smithi138.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-24T13:27:11.521 INFO:teuthology.orchestra.run.smithi071.stderr:Warning: apt-key is deprecated. Manage keyring files in trusted.gpg.d instead (see apt-key(8)). 2024-04-24T13:27:11.529 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-24T13:27:11.529 INFO:teuthology.orchestra.run.smithi138.stdout:uid [ unknown] Ceph.com (release key) 2024-04-24T13:27:11.529 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-24T13:27:11.530 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=882080b304cb1602e69c11bc5fe8479e7d2bc64d 2024-04-24T13:27:11.549 INFO:teuthology.orchestra.run.smithi071.stdout:uid [ unknown] Ceph automated package build (Ceph automated package build) 2024-04-24T13:27:11.549 INFO:teuthology.orchestra.run.smithi071.stdout:uid [ unknown] Ceph.com (release key) 2024-04-24T13:27:11.549 INFO:teuthology.task.install.deb:Installing packages: ceph, cephadm, ceph-mds, ceph-mgr, ceph-common, ceph-fuse, ceph-test, ceph-volume, radosgw, python3-rados, python3-rgw, python3-cephfs, python3-rbd, libcephfs2, libcephfs-dev, librados2, librbd1, rbd-fuse on remote deb x86_64 2024-04-24T13:27:11.550 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=882080b304cb1602e69c11bc5fe8479e7d2bc64d 2024-04-24T13:27:11.707 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default/ 2024-04-24T13:27:11.707 INFO:teuthology.task.install.deb:Package version is 19.0.0-3241-g882080b3-1jammy 2024-04-24T13:27:11.757 INFO:teuthology.task.install.deb:Pulling from https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default/ 2024-04-24T13:27:11.757 INFO:teuthology.task.install.deb:Package version is 19.0.0-3241-g882080b3-1jammy 2024-04-24T13:27:11.869 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:27:11.869 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-24T13:27:11.878 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:27:11.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/apt/sources.list.d/ceph.list 2024-04-24T13:27:11.883 DEBUG:teuthology.orchestra.run.smithi138:> sudo apt-get update 2024-04-24T13:27:11.892 DEBUG:teuthology.orchestra.run.smithi071:> sudo apt-get update 2024-04-24T13:27:12.052 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:1 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T13:27:12.065 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:2 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T13:27:12.070 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:3 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T13:27:12.084 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:1 http://security.ubuntu.com/ubuntu jammy-security InRelease 2024-04-24T13:27:12.085 INFO:teuthology.orchestra.run.smithi138.stdout:Hit:4 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T13:27:12.102 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy InRelease 2024-04-24T13:27:12.123 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-24T13:27:12.148 INFO:teuthology.orchestra.run.smithi138.stdout:Ign:7 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-24T13:27:12.169 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-24T13:27:12.174 INFO:teuthology.orchestra.run.smithi071.stdout:Ign:2 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy InRelease 2024-04-24T13:27:12.180 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:3 http://archive.ubuntu.com/ubuntu jammy InRelease 2024-04-24T13:27:12.205 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-04-24T13:27:12.210 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy Release [7,662 B] 2024-04-24T13:27:12.248 INFO:teuthology.orchestra.run.smithi071.stdout:Ign:5 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy Release.gpg 2024-04-24T13:27:12.261 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:6 http://archive.ubuntu.com/ubuntu jammy-updates InRelease 2024-04-24T13:27:12.284 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main i386 Packages [3,412 B] 2024-04-24T13:27:12.328 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 Packages [18.2 kB] 2024-04-24T13:27:12.343 INFO:teuthology.orchestra.run.smithi071.stdout:Hit:9 http://archive.ubuntu.com/ubuntu jammy-backports InRelease 2024-04-24T13:27:12.394 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 29.2 kB in 0s (87.1 kB/s) 2024-04-24T13:27:12.476 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 29.2 kB in 0s (71.6 kB/s) 2024-04-24T13:27:13.334 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-24T13:27:13.350 DEBUG:teuthology.orchestra.run.smithi138:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3241-g882080b3-1jammy cephadm=19.0.0-3241-g882080b3-1jammy ceph-mds=19.0.0-3241-g882080b3-1jammy ceph-mgr=19.0.0-3241-g882080b3-1jammy ceph-common=19.0.0-3241-g882080b3-1jammy ceph-fuse=19.0.0-3241-g882080b3-1jammy ceph-test=19.0.0-3241-g882080b3-1jammy ceph-volume=19.0.0-3241-g882080b3-1jammy radosgw=19.0.0-3241-g882080b3-1jammy python3-rados=19.0.0-3241-g882080b3-1jammy python3-rgw=19.0.0-3241-g882080b3-1jammy python3-cephfs=19.0.0-3241-g882080b3-1jammy python3-rbd=19.0.0-3241-g882080b3-1jammy libcephfs2=19.0.0-3241-g882080b3-1jammy libcephfs-dev=19.0.0-3241-g882080b3-1jammy librados2=19.0.0-3241-g882080b3-1jammy librbd1=19.0.0-3241-g882080b3-1jammy rbd-fuse=19.0.0-3241-g882080b3-1jammy 2024-04-24T13:27:13.413 INFO:teuthology.orchestra.run.smithi138.stdout:Reading package lists... 2024-04-24T13:27:13.442 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-04-24T13:27:13.458 DEBUG:teuthology.orchestra.run.smithi071:> sudo DEBIAN_FRONTEND=noninteractive apt-get -y --force-yes -o Dpkg::Options::="--force-confdef" -o Dpkg::Options::="--force-confold" install ceph=19.0.0-3241-g882080b3-1jammy cephadm=19.0.0-3241-g882080b3-1jammy ceph-mds=19.0.0-3241-g882080b3-1jammy ceph-mgr=19.0.0-3241-g882080b3-1jammy ceph-common=19.0.0-3241-g882080b3-1jammy ceph-fuse=19.0.0-3241-g882080b3-1jammy ceph-test=19.0.0-3241-g882080b3-1jammy ceph-volume=19.0.0-3241-g882080b3-1jammy radosgw=19.0.0-3241-g882080b3-1jammy python3-rados=19.0.0-3241-g882080b3-1jammy python3-rgw=19.0.0-3241-g882080b3-1jammy python3-cephfs=19.0.0-3241-g882080b3-1jammy python3-rbd=19.0.0-3241-g882080b3-1jammy libcephfs2=19.0.0-3241-g882080b3-1jammy libcephfs-dev=19.0.0-3241-g882080b3-1jammy librados2=19.0.0-3241-g882080b3-1jammy librbd1=19.0.0-3241-g882080b3-1jammy rbd-fuse=19.0.0-3241-g882080b3-1jammy 2024-04-24T13:27:13.510 INFO:teuthology.orchestra.run.smithi071.stdout:Reading package lists... 2024-04-24T13:27:13.614 INFO:teuthology.orchestra.run.smithi138.stdout:Building dependency tree... 2024-04-24T13:27:13.614 INFO:teuthology.orchestra.run.smithi138.stdout:Reading state information... 2024-04-24T13:27:13.686 INFO:teuthology.orchestra.run.smithi071.stdout:Building dependency tree... 2024-04-24T13:27:13.687 INFO:teuthology.orchestra.run.smithi071.stdout:Reading state information... 2024-04-24T13:27:13.811 INFO:teuthology.orchestra.run.smithi138.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T13:27:13.811 INFO:teuthology.orchestra.run.smithi138.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T13:27:13.811 INFO:teuthology.orchestra.run.smithi138.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T13:27:13.811 INFO:teuthology.orchestra.run.smithi138.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T13:27:13.812 INFO:teuthology.orchestra.run.smithi138.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T13:27:13.812 INFO:teuthology.orchestra.run.smithi138.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T13:27:13.812 INFO:teuthology.orchestra.run.smithi138.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T13:27:13.813 INFO:teuthology.orchestra.run.smithi138.stdout:The following additional packages will be installed: 2024-04-24T13:27:13.813 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-24T13:27:13.813 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-24T13:27:13.813 INFO:teuthology.orchestra.run.smithi138.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T13:27:13.813 INFO:teuthology.orchestra.run.smithi138.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-24T13:27:13.814 INFO:teuthology.orchestra.run.smithi138.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-24T13:27:13.814 INFO:teuthology.orchestra.run.smithi138.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-24T13:27:13.814 INFO:teuthology.orchestra.run.smithi138.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-24T13:27:13.814 INFO:teuthology.orchestra.run.smithi138.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-24T13:27:13.814 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-24T13:27:13.814 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-24T13:27:13.814 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-24T13:27:13.815 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-24T13:27:13.815 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-24T13:27:13.815 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-24T13:27:13.815 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-24T13:27:13.815 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-24T13:27:13.815 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-24T13:27:13.815 INFO:teuthology.orchestra.run.smithi138.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-24T13:27:13.815 INFO:teuthology.orchestra.run.smithi138.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-24T13:27:13.815 INFO:teuthology.orchestra.run.smithi138.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-24T13:27:13.815 INFO:teuthology.orchestra.run.smithi138.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-24T13:27:13.815 INFO:teuthology.orchestra.run.smithi138.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-24T13:27:13.815 INFO:teuthology.orchestra.run.smithi138.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-24T13:27:13.815 INFO:teuthology.orchestra.run.smithi138.stdout: xmlstarlet zip 2024-04-24T13:27:13.816 INFO:teuthology.orchestra.run.smithi138.stdout:Suggested packages: 2024-04-24T13:27:13.816 INFO:teuthology.orchestra.run.smithi138.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-24T13:27:13.816 INFO:teuthology.orchestra.run.smithi138.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-24T13:27:13.816 INFO:teuthology.orchestra.run.smithi138.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-24T13:27:13.816 INFO:teuthology.orchestra.run.smithi138.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-24T13:27:13.816 INFO:teuthology.orchestra.run.smithi138.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-24T13:27:13.816 INFO:teuthology.orchestra.run.smithi138.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-24T13:27:13.816 INFO:teuthology.orchestra.run.smithi138.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-24T13:27:13.816 INFO:teuthology.orchestra.run.smithi138.stdout:Recommended packages: 2024-04-24T13:27:13.816 INFO:teuthology.orchestra.run.smithi138.stdout: btrfs-tools 2024-04-24T13:27:13.857 INFO:teuthology.orchestra.run.smithi071.stdout:The following packages were automatically installed and are no longer required: 2024-04-24T13:27:13.857 INFO:teuthology.orchestra.run.smithi071.stdout: libboost-iostreams1.74.0 libboost-thread1.74.0 libgfapi0 libgfrpc0 libgfxdr0 2024-04-24T13:27:13.857 INFO:teuthology.orchestra.run.smithi071.stdout: libglusterfs0 libiscsi7 libpmemobj1 libpython2-dev libpython2-stdlib 2024-04-24T13:27:13.857 INFO:teuthology.orchestra.run.smithi071.stdout: libpython2.7 libpython2.7-dev libpython2.7-minimal libpython2.7-stdlib 2024-04-24T13:27:13.857 INFO:teuthology.orchestra.run.smithi071.stdout: linux-image-5.4.0-135-generic linux-modules-5.4.0-135-generic python2 2024-04-24T13:27:13.858 INFO:teuthology.orchestra.run.smithi071.stdout: python2-dev python2-minimal python2.7 python2.7-dev python2.7-minimal 2024-04-24T13:27:13.858 INFO:teuthology.orchestra.run.smithi071.stdout:Use 'sudo apt autoremove' to remove them. 2024-04-24T13:27:13.858 INFO:teuthology.orchestra.run.smithi071.stdout:The following additional packages will be installed: 2024-04-24T13:27:13.858 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-base ceph-mgr-cephadm ceph-mgr-dashboard ceph-mgr-diskprediction-local 2024-04-24T13:27:13.858 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-k8sevents ceph-mgr-modules-core ceph-mon ceph-osd jq 2024-04-24T13:27:13.859 INFO:teuthology.orchestra.run.smithi071.stdout: libdouble-conversion3 libjq1 liblttng-ust1 liblua5.3-dev liboath0 libonig5 2024-04-24T13:27:13.860 INFO:teuthology.orchestra.run.smithi071.stdout: libpcre2-16-0 libqt5core5a libqt5dbus5 libqt5network5 libradosstriper1 2024-04-24T13:27:13.860 INFO:teuthology.orchestra.run.smithi071.stdout: librdkafka1 libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 2024-04-24T13:27:13.860 INFO:teuthology.orchestra.run.smithi071.stdout: lua-any lua-sec lua-socket lua5.1 luarocks nvme-cli pkg-config 2024-04-24T13:27:13.860 INFO:teuthology.orchestra.run.smithi071.stdout: python-asyncssh-doc python-babel-localedata python-pastedeploy-tpl 2024-04-24T13:27:13.860 INFO:teuthology.orchestra.run.smithi071.stdout: python3-asyncssh python3-babel python3-bcrypt python3-cachetools 2024-04-24T13:27:13.860 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-argparse python3-ceph-common python3-certifi python3-cheroot 2024-04-24T13:27:13.860 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-24T13:27:13.860 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-24T13:27:13.860 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-24T13:27:13.860 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-24T13:27:13.860 INFO:teuthology.orchestra.run.smithi071.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-24T13:27:13.860 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-24T13:27:13.860 INFO:teuthology.orchestra.run.smithi071.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-24T13:27:13.861 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pygments python3-pyinotify python3-pytest python3-repoze.lru 2024-04-24T13:27:13.861 INFO:teuthology.orchestra.run.smithi071.stdout: python3-requests python3-requests-oauthlib python3-routes python3-rsa 2024-04-24T13:27:13.861 INFO:teuthology.orchestra.run.smithi071.stdout: python3-simplegeneric python3-simplejson python3-singledispatch 2024-04-24T13:27:13.861 INFO:teuthology.orchestra.run.smithi071.stdout: python3-sklearn python3-sklearn-lib python3-tempita python3-tempora 2024-04-24T13:27:13.861 INFO:teuthology.orchestra.run.smithi071.stdout: python3-threadpoolctl python3-toml python3-urllib3 python3-waitress 2024-04-24T13:27:13.861 INFO:teuthology.orchestra.run.smithi071.stdout: python3-wcwidth python3-webob python3-websocket python3-webtest 2024-04-24T13:27:13.861 INFO:teuthology.orchestra.run.smithi071.stdout: python3-werkzeug python3-zc.lockfile qttranslations5-l10n socat unzip 2024-04-24T13:27:13.861 INFO:teuthology.orchestra.run.smithi071.stdout: xmlstarlet zip 2024-04-24T13:27:13.862 INFO:teuthology.orchestra.run.smithi071.stdout:Suggested packages: 2024-04-24T13:27:13.862 INFO:teuthology.orchestra.run.smithi071.stdout: python3-influxdb readline-doc python-jinja2-doc python3-beaker 2024-04-24T13:27:13.862 INFO:teuthology.orchestra.run.smithi071.stdout: python-mako-doc python-natsort-doc python-openssl-doc python3-openssl-dbg 2024-04-24T13:27:13.862 INFO:teuthology.orchestra.run.smithi071.stdout: httpd-wsgi libapache2-mod-python libapache2-mod-scgi libjs-mochikit 2024-04-24T13:27:13.862 INFO:teuthology.orchestra.run.smithi071.stdout: python-pecan-doc python-psutil-doc subversion python-pygments-doc 2024-04-24T13:27:13.862 INFO:teuthology.orchestra.run.smithi071.stdout: python-pyinotify-doc python3-socks python-requests-doc python3-dap 2024-04-24T13:27:13.862 INFO:teuthology.orchestra.run.smithi071.stdout: python-sklearn-doc ipython3 python-waitress-doc python-webob-doc 2024-04-24T13:27:13.862 INFO:teuthology.orchestra.run.smithi071.stdout: python-webtest-doc python-werkzeug-doc python3-watchdog 2024-04-24T13:27:13.862 INFO:teuthology.orchestra.run.smithi071.stdout:Recommended packages: 2024-04-24T13:27:13.863 INFO:teuthology.orchestra.run.smithi071.stdout: btrfs-tools 2024-04-24T13:27:13.916 INFO:teuthology.orchestra.run.smithi138.stdout:The following NEW packages will be installed: 2024-04-24T13:27:13.916 INFO:teuthology.orchestra.run.smithi138.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-24T13:27:13.916 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-24T13:27:13.916 INFO:teuthology.orchestra.run.smithi138.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-24T13:27:13.917 INFO:teuthology.orchestra.run.smithi138.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-24T13:27:13.917 INFO:teuthology.orchestra.run.smithi138.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-24T13:27:13.917 INFO:teuthology.orchestra.run.smithi138.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-24T13:27:13.917 INFO:teuthology.orchestra.run.smithi138.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-24T13:27:13.917 INFO:teuthology.orchestra.run.smithi138.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-24T13:27:13.917 INFO:teuthology.orchestra.run.smithi138.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-24T13:27:13.917 INFO:teuthology.orchestra.run.smithi138.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-24T13:27:13.917 INFO:teuthology.orchestra.run.smithi138.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-24T13:27:13.917 INFO:teuthology.orchestra.run.smithi138.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-24T13:27:13.917 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-24T13:27:13.917 INFO:teuthology.orchestra.run.smithi138.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-24T13:27:13.917 INFO:teuthology.orchestra.run.smithi138.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-24T13:27:13.917 INFO:teuthology.orchestra.run.smithi138.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-24T13:27:13.918 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-24T13:27:13.918 INFO:teuthology.orchestra.run.smithi138.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-24T13:27:13.918 INFO:teuthology.orchestra.run.smithi138.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-24T13:27:13.918 INFO:teuthology.orchestra.run.smithi138.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-24T13:27:13.918 INFO:teuthology.orchestra.run.smithi138.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-24T13:27:13.918 INFO:teuthology.orchestra.run.smithi138.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-24T13:27:13.918 INFO:teuthology.orchestra.run.smithi138.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-24T13:27:13.918 INFO:teuthology.orchestra.run.smithi138.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-24T13:27:13.918 INFO:teuthology.orchestra.run.smithi138.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-24T13:27:13.918 INFO:teuthology.orchestra.run.smithi138.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-24T13:27:13.959 INFO:teuthology.orchestra.run.smithi071.stdout:The following NEW packages will be installed: 2024-04-24T13:27:13.959 INFO:teuthology.orchestra.run.smithi071.stdout: ceph ceph-base ceph-common ceph-fuse ceph-mds ceph-mgr ceph-mgr-cephadm 2024-04-24T13:27:13.959 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-dashboard ceph-mgr-diskprediction-local ceph-mgr-k8sevents 2024-04-24T13:27:13.959 INFO:teuthology.orchestra.run.smithi071.stdout: ceph-mgr-modules-core ceph-mon ceph-osd ceph-test ceph-volume cephadm jq 2024-04-24T13:27:13.959 INFO:teuthology.orchestra.run.smithi071.stdout: libcephfs-dev libcephfs2 libdouble-conversion3 libjq1 liblttng-ust1 2024-04-24T13:27:13.959 INFO:teuthology.orchestra.run.smithi071.stdout: liblua5.3-dev liboath0 libonig5 libpcre2-16-0 libqt5core5a libqt5dbus5 2024-04-24T13:27:13.959 INFO:teuthology.orchestra.run.smithi071.stdout: libqt5network5 librados2 libradosstriper1 librbd1 librdkafka1 2024-04-24T13:27:13.960 INFO:teuthology.orchestra.run.smithi071.stdout: libreadline-dev librgw2 libsqlite3-mod-ceph libthrift-0.16.0 lua-any lua-sec 2024-04-24T13:27:13.960 INFO:teuthology.orchestra.run.smithi071.stdout: lua-socket lua5.1 luarocks nvme-cli pkg-config python-asyncssh-doc 2024-04-24T13:27:13.961 INFO:teuthology.orchestra.run.smithi071.stdout: python-babel-localedata python-pastedeploy-tpl python3-asyncssh 2024-04-24T13:27:13.961 INFO:teuthology.orchestra.run.smithi071.stdout: python3-babel python3-bcrypt python3-cachetools python3-ceph-argparse 2024-04-24T13:27:13.961 INFO:teuthology.orchestra.run.smithi071.stdout: python3-ceph-common python3-cephfs python3-certifi python3-cheroot 2024-04-24T13:27:13.961 INFO:teuthology.orchestra.run.smithi071.stdout: python3-cherrypy3 python3-google-auth python3-idna python3-iniconfig 2024-04-24T13:27:13.961 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco.classes python3-jaraco.collections python3-jaraco.functools 2024-04-24T13:27:13.961 INFO:teuthology.orchestra.run.smithi071.stdout: python3-jaraco.text python3-jinja2 python3-joblib python3-kubernetes 2024-04-24T13:27:13.961 INFO:teuthology.orchestra.run.smithi071.stdout: python3-logutils python3-mako python3-markupsafe python3-natsort 2024-04-24T13:27:13.961 INFO:teuthology.orchestra.run.smithi071.stdout: python3-openssl python3-paste python3-pastedeploy python3-pastescript 2024-04-24T13:27:13.961 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pecan python3-pluggy python3-portend python3-prettytable 2024-04-24T13:27:13.961 INFO:teuthology.orchestra.run.smithi071.stdout: python3-psutil python3-py python3-pyasn1 python3-pyasn1-modules 2024-04-24T13:27:13.961 INFO:teuthology.orchestra.run.smithi071.stdout: python3-pygments python3-pyinotify python3-pytest python3-rados python3-rbd 2024-04-24T13:27:13.961 INFO:teuthology.orchestra.run.smithi071.stdout: python3-repoze.lru python3-requests python3-requests-oauthlib python3-rgw 2024-04-24T13:27:13.961 INFO:teuthology.orchestra.run.smithi071.stdout: python3-routes python3-rsa python3-simplegeneric python3-simplejson 2024-04-24T13:27:13.962 INFO:teuthology.orchestra.run.smithi071.stdout: python3-singledispatch python3-sklearn python3-sklearn-lib python3-tempita 2024-04-24T13:27:13.962 INFO:teuthology.orchestra.run.smithi071.stdout: python3-tempora python3-threadpoolctl python3-toml python3-urllib3 2024-04-24T13:27:13.962 INFO:teuthology.orchestra.run.smithi071.stdout: python3-waitress python3-wcwidth python3-webob python3-websocket 2024-04-24T13:27:13.962 INFO:teuthology.orchestra.run.smithi071.stdout: python3-webtest python3-werkzeug python3-zc.lockfile qttranslations5-l10n 2024-04-24T13:27:13.962 INFO:teuthology.orchestra.run.smithi071.stdout: radosgw rbd-fuse socat unzip xmlstarlet zip 2024-04-24T13:27:14.100 INFO:teuthology.orchestra.run.smithi071.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-24T13:27:14.100 INFO:teuthology.orchestra.run.smithi071.stdout:Need to get 181 MB of archives. 2024-04-24T13:27:14.101 INFO:teuthology.orchestra.run.smithi071.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-24T13:27:14.101 INFO:teuthology.orchestra.run.smithi071.stdout:Get:1 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3241-g882080b3-1jammy [3,556 kB] 2024-04-24T13:27:14.103 INFO:teuthology.orchestra.run.smithi138.stdout:0 upgraded, 118 newly installed, 0 to remove and 302 not upgraded. 2024-04-24T13:27:14.103 INFO:teuthology.orchestra.run.smithi138.stdout:Need to get 181 MB of archives. 2024-04-24T13:27:14.103 INFO:teuthology.orchestra.run.smithi138.stdout:After this operation, 829 MB of additional disk space will be used. 2024-04-24T13:27:14.103 INFO:teuthology.orchestra.run.smithi138.stdout:Get:1 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-24T13:27:14.146 INFO:teuthology.orchestra.run.smithi138.stdout:Get:2 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 librados2 amd64 19.0.0-3241-g882080b3-1jammy [3,556 kB] 2024-04-24T13:27:14.147 INFO:teuthology.orchestra.run.smithi071.stdout:Get:2 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblttng-ust1 amd64 2.13.1-1ubuntu1 [190 kB] 2024-04-24T13:27:14.319 INFO:teuthology.orchestra.run.smithi071.stdout:Get:3 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3241-g882080b3-1jammy [3,224 kB] 2024-04-24T13:27:14.422 INFO:teuthology.orchestra.run.smithi071.stdout:Get:4 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3241-g882080b3-1jammy [712 kB] 2024-04-24T13:27:14.449 INFO:teuthology.orchestra.run.smithi071.stdout:Get:5 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3241-g882080b3-1jammy [356 kB] 2024-04-24T13:27:14.461 INFO:teuthology.orchestra.run.smithi071.stdout:Get:6 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3241-g882080b3-1jammy [32.8 kB] 2024-04-24T13:27:14.462 INFO:teuthology.orchestra.run.smithi071.stdout:Get:7 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3241-g882080b3-1jammy [180 kB] 2024-04-24T13:27:14.468 INFO:teuthology.orchestra.run.smithi071.stdout:Get:8 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3241-g882080b3-1jammy [67.1 kB] 2024-04-24T13:27:14.470 INFO:teuthology.orchestra.run.smithi071.stdout:Get:9 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3241-g882080b3-1jammy [330 kB] 2024-04-24T13:27:14.480 INFO:teuthology.orchestra.run.smithi071.stdout:Get:10 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3241-g882080b3-1jammy [6,896 kB] 2024-04-24T13:27:14.525 INFO:teuthology.orchestra.run.smithi138.stdout:Get:3 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-24T13:27:14.538 INFO:teuthology.orchestra.run.smithi138.stdout:Get:4 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-24T13:27:14.575 INFO:teuthology.orchestra.run.smithi071.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libdouble-conversion3 amd64 3.1.7-4 [39.0 kB] 2024-04-24T13:27:14.587 INFO:teuthology.orchestra.run.smithi071.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 libpcre2-16-0 amd64 10.39-3ubuntu0.1 [203 kB] 2024-04-24T13:27:14.619 INFO:teuthology.orchestra.run.smithi138.stdout:Get:5 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-24T13:27:14.668 INFO:teuthology.orchestra.run.smithi071.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5core5a amd64 5.15.3+dfsg-2ubuntu0.2 [2,006 kB] 2024-04-24T13:27:14.725 INFO:teuthology.orchestra.run.smithi071.stdout:Get:14 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3241-g882080b3-1jammy [112 kB] 2024-04-24T13:27:14.727 INFO:teuthology.orchestra.run.smithi071.stdout:Get:15 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3241-g882080b3-1jammy [466 kB] 2024-04-24T13:27:14.746 INFO:teuthology.orchestra.run.smithi071.stdout:Get:16 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3241-g882080b3-1jammy [25.9 MB] 2024-04-24T13:27:14.849 INFO:teuthology.orchestra.run.smithi138.stdout:Get:6 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-24T13:27:14.860 INFO:teuthology.orchestra.run.smithi138.stdout:Get:7 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-24T13:27:14.890 INFO:teuthology.orchestra.run.smithi138.stdout:Get:8 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-24T13:27:14.902 INFO:teuthology.orchestra.run.smithi138.stdout:Get:9 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-24T13:27:14.902 INFO:teuthology.orchestra.run.smithi071.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5dbus5 amd64 5.15.3+dfsg-2ubuntu0.2 [222 kB] 2024-04-24T13:27:14.903 INFO:teuthology.orchestra.run.smithi138.stdout:Get:10 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-24T13:27:14.904 INFO:teuthology.orchestra.run.smithi138.stdout:Get:11 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-24T13:27:14.912 INFO:teuthology.orchestra.run.smithi071.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy-updates/universe amd64 libqt5network5 amd64 5.15.3+dfsg-2ubuntu0.2 [731 kB] 2024-04-24T13:27:14.922 INFO:teuthology.orchestra.run.smithi138.stdout:Get:12 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-24T13:27:14.942 INFO:teuthology.orchestra.run.smithi071.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/universe amd64 libthrift-0.16.0 amd64 0.16.0-2 [267 kB] 2024-04-24T13:27:14.951 INFO:teuthology.orchestra.run.smithi071.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-wcwidth all 0.2.5+dfsg1-1 [21.9 kB] 2024-04-24T13:27:14.952 INFO:teuthology.orchestra.run.smithi071.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-prettytable all 2.5.0-2 [31.3 kB] 2024-04-24T13:27:14.953 INFO:teuthology.orchestra.run.smithi071.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/universe amd64 librdkafka1 amd64 1.8.0-1build1 [633 kB] 2024-04-24T13:27:14.974 INFO:teuthology.orchestra.run.smithi071.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 libreadline-dev amd64 8.1.2-1 [166 kB] 2024-04-24T13:27:15.090 INFO:teuthology.orchestra.run.smithi138.stdout:Get:13 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-24T13:27:15.142 INFO:teuthology.orchestra.run.smithi071.stdout:Get:24 http://archive.ubuntu.com/ubuntu jammy/main amd64 liblua5.3-dev amd64 5.3.6-1build1 [167 kB] 2024-04-24T13:27:15.494 INFO:teuthology.orchestra.run.smithi138.stdout:Get:14 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-24T13:27:15.528 INFO:teuthology.orchestra.run.smithi138.stdout:Get:15 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-24T13:27:15.530 INFO:teuthology.orchestra.run.smithi138.stdout:Get:16 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-24T13:27:15.550 INFO:teuthology.orchestra.run.smithi071.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua5.1 amd64 5.1.5-8.1build4 [94.6 kB] 2024-04-24T13:27:15.582 INFO:teuthology.orchestra.run.smithi071.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-any all 27ubuntu1 [5,034 B] 2024-04-24T13:27:15.584 INFO:teuthology.orchestra.run.smithi071.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 zip amd64 3.0-12build2 [176 kB] 2024-04-24T13:27:15.610 INFO:teuthology.orchestra.run.smithi138.stdout:Get:17 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-24T13:27:15.661 INFO:teuthology.orchestra.run.smithi138.stdout:Get:18 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-24T13:27:15.683 INFO:teuthology.orchestra.run.smithi138.stdout:Get:19 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-24T13:27:15.689 INFO:teuthology.orchestra.run.smithi138.stdout:Get:20 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-24T13:27:15.690 INFO:teuthology.orchestra.run.smithi138.stdout:Get:21 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-24T13:27:15.702 INFO:teuthology.orchestra.run.smithi138.stdout:Get:22 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-24T13:27:15.702 INFO:teuthology.orchestra.run.smithi138.stdout:Get:23 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-24T13:27:15.733 INFO:teuthology.orchestra.run.smithi071.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 unzip amd64 6.0-26ubuntu3.2 [175 kB] 2024-04-24T13:27:15.800 INFO:teuthology.orchestra.run.smithi071.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/universe amd64 luarocks all 3.8.0+dfsg1-1 [140 kB] 2024-04-24T13:27:15.800 INFO:teuthology.orchestra.run.smithi071.stdout:Get:30 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3241-g882080b3-1jammy [5,092 kB] 2024-04-24T13:27:15.804 INFO:teuthology.orchestra.run.smithi071.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 liboath0 amd64 2.6.7-3build1 [41.1 kB] 2024-04-24T13:27:15.805 INFO:teuthology.orchestra.run.smithi071.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.functools all 3.4.0-2 [9,030 B] 2024-04-24T13:27:15.806 INFO:teuthology.orchestra.run.smithi071.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-cheroot all 8.5.2+ds1-1ubuntu3.1 [71.1 kB] 2024-04-24T13:27:15.808 INFO:teuthology.orchestra.run.smithi071.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.classes all 3.2.1-3 [6,452 B] 2024-04-24T13:27:15.839 INFO:teuthology.orchestra.run.smithi138.stdout:Get:24 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 librbd1 amd64 19.0.0-3241-g882080b3-1jammy [3,224 kB] 2024-04-24T13:27:15.868 INFO:teuthology.orchestra.run.smithi138.stdout:Get:25 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-24T13:27:15.879 INFO:teuthology.orchestra.run.smithi071.stdout:Get:35 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3241-g882080b3-1jammy [244 kB] 2024-04-24T13:27:15.882 INFO:teuthology.orchestra.run.smithi071.stdout:Get:36 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3241-g882080b3-1jammy [124 kB] 2024-04-24T13:27:15.883 INFO:teuthology.orchestra.run.smithi071.stdout:Get:37 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3241-g882080b3-1jammy [1,526 kB] 2024-04-24T13:27:15.920 INFO:teuthology.orchestra.run.smithi071.stdout:Get:38 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3241-g882080b3-1jammy [6,258 kB] 2024-04-24T13:27:15.952 INFO:teuthology.orchestra.run.smithi138.stdout:Get:26 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-24T13:27:15.974 INFO:teuthology.orchestra.run.smithi071.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.text all 3.6.0-2 [8,716 B] 2024-04-24T13:27:15.974 INFO:teuthology.orchestra.run.smithi071.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-jaraco.collections all 3.4.0-2 [11.4 kB] 2024-04-24T13:27:15.980 INFO:teuthology.orchestra.run.smithi138.stdout:Get:27 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-24T13:27:15.997 INFO:teuthology.orchestra.run.smithi138.stdout:Get:28 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-24T13:27:16.042 INFO:teuthology.orchestra.run.smithi138.stdout:Get:29 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-24T13:27:16.064 INFO:teuthology.orchestra.run.smithi071.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempora all 4.1.2-1 [14.8 kB] 2024-04-24T13:27:16.098 INFO:teuthology.orchestra.run.smithi071.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-portend all 3.0.0-1 [7,240 B] 2024-04-24T13:27:16.136 INFO:teuthology.orchestra.run.smithi071.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-zc.lockfile all 2.0-1 [8,980 B] 2024-04-24T13:27:16.143 INFO:teuthology.orchestra.run.smithi071.stdout:Get:44 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3241-g882080b3-1jammy [22.8 MB] 2024-04-24T13:27:16.151 INFO:teuthology.orchestra.run.smithi071.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cherrypy3 all 18.6.1-4 [208 kB] 2024-04-24T13:27:16.257 INFO:teuthology.orchestra.run.smithi138.stdout:Get:30 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-24T13:27:16.272 INFO:teuthology.orchestra.run.smithi138.stdout:Get:31 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-24T13:27:16.278 INFO:teuthology.orchestra.run.smithi138.stdout:Get:32 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-24T13:27:16.284 INFO:teuthology.orchestra.run.smithi138.stdout:Get:33 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-24T13:27:16.305 INFO:teuthology.orchestra.run.smithi138.stdout:Get:34 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-24T13:27:16.309 INFO:teuthology.orchestra.run.smithi138.stdout:Get:35 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-24T13:27:16.349 INFO:teuthology.orchestra.run.smithi071.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-natsort all 8.0.2-1 [35.3 kB] 2024-04-24T13:27:16.363 INFO:teuthology.orchestra.run.smithi071.stdout:Get:47 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-logutils all 0.3.3-8 [17.6 kB] 2024-04-24T13:27:16.370 INFO:teuthology.orchestra.run.smithi071.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-markupsafe amd64 2.0.1-2build1 [12.7 kB] 2024-04-24T13:27:16.375 INFO:teuthology.orchestra.run.smithi071.stdout:Get:49 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-mako all 1.1.3+ds1-2ubuntu0.1 [60.5 kB] 2024-04-24T13:27:16.396 INFO:teuthology.orchestra.run.smithi071.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplegeneric all 0.8.1-3 [11.3 kB] 2024-04-24T13:27:16.474 INFO:teuthology.orchestra.run.smithi138.stdout:Get:36 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-24T13:27:16.563 INFO:teuthology.orchestra.run.smithi071.stdout:Get:51 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-singledispatch all 3.4.0.3-3 [7,320 B] 2024-04-24T13:27:16.646 INFO:teuthology.orchestra.run.smithi071.stdout:Get:52 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webob all 1:1.8.6-1.1 [85.2 kB] 2024-04-24T13:27:16.792 INFO:teuthology.orchestra.run.smithi138.stdout:Get:37 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-24T13:27:16.832 INFO:teuthology.orchestra.run.smithi138.stdout:Get:38 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-24T13:27:16.844 INFO:teuthology.orchestra.run.smithi138.stdout:Get:39 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-24T13:27:16.846 INFO:teuthology.orchestra.run.smithi071.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-waitress all 1.4.4-1.1ubuntu1 [47.3 kB] 2024-04-24T13:27:16.903 INFO:teuthology.orchestra.run.smithi071.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-tempita all 0.5.2-6ubuntu1 [15.1 kB] 2024-04-24T13:27:16.914 INFO:teuthology.orchestra.run.smithi071.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-paste all 3.5.0+dfsg1-1 [456 kB] 2024-04-24T13:27:17.032 INFO:teuthology.orchestra.run.smithi071.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3241-g882080b3-1jammy [14.0 kB] 2024-04-24T13:27:17.033 INFO:teuthology.orchestra.run.smithi071.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3241-g882080b3-1jammy [870 kB] 2024-04-24T13:27:17.050 INFO:teuthology.orchestra.run.smithi071.stdout:Get:58 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3241-g882080b3-1jammy [2,437 kB] 2024-04-24T13:27:17.066 INFO:teuthology.orchestra.run.smithi138.stdout:Get:40 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-24T13:27:17.068 INFO:teuthology.orchestra.run.smithi138.stdout:Get:41 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-24T13:27:17.070 INFO:teuthology.orchestra.run.smithi138.stdout:Get:42 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-24T13:27:17.075 INFO:teuthology.orchestra.run.smithi138.stdout:Get:43 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-24T13:27:17.078 INFO:teuthology.orchestra.run.smithi071.stdout:Get:59 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-pastedeploy-tpl all 2.1.1-1 [4,892 B] 2024-04-24T13:27:17.079 INFO:teuthology.orchestra.run.smithi071.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastedeploy all 2.1.1-1 [26.6 kB] 2024-04-24T13:27:17.084 INFO:teuthology.orchestra.run.smithi071.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-webtest all 2.0.35-1 [28.5 kB] 2024-04-24T13:27:17.088 INFO:teuthology.orchestra.run.smithi138.stdout:Get:44 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-24T13:27:17.089 INFO:teuthology.orchestra.run.smithi071.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pecan all 1.3.3-4ubuntu2 [87.3 kB] 2024-04-24T13:27:17.090 INFO:teuthology.orchestra.run.smithi071.stdout:Get:63 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3241-g882080b3-1jammy [791 kB] 2024-04-24T13:27:17.099 INFO:teuthology.orchestra.run.smithi071.stdout:Get:64 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3241-g882080b3-1jammy [148 kB] 2024-04-24T13:27:17.101 INFO:teuthology.orchestra.run.smithi071.stdout:Get:65 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3241-g882080b3-1jammy [2,297 kB] 2024-04-24T13:27:17.104 INFO:teuthology.orchestra.run.smithi071.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-certifi all 2020.6.20-1 [150 kB] 2024-04-24T13:27:17.107 INFO:teuthology.orchestra.run.smithi138.stdout:Get:45 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-24T13:27:17.112 INFO:teuthology.orchestra.run.smithi138.stdout:Get:46 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-24T13:27:17.126 INFO:teuthology.orchestra.run.smithi071.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-idna all 3.3-1 [49.3 kB] 2024-04-24T13:27:17.184 INFO:teuthology.orchestra.run.smithi071.stdout:Get:68 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3241-g882080b3-1jammy [8,625 kB] 2024-04-24T13:27:17.184 INFO:teuthology.orchestra.run.smithi138.stdout:Get:47 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs2 amd64 19.0.0-3241-g882080b3-1jammy [712 kB] 2024-04-24T13:27:17.287 INFO:teuthology.orchestra.run.smithi138.stdout:Get:48 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-24T13:27:17.298 INFO:teuthology.orchestra.run.smithi071.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-urllib3 all 1.26.5-1~exp1ubuntu0.1 [98.2 kB] 2024-04-24T13:27:17.490 INFO:teuthology.orchestra.run.smithi071.stdout:Get:70 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3241-g882080b3-1jammy [14.2 kB] 2024-04-24T13:27:17.491 INFO:teuthology.orchestra.run.smithi071.stdout:Get:71 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3241-g882080b3-1jammy [51.7 MB] 2024-04-24T13:27:17.511 INFO:teuthology.orchestra.run.smithi138.stdout:Get:49 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rados amd64 19.0.0-3241-g882080b3-1jammy [356 kB] 2024-04-24T13:27:17.543 INFO:teuthology.orchestra.run.smithi138.stdout:Get:50 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-24T13:27:17.646 INFO:teuthology.orchestra.run.smithi071.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-requests all 2.25.1+dfsg-2ubuntu0.1 [48.8 kB] 2024-04-24T13:27:17.670 INFO:teuthology.orchestra.run.smithi138.stdout:Get:51 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-argparse all 19.0.0-3241-g882080b3-1jammy [32.8 kB] 2024-04-24T13:27:17.676 INFO:teuthology.orchestra.run.smithi071.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-werkzeug all 2.0.2+dfsg1-1ubuntu0.22.04.1 [181 kB] 2024-04-24T13:27:17.683 INFO:teuthology.orchestra.run.smithi138.stdout:Get:52 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 python3-cephfs amd64 19.0.0-3241-g882080b3-1jammy [180 kB] 2024-04-24T13:27:17.720 INFO:teuthology.orchestra.run.smithi138.stdout:Get:53 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-24T13:27:17.733 INFO:teuthology.orchestra.run.smithi138.stdout:Get:54 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-24T13:27:17.753 INFO:teuthology.orchestra.run.smithi138.stdout:Get:55 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-24T13:27:17.759 INFO:teuthology.orchestra.run.smithi138.stdout:Get:56 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 python3-ceph-common all 19.0.0-3241-g882080b3-1jammy [67.1 kB] 2024-04-24T13:27:17.780 INFO:teuthology.orchestra.run.smithi138.stdout:Get:57 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rbd amd64 19.0.0-3241-g882080b3-1jammy [330 kB] 2024-04-24T13:27:17.797 INFO:teuthology.orchestra.run.smithi071.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-bcrypt amd64 3.2.0-1build1 [32.7 kB] 2024-04-24T13:27:17.812 INFO:teuthology.orchestra.run.smithi071.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-openssl all 21.0.0-1 [45.2 kB] 2024-04-24T13:27:17.818 INFO:teuthology.orchestra.run.smithi138.stdout:Get:58 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-24T13:27:17.823 INFO:teuthology.orchestra.run.smithi071.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-asyncssh all 2.5.0-1 [185 kB] 2024-04-24T13:27:17.870 INFO:teuthology.orchestra.run.smithi071.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 python-babel-localedata all 2.8.0+dfsg.1-7 [4,982 kB] 2024-04-24T13:27:17.935 INFO:teuthology.orchestra.run.smithi138.stdout:Get:59 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 librgw2 amd64 19.0.0-3241-g882080b3-1jammy [6,896 kB] 2024-04-24T13:27:18.106 INFO:teuthology.orchestra.run.smithi138.stdout:Get:60 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-24T13:27:18.108 INFO:teuthology.orchestra.run.smithi138.stdout:Get:61 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-24T13:27:18.110 INFO:teuthology.orchestra.run.smithi138.stdout:Get:62 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-24T13:27:18.111 INFO:teuthology.orchestra.run.smithi138.stdout:Get:63 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-24T13:27:18.113 INFO:teuthology.orchestra.run.smithi138.stdout:Get:64 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-24T13:27:18.150 INFO:teuthology.orchestra.run.smithi071.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-babel all 2.8.0+dfsg.1-7 [85.1 kB] 2024-04-24T13:27:18.153 INFO:teuthology.orchestra.run.smithi071.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 python3-jinja2 all 3.0.3-1ubuntu0.1 [108 kB] 2024-04-24T13:27:18.155 INFO:teuthology.orchestra.run.smithi071.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-repoze.lru all 0.7-2 [12.1 kB] 2024-04-24T13:27:18.156 INFO:teuthology.orchestra.run.smithi071.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-routes all 2.5.1-1ubuntu1 [89.0 kB] 2024-04-24T13:27:18.321 INFO:teuthology.orchestra.run.smithi071.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn-lib amd64 0.23.2-5ubuntu6 [2,058 kB] 2024-04-24T13:27:18.341 INFO:teuthology.orchestra.run.smithi138.stdout:Get:65 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-24T13:27:18.777 INFO:teuthology.orchestra.run.smithi138.stdout:Get:66 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-24T13:27:18.783 INFO:teuthology.orchestra.run.smithi138.stdout:Get:67 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-24T13:27:19.026 INFO:teuthology.orchestra.run.smithi071.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-joblib all 0.17.0-4ubuntu1 [204 kB] 2024-04-24T13:27:19.031 INFO:teuthology.orchestra.run.smithi071.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-threadpoolctl all 3.1.0-1 [21.3 kB] 2024-04-24T13:27:19.032 INFO:teuthology.orchestra.run.smithi071.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-sklearn all 0.23.2-5ubuntu6 [1,829 kB] 2024-04-24T13:27:19.072 INFO:teuthology.orchestra.run.smithi138.stdout:Get:68 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-24T13:27:19.072 INFO:teuthology.orchestra.run.smithi138.stdout:Get:69 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-24T13:27:19.074 INFO:teuthology.orchestra.run.smithi138.stdout:Get:70 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-24T13:27:19.076 INFO:teuthology.orchestra.run.smithi138.stdout:Get:71 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-24T13:27:19.078 INFO:teuthology.orchestra.run.smithi138.stdout:Get:72 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-24T13:27:19.080 INFO:teuthology.orchestra.run.smithi138.stdout:Get:73 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-24T13:27:19.081 INFO:teuthology.orchestra.run.smithi138.stdout:Get:74 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-24T13:27:19.082 INFO:teuthology.orchestra.run.smithi138.stdout:Get:75 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-24T13:27:19.108 INFO:teuthology.orchestra.run.smithi071.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-cachetools all 5.0.0-1 [9,722 B] 2024-04-24T13:27:19.108 INFO:teuthology.orchestra.run.smithi071.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1 all 0.4.8-1 [50.9 kB] 2024-04-24T13:27:19.110 INFO:teuthology.orchestra.run.smithi071.stdout:Get:88 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyasn1-modules all 0.2.1-1 [33.0 kB] 2024-04-24T13:27:19.111 INFO:teuthology.orchestra.run.smithi071.stdout:Get:89 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-rsa all 4.8-1 [28.4 kB] 2024-04-24T13:27:19.113 INFO:teuthology.orchestra.run.smithi071.stdout:Get:90 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-google-auth all 1.5.1-3 [35.7 kB] 2024-04-24T13:27:19.114 INFO:teuthology.orchestra.run.smithi071.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-requests-oauthlib all 1.3.0+ds-0.1 [18.7 kB] 2024-04-24T13:27:19.264 INFO:teuthology.orchestra.run.smithi138.stdout:Get:76 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-24T13:27:19.279 INFO:teuthology.orchestra.run.smithi071.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-websocket all 1.2.3-1 [34.7 kB] 2024-04-24T13:27:19.430 INFO:teuthology.orchestra.run.smithi071.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-kubernetes all 12.0.1-1ubuntu1 [353 kB] 2024-04-24T13:27:19.584 INFO:teuthology.orchestra.run.smithi071.stdout:Get:94 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3241-g882080b3-1jammy [124 kB] 2024-04-24T13:27:19.587 INFO:teuthology.orchestra.run.smithi071.stdout:Get:95 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3241-g882080b3-1jammy [38.9 kB] 2024-04-24T13:27:19.588 INFO:teuthology.orchestra.run.smithi071.stdout:Get:96 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3241-g882080b3-1jammy [13.7 MB] 2024-04-24T13:27:19.677 INFO:teuthology.orchestra.run.smithi138.stdout:Get:77 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-24T13:27:19.709 INFO:teuthology.orchestra.run.smithi071.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/main amd64 libonig5 amd64 6.9.7.1-2build1 [172 kB] 2024-04-24T13:27:19.723 INFO:teuthology.orchestra.run.smithi138.stdout:Get:78 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-24T13:27:19.754 INFO:teuthology.orchestra.run.smithi071.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 libjq1 amd64 1.6-2.1ubuntu3 [133 kB] 2024-04-24T13:27:19.759 INFO:teuthology.orchestra.run.smithi138.stdout:Get:79 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-24T13:27:19.779 INFO:teuthology.orchestra.run.smithi071.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/main amd64 jq amd64 1.6-2.1ubuntu3 [52.5 kB] 2024-04-24T13:27:19.788 INFO:teuthology.orchestra.run.smithi071.stdout:Get:100 http://archive.ubuntu.com/ubuntu jammy/main amd64 socat amd64 1.7.4.1-3ubuntu4 [349 kB] 2024-04-24T13:27:19.832 INFO:teuthology.orchestra.run.smithi071.stdout:Get:101 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-24T13:27:19.855 INFO:teuthology.orchestra.run.smithi138.stdout:Get:80 http://archive.ubuntu.com/ubuntu jammy/universe amd64 xmlstarlet amd64 1.6.1-2.1 [265 kB] 2024-04-24T13:27:19.858 INFO:teuthology.orchestra.run.smithi071.stdout:Get:102 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-24T13:27:19.864 INFO:teuthology.orchestra.run.smithi071.stdout:Get:103 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-24T13:27:19.866 INFO:teuthology.orchestra.run.smithi071.stdout:Get:104 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-24T13:27:19.895 INFO:teuthology.orchestra.run.smithi138.stdout:Get:81 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-socket amd64 3.0~rc1+git+ac3201d-6 [78.9 kB] 2024-04-24T13:27:19.902 INFO:teuthology.orchestra.run.smithi071.stdout:Get:105 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-24T13:27:19.907 INFO:teuthology.orchestra.run.smithi138.stdout:Get:82 http://archive.ubuntu.com/ubuntu jammy/universe amd64 lua-sec amd64 1.0.2-1 [37.6 kB] 2024-04-24T13:27:19.912 INFO:teuthology.orchestra.run.smithi138.stdout:Get:83 http://archive.ubuntu.com/ubuntu jammy-updates/main amd64 nvme-cli amd64 1.16-3ubuntu0.1 [474 kB] 2024-04-24T13:27:19.959 INFO:teuthology.orchestra.run.smithi138.stdout:Get:84 http://archive.ubuntu.com/ubuntu jammy/main amd64 pkg-config amd64 0.29.2-1ubuntu3 [48.2 kB] 2024-04-24T13:27:19.961 INFO:teuthology.orchestra.run.smithi071.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3241-g882080b3-1jammy [91.2 kB] 2024-04-24T13:27:19.963 INFO:teuthology.orchestra.run.smithi138.stdout:Get:85 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-24T13:27:19.983 INFO:teuthology.orchestra.run.smithi138.stdout:Get:86 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-24T13:27:20.068 INFO:teuthology.orchestra.run.smithi071.stdout:Get:107 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python-asyncssh-doc all 2.5.0-1 [318 kB] 2024-04-24T13:27:20.149 INFO:teuthology.orchestra.run.smithi138.stdout:Get:87 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-24T13:27:20.253 INFO:teuthology.orchestra.run.smithi138.stdout:Get:88 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 python3-rgw amd64 19.0.0-3241-g882080b3-1jammy [112 kB] 2024-04-24T13:27:20.281 INFO:teuthology.orchestra.run.smithi138.stdout:Get:89 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 libradosstriper1 amd64 19.0.0-3241-g882080b3-1jammy [466 kB] 2024-04-24T13:27:20.354 INFO:teuthology.orchestra.run.smithi138.stdout:Get:90 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-common amd64 19.0.0-3241-g882080b3-1jammy [25.9 MB] 2024-04-24T13:27:20.421 INFO:teuthology.orchestra.run.smithi138.stdout:Get:91 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-24T13:27:20.439 INFO:teuthology.orchestra.run.smithi138.stdout:Get:92 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-24T13:27:20.552 INFO:teuthology.orchestra.run.smithi071.stdout:Get:108 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-iniconfig all 1.1.1-2 [6,024 B] 2024-04-24T13:27:20.552 INFO:teuthology.orchestra.run.smithi071.stdout:Get:109 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pastescript all 2.0.2-4 [54.6 kB] 2024-04-24T13:27:20.563 INFO:teuthology.orchestra.run.smithi071.stdout:Get:110 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pluggy all 0.13.0-7.1 [19.0 kB] 2024-04-24T13:27:20.566 INFO:teuthology.orchestra.run.smithi071.stdout:Get:111 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-psutil amd64 5.9.0-1build1 [158 kB] 2024-04-24T13:27:20.593 INFO:teuthology.orchestra.run.smithi138.stdout:Get:93 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-24T13:27:20.597 INFO:teuthology.orchestra.run.smithi071.stdout:Get:112 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-py all 1.10.0-1 [71.9 kB] 2024-04-24T13:27:20.610 INFO:teuthology.orchestra.run.smithi071.stdout:Get:113 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-24T13:27:20.622 INFO:teuthology.orchestra.run.smithi138.stdout:Get:94 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pygments all 2.11.2+dfsg-2 [750 kB] 2024-04-24T13:27:20.738 INFO:teuthology.orchestra.run.smithi071.stdout:Get:114 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-24T13:27:20.739 INFO:teuthology.orchestra.run.smithi071.stdout:Get:115 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-24T13:27:20.741 INFO:teuthology.orchestra.run.smithi071.stdout:Get:116 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-24T13:27:20.759 INFO:teuthology.orchestra.run.smithi071.stdout:Get:117 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-24T13:27:20.779 INFO:teuthology.orchestra.run.smithi138.stdout:Get:95 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-pyinotify all 0.9.6-1.3 [24.8 kB] 2024-04-24T13:27:20.783 INFO:teuthology.orchestra.run.smithi138.stdout:Get:96 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-toml all 0.10.2-1 [16.5 kB] 2024-04-24T13:27:20.784 INFO:teuthology.orchestra.run.smithi138.stdout:Get:97 http://archive.ubuntu.com/ubuntu jammy/universe amd64 python3-pytest all 6.2.5-1ubuntu2 [214 kB] 2024-04-24T13:27:20.807 INFO:teuthology.orchestra.run.smithi138.stdout:Get:98 http://archive.ubuntu.com/ubuntu jammy/main amd64 python3-simplejson amd64 3.17.6-1build1 [54.7 kB] 2024-04-24T13:27:20.811 INFO:teuthology.orchestra.run.smithi138.stdout:Get:99 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-24T13:27:20.927 INFO:teuthology.orchestra.run.smithi071.stdout:Get:118 http://archive.ubuntu.com/ubuntu jammy/universe amd64 qttranslations5-l10n all 5.15.3-1 [1,983 kB] 2024-04-24T13:27:22.118 INFO:teuthology.orchestra.run.smithi071.stdout:Fetched 181 MB in 8s (23.9 MB/s) 2024-04-24T13:27:22.248 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-24T13:27:22.340 INFO:teuthology.orchestra.run.smithi071.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-24T13:27:22.346 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-24T13:27:22.422 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T13:27:22.742 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-24T13:27:22.768 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-24T13:27:22.809 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T13:27:23.153 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-24T13:27:23.179 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-24T13:27:23.219 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T13:27:23.656 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-24T13:27:23.682 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T13:27:23.732 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T13:27:24.159 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-24T13:27:24.185 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T13:27:24.226 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T13:27:24.554 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-24T13:27:24.580 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T13:27:24.620 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T13:27:24.965 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-24T13:27:24.992 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-24T13:27:25.032 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T13:27:25.335 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librados2. 2024-04-24T13:27:25.360 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../007-librados2_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:25.401 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librados2 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:25.854 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librbd1. 2024-04-24T13:27:25.880 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../008-librbd1_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:25.920 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librbd1 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:26.374 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libcephfs2. 2024-04-24T13:27:26.399 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:26.440 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libcephfs2 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:26.718 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rados. 2024-04-24T13:27:26.744 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:26.776 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rados (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:27.371 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-24T13:27:27.397 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:27:27.437 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-ceph-argparse (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:27.698 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cephfs. 2024-04-24T13:27:27.713 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:27.756 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cephfs (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:28.117 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-24T13:27:28.143 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:27:28.184 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-ceph-common (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:28.503 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-24T13:27:28.529 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-24T13:27:28.570 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T13:27:28.889 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-prettytable. 2024-04-24T13:27:28.915 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-24T13:27:28.956 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-24T13:27:29.014 INFO:teuthology.orchestra.run.smithi138.stdout:Get:100 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-base amd64 19.0.0-3241-g882080b3-1jammy [5,092 kB] 2024-04-24T13:27:29.200 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rbd. 2024-04-24T13:27:29.215 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:29.250 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rbd (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:29.569 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-24T13:27:29.596 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-24T13:27:29.636 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T13:27:29.782 INFO:teuthology.orchestra.run.smithi138.stdout:Get:101 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-modules-core all 19.0.0-3241-g882080b3-1jammy [244 kB] 2024-04-24T13:27:29.817 INFO:teuthology.orchestra.run.smithi138.stdout:Get:102 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 libsqlite3-mod-ceph amd64 19.0.0-3241-g882080b3-1jammy [124 kB] 2024-04-24T13:27:29.821 INFO:teuthology.orchestra.run.smithi138.stdout:Get:103 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr amd64 19.0.0-3241-g882080b3-1jammy [1,526 kB] 2024-04-24T13:27:29.922 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-24T13:27:29.937 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-24T13:27:29.980 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T13:27:30.067 INFO:teuthology.orchestra.run.smithi138.stdout:Get:104 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mon amd64 19.0.0-3241-g882080b3-1jammy [6,258 kB] 2024-04-24T13:27:30.258 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-24T13:27:30.273 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-24T13:27:30.316 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T13:27:30.653 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package lua5.1. 2024-04-24T13:27:30.679 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-24T13:27:30.719 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-24T13:27:30.961 INFO:teuthology.orchestra.run.smithi138.stdout:Get:105 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-osd amd64 19.0.0-3241-g882080b3-1jammy [22.8 MB] 2024-04-24T13:27:31.039 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package lua-any. 2024-04-24T13:27:31.054 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-24T13:27:31.097 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-24T13:27:31.316 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package zip. 2024-04-24T13:27:31.332 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-24T13:27:31.375 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking zip (3.0-12build2) ... 2024-04-24T13:27:31.728 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package unzip. 2024-04-24T13:27:31.754 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-24T13:27:31.794 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-24T13:27:32.224 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package luarocks. 2024-04-24T13:27:32.250 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-24T13:27:32.290 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-24T13:27:32.873 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package librgw2. 2024-04-24T13:27:32.899 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../025-librgw2_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:32.931 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking librgw2 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:33.475 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rgw. 2024-04-24T13:27:33.502 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:33.542 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rgw (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:33.758 INFO:teuthology.orchestra.run.smithi138.stdout:Get:106 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph amd64 19.0.0-3241-g882080b3-1jammy [14.0 kB] 2024-04-24T13:27:33.759 INFO:teuthology.orchestra.run.smithi138.stdout:Get:107 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-fuse amd64 19.0.0-3241-g882080b3-1jammy [870 kB] 2024-04-24T13:27:33.792 INFO:teuthology.orchestra.run.smithi138.stdout:Get:108 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mds amd64 19.0.0-3241-g882080b3-1jammy [2,437 kB] 2024-04-24T13:27:33.894 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-24T13:27:33.921 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-24T13:27:33.961 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T13:27:34.010 INFO:teuthology.orchestra.run.smithi138.stdout:Get:109 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 cephadm amd64 19.0.0-3241-g882080b3-1jammy [791 kB] 2024-04-24T13:27:34.082 INFO:teuthology.orchestra.run.smithi138.stdout:Get:110 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-cephadm all 19.0.0-3241-g882080b3-1jammy [148 kB] 2024-04-24T13:27:34.085 INFO:teuthology.orchestra.run.smithi138.stdout:Get:111 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-dashboard all 19.0.0-3241-g882080b3-1jammy [2,297 kB] 2024-04-24T13:27:34.280 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libradosstriper1. 2024-04-24T13:27:34.296 INFO:teuthology.orchestra.run.smithi138.stdout:Get:112 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-diskprediction-local all 19.0.0-3241-g882080b3-1jammy [8,625 kB] 2024-04-24T13:27:34.307 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:34.347 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libradosstriper1 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:34.750 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-common. 2024-04-24T13:27:34.777 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:34.817 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-common (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:35.113 INFO:teuthology.orchestra.run.smithi138.stdout:Get:113 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-mgr-k8sevents all 19.0.0-3241-g882080b3-1jammy [14.2 kB] 2024-04-24T13:27:35.113 INFO:teuthology.orchestra.run.smithi138.stdout:Get:114 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-test amd64 19.0.0-3241-g882080b3-1jammy [51.7 MB] 2024-04-24T13:27:36.205 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-base. 2024-04-24T13:27:36.232 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:36.281 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-base (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:36.818 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-24T13:27:36.844 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-24T13:27:36.876 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-24T13:27:37.145 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cheroot. 2024-04-24T13:27:37.172 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-24T13:27:37.212 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T13:27:37.549 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-24T13:27:37.575 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-24T13:27:37.615 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-24T13:27:37.910 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-24T13:27:37.936 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-24T13:27:37.976 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-24T13:27:38.245 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-24T13:27:38.272 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-24T13:27:38.312 INFO:teuthology.orchestra.run.smithi138.stdout:Get:115 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 ceph-volume all 19.0.0-3241-g882080b3-1jammy [124 kB] 2024-04-24T13:27:38.312 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-24T13:27:38.314 INFO:teuthology.orchestra.run.smithi138.stdout:Get:116 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 libcephfs-dev amd64 19.0.0-3241-g882080b3-1jammy [38.9 kB] 2024-04-24T13:27:38.315 INFO:teuthology.orchestra.run.smithi138.stdout:Get:117 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 radosgw amd64 19.0.0-3241-g882080b3-1jammy [13.7 MB] 2024-04-24T13:27:38.623 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-tempora. 2024-04-24T13:27:38.650 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-24T13:27:38.690 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-24T13:27:38.714 INFO:teuthology.orchestra.run.smithi138.stdout:Get:118 https://3.chacra.ceph.com/r/ceph/wip-cbodley-testing/882080b304cb1602e69c11bc5fe8479e7d2bc64d/ubuntu/jammy/flavors/default jammy/main amd64 rbd-fuse amd64 19.0.0-3241-g882080b3-1jammy [91.2 kB] 2024-04-24T13:27:38.995 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-portend. 2024-04-24T13:27:39.019 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-24T13:27:39.059 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-24T13:27:39.332 INFO:teuthology.orchestra.run.smithi138.stdout:Fetched 181 MB in 25s (7,291 kB/s) 2024-04-24T13:27:39.362 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-24T13:27:39.388 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-24T13:27:39.420 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-24T13:27:39.491 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblttng-ust1:amd64. 2024-04-24T13:27:39.592 INFO:teuthology.orchestra.run.smithi138.stdout:(Reading database ... (Reading database ... 5% (Reading database ... 10% (Reading database ... 15% (Reading database ... 20% (Reading database ... 25% (Reading database ... 30% (Reading database ... 35% (Reading database ... 40% (Reading database ... 45% (Reading database ... 50% (Reading database ... 55% (Reading database ... 60% (Reading database ... 65% (Reading database ... 70% (Reading database ... 75% (Reading database ... 80% (Reading database ... 85% (Reading database ... 90% (Reading database ... 95% (Reading database ... 100% (Reading database ... 165995 files and directories currently installed.) 2024-04-24T13:27:39.597 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../000-liblttng-ust1_2.13.1-1ubuntu1_amd64.deb ... 2024-04-24T13:27:39.674 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T13:27:39.706 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-24T13:27:39.733 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-24T13:27:39.773 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-24T13:27:39.994 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libdouble-conversion3:amd64. 2024-04-24T13:27:40.022 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../001-libdouble-conversion3_3.1.7-4_amd64.deb ... 2024-04-24T13:27:40.061 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T13:27:40.102 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-natsort. 2024-04-24T13:27:40.128 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-24T13:27:40.160 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-24T13:27:40.396 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libpcre2-16-0:amd64. 2024-04-24T13:27:40.423 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../002-libpcre2-16-0_10.39-3ubuntu0.1_amd64.deb ... 2024-04-24T13:27:40.438 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-logutils. 2024-04-24T13:27:40.463 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T13:27:40.464 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-24T13:27:40.504 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-24T13:27:40.807 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-24T13:27:40.834 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-24T13:27:40.858 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5core5a:amd64. 2024-04-24T13:27:40.874 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-24T13:27:40.885 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../003-libqt5core5a_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T13:27:40.934 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T13:27:41.176 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-mako. 2024-04-24T13:27:41.203 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-24T13:27:41.243 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T13:27:41.336 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5dbus5:amd64. 2024-04-24T13:27:41.363 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../004-libqt5dbus5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T13:27:41.403 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T13:27:41.554 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-24T13:27:41.581 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-24T13:27:41.621 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-24T13:27:41.748 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libqt5network5:amd64. 2024-04-24T13:27:41.774 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../005-libqt5network5_5.15.3+dfsg-2ubuntu0.2_amd64.deb ... 2024-04-24T13:27:41.814 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T13:27:41.899 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-24T13:27:41.926 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-24T13:27:41.965 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-24T13:27:42.270 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-webob. 2024-04-24T13:27:42.294 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-24T13:27:42.309 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libthrift-0.16.0:amd64. 2024-04-24T13:27:42.335 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-24T13:27:42.335 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../006-libthrift-0.16.0_0.16.0-2_amd64.deb ... 2024-04-24T13:27:42.376 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T13:27:42.663 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-waitress. 2024-04-24T13:27:42.678 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-24T13:27:42.695 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librados2. 2024-04-24T13:27:42.716 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T13:27:42.721 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../007-librados2_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:42.762 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librados2 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:43.165 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librbd1. 2024-04-24T13:27:43.180 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../008-librbd1_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:43.191 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-tempita. 2024-04-24T13:27:43.217 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-24T13:27:43.223 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librbd1 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:43.257 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T13:27:43.560 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-paste. 2024-04-24T13:27:43.586 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-24T13:27:43.626 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T13:27:43.651 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs2. 2024-04-24T13:27:43.677 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../009-libcephfs2_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:43.717 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs2 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:43.946 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-24T13:27:43.974 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-24T13:27:44.003 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rados. 2024-04-24T13:27:44.013 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T13:27:44.018 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../010-python3-rados_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:44.061 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rados (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:44.341 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-24T13:27:44.367 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-24T13:27:44.389 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-argparse. 2024-04-24T13:27:44.407 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-24T13:27:44.416 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../011-python3-ceph-argparse_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:27:44.456 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-argparse (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:44.685 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-webtest. 2024-04-24T13:27:44.691 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cephfs. 2024-04-24T13:27:44.707 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../012-python3-cephfs_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:44.712 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-24T13:27:44.742 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cephfs (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:44.752 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-24T13:27:45.004 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pecan. 2024-04-24T13:27:45.019 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-24T13:27:45.054 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T13:27:45.069 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-ceph-common. 2024-04-24T13:27:45.095 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../013-python3-ceph-common_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:27:45.136 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-ceph-common (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:45.368 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-certifi. 2024-04-24T13:27:45.394 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-24T13:27:45.434 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-24T13:27:45.455 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-wcwidth. 2024-04-24T13:27:45.482 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../014-python3-wcwidth_0.2.5+dfsg1-1_all.deb ... 2024-04-24T13:27:45.522 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T13:27:45.770 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-idna. 2024-04-24T13:27:45.797 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-24T13:27:45.837 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-24T13:27:45.841 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-prettytable. 2024-04-24T13:27:45.868 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../015-python3-prettytable_2.5.0-2_all.deb ... 2024-04-24T13:27:45.908 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-prettytable (2.5.0-2) ... 2024-04-24T13:27:46.156 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-urllib3. 2024-04-24T13:27:46.160 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rbd. 2024-04-24T13:27:46.176 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../016-python3-rbd_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:46.182 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-24T13:27:46.210 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rbd (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:46.222 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T13:27:46.530 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librdkafka1:amd64. 2024-04-24T13:27:46.557 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../017-librdkafka1_1.8.0-1build1_amd64.deb ... 2024-04-24T13:27:46.559 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-requests. 2024-04-24T13:27:46.586 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-24T13:27:46.597 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T13:27:46.626 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T13:27:46.895 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libreadline-dev:amd64. 2024-04-24T13:27:46.912 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-24T13:27:46.922 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../018-libreadline-dev_8.1.2-1_amd64.deb ... 2024-04-24T13:27:46.938 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-24T13:27:46.966 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T13:27:46.978 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T13:27:47.766 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-24T13:27:47.793 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:27:48.011 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liblua5.3-dev:amd64. 2024-04-24T13:27:48.027 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../019-liblua5.3-dev_5.3.6-1build1_amd64.deb ... 2024-04-24T13:27:48.069 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T13:27:48.182 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:48.406 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua5.1. 2024-04-24T13:27:48.433 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../020-lua5.1_5.1.5-8.1build4_amd64.deb ... 2024-04-24T13:27:48.472 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua5.1 (5.1.5-8.1build4) ... 2024-04-24T13:27:48.537 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-24T13:27:48.564 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:48.603 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:48.767 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-any. 2024-04-24T13:27:48.794 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../021-lua-any_27ubuntu1_all.deb ... 2024-04-24T13:27:48.834 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-any (27ubuntu1) ... 2024-04-24T13:27:48.914 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-24T13:27:48.941 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-24T13:27:48.981 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-24T13:27:49.070 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package zip. 2024-04-24T13:27:49.085 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../022-zip_3.0-12build2_amd64.deb ... 2024-04-24T13:27:49.128 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking zip (3.0-12build2) ... 2024-04-24T13:27:49.234 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-openssl. 2024-04-24T13:27:49.261 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-24T13:27:49.292 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-24T13:27:49.439 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package unzip. 2024-04-24T13:27:49.466 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../023-unzip_6.0-26ubuntu3.2_amd64.deb ... 2024-04-24T13:27:49.514 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking unzip (6.0-26ubuntu3.2) ... 2024-04-24T13:27:49.628 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr. 2024-04-24T13:27:49.655 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:49.695 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:49.860 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package luarocks. 2024-04-24T13:27:49.887 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../024-luarocks_3.8.0+dfsg1-1_all.deb ... 2024-04-24T13:27:49.918 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking luarocks (3.8.0+dfsg1-1) ... 2024-04-24T13:27:50.123 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mon. 2024-04-24T13:27:50.150 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:50.189 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mon (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:50.292 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package librgw2. 2024-04-24T13:27:50.319 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../025-librgw2_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:50.359 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking librgw2 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:50.802 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-osd. 2024-04-24T13:27:50.829 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:50.884 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-osd (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:50.911 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rgw. 2024-04-24T13:27:50.926 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../026-python3-rgw_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:50.989 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rgw (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:51.306 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package liboath0:amd64. 2024-04-24T13:27:51.332 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../027-liboath0_2.6.7-3build1_amd64.deb ... 2024-04-24T13:27:51.364 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T13:27:51.659 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libradosstriper1. 2024-04-24T13:27:51.685 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../028-libradosstriper1_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:51.725 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libradosstriper1 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:51.996 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph. 2024-04-24T13:27:52.023 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../066-ceph_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:52.071 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:52.145 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-common. 2024-04-24T13:27:52.172 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../029-ceph-common_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:52.211 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-common (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:52.449 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-fuse. 2024-04-24T13:27:52.476 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:52.515 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-fuse (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:52.877 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mds. 2024-04-24T13:27:52.904 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:52.943 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mds (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:53.517 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-base. 2024-04-24T13:27:53.544 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../030-ceph-base_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:53.576 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package cephadm. 2024-04-24T13:27:53.585 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-base (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:53.602 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../069-cephadm_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:27:53.662 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking cephadm (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:54.041 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-24T13:27:54.067 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-24T13:27:54.115 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-24T13:27:54.155 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.functools. 2024-04-24T13:27:54.181 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../031-python3-jaraco.functools_3.4.0-2_all.deb ... 2024-04-24T13:27:54.221 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.functools (3.4.0-2) ... 2024-04-24T13:27:54.468 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-24T13:27:54.483 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T13:27:54.507 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cheroot. 2024-04-24T13:27:54.535 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../032-python3-cheroot_8.5.2+ds1-1ubuntu3.1_all.deb ... 2024-04-24T13:27:54.535 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T13:27:54.574 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T13:27:54.894 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.classes. 2024-04-24T13:27:54.920 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../033-python3-jaraco.classes_3.2.1-3_all.deb ... 2024-04-24T13:27:54.960 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.classes (3.2.1-3) ... 2024-04-24T13:27:55.288 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.text. 2024-04-24T13:27:55.315 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../034-python3-jaraco.text_3.6.0-2_all.deb ... 2024-04-24T13:27:55.354 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.text (3.6.0-2) ... 2024-04-24T13:27:55.548 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-babel. 2024-04-24T13:27:55.574 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T13:27:55.605 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T13:27:55.641 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jaraco.collections. 2024-04-24T13:27:55.656 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../035-python3-jaraco.collections_3.4.0-2_all.deb ... 2024-04-24T13:27:55.691 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jaraco.collections (3.4.0-2) ... 2024-04-24T13:27:55.876 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-jinja2. 2024-04-24T13:27:55.902 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-24T13:27:55.942 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T13:27:55.969 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempora. 2024-04-24T13:27:55.995 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../036-python3-tempora_4.1.2-1_all.deb ... 2024-04-24T13:27:56.035 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempora (4.1.2-1) ... 2024-04-24T13:27:56.262 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-24T13:27:56.288 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:27:56.328 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:56.338 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-portend. 2024-04-24T13:27:56.365 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../037-python3-portend_3.0.0-1_all.deb ... 2024-04-24T13:27:56.404 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-portend (3.0.0-1) ... 2024-04-24T13:27:56.639 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-24T13:27:56.666 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-24T13:27:56.707 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-24T13:27:56.716 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-zc.lockfile. 2024-04-24T13:27:56.743 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../038-python3-zc.lockfile_2.0-1_all.deb ... 2024-04-24T13:27:56.782 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-zc.lockfile (2.0-1) ... 2024-04-24T13:27:57.009 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-routes. 2024-04-24T13:27:57.036 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-24T13:27:57.043 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cherrypy3. 2024-04-24T13:27:57.059 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../039-python3-cherrypy3_18.6.1-4_all.deb ... 2024-04-24T13:27:57.075 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T13:27:57.093 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cherrypy3 (18.6.1-4) ... 2024-04-24T13:27:57.395 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-24T13:27:57.422 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:27:57.455 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-natsort. 2024-04-24T13:27:57.461 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:27:57.482 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../040-python3-natsort_8.0.2-1_all.deb ... 2024-04-24T13:27:57.522 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-natsort (8.0.2-1) ... 2024-04-24T13:27:57.833 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-logutils. 2024-04-24T13:27:57.860 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../041-python3-logutils_0.3.3-8_all.deb ... 2024-04-24T13:27:57.900 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-logutils (0.3.3-8) ... 2024-04-24T13:27:58.203 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-markupsafe. 2024-04-24T13:27:58.229 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../042-python3-markupsafe_2.0.1-2build1_amd64.deb ... 2024-04-24T13:27:58.269 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-markupsafe (2.0.1-2build1) ... 2024-04-24T13:27:58.547 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-mako. 2024-04-24T13:27:58.574 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../043-python3-mako_1.1.3+ds1-2ubuntu0.1_all.deb ... 2024-04-24T13:27:58.613 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T13:27:58.758 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-24T13:27:58.786 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-24T13:27:58.835 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T13:27:58.917 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplegeneric. 2024-04-24T13:27:58.944 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../044-python3-simplegeneric_0.8.1-3_all.deb ... 2024-04-24T13:27:58.983 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplegeneric (0.8.1-3) ... 2024-04-24T13:27:59.261 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-singledispatch. 2024-04-24T13:27:59.288 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../045-python3-singledispatch_3.4.0.3-3_all.deb ... 2024-04-24T13:27:59.328 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-singledispatch (3.4.0.3-3) ... 2024-04-24T13:27:59.328 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-joblib. 2024-04-24T13:27:59.356 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-24T13:27:59.395 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T13:27:59.622 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webob. 2024-04-24T13:27:59.649 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../046-python3-webob_1%3a1.8.6-1.1_all.deb ... 2024-04-24T13:27:59.689 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webob (1:1.8.6-1.1) ... 2024-04-24T13:27:59.759 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-24T13:27:59.786 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-24T13:27:59.825 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-24T13:28:00.042 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-waitress. 2024-04-24T13:28:00.069 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../047-python3-waitress_1.4.4-1.1ubuntu1_all.deb ... 2024-04-24T13:28:00.103 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-sklearn. 2024-04-24T13:28:00.112 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T13:28:00.130 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-24T13:28:00.161 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T13:28:00.403 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-tempita. 2024-04-24T13:28:00.430 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../048-python3-tempita_0.5.2-6ubuntu1_all.deb ... 2024-04-24T13:28:00.469 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T13:28:00.731 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-paste. 2024-04-24T13:28:00.758 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../049-python3-paste_3.5.0+dfsg1-1_all.deb ... 2024-04-24T13:28:00.797 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T13:28:00.954 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-24T13:28:00.981 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:28:01.114 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:01.119 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-pastedeploy-tpl. 2024-04-24T13:28:01.135 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../050-python-pastedeploy-tpl_2.1.1-1_all.deb ... 2024-04-24T13:28:01.178 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T13:28:01.448 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastedeploy. 2024-04-24T13:28:01.474 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../051-python3-pastedeploy_2.1.1-1_all.deb ... 2024-04-24T13:28:01.514 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastedeploy (2.1.1-1) ... 2024-04-24T13:28:01.801 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-webtest. 2024-04-24T13:28:01.828 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../052-python3-webtest_2.0.35-1_all.deb ... 2024-04-24T13:28:01.868 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-webtest (2.0.35-1) ... 2024-04-24T13:28:02.077 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-cachetools. 2024-04-24T13:28:02.104 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-24T13:28:02.143 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-24T13:28:02.213 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pecan. 2024-04-24T13:28:02.239 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../053-python3-pecan_1.3.3-4ubuntu2_all.deb ... 2024-04-24T13:28:02.279 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T13:28:02.463 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-24T13:28:02.490 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-24T13:28:02.529 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-24T13:28:02.644 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-certifi. 2024-04-24T13:28:02.670 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../054-python3-certifi_2020.6.20-1_all.deb ... 2024-04-24T13:28:02.710 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-certifi (2020.6.20-1) ... 2024-04-24T13:28:02.866 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-24T13:28:02.894 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-24T13:28:02.941 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T13:28:03.047 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-idna. 2024-04-24T13:28:03.073 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../055-python3-idna_3.3-1_all.deb ... 2024-04-24T13:28:03.113 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-idna (3.3-1) ... 2024-04-24T13:28:03.236 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-rsa. 2024-04-24T13:28:03.264 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-24T13:28:03.295 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-24T13:28:03.425 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-urllib3. 2024-04-24T13:28:03.452 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../056-python3-urllib3_1.26.5-1~exp1ubuntu0.1_all.deb ... 2024-04-24T13:28:03.492 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T13:28:03.624 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-google-auth. 2024-04-24T13:28:03.651 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-24T13:28:03.690 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-24T13:28:03.796 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests. 2024-04-24T13:28:03.823 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../057-python3-requests_2.25.1+dfsg-2ubuntu0.1_all.deb ... 2024-04-24T13:28:03.862 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T13:28:04.174 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-werkzeug. 2024-04-24T13:28:04.201 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../058-python3-werkzeug_2.0.2+dfsg1-1ubuntu0.22.04.1_all.deb ... 2024-04-24T13:28:04.211 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-24T13:28:04.238 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-24T13:28:04.241 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T13:28:04.277 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T13:28:04.536 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-modules-core. 2024-04-24T13:28:04.552 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../059-ceph-mgr-modules-core_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:28:04.595 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-modules-core (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:04.597 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-websocket. 2024-04-24T13:28:04.624 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-24T13:28:04.663 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-24T13:28:04.967 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-24T13:28:04.975 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libsqlite3-mod-ceph. 2024-04-24T13:28:04.994 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-24T13:28:05.002 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../060-libsqlite3-mod-ceph_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:05.033 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T13:28:05.041 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libsqlite3-mod-ceph (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:05.303 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-bcrypt. 2024-04-24T13:28:05.330 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../061-python3-bcrypt_3.2.0-1build1_amd64.deb ... 2024-04-24T13:28:05.370 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-bcrypt (3.2.0-1build1) ... 2024-04-24T13:28:05.673 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-openssl. 2024-04-24T13:28:05.700 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../062-python3-openssl_21.0.0-1_all.deb ... 2024-04-24T13:28:05.723 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-24T13:28:05.740 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-openssl (21.0.0-1) ... 2024-04-24T13:28:05.751 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:28:05.789 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:06.085 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr. 2024-04-24T13:28:06.109 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-24T13:28:06.112 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../063-ceph-mgr_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:06.137 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-24T13:28:06.152 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:06.176 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T13:28:06.497 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mon. 2024-04-24T13:28:06.524 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../064-ceph-mon_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:06.529 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-24T13:28:06.557 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T13:28:06.563 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mon (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:06.595 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T13:28:06.856 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package jq. 2024-04-24T13:28:06.873 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T13:28:06.915 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-24T13:28:07.126 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-osd. 2024-04-24T13:28:07.143 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package socat. 2024-04-24T13:28:07.153 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../065-ceph-osd_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:07.159 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-24T13:28:07.193 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-osd (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:07.193 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-24T13:28:07.455 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package xmlstarlet. 2024-04-24T13:28:07.471 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-24T13:28:07.512 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-24T13:28:07.884 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-test. 2024-04-24T13:28:07.911 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:07.950 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-test (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:08.371 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph. 2024-04-24T13:28:08.387 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../066-ceph_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:08.421 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:08.758 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-fuse. 2024-04-24T13:28:08.785 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../067-ceph-fuse_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:08.824 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-fuse (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:09.212 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mds. 2024-04-24T13:28:09.238 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../068-ceph-mds_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:09.278 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mds (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:09.648 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package cephadm. 2024-04-24T13:28:09.663 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../069-cephadm_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:09.698 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking cephadm (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:10.010 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-asyncssh. 2024-04-24T13:28:10.037 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../070-python3-asyncssh_2.5.0-1_all.deb ... 2024-04-24T13:28:10.076 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-asyncssh (2.5.0-1) ... 2024-04-24T13:28:10.305 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package ceph-volume. 2024-04-24T13:28:10.332 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:28:10.363 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-babel-localedata. 2024-04-24T13:28:10.363 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking ceph-volume (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:10.390 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../071-python-babel-localedata_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T13:28:10.429 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T13:28:10.634 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-24T13:28:10.650 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:10.684 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking libcephfs-dev (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:11.004 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-24T13:28:11.031 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-24T13:28:11.070 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T13:28:11.417 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-24T13:28:11.444 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-24T13:28:11.483 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-24T13:28:11.485 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-babel. 2024-04-24T13:28:11.512 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../072-python3-babel_2.8.0+dfsg.1-7_all.deb ... 2024-04-24T13:28:11.552 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T13:28:11.813 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package nvme-cli. 2024-04-24T13:28:11.840 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-24T13:28:11.871 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T13:28:11.871 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-jinja2. 2024-04-24T13:28:11.899 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../073-python3-jinja2_3.0.3-1ubuntu0.1_all.deb ... 2024-04-24T13:28:11.938 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T13:28:12.242 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-cephadm. 2024-04-24T13:28:12.257 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../074-ceph-mgr-cephadm_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:28:12.291 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-cephadm (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:12.318 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package pkg-config. 2024-04-24T13:28:12.345 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-24T13:28:12.384 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T13:28:12.604 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-repoze.lru. 2024-04-24T13:28:12.631 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../075-python3-repoze.lru_0.7-2_all.deb ... 2024-04-24T13:28:12.646 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-24T13:28:12.662 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-24T13:28:12.671 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-repoze.lru (0.7-2) ... 2024-04-24T13:28:12.704 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-24T13:28:12.974 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-routes. 2024-04-24T13:28:13.001 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../076-python3-routes_2.5.1-1ubuntu1_all.deb ... 2024-04-24T13:28:13.041 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T13:28:13.149 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-24T13:28:13.178 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-24T13:28:13.216 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-24T13:28:13.378 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-dashboard. 2024-04-24T13:28:13.405 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../077-ceph-mgr-dashboard_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:28:13.444 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-dashboard (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:13.519 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pastescript. 2024-04-24T13:28:13.546 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-24T13:28:13.585 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-24T13:28:13.897 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pluggy. 2024-04-24T13:28:13.925 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-24T13:28:13.963 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-24T13:28:14.259 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-psutil. 2024-04-24T13:28:14.286 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-24T13:28:14.325 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-24T13:28:14.645 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-py. 2024-04-24T13:28:14.673 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-24T13:28:14.714 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-24T13:28:14.767 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn-lib:amd64. 2024-04-24T13:28:14.798 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../078-python3-sklearn-lib_0.23.2-5ubuntu6_amd64.deb ... 2024-04-24T13:28:14.834 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T13:28:15.015 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pygments. 2024-04-24T13:28:15.043 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-24T13:28:15.082 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T13:28:15.313 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-joblib. 2024-04-24T13:28:15.341 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../079-python3-joblib_0.17.0-4ubuntu1_all.deb ... 2024-04-24T13:28:15.379 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T13:28:15.561 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-24T13:28:15.588 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-24T13:28:15.627 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-24T13:28:15.767 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-threadpoolctl. 2024-04-24T13:28:15.794 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../080-python3-threadpoolctl_3.1.0-1_all.deb ... 2024-04-24T13:28:15.833 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-threadpoolctl (3.1.0-1) ... 2024-04-24T13:28:15.939 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-toml. 2024-04-24T13:28:15.966 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-24T13:28:16.005 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-24T13:28:16.145 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-sklearn. 2024-04-24T13:28:16.172 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../081-python3-sklearn_0.23.2-5ubuntu6_all.deb ... 2024-04-24T13:28:16.211 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T13:28:16.283 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-pytest. 2024-04-24T13:28:16.311 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-24T13:28:16.358 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T13:28:16.687 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package python3-simplejson. 2024-04-24T13:28:16.714 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-24T13:28:16.753 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-24T13:28:16.889 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-diskprediction-local. 2024-04-24T13:28:16.916 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../082-ceph-mgr-diskprediction-local_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:28:17.023 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-24T13:28:17.032 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-diskprediction-local (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:17.050 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-24T13:28:17.089 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-24T13:28:17.894 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package radosgw. 2024-04-24T13:28:17.921 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../116-radosgw_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:17.960 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking radosgw (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:18.020 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-cachetools. 2024-04-24T13:28:18.048 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../083-python3-cachetools_5.0.0-1_all.deb ... 2024-04-24T13:28:18.086 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-cachetools (5.0.0-1) ... 2024-04-24T13:28:18.373 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1. 2024-04-24T13:28:18.389 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../084-python3-pyasn1_0.4.8-1_all.deb ... 2024-04-24T13:28:18.423 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1 (0.4.8-1) ... 2024-04-24T13:28:18.719 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyasn1-modules. 2024-04-24T13:28:18.746 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../085-python3-pyasn1-modules_0.2.1-1_all.deb ... 2024-04-24T13:28:18.763 INFO:teuthology.orchestra.run.smithi071.stdout:Selecting previously unselected package rbd-fuse. 2024-04-24T13:28:18.779 INFO:teuthology.orchestra.run.smithi071.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:18.785 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T13:28:18.821 INFO:teuthology.orchestra.run.smithi071.stdout:Unpacking rbd-fuse (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:19.081 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-rsa. 2024-04-24T13:28:19.108 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../086-python3-rsa_4.8-1_all.deb ... 2024-04-24T13:28:19.135 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-24T13:28:19.147 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-rsa (4.8-1) ... 2024-04-24T13:28:19.411 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T13:28:19.468 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-google-auth. 2024-04-24T13:28:19.495 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../087-python3-google-auth_1.5.1-3_all.deb ... 2024-04-24T13:28:19.535 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-google-auth (1.5.1-3) ... 2024-04-24T13:28:19.536 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T13:28:19.777 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-24T13:28:19.889 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-requests-oauthlib. 2024-04-24T13:28:19.916 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../088-python3-requests-oauthlib_1.3.0+ds-0.1_all.deb ... 2024-04-24T13:28:19.955 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T13:28:20.138 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-24T13:28:20.237 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-websocket. 2024-04-24T13:28:20.261 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../089-python3-websocket_1.2.3-1_all.deb ... 2024-04-24T13:28:20.293 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-websocket (1.2.3-1) ... 2024-04-24T13:28:20.564 INFO:teuthology.orchestra.run.smithi071.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-24T13:28:20.605 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-kubernetes. 2024-04-24T13:28:20.632 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../090-python3-kubernetes_12.0.1-1ubuntu1_all.deb ... 2024-04-24T13:28:20.643 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up cephadm (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:20.671 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T13:28:21.113 INFO:teuthology.orchestra.run.smithi071.stdout:Adding system user cephadm....done 2024-04-24T13:28:21.228 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T13:28:21.386 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-mgr-k8sevents. 2024-04-24T13:28:21.414 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../091-ceph-mgr-k8sevents_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:28:21.452 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-mgr-k8sevents (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:21.522 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-24T13:28:21.781 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libonig5:amd64. 2024-04-24T13:28:21.806 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-24T13:28:21.808 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../092-libonig5_6.9.7.1-2build1_amd64.deb ... 2024-04-24T13:28:21.847 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T13:28:21.907 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-24T13:28:22.150 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-24T13:28:22.159 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libjq1:amd64. 2024-04-24T13:28:22.186 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../093-libjq1_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T13:28:22.225 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T13:28:22.410 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T13:28:22.496 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package jq. 2024-04-24T13:28:22.511 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../094-jq_1.6-2.1ubuntu3_amd64.deb ... 2024-04-24T13:28:22.536 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-24T13:28:22.545 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking jq (1.6-2.1ubuntu3) ... 2024-04-24T13:28:22.773 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package socat. 2024-04-24T13:28:22.801 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../095-socat_1.7.4.1-3ubuntu4_amd64.deb ... 2024-04-24T13:28:22.837 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T13:28:22.840 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking socat (1.7.4.1-3ubuntu4) ... 2024-04-24T13:28:23.152 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package xmlstarlet. 2024-04-24T13:28:23.179 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../096-xmlstarlet_1.6.1-2.1_amd64.deb ... 2024-04-24T13:28:23.198 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-24T13:28:23.219 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking xmlstarlet (1.6.1-2.1) ... 2024-04-24T13:28:23.441 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-24T13:28:23.557 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-test. 2024-04-24T13:28:23.570 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../097-ceph-test_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:23.607 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-test (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:23.709 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-24T13:28:23.961 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-24T13:28:24.212 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-24T13:28:24.471 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-24T13:28:24.723 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-ceph-argparse (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:24.974 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T13:28:25.108 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T13:28:25.234 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T13:28:25.361 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-24T13:28:25.663 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-24T13:28:25.796 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package ceph-volume. 2024-04-24T13:28:25.824 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../098-ceph-volume_19.0.0-3241-g882080b3-1jammy_all.deb ... 2024-04-24T13:28:25.862 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking ceph-volume (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:26.061 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-24T13:28:26.093 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-24T13:28:26.149 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T13:28:26.175 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package libcephfs-dev. 2024-04-24T13:28:26.203 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../099-libcephfs-dev_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:26.242 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking libcephfs-dev (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:26.277 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-24T13:28:26.562 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-socket:amd64. 2024-04-24T13:28:26.590 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../100-lua-socket_3.0~rc1+git+ac3201d-6_amd64.deb ... 2024-04-24T13:28:26.628 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T13:28:26.634 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T13:28:26.760 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-24T13:28:26.933 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package lua-sec:amd64. 2024-04-24T13:28:26.949 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../101-lua-sec_1.0.2-1_amd64.deb ... 2024-04-24T13:28:26.983 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking lua-sec:amd64 (1.0.2-1) ... 2024-04-24T13:28:27.037 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T13:28:27.313 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-24T13:28:27.355 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package nvme-cli. 2024-04-24T13:28:27.383 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../102-nvme-cli_1.16-3ubuntu0.1_amd64.deb ... 2024-04-24T13:28:27.421 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T13:28:27.622 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up zip (3.0-12build2) ... 2024-04-24T13:28:27.732 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T13:28:27.794 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package pkg-config. 2024-04-24T13:28:27.822 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../103-pkg-config_0.29.2-1ubuntu3_amd64.deb ... 2024-04-24T13:28:27.877 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T13:28:28.131 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python-asyncssh-doc. 2024-04-24T13:28:28.147 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../104-python-asyncssh-doc_2.5.0-1_all.deb ... 2024-04-24T13:28:28.189 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python-asyncssh-doc (2.5.0-1) ... 2024-04-24T13:28:28.376 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T13:28:28.644 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T13:28:28.753 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-24T13:28:28.759 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-iniconfig. 2024-04-24T13:28:28.788 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../105-python3-iniconfig_1.1.1-2_all.deb ... 2024-04-24T13:28:28.879 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T13:28:28.951 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-iniconfig (1.1.1-2) ... 2024-04-24T13:28:29.172 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-24T13:28:29.404 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pastescript. 2024-04-24T13:28:29.432 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../106-python3-pastescript_2.0.2-4_all.deb ... 2024-04-24T13:28:29.471 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pastescript (2.0.2-4) ... 2024-04-24T13:28:29.565 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-24T13:28:29.800 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pluggy. 2024-04-24T13:28:29.808 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T13:28:29.827 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../107-python3-pluggy_0.13.0-7.1_all.deb ... 2024-04-24T13:28:29.866 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pluggy (0.13.0-7.1) ... 2024-04-24T13:28:30.153 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-psutil. 2024-04-24T13:28:30.180 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../108-python3-psutil_5.9.0-1build1_amd64.deb ... 2024-04-24T13:28:30.202 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T13:28:30.220 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-psutil (5.9.0-1build1) ... 2024-04-24T13:28:30.478 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T13:28:30.565 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-py. 2024-04-24T13:28:30.592 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../109-python3-py_1.10.0-1_all.deb ... 2024-04-24T13:28:30.631 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-py (1.10.0-1) ... 2024-04-24T13:28:30.829 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-24T13:28:30.985 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pygments. 2024-04-24T13:28:31.013 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../110-python3-pygments_2.11.2+dfsg-2_all.deb ... 2024-04-24T13:28:31.052 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T13:28:31.064 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-24T13:28:31.190 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-ceph-common (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:31.483 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-idna (3.3-1) ... 2024-04-24T13:28:31.523 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pyinotify. 2024-04-24T13:28:31.551 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../111-python3-pyinotify_0.9.6-1.3_all.deb ... 2024-04-24T13:28:31.590 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pyinotify (0.9.6-1.3) ... 2024-04-24T13:28:31.801 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T13:28:31.885 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-toml. 2024-04-24T13:28:31.912 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../112-python3-toml_0.10.2-1_all.deb ... 2024-04-24T13:28:31.968 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-toml (0.10.2-1) ... 2024-04-24T13:28:32.263 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-pytest. 2024-04-24T13:28:32.290 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../113-python3-pytest_6.2.5-1ubuntu2_all.deb ... 2024-04-24T13:28:32.329 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T13:28:32.626 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package python3-simplejson. 2024-04-24T13:28:32.652 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../114-python3-simplejson_3.17.6-1build1_amd64.deb ... 2024-04-24T13:28:32.691 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking python3-simplejson (3.17.6-1build1) ... 2024-04-24T13:28:32.944 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package qttranslations5-l10n. 2024-04-24T13:28:32.972 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../115-qttranslations5-l10n_5.15.3-1_all.deb ... 2024-04-24T13:28:32.991 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T13:28:33.011 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking qttranslations5-l10n (5.15.3-1) ... 2024-04-24T13:28:33.259 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T13:28:33.385 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-24T13:28:33.645 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T13:28:33.707 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package radosgw. 2024-04-24T13:28:33.735 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../116-radosgw_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:33.763 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-24T13:28:33.774 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking radosgw (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:33.864 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T13:28:34.148 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-24T13:28:34.400 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-24T13:28:34.561 INFO:teuthology.orchestra.run.smithi138.stdout:Selecting previously unselected package rbd-fuse. 2024-04-24T13:28:34.589 INFO:teuthology.orchestra.run.smithi138.stdout:Preparing to unpack .../117-rbd-fuse_19.0.0-3241-g882080b3-1jammy_amd64.deb ... 2024-04-24T13:28:34.627 INFO:teuthology.orchestra.run.smithi138.stdout:Unpacking rbd-fuse (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:34.849 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T13:28:34.916 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-iniconfig (1.1.1-2) ... 2024-04-24T13:28:35.094 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-24T13:28:35.175 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libdouble-conversion3:amd64 (3.1.7-4) ... 2024-04-24T13:28:35.293 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up nvme-cli (1.16-3ubuntu0.1) ... 2024-04-24T13:28:35.395 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-24T13:28:35.548 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmefc-boot-connections.service -> /lib/systemd/system/nvmefc-boot-connections.service. 2024-04-24T13:28:35.647 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-24T13:28:35.873 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/default.target.wants/nvmf-autoconnect.service -> /lib/systemd/system/nvmf-autoconnect.service. 2024-04-24T13:28:35.941 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-24T13:28:36.216 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-24T13:28:36.345 INFO:teuthology.orchestra.run.smithi138.stdout:nvmf-connect.target is a disabled or a static unit, not starting it. 2024-04-24T13:28:36.404 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up cephadm (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:36.467 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-24T13:28:36.721 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T13:28:36.836 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-24T13:28:36.870 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user cephadm....done 2024-04-24T13:28:37.019 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-waitress (1.4.4-1.1ubuntu1) ... 2024-04-24T13:28:37.137 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T13:28:37.247 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T13:28:37.315 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.classes (3.2.1-3) ... 2024-04-24T13:28:37.515 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-24T13:28:37.549 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-asyncssh-doc (2.5.0-1) ... 2024-04-24T13:28:37.650 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.functools (3.4.0-2) ... 2024-04-24T13:28:37.816 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-24T13:28:37.910 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-repoze.lru (0.7-2) ... 2024-04-24T13:28:38.067 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T13:28:38.170 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liboath0:amd64 (2.6.7-3build1) ... 2024-04-24T13:28:38.176 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-24T13:28:38.294 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T13:28:38.296 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-py (1.10.0-1) ... 2024-04-24T13:28:38.384 INFO:teuthology.orchestra.run.smithi071.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-24T13:28:38.599 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-joblib (0.17.0-4ubuntu1) ... 2024-04-24T13:28:38.621 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T13:28:38.722 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T13:28:38.950 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cachetools (5.0.0-1) ... 2024-04-24T13:28:39.124 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-24T13:28:39.344 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-openssl (21.0.0-1) ... 2024-04-24T13:28:39.384 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-24T13:28:39.510 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-24T13:28:39.620 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up unzip (6.0-26ubuntu3.2) ... 2024-04-24T13:28:39.761 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T13:28:39.880 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-bcrypt (3.2.0-1build1) ... 2024-04-24T13:28:39.887 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T13:28:40.156 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyinotify (0.9.6-1.3) ... 2024-04-24T13:28:40.188 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T13:28:40.424 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-threadpoolctl (3.1.0-1) ... 2024-04-24T13:28:40.473 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T13:28:40.741 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-24T13:28:40.792 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-argparse (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:40.875 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-24T13:28:41.052 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn-lib:amd64 (0.23.2-5ubuntu6) ... 2024-04-24T13:28:41.152 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-24T13:28:41.183 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-socket:amd64 (3.0~rc1+git+ac3201d-6) ... 2024-04-24T13:28:41.304 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libreadline-dev:amd64 (8.1.2-1) ... 2024-04-24T13:28:41.415 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-markupsafe (2.0.1-2build1) ... 2024-04-24T13:28:41.419 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T13:28:41.657 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua5.1 (5.1.5-8.1build4) ... 2024-04-24T13:28:41.756 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-24T13:28:42.027 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/lua5.1 to provide /usr/bin/lua (lua-interpreter) in auto mode 2024-04-24T13:28:42.063 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/luac5.1 to provide /usr/bin/luac (lua-compiler) in auto mode 2024-04-24T13:28:42.127 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libpcre2-16-0:amd64 (10.39-3ubuntu0.1) ... 2024-04-24T13:28:42.133 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-24T13:28:42.255 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-psutil (5.9.0-1build1) ... 2024-04-24T13:28:42.410 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T13:28:42.605 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-babel-localedata (2.8.0+dfsg.1-7) ... 2024-04-24T13:28:42.729 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T13:28:42.739 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-natsort (8.0.2-1) ... 2024-04-24T13:28:42.855 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librados2 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:42.981 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:42.990 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-routes (2.5.1-1ubuntu1) ... 2024-04-24T13:28:43.101 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-24T13:28:43.242 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplejson (3.17.6-1build1) ... 2024-04-24T13:28:43.421 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libcephfs2 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:43.527 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up zip (3.0-12build2) ... 2024-04-24T13:28:43.546 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libradosstriper1 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:43.653 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pygments (2.11.2+dfsg-2) ... 2024-04-24T13:28:43.673 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-24T13:28:43.958 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librbd1 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:44.076 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-modules-core (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:44.177 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-fuse (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:44.297 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempita (0.5.2-6ubuntu1) ... 2024-04-24T13:28:44.385 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T13:28:44.386 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T13:28:44.540 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python-pastedeploy-tpl (2.1.1-1) ... 2024-04-24T13:28:44.641 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up qttranslations5-l10n (5.15.3-1) ... 2024-04-24T13:28:44.742 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-wcwidth (0.2.5+dfsg1-1) ... 2024-04-24T13:28:44.895 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up libcephfs-dev (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:45.021 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rados (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:45.044 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-asyncssh (2.5.0-1) ... 2024-04-24T13:28:45.147 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up librgw2 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:45.273 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T13:28:45.428 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-certifi (2020.6.20-1) ... 2024-04-24T13:28:45.671 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-paste (3.5.0+dfsg1-1) ... 2024-04-24T13:28:46.073 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cheroot (8.5.2+ds1-1ubuntu3.1) ... 2024-04-24T13:28:46.342 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-werkzeug (2.0.2+dfsg1-1ubuntu0.22.04.1) ... 2024-04-24T13:28:46.419 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rbd (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:46.545 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up rbd-fuse (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:46.668 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.text (3.6.0-2) ... 2024-04-24T13:28:46.671 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-rgw (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:46.797 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up python3-cephfs (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:46.919 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up socat (1.7.4.1-3ubuntu4) ... 2024-04-24T13:28:46.923 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-common (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:47.045 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-ceph-common (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:47.339 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-idna (3.3-1) ... 2024-04-24T13:28:47.442 INFO:teuthology.orchestra.run.smithi071.stdout:Adding group ceph....done 2024-04-24T13:28:47.648 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-sklearn (0.23.2-5ubuntu6) ... 2024-04-24T13:28:47.802 INFO:teuthology.orchestra.run.smithi071.stdout:Adding system user ceph....done 2024-04-24T13:28:47.970 INFO:teuthology.orchestra.run.smithi071.stdout:Setting system user ceph properties....done 2024-04-24T13:28:47.984 INFO:teuthology.orchestra.run.smithi071.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-24T13:28:48.120 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-24T13:28:48.452 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-24T13:28:48.789 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up pkg-config (0.29.2-1ubuntu3) ... 2024-04-24T13:28:48.934 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-test (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:49.007 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5core5a:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T13:28:49.110 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up radosgw (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:49.117 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-toml (0.10.2-1) ... 2024-04-24T13:28:49.368 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librdkafka1:amd64 (1.8.0-1build1) ... 2024-04-24T13:28:49.494 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up xmlstarlet (1.6.1-2.1) ... 2024-04-24T13:28:49.594 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T13:28:49.594 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T13:28:49.620 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-urllib3 (1.26.5-1~exp1ubuntu0.1) ... 2024-04-24T13:28:49.897 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pluggy (0.13.0-7.1) ... 2024-04-24T13:28:50.080 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-base (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:50.148 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-zc.lockfile (2.0-1) ... 2024-04-24T13:28:50.391 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5dbus5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T13:28:50.420 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-24T13:28:50.501 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1 (0.4.8-1) ... 2024-04-24T13:28:50.803 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-singledispatch (3.4.0.3-3) ... 2024-04-24T13:28:50.865 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mds (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:51.062 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-logutils (0.3.3-8) ... 2024-04-24T13:28:51.120 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T13:28:51.120 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T13:28:51.330 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-tempora (4.1.2-1) ... 2024-04-24T13:28:51.582 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-simplegeneric (0.8.1-3) ... 2024-04-24T13:28:51.772 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:51.816 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-prettytable (2.5.0-2) ... 2024-04-24T13:28:51.991 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T13:28:51.991 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T13:28:52.076 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblttng-ust1:amd64 (2.13.1-1ubuntu1) ... 2024-04-24T13:28:52.202 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-websocket (1.2.3-1) ... 2024-04-24T13:28:52.482 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-osd (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:52.487 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libonig5:amd64 (6.9.7.1-2build1) ... 2024-04-24T13:28:52.613 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-mako (1.1.3+ds1-2ubuntu0.1) ... 2024-04-24T13:28:52.745 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T13:28:52.745 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T13:28:52.906 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webob (1:1.8.6-1.1) ... 2024-04-24T13:28:53.200 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:53.207 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jaraco.collections (3.4.0-2) ... 2024-04-24T13:28:53.318 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:53.467 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up liblua5.3-dev:amd64 (5.3.6-1build1) ... 2024-04-24T13:28:53.469 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mon (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:53.593 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-sec:amd64 (1.0.2-1) ... 2024-04-24T13:28:53.682 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T13:28:53.682 INFO:teuthology.orchestra.run.smithi071.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T13:28:53.719 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-babel (2.8.0+dfsg.1-7) ... 2024-04-24T13:28:53.809 INFO:teuthology.orchestra.run.smithi138.stdout:update-alternatives: using /usr/bin/pybabel-python3 to provide /usr/bin/pybabel (pybabel) in auto mode 2024-04-24T13:28:54.046 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libjq1:amd64 (1.6-2.1ubuntu3) ... 2024-04-24T13:28:54.162 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-cephadm (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:54.173 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pytest (6.2.5-1ubuntu2) ... 2024-04-24T13:28:54.305 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:54.431 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-mgr-dashboard (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:54.558 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastedeploy (2.1.1-1) ... 2024-04-24T13:28:54.574 INFO:teuthology.orchestra.run.smithi071.stdout:Setting up ceph-volume (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:54.843 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up lua-any (27ubuntu1) ... 2024-04-24T13:28:54.911 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T13:28:54.969 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-portend (3.0.0-1) ... 2024-04-24T13:28:55.020 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T13:28:55.173 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T13:28:55.228 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libqt5network5:amd64 (5.15.3+dfsg-2ubuntu0.2) ... 2024-04-24T13:28:55.346 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-jinja2 (3.0.3-1ubuntu0.1) ... 2024-04-24T13:28:55.656 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pyasn1-modules (0.2.1-1) ... 2024-04-24T13:28:55.957 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests (2.25.1+dfsg-2ubuntu0.1) ... 2024-04-24T13:28:56.233 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up jq (1.6-2.1ubuntu3) ... 2024-04-24T13:28:56.274 INFO:teuthology.orchestra.run.smithi071.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T13:28:56.351 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rsa (4.8-1) ... 2024-04-24T13:28:56.628 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-webtest (2.0.35-1) ... 2024-04-24T13:28:56.912 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-requests-oauthlib (1.3.0+ds-0.1) ... 2024-04-24T13:28:56.918 INFO:teuthology.orchestra.run.smithi071.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T13:28:56.924 DEBUG:teuthology.parallel:result is None 2024-04-24T13:28:57.274 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cherrypy3 (18.6.1-4) ... 2024-04-24T13:28:57.652 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pastescript (2.0.2-4) ... 2024-04-24T13:28:57.953 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-pecan (1.3.3-4ubuntu2) ... 2024-04-24T13:28:58.273 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libthrift-0.16.0:amd64 (0.16.0-2) ... 2024-04-24T13:28:58.383 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librados2 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:58.484 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libsqlite3-mod-ceph (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:58.602 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up luarocks (3.8.0+dfsg1-1) ... 2024-04-24T13:28:58.938 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs2 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:59.073 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libradosstriper1 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:59.199 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-google-auth (1.5.1-3) ... 2024-04-24T13:28:59.468 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librbd1 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:59.594 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-modules-core (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:59.721 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-fuse (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:28:59.934 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/remote-fs.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T13:28:59.934 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-fuse.target -> /lib/systemd/system/ceph-fuse.target. 2024-04-24T13:29:00.489 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up libcephfs-dev (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:00.649 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rados (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:00.767 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up librgw2 (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:00.885 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-kubernetes (12.0.1-1ubuntu1) ... 2024-04-24T13:29:02.108 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rbd (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:02.208 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up rbd-fuse (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:02.318 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-rgw (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:02.444 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up python3-cephfs (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:02.570 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-common (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:03.114 INFO:teuthology.orchestra.run.smithi138.stdout:Adding group ceph....done 2024-04-24T13:29:03.491 INFO:teuthology.orchestra.run.smithi138.stdout:Adding system user ceph....done 2024-04-24T13:29:03.610 INFO:teuthology.orchestra.run.smithi138.stdout:Setting system user ceph properties....done 2024-04-24T13:29:03.623 INFO:teuthology.orchestra.run.smithi138.stdout:chown: cannot access '/var/log/ceph/*.log*': No such file or directory 2024-04-24T13:29:03.755 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target -> /lib/systemd/system/ceph.target. 2024-04-24T13:29:04.078 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/rbdmap.service -> /lib/systemd/system/rbdmap.service. 2024-04-24T13:29:04.549 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-test (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:04.658 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up radosgw (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:05.122 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T13:29:05.122 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target -> /lib/systemd/system/ceph-radosgw.target. 2024-04-24T13:29:05.560 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-base (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:05.904 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service -> /lib/systemd/system/ceph-crash.service. 2024-04-24T13:29:06.387 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mds (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:06.625 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T13:29:06.625 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target -> /lib/systemd/system/ceph-mds.target. 2024-04-24T13:29:07.082 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:07.292 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T13:29:07.292 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target -> /lib/systemd/system/ceph-mgr.target. 2024-04-24T13:29:07.725 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-osd (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:07.980 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T13:29:07.980 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target -> /lib/systemd/system/ceph-osd.target. 2024-04-24T13:29:08.468 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-k8sevents (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:08.594 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-diskprediction-local (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:08.745 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mon (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:08.983 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T13:29:08.983 INFO:teuthology.orchestra.run.smithi138.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target -> /lib/systemd/system/ceph-mon.target. 2024-04-24T13:29:09.439 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-cephadm (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:09.590 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:09.708 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-mgr-dashboard (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:09.834 INFO:teuthology.orchestra.run.smithi138.stdout:Setting up ceph-volume (19.0.0-3241-g882080b3-1jammy) ... 2024-04-24T13:29:10.448 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for mailcap (3.70+nmu1ubuntu1) ... 2024-04-24T13:29:10.565 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for libc-bin (2.35-0ubuntu3.1) ... 2024-04-24T13:29:10.718 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for man-db (2.10.2-1) ... 2024-04-24T13:29:11.829 INFO:teuthology.orchestra.run.smithi138.stdout:Processing triggers for install-info (6.8-4build1) ... 2024-04-24T13:29:12.443 INFO:teuthology.orchestra.run.smithi138.stderr:W: --force-yes is deprecated, use one of the options starting with --allow instead. 2024-04-24T13:29:12.850 DEBUG:teuthology.parallel:result is None 2024-04-24T13:29:12.851 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=882080b304cb1602e69c11bc5fe8479e7d2bc64d 2024-04-24T13:29:12.999 DEBUG:teuthology.orchestra.run.smithi071:> dpkg-query -W -f '${Version}' ceph 2024-04-24T13:29:13.018 INFO:teuthology.orchestra.run.smithi071.stdout:19.0.0-3241-g882080b3-1jammy 2024-04-24T13:29:13.019 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3241-g882080b3-1jammy 2024-04-24T13:29:13.019 INFO:teuthology.task.install:The correct ceph version 19.0.0-3241-g882080b3-1jammy is installed. 2024-04-24T13:29:13.021 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=ubuntu%2F22.04%2Fx86_64&sha1=882080b304cb1602e69c11bc5fe8479e7d2bc64d 2024-04-24T13:29:13.238 DEBUG:teuthology.orchestra.run.smithi138:> dpkg-query -W -f '${Version}' ceph 2024-04-24T13:29:13.258 INFO:teuthology.orchestra.run.smithi138.stdout:19.0.0-3241-g882080b3-1jammy 2024-04-24T13:29:13.258 INFO:teuthology.packaging:The installed version of ceph is 19.0.0-3241-g882080b3-1jammy 2024-04-24T13:29:13.258 INFO:teuthology.task.install:The correct ceph version 19.0.0-3241-g882080b3-1jammy is installed. 2024-04-24T13:29:13.260 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-04-24T13:29:13.260 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:13.260 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T13:29:13.274 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:13.274 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-04-24T13:29:13.313 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-04-24T13:29:13.314 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:13.314 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T13:29:13.331 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T13:29:13.386 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:13.386 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/daemon-helper 2024-04-24T13:29:13.400 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-04-24T13:29:13.452 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-04-24T13:29:13.452 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:13.452 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T13:29:13.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T13:29:13.527 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:13.527 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/adjust-ulimits 2024-04-24T13:29:13.539 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-04-24T13:29:13.593 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-04-24T13:29:13.594 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:13.594 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T13:29:13.606 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T13:29:13.662 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:13.662 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/usr/bin/stdin-killer 2024-04-24T13:29:13.676 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-04-24T13:29:13.732 INFO:teuthology.run_tasks:Running task ceph... 2024-04-24T13:29:13.817 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-04-24T13:29:13.817 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 777 /var/log/ceph 2024-04-24T13:29:13.820 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 777 /var/log/ceph 2024-04-24T13:29:13.832 INFO:tasks.ceph:Disabling ceph logrotate... 2024-04-24T13:29:13.832 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T13:29:13.876 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/logrotate.d/ceph 2024-04-24T13:29:13.889 INFO:tasks.ceph:Creating extra log directories... 2024-04-24T13:29:13.889 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T13:29:13.928 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-04-24T13:29:13.956 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-04-24T13:29:13.957 INFO:tasks.ceph:config {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-04-24T13:29:13.957 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434', 'branch': 'wip-cbodley-testing', 'description': 'rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota}', 'email': None, 'first_in_suite': False, 'job_id': '7671434', 'kernel': {'kdb': True, 'sha1': 'distro'}, 'ktype': 'distro', 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi', 'no_nested_subset': False, 'nuke-on-error': True, 'openstack': [{'volumes': {'count': 4, 'size': 10}}], 'os_type': 'ubuntu', 'os_version': '22.04', 'overrides': {'admin_socket': {'branch': 'wip-cbodley-testing'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '882080b304cb1602e69c11bc5fe8479e7d2bc64d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '882080b304cb1602e69c11bc5fe8479e7d2bc64d'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley-testing', 'sha1': '882080b304cb1602e69c11bc5fe8479e7d2bc64d'}}, 'owner': 'scheduled_cbodley@teuthology', 'priority': 75, 'repo': 'https://git.ceph.com/ceph-ci.git', 'roles': [['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a'], ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'node-exporter.b']], 'seed': 4466, 'sha1': '882080b304cb1602e69c11bc5fe8479e7d2bc64d', 'sleep_before_teardown': 0, 'suite': 'rgw', 'suite_branch': 'wip-cbodley-testing', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_882080b304cb1602e69c11bc5fe8479e7d2bc64d/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '882080b304cb1602e69c11bc5fe8479e7d2bc64d', 'targets': {'smithi071.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBOU2F4NK4VX1Ts4ppD2JoJBw6vciwrCucDkmqEwzDMlbtLnGGDpugrlDV9k33KjxQA12mDqT7bX+2jBQy8Iyd8=', 'smithi138.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBNzGGlhf88aO8WN61EVg1AhyHeCqx8Oxe1R6ERGnuWQ8HR54jACSJ627ocCUXG+KcUG0Lw6CH6MdpjbXF8VRID4='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': True, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': None}, {'rgw': ['client.0']}, {'thrashosds': {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200}}, {'workunit': {'clients': {'client.0': ['rgw/s3_bucket_quota.pl']}}}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '9481b1d62f50e7d0a4f3dd83adf6945b08d5ff17', 'timestamp': '2024-04-24_12:59:55', 'tube': 'smithi', 'user': 'cbodley', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885'} 2024-04-24T13:29:13.957 DEBUG:teuthology.orchestra.run.smithi071:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T13:29:13.984 DEBUG:teuthology.orchestra.run.smithi138:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-04-24T13:29:13.993 DEBUG:teuthology.orchestra.run.smithi071:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T13:29:14.032 DEBUG:teuthology.orchestra.run.smithi138:> sudo install -d -m0777 -- /var/run/ceph 2024-04-24T13:29:14.049 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:14.049 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T13:29:14.091 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T13:29:14.092 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_1 2024-04-24T13:29:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T13:29:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T13:29:14.139 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 868 Links: 1 2024-04-24T13:29:14.139 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T13:29:14.140 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-24 13:23:50.857088338 +0000 2024-04-24T13:29:14.140 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-24 13:23:50.609090553 +0000 2024-04-24T13:29:14.140 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-24 13:23:50.609090553 +0000 2024-04-24T13:29:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-04-24T13:29:14.140 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T13:29:14.193 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-24T13:29:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-24T13:29:14.194 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000388711 s, 1.3 MB/s 2024-04-24T13:29:14.195 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T13:29:14.244 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_2 2024-04-24T13:29:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T13:29:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T13:29:14.291 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 886 Links: 1 2024-04-24T13:29:14.291 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T13:29:14.291 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-24 13:23:51.345083979 +0000 2024-04-24T13:29:14.291 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-24 13:23:51.081086337 +0000 2024-04-24T13:29:14.291 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-24 13:23:51.081086337 +0000 2024-04-24T13:29:14.291 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-04-24T13:29:14.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T13:29:14.344 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-24T13:29:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-24T13:29:14.345 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000394685 s, 1.3 MB/s 2024-04-24T13:29:14.346 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T13:29:14.397 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_3 2024-04-24T13:29:14.443 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T13:29:14.443 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T13:29:14.443 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 900 Links: 1 2024-04-24T13:29:14.443 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T13:29:14.444 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-24 13:23:51.793079978 +0000 2024-04-24T13:29:14.444 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-24 13:23:51.557082084 +0000 2024-04-24T13:29:14.444 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-24 13:23:51.557082084 +0000 2024-04-24T13:29:14.444 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-04-24T13:29:14.444 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T13:29:14.497 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-24T13:29:14.498 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-24T13:29:14.498 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000398574 s, 1.3 MB/s 2024-04-24T13:29:14.499 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T13:29:14.548 DEBUG:teuthology.orchestra.run.smithi071:> stat /dev/vg_nvme/lv_4 2024-04-24T13:29:14.595 INFO:teuthology.orchestra.run.smithi071.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T13:29:14.595 INFO:teuthology.orchestra.run.smithi071.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T13:29:14.595 INFO:teuthology.orchestra.run.smithi071.stdout:Device: 5h/5d Inode: 923 Links: 1 2024-04-24T13:29:14.595 INFO:teuthology.orchestra.run.smithi071.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T13:29:14.595 INFO:teuthology.orchestra.run.smithi071.stdout:Access: 2024-04-24 13:23:52.021077941 +0000 2024-04-24T13:29:14.595 INFO:teuthology.orchestra.run.smithi071.stdout:Modify: 2024-04-24 13:23:52.017077977 +0000 2024-04-24T13:29:14.595 INFO:teuthology.orchestra.run.smithi071.stdout:Change: 2024-04-24 13:23:52.017077977 +0000 2024-04-24T13:29:14.595 INFO:teuthology.orchestra.run.smithi071.stdout: Birth: - 2024-04-24T13:29:14.595 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T13:29:14.649 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records in 2024-04-24T13:29:14.649 INFO:teuthology.orchestra.run.smithi071.stderr:1+0 records out 2024-04-24T13:29:14.650 INFO:teuthology.orchestra.run.smithi071.stderr:512 bytes copied, 0.000384494 s, 1.3 MB/s 2024-04-24T13:29:14.651 DEBUG:teuthology.orchestra.run.smithi071:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T13:29:14.700 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T13:29:14.700 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:14.700 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/scratch_devs of=/dev/stdout 2024-04-24T13:29:14.706 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-04-24T13:29:14.706 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_1 2024-04-24T13:29:14.753 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-04-24T13:29:14.753 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T13:29:14.753 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 872 Links: 1 2024-04-24T13:29:14.753 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T13:29:14.754 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-24 13:23:51.721704220 +0000 2024-04-24T13:29:14.754 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-24 13:23:51.441706720 +0000 2024-04-24T13:29:14.754 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-24 13:23:51.441706720 +0000 2024-04-24T13:29:14.754 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-04-24T13:29:14.754 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-04-24T13:29:14.807 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-24T13:29:14.807 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-24T13:29:14.807 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000372062 s, 1.4 MB/s 2024-04-24T13:29:14.809 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-04-24T13:29:14.858 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_2 2024-04-24T13:29:14.909 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-04-24T13:29:14.909 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T13:29:14.909 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 892 Links: 1 2024-04-24T13:29:14.909 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T13:29:14.909 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-24 13:23:51.953702148 +0000 2024-04-24T13:29:14.909 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-24 13:23:51.949702182 +0000 2024-04-24T13:29:14.909 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-24 13:23:51.949702182 +0000 2024-04-24T13:29:14.909 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-04-24T13:29:14.910 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-04-24T13:29:14.963 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-24T13:29:14.963 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-24T13:29:14.963 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000414817 s, 1.2 MB/s 2024-04-24T13:29:14.964 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-04-24T13:29:15.014 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_3 2024-04-24T13:29:15.061 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-04-24T13:29:15.061 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T13:29:15.061 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 908 Links: 1 2024-04-24T13:29:15.061 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T13:29:15.061 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-24 13:23:52.737695144 +0000 2024-04-24T13:29:15.061 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-24 13:23:52.469697538 +0000 2024-04-24T13:29:15.062 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-24 13:23:52.469697538 +0000 2024-04-24T13:29:15.062 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-04-24T13:29:15.062 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-04-24T13:29:15.115 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-24T13:29:15.116 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-24T13:29:15.116 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000341864 s, 1.5 MB/s 2024-04-24T13:29:15.117 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-04-24T13:29:15.166 DEBUG:teuthology.orchestra.run.smithi138:> stat /dev/vg_nvme/lv_4 2024-04-24T13:29:15.213 INFO:teuthology.orchestra.run.smithi138.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-04-24T13:29:15.213 INFO:teuthology.orchestra.run.smithi138.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-04-24T13:29:15.213 INFO:teuthology.orchestra.run.smithi138.stdout:Device: 5h/5d Inode: 926 Links: 1 2024-04-24T13:29:15.213 INFO:teuthology.orchestra.run.smithi138.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-04-24T13:29:15.213 INFO:teuthology.orchestra.run.smithi138.stdout:Access: 2024-04-24 13:23:53.257690500 +0000 2024-04-24T13:29:15.213 INFO:teuthology.orchestra.run.smithi138.stdout:Modify: 2024-04-24 13:23:52.993692858 +0000 2024-04-24T13:29:15.213 INFO:teuthology.orchestra.run.smithi138.stdout:Change: 2024-04-24 13:23:52.993692858 +0000 2024-04-24T13:29:15.213 INFO:teuthology.orchestra.run.smithi138.stdout: Birth: - 2024-04-24T13:29:15.213 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-04-24T13:29:15.266 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records in 2024-04-24T13:29:15.266 INFO:teuthology.orchestra.run.smithi138.stderr:1+0 records out 2024-04-24T13:29:15.267 INFO:teuthology.orchestra.run.smithi138.stderr:512 bytes copied, 0.000287437 s, 1.8 MB/s 2024-04-24T13:29:15.268 DEBUG:teuthology.orchestra.run.smithi138:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-04-24T13:29:15.318 INFO:tasks.ceph:osd dev map: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T13:29:15.318 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-24T13:29:15.318 INFO:tasks.ceph:Generating config... 2024-04-24T13:29:15.320 INFO:tasks.ceph:[client] rgw relaxed s3 bucket names = True 2024-04-24T13:29:15.320 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-04-24T13:29:15.320 INFO:tasks.ceph:[mgr] debug ms = 1 2024-04-24T13:29:15.320 INFO:tasks.ceph:[mon] debug mon = 20 2024-04-24T13:29:15.320 INFO:tasks.ceph:[mon] debug ms = 1 2024-04-24T13:29:15.320 INFO:tasks.ceph:[mon] debug paxos = 20 2024-04-24T13:29:15.320 INFO:tasks.ceph:[osd] bdev async discard = True 2024-04-24T13:29:15.320 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-04-24T13:29:15.320 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-04-24T13:29:15.320 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-04-24T13:29:15.320 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-04-24T13:29:15.320 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-04-24T13:29:15.320 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-04-24T13:29:15.321 INFO:tasks.ceph:[osd] debug ms = 1 2024-04-24T13:29:15.321 INFO:tasks.ceph:[osd] debug osd = 20 2024-04-24T13:29:15.321 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-04-24T13:29:15.321 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-04-24T13:29:15.321 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-04-24T13:29:15.321 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-04-24T13:29:15.321 INFO:tasks.ceph:[osd] osd blocked scrub grace period = 3600 2024-04-24T13:29:15.321 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-04-24T13:29:15.321 INFO:tasks.ceph:[osd] osd max markdown count = 1000 2024-04-24T13:29:15.321 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-04-24T13:29:15.321 INFO:tasks.ceph:[osd] osd shutdown pgref assert = True 2024-04-24T13:29:15.321 INFO:tasks.ceph:Setting up mon.a... 2024-04-24T13:29:15.322 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-04-24T13:29:15.355 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.keyring 2024-04-24T13:29:15.363 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-04-24T13:29:15.440 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T13:29:15.493 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.71'), ('mon.c', '[v2:172.21.15.71:3301,v1:172.21.15.71:6790]'), ('mon.b', '172.21.15.138')] 2024-04-24T13:29:15.494 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],172.21.15.138'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'rgw relaxed s3 bucket names': True}, 'mon.a': {}, 'mon.c': {}, 'mon.b': {}} 2024-04-24T13:29:15.495 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:15.495 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T13:29:15.539 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.71 --addv c '[v2:172.21.15.71:3301,v1:172.21.15.71:6790]' --add b 172.21.15.138 --print /home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:15.624 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:15.624 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: generated fsid 6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8 2024-04-24T13:29:15.624 INFO:teuthology.orchestra.run.smithi071.stdout:setting min_mon_release = quincy 2024-04-24T13:29:15.625 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 0 2024-04-24T13:29:15.625 INFO:teuthology.orchestra.run.smithi071.stdout:fsid 6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8 2024-04-24T13:29:15.625 INFO:teuthology.orchestra.run.smithi071.stdout:last_changed 2024-04-24T13:29:15.625708+0000 2024-04-24T13:29:15.625 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-04-24T13:29:15.625708+0000 2024-04-24T13:29:15.625 INFO:teuthology.orchestra.run.smithi071.stdout:min_mon_release 17 (quincy) 2024-04-24T13:29:15.625 INFO:teuthology.orchestra.run.smithi071.stdout:election_strategy: 1 2024-04-24T13:29:15.625 INFO:teuthology.orchestra.run.smithi071.stdout:0: [v2:172.21.15.71:3300/0,v1:172.21.15.71:6789/0] mon.a 2024-04-24T13:29:15.625 INFO:teuthology.orchestra.run.smithi071.stdout:1: [v2:172.21.15.138:3300/0,v1:172.21.15.138:6789/0] mon.b 2024-04-24T13:29:15.625 INFO:teuthology.orchestra.run.smithi071.stdout:2: [v2:172.21.15.71:3301/0,v1:172.21.15.71:6790/0] mon.c 2024-04-24T13:29:15.625 INFO:teuthology.orchestra.run.smithi071.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (3 monitors) 2024-04-24T13:29:15.626 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-04-24T13:29:15.675 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID 6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8... 2024-04-24T13:29:15.675 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T13:29:15.720 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-04-24T13:29:15.748 INFO:teuthology.orchestra.run.smithi071.stdout:[global] 2024-04-24T13:29:15.748 INFO:teuthology.orchestra.run.smithi071.stdout: chdir = "" 2024-04-24T13:29:15.748 INFO:teuthology.orchestra.run.smithi071.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T13:29:15.748 INFO:teuthology.orchestra.run.smithi071.stdout: auth supported = cephx 2024-04-24T13:29:15.748 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.748 INFO:teuthology.orchestra.run.smithi071.stdout: filestore xattr use omap = true 2024-04-24T13:29:15.748 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.748 INFO:teuthology.orchestra.run.smithi071.stdout: mon clock drift allowed = 1.000 2024-04-24T13:29:15.748 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: osd crush chooseleaf type = 0 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: auth debug = true 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on old message = true 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: ms die on bug = true 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: mon pg warn max object skew = 0 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default size = 2 2024-04-24T13:29:15.749 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow primary affinity = true 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd allow pg remap = true 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on legacy crush tunables = false 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on crush straw calc version zero = false 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on no sortbitwise = false 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on osd down out interval zero = false 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: mon warn on too few osds = false 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: mon_allow_pool_size_one = true 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: osd default data pool replay window = 5 2024-04-24T13:29:15.750 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: mon allow pool delete = true 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: mon cluster log file level = debug 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: debug asserts on shutdown = true 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: mon health detail to clog = false 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: mon host = "172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],172.21.15.138" 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: fsid = 6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout:[osd] 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: osd journal size = 100 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub load threshold = 5.0 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: osd scrub max interval = 600 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: osd mclock profile = high_recovery_ops 2024-04-24T13:29:15.751 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: osd recover clone overlap = true 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: osd recovery max chunk = 1048576 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug shutdown = true 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug op order = true 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug verify stray on activate = true 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug trim objects = true 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: osd open classes on start = true 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug pg log writeout = true 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: osd deep scrub update digest min age = 30 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.752 INFO:teuthology.orchestra.run.smithi071.stdout: osd map max advance = 10 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: journal zero on create = true 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: filestore ondisk finisher threads = 3 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: filestore apply finisher threads = 3 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: bdev debug aio = true 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: osd debug misdirected ops = true 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: bdev async discard = True 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: bdev enable discard = True 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore allocator = bitmap 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore block size = 96636764160 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: bluestore fsck on mount = True 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluefs = 1/20 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: debug bluestore = 1/20 2024-04-24T13:29:15.753 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout: debug osd = 20 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout: debug rocksdb = 4/10 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd full ratio = 0.9 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd nearfull ratio = 0.8 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout: osd blocked scrub grace period = 3600 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout: osd failsafe full ratio = 0.95 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout: osd max markdown count = 1000 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout: osd objectstore = bluestore 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout: osd shutdown pgref assert = True 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr] 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-24T13:29:15.754 INFO:teuthology.orchestra.run.smithi071.stdout: debug mgr = 20 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout: mgr/telemetry/nag = false 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout:[mon] 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout: debug ms = 1 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout: debug mon = 20 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout: debug paxos = 20 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout: debug auth = 20 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout: mon data avail warn = 5 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout: mon mgr mkfs grace = 240 2024-04-24T13:29:15.755 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min pgs per osd = 4 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd reporter subtree level = osd 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: mon osd prime pg temp = true 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: mon reweight min bytes per osd = 10 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: # 1m isn't quite enough 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: mon_down_mkfs_grace = 2m 2024-04-24T13:29:15.756 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.757 INFO:teuthology.orchestra.run.smithi071.stdout: mon_warn_on_filestore_osds = false 2024-04-24T13:29:15.757 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:15.757 INFO:teuthology.orchestra.run.smithi071.stdout:[client] 2024-04-24T13:29:15.757 INFO:teuthology.orchestra.run.smithi071.stdout: rgw cache enabled = true 2024-04-24T13:29:15.757 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable ops log = true 2024-04-24T13:29:15.757 INFO:teuthology.orchestra.run.smithi071.stdout: rgw enable usage log = true 2024-04-24T13:29:15.757 INFO:teuthology.orchestra.run.smithi071.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T13:29:15.757 INFO:teuthology.orchestra.run.smithi071.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T13:29:15.757 INFO:teuthology.orchestra.run.smithi071.stdout: rgw relaxed s3 bucket names = True 2024-04-24T13:29:15.757 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.a] 2024-04-24T13:29:15.757 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.c] 2024-04-24T13:29:15.757 INFO:teuthology.orchestra.run.smithi071.stdout:[mon.b] 2024-04-24T13:29:15.758 INFO:teuthology.orchestra.run.smithi138.stdout:[global] 2024-04-24T13:29:15.758 INFO:teuthology.orchestra.run.smithi138.stdout: chdir = "" 2024-04-24T13:29:15.758 INFO:teuthology.orchestra.run.smithi138.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-04-24T13:29:15.758 INFO:teuthology.orchestra.run.smithi138.stdout: auth supported = cephx 2024-04-24T13:29:15.758 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.758 INFO:teuthology.orchestra.run.smithi138.stdout: filestore xattr use omap = true 2024-04-24T13:29:15.758 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.758 INFO:teuthology.orchestra.run.smithi138.stdout: mon clock drift allowed = 1.000 2024-04-24T13:29:15.758 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: osd crush chooseleaf type = 0 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: auth debug = true 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on old message = true 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: ms die on bug = true 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: mon max pg per osd = 10000 # >= luminous 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: mon pg warn max object skew = 0 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: # disable pg_autoscaler by default for new pools 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: osd_pool_default_pg_autoscale_mode = off 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default size = 2 2024-04-24T13:29:15.759 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow primary affinity = true 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd allow pg remap = true 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on legacy crush tunables = false 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on crush straw calc version zero = false 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on no sortbitwise = false 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on osd down out interval zero = false 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: mon warn on too few osds = false 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_pool_no_redundancy = false 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: mon_allow_pool_size_one = true 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.760 INFO:teuthology.orchestra.run.smithi138.stdout: osd default data pool replay window = 5 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout: mon allow pool delete = true 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout: mon cluster log file level = debug 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout: debug asserts on shutdown = true 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout: mon health detail to clog = false 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout: mon host = "172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],172.21.15.138" 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout: fsid = 6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout:[osd] 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout: osd journal size = 100 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub load threshold = 5.0 2024-04-24T13:29:15.761 INFO:teuthology.orchestra.run.smithi138.stdout: osd scrub max interval = 600 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: osd mclock profile = high_recovery_ops 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: osd recover clone overlap = true 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: osd recovery max chunk = 1048576 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug shutdown = true 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug op order = true 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug verify stray on activate = true 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug trim objects = true 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: osd open classes on start = true 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug pg log writeout = true 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.762 INFO:teuthology.orchestra.run.smithi138.stdout: osd deep scrub update digest min age = 30 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: osd map max advance = 10 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: journal zero on create = true 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: filestore ondisk finisher threads = 3 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: filestore apply finisher threads = 3 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: bdev debug aio = true 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: osd debug misdirected ops = true 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: bdev async discard = True 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: bdev enable discard = True 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore allocator = bitmap 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore block size = 96636764160 2024-04-24T13:29:15.763 INFO:teuthology.orchestra.run.smithi138.stdout: bluestore fsck on mount = True 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluefs = 1/20 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: debug bluestore = 1/20 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: debug osd = 20 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: debug rocksdb = 4/10 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd backfillfull_ratio = 0.85 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd full ratio = 0.9 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd nearfull ratio = 0.8 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: osd blocked scrub grace period = 3600 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: osd failsafe full ratio = 0.95 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: osd max markdown count = 1000 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: osd objectstore = bluestore 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: osd shutdown pgref assert = True 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.764 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr] 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: debug mgr = 20 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: mgr/telemetry/nag = false 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout:[mon] 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: debug ms = 1 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: debug mon = 20 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: debug paxos = 20 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: debug auth = 20 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: mon data avail warn = 5 2024-04-24T13:29:15.765 INFO:teuthology.orchestra.run.smithi138.stdout: mon mgr mkfs grace = 240 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min pgs per osd = 4 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd reporter subtree level = osd 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: mon osd prime pg temp = true 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: mon reweight min bytes per osd = 10 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: auth mon ticket ttl = 660 # 11m 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: auth service ticket ttl = 240 # 4m 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: # don't complain about insecure global_id in the test suite 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: # 1m isn't quite enough 2024-04-24T13:29:15.766 INFO:teuthology.orchestra.run.smithi138.stdout: mon_down_mkfs_grace = 2m 2024-04-24T13:29:15.767 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.767 INFO:teuthology.orchestra.run.smithi138.stdout: mon_warn_on_filestore_osds = false 2024-04-24T13:29:15.767 INFO:teuthology.orchestra.run.smithi138.stdout: 2024-04-24T13:29:15.767 INFO:teuthology.orchestra.run.smithi138.stdout:[client] 2024-04-24T13:29:15.767 INFO:teuthology.orchestra.run.smithi138.stdout: rgw cache enabled = true 2024-04-24T13:29:15.767 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable ops log = true 2024-04-24T13:29:15.767 INFO:teuthology.orchestra.run.smithi138.stdout: rgw enable usage log = true 2024-04-24T13:29:15.767 INFO:teuthology.orchestra.run.smithi138.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-04-24T13:29:15.767 INFO:teuthology.orchestra.run.smithi138.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-04-24T13:29:15.767 INFO:teuthology.orchestra.run.smithi138.stdout: rgw relaxed s3 bucket names = True 2024-04-24T13:29:15.767 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.a] 2024-04-24T13:29:15.767 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.c] 2024-04-24T13:29:15.767 INFO:teuthology.orchestra.run.smithi138.stdout:[mon.b] 2024-04-24T13:29:15.769 INFO:tasks.ceph:Creating admin key on mon.a... 2024-04-24T13:29:15.769 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-04-24T13:29:15.859 INFO:tasks.ceph:Copying monmap to all nodes... 2024-04-24T13:29:15.859 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:15.859 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-04-24T13:29:15.864 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:15.865 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-04-24T13:29:15.910 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi071.front.sepia.ceph.com 2024-04-24T13:29:15.910 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:15.911 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T13:29:15.911 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T13:29:15.974 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:15.974 DEBUG:teuthology.orchestra.run.smithi071:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:16.023 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi138.front.sepia.ceph.com 2024-04-24T13:29:16.023 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:16.023 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd of=/etc/ceph/ceph.keyring 2024-04-24T13:29:16.023 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-04-24T13:29:16.046 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:16.046 DEBUG:teuthology.orchestra.run.smithi138:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:16.093 INFO:tasks.ceph:Setting up mon nodes... 2024-04-24T13:29:16.093 INFO:tasks.ceph:Setting up mgr nodes... 2024-04-24T13:29:16.093 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mgr/ceph-y && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.y /var/lib/ceph/mgr/ceph-y/keyring 2024-04-24T13:29:16.135 INFO:teuthology.orchestra.run.smithi071.stdout:creating /var/lib/ceph/mgr/ceph-y/keyring 2024-04-24T13:29:16.138 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T13:29:16.181 INFO:teuthology.orchestra.run.smithi138.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-04-24T13:29:16.192 INFO:tasks.ceph:Setting up mds nodes... 2024-04-24T13:29:16.192 INFO:tasks.ceph_client:Setting up client nodes... 2024-04-24T13:29:16.192 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-04-24T13:29:16.226 INFO:teuthology.orchestra.run.smithi071.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-04-24T13:29:16.236 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.1 /etc/ceph/ceph.client.1.keyring && sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-04-24T13:29:16.271 INFO:teuthology.orchestra.run.smithi138.stdout:creating /etc/ceph/ceph.client.1.keyring 2024-04-24T13:29:16.283 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-04-24T13:29:16.283 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi071.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'}, Remote(name='ubuntu@smithi138.front.sepia.ceph.com'): {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'}} 2024-04-24T13:29:16.283 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-04-24T13:29:16.295 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T13:29:16.295 INFO:tasks.ceph:role: osd.0 2024-04-24T13:29:16.295 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-24T13:29:16.295 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T13:29:16.359 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T13:29:16.359 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T13:29:16.359 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T13:29:16.359 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T13:29:16.359 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T13:29:16.359 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-04-24T13:29:16.359 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T13:29:16.359 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T13:29:16.359 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T13:29:16.359 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T13:29:16.847 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-04-24T13:29:16.849 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-04-24T13:29:16.849 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-04-24T13:29:16.991 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-04-24T13:29:17.002 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T13:29:17.003 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T13:29:17.004 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-04-24T13:29:17.059 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T13:29:17.059 INFO:tasks.ceph:role: osd.1 2024-04-24T13:29:17.059 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-24T13:29:17.059 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T13:29:17.122 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T13:29:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T13:29:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T13:29:17.122 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T13:29:17.123 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T13:29:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-04-24T13:29:17.123 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T13:29:17.123 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T13:29:17.123 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T13:29:17.123 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T13:29:17.572 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-04-24T13:29:17.574 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-04-24T13:29:17.574 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-1 2024-04-24T13:29:17.662 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-04-24T13:29:17.720 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T13:29:17.721 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T13:29:17.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-04-24T13:29:17.774 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T13:29:17.774 INFO:tasks.ceph:role: osd.2 2024-04-24T13:29:17.775 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-24T13:29:17.775 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T13:29:17.839 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T13:29:17.839 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T13:29:17.839 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T13:29:17.839 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T13:29:17.839 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T13:29:17.839 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-04-24T13:29:17.839 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T13:29:17.839 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T13:29:17.839 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T13:29:17.839 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T13:29:18.295 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-04-24T13:29:18.297 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-04-24T13:29:18.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-2 2024-04-24T13:29:18.440 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-04-24T13:29:18.451 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T13:29:18.451 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T13:29:18.452 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-04-24T13:29:18.506 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1', 'osd.1': '/dev/vg_nvme/lv_2', 'osd.2': '/dev/vg_nvme/lv_3', 'osd.3': '/dev/vg_nvme/lv_4'} 2024-04-24T13:29:18.506 INFO:tasks.ceph:role: osd.3 2024-04-24T13:29:18.507 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-24T13:29:18.507 DEBUG:teuthology.orchestra.run.smithi071:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-24T13:29:18.570 INFO:teuthology.orchestra.run.smithi071.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T13:29:18.571 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T13:29:18.571 INFO:teuthology.orchestra.run.smithi071.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T13:29:18.571 INFO:teuthology.orchestra.run.smithi071.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T13:29:18.571 INFO:teuthology.orchestra.run.smithi071.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T13:29:18.571 INFO:teuthology.orchestra.run.smithi071.stdout: = sunit=0 swidth=0 blks 2024-04-24T13:29:18.571 INFO:teuthology.orchestra.run.smithi071.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T13:29:18.571 INFO:teuthology.orchestra.run.smithi071.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T13:29:18.571 INFO:teuthology.orchestra.run.smithi071.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T13:29:18.571 INFO:teuthology.orchestra.run.smithi071.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T13:29:19.062 INFO:teuthology.orchestra.run.smithi071.stdout:Discarding blocks...Done. 2024-04-24T13:29:19.064 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi071.front.sepia.ceph.com -o noatime 2024-04-24T13:29:19.065 DEBUG:teuthology.orchestra.run.smithi071:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-3 2024-04-24T13:29:19.217 DEBUG:teuthology.orchestra.run.smithi071:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-04-24T13:29:19.227 INFO:teuthology.orchestra.run.smithi071.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T13:29:19.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T13:29:19.228 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:19.527 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:19.527+0000 7ff9fb8017c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-04-24T13:29:19.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:19.531+0000 7ff9fb8017c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-04-24T13:29:19.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:19.531+0000 7ff9fb8017c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T13:29:19.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:19.531+0000 7ff9fb8017c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T13:29:19.532 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:19.531+0000 7ff9fb8017c0 -1 bluestore(/var/lib/ceph/osd/ceph-0/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-0/block: (2) No such file or directory 2024-04-24T13:29:19.533 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:19.531+0000 7ff9fb8017c0 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-04-24T13:29:22.520 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-04-24T13:29:22.533 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:22.613 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:22.611+0000 7f953d9b97c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-04-24T13:29:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:22.611+0000 7f953d9b97c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-04-24T13:29:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:22.611+0000 7f953d9b97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T13:29:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:22.611+0000 7f953d9b97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T13:29:22.614 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:22.611+0000 7f953d9b97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-1/block: (2) No such file or directory 2024-04-24T13:29:22.615 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:22.611+0000 7f953d9b97c0 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-04-24T13:29:25.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-04-24T13:29:25.639 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:25.722 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:25.719+0000 7fc45a4a07c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-04-24T13:29:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:25.723+0000 7fc45a4a07c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-04-24T13:29:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:25.723+0000 7fc45a4a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T13:29:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:25.723+0000 7fc45a4a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T13:29:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:25.723+0000 7fc45a4a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-2/block: (2) No such file or directory 2024-04-24T13:29:25.723 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:25.723+0000 7fc45a4a07c0 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-04-24T13:29:28.707 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-04-24T13:29:28.763 DEBUG:teuthology.orchestra.run.smithi071:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:28.845 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:28.843+0000 7fc53e4817c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-04-24T13:29:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:28.843+0000 7fc53e4817c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-04-24T13:29:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:28.843+0000 7fc53e4817c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T13:29:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:28.843+0000 7fc53e4817c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T13:29:28.846 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:28.843+0000 7fc53e4817c0 -1 bluestore(/var/lib/ceph/osd/ceph-3/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-3/block: (2) No such file or directory 2024-04-24T13:29:28.847 INFO:teuthology.orchestra.run.smithi071.stderr:2024-04-24T13:29:28.847+0000 7fc53e4817c0 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-04-24T13:29:31.819 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-04-24T13:29:31.876 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-4 2024-04-24T13:29:31.889 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T13:29:31.890 INFO:tasks.ceph:role: osd.4 2024-04-24T13:29:31.890 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-24T13:29:31.890 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-04-24T13:29:31.951 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T13:29:31.951 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T13:29:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T13:29:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T13:29:31.952 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T13:29:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-24T13:29:31.952 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T13:29:31.952 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T13:29:31.952 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T13:29:31.952 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T13:29:32.418 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-24T13:29:32.420 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-24T13:29:32.421 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-4 2024-04-24T13:29:32.540 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-4 2024-04-24T13:29:32.552 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T13:29:32.552 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T13:29:32.552 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-5 2024-04-24T13:29:32.612 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T13:29:32.612 INFO:tasks.ceph:role: osd.5 2024-04-24T13:29:32.612 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-24T13:29:32.612 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-04-24T13:29:32.676 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T13:29:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T13:29:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T13:29:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T13:29:32.676 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T13:29:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-24T13:29:32.676 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T13:29:32.676 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T13:29:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T13:29:32.677 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T13:29:33.102 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-24T13:29:33.104 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-24T13:29:33.104 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-5 2024-04-24T13:29:33.173 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-5 2024-04-24T13:29:33.227 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T13:29:33.227 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T13:29:33.228 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-6 2024-04-24T13:29:33.280 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T13:29:33.281 INFO:tasks.ceph:role: osd.6 2024-04-24T13:29:33.281 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-24T13:29:33.281 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-04-24T13:29:33.344 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T13:29:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T13:29:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T13:29:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T13:29:33.344 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T13:29:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-24T13:29:33.345 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T13:29:33.345 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T13:29:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T13:29:33.345 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T13:29:33.810 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-24T13:29:33.812 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-24T13:29:33.812 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-6 2024-04-24T13:29:33.906 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-6 2024-04-24T13:29:33.916 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T13:29:33.917 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T13:29:33.917 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/osd/ceph-7 2024-04-24T13:29:33.971 INFO:tasks.ceph:roles_to_devs: {'osd.4': '/dev/vg_nvme/lv_1', 'osd.5': '/dev/vg_nvme/lv_2', 'osd.6': '/dev/vg_nvme/lv_3', 'osd.7': '/dev/vg_nvme/lv_4'} 2024-04-24T13:29:33.972 INFO:tasks.ceph:role: osd.7 2024-04-24T13:29:33.972 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-24T13:29:33.972 DEBUG:teuthology.orchestra.run.smithi138:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_4 2024-04-24T13:29:34.032 INFO:teuthology.orchestra.run.smithi138.stdout:meta-data=/dev/vg_nvme/lv_4 isize=2048 agcount=4, agsize=5859072 blks 2024-04-24T13:29:34.032 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 attr=2, projid32bit=1 2024-04-24T13:29:34.032 INFO:teuthology.orchestra.run.smithi138.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-04-24T13:29:34.032 INFO:teuthology.orchestra.run.smithi138.stdout: = reflink=1 bigtime=0 inobtcount=0 2024-04-24T13:29:34.032 INFO:teuthology.orchestra.run.smithi138.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-04-24T13:29:34.032 INFO:teuthology.orchestra.run.smithi138.stdout: = sunit=0 swidth=0 blks 2024-04-24T13:29:34.032 INFO:teuthology.orchestra.run.smithi138.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-04-24T13:29:34.032 INFO:teuthology.orchestra.run.smithi138.stdout:log =internal log bsize=4096 blocks=11443, version=2 2024-04-24T13:29:34.032 INFO:teuthology.orchestra.run.smithi138.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-04-24T13:29:34.033 INFO:teuthology.orchestra.run.smithi138.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-04-24T13:29:34.488 INFO:teuthology.orchestra.run.smithi138.stdout:Discarding blocks...Done. 2024-04-24T13:29:34.490 INFO:tasks.ceph:mount /dev/vg_nvme/lv_4 on ubuntu@smithi138.front.sepia.ceph.com -o noatime 2024-04-24T13:29:34.490 DEBUG:teuthology.orchestra.run.smithi138:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_4 /var/lib/ceph/osd/ceph-7 2024-04-24T13:29:34.616 DEBUG:teuthology.orchestra.run.smithi138:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-7 2024-04-24T13:29:34.627 INFO:teuthology.orchestra.run.smithi138.stderr:sudo: /sbin/restorecon: command not found 2024-04-24T13:29:34.627 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T13:29:34.628 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 4 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:34.740 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:34.735+0000 7fba287ef7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-4/keyring: can't open /var/lib/ceph/osd/ceph-4/keyring: (2) No such file or directory 2024-04-24T13:29:34.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:34.743+0000 7fba287ef7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-4/keyring 2024-04-24T13:29:34.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:34.743+0000 7fba287ef7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T13:29:34.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:34.743+0000 7fba287ef7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T13:29:34.747 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:34.743+0000 7fba287ef7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-4/block: (2) No such file or directory 2024-04-24T13:29:34.752 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:34.747+0000 7fba287ef7c0 -1 bluestore(/var/lib/ceph/osd/ceph-4) _read_fsid unparsable uuid 2024-04-24T13:29:37.740 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-04-24T13:29:37.754 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 5 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:37.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:37.831+0000 7f944c3e37c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-5/keyring: can't open /var/lib/ceph/osd/ceph-5/keyring: (2) No such file or directory 2024-04-24T13:29:37.836 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:37.835+0000 7f944c3e37c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-5/keyring 2024-04-24T13:29:37.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:37.835+0000 7f944c3e37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T13:29:37.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:37.835+0000 7f944c3e37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T13:29:37.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:37.835+0000 7f944c3e37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-5/block: (2) No such file or directory 2024-04-24T13:29:37.837 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:37.835+0000 7f944c3e37c0 -1 bluestore(/var/lib/ceph/osd/ceph-5) _read_fsid unparsable uuid 2024-04-24T13:29:40.833 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-04-24T13:29:40.890 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 6 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:40.971 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:40.967+0000 7fb235a587c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-6/keyring: can't open /var/lib/ceph/osd/ceph-6/keyring: (2) No such file or directory 2024-04-24T13:29:40.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:40.967+0000 7fb235a587c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-6/keyring 2024-04-24T13:29:40.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:40.967+0000 7fb235a587c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T13:29:40.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:40.967+0000 7fb235a587c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T13:29:40.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:40.967+0000 7fb235a587c0 -1 bluestore(/var/lib/ceph/osd/ceph-6/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-6/block: (2) No such file or directory 2024-04-24T13:29:40.972 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:40.971+0000 7fb235a587c0 -1 bluestore(/var/lib/ceph/osd/ceph-6) _read_fsid unparsable uuid 2024-04-24T13:29:43.948 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-6 2024-04-24T13:29:44.005 DEBUG:teuthology.orchestra.run.smithi138:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 7 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:44.087 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:44.083+0000 7fdf6f6fc7c0 -1 auth: error reading file: /var/lib/ceph/osd/ceph-7/keyring: can't open /var/lib/ceph/osd/ceph-7/keyring: (2) No such file or directory 2024-04-24T13:29:44.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:44.083+0000 7fdf6f6fc7c0 -1 created new key in keyring /var/lib/ceph/osd/ceph-7/keyring 2024-04-24T13:29:44.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:44.083+0000 7fdf6f6fc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T13:29:44.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:44.083+0000 7fdf6f6fc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T13:29:44.089 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:44.083+0000 7fdf6f6fc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7/block) _read_bdev_label failed to open /var/lib/ceph/osd/ceph-7/block: (2) No such file or directory 2024-04-24T13:29:44.090 INFO:teuthology.orchestra.run.smithi138.stderr:2024-04-24T13:29:44.087+0000 7fdf6f6fc7c0 -1 bluestore(/var/lib/ceph/osd/ceph-7) _read_fsid unparsable uuid 2024-04-24T13:29:47.084 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-7 2024-04-24T13:29:47.145 INFO:tasks.ceph:Reading keys from all nodes... 2024-04-24T13:29:47.146 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:47.146 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/mgr/ceph-y/keyring of=/dev/stdout 2024-04-24T13:29:47.164 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:47.164 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-04-24T13:29:47.217 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:47.218 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-04-24T13:29:47.273 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:47.273 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-04-24T13:29:47.325 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:47.325 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-04-24T13:29:47.378 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:47.378 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-04-24T13:29:47.392 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:47.392 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/keyring of=/dev/stdout 2024-04-24T13:29:47.447 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:47.447 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/keyring of=/dev/stdout 2024-04-24T13:29:47.499 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:47.499 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-6/keyring of=/dev/stdout 2024-04-24T13:29:47.552 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:47.552 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-7/keyring of=/dev/stdout 2024-04-24T13:29:47.608 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:47.608 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-04-24T13:29:47.614 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:47.614 DEBUG:teuthology.orchestra.run.smithi138:> dd if=/etc/ceph/ceph.client.1.keyring of=/dev/stdout 2024-04-24T13:29:47.657 INFO:tasks.ceph:Adding keys to all mons... 2024-04-24T13:29:47.657 DEBUG:teuthology.orchestra.run.smithi071:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T13:29:47.660 DEBUG:teuthology.orchestra.run.smithi138:> sudo tee -a /etc/ceph/ceph.keyring 2024-04-24T13:29:47.702 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.y] 2024-04-24T13:29:47.703 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAsCSlmAWMoCBAAPu4RSsaCTtNd98Eh617duw== 2024-04-24T13:29:47.703 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.0] 2024-04-24T13:29:47.703 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAvCSlmgq+EHxAAGmu6Xtaq7oLkMmKlaNi6mw== 2024-04-24T13:29:47.703 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.1] 2024-04-24T13:29:47.703 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAyCSlmhNiaJBAA/t33D1KDWBEKiX055UJLEA== 2024-04-24T13:29:47.703 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.2] 2024-04-24T13:29:47.703 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQA1CSlmREEdKxAAayabQqReDwBTyabFtIae7Q== 2024-04-24T13:29:47.703 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.3] 2024-04-24T13:29:47.703 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQA4CSlmWlN8MhAAySOBRRj8ktomshW8pwLq9Q== 2024-04-24T13:29:47.703 INFO:teuthology.orchestra.run.smithi071.stdout:[mgr.x] 2024-04-24T13:29:47.703 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAsCSlmTdr/ChAAdtQXXyPv2vquSf+fFMIHrw== 2024-04-24T13:29:47.703 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.4] 2024-04-24T13:29:47.703 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQA+CSlmSiFHLBAAzFstuj7iYas5ZZ8my4Gu0w== 2024-04-24T13:29:47.704 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.5] 2024-04-24T13:29:47.704 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBBCSlmCXIDMhAAqReQU40OiL1Dnx0x/XXp9w== 2024-04-24T13:29:47.704 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.6] 2024-04-24T13:29:47.704 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBECSlmyyIPOhAAOpOGn7eiUkSu+5gld6KdAg== 2024-04-24T13:29:47.704 INFO:teuthology.orchestra.run.smithi071.stdout:[osd.7] 2024-04-24T13:29:47.704 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQBICSlmM8FfBRAAn4I/wc/S3LL0JxdFJ0zL6w== 2024-04-24T13:29:47.704 INFO:teuthology.orchestra.run.smithi071.stdout:[client.0] 2024-04-24T13:29:47.704 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAsCSlmA+KWDRAAxYcV3AcftqOSe87p1TzT7w== 2024-04-24T13:29:47.704 INFO:teuthology.orchestra.run.smithi071.stdout:[client.1] 2024-04-24T13:29:47.704 INFO:teuthology.orchestra.run.smithi071.stdout: key = AQAsCSlmdcpaEBAAstLtxN08Qj+3ZheTLHrb1g== 2024-04-24T13:29:47.711 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.y] 2024-04-24T13:29:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAsCSlmAWMoCBAAPu4RSsaCTtNd98Eh617duw== 2024-04-24T13:29:47.712 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.0] 2024-04-24T13:29:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAvCSlmgq+EHxAAGmu6Xtaq7oLkMmKlaNi6mw== 2024-04-24T13:29:47.712 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.1] 2024-04-24T13:29:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAyCSlmhNiaJBAA/t33D1KDWBEKiX055UJLEA== 2024-04-24T13:29:47.712 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.2] 2024-04-24T13:29:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQA1CSlmREEdKxAAayabQqReDwBTyabFtIae7Q== 2024-04-24T13:29:47.712 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.3] 2024-04-24T13:29:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQA4CSlmWlN8MhAAySOBRRj8ktomshW8pwLq9Q== 2024-04-24T13:29:47.713 INFO:teuthology.orchestra.run.smithi138.stdout:[mgr.x] 2024-04-24T13:29:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAsCSlmTdr/ChAAdtQXXyPv2vquSf+fFMIHrw== 2024-04-24T13:29:47.713 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.4] 2024-04-24T13:29:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQA+CSlmSiFHLBAAzFstuj7iYas5ZZ8my4Gu0w== 2024-04-24T13:29:47.713 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.5] 2024-04-24T13:29:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBBCSlmCXIDMhAAqReQU40OiL1Dnx0x/XXp9w== 2024-04-24T13:29:47.713 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.6] 2024-04-24T13:29:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBECSlmyyIPOhAAOpOGn7eiUkSu+5gld6KdAg== 2024-04-24T13:29:47.713 INFO:teuthology.orchestra.run.smithi138.stdout:[osd.7] 2024-04-24T13:29:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQBICSlmM8FfBRAAn4I/wc/S3LL0JxdFJ0zL6w== 2024-04-24T13:29:47.713 INFO:teuthology.orchestra.run.smithi138.stdout:[client.0] 2024-04-24T13:29:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAsCSlmA+KWDRAAxYcV3AcftqOSe87p1TzT7w== 2024-04-24T13:29:47.714 INFO:teuthology.orchestra.run.smithi138.stdout:[client.1] 2024-04-24T13:29:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: key = AQAsCSlmdcpaEBAAstLtxN08Qj+3ZheTLHrb1g== 2024-04-24T13:29:47.715 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T13:29:47.748 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.y --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T13:29:47.801 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:47.803 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:47.846 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:47.888 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:47.927 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:47.972 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:48.014 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:48.017 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:48.097 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T13:29:48.099 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-04-24T13:29:48.178 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:48.183 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.4 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:48.263 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:48.267 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.5 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:48.349 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:48.351 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.6 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:48.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:48.438 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.7 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-04-24T13:29:48.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T13:29:48.520 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T13:29:48.608 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T13:29:48.611 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.1 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-04-24T13:29:48.658 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-04-24T13:29:48.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-04-24T13:29:48.670 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T13:29:48.760 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-04-24T13:29:48.770 DEBUG:teuthology.orchestra.run.smithi071:> sudo mkdir -p /var/lib/ceph/mon/ceph-c 2024-04-24T13:29:48.823 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i c --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T13:29:48.909 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-c 2024-04-24T13:29:48.960 DEBUG:teuthology.orchestra.run.smithi138:> sudo mkdir -p /var/lib/ceph/mon/ceph-b 2024-04-24T13:29:48.974 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i b --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-04-24T13:29:49.067 DEBUG:teuthology.orchestra.run.smithi138:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-b 2024-04-24T13:29:49.078 DEBUG:teuthology.orchestra.run.smithi071:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:49.081 DEBUG:teuthology.orchestra.run.smithi138:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-04-24T13:29:49.128 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-04-24T13:29:49.129 INFO:tasks.ceph.mon.a:Restarting daemon 2024-04-24T13:29:49.129 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-04-24T13:29:49.131 INFO:tasks.ceph.mon.a:Started 2024-04-24T13:29:49.131 INFO:tasks.ceph.mon.c:Restarting daemon 2024-04-24T13:29:49.131 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i c 2024-04-24T13:29:49.134 INFO:tasks.ceph.mon.c:Started 2024-04-24T13:29:49.134 INFO:tasks.ceph.mon.b:Restarting daemon 2024-04-24T13:29:49.134 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i b 2024-04-24T13:29:49.174 INFO:tasks.ceph.mon.b:Started 2024-04-24T13:29:49.174 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-04-24T13:29:49.174 INFO:tasks.ceph.mgr.y:Restarting daemon 2024-04-24T13:29:49.174 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i y 2024-04-24T13:29:49.177 INFO:tasks.ceph.mgr.y:Started 2024-04-24T13:29:49.177 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-04-24T13:29:49.177 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-04-24T13:29:49.179 INFO:tasks.ceph.mgr.x:Started 2024-04-24T13:29:49.179 INFO:tasks.ceph:Setting crush tunables to default 2024-04-24T13:29:49.179 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd crush tunables default 2024-04-24T13:29:54.766 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:54.763+0000 7f90bf488180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T13:29:55.268 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:55.267+0000 7f90bf488180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T13:29:55.386 INFO:teuthology.orchestra.run.smithi071.stderr:adjusted tunables profile to default 2024-04-24T13:29:55.404 INFO:tasks.ceph:check_enable_crimson: False 2024-04-24T13:29:55.404 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-04-24T13:29:55.405 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:55.405 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-04-24T13:29:55.415 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:55.415 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-04-24T13:29:55.464 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:55.463+0000 7f90bf488180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T13:29:55.468 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:55.468 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-04-24T13:29:55.499 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:55.498+0000 7fcb390a7180 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-04-24T13:29:55.510 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:29:55.510 DEBUG:teuthology.orchestra.run.smithi071:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-04-24T13:29:55.566 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:55.567 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-4/fsid of=/dev/stdout 2024-04-24T13:29:55.580 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:55.580 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-5/fsid of=/dev/stdout 2024-04-24T13:29:55.635 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:55.635 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-6/fsid of=/dev/stdout 2024-04-24T13:29:55.687 DEBUG:teuthology.orchestra.run.smithi138:> set -ex 2024-04-24T13:29:55.687 DEBUG:teuthology.orchestra.run.smithi138:> sudo dd if=/var/lib/ceph/osd/ceph-7/fsid of=/dev/stdout 2024-04-24T13:29:55.739 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new dcf17737-d21a-4731-8a14-4b008f82e1b8 0 2024-04-24T13:29:55.997 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:55.994+0000 7fcb390a7180 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-04-24T13:29:56.006 INFO:teuthology.orchestra.run.smithi138.stdout:0 2024-04-24T13:29:56.024 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:56.023+0000 7f90bf488180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T13:29:56.028 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 559511d8-704f-48ae-a330-331a8a18486a 1 2024-04-24T13:29:56.081 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:56.079+0000 7f90bf488180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T13:29:56.135 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:56.131+0000 7f90bf488180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T13:29:56.187 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:56.186+0000 7fcb390a7180 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-04-24T13:29:56.215 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:56.211+0000 7f90bf488180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T13:29:56.236 INFO:teuthology.orchestra.run.smithi138.stdout:1 2024-04-24T13:29:56.252 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 496cf95c-01c4-4537-ba79-35c2ad152201 2 2024-04-24T13:29:56.269 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:56.267+0000 7f90bf488180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T13:29:56.348 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:56.347+0000 7f90bf488180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T13:29:56.403 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:56.399+0000 7f90bf488180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T13:29:56.460 INFO:teuthology.orchestra.run.smithi138.stdout:2 2024-04-24T13:29:56.477 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 5ce9d307-23e5-4bb9-8035-0827520a6d80 3 2024-04-24T13:29:56.556 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:56.551+0000 7f90bf488180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T13:29:56.619 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:56.615+0000 7f90bf488180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T13:29:56.719 INFO:teuthology.orchestra.run.smithi138.stdout:3 2024-04-24T13:29:56.735 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 6d6e5b3c-301d-4b2c-996f-17d13224f780 4 2024-04-24T13:29:56.737 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:56.734+0000 7fcb390a7180 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-04-24T13:29:56.791 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:56.790+0000 7fcb390a7180 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-04-24T13:29:56.843 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:56.842+0000 7fcb390a7180 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-04-24T13:29:56.920 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:56.918+0000 7fcb390a7180 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-04-24T13:29:56.971 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:56.970+0000 7fcb390a7180 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-04-24T13:29:57.028 INFO:teuthology.orchestra.run.smithi138.stdout:4 2024-04-24T13:29:57.044 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new b3d18c54-5a9a-4215-8b40-3e796ac2fed4 5 2024-04-24T13:29:57.048 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:57.046+0000 7fcb390a7180 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-04-24T13:29:57.101 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:57.098+0000 7fcb390a7180 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-04-24T13:29:57.220 INFO:teuthology.orchestra.run.smithi138.stdout:5 2024-04-24T13:29:57.236 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new 12d21ba0-8670-470b-8fd5-a02349ecb4d4 6 2024-04-24T13:29:57.251 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:57.250+0000 7fcb390a7180 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-04-24T13:29:57.290 INFO:tasks.ceph.mgr.x.smithi138.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-24T13:29:57.290 INFO:tasks.ceph.mgr.x.smithi138.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-24T13:29:57.290 INFO:tasks.ceph.mgr.x.smithi138.stderr: from numpy import show_config as show_numpy_config 2024-04-24T13:29:57.315 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:57.314+0000 7fcb390a7180 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-04-24T13:29:57.332 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:57.327+0000 7f90bf488180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T13:29:57.423 INFO:teuthology.orchestra.run.smithi138.stdout:6 2024-04-24T13:29:57.441 DEBUG:teuthology.orchestra.run.smithi138:> sudo ceph --cluster ceph osd new dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce 7 2024-04-24T13:29:57.478 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:57.475+0000 7f90bf488180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T13:29:57.633 INFO:teuthology.orchestra.run.smithi138.stdout:7 2024-04-24T13:29:57.650 INFO:tasks.ceph.osd.0:Restarting daemon 2024-04-24T13:29:57.650 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-04-24T13:29:57.652 INFO:tasks.ceph.osd.0:Started 2024-04-24T13:29:57.652 INFO:tasks.ceph.osd.1:Restarting daemon 2024-04-24T13:29:57.653 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-04-24T13:29:57.654 INFO:tasks.ceph.osd.1:Started 2024-04-24T13:29:57.655 INFO:tasks.ceph.osd.2:Restarting daemon 2024-04-24T13:29:57.655 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-04-24T13:29:57.657 INFO:tasks.ceph.osd.2:Started 2024-04-24T13:29:57.657 INFO:tasks.ceph.osd.3:Restarting daemon 2024-04-24T13:29:57.657 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-04-24T13:29:57.659 INFO:tasks.ceph.osd.3:Started 2024-04-24T13:29:57.659 INFO:tasks.ceph.osd.4:Restarting daemon 2024-04-24T13:29:57.659 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 4 2024-04-24T13:29:57.660 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:57.659+0000 7f90bf488180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T13:29:57.662 INFO:tasks.ceph.osd.4:Started 2024-04-24T13:29:57.662 INFO:tasks.ceph.osd.5:Restarting daemon 2024-04-24T13:29:57.662 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 5 2024-04-24T13:29:57.664 INFO:tasks.ceph.osd.5:Started 2024-04-24T13:29:57.664 INFO:tasks.ceph.osd.6:Restarting daemon 2024-04-24T13:29:57.664 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 6 2024-04-24T13:29:57.666 INFO:tasks.ceph.osd.6:Started 2024-04-24T13:29:57.667 INFO:tasks.ceph.osd.7:Restarting daemon 2024-04-24T13:29:57.667 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 7 2024-04-24T13:29:57.669 INFO:tasks.ceph.osd.7:Started 2024-04-24T13:29:57.669 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T13:29:57.753 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:57.751+0000 7f90bf488180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T13:29:57.864 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:29:57.865 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":10,"fsid":"6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8","created":"2024-04-24T13:29:54.500837+0000","modified":"2024-04-24T13:29:57.629279+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T13:29:57.629279+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dcf17737-d21a-4731-8a14-4b008f82e1b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"559511d8-704f-48ae-a330-331a8a18486a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"496cf95c-01c4-4537-ba79-35c2ad152201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5ce9d307-23e5-4bb9-8035-0827520a6d80","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6d6e5b3c-301d-4b2c-996f-17d13224f780","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b3d18c54-5a9a-4215-8b40-3e796ac2fed4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"12d21ba0-8670-470b-8fd5-a02349ecb4d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T13:29:57.881 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-04-24T13:29:57.882 INFO:tasks.ceph:Waiting for OSDs to come up 2024-04-24T13:29:57.886 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:57.883+0000 7f90bf488180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T13:29:57.961 INFO:tasks.ceph.mgr.y.smithi071.stderr:/usr/lib/python3/dist-packages/scipy/__init__.py:67: UserWarning: NumPy was imported from a Python sub-interpreter but NumPy does not properly support sub-interpreters. This will likely work for most users but might cause hard to track down issues or subtle bugs. A common user of the rare sub-interpreter feature is wsgi which also allows single-interpreter mode. 2024-04-24T13:29:57.962 INFO:tasks.ceph.mgr.y.smithi071.stderr:Improvements in the case of bugs are welcome, but is not on the NumPy roadmap, and full support may require significant effort to achieve. 2024-04-24T13:29:57.962 INFO:tasks.ceph.mgr.y.smithi071.stderr: from numpy import show_config as show_numpy_config 2024-04-24T13:29:58.001 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:57.998+0000 7fcb390a7180 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-04-24T13:29:58.146 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:58.142+0000 7fcb390a7180 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-04-24T13:29:58.285 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:29:58.283+0000 7fe76526a7c0 -1 Falling back to public interface 2024-04-24T13:29:58.297 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:29:58.295+0000 7f5cd576d7c0 -1 Falling back to public interface 2024-04-24T13:29:58.297 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:29:58.295+0000 7f03837957c0 -1 Falling back to public interface 2024-04-24T13:29:58.297 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:29:58.295+0000 7fe8c448b7c0 -1 Falling back to public interface 2024-04-24T13:29:58.301 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:58.298+0000 7fcb390a7180 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-04-24T13:29:58.303 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:29:58.302+0000 7fef37b617c0 -1 Falling back to public interface 2024-04-24T13:29:58.304 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:29:58.302+0000 7f115c00e7c0 -1 Falling back to public interface 2024-04-24T13:29:58.304 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:29:58.302+0000 7f6c7b5467c0 -1 Falling back to public interface 2024-04-24T13:29:58.319 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:29:58.318+0000 7f4504f3b7c0 -1 Falling back to public interface 2024-04-24T13:29:58.368 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:58.366+0000 7fcb390a7180 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-04-24T13:29:58.500 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:58.499+0000 7f90bf488180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T13:29:58.500 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:58.498+0000 7fcb390a7180 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-04-24T13:29:58.575 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:58.571+0000 7f90bf488180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T13:29:58.687 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T13:29:58.755 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:58.751+0000 7f90bf488180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T13:29:58.828 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:58.823+0000 7f90bf488180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T13:29:58.862 INFO:teuthology.misc.health.smithi071.stdout: 2024-04-24T13:29:58.863 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":10,"fsid":"6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8","created":"2024-04-24T13:29:54.500837+0000","modified":"2024-04-24T13:29:57.629279+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T13:29:57.629279+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dcf17737-d21a-4731-8a14-4b008f82e1b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"559511d8-704f-48ae-a330-331a8a18486a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"496cf95c-01c4-4537-ba79-35c2ad152201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5ce9d307-23e5-4bb9-8035-0827520a6d80","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6d6e5b3c-301d-4b2c-996f-17d13224f780","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b3d18c54-5a9a-4215-8b40-3e796ac2fed4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"12d21ba0-8670-470b-8fd5-a02349ecb4d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T13:29:58.878 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-24T13:29:59.112 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:59.111+0000 7f90bf488180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T13:29:59.121 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:59.118+0000 7fcb390a7180 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-04-24T13:29:59.173 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:29:59.171+0000 7f90bf488180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T13:29:59.196 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:59.194+0000 7fcb390a7180 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-04-24T13:29:59.383 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:59.382+0000 7fcb390a7180 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-04-24T13:29:59.456 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:59.454+0000 7fcb390a7180 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-04-24T13:29:59.744 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:59.742+0000 7fcb390a7180 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-04-24T13:29:59.805 INFO:tasks.ceph.mgr.y.smithi071.stderr:2024-04-24T13:29:59.802+0000 7fcb390a7180 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-04-24T13:30:00.221 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:30:00.219+0000 7f90668d1640 -1 mgr.server handle_report got status from non-daemon mon.b 2024-04-24T13:30:00.221 INFO:tasks.ceph.mgr.x.smithi138.stderr:2024-04-24T13:30:00.219+0000 7f90668d1640 -1 mgr.server handle_report got status from non-daemon mon.c 2024-04-24T13:30:02.101 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:02.099+0000 7f5cd576d7c0 -1 osd.6 0 log_to_monitors true 2024-04-24T13:30:02.107 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:02.103+0000 7fe8c448b7c0 -1 osd.5 0 log_to_monitors true 2024-04-24T13:30:02.145 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:02.142+0000 7f115c00e7c0 -1 osd.2 0 log_to_monitors true 2024-04-24T13:30:02.175 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:02.174+0000 7f6c7b5467c0 -1 osd.3 0 log_to_monitors true 2024-04-24T13:30:02.188 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:02.187+0000 7f03837957c0 -1 osd.4 0 log_to_monitors true 2024-04-24T13:30:02.191 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:02.187+0000 7fe76526a7c0 -1 osd.7 0 log_to_monitors true 2024-04-24T13:30:02.268 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:02.266+0000 7fef37b617c0 -1 osd.0 0 log_to_monitors true 2024-04-24T13:30:02.277 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:02.274+0000 7f4504f3b7c0 -1 osd.1 0 log_to_monitors true 2024-04-24T13:30:05.572 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:05.571+0000 7fe8c0434640 -1 osd.5 0 waiting for initial osdmap 2024-04-24T13:30:05.601 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:05.599+0000 7fe8b8268640 -1 osd.5 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T13:30:05.610 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:05.610+0000 7f6c774ef640 -1 osd.3 0 waiting for initial osdmap 2024-04-24T13:30:05.635 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:05.634+0000 7fef33b0a640 -1 osd.0 0 waiting for initial osdmap 2024-04-24T13:30:05.651 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:05.650+0000 7f6c6f323640 -1 osd.3 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T13:30:05.654 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:05.651+0000 7f5cd1716640 -1 osd.6 0 waiting for initial osdmap 2024-04-24T13:30:05.658 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:05.658+0000 7fef2b93e640 -1 osd.0 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T13:30:05.673 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:05.671+0000 7fe761213640 -1 osd.7 0 waiting for initial osdmap 2024-04-24T13:30:05.674 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:05.674+0000 7f1157fb7640 -1 osd.2 0 waiting for initial osdmap 2024-04-24T13:30:05.684 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T13:30:05.688 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:05.687+0000 7f5cc954a640 -1 osd.6 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T13:30:05.694 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:05.691+0000 7f037ff50640 -1 osd.4 0 waiting for initial osdmap 2024-04-24T13:30:05.697 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:05.694+0000 7f114fdeb640 -1 osd.2 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T13:30:05.705 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:05.703+0000 7fe759047640 -1 osd.7 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T13:30:05.725 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:05.723+0000 7f0377572640 -1 osd.4 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T13:30:05.750 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:05.750+0000 7f4500ee4640 -1 osd.1 0 waiting for initial osdmap 2024-04-24T13:30:05.779 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:05.778+0000 7f44f8d18640 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-04-24T13:30:05.950 INFO:teuthology.misc.health.smithi071.stdout: 2024-04-24T13:30:05.950 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":12,"fsid":"6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8","created":"2024-04-24T13:29:54.500837+0000","modified":"2024-04-24T13:30:03.540331+0000","last_up_change":"0.000000","last_in_change":"2024-04-24T13:29:57.629279+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"dcf17737-d21a-4731-8a14-4b008f82e1b8","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"559511d8-704f-48ae-a330-331a8a18486a","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"496cf95c-01c4-4537-ba79-35c2ad152201","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"5ce9d307-23e5-4bb9-8035-0827520a6d80","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":4,"uuid":"6d6e5b3c-301d-4b2c-996f-17d13224f780","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":5,"uuid":"b3d18c54-5a9a-4215-8b40-3e796ac2fed4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":6,"uuid":"12d21ba0-8670-470b-8fd5-a02349ecb4d4","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":7,"uuid":"dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T13:30:05.966 DEBUG:teuthology.misc:0 of 8 OSDs are up 2024-04-24T13:30:12.774 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-04-24T13:30:13.074 INFO:teuthology.misc.health.smithi071.stdout: 2024-04-24T13:30:13.075 INFO:teuthology.misc.health.smithi071.stdout:{"epoch":16,"fsid":"6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8","created":"2024-04-24T13:29:54.500837+0000","modified":"2024-04-24T13:30:09.785973+0000","last_up_change":"2024-04-24T13:30:06.614065+0000","last_in_change":"2024-04-24T13:29:57.629279+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T13:30:07.251223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dcf17737-d21a-4731-8a14-4b008f82e1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6801","nonce":1371554644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6803","nonce":1371554644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6812","nonce":1371554644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6806","nonce":1371554644}]},"public_addr":"172.21.15.71:6801/1371554644","cluster_addr":"172.21.15.71:6803/1371554644","heartbeat_back_addr":"172.21.15.71:6812/1371554644","heartbeat_front_addr":"172.21.15.71:6806/1371554644","state":["exists","up"]},{"osd":1,"uuid":"559511d8-704f-48ae-a330-331a8a18486a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6825","nonce":2907970623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6827","nonce":2907970623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6831","nonce":2907970623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6829","nonce":2907970623}]},"public_addr":"172.21.15.71:6825/2907970623","cluster_addr":"172.21.15.71:6827/2907970623","heartbeat_back_addr":"172.21.15.71:6831/2907970623","heartbeat_front_addr":"172.21.15.71:6829/2907970623","state":["exists","up"]},{"osd":2,"uuid":"496cf95c-01c4-4537-ba79-35c2ad152201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6808","nonce":747727017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6813","nonce":747727017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6823","nonce":747727017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6819","nonce":747727017}]},"public_addr":"172.21.15.71:6808/747727017","cluster_addr":"172.21.15.71:6813/747727017","heartbeat_back_addr":"172.21.15.71:6823/747727017","heartbeat_front_addr":"172.21.15.71:6819/747727017","state":["exists","up"]},{"osd":3,"uuid":"5ce9d307-23e5-4bb9-8035-0827520a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6810","nonce":2258589678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6815","nonce":2258589678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6821","nonce":2258589678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6818","nonce":2258589678}]},"public_addr":"172.21.15.71:6810/2258589678","cluster_addr":"172.21.15.71:6815/2258589678","heartbeat_back_addr":"172.21.15.71:6821/2258589678","heartbeat_front_addr":"172.21.15.71:6818/2258589678","state":["exists","up"]},{"osd":4,"uuid":"6d6e5b3c-301d-4b2c-996f-17d13224f780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6814","nonce":2264053969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6817","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6821","nonce":2264053969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6830","nonce":2264053969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6826","nonce":2264053969}]},"public_addr":"172.21.15.138:6814/2264053969","cluster_addr":"172.21.15.138:6821/2264053969","heartbeat_back_addr":"172.21.15.138:6830/2264053969","heartbeat_front_addr":"172.21.15.138:6826/2264053969","state":["exists","up"]},{"osd":5,"uuid":"b3d18c54-5a9a-4215-8b40-3e796ac2fed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6815","nonce":942955714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6819","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6822","nonce":942955714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6829","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6831","nonce":942955714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6827","nonce":942955714}]},"public_addr":"172.21.15.138:6815/942955714","cluster_addr":"172.21.15.138:6822/942955714","heartbeat_back_addr":"172.21.15.138:6831/942955714","heartbeat_front_addr":"172.21.15.138:6827/942955714","state":["exists","up"]},{"osd":6,"uuid":"12d21ba0-8670-470b-8fd5-a02349ecb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6809","nonce":889830629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6813","nonce":889830629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6823","nonce":889830629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6818","nonce":889830629}]},"public_addr":"172.21.15.138:6809/889830629","cluster_addr":"172.21.15.138:6813/889830629","heartbeat_back_addr":"172.21.15.138:6823/889830629","heartbeat_front_addr":"172.21.15.138:6818/889830629","state":["exists","up"]},{"osd":7,"uuid":"dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":14,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6801","nonce":2015291049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6803","nonce":2015291049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6807","nonce":2015291049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6805","nonce":2015291049}]},"public_addr":"172.21.15.138:6801/2015291049","cluster_addr":"172.21.15.138:6803/2015291049","heartbeat_back_addr":"172.21.15.138:6807/2015291049","heartbeat_front_addr":"172.21.15.138:6805/2015291049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.268101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.247572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.186485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.184532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.157242+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.126293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.118991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.213395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T13:30:13.092 DEBUG:teuthology.misc:8 of 8 OSDs are up 2024-04-24T13:30:13.092 INFO:tasks.ceph:Creating RBD pool 2024-04-24T13:30:13.092 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd pool create rbd 8 2024-04-24T13:30:14.142 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'rbd' created 2024-04-24T13:30:14.165 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph osd pool application enable rbd rbd --yes-i-really-mean-it 2024-04-24T13:30:15.145 INFO:teuthology.orchestra.run.smithi071.stderr:enabled application 'rbd' on pool 'rbd' 2024-04-24T13:30:15.170 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-04-24T13:30:15.170 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-04-24T13:30:15.170 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-04-24T13:30:15.170 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-04-24T13:30:15.171 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-04-24T13:30:15.509 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:30:15.527 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6832","nonce":1407719821},{"type":"v1","addr":"172.21.15.138:6833","nonce":1407719821}]},"active_addr":"172.21.15.138:6833/1407719821","active_change":"2024-04-24T13:29:59.196746+0000","active_mgr_features":4540701547738038271,"available":true,"standbys":[{"gid":4107,"name":"y","mgr_features":4540701547738038271,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.25.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:9.4.12","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.5.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.1","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.43.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:2.4.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":2070446931}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":2674849272}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1853314966}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.138:0","nonce":1931884507}]}]} 2024-04-24T13:30:15.533 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-04-24T13:30:15.533 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-24T13:30:15.533 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T13:30:15.818 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:30:15.818 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":18,"fsid":"6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8","created":"2024-04-24T13:29:54.500837+0000","modified":"2024-04-24T13:30:15.137612+0000","last_up_change":"2024-04-24T13:30:06.614065+0000","last_in_change":"2024-04-24T13:29:57.629279+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T13:30:07.251223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T13:30:13.385113+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dcf17737-d21a-4731-8a14-4b008f82e1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6801","nonce":1371554644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6803","nonce":1371554644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6812","nonce":1371554644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6806","nonce":1371554644}]},"public_addr":"172.21.15.71:6801/1371554644","cluster_addr":"172.21.15.71:6803/1371554644","heartbeat_back_addr":"172.21.15.71:6812/1371554644","heartbeat_front_addr":"172.21.15.71:6806/1371554644","state":["exists","up"]},{"osd":1,"uuid":"559511d8-704f-48ae-a330-331a8a18486a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6825","nonce":2907970623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6827","nonce":2907970623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6831","nonce":2907970623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6829","nonce":2907970623}]},"public_addr":"172.21.15.71:6825/2907970623","cluster_addr":"172.21.15.71:6827/2907970623","heartbeat_back_addr":"172.21.15.71:6831/2907970623","heartbeat_front_addr":"172.21.15.71:6829/2907970623","state":["exists","up"]},{"osd":2,"uuid":"496cf95c-01c4-4537-ba79-35c2ad152201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6808","nonce":747727017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6813","nonce":747727017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6823","nonce":747727017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6819","nonce":747727017}]},"public_addr":"172.21.15.71:6808/747727017","cluster_addr":"172.21.15.71:6813/747727017","heartbeat_back_addr":"172.21.15.71:6823/747727017","heartbeat_front_addr":"172.21.15.71:6819/747727017","state":["exists","up"]},{"osd":3,"uuid":"5ce9d307-23e5-4bb9-8035-0827520a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6810","nonce":2258589678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6815","nonce":2258589678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6821","nonce":2258589678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6818","nonce":2258589678}]},"public_addr":"172.21.15.71:6810/2258589678","cluster_addr":"172.21.15.71:6815/2258589678","heartbeat_back_addr":"172.21.15.71:6821/2258589678","heartbeat_front_addr":"172.21.15.71:6818/2258589678","state":["exists","up"]},{"osd":4,"uuid":"6d6e5b3c-301d-4b2c-996f-17d13224f780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6814","nonce":2264053969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6817","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6821","nonce":2264053969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6830","nonce":2264053969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6826","nonce":2264053969}]},"public_addr":"172.21.15.138:6814/2264053969","cluster_addr":"172.21.15.138:6821/2264053969","heartbeat_back_addr":"172.21.15.138:6830/2264053969","heartbeat_front_addr":"172.21.15.138:6826/2264053969","state":["exists","up"]},{"osd":5,"uuid":"b3d18c54-5a9a-4215-8b40-3e796ac2fed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6815","nonce":942955714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6819","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6822","nonce":942955714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6829","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6831","nonce":942955714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6827","nonce":942955714}]},"public_addr":"172.21.15.138:6815/942955714","cluster_addr":"172.21.15.138:6822/942955714","heartbeat_back_addr":"172.21.15.138:6831/942955714","heartbeat_front_addr":"172.21.15.138:6827/942955714","state":["exists","up"]},{"osd":6,"uuid":"12d21ba0-8670-470b-8fd5-a02349ecb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6809","nonce":889830629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6813","nonce":889830629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6823","nonce":889830629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6818","nonce":889830629}]},"public_addr":"172.21.15.138:6809/889830629","cluster_addr":"172.21.15.138:6813/889830629","heartbeat_back_addr":"172.21.15.138:6823/889830629","heartbeat_front_addr":"172.21.15.138:6818/889830629","state":["exists","up"]},{"osd":7,"uuid":"dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6801","nonce":2015291049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6803","nonce":2015291049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6807","nonce":2015291049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6805","nonce":2015291049}]},"public_addr":"172.21.15.138:6801/2015291049","cluster_addr":"172.21.15.138:6803/2015291049","heartbeat_back_addr":"172.21.15.138:6807/2015291049","heartbeat_front_addr":"172.21.15.138:6805/2015291049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.268101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.247572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.186485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.184532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.157242+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.126293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.118991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.213395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T13:30:15.834 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-24T13:30:15.834 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T13:30:16.123 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:30:16.123 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":18,"fsid":"6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8","created":"2024-04-24T13:29:54.500837+0000","modified":"2024-04-24T13:30:15.137612+0000","last_up_change":"2024-04-24T13:30:06.614065+0000","last_in_change":"2024-04-24T13:29:57.629279+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T13:30:07.251223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T13:30:13.385113+0000","flags":32769,"flags_names":"hashpspool,creating","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"18","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dcf17737-d21a-4731-8a14-4b008f82e1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6801","nonce":1371554644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6803","nonce":1371554644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6812","nonce":1371554644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6806","nonce":1371554644}]},"public_addr":"172.21.15.71:6801/1371554644","cluster_addr":"172.21.15.71:6803/1371554644","heartbeat_back_addr":"172.21.15.71:6812/1371554644","heartbeat_front_addr":"172.21.15.71:6806/1371554644","state":["exists","up"]},{"osd":1,"uuid":"559511d8-704f-48ae-a330-331a8a18486a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6825","nonce":2907970623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6827","nonce":2907970623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6831","nonce":2907970623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6829","nonce":2907970623}]},"public_addr":"172.21.15.71:6825/2907970623","cluster_addr":"172.21.15.71:6827/2907970623","heartbeat_back_addr":"172.21.15.71:6831/2907970623","heartbeat_front_addr":"172.21.15.71:6829/2907970623","state":["exists","up"]},{"osd":2,"uuid":"496cf95c-01c4-4537-ba79-35c2ad152201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6808","nonce":747727017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6813","nonce":747727017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6823","nonce":747727017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6819","nonce":747727017}]},"public_addr":"172.21.15.71:6808/747727017","cluster_addr":"172.21.15.71:6813/747727017","heartbeat_back_addr":"172.21.15.71:6823/747727017","heartbeat_front_addr":"172.21.15.71:6819/747727017","state":["exists","up"]},{"osd":3,"uuid":"5ce9d307-23e5-4bb9-8035-0827520a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6810","nonce":2258589678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6815","nonce":2258589678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6821","nonce":2258589678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6818","nonce":2258589678}]},"public_addr":"172.21.15.71:6810/2258589678","cluster_addr":"172.21.15.71:6815/2258589678","heartbeat_back_addr":"172.21.15.71:6821/2258589678","heartbeat_front_addr":"172.21.15.71:6818/2258589678","state":["exists","up"]},{"osd":4,"uuid":"6d6e5b3c-301d-4b2c-996f-17d13224f780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6814","nonce":2264053969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6817","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6821","nonce":2264053969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6830","nonce":2264053969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6826","nonce":2264053969}]},"public_addr":"172.21.15.138:6814/2264053969","cluster_addr":"172.21.15.138:6821/2264053969","heartbeat_back_addr":"172.21.15.138:6830/2264053969","heartbeat_front_addr":"172.21.15.138:6826/2264053969","state":["exists","up"]},{"osd":5,"uuid":"b3d18c54-5a9a-4215-8b40-3e796ac2fed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6815","nonce":942955714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6819","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6822","nonce":942955714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6829","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6831","nonce":942955714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6827","nonce":942955714}]},"public_addr":"172.21.15.138:6815/942955714","cluster_addr":"172.21.15.138:6822/942955714","heartbeat_back_addr":"172.21.15.138:6831/942955714","heartbeat_front_addr":"172.21.15.138:6827/942955714","state":["exists","up"]},{"osd":6,"uuid":"12d21ba0-8670-470b-8fd5-a02349ecb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6809","nonce":889830629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6813","nonce":889830629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6823","nonce":889830629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6818","nonce":889830629}]},"public_addr":"172.21.15.138:6809/889830629","cluster_addr":"172.21.15.138:6813/889830629","heartbeat_back_addr":"172.21.15.138:6823/889830629","heartbeat_front_addr":"172.21.15.138:6818/889830629","state":["exists","up"]},{"osd":7,"uuid":"dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":17,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6801","nonce":2015291049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6803","nonce":2015291049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6807","nonce":2015291049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6805","nonce":2015291049}]},"public_addr":"172.21.15.138:6801/2015291049","cluster_addr":"172.21.15.138:6803/2015291049","heartbeat_back_addr":"172.21.15.138:6807/2015291049","heartbeat_front_addr":"172.21.15.138:6805/2015291049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.268101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.247572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.186485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.184532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.157242+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.126293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.118991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.213395+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T13:30:16.143 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-24T13:30:16.143 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-24T13:30:16.144 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-24T13:30:16.144 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-24T13:30:16.144 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-24T13:30:16.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-24T13:30:16.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-24T13:30:16.146 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-24T13:30:16.401 INFO:teuthology.orchestra.run.smithi071.stdout:55834574852 2024-04-24T13:30:16.401 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T13:30:16.402 INFO:teuthology.orchestra.run.smithi071.stdout:55834574853 2024-04-24T13:30:16.403 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T13:30:16.408 INFO:teuthology.orchestra.run.smithi071.stdout:55834574853 2024-04-24T13:30:16.409 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-24T13:30:16.410 INFO:teuthology.orchestra.run.smithi071.stdout:55834574853 2024-04-24T13:30:16.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-24T13:30:16.418 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2024-04-24T13:30:16.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T13:30:16.420 INFO:teuthology.orchestra.run.smithi071.stdout:55834574852 2024-04-24T13:30:16.420 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-24T13:30:16.422 INFO:teuthology.orchestra.run.smithi071.stdout:55834574852 2024-04-24T13:30:16.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-24T13:30:16.424 INFO:teuthology.orchestra.run.smithi071.stdout:55834574853 2024-04-24T13:30:16.425 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T13:30:16.908 INFO:teuthology.orchestra.run.smithi071.stdout:55834574852 2024-04-24T13:30:16.926 INFO:teuthology.orchestra.run.smithi071.stdout:55834574853 2024-04-24T13:30:16.929 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.4 2024-04-24T13:30:16.935 INFO:teuthology.orchestra.run.smithi071.stdout:55834574851 2024-04-24T13:30:16.943 INFO:teuthology.orchestra.run.smithi071.stdout:55834574852 2024-04-24T13:30:16.949 INFO:teuthology.orchestra.run.smithi071.stdout:55834574851 2024-04-24T13:30:16.952 INFO:teuthology.orchestra.run.smithi071.stdout:55834574852 2024-04-24T13:30:16.953 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574853 for osd.1 2024-04-24T13:30:16.968 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.3 2024-04-24T13:30:16.969 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.0 2024-04-24T13:30:16.975 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.5 2024-04-24T13:30:16.980 INFO:teuthology.orchestra.run.smithi071.stdout:55834574851 2024-04-24T13:30:16.981 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.7 2024-04-24T13:30:16.983 INFO:teuthology.orchestra.run.smithi071.stdout:55834574852 2024-04-24T13:30:16.999 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574851 for osd.6 2024-04-24T13:30:17.001 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574852 for osd.2 2024-04-24T13:30:17.930 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-24T13:30:17.955 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T13:30:17.969 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T13:30:17.970 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T13:30:17.975 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-24T13:30:17.983 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-24T13:30:18.000 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-24T13:30:18.002 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T13:30:18.428 INFO:teuthology.orchestra.run.smithi071.stdout:55834574853 2024-04-24T13:30:18.450 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.4 2024-04-24T13:30:18.450 DEBUG:teuthology.parallel:result is None 2024-04-24T13:30:18.498 INFO:teuthology.orchestra.run.smithi071.stdout:55834574852 2024-04-24T13:30:18.504 INFO:teuthology.orchestra.run.smithi071.stdout:55834574853 2024-04-24T13:30:18.512 INFO:teuthology.orchestra.run.smithi071.stdout:55834574852 2024-04-24T13:30:18.516 INFO:teuthology.orchestra.run.smithi071.stdout:55834574854 2024-04-24T13:30:18.517 INFO:teuthology.orchestra.run.smithi071.stdout:55834574853 2024-04-24T13:30:18.521 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.7 2024-04-24T13:30:18.521 DEBUG:teuthology.parallel:result is None 2024-04-24T13:30:18.539 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.3 2024-04-24T13:30:18.539 DEBUG:teuthology.parallel:result is None 2024-04-24T13:30:18.540 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.0 2024-04-24T13:30:18.540 DEBUG:teuthology.parallel:result is None 2024-04-24T13:30:18.541 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.5 2024-04-24T13:30:18.542 DEBUG:teuthology.parallel:result is None 2024-04-24T13:30:18.549 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574854 got 55834574854 for osd.1 2024-04-24T13:30:18.549 DEBUG:teuthology.parallel:result is None 2024-04-24T13:30:18.550 INFO:teuthology.orchestra.run.smithi071.stdout:55834574853 2024-04-24T13:30:18.550 INFO:teuthology.orchestra.run.smithi071.stdout:55834574852 2024-04-24T13:30:18.569 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574853 got 55834574853 for osd.2 2024-04-24T13:30:18.570 DEBUG:teuthology.parallel:result is None 2024-04-24T13:30:18.570 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574852 got 55834574852 for osd.6 2024-04-24T13:30:18.570 DEBUG:teuthology.parallel:result is None 2024-04-24T13:30:18.570 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T13:30:18.570 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:30:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:30:18.877 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:30:18.895 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-24T13:30:17.208422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218740,"kb_used_data":2556,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755980,"statfs":{"total":773094113280,"available":772870123520,"internally_reserved":0,"allocated":2617344,"data_stored":1633436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001180"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-24T13:30:15.162907+0000","last_change":"2024-04-24T13:30:15.161378+0000","last_active":"2024-04-24T13:30:15.162907+0000","last_peered":"2024-04-24T13:30:15.162907+0000","last_clean":"2024-04-24T13:30:15.162907+0000","last_became_active":"2024-04-24T13:30:15.160775+0000","last_became_peered":"2024-04-24T13:30:15.160775+0000","last_unstale":"2024-04-24T13:30:15.162907+0000","last_undegraded":"2024-04-24T13:30:15.162907+0000","last_fullsized":"2024-04-24T13:30:15.162907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:37.833238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-24T13:30:15.155913+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:30:15.155913+0000","last_peered":"2024-04-24T13:30:15.155913+0000","last_clean":"2024-04-24T13:30:15.155913+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:30:15.155913+0000","last_undegraded":"2024-04-24T13:30:15.155913+0000","last_fullsized":"2024-04-24T13:30:15.155913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:37.833238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-24T13:30:16.060627+0000","last_change":"2024-04-24T13:30:16.059514+0000","last_active":"2024-04-24T13:30:16.060627+0000","last_peered":"2024-04-24T13:30:16.060627+0000","last_clean":"2024-04-24T13:30:16.060627+0000","last_became_active":"2024-04-24T13:30:16.058864+0000","last_became_peered":"2024-04-24T13:30:16.058864+0000","last_unstale":"2024-04-24T13:30:16.060627+0000","last_undegraded":"2024-04-24T13:30:16.060627+0000","last_fullsized":"2024-04-24T13:30:16.060627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:17:14.239450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-24T13:30:16.058259+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:30:16.058259+0000","last_peered":"2024-04-24T13:30:16.058259+0000","last_clean":"2024-04-24T13:30:16.058259+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:30:16.058259+0000","last_undegraded":"2024-04-24T13:30:16.058259+0000","last_fullsized":"2024-04-24T13:30:16.058259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T13:30:16.165597+0000","last_change":"2024-04-24T13:30:15.151799+0000","last_active":"2024-04-24T13:30:16.165597+0000","last_peered":"2024-04-24T13:30:16.165597+0000","last_clean":"2024-04-24T13:30:16.165597+0000","last_became_active":"2024-04-24T13:30:15.150672+0000","last_became_peered":"2024-04-24T13:30:15.150672+0000","last_unstale":"2024-04-24T13:30:16.165597+0000","last_undegraded":"2024-04-24T13:30:16.165597+0000","last_fullsized":"2024-04-24T13:30:16.165597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T13:30:16.163885+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:30:16.163885+0000","last_peered":"2024-04-24T13:30:16.163885+0000","last_clean":"2024-04-24T13:30:16.163885+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:30:16.163885+0000","last_undegraded":"2024-04-24T13:30:16.163885+0000","last_fullsized":"2024-04-24T13:30:16.163885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-24T13:30:15.162429+0000","last_change":"2024-04-24T13:30:15.156142+0000","last_active":"2024-04-24T13:30:15.162429+0000","last_peered":"2024-04-24T13:30:15.162429+0000","last_clean":"2024-04-24T13:30:15.162429+0000","last_became_active":"2024-04-24T13:30:15.155326+0000","last_became_peered":"2024-04-24T13:30:15.155326+0000","last_unstale":"2024-04-24T13:30:15.162429+0000","last_undegraded":"2024-04-24T13:30:15.162429+0000","last_fullsized":"2024-04-24T13:30:15.162429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T13:30:16.165749+0000","last_change":"2024-04-24T13:30:15.154142+0000","last_active":"2024-04-24T13:30:16.165749+0000","last_peered":"2024-04-24T13:30:16.165749+0000","last_clean":"2024-04-24T13:30:16.165749+0000","last_became_active":"2024-04-24T13:30:15.153433+0000","last_became_peered":"2024-04-24T13:30:15.153433+0000","last_unstale":"2024-04-24T13:30:16.165749+0000","last_undegraded":"2024-04-24T13:30:16.165749+0000","last_fullsized":"2024-04-24T13:30:16.165749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-24T13:30:15.150184+0000","last_change":"2024-04-24T13:30:08.802517+0000","last_active":"2024-04-24T13:30:15.150184+0000","last_peered":"2024-04-24T13:30:15.150184+0000","last_clean":"2024-04-24T13:30:15.150184+0000","last_became_active":"2024-04-24T13:30:08.800555+0000","last_became_peered":"2024-04-24T13:30:08.800555+0000","last_unstale":"2024-04-24T13:30:15.150184+0000","last_undegraded":"2024-04-24T13:30:15.150184+0000","last_fullsized":"2024-04-24T13:30:15.150184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:06.125070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":641896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:30:18.896 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:30:19.167 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:30:19.167 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:30:19.184 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":17,"stamp":"2024-04-24T13:30:17.208422+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":2,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":7,"kb":754974720,"kb_used":218740,"kb_used_data":2556,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754755980,"statfs":{"total":773094113280,"available":772870123520,"internally_reserved":0,"allocated":2617344,"data_stored":1633436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001180"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-24T13:30:15.162907+0000","last_change":"2024-04-24T13:30:15.161378+0000","last_active":"2024-04-24T13:30:15.162907+0000","last_peered":"2024-04-24T13:30:15.162907+0000","last_clean":"2024-04-24T13:30:15.162907+0000","last_became_active":"2024-04-24T13:30:15.160775+0000","last_became_peered":"2024-04-24T13:30:15.160775+0000","last_unstale":"2024-04-24T13:30:15.162907+0000","last_undegraded":"2024-04-24T13:30:15.162907+0000","last_fullsized":"2024-04-24T13:30:15.162907+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:37.833238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-24T13:30:15.155913+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:30:15.155913+0000","last_peered":"2024-04-24T13:30:15.155913+0000","last_clean":"2024-04-24T13:30:15.155913+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:30:15.155913+0000","last_undegraded":"2024-04-24T13:30:15.155913+0000","last_fullsized":"2024-04-24T13:30:15.155913+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:43:37.833238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-24T13:30:16.060627+0000","last_change":"2024-04-24T13:30:16.059514+0000","last_active":"2024-04-24T13:30:16.060627+0000","last_peered":"2024-04-24T13:30:16.060627+0000","last_clean":"2024-04-24T13:30:16.060627+0000","last_became_active":"2024-04-24T13:30:16.058864+0000","last_became_peered":"2024-04-24T13:30:16.058864+0000","last_unstale":"2024-04-24T13:30:16.060627+0000","last_undegraded":"2024-04-24T13:30:16.060627+0000","last_fullsized":"2024-04-24T13:30:16.060627+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:17:14.239450+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-24T13:30:16.058259+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:30:16.058259+0000","last_peered":"2024-04-24T13:30:16.058259+0000","last_clean":"2024-04-24T13:30:16.058259+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:30:16.058259+0000","last_undegraded":"2024-04-24T13:30:16.058259+0000","last_fullsized":"2024-04-24T13:30:16.058259+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T13:30:16.165597+0000","last_change":"2024-04-24T13:30:15.151799+0000","last_active":"2024-04-24T13:30:16.165597+0000","last_peered":"2024-04-24T13:30:16.165597+0000","last_clean":"2024-04-24T13:30:16.165597+0000","last_became_active":"2024-04-24T13:30:15.150672+0000","last_became_peered":"2024-04-24T13:30:15.150672+0000","last_unstale":"2024-04-24T13:30:16.165597+0000","last_undegraded":"2024-04-24T13:30:16.165597+0000","last_fullsized":"2024-04-24T13:30:16.165597+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T13:30:16.163885+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:30:16.163885+0000","last_peered":"2024-04-24T13:30:16.163885+0000","last_clean":"2024-04-24T13:30:16.163885+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:30:16.163885+0000","last_undegraded":"2024-04-24T13:30:16.163885+0000","last_fullsized":"2024-04-24T13:30:16.163885+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":9,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-24T13:30:15.162429+0000","last_change":"2024-04-24T13:30:15.156142+0000","last_active":"2024-04-24T13:30:15.162429+0000","last_peered":"2024-04-24T13:30:15.162429+0000","last_clean":"2024-04-24T13:30:15.162429+0000","last_became_active":"2024-04-24T13:30:15.155326+0000","last_became_peered":"2024-04-24T13:30:15.155326+0000","last_unstale":"2024-04-24T13:30:15.162429+0000","last_undegraded":"2024-04-24T13:30:15.162429+0000","last_fullsized":"2024-04-24T13:30:15.162429+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":12,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-04-24T13:30:16.165749+0000","last_change":"2024-04-24T13:30:15.154142+0000","last_active":"2024-04-24T13:30:16.165749+0000","last_peered":"2024-04-24T13:30:16.165749+0000","last_clean":"2024-04-24T13:30:16.165749+0000","last_became_active":"2024-04-24T13:30:15.153433+0000","last_became_peered":"2024-04-24T13:30:15.153433+0000","last_unstale":"2024-04-24T13:30:16.165749+0000","last_undegraded":"2024-04-24T13:30:16.165749+0000","last_fullsized":"2024-04-24T13:30:16.165749+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":166,"reported_epoch":18,"state":"active+clean","last_fresh":"2024-04-24T13:30:15.150184+0000","last_change":"2024-04-24T13:30:08.802517+0000","last_active":"2024-04-24T13:30:15.150184+0000","last_peered":"2024-04-24T13:30:15.150184+0000","last_clean":"2024-04-24T13:30:15.150184+0000","last_became_active":"2024-04-24T13:30:08.800555+0000","last_became_peered":"2024-04-24T13:30:08.800555+0000","last_unstale":"2024-04-24T13:30:15.150184+0000","last_undegraded":"2024-04-24T13:30:15.150184+0000","last_fullsized":"2024-04-24T13:30:15.150184+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:06.125070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574852,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27780,"kb_used_data":756,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344060,"statfs":{"total":96636764160,"available":96608317440,"internally_reserved":0,"allocated":774144,"data_stored":647684,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":94371840,"kb_used":27184,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344656,"statfs":{"total":96636764160,"available":96608927744,"internally_reserved":0,"allocated":167936,"data_stored":51528,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574852,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574853,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27216,"kb_used_data":188,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344624,"statfs":{"total":96636764160,"available":96608894976,"internally_reserved":0,"allocated":192512,"data_stored":63064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574854,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27196,"kb_used_data":176,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344644,"statfs":{"total":96636764160,"available":96608915456,"internally_reserved":0,"allocated":180224,"data_stored":57316,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574853,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27764,"kb_used_data":744,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344076,"statfs":{"total":96636764160,"available":96608333824,"internally_reserved":0,"allocated":761856,"data_stored":641896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:30:19.185 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T13:30:19.185 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-04-24T13:30:19.185 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-04-24T13:30:19.185 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-04-24T13:30:19.495 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:30:19.496 INFO:teuthology.orchestra.run.smithi071.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-04-24T13:30:19.512 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-04-24T13:30:19.513 INFO:teuthology.run_tasks:Running task rgw... 2024-04-24T13:30:19.871 DEBUG:tasks.rgw:config is {'client.0': None} 2024-04-24T13:30:19.871 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-04-24T13:30:19.872 INFO:tasks.rgw:Creating data pools 2024-04-24T13:30:19.872 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-04-24T13:30:19.872 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph osd pool create default.rgw.buckets.data 64 64 --cluster ceph 2024-04-24T13:30:20.184 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'default.rgw.buckets.data' created 2024-04-24T13:30:20.209 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-04-24T13:30:21.197 INFO:teuthology.orchestra.run.smithi071.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-04-24T13:30:21.239 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-04-24T13:30:22.191 INFO:teuthology.orchestra.run.smithi071.stderr:pool 'default.rgw.buckets.index' created 2024-04-24T13:30:22.224 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-04-24T13:30:23.194 INFO:teuthology.orchestra.run.smithi071.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-04-24T13:30:23.243 DEBUG:tasks.rgw:Pools created 2024-04-24T13:30:23.243 INFO:tasks.rgw:Starting rgw... 2024-04-24T13:30:23.243 INFO:tasks.rgw:rgw client.0 config is {} 2024-04-24T13:30:23.243 INFO:tasks.rgw:Using beast as radosgw frontend 2024-04-24T13:30:23.243 DEBUG:teuthology.orchestra.run.smithi071:> sudo echo -n http://smithi071.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-04-24T13:30:23.254 INFO:teuthology.orchestra.run.smithi071.stdout:http://smithi071.front.sepia.ceph.com:80 2024-04-24T13:30:23.255 DEBUG:teuthology.orchestra.run.smithi071:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-04-24T13:30:23.308 INFO:tasks.rgw.client.0:Restarting daemon 2024-04-24T13:30:23.308 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-04-24T13:30:23.351 INFO:tasks.rgw.client.0:Started 2024-04-24T13:30:23.351 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi071.front.sepia.ceph.com:80/ 2024-04-24T13:30:23.352 DEBUG:teuthology.orchestra.run.smithi071:> curl http://smithi071.front.sepia.ceph.com:80/ 2024-04-24T13:30:23.382 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T13:30:23.383 INFO:teuthology.orchestra.run.smithi071.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T13:30:23.383 INFO:teuthology.orchestra.run.smithi071.stderr: Dload Upload Total Spent Left Speed 2024-04-24T13:30:23.383 INFO:teuthology.orchestra.run.smithi071.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T13:30:23.383 INFO:teuthology.orchestra.run.smithi071.stderr:curl: (7) Failed to connect to smithi071.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-24T13:30:24.384 DEBUG:teuthology.orchestra.run.smithi071:> curl http://smithi071.front.sepia.ceph.com:80/ 2024-04-24T13:30:24.396 INFO:teuthology.orchestra.run.smithi071.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T13:30:24.396 INFO:teuthology.orchestra.run.smithi071.stderr: Dload Upload Total Spent Left Speed 2024-04-24T13:30:24.396 INFO:teuthology.orchestra.run.smithi071.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T13:30:24.397 INFO:teuthology.orchestra.run.smithi071.stderr:curl: (7) Failed to connect to smithi071.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-24T13:30:24.397 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T13:30:26.399 DEBUG:teuthology.orchestra.run.smithi071:> curl http://smithi071.front.sepia.ceph.com:80/ 2024-04-24T13:30:26.410 INFO:teuthology.orchestra.run.smithi071.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T13:30:26.410 INFO:teuthology.orchestra.run.smithi071.stderr: Dload Upload Total Spent Left Speed 2024-04-24T13:30:26.410 INFO:teuthology.orchestra.run.smithi071.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T13:30:26.411 INFO:teuthology.orchestra.run.smithi071.stderr:curl: (7) Failed to connect to smithi071.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-24T13:30:26.411 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T13:30:30.413 DEBUG:teuthology.orchestra.run.smithi071:> curl http://smithi071.front.sepia.ceph.com:80/ 2024-04-24T13:30:30.424 INFO:teuthology.orchestra.run.smithi071.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T13:30:30.425 INFO:teuthology.orchestra.run.smithi071.stderr: Dload Upload Total Spent Left Speed 2024-04-24T13:30:30.425 INFO:teuthology.orchestra.run.smithi071.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-04-24T13:30:30.425 INFO:teuthology.orchestra.run.smithi071.stderr:curl: (7) Failed to connect to smithi071.front.sepia.ceph.com port 80 after 0 ms: Connection refused 2024-04-24T13:30:30.425 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-04-24T13:30:32.404 INFO:tasks.rgw.client.0.smithi071.stdout:2024-04-24T13:30:32.402+0000 7f2a9ce51a40 -1 LDAP not started since no server URIs were provided in the configuration. 2024-04-24T13:30:38.427 DEBUG:teuthology.orchestra.run.smithi071:> curl http://smithi071.front.sepia.ceph.com:80/ 2024-04-24T13:30:38.438 INFO:teuthology.orchestra.run.smithi071.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-04-24T13:30:38.438 INFO:teuthology.orchestra.run.smithi071.stderr: Dload Upload Total Spent Left Speed 2024-04-24T13:30:38.441 INFO:teuthology.orchestra.run.smithi071.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 57680 0 --:--:-- --:--:-- --:--:-- 62333 2024-04-24T13:30:38.442 INFO:teuthology.orchestra.run.smithi071.stdout:anonymous 2024-04-24T13:30:38.442 INFO:teuthology.run_tasks:Running task thrashosds... 2024-04-24T13:30:38.470 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0} 2024-04-24T13:30:38.471 INFO:tasks.thrashosds:overrides is {'admin_socket': {'branch': 'wip-cbodley-testing'}, 'ceph': {'conf': {'client': {'rgw relaxed s3 bucket names': True}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd blocked scrub grace period': 3600, 'osd failsafe full ratio': 0.95, 'osd max markdown count': 1000, 'osd objectstore': 'bluestore', 'osd shutdown pgref assert': True}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled', 'overall HEALTH_', '\\(OSDMAP_FLAGS\\)', '\\(OSD_', '\\(PG_', '\\(POOL_', '\\(CACHE_POOL_', '\\(SMALLER_PGP_NUM\\)', '\\(OBJECT_', '\\(SLOW_OPS\\)', '\\(REQUEST_SLOW\\)', '\\(TOO_FEW_PGS\\)', 'slow request', 'timeout on replica', 'late reservation from', 'MON_DOWN', 'OSDMAP_FLAGS', 'OSD_DOWN', 'PG_DEGRADED', 'PG_AVAILABILITY', 'POOL_APP_NOT_ENABLED', 'mons down', 'mon down', 'out of quorum'], 'sha1': '882080b304cb1602e69c11bc5fe8479e7d2bc64d'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '882080b304cb1602e69c11bc5fe8479e7d2bc64d'}}, 'rgw': {'frontend': 'beast'}, 's3tests': {'force-branch': 'ceph-master'}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-cbodley-testing', 'sha1': '882080b304cb1602e69c11bc5fe8479e7d2bc64d'}} 2024-04-24T13:30:38.471 INFO:tasks.thrashosds:config is {'ceph_objectstore_tool': False, 'chance_pgnum_grow': 1, 'chance_pgnum_shrink': 1, 'chance_pgpnum_fix': 1, 'chance_test_min_size': 0, 'op_delay': 30, 'timeout': 1200, 'sighup_delay': 0.1, 'optrack_toggle_delay': 2.0, 'dump_ops_enable': 'true', 'noscrub_toggle_delay': 2.0, 'random_eio': 0.0, 'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5} 2024-04-24T13:30:38.471 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config set mgr mgr_debug_aggressive_pg_num_changes true 2024-04-24T13:30:38.812 INFO:tasks.thrashosds:Beginning thrashosds... 2024-04-24T13:30:38.813 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T13:30:38.813 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:30:39.130 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:30:39.139 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:30:39.150 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":40,"stamp":"2024-04-24T13:30:37.217125+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":92,"num_object_clones":0,"num_object_copies":184,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":92,"num_whiteouts":0,"num_read":429,"num_read_kb":286,"num_write":357,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":297,"ondisk_log_size":297,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":475,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":220028,"kb_used_data":3880,"kb_used_omap":12,"kb_used_meta":216051,"kb_avail":754754692,"statfs":{"total":773094113280,"available":772868804608,"internally_reserved":0,"allocated":3973120,"data_stored":2382518,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":221236785},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":26,"apply_latency_ms":26,"commit_latency_ns":26000000,"apply_latency_ns":26000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":84,"num_object_clones":0,"num_object_copies":168,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":84,"num_whiteouts":0,"num_read":309,"num_read_kb":182,"num_write":188,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.977494"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292212+0000","last_change":"2024-04-24T13:30:21.250354+0000","last_active":"2024-04-24T13:30:32.292212+0000","last_peered":"2024-04-24T13:30:32.292212+0000","last_clean":"2024-04-24T13:30:32.292212+0000","last_became_active":"2024-04-24T13:30:21.246835+0000","last_became_peered":"2024-04-24T13:30:21.246835+0000","last_unstale":"2024-04-24T13:30:32.292212+0000","last_undegraded":"2024-04-24T13:30:32.292212+0000","last_fullsized":"2024-04-24T13:30:32.292212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:09.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261038+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:30:32.261038+0000","last_peered":"2024-04-24T13:30:32.261038+0000","last_clean":"2024-04-24T13:30:32.261038+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:30:32.261038+0000","last_undegraded":"2024-04-24T13:30:32.261038+0000","last_fullsized":"2024-04-24T13:30:32.261038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260106+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:30:32.260106+0000","last_peered":"2024-04-24T13:30:32.260106+0000","last_clean":"2024-04-24T13:30:32.260106+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:30:32.260106+0000","last_undegraded":"2024-04-24T13:30:32.260106+0000","last_fullsized":"2024-04-24T13:30:32.260106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290637+0000","last_change":"2024-04-24T13:30:23.237080+0000","last_active":"2024-04-24T13:30:32.290637+0000","last_peered":"2024-04-24T13:30:32.290637+0000","last_clean":"2024-04-24T13:30:32.290637+0000","last_became_active":"2024-04-24T13:30:23.236356+0000","last_became_peered":"2024-04-24T13:30:23.236356+0000","last_unstale":"2024-04-24T13:30:32.290637+0000","last_undegraded":"2024-04-24T13:30:32.290637+0000","last_fullsized":"2024-04-24T13:30:32.290637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272609+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:30:32.272609+0000","last_peered":"2024-04-24T13:30:32.272609+0000","last_clean":"2024-04-24T13:30:32.272609+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:30:32.272609+0000","last_undegraded":"2024-04-24T13:30:32.272609+0000","last_fullsized":"2024-04-24T13:30:32.272609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306985+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:30:32.306985+0000","last_peered":"2024-04-24T13:30:32.306985+0000","last_clean":"2024-04-24T13:30:32.306985+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:30:32.306985+0000","last_undegraded":"2024-04-24T13:30:32.306985+0000","last_fullsized":"2024-04-24T13:30:32.306985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262083+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:30:32.262083+0000","last_peered":"2024-04-24T13:30:32.262083+0000","last_clean":"2024-04-24T13:30:32.262083+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:30:32.262083+0000","last_undegraded":"2024-04-24T13:30:32.262083+0000","last_fullsized":"2024-04-24T13:30:32.262083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271640+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:30:32.271640+0000","last_peered":"2024-04-24T13:30:32.271640+0000","last_clean":"2024-04-24T13:30:32.271640+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:30:32.271640+0000","last_undegraded":"2024-04-24T13:30:32.271640+0000","last_fullsized":"2024-04-24T13:30:32.271640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.291101+0000","last_change":"2024-04-24T13:30:21.251948+0000","last_active":"2024-04-24T13:30:32.291101+0000","last_peered":"2024-04-24T13:30:32.291101+0000","last_clean":"2024-04-24T13:30:32.291101+0000","last_became_active":"2024-04-24T13:30:21.251184+0000","last_became_peered":"2024-04-24T13:30:21.251184+0000","last_unstale":"2024-04-24T13:30:32.291101+0000","last_undegraded":"2024-04-24T13:30:32.291101+0000","last_fullsized":"2024-04-24T13:30:32.291101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.299706+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:30:32.299706+0000","last_peered":"2024-04-24T13:30:32.299706+0000","last_clean":"2024-04-24T13:30:32.299706+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:30:32.299706+0000","last_undegraded":"2024-04-24T13:30:32.299706+0000","last_fullsized":"2024-04-24T13:30:32.299706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261742+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:30:32.261742+0000","last_peered":"2024-04-24T13:30:32.261742+0000","last_clean":"2024-04-24T13:30:32.261742+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:30:32.261742+0000","last_undegraded":"2024-04-24T13:30:32.261742+0000","last_fullsized":"2024-04-24T13:30:32.261742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307736+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:30:32.307736+0000","last_peered":"2024-04-24T13:30:32.307736+0000","last_clean":"2024-04-24T13:30:32.307736+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:30:32.307736+0000","last_undegraded":"2024-04-24T13:30:32.307736+0000","last_fullsized":"2024-04-24T13:30:32.307736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290888+0000","last_change":"2024-04-24T13:30:21.247080+0000","last_active":"2024-04-24T13:30:32.290888+0000","last_peered":"2024-04-24T13:30:32.290888+0000","last_clean":"2024-04-24T13:30:32.290888+0000","last_became_active":"2024-04-24T13:30:21.239363+0000","last_became_peered":"2024-04-24T13:30:21.239363+0000","last_unstale":"2024-04-24T13:30:32.290888+0000","last_undegraded":"2024-04-24T13:30:32.290888+0000","last_fullsized":"2024-04-24T13:30:32.290888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262931+0000","last_change":"2024-04-24T13:30:23.228080+0000","last_active":"2024-04-24T13:30:32.262931+0000","last_peered":"2024-04-24T13:30:32.262931+0000","last_clean":"2024-04-24T13:30:32.262931+0000","last_became_active":"2024-04-24T13:30:23.227215+0000","last_became_peered":"2024-04-24T13:30:23.227215+0000","last_unstale":"2024-04-24T13:30:32.262931+0000","last_undegraded":"2024-04-24T13:30:32.262931+0000","last_fullsized":"2024-04-24T13:30:32.262931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280443+0000","last_change":"2024-04-24T13:30:21.232985+0000","last_active":"2024-04-24T13:30:32.280443+0000","last_peered":"2024-04-24T13:30:32.280443+0000","last_clean":"2024-04-24T13:30:32.280443+0000","last_became_active":"2024-04-24T13:30:21.229584+0000","last_became_peered":"2024-04-24T13:30:21.229584+0000","last_unstale":"2024-04-24T13:30:32.280443+0000","last_undegraded":"2024-04-24T13:30:32.280443+0000","last_fullsized":"2024-04-24T13:30:32.280443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.321251+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:30:32.321251+0000","last_peered":"2024-04-24T13:30:32.321251+0000","last_clean":"2024-04-24T13:30:32.321251+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:30:32.321251+0000","last_undegraded":"2024-04-24T13:30:32.321251+0000","last_fullsized":"2024-04-24T13:30:32.321251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306431+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:30:32.306431+0000","last_peered":"2024-04-24T13:30:32.306431+0000","last_clean":"2024-04-24T13:30:32.306431+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:30:32.306431+0000","last_undegraded":"2024-04-24T13:30:32.306431+0000","last_fullsized":"2024-04-24T13:30:32.306431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292313+0000","last_change":"2024-04-24T13:30:21.247071+0000","last_active":"2024-04-24T13:30:32.292313+0000","last_peered":"2024-04-24T13:30:32.292313+0000","last_clean":"2024-04-24T13:30:32.292313+0000","last_became_active":"2024-04-24T13:30:21.246454+0000","last_became_peered":"2024-04-24T13:30:21.246454+0000","last_unstale":"2024-04-24T13:30:32.292313+0000","last_undegraded":"2024-04-24T13:30:32.292313+0000","last_fullsized":"2024-04-24T13:30:32.292313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:48.173823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290801+0000","last_change":"2024-04-24T13:30:23.241549+0000","last_active":"2024-04-24T13:30:32.290801+0000","last_peered":"2024-04-24T13:30:32.290801+0000","last_clean":"2024-04-24T13:30:32.290801+0000","last_became_active":"2024-04-24T13:30:23.236814+0000","last_became_peered":"2024-04-24T13:30:23.236814+0000","last_unstale":"2024-04-24T13:30:32.290801+0000","last_undegraded":"2024-04-24T13:30:32.290801+0000","last_fullsized":"2024-04-24T13:30:32.290801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.299830+0000","last_change":"2024-04-24T13:30:21.244607+0000","last_active":"2024-04-24T13:30:32.299830+0000","last_peered":"2024-04-24T13:30:32.299830+0000","last_clean":"2024-04-24T13:30:32.299830+0000","last_became_active":"2024-04-24T13:30:21.243828+0000","last_became_peered":"2024-04-24T13:30:21.243828+0000","last_unstale":"2024-04-24T13:30:32.299830+0000","last_undegraded":"2024-04-24T13:30:32.299830+0000","last_fullsized":"2024-04-24T13:30:32.299830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262024+0000","last_change":"2024-04-24T13:30:23.220120+0000","last_active":"2024-04-24T13:30:32.262024+0000","last_peered":"2024-04-24T13:30:32.262024+0000","last_clean":"2024-04-24T13:30:32.262024+0000","last_became_active":"2024-04-24T13:30:23.219312+0000","last_became_peered":"2024-04-24T13:30:23.219312+0000","last_unstale":"2024-04-24T13:30:32.262024+0000","last_undegraded":"2024-04-24T13:30:32.262024+0000","last_fullsized":"2024-04-24T13:30:32.262024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300336+0000","last_change":"2024-04-24T13:30:21.243317+0000","last_active":"2024-04-24T13:30:32.300336+0000","last_peered":"2024-04-24T13:30:32.300336+0000","last_clean":"2024-04-24T13:30:32.300336+0000","last_became_active":"2024-04-24T13:30:21.239686+0000","last_became_peered":"2024-04-24T13:30:21.239686+0000","last_unstale":"2024-04-24T13:30:32.300336+0000","last_undegraded":"2024-04-24T13:30:32.300336+0000","last_fullsized":"2024-04-24T13:30:32.300336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320287+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:30:32.320287+0000","last_peered":"2024-04-24T13:30:32.320287+0000","last_clean":"2024-04-24T13:30:32.320287+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:30:32.320287+0000","last_undegraded":"2024-04-24T13:30:32.320287+0000","last_fullsized":"2024-04-24T13:30:32.320287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307730+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:30:32.307730+0000","last_peered":"2024-04-24T13:30:32.307730+0000","last_clean":"2024-04-24T13:30:32.307730+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:30:32.307730+0000","last_undegraded":"2024-04-24T13:30:32.307730+0000","last_fullsized":"2024-04-24T13:30:32.307730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.321289+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:30:32.321289+0000","last_peered":"2024-04-24T13:30:32.321289+0000","last_clean":"2024-04-24T13:30:32.321289+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:30:32.321289+0000","last_undegraded":"2024-04-24T13:30:32.321289+0000","last_fullsized":"2024-04-24T13:30:32.321289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281219+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:30:32.281219+0000","last_peered":"2024-04-24T13:30:32.281219+0000","last_clean":"2024-04-24T13:30:32.281219+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:30:32.281219+0000","last_undegraded":"2024-04-24T13:30:32.281219+0000","last_fullsized":"2024-04-24T13:30:32.281219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307989+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:30:32.307989+0000","last_peered":"2024-04-24T13:30:32.307989+0000","last_clean":"2024-04-24T13:30:32.307989+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:30:32.307989+0000","last_undegraded":"2024-04-24T13:30:32.307989+0000","last_fullsized":"2024-04-24T13:30:32.307989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271833+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:30:32.271833+0000","last_peered":"2024-04-24T13:30:32.271833+0000","last_clean":"2024-04-24T13:30:32.271833+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:30:32.271833+0000","last_undegraded":"2024-04-24T13:30:32.271833+0000","last_fullsized":"2024-04-24T13:30:32.271833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306167+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:30:32.306167+0000","last_peered":"2024-04-24T13:30:32.306167+0000","last_clean":"2024-04-24T13:30:32.306167+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:30:32.306167+0000","last_undegraded":"2024-04-24T13:30:32.306167+0000","last_fullsized":"2024-04-24T13:30:32.306167+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282397+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:30:32.282397+0000","last_peered":"2024-04-24T13:30:32.282397+0000","last_clean":"2024-04-24T13:30:32.282397+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:30:32.282397+0000","last_undegraded":"2024-04-24T13:30:32.282397+0000","last_fullsized":"2024-04-24T13:30:32.282397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.291339+0000","last_change":"2024-04-24T13:30:21.239348+0000","last_active":"2024-04-24T13:30:32.291339+0000","last_peered":"2024-04-24T13:30:32.291339+0000","last_clean":"2024-04-24T13:30:32.291339+0000","last_became_active":"2024-04-24T13:30:21.238561+0000","last_became_peered":"2024-04-24T13:30:21.238561+0000","last_unstale":"2024-04-24T13:30:32.291339+0000","last_undegraded":"2024-04-24T13:30:32.291339+0000","last_fullsized":"2024-04-24T13:30:32.291339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262470+0000","last_change":"2024-04-24T13:30:25.234573+0000","last_active":"2024-04-24T13:30:32.262470+0000","last_peered":"2024-04-24T13:30:32.262470+0000","last_clean":"2024-04-24T13:30:32.262470+0000","last_became_active":"2024-04-24T13:30:25.233807+0000","last_became_peered":"2024-04-24T13:30:25.233807+0000","last_unstale":"2024-04-24T13:30:32.262470+0000","last_undegraded":"2024-04-24T13:30:32.262470+0000","last_fullsized":"2024-04-24T13:30:32.262470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.552474+0000","last_change":"2024-04-24T13:30:27.251872+0000","last_active":"2024-04-24T13:30:32.552474+0000","last_peered":"2024-04-24T13:30:32.552474+0000","last_clean":"2024-04-24T13:30:32.552474+0000","last_became_active":"2024-04-24T13:30:27.251286+0000","last_became_peered":"2024-04-24T13:30:27.251286+0000","last_unstale":"2024-04-24T13:30:32.552474+0000","last_undegraded":"2024-04-24T13:30:32.552474+0000","last_fullsized":"2024-04-24T13:30:32.552474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:20.682651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292033+0000","last_change":"2024-04-24T13:30:29.281884+0000","last_active":"2024-04-24T13:30:32.292033+0000","last_peered":"2024-04-24T13:30:32.292033+0000","last_clean":"2024-04-24T13:30:32.292033+0000","last_became_active":"2024-04-24T13:30:29.281138+0000","last_became_peered":"2024-04-24T13:30:29.281138+0000","last_unstale":"2024-04-24T13:30:32.292033+0000","last_undegraded":"2024-04-24T13:30:32.292033+0000","last_fullsized":"2024-04-24T13:30:32.292033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261008+0000","last_change":"2024-04-24T13:30:31.266582+0000","last_active":"2024-04-24T13:30:32.261008+0000","last_peered":"2024-04-24T13:30:32.261008+0000","last_clean":"2024-04-24T13:30:32.261008+0000","last_became_active":"2024-04-24T13:30:31.265452+0000","last_became_peered":"2024-04-24T13:30:31.265452+0000","last_unstale":"2024-04-24T13:30:32.261008+0000","last_undegraded":"2024-04-24T13:30:32.261008+0000","last_fullsized":"2024-04-24T13:30:32.261008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263112+0000","last_change":"2024-04-24T13:30:23.247313+0000","last_active":"2024-04-24T13:30:32.263112+0000","last_peered":"2024-04-24T13:30:32.263112+0000","last_clean":"2024-04-24T13:30:32.263112+0000","last_became_active":"2024-04-24T13:30:23.246445+0000","last_became_peered":"2024-04-24T13:30:23.246445+0000","last_unstale":"2024-04-24T13:30:32.263112+0000","last_undegraded":"2024-04-24T13:30:32.263112+0000","last_fullsized":"2024-04-24T13:30:32.263112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271892+0000","last_change":"2024-04-24T13:30:21.238903+0000","last_active":"2024-04-24T13:30:32.271892+0000","last_peered":"2024-04-24T13:30:32.271892+0000","last_clean":"2024-04-24T13:30:32.271892+0000","last_became_active":"2024-04-24T13:30:21.238625+0000","last_became_peered":"2024-04-24T13:30:21.238625+0000","last_unstale":"2024-04-24T13:30:32.271892+0000","last_undegraded":"2024-04-24T13:30:32.271892+0000","last_fullsized":"2024-04-24T13:30:32.271892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282011+0000","last_change":"2024-04-24T13:30:25.226046+0000","last_active":"2024-04-24T13:30:32.282011+0000","last_peered":"2024-04-24T13:30:32.282011+0000","last_clean":"2024-04-24T13:30:32.282011+0000","last_became_active":"2024-04-24T13:30:25.225623+0000","last_became_peered":"2024-04-24T13:30:25.225623+0000","last_unstale":"2024-04-24T13:30:32.282011+0000","last_undegraded":"2024-04-24T13:30:32.282011+0000","last_fullsized":"2024-04-24T13:30:32.282011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.410085+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:30:32.410085+0000","last_peered":"2024-04-24T13:30:32.410085+0000","last_clean":"2024-04-24T13:30:32.410085+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:30:32.410085+0000","last_undegraded":"2024-04-24T13:30:32.410085+0000","last_fullsized":"2024-04-24T13:30:32.410085+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308478+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:30:32.308478+0000","last_peered":"2024-04-24T13:30:32.308478+0000","last_clean":"2024-04-24T13:30:32.308478+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:30:32.308478+0000","last_undegraded":"2024-04-24T13:30:32.308478+0000","last_fullsized":"2024-04-24T13:30:32.308478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271430+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:30:32.271430+0000","last_peered":"2024-04-24T13:30:32.271430+0000","last_clean":"2024-04-24T13:30:32.271430+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:30:32.271430+0000","last_undegraded":"2024-04-24T13:30:32.271430+0000","last_fullsized":"2024-04-24T13:30:32.271430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.274290+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:30:32.274290+0000","last_peered":"2024-04-24T13:30:32.274290+0000","last_clean":"2024-04-24T13:30:32.274290+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:30:32.274290+0000","last_undegraded":"2024-04-24T13:30:32.274290+0000","last_fullsized":"2024-04-24T13:30:32.274290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.291079+0000","last_change":"2024-04-24T13:30:21.250665+0000","last_active":"2024-04-24T13:30:32.291079+0000","last_peered":"2024-04-24T13:30:32.291079+0000","last_clean":"2024-04-24T13:30:32.291079+0000","last_became_active":"2024-04-24T13:30:21.246084+0000","last_became_peered":"2024-04-24T13:30:21.246084+0000","last_unstale":"2024-04-24T13:30:32.291079+0000","last_undegraded":"2024-04-24T13:30:32.291079+0000","last_fullsized":"2024-04-24T13:30:32.291079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282955+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:30:32.282955+0000","last_peered":"2024-04-24T13:30:32.282955+0000","last_clean":"2024-04-24T13:30:32.282955+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:30:32.282955+0000","last_undegraded":"2024-04-24T13:30:32.282955+0000","last_fullsized":"2024-04-24T13:30:32.282955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.414942+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:30:32.414942+0000","last_peered":"2024-04-24T13:30:32.414942+0000","last_clean":"2024-04-24T13:30:32.414942+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:30:32.414942+0000","last_undegraded":"2024-04-24T13:30:32.414942+0000","last_fullsized":"2024-04-24T13:30:32.414942+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.291759+0000","last_change":"2024-04-24T13:30:29.287547+0000","last_active":"2024-04-24T13:30:32.291759+0000","last_peered":"2024-04-24T13:30:32.291759+0000","last_clean":"2024-04-24T13:30:32.291759+0000","last_became_active":"2024-04-24T13:30:29.285504+0000","last_became_peered":"2024-04-24T13:30:29.285504+0000","last_unstale":"2024-04-24T13:30:32.291759+0000","last_undegraded":"2024-04-24T13:30:32.291759+0000","last_fullsized":"2024-04-24T13:30:32.291759+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308545+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:30:32.308545+0000","last_peered":"2024-04-24T13:30:32.308545+0000","last_clean":"2024-04-24T13:30:32.308545+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:30:32.308545+0000","last_undegraded":"2024-04-24T13:30:32.308545+0000","last_fullsized":"2024-04-24T13:30:32.308545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282437+0000","last_change":"2024-04-24T13:30:23.243719+0000","last_active":"2024-04-24T13:30:32.282437+0000","last_peered":"2024-04-24T13:30:32.282437+0000","last_clean":"2024-04-24T13:30:32.282437+0000","last_became_active":"2024-04-24T13:30:23.243202+0000","last_became_peered":"2024-04-24T13:30:23.243202+0000","last_unstale":"2024-04-24T13:30:32.282437+0000","last_undegraded":"2024-04-24T13:30:32.282437+0000","last_fullsized":"2024-04-24T13:30:32.282437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:56.206587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298338+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:30:32.298338+0000","last_peered":"2024-04-24T13:30:32.298338+0000","last_clean":"2024-04-24T13:30:32.298338+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:30:32.298338+0000","last_undegraded":"2024-04-24T13:30:32.298338+0000","last_fullsized":"2024-04-24T13:30:32.298338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262846+0000","last_change":"2024-04-24T13:30:25.229897+0000","last_active":"2024-04-24T13:30:32.262846+0000","last_peered":"2024-04-24T13:30:32.262846+0000","last_clean":"2024-04-24T13:30:32.262846+0000","last_became_active":"2024-04-24T13:30:25.228575+0000","last_became_peered":"2024-04-24T13:30:25.228575+0000","last_unstale":"2024-04-24T13:30:32.262846+0000","last_undegraded":"2024-04-24T13:30:32.262846+0000","last_fullsized":"2024-04-24T13:30:32.262846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.534874+0000","last_change":"2024-04-24T13:30:27.251316+0000","last_active":"2024-04-24T13:30:32.534874+0000","last_peered":"2024-04-24T13:30:32.534874+0000","last_clean":"2024-04-24T13:30:32.534874+0000","last_became_active":"2024-04-24T13:30:27.250447+0000","last_became_peered":"2024-04-24T13:30:27.250447+0000","last_unstale":"2024-04-24T13:30:32.534874+0000","last_undegraded":"2024-04-24T13:30:32.534874+0000","last_fullsized":"2024-04-24T13:30:32.534874+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281460+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:30:32.281460+0000","last_peered":"2024-04-24T13:30:32.281460+0000","last_clean":"2024-04-24T13:30:32.281460+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:30:32.281460+0000","last_undegraded":"2024-04-24T13:30:32.281460+0000","last_fullsized":"2024-04-24T13:30:32.281460+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261483+0000","last_change":"2024-04-24T13:30:23.245613+0000","last_active":"2024-04-24T13:30:32.261483+0000","last_peered":"2024-04-24T13:30:32.261483+0000","last_clean":"2024-04-24T13:30:32.261483+0000","last_became_active":"2024-04-24T13:30:23.242590+0000","last_became_peered":"2024-04-24T13:30:23.242590+0000","last_unstale":"2024-04-24T13:30:32.261483+0000","last_undegraded":"2024-04-24T13:30:32.261483+0000","last_fullsized":"2024-04-24T13:30:32.261483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292490+0000","last_change":"2024-04-24T13:30:21.256198+0000","last_active":"2024-04-24T13:30:32.292490+0000","last_peered":"2024-04-24T13:30:32.292490+0000","last_clean":"2024-04-24T13:30:32.292490+0000","last_became_active":"2024-04-24T13:30:21.255557+0000","last_became_peered":"2024-04-24T13:30:21.255557+0000","last_unstale":"2024-04-24T13:30:32.292490+0000","last_undegraded":"2024-04-24T13:30:32.292490+0000","last_fullsized":"2024-04-24T13:30:32.292490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:09.431110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290029+0000","last_change":"2024-04-24T13:30:25.237115+0000","last_active":"2024-04-24T13:30:32.290029+0000","last_peered":"2024-04-24T13:30:32.290029+0000","last_clean":"2024-04-24T13:30:32.290029+0000","last_became_active":"2024-04-24T13:30:25.236366+0000","last_became_peered":"2024-04-24T13:30:25.236366+0000","last_unstale":"2024-04-24T13:30:32.290029+0000","last_undegraded":"2024-04-24T13:30:32.290029+0000","last_fullsized":"2024-04-24T13:30:32.290029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:57.978574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'5","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.468843+0000","last_change":"2024-04-24T13:30:27.261028+0000","last_active":"2024-04-24T13:30:32.468843+0000","last_peered":"2024-04-24T13:30:32.468843+0000","last_clean":"2024-04-24T13:30:32.468843+0000","last_became_active":"2024-04-24T13:30:27.260231+0000","last_became_peered":"2024-04-24T13:30:27.260231+0000","last_unstale":"2024-04-24T13:30:32.468843+0000","last_undegraded":"2024-04-24T13:30:32.468843+0000","last_fullsized":"2024-04-24T13:30:32.468843+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":8,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258416+0000","last_change":"2024-04-24T13:30:29.256804+0000","last_active":"2024-04-24T13:30:32.258416+0000","last_peered":"2024-04-24T13:30:32.258416+0000","last_clean":"2024-04-24T13:30:32.258416+0000","last_became_active":"2024-04-24T13:30:29.255975+0000","last_became_peered":"2024-04-24T13:30:29.255975+0000","last_unstale":"2024-04-24T13:30:32.258416+0000","last_undegraded":"2024-04-24T13:30:32.258416+0000","last_fullsized":"2024-04-24T13:30:32.258416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:51.521585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261809+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:30:32.261809+0000","last_peered":"2024-04-24T13:30:32.261809+0000","last_clean":"2024-04-24T13:30:32.261809+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:30:32.261809+0000","last_undegraded":"2024-04-24T13:30:32.261809+0000","last_fullsized":"2024-04-24T13:30:32.261809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306549+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:30:32.306549+0000","last_peered":"2024-04-24T13:30:32.306549+0000","last_clean":"2024-04-24T13:30:32.306549+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:30:32.306549+0000","last_undegraded":"2024-04-24T13:30:32.306549+0000","last_fullsized":"2024-04-24T13:30:32.306549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292436+0000","last_change":"2024-04-24T13:30:21.251719+0000","last_active":"2024-04-24T13:30:32.292436+0000","last_peered":"2024-04-24T13:30:32.292436+0000","last_clean":"2024-04-24T13:30:32.292436+0000","last_became_active":"2024-04-24T13:30:21.239440+0000","last_became_peered":"2024-04-24T13:30:21.239440+0000","last_unstale":"2024-04-24T13:30:32.292436+0000","last_undegraded":"2024-04-24T13:30:32.292436+0000","last_fullsized":"2024-04-24T13:30:32.292436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:24.585089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.319734+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:30:32.319734+0000","last_peered":"2024-04-24T13:30:32.319734+0000","last_clean":"2024-04-24T13:30:32.319734+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:30:32.319734+0000","last_undegraded":"2024-04-24T13:30:32.319734+0000","last_fullsized":"2024-04-24T13:30:32.319734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.558124+0000","last_change":"2024-04-24T13:30:27.252640+0000","last_active":"2024-04-24T13:30:32.558124+0000","last_peered":"2024-04-24T13:30:32.558124+0000","last_clean":"2024-04-24T13:30:32.558124+0000","last_became_active":"2024-04-24T13:30:27.252211+0000","last_became_peered":"2024-04-24T13:30:27.252211+0000","last_unstale":"2024-04-24T13:30:32.558124+0000","last_undegraded":"2024-04-24T13:30:32.558124+0000","last_fullsized":"2024-04-24T13:30:32.558124+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:15.455006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280417+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:30:32.280417+0000","last_peered":"2024-04-24T13:30:32.280417+0000","last_clean":"2024-04-24T13:30:32.280417+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:30:32.280417+0000","last_undegraded":"2024-04-24T13:30:32.280417+0000","last_fullsized":"2024-04-24T13:30:32.280417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.299596+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:30:32.299596+0000","last_peered":"2024-04-24T13:30:32.299596+0000","last_clean":"2024-04-24T13:30:32.299596+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:30:32.299596+0000","last_undegraded":"2024-04-24T13:30:32.299596+0000","last_fullsized":"2024-04-24T13:30:32.299596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298973+0000","last_change":"2024-04-24T13:30:23.239143+0000","last_active":"2024-04-24T13:30:32.298973+0000","last_peered":"2024-04-24T13:30:32.298973+0000","last_clean":"2024-04-24T13:30:32.298973+0000","last_became_active":"2024-04-24T13:30:23.238351+0000","last_became_peered":"2024-04-24T13:30:23.238351+0000","last_unstale":"2024-04-24T13:30:32.298973+0000","last_undegraded":"2024-04-24T13:30:32.298973+0000","last_fullsized":"2024-04-24T13:30:32.298973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292702+0000","last_change":"2024-04-24T13:30:21.250029+0000","last_active":"2024-04-24T13:30:32.292702+0000","last_peered":"2024-04-24T13:30:32.292702+0000","last_clean":"2024-04-24T13:30:32.292702+0000","last_became_active":"2024-04-24T13:30:21.247198+0000","last_became_peered":"2024-04-24T13:30:21.247198+0000","last_unstale":"2024-04-24T13:30:32.292702+0000","last_undegraded":"2024-04-24T13:30:32.292702+0000","last_fullsized":"2024-04-24T13:30:32.292702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:02.477283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320583+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:30:32.320583+0000","last_peered":"2024-04-24T13:30:32.320583+0000","last_clean":"2024-04-24T13:30:32.320583+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:30:32.320583+0000","last_undegraded":"2024-04-24T13:30:32.320583+0000","last_fullsized":"2024-04-24T13:30:32.320583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.427436+0000","last_change":"2024-04-24T13:30:27.243504+0000","last_active":"2024-04-24T13:30:32.427436+0000","last_peered":"2024-04-24T13:30:32.427436+0000","last_clean":"2024-04-24T13:30:32.427436+0000","last_became_active":"2024-04-24T13:30:27.237695+0000","last_became_peered":"2024-04-24T13:30:27.237695+0000","last_unstale":"2024-04-24T13:30:32.427436+0000","last_undegraded":"2024-04-24T13:30:32.427436+0000","last_fullsized":"2024-04-24T13:30:32.427436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:19.623955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.270839+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:30:32.270839+0000","last_peered":"2024-04-24T13:30:32.270839+0000","last_clean":"2024-04-24T13:30:32.270839+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:30:32.270839+0000","last_undegraded":"2024-04-24T13:30:32.270839+0000","last_fullsized":"2024-04-24T13:30:32.270839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273609+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:30:32.273609+0000","last_peered":"2024-04-24T13:30:32.273609+0000","last_clean":"2024-04-24T13:30:32.273609+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:30:32.273609+0000","last_undegraded":"2024-04-24T13:30:32.273609+0000","last_fullsized":"2024-04-24T13:30:32.273609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273118+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:30:32.273118+0000","last_peered":"2024-04-24T13:30:32.273118+0000","last_clean":"2024-04-24T13:30:32.273118+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:30:32.273118+0000","last_undegraded":"2024-04-24T13:30:32.273118+0000","last_fullsized":"2024-04-24T13:30:32.273118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262473+0000","last_change":"2024-04-24T13:30:21.228287+0000","last_active":"2024-04-24T13:30:32.262473+0000","last_peered":"2024-04-24T13:30:32.262473+0000","last_clean":"2024-04-24T13:30:32.262473+0000","last_became_active":"2024-04-24T13:30:21.227358+0000","last_became_peered":"2024-04-24T13:30:21.227358+0000","last_unstale":"2024-04-24T13:30:32.262473+0000","last_undegraded":"2024-04-24T13:30:32.262473+0000","last_fullsized":"2024-04-24T13:30:32.262473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:09.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320075+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:30:32.320075+0000","last_peered":"2024-04-24T13:30:32.320075+0000","last_clean":"2024-04-24T13:30:32.320075+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:30:32.320075+0000","last_undegraded":"2024-04-24T13:30:32.320075+0000","last_fullsized":"2024-04-24T13:30:32.320075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.527584+0000","last_change":"2024-04-24T13:30:27.249393+0000","last_active":"2024-04-24T13:30:32.527584+0000","last_peered":"2024-04-24T13:30:32.527584+0000","last_clean":"2024-04-24T13:30:32.527584+0000","last_became_active":"2024-04-24T13:30:27.248615+0000","last_became_peered":"2024-04-24T13:30:27.248615+0000","last_unstale":"2024-04-24T13:30:32.527584+0000","last_undegraded":"2024-04-24T13:30:32.527584+0000","last_fullsized":"2024-04-24T13:30:32.527584+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:19.623955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.319665+0000","last_change":"2024-04-24T13:30:29.273036+0000","last_active":"2024-04-24T13:30:32.319665+0000","last_peered":"2024-04-24T13:30:32.319665+0000","last_clean":"2024-04-24T13:30:32.319665+0000","last_became_active":"2024-04-24T13:30:29.272326+0000","last_became_peered":"2024-04-24T13:30:29.272326+0000","last_unstale":"2024-04-24T13:30:32.319665+0000","last_undegraded":"2024-04-24T13:30:32.319665+0000","last_fullsized":"2024-04-24T13:30:32.319665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:12.872542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260720+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:30:32.260720+0000","last_peered":"2024-04-24T13:30:32.260720+0000","last_clean":"2024-04-24T13:30:32.260720+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:30:32.260720+0000","last_undegraded":"2024-04-24T13:30:32.260720+0000","last_fullsized":"2024-04-24T13:30:32.260720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308123+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:30:32.308123+0000","last_peered":"2024-04-24T13:30:32.308123+0000","last_clean":"2024-04-24T13:30:32.308123+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:30:32.308123+0000","last_undegraded":"2024-04-24T13:30:32.308123+0000","last_fullsized":"2024-04-24T13:30:32.308123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280891+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:30:32.280891+0000","last_peered":"2024-04-24T13:30:32.280891+0000","last_clean":"2024-04-24T13:30:32.280891+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:30:32.280891+0000","last_undegraded":"2024-04-24T13:30:32.280891+0000","last_fullsized":"2024-04-24T13:30:32.280891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320389+0000","last_change":"2024-04-24T13:30:25.226038+0000","last_active":"2024-04-24T13:30:32.320389+0000","last_peered":"2024-04-24T13:30:32.320389+0000","last_clean":"2024-04-24T13:30:32.320389+0000","last_became_active":"2024-04-24T13:30:25.225628+0000","last_became_peered":"2024-04-24T13:30:25.225628+0000","last_unstale":"2024-04-24T13:30:32.320389+0000","last_undegraded":"2024-04-24T13:30:32.320389+0000","last_fullsized":"2024-04-24T13:30:32.320389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:33.775369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.458632+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:30:32.458632+0000","last_peered":"2024-04-24T13:30:32.458632+0000","last_clean":"2024-04-24T13:30:32.458632+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:30:32.458632+0000","last_undegraded":"2024-04-24T13:30:32.458632+0000","last_fullsized":"2024-04-24T13:30:32.458632+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273113+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:30:32.273113+0000","last_peered":"2024-04-24T13:30:32.273113+0000","last_clean":"2024-04-24T13:30:32.273113+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:30:32.273113+0000","last_undegraded":"2024-04-24T13:30:32.273113+0000","last_fullsized":"2024-04-24T13:30:32.273113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.279945+0000","last_change":"2024-04-24T13:30:31.269459+0000","last_active":"2024-04-24T13:30:32.279945+0000","last_peered":"2024-04-24T13:30:32.279945+0000","last_clean":"2024-04-24T13:30:32.279945+0000","last_became_active":"2024-04-24T13:30:31.268604+0000","last_became_peered":"2024-04-24T13:30:31.268604+0000","last_unstale":"2024-04-24T13:30:32.279945+0000","last_undegraded":"2024-04-24T13:30:32.279945+0000","last_fullsized":"2024-04-24T13:30:32.279945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:57.047113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308233+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:30:32.308233+0000","last_peered":"2024-04-24T13:30:32.308233+0000","last_clean":"2024-04-24T13:30:32.308233+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:30:32.308233+0000","last_undegraded":"2024-04-24T13:30:32.308233+0000","last_fullsized":"2024-04-24T13:30:32.308233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.299125+0000","last_change":"2024-04-24T13:30:21.233733+0000","last_active":"2024-04-24T13:30:32.299125+0000","last_peered":"2024-04-24T13:30:32.299125+0000","last_clean":"2024-04-24T13:30:32.299125+0000","last_became_active":"2024-04-24T13:30:21.221797+0000","last_became_peered":"2024-04-24T13:30:21.221797+0000","last_unstale":"2024-04-24T13:30:32.299125+0000","last_undegraded":"2024-04-24T13:30:32.299125+0000","last_fullsized":"2024-04-24T13:30:32.299125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258749+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:30:32.258749+0000","last_peered":"2024-04-24T13:30:32.258749+0000","last_clean":"2024-04-24T13:30:32.258749+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:30:32.258749+0000","last_undegraded":"2024-04-24T13:30:32.258749+0000","last_fullsized":"2024-04-24T13:30:32.258749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.410574+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:30:32.410574+0000","last_peered":"2024-04-24T13:30:32.410574+0000","last_clean":"2024-04-24T13:30:32.410574+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:30:32.410574+0000","last_undegraded":"2024-04-24T13:30:32.410574+0000","last_fullsized":"2024-04-24T13:30:32.410574+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320669+0000","last_change":"2024-04-24T13:30:29.259692+0000","last_active":"2024-04-24T13:30:32.320669+0000","last_peered":"2024-04-24T13:30:32.320669+0000","last_clean":"2024-04-24T13:30:32.320669+0000","last_became_active":"2024-04-24T13:30:29.258945+0000","last_became_peered":"2024-04-24T13:30:29.258945+0000","last_unstale":"2024-04-24T13:30:32.320669+0000","last_undegraded":"2024-04-24T13:30:32.320669+0000","last_fullsized":"2024-04-24T13:30:32.320669+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:35.346937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258678+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:30:32.258678+0000","last_peered":"2024-04-24T13:30:32.258678+0000","last_clean":"2024-04-24T13:30:32.258678+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:30:32.258678+0000","last_undegraded":"2024-04-24T13:30:32.258678+0000","last_fullsized":"2024-04-24T13:30:32.258678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.309047+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:30:32.309047+0000","last_peered":"2024-04-24T13:30:32.309047+0000","last_clean":"2024-04-24T13:30:32.309047+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:30:32.309047+0000","last_undegraded":"2024-04-24T13:30:32.309047+0000","last_fullsized":"2024-04-24T13:30:32.309047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307326+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:30:32.307326+0000","last_peered":"2024-04-24T13:30:32.307326+0000","last_clean":"2024-04-24T13:30:32.307326+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:30:32.307326+0000","last_undegraded":"2024-04-24T13:30:32.307326+0000","last_fullsized":"2024-04-24T13:30:32.307326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262998+0000","last_change":"2024-04-24T13:30:25.223759+0000","last_active":"2024-04-24T13:30:32.262998+0000","last_peered":"2024-04-24T13:30:32.262998+0000","last_clean":"2024-04-24T13:30:32.262998+0000","last_became_active":"2024-04-24T13:30:25.222877+0000","last_became_peered":"2024-04-24T13:30:25.222877+0000","last_unstale":"2024-04-24T13:30:32.262998+0000","last_undegraded":"2024-04-24T13:30:32.262998+0000","last_fullsized":"2024-04-24T13:30:32.262998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.454631+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:30:32.454631+0000","last_peered":"2024-04-24T13:30:32.454631+0000","last_clean":"2024-04-24T13:30:32.454631+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:30:32.454631+0000","last_undegraded":"2024-04-24T13:30:32.454631+0000","last_fullsized":"2024-04-24T13:30:32.454631+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300068+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:30:32.300068+0000","last_peered":"2024-04-24T13:30:32.300068+0000","last_clean":"2024-04-24T13:30:32.300068+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:30:32.300068+0000","last_undegraded":"2024-04-24T13:30:32.300068+0000","last_fullsized":"2024-04-24T13:30:32.300068+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307301+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:30:32.307301+0000","last_peered":"2024-04-24T13:30:32.307301+0000","last_clean":"2024-04-24T13:30:32.307301+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:30:32.307301+0000","last_undegraded":"2024-04-24T13:30:32.307301+0000","last_fullsized":"2024-04-24T13:30:32.307301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260901+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:30:32.260901+0000","last_peered":"2024-04-24T13:30:32.260901+0000","last_clean":"2024-04-24T13:30:32.260901+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:30:32.260901+0000","last_undegraded":"2024-04-24T13:30:32.260901+0000","last_fullsized":"2024-04-24T13:30:32.260901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280737+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:30:32.280737+0000","last_peered":"2024-04-24T13:30:32.280737+0000","last_clean":"2024-04-24T13:30:32.280737+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:30:32.280737+0000","last_undegraded":"2024-04-24T13:30:32.280737+0000","last_fullsized":"2024-04-24T13:30:32.280737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308828+0000","last_change":"2024-04-24T13:30:25.224875+0000","last_active":"2024-04-24T13:30:32.308828+0000","last_peered":"2024-04-24T13:30:32.308828+0000","last_clean":"2024-04-24T13:30:32.308828+0000","last_became_active":"2024-04-24T13:30:25.224128+0000","last_became_peered":"2024-04-24T13:30:25.224128+0000","last_unstale":"2024-04-24T13:30:32.308828+0000","last_undegraded":"2024-04-24T13:30:32.308828+0000","last_fullsized":"2024-04-24T13:30:32.308828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.562270+0000","last_change":"2024-04-24T13:30:27.261440+0000","last_active":"2024-04-24T13:30:32.562270+0000","last_peered":"2024-04-24T13:30:32.562270+0000","last_clean":"2024-04-24T13:30:32.562270+0000","last_became_active":"2024-04-24T13:30:27.260655+0000","last_became_peered":"2024-04-24T13:30:27.260655+0000","last_unstale":"2024-04-24T13:30:32.562270+0000","last_undegraded":"2024-04-24T13:30:32.562270+0000","last_fullsized":"2024-04-24T13:30:32.562270+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.299391+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:30:32.299391+0000","last_peered":"2024-04-24T13:30:32.299391+0000","last_clean":"2024-04-24T13:30:32.299391+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:30:32.299391+0000","last_undegraded":"2024-04-24T13:30:32.299391+0000","last_fullsized":"2024-04-24T13:30:32.299391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258575+0000","last_change":"2024-04-24T13:30:31.264695+0000","last_active":"2024-04-24T13:30:32.258575+0000","last_peered":"2024-04-24T13:30:32.258575+0000","last_clean":"2024-04-24T13:30:32.258575+0000","last_became_active":"2024-04-24T13:30:31.263950+0000","last_became_peered":"2024-04-24T13:30:31.263950+0000","last_unstale":"2024-04-24T13:30:32.258575+0000","last_undegraded":"2024-04-24T13:30:32.258575+0000","last_fullsized":"2024-04-24T13:30:32.258575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:18.381332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300230+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:30:32.300230+0000","last_peered":"2024-04-24T13:30:32.300230+0000","last_clean":"2024-04-24T13:30:32.300230+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:30:32.300230+0000","last_undegraded":"2024-04-24T13:30:32.300230+0000","last_fullsized":"2024-04-24T13:30:32.300230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290695+0000","last_change":"2024-04-24T13:30:08.802517+0000","last_active":"2024-04-24T13:30:32.290695+0000","last_peered":"2024-04-24T13:30:32.290695+0000","last_clean":"2024-04-24T13:30:32.290695+0000","last_became_active":"2024-04-24T13:30:08.800555+0000","last_became_peered":"2024-04-24T13:30:08.800555+0000","last_unstale":"2024-04-24T13:30:32.290695+0000","last_undegraded":"2024-04-24T13:30:32.290695+0000","last_fullsized":"2024-04-24T13:30:32.290695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:06.125070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262124+0000","last_change":"2024-04-24T13:30:15.154142+0000","last_active":"2024-04-24T13:30:32.262124+0000","last_peered":"2024-04-24T13:30:32.262124+0000","last_clean":"2024-04-24T13:30:32.262124+0000","last_became_active":"2024-04-24T13:30:15.153433+0000","last_became_peered":"2024-04-24T13:30:15.153433+0000","last_unstale":"2024-04-24T13:30:32.262124+0000","last_undegraded":"2024-04-24T13:30:32.262124+0000","last_fullsized":"2024-04-24T13:30:32.262124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280753+0000","last_change":"2024-04-24T13:30:21.229655+0000","last_active":"2024-04-24T13:30:32.280753+0000","last_peered":"2024-04-24T13:30:32.280753+0000","last_clean":"2024-04-24T13:30:32.280753+0000","last_became_active":"2024-04-24T13:30:21.229312+0000","last_became_peered":"2024-04-24T13:30:21.229312+0000","last_unstale":"2024-04-24T13:30:32.280753+0000","last_undegraded":"2024-04-24T13:30:32.280753+0000","last_fullsized":"2024-04-24T13:30:32.280753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.291603+0000","last_change":"2024-04-24T13:30:25.238663+0000","last_active":"2024-04-24T13:30:32.291603+0000","last_peered":"2024-04-24T13:30:32.291603+0000","last_clean":"2024-04-24T13:30:32.291603+0000","last_became_active":"2024-04-24T13:30:25.237978+0000","last_became_peered":"2024-04-24T13:30:25.237978+0000","last_unstale":"2024-04-24T13:30:32.291603+0000","last_undegraded":"2024-04-24T13:30:32.291603+0000","last_fullsized":"2024-04-24T13:30:32.291603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:02.798146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'7","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.533696+0000","last_change":"2024-04-24T13:30:27.258347+0000","last_active":"2024-04-24T13:30:32.533696+0000","last_peered":"2024-04-24T13:30:32.533696+0000","last_clean":"2024-04-24T13:30:32.533696+0000","last_became_active":"2024-04-24T13:30:27.257694+0000","last_became_peered":"2024-04-24T13:30:27.257694+0000","last_unstale":"2024-04-24T13:30:32.533696+0000","last_undegraded":"2024-04-24T13:30:32.533696+0000","last_fullsized":"2024-04-24T13:30:32.533696+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":15,"num_read_kb":7,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273835+0000","last_change":"2024-04-24T13:30:29.280834+0000","last_active":"2024-04-24T13:30:32.273835+0000","last_peered":"2024-04-24T13:30:32.273835+0000","last_clean":"2024-04-24T13:30:32.273835+0000","last_became_active":"2024-04-24T13:30:29.280212+0000","last_became_peered":"2024-04-24T13:30:29.280212+0000","last_unstale":"2024-04-24T13:30:32.273835+0000","last_undegraded":"2024-04-24T13:30:32.273835+0000","last_fullsized":"2024-04-24T13:30:32.273835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298354+0000","last_change":"2024-04-24T13:30:31.272077+0000","last_active":"2024-04-24T13:30:32.298354+0000","last_peered":"2024-04-24T13:30:32.298354+0000","last_clean":"2024-04-24T13:30:32.298354+0000","last_became_active":"2024-04-24T13:30:31.271268+0000","last_became_peered":"2024-04-24T13:30:31.271268+0000","last_unstale":"2024-04-24T13:30:32.298354+0000","last_undegraded":"2024-04-24T13:30:32.298354+0000","last_fullsized":"2024-04-24T13:30:32.298354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:33.796332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.274231+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:30:32.274231+0000","last_peered":"2024-04-24T13:30:32.274231+0000","last_clean":"2024-04-24T13:30:32.274231+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:30:32.274231+0000","last_undegraded":"2024-04-24T13:30:32.274231+0000","last_fullsized":"2024-04-24T13:30:32.274231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290437+0000","last_change":"2024-04-24T13:30:15.156142+0000","last_active":"2024-04-24T13:30:32.290437+0000","last_peered":"2024-04-24T13:30:32.290437+0000","last_clean":"2024-04-24T13:30:32.290437+0000","last_became_active":"2024-04-24T13:30:15.155326+0000","last_became_peered":"2024-04-24T13:30:15.155326+0000","last_unstale":"2024-04-24T13:30:32.290437+0000","last_undegraded":"2024-04-24T13:30:32.290437+0000","last_fullsized":"2024-04-24T13:30:32.290437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:52.140457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271238+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:30:32.271238+0000","last_peered":"2024-04-24T13:30:32.271238+0000","last_clean":"2024-04-24T13:30:32.271238+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:30:32.271238+0000","last_undegraded":"2024-04-24T13:30:32.271238+0000","last_fullsized":"2024-04-24T13:30:32.271238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263627+0000","last_change":"2024-04-24T13:30:25.232972+0000","last_active":"2024-04-24T13:30:32.263627+0000","last_peered":"2024-04-24T13:30:32.263627+0000","last_clean":"2024-04-24T13:30:32.263627+0000","last_became_active":"2024-04-24T13:30:25.232265+0000","last_became_peered":"2024-04-24T13:30:25.232265+0000","last_unstale":"2024-04-24T13:30:32.263627+0000","last_undegraded":"2024-04-24T13:30:32.263627+0000","last_fullsized":"2024-04-24T13:30:32.263627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:47.489762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'14","reported_seq":49,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.568321+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:30:32.568321+0000","last_peered":"2024-04-24T13:30:32.568321+0000","last_clean":"2024-04-24T13:30:32.568321+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:30:32.568321+0000","last_undegraded":"2024-04-24T13:30:32.568321+0000","last_fullsized":"2024-04-24T13:30:32.568321+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":29,"num_read_kb":18,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.291746+0000","last_change":"2024-04-24T13:30:29.275359+0000","last_active":"2024-04-24T13:30:32.291746+0000","last_peered":"2024-04-24T13:30:32.291746+0000","last_clean":"2024-04-24T13:30:32.291746+0000","last_became_active":"2024-04-24T13:30:29.274589+0000","last_became_peered":"2024-04-24T13:30:29.274589+0000","last_unstale":"2024-04-24T13:30:32.291746+0000","last_undegraded":"2024-04-24T13:30:32.291746+0000","last_fullsized":"2024-04-24T13:30:32.291746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258347+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:30:32.258347+0000","last_peered":"2024-04-24T13:30:32.258347+0000","last_clean":"2024-04-24T13:30:32.258347+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:30:32.258347+0000","last_undegraded":"2024-04-24T13:30:32.258347+0000","last_fullsized":"2024-04-24T13:30:32.258347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260907+0000","last_change":"2024-04-24T13:30:23.217937+0000","last_active":"2024-04-24T13:30:32.260907+0000","last_peered":"2024-04-24T13:30:32.260907+0000","last_clean":"2024-04-24T13:30:32.260907+0000","last_became_active":"2024-04-24T13:30:23.217577+0000","last_became_peered":"2024-04-24T13:30:23.217577+0000","last_unstale":"2024-04-24T13:30:32.260907+0000","last_undegraded":"2024-04-24T13:30:32.260907+0000","last_fullsized":"2024-04-24T13:30:32.260907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320010+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:30:32.320010+0000","last_peered":"2024-04-24T13:30:32.320010+0000","last_clean":"2024-04-24T13:30:32.320010+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:30:32.320010+0000","last_undegraded":"2024-04-24T13:30:32.320010+0000","last_fullsized":"2024-04-24T13:30:32.320010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.257862+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:30:32.257862+0000","last_peered":"2024-04-24T13:30:32.257862+0000","last_clean":"2024-04-24T13:30:32.257862+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:30:32.257862+0000","last_undegraded":"2024-04-24T13:30:32.257862+0000","last_fullsized":"2024-04-24T13:30:32.257862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320696+0000","last_change":"2024-04-24T13:30:25.229114+0000","last_active":"2024-04-24T13:30:32.320696+0000","last_peered":"2024-04-24T13:30:32.320696+0000","last_clean":"2024-04-24T13:30:32.320696+0000","last_became_active":"2024-04-24T13:30:25.228634+0000","last_became_peered":"2024-04-24T13:30:25.228634+0000","last_unstale":"2024-04-24T13:30:32.320696+0000","last_undegraded":"2024-04-24T13:30:32.320696+0000","last_fullsized":"2024-04-24T13:30:32.320696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:13.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'7","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.487344+0000","last_change":"2024-04-24T13:30:27.255646+0000","last_active":"2024-04-24T13:30:32.487344+0000","last_peered":"2024-04-24T13:30:32.487344+0000","last_clean":"2024-04-24T13:30:32.487344+0000","last_became_active":"2024-04-24T13:30:27.254389+0000","last_became_peered":"2024-04-24T13:30:27.254389+0000","last_unstale":"2024-04-24T13:30:32.487344+0000","last_undegraded":"2024-04-24T13:30:32.487344+0000","last_fullsized":"2024-04-24T13:30:32.487344+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272651+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:30:32.272651+0000","last_peered":"2024-04-24T13:30:32.272651+0000","last_clean":"2024-04-24T13:30:32.272651+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:30:32.272651+0000","last_undegraded":"2024-04-24T13:30:32.272651+0000","last_fullsized":"2024-04-24T13:30:32.272651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281803+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:30:32.281803+0000","last_peered":"2024-04-24T13:30:32.281803+0000","last_clean":"2024-04-24T13:30:32.281803+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:30:32.281803+0000","last_undegraded":"2024-04-24T13:30:32.281803+0000","last_fullsized":"2024-04-24T13:30:32.281803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259241+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:30:32.259241+0000","last_peered":"2024-04-24T13:30:32.259241+0000","last_clean":"2024-04-24T13:30:32.259241+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:30:32.259241+0000","last_undegraded":"2024-04-24T13:30:32.259241+0000","last_fullsized":"2024-04-24T13:30:32.259241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262401+0000","last_change":"2024-04-24T13:30:15.151799+0000","last_active":"2024-04-24T13:30:32.262401+0000","last_peered":"2024-04-24T13:30:32.262401+0000","last_clean":"2024-04-24T13:30:32.262401+0000","last_became_active":"2024-04-24T13:30:15.150672+0000","last_became_peered":"2024-04-24T13:30:15.150672+0000","last_unstale":"2024-04-24T13:30:32.262401+0000","last_undegraded":"2024-04-24T13:30:32.262401+0000","last_fullsized":"2024-04-24T13:30:32.262401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307877+0000","last_change":"2024-04-24T13:30:21.222734+0000","last_active":"2024-04-24T13:30:32.307877+0000","last_peered":"2024-04-24T13:30:32.307877+0000","last_clean":"2024-04-24T13:30:32.307877+0000","last_became_active":"2024-04-24T13:30:21.220992+0000","last_became_peered":"2024-04-24T13:30:21.220992+0000","last_unstale":"2024-04-24T13:30:32.307877+0000","last_undegraded":"2024-04-24T13:30:32.307877+0000","last_fullsized":"2024-04-24T13:30:32.307877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:05.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272010+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:30:32.272010+0000","last_peered":"2024-04-24T13:30:32.272010+0000","last_clean":"2024-04-24T13:30:32.272010+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:30:32.272010+0000","last_undegraded":"2024-04-24T13:30:32.272010+0000","last_fullsized":"2024-04-24T13:30:32.272010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.466746+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:30:32.466746+0000","last_peered":"2024-04-24T13:30:32.466746+0000","last_clean":"2024-04-24T13:30:32.466746+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:30:32.466746+0000","last_undegraded":"2024-04-24T13:30:32.466746+0000","last_fullsized":"2024-04-24T13:30:32.466746+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300256+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:30:32.300256+0000","last_peered":"2024-04-24T13:30:32.300256+0000","last_clean":"2024-04-24T13:30:32.300256+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:30:32.300256+0000","last_undegraded":"2024-04-24T13:30:32.300256+0000","last_fullsized":"2024-04-24T13:30:32.300256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260854+0000","last_change":"2024-04-24T13:30:31.267157+0000","last_active":"2024-04-24T13:30:32.260854+0000","last_peered":"2024-04-24T13:30:32.260854+0000","last_clean":"2024-04-24T13:30:32.260854+0000","last_became_active":"2024-04-24T13:30:31.266348+0000","last_became_peered":"2024-04-24T13:30:31.266348+0000","last_unstale":"2024-04-24T13:30:32.260854+0000","last_undegraded":"2024-04-24T13:30:32.260854+0000","last_fullsized":"2024-04-24T13:30:32.260854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:31.837696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258886+0000","last_change":"2024-04-24T13:30:23.218086+0000","last_active":"2024-04-24T13:30:32.258886+0000","last_peered":"2024-04-24T13:30:32.258886+0000","last_clean":"2024-04-24T13:30:32.258886+0000","last_became_active":"2024-04-24T13:30:23.217750+0000","last_became_peered":"2024-04-24T13:30:23.217750+0000","last_unstale":"2024-04-24T13:30:32.258886+0000","last_undegraded":"2024-04-24T13:30:32.258886+0000","last_fullsized":"2024-04-24T13:30:32.258886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263372+0000","last_change":"2024-04-24T13:30:21.214846+0000","last_active":"2024-04-24T13:30:32.263372+0000","last_peered":"2024-04-24T13:30:32.263372+0000","last_clean":"2024-04-24T13:30:32.263372+0000","last_became_active":"2024-04-24T13:30:21.214127+0000","last_became_peered":"2024-04-24T13:30:21.214127+0000","last_unstale":"2024-04-24T13:30:32.263372+0000","last_undegraded":"2024-04-24T13:30:32.263372+0000","last_fullsized":"2024-04-24T13:30:32.263372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:02.477283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259647+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:30:32.259647+0000","last_peered":"2024-04-24T13:30:32.259647+0000","last_clean":"2024-04-24T13:30:32.259647+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:30:32.259647+0000","last_undegraded":"2024-04-24T13:30:32.259647+0000","last_fullsized":"2024-04-24T13:30:32.259647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271915+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:30:32.271915+0000","last_peered":"2024-04-24T13:30:32.271915+0000","last_clean":"2024-04-24T13:30:32.271915+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:30:32.271915+0000","last_undegraded":"2024-04-24T13:30:32.271915+0000","last_fullsized":"2024-04-24T13:30:32.271915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'6","reported_seq":31,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.516383+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:30:32.516383+0000","last_peered":"2024-04-24T13:30:32.516383+0000","last_clean":"2024-04-24T13:30:32.516383+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:30:32.516383+0000","last_undegraded":"2024-04-24T13:30:32.516383+0000","last_fullsized":"2024-04-24T13:30:32.516383+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":13,"num_read_kb":7,"num_write":8,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306278+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:30:32.306278+0000","last_peered":"2024-04-24T13:30:32.306278+0000","last_clean":"2024-04-24T13:30:32.306278+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:30:32.306278+0000","last_undegraded":"2024-04-24T13:30:32.306278+0000","last_fullsized":"2024-04-24T13:30:32.306278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273165+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:30:32.273165+0000","last_peered":"2024-04-24T13:30:32.273165+0000","last_clean":"2024-04-24T13:30:32.273165+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:30:32.273165+0000","last_undegraded":"2024-04-24T13:30:32.273165+0000","last_fullsized":"2024-04-24T13:30:32.273165+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272820+0000","last_change":"2024-04-24T13:30:23.220277+0000","last_active":"2024-04-24T13:30:32.272820+0000","last_peered":"2024-04-24T13:30:32.272820+0000","last_clean":"2024-04-24T13:30:32.272820+0000","last_became_active":"2024-04-24T13:30:23.219932+0000","last_became_peered":"2024-04-24T13:30:23.219932+0000","last_unstale":"2024-04-24T13:30:32.272820+0000","last_undegraded":"2024-04-24T13:30:32.272820+0000","last_fullsized":"2024-04-24T13:30:32.272820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259352+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:30:32.259352+0000","last_peered":"2024-04-24T13:30:32.259352+0000","last_clean":"2024-04-24T13:30:32.259352+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:30:32.259352+0000","last_undegraded":"2024-04-24T13:30:32.259352+0000","last_fullsized":"2024-04-24T13:30:32.259352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.293005+0000","last_change":"2024-04-24T13:30:16.059514+0000","last_active":"2024-04-24T13:30:32.293005+0000","last_peered":"2024-04-24T13:30:32.293005+0000","last_clean":"2024-04-24T13:30:32.293005+0000","last_became_active":"2024-04-24T13:30:16.058864+0000","last_became_peered":"2024-04-24T13:30:16.058864+0000","last_unstale":"2024-04-24T13:30:32.293005+0000","last_undegraded":"2024-04-24T13:30:32.293005+0000","last_fullsized":"2024-04-24T13:30:32.293005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:43.235155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298716+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:30:32.298716+0000","last_peered":"2024-04-24T13:30:32.298716+0000","last_clean":"2024-04-24T13:30:32.298716+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:30:32.298716+0000","last_undegraded":"2024-04-24T13:30:32.298716+0000","last_fullsized":"2024-04-24T13:30:32.298716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.477152+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:30:32.477152+0000","last_peered":"2024-04-24T13:30:32.477152+0000","last_clean":"2024-04-24T13:30:32.477152+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:30:32.477152+0000","last_undegraded":"2024-04-24T13:30:32.477152+0000","last_fullsized":"2024-04-24T13:30:32.477152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261311+0000","last_change":"2024-04-24T13:30:29.257969+0000","last_active":"2024-04-24T13:30:32.261311+0000","last_peered":"2024-04-24T13:30:32.261311+0000","last_clean":"2024-04-24T13:30:32.261311+0000","last_became_active":"2024-04-24T13:30:29.257131+0000","last_became_peered":"2024-04-24T13:30:29.257131+0000","last_unstale":"2024-04-24T13:30:32.261311+0000","last_undegraded":"2024-04-24T13:30:32.261311+0000","last_fullsized":"2024-04-24T13:30:32.261311+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282762+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:30:32.282762+0000","last_peered":"2024-04-24T13:30:32.282762+0000","last_clean":"2024-04-24T13:30:32.282762+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:30:32.282762+0000","last_undegraded":"2024-04-24T13:30:32.282762+0000","last_fullsized":"2024-04-24T13:30:32.282762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280888+0000","last_change":"2024-04-24T13:30:23.249852+0000","last_active":"2024-04-24T13:30:32.280888+0000","last_peered":"2024-04-24T13:30:32.280888+0000","last_clean":"2024-04-24T13:30:32.280888+0000","last_became_active":"2024-04-24T13:30:23.249522+0000","last_became_peered":"2024-04-24T13:30:23.249522+0000","last_unstale":"2024-04-24T13:30:32.280888+0000","last_undegraded":"2024-04-24T13:30:32.280888+0000","last_fullsized":"2024-04-24T13:30:32.280888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282159+0000","last_change":"2024-04-24T13:30:21.238933+0000","last_active":"2024-04-24T13:30:32.282159+0000","last_peered":"2024-04-24T13:30:32.282159+0000","last_clean":"2024-04-24T13:30:32.282159+0000","last_became_active":"2024-04-24T13:30:21.238648+0000","last_became_peered":"2024-04-24T13:30:21.238648+0000","last_unstale":"2024-04-24T13:30:32.282159+0000","last_undegraded":"2024-04-24T13:30:32.282159+0000","last_fullsized":"2024-04-24T13:30:32.282159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260147+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:30:32.260147+0000","last_peered":"2024-04-24T13:30:32.260147+0000","last_clean":"2024-04-24T13:30:32.260147+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:30:32.260147+0000","last_undegraded":"2024-04-24T13:30:32.260147+0000","last_fullsized":"2024-04-24T13:30:32.260147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306417+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:30:32.306417+0000","last_peered":"2024-04-24T13:30:32.306417+0000","last_clean":"2024-04-24T13:30:32.306417+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:30:32.306417+0000","last_undegraded":"2024-04-24T13:30:32.306417+0000","last_fullsized":"2024-04-24T13:30:32.306417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'8","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.542556+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:30:32.542556+0000","last_peered":"2024-04-24T13:30:32.542556+0000","last_clean":"2024-04-24T13:30:32.542556+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:30:32.542556+0000","last_undegraded":"2024-04-24T13:30:32.542556+0000","last_fullsized":"2024-04-24T13:30:32.542556+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":12,"num_read_kb":8,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.283824+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:30:32.283824+0000","last_peered":"2024-04-24T13:30:32.283824+0000","last_clean":"2024-04-24T13:30:32.283824+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:30:32.283824+0000","last_undegraded":"2024-04-24T13:30:32.283824+0000","last_fullsized":"2024-04-24T13:30:32.283824+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272258+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:30:32.272258+0000","last_peered":"2024-04-24T13:30:32.272258+0000","last_clean":"2024-04-24T13:30:32.272258+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:30:32.272258+0000","last_undegraded":"2024-04-24T13:30:32.272258+0000","last_fullsized":"2024-04-24T13:30:32.272258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306672+0000","last_change":"2024-04-24T13:30:23.219012+0000","last_active":"2024-04-24T13:30:32.306672+0000","last_peered":"2024-04-24T13:30:32.306672+0000","last_clean":"2024-04-24T13:30:32.306672+0000","last_became_active":"2024-04-24T13:30:23.218312+0000","last_became_peered":"2024-04-24T13:30:23.218312+0000","last_unstale":"2024-04-24T13:30:32.306672+0000","last_undegraded":"2024-04-24T13:30:32.306672+0000","last_fullsized":"2024-04-24T13:30:32.306672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.274470+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:30:32.274470+0000","last_peered":"2024-04-24T13:30:32.274470+0000","last_clean":"2024-04-24T13:30:32.274470+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:30:32.274470+0000","last_undegraded":"2024-04-24T13:30:32.274470+0000","last_fullsized":"2024-04-24T13:30:32.274470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300687+0000","last_change":"2024-04-24T13:30:15.161378+0000","last_active":"2024-04-24T13:30:32.300687+0000","last_peered":"2024-04-24T13:30:32.300687+0000","last_clean":"2024-04-24T13:30:32.300687+0000","last_became_active":"2024-04-24T13:30:15.160775+0000","last_became_peered":"2024-04-24T13:30:15.160775+0000","last_unstale":"2024-04-24T13:30:32.300687+0000","last_undegraded":"2024-04-24T13:30:32.300687+0000","last_fullsized":"2024-04-24T13:30:32.300687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280159+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:30:32.280159+0000","last_peered":"2024-04-24T13:30:32.280159+0000","last_clean":"2024-04-24T13:30:32.280159+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:30:32.280159+0000","last_undegraded":"2024-04-24T13:30:32.280159+0000","last_fullsized":"2024-04-24T13:30:32.280159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.543354+0000","last_change":"2024-04-24T13:30:27.251349+0000","last_active":"2024-04-24T13:30:32.543354+0000","last_peered":"2024-04-24T13:30:32.543354+0000","last_clean":"2024-04-24T13:30:32.543354+0000","last_became_active":"2024-04-24T13:30:27.250525+0000","last_became_peered":"2024-04-24T13:30:27.250525+0000","last_unstale":"2024-04-24T13:30:32.543354+0000","last_undegraded":"2024-04-24T13:30:32.543354+0000","last_fullsized":"2024-04-24T13:30:32.543354+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280372+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:30:32.280372+0000","last_peered":"2024-04-24T13:30:32.280372+0000","last_clean":"2024-04-24T13:30:32.280372+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:30:32.280372+0000","last_undegraded":"2024-04-24T13:30:32.280372+0000","last_fullsized":"2024-04-24T13:30:32.280372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262641+0000","last_change":"2024-04-24T13:30:31.277358+0000","last_active":"2024-04-24T13:30:32.262641+0000","last_peered":"2024-04-24T13:30:32.262641+0000","last_clean":"2024-04-24T13:30:32.262641+0000","last_became_active":"2024-04-24T13:30:31.276606+0000","last_became_peered":"2024-04-24T13:30:31.276606+0000","last_unstale":"2024-04-24T13:30:32.262641+0000","last_undegraded":"2024-04-24T13:30:32.262641+0000","last_fullsized":"2024-04-24T13:30:32.262641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273103+0000","last_change":"2024-04-24T13:30:31.264343+0000","last_active":"2024-04-24T13:30:32.273103+0000","last_peered":"2024-04-24T13:30:32.273103+0000","last_clean":"2024-04-24T13:30:32.273103+0000","last_became_active":"2024-04-24T13:30:31.263640+0000","last_became_peered":"2024-04-24T13:30:31.263640+0000","last_unstale":"2024-04-24T13:30:32.273103+0000","last_undegraded":"2024-04-24T13:30:32.273103+0000","last_fullsized":"2024-04-24T13:30:32.273103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:51:45.241537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307110+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:30:32.307110+0000","last_peered":"2024-04-24T13:30:32.307110+0000","last_clean":"2024-04-24T13:30:32.307110+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:30:32.307110+0000","last_undegraded":"2024-04-24T13:30:32.307110+0000","last_fullsized":"2024-04-24T13:30:32.307110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307585+0000","last_change":"2024-04-24T13:30:21.252985+0000","last_active":"2024-04-24T13:30:32.307585+0000","last_peered":"2024-04-24T13:30:32.307585+0000","last_clean":"2024-04-24T13:30:32.307585+0000","last_became_active":"2024-04-24T13:30:21.252417+0000","last_became_peered":"2024-04-24T13:30:21.252417+0000","last_unstale":"2024-04-24T13:30:32.307585+0000","last_undegraded":"2024-04-24T13:30:32.307585+0000","last_fullsized":"2024-04-24T13:30:32.307585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259306+0000","last_change":"2024-04-24T13:30:25.228158+0000","last_active":"2024-04-24T13:30:32.259306+0000","last_peered":"2024-04-24T13:30:32.259306+0000","last_clean":"2024-04-24T13:30:32.259306+0000","last_became_active":"2024-04-24T13:30:25.226828+0000","last_became_peered":"2024-04-24T13:30:25.226828+0000","last_unstale":"2024-04-24T13:30:32.259306+0000","last_undegraded":"2024-04-24T13:30:32.259306+0000","last_fullsized":"2024-04-24T13:30:32.259306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:11.608677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280030+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:30:32.280030+0000","last_peered":"2024-04-24T13:30:32.280030+0000","last_clean":"2024-04-24T13:30:32.280030+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:30:32.280030+0000","last_undegraded":"2024-04-24T13:30:32.280030+0000","last_fullsized":"2024-04-24T13:30:32.280030+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280148+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:30:32.280148+0000","last_peered":"2024-04-24T13:30:32.280148+0000","last_clean":"2024-04-24T13:30:32.280148+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:30:32.280148+0000","last_undegraded":"2024-04-24T13:30:32.280148+0000","last_fullsized":"2024-04-24T13:30:32.280148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281953+0000","last_change":"2024-04-24T13:30:31.265871+0000","last_active":"2024-04-24T13:30:32.281953+0000","last_peered":"2024-04-24T13:30:32.281953+0000","last_clean":"2024-04-24T13:30:32.281953+0000","last_became_active":"2024-04-24T13:30:31.265184+0000","last_became_peered":"2024-04-24T13:30:31.265184+0000","last_unstale":"2024-04-24T13:30:32.281953+0000","last_undegraded":"2024-04-24T13:30:32.281953+0000","last_fullsized":"2024-04-24T13:30:32.281953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:22.937959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258883+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:30:32.258883+0000","last_peered":"2024-04-24T13:30:32.258883+0000","last_clean":"2024-04-24T13:30:32.258883+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:30:32.258883+0000","last_undegraded":"2024-04-24T13:30:32.258883+0000","last_fullsized":"2024-04-24T13:30:32.258883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292573+0000","last_change":"2024-04-24T13:30:21.247573+0000","last_active":"2024-04-24T13:30:32.292573+0000","last_peered":"2024-04-24T13:30:32.292573+0000","last_clean":"2024-04-24T13:30:32.292573+0000","last_became_active":"2024-04-24T13:30:21.246433+0000","last_became_peered":"2024-04-24T13:30:21.246433+0000","last_unstale":"2024-04-24T13:30:32.292573+0000","last_undegraded":"2024-04-24T13:30:32.292573+0000","last_fullsized":"2024-04-24T13:30:32.292573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281348+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:30:32.281348+0000","last_peered":"2024-04-24T13:30:32.281348+0000","last_clean":"2024-04-24T13:30:32.281348+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:30:32.281348+0000","last_undegraded":"2024-04-24T13:30:32.281348+0000","last_fullsized":"2024-04-24T13:30:32.281348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'2","reported_seq":23,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.503661+0000","last_change":"2024-04-24T13:30:27.260167+0000","last_active":"2024-04-24T13:30:32.503661+0000","last_peered":"2024-04-24T13:30:32.503661+0000","last_clean":"2024-04-24T13:30:32.503661+0000","last_became_active":"2024-04-24T13:30:27.259644+0000","last_became_peered":"2024-04-24T13:30:27.259644+0000","last_unstale":"2024-04-24T13:30:32.503661+0000","last_undegraded":"2024-04-24T13:30:32.503661+0000","last_fullsized":"2024-04-24T13:30:32.503661+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:21.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":3,"num_read_kb":2,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290484+0000","last_change":"2024-04-24T13:30:29.273787+0000","last_active":"2024-04-24T13:30:32.290484+0000","last_peered":"2024-04-24T13:30:32.290484+0000","last_clean":"2024-04-24T13:30:32.290484+0000","last_became_active":"2024-04-24T13:30:29.273151+0000","last_became_peered":"2024-04-24T13:30:29.273151+0000","last_unstale":"2024-04-24T13:30:32.290484+0000","last_undegraded":"2024-04-24T13:30:32.290484+0000","last_fullsized":"2024-04-24T13:30:32.290484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:23.009033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272185+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:30:32.272185+0000","last_peered":"2024-04-24T13:30:32.272185+0000","last_clean":"2024-04-24T13:30:32.272185+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:30:32.272185+0000","last_undegraded":"2024-04-24T13:30:32.272185+0000","last_fullsized":"2024-04-24T13:30:32.272185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280527+0000","last_change":"2024-04-24T13:30:23.246371+0000","last_active":"2024-04-24T13:30:32.280527+0000","last_peered":"2024-04-24T13:30:32.280527+0000","last_clean":"2024-04-24T13:30:32.280527+0000","last_became_active":"2024-04-24T13:30:23.246084+0000","last_became_peered":"2024-04-24T13:30:23.246084+0000","last_unstale":"2024-04-24T13:30:32.280527+0000","last_undegraded":"2024-04-24T13:30:32.280527+0000","last_fullsized":"2024-04-24T13:30:32.280527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263425+0000","last_change":"2024-04-24T13:30:21.241794+0000","last_active":"2024-04-24T13:30:32.263425+0000","last_peered":"2024-04-24T13:30:32.263425+0000","last_clean":"2024-04-24T13:30:32.263425+0000","last_became_active":"2024-04-24T13:30:21.241043+0000","last_became_peered":"2024-04-24T13:30:21.241043+0000","last_unstale":"2024-04-24T13:30:32.263425+0000","last_undegraded":"2024-04-24T13:30:32.263425+0000","last_fullsized":"2024-04-24T13:30:32.263425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:21.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.289650+0000","last_change":"2024-04-24T13:30:25.239146+0000","last_active":"2024-04-24T13:30:32.289650+0000","last_peered":"2024-04-24T13:30:32.289650+0000","last_clean":"2024-04-24T13:30:32.289650+0000","last_became_active":"2024-04-24T13:30:25.238359+0000","last_became_peered":"2024-04-24T13:30:25.238359+0000","last_unstale":"2024-04-24T13:30:32.289650+0000","last_undegraded":"2024-04-24T13:30:32.289650+0000","last_fullsized":"2024-04-24T13:30:32.289650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.516576+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:30:32.516576+0000","last_peered":"2024-04-24T13:30:32.516576+0000","last_clean":"2024-04-24T13:30:32.516576+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:30:32.516576+0000","last_undegraded":"2024-04-24T13:30:32.516576+0000","last_fullsized":"2024-04-24T13:30:32.516576+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298644+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:30:32.298644+0000","last_peered":"2024-04-24T13:30:32.298644+0000","last_clean":"2024-04-24T13:30:32.298644+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:30:32.298644+0000","last_undegraded":"2024-04-24T13:30:32.298644+0000","last_fullsized":"2024-04-24T13:30:32.298644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261378+0000","last_change":"2024-04-24T13:30:31.276150+0000","last_active":"2024-04-24T13:30:32.261378+0000","last_peered":"2024-04-24T13:30:32.261378+0000","last_clean":"2024-04-24T13:30:32.261378+0000","last_became_active":"2024-04-24T13:30:31.275437+0000","last_became_peered":"2024-04-24T13:30:31.275437+0000","last_unstale":"2024-04-24T13:30:32.261378+0000","last_undegraded":"2024-04-24T13:30:32.261378+0000","last_fullsized":"2024-04-24T13:30:32.261378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280391+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:30:32.280391+0000","last_peered":"2024-04-24T13:30:32.280391+0000","last_clean":"2024-04-24T13:30:32.280391+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:30:32.280391+0000","last_undegraded":"2024-04-24T13:30:32.280391+0000","last_fullsized":"2024-04-24T13:30:32.280391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273816+0000","last_change":"2024-04-24T13:30:21.229237+0000","last_active":"2024-04-24T13:30:32.273816+0000","last_peered":"2024-04-24T13:30:32.273816+0000","last_clean":"2024-04-24T13:30:32.273816+0000","last_became_active":"2024-04-24T13:30:21.228971+0000","last_became_peered":"2024-04-24T13:30:21.228971+0000","last_unstale":"2024-04-24T13:30:32.273816+0000","last_undegraded":"2024-04-24T13:30:32.273816+0000","last_fullsized":"2024-04-24T13:30:32.273816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298822+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:30:32.298822+0000","last_peered":"2024-04-24T13:30:32.298822+0000","last_clean":"2024-04-24T13:30:32.298822+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:30:32.298822+0000","last_undegraded":"2024-04-24T13:30:32.298822+0000","last_fullsized":"2024-04-24T13:30:32.298822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'3","reported_seq":27,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.473695+0000","last_change":"2024-04-24T13:30:27.244776+0000","last_active":"2024-04-24T13:30:32.473695+0000","last_peered":"2024-04-24T13:30:32.473695+0000","last_clean":"2024-04-24T13:30:32.473695+0000","last_became_active":"2024-04-24T13:30:27.243967+0000","last_became_peered":"2024-04-24T13:30:27.243967+0000","last_unstale":"2024-04-24T13:30:32.473695+0000","last_undegraded":"2024-04-24T13:30:32.473695+0000","last_fullsized":"2024-04-24T13:30:32.473695+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:20.682651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":8,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271502+0000","last_change":"2024-04-24T13:30:29.279248+0000","last_active":"2024-04-24T13:30:32.271502+0000","last_peered":"2024-04-24T13:30:32.271502+0000","last_clean":"2024-04-24T13:30:32.271502+0000","last_became_active":"2024-04-24T13:30:29.278511+0000","last_became_peered":"2024-04-24T13:30:29.278511+0000","last_unstale":"2024-04-24T13:30:32.271502+0000","last_undegraded":"2024-04-24T13:30:32.271502+0000","last_fullsized":"2024-04-24T13:30:32.271502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300515+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:30:32.300515+0000","last_peered":"2024-04-24T13:30:32.300515+0000","last_clean":"2024-04-24T13:30:32.300515+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:30:32.300515+0000","last_undegraded":"2024-04-24T13:30:32.300515+0000","last_fullsized":"2024-04-24T13:30:32.300515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280622+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:30:32.280622+0000","last_peered":"2024-04-24T13:30:32.280622+0000","last_clean":"2024-04-24T13:30:32.280622+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:30:32.280622+0000","last_undegraded":"2024-04-24T13:30:32.280622+0000","last_fullsized":"2024-04-24T13:30:32.280622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273977+0000","last_change":"2024-04-24T13:30:25.242437+0000","last_active":"2024-04-24T13:30:32.273977+0000","last_peered":"2024-04-24T13:30:32.273977+0000","last_clean":"2024-04-24T13:30:32.273977+0000","last_became_active":"2024-04-24T13:30:25.241948+0000","last_became_peered":"2024-04-24T13:30:25.241948+0000","last_unstale":"2024-04-24T13:30:32.273977+0000","last_undegraded":"2024-04-24T13:30:32.273977+0000","last_fullsized":"2024-04-24T13:30:32.273977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:57.978574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'4","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.463196+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:30:32.463196+0000","last_peered":"2024-04-24T13:30:32.463196+0000","last_clean":"2024-04-24T13:30:32.463196+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:30:32.463196+0000","last_undegraded":"2024-04-24T13:30:32.463196+0000","last_fullsized":"2024-04-24T13:30:32.463196+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":10,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261702+0000","last_change":"2024-04-24T13:30:29.277963+0000","last_active":"2024-04-24T13:30:32.261702+0000","last_peered":"2024-04-24T13:30:32.261702+0000","last_clean":"2024-04-24T13:30:32.261702+0000","last_became_active":"2024-04-24T13:30:29.277170+0000","last_became_peered":"2024-04-24T13:30:29.277170+0000","last_unstale":"2024-04-24T13:30:32.261702+0000","last_undegraded":"2024-04-24T13:30:32.261702+0000","last_fullsized":"2024-04-24T13:30:32.261702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280740+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:30:32.280740+0000","last_peered":"2024-04-24T13:30:32.280740+0000","last_clean":"2024-04-24T13:30:32.280740+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:30:32.280740+0000","last_undegraded":"2024-04-24T13:30:32.280740+0000","last_fullsized":"2024-04-24T13:30:32.280740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.274038+0000","last_change":"2024-04-24T13:30:23.235742+0000","last_active":"2024-04-24T13:30:32.274038+0000","last_peered":"2024-04-24T13:30:32.274038+0000","last_clean":"2024-04-24T13:30:32.274038+0000","last_became_active":"2024-04-24T13:30:23.235385+0000","last_became_peered":"2024-04-24T13:30:23.235385+0000","last_unstale":"2024-04-24T13:30:32.274038+0000","last_undegraded":"2024-04-24T13:30:32.274038+0000","last_fullsized":"2024-04-24T13:30:32.274038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258960+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:30:32.258960+0000","last_peered":"2024-04-24T13:30:32.258960+0000","last_clean":"2024-04-24T13:30:32.258960+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:30:32.258960+0000","last_undegraded":"2024-04-24T13:30:32.258960+0000","last_fullsized":"2024-04-24T13:30:32.258960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300332+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:30:32.300332+0000","last_peered":"2024-04-24T13:30:32.300332+0000","last_clean":"2024-04-24T13:30:32.300332+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:30:32.300332+0000","last_undegraded":"2024-04-24T13:30:32.300332+0000","last_fullsized":"2024-04-24T13:30:32.300332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.549604+0000","last_change":"2024-04-24T13:30:27.262590+0000","last_active":"2024-04-24T13:30:32.549604+0000","last_peered":"2024-04-24T13:30:32.549604+0000","last_clean":"2024-04-24T13:30:32.549604+0000","last_became_active":"2024-04-24T13:30:27.261920+0000","last_became_peered":"2024-04-24T13:30:27.261920+0000","last_unstale":"2024-04-24T13:30:32.549604+0000","last_undegraded":"2024-04-24T13:30:32.549604+0000","last_fullsized":"2024-04-24T13:30:32.549604+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:21.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259289+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:30:32.259289+0000","last_peered":"2024-04-24T13:30:32.259289+0000","last_clean":"2024-04-24T13:30:32.259289+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:30:32.259289+0000","last_undegraded":"2024-04-24T13:30:32.259289+0000","last_fullsized":"2024-04-24T13:30:32.259289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298641+0000","last_change":"2024-04-24T13:30:31.284027+0000","last_active":"2024-04-24T13:30:32.298641+0000","last_peered":"2024-04-24T13:30:32.298641+0000","last_clean":"2024-04-24T13:30:32.298641+0000","last_became_active":"2024-04-24T13:30:31.283348+0000","last_became_peered":"2024-04-24T13:30:31.283348+0000","last_unstale":"2024-04-24T13:30:32.298641+0000","last_undegraded":"2024-04-24T13:30:32.298641+0000","last_fullsized":"2024-04-24T13:30:32.298641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:42.409692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281501+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:30:32.281501+0000","last_peered":"2024-04-24T13:30:32.281501+0000","last_clean":"2024-04-24T13:30:32.281501+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:30:32.281501+0000","last_undegraded":"2024-04-24T13:30:32.281501+0000","last_fullsized":"2024-04-24T13:30:32.281501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307732+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:30:32.307732+0000","last_peered":"2024-04-24T13:30:32.307732+0000","last_clean":"2024-04-24T13:30:32.307732+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:30:32.307732+0000","last_undegraded":"2024-04-24T13:30:32.307732+0000","last_fullsized":"2024-04-24T13:30:32.307732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308552+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:30:32.308552+0000","last_peered":"2024-04-24T13:30:32.308552+0000","last_clean":"2024-04-24T13:30:32.308552+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:30:32.308552+0000","last_undegraded":"2024-04-24T13:30:32.308552+0000","last_fullsized":"2024-04-24T13:30:32.308552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282840+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:30:32.282840+0000","last_peered":"2024-04-24T13:30:32.282840+0000","last_clean":"2024-04-24T13:30:32.282840+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:30:32.282840+0000","last_undegraded":"2024-04-24T13:30:32.282840+0000","last_fullsized":"2024-04-24T13:30:32.282840+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259459+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:30:32.259459+0000","last_peered":"2024-04-24T13:30:32.259459+0000","last_clean":"2024-04-24T13:30:32.259459+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:30:32.259459+0000","last_undegraded":"2024-04-24T13:30:32.259459+0000","last_fullsized":"2024-04-24T13:30:32.259459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261174+0000","last_change":"2024-04-24T13:30:31.277531+0000","last_active":"2024-04-24T13:30:32.261174+0000","last_peered":"2024-04-24T13:30:32.261174+0000","last_clean":"2024-04-24T13:30:32.261174+0000","last_became_active":"2024-04-24T13:30:31.275550+0000","last_became_peered":"2024-04-24T13:30:31.275550+0000","last_unstale":"2024-04-24T13:30:32.261174+0000","last_undegraded":"2024-04-24T13:30:32.261174+0000","last_fullsized":"2024-04-24T13:30:32.261174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.321417+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:30:32.321417+0000","last_peered":"2024-04-24T13:30:32.321417+0000","last_clean":"2024-04-24T13:30:32.321417+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:30:32.321417+0000","last_undegraded":"2024-04-24T13:30:32.321417+0000","last_fullsized":"2024-04-24T13:30:32.321417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271537+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:30:32.271537+0000","last_peered":"2024-04-24T13:30:32.271537+0000","last_clean":"2024-04-24T13:30:32.271537+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:30:32.271537+0000","last_undegraded":"2024-04-24T13:30:32.271537+0000","last_fullsized":"2024-04-24T13:30:32.271537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260238+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:30:32.260238+0000","last_peered":"2024-04-24T13:30:32.260238+0000","last_clean":"2024-04-24T13:30:32.260238+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:30:32.260238+0000","last_undegraded":"2024-04-24T13:30:32.260238+0000","last_fullsized":"2024-04-24T13:30:32.260238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"0'0","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308710+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:30:32.308710+0000","last_peered":"2024-04-24T13:30:32.308710+0000","last_clean":"2024-04-24T13:30:32.308710+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:30:32.308710+0000","last_undegraded":"2024-04-24T13:30:32.308710+0000","last_fullsized":"2024-04-24T13:30:32.308710+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":19,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.299926+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:30:32.299926+0000","last_peered":"2024-04-24T13:30:32.299926+0000","last_clean":"2024-04-24T13:30:32.299926+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:30:32.299926+0000","last_undegraded":"2024-04-24T13:30:32.299926+0000","last_fullsized":"2024-04-24T13:30:32.299926+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.289897+0000","last_change":"2024-04-24T13:30:31.285910+0000","last_active":"2024-04-24T13:30:32.289897+0000","last_peered":"2024-04-24T13:30:32.289897+0000","last_clean":"2024-04-24T13:30:32.289897+0000","last_became_active":"2024-04-24T13:30:31.285205+0000","last_became_peered":"2024-04-24T13:30:31.285205+0000","last_unstale":"2024-04-24T13:30:32.289897+0000","last_undegraded":"2024-04-24T13:30:32.289897+0000","last_fullsized":"2024-04-24T13:30:32.289897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:48.546868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306799+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:30:32.306799+0000","last_peered":"2024-04-24T13:30:32.306799+0000","last_clean":"2024-04-24T13:30:32.306799+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:30:32.306799+0000","last_undegraded":"2024-04-24T13:30:32.306799+0000","last_fullsized":"2024-04-24T13:30:32.306799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262193+0000","last_change":"2024-04-24T13:30:21.226147+0000","last_active":"2024-04-24T13:30:32.262193+0000","last_peered":"2024-04-24T13:30:32.262193+0000","last_clean":"2024-04-24T13:30:32.262193+0000","last_became_active":"2024-04-24T13:30:21.225369+0000","last_became_peered":"2024-04-24T13:30:21.225369+0000","last_unstale":"2024-04-24T13:30:32.262193+0000","last_undegraded":"2024-04-24T13:30:32.262193+0000","last_fullsized":"2024-04-24T13:30:32.262193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:24.585089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290334+0000","last_change":"2024-04-24T13:30:25.239519+0000","last_active":"2024-04-24T13:30:32.290334+0000","last_peered":"2024-04-24T13:30:32.290334+0000","last_clean":"2024-04-24T13:30:32.290334+0000","last_became_active":"2024-04-24T13:30:25.238779+0000","last_became_peered":"2024-04-24T13:30:25.238779+0000","last_unstale":"2024-04-24T13:30:32.290334+0000","last_undegraded":"2024-04-24T13:30:32.290334+0000","last_fullsized":"2024-04-24T13:30:32.290334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.432817+0000","last_change":"2024-04-24T13:30:27.260827+0000","last_active":"2024-04-24T13:30:32.432817+0000","last_peered":"2024-04-24T13:30:32.432817+0000","last_clean":"2024-04-24T13:30:32.432817+0000","last_became_active":"2024-04-24T13:30:27.260164+0000","last_became_peered":"2024-04-24T13:30:27.260164+0000","last_unstale":"2024-04-24T13:30:32.432817+0000","last_undegraded":"2024-04-24T13:30:32.432817+0000","last_fullsized":"2024-04-24T13:30:32.432817+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.270553+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:30:32.270553+0000","last_peered":"2024-04-24T13:30:32.270553+0000","last_clean":"2024-04-24T13:30:32.270553+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:30:32.270553+0000","last_undegraded":"2024-04-24T13:30:32.270553+0000","last_fullsized":"2024-04-24T13:30:32.270553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292635+0000","last_change":"2024-04-24T13:30:31.280268+0000","last_active":"2024-04-24T13:30:32.292635+0000","last_peered":"2024-04-24T13:30:32.292635+0000","last_clean":"2024-04-24T13:30:32.292635+0000","last_became_active":"2024-04-24T13:30:31.279721+0000","last_became_peered":"2024-04-24T13:30:31.279721+0000","last_unstale":"2024-04-24T13:30:32.292635+0000","last_undegraded":"2024-04-24T13:30:32.292635+0000","last_fullsized":"2024-04-24T13:30:32.292635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:31.837696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307462+0000","last_change":"2024-04-24T13:30:23.225100+0000","last_active":"2024-04-24T13:30:32.307462+0000","last_peered":"2024-04-24T13:30:32.307462+0000","last_clean":"2024-04-24T13:30:32.307462+0000","last_became_active":"2024-04-24T13:30:23.224324+0000","last_became_peered":"2024-04-24T13:30:23.224324+0000","last_unstale":"2024-04-24T13:30:32.307462+0000","last_undegraded":"2024-04-24T13:30:32.307462+0000","last_fullsized":"2024-04-24T13:30:32.307462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263199+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:30:32.263199+0000","last_peered":"2024-04-24T13:30:32.263199+0000","last_clean":"2024-04-24T13:30:32.263199+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:30:32.263199+0000","last_undegraded":"2024-04-24T13:30:32.263199+0000","last_fullsized":"2024-04-24T13:30:32.263199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261843+0000","last_change":"2024-04-24T13:30:25.238830+0000","last_active":"2024-04-24T13:30:32.261843+0000","last_peered":"2024-04-24T13:30:32.261843+0000","last_clean":"2024-04-24T13:30:32.261843+0000","last_became_active":"2024-04-24T13:30:25.237595+0000","last_became_peered":"2024-04-24T13:30:25.237595+0000","last_unstale":"2024-04-24T13:30:32.261843+0000","last_undegraded":"2024-04-24T13:30:32.261843+0000","last_fullsized":"2024-04-24T13:30:32.261843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'7","reported_seq":33,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.564985+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:30:32.564985+0000","last_peered":"2024-04-24T13:30:32.564985+0000","last_clean":"2024-04-24T13:30:32.564985+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:30:32.564985+0000","last_undegraded":"2024-04-24T13:30:32.564985+0000","last_fullsized":"2024-04-24T13:30:32.564985+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":14,"num_read_kb":9,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298747+0000","last_change":"2024-04-24T13:30:29.274924+0000","last_active":"2024-04-24T13:30:32.298747+0000","last_peered":"2024-04-24T13:30:32.298747+0000","last_clean":"2024-04-24T13:30:32.298747+0000","last_became_active":"2024-04-24T13:30:29.274044+0000","last_became_peered":"2024-04-24T13:30:29.274044+0000","last_unstale":"2024-04-24T13:30:32.298747+0000","last_undegraded":"2024-04-24T13:30:32.298747+0000","last_fullsized":"2024-04-24T13:30:32.298747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:43.398878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281944+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:30:32.281944+0000","last_peered":"2024-04-24T13:30:32.281944+0000","last_clean":"2024-04-24T13:30:32.281944+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:30:32.281944+0000","last_undegraded":"2024-04-24T13:30:32.281944+0000","last_fullsized":"2024-04-24T13:30:32.281944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280770+0000","last_change":"2024-04-24T13:30:23.214114+0000","last_active":"2024-04-24T13:30:32.280770+0000","last_peered":"2024-04-24T13:30:32.280770+0000","last_clean":"2024-04-24T13:30:32.280770+0000","last_became_active":"2024-04-24T13:30:23.213489+0000","last_became_peered":"2024-04-24T13:30:23.213489+0000","last_unstale":"2024-04-24T13:30:32.280770+0000","last_undegraded":"2024-04-24T13:30:32.280770+0000","last_fullsized":"2024-04-24T13:30:32.280770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282450+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:30:32.282450+0000","last_peered":"2024-04-24T13:30:32.282450+0000","last_clean":"2024-04-24T13:30:32.282450+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:30:32.282450+0000","last_undegraded":"2024-04-24T13:30:32.282450+0000","last_fullsized":"2024-04-24T13:30:32.282450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.305984+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:30:32.305984+0000","last_peered":"2024-04-24T13:30:32.305984+0000","last_clean":"2024-04-24T13:30:32.305984+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:30:32.305984+0000","last_undegraded":"2024-04-24T13:30:32.305984+0000","last_fullsized":"2024-04-24T13:30:32.305984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'1","reported_seq":21,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282456+0000","last_change":"2024-04-24T13:30:27.253296+0000","last_active":"2024-04-24T13:30:32.282456+0000","last_peered":"2024-04-24T13:30:32.282456+0000","last_clean":"2024-04-24T13:30:32.282456+0000","last_became_active":"2024-04-24T13:30:27.252584+0000","last_became_peered":"2024-04-24T13:30:27.252584+0000","last_unstale":"2024-04-24T13:30:32.282456+0000","last_undegraded":"2024-04-24T13:30:32.282456+0000","last_fullsized":"2024-04-24T13:30:32.282456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306609+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:30:32.306609+0000","last_peered":"2024-04-24T13:30:32.306609+0000","last_clean":"2024-04-24T13:30:32.306609+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:30:32.306609+0000","last_undegraded":"2024-04-24T13:30:32.306609+0000","last_fullsized":"2024-04-24T13:30:32.306609+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.293279+0000","last_change":"2024-04-24T13:30:31.279466+0000","last_active":"2024-04-24T13:30:32.293279+0000","last_peered":"2024-04-24T13:30:32.293279+0000","last_clean":"2024-04-24T13:30:32.293279+0000","last_became_active":"2024-04-24T13:30:31.278784+0000","last_became_peered":"2024-04-24T13:30:31.278784+0000","last_unstale":"2024-04-24T13:30:32.293279+0000","last_undegraded":"2024-04-24T13:30:32.293279+0000","last_fullsized":"2024-04-24T13:30:32.293279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306449+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:30:32.306449+0000","last_peered":"2024-04-24T13:30:32.306449+0000","last_clean":"2024-04-24T13:30:32.306449+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:30:32.306449+0000","last_undegraded":"2024-04-24T13:30:32.306449+0000","last_fullsized":"2024-04-24T13:30:32.306449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273663+0000","last_change":"2024-04-24T13:30:21.229211+0000","last_active":"2024-04-24T13:30:32.273663+0000","last_peered":"2024-04-24T13:30:32.273663+0000","last_clean":"2024-04-24T13:30:32.273663+0000","last_became_active":"2024-04-24T13:30:21.228906+0000","last_became_peered":"2024-04-24T13:30:21.228906+0000","last_unstale":"2024-04-24T13:30:32.273663+0000","last_undegraded":"2024-04-24T13:30:32.273663+0000","last_fullsized":"2024-04-24T13:30:32.273663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258045+0000","last_change":"2024-04-24T13:30:25.228645+0000","last_active":"2024-04-24T13:30:32.258045+0000","last_peered":"2024-04-24T13:30:32.258045+0000","last_clean":"2024-04-24T13:30:32.258045+0000","last_became_active":"2024-04-24T13:30:25.227801+0000","last_became_peered":"2024-04-24T13:30:25.227801+0000","last_unstale":"2024-04-24T13:30:32.258045+0000","last_undegraded":"2024-04-24T13:30:32.258045+0000","last_fullsized":"2024-04-24T13:30:32.258045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:16.778257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'3","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.506456+0000","last_change":"2024-04-24T13:30:27.264731+0000","last_active":"2024-04-24T13:30:32.506456+0000","last_peered":"2024-04-24T13:30:32.506456+0000","last_clean":"2024-04-24T13:30:32.506456+0000","last_became_active":"2024-04-24T13:30:27.263888+0000","last_became_peered":"2024-04-24T13:30:27.263888+0000","last_unstale":"2024-04-24T13:30:32.506456+0000","last_undegraded":"2024-04-24T13:30:32.506456+0000","last_fullsized":"2024-04-24T13:30:32.506456+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271359+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:30:32.271359+0000","last_peered":"2024-04-24T13:30:32.271359+0000","last_clean":"2024-04-24T13:30:32.271359+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:30:32.271359+0000","last_undegraded":"2024-04-24T13:30:32.271359+0000","last_fullsized":"2024-04-24T13:30:32.271359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307275+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:30:32.307275+0000","last_peered":"2024-04-24T13:30:32.307275+0000","last_clean":"2024-04-24T13:30:32.307275+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:30:32.307275+0000","last_undegraded":"2024-04-24T13:30:32.307275+0000","last_fullsized":"2024-04-24T13:30:32.307275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260617+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:30:32.260617+0000","last_peered":"2024-04-24T13:30:32.260617+0000","last_clean":"2024-04-24T13:30:32.260617+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:30:32.260617+0000","last_undegraded":"2024-04-24T13:30:32.260617+0000","last_fullsized":"2024-04-24T13:30:32.260617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298077+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:30:32.298077+0000","last_peered":"2024-04-24T13:30:32.298077+0000","last_clean":"2024-04-24T13:30:32.298077+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:30:32.298077+0000","last_undegraded":"2024-04-24T13:30:32.298077+0000","last_fullsized":"2024-04-24T13:30:32.298077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259948+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:30:32.259948+0000","last_peered":"2024-04-24T13:30:32.259948+0000","last_clean":"2024-04-24T13:30:32.259948+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:30:32.259948+0000","last_undegraded":"2024-04-24T13:30:32.259948+0000","last_fullsized":"2024-04-24T13:30:32.259948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.319740+0000","last_change":"2024-04-24T13:30:21.223752+0000","last_active":"2024-04-24T13:30:32.319740+0000","last_peered":"2024-04-24T13:30:32.319740+0000","last_clean":"2024-04-24T13:30:32.319740+0000","last_became_active":"2024-04-24T13:30:21.223457+0000","last_became_peered":"2024-04-24T13:30:21.223457+0000","last_unstale":"2024-04-24T13:30:32.319740+0000","last_undegraded":"2024-04-24T13:30:32.319740+0000","last_fullsized":"2024-04-24T13:30:32.319740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:49.280399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262757+0000","last_change":"2024-04-24T13:30:23.239053+0000","last_active":"2024-04-24T13:30:32.262757+0000","last_peered":"2024-04-24T13:30:32.262757+0000","last_clean":"2024-04-24T13:30:32.262757+0000","last_became_active":"2024-04-24T13:30:23.238289+0000","last_became_peered":"2024-04-24T13:30:23.238289+0000","last_unstale":"2024-04-24T13:30:32.262757+0000","last_undegraded":"2024-04-24T13:30:32.262757+0000","last_fullsized":"2024-04-24T13:30:32.262757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262315+0000","last_change":"2024-04-24T13:30:21.224037+0000","last_active":"2024-04-24T13:30:32.262315+0000","last_peered":"2024-04-24T13:30:32.262315+0000","last_clean":"2024-04-24T13:30:32.262315+0000","last_became_active":"2024-04-24T13:30:21.222146+0000","last_became_peered":"2024-04-24T13:30:21.222146+0000","last_unstale":"2024-04-24T13:30:32.262315+0000","last_undegraded":"2024-04-24T13:30:32.262315+0000","last_fullsized":"2024-04-24T13:30:32.262315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259546+0000","last_change":"2024-04-24T13:30:23.241090+0000","last_active":"2024-04-24T13:30:32.259546+0000","last_peered":"2024-04-24T13:30:32.259546+0000","last_clean":"2024-04-24T13:30:32.259546+0000","last_became_active":"2024-04-24T13:30:23.240726+0000","last_became_peered":"2024-04-24T13:30:23.240726+0000","last_unstale":"2024-04-24T13:30:32.259546+0000","last_undegraded":"2024-04-24T13:30:32.259546+0000","last_fullsized":"2024-04-24T13:30:32.259546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271825+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:30:32.271825+0000","last_peered":"2024-04-24T13:30:32.271825+0000","last_clean":"2024-04-24T13:30:32.271825+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:30:32.271825+0000","last_undegraded":"2024-04-24T13:30:32.271825+0000","last_fullsized":"2024-04-24T13:30:32.271825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281943+0000","last_change":"2024-04-24T13:30:23.246330+0000","last_active":"2024-04-24T13:30:32.281943+0000","last_peered":"2024-04-24T13:30:32.281943+0000","last_clean":"2024-04-24T13:30:32.281943+0000","last_became_active":"2024-04-24T13:30:23.246109+0000","last_became_peered":"2024-04-24T13:30:23.246109+0000","last_unstale":"2024-04-24T13:30:32.281943+0000","last_undegraded":"2024-04-24T13:30:32.281943+0000","last_fullsized":"2024-04-24T13:30:32.281943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282902+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:30:32.282902+0000","last_peered":"2024-04-24T13:30:32.282902+0000","last_clean":"2024-04-24T13:30:32.282902+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:30:32.282902+0000","last_undegraded":"2024-04-24T13:30:32.282902+0000","last_fullsized":"2024-04-24T13:30:32.282902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307725+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:30:32.307725+0000","last_peered":"2024-04-24T13:30:32.307725+0000","last_clean":"2024-04-24T13:30:32.307725+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:30:32.307725+0000","last_undegraded":"2024-04-24T13:30:32.307725+0000","last_fullsized":"2024-04-24T13:30:32.307725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260773+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:30:32.260773+0000","last_peered":"2024-04-24T13:30:32.260773+0000","last_clean":"2024-04-24T13:30:32.260773+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:30:32.260773+0000","last_undegraded":"2024-04-24T13:30:32.260773+0000","last_fullsized":"2024-04-24T13:30:32.260773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280357+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:30:32.280357+0000","last_peered":"2024-04-24T13:30:32.280357+0000","last_clean":"2024-04-24T13:30:32.280357+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:30:32.280357+0000","last_undegraded":"2024-04-24T13:30:32.280357+0000","last_fullsized":"2024-04-24T13:30:32.280357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300053+0000","last_change":"2024-04-24T13:30:21.244582+0000","last_active":"2024-04-24T13:30:32.300053+0000","last_peered":"2024-04-24T13:30:32.300053+0000","last_clean":"2024-04-24T13:30:32.300053+0000","last_became_active":"2024-04-24T13:30:21.243856+0000","last_became_peered":"2024-04-24T13:30:21.243856+0000","last_unstale":"2024-04-24T13:30:32.300053+0000","last_undegraded":"2024-04-24T13:30:32.300053+0000","last_fullsized":"2024-04-24T13:30:32.300053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298059+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:30:32.298059+0000","last_peered":"2024-04-24T13:30:32.298059+0000","last_clean":"2024-04-24T13:30:32.298059+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:30:32.298059+0000","last_undegraded":"2024-04-24T13:30:32.298059+0000","last_fullsized":"2024-04-24T13:30:32.298059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282569+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:30:32.282569+0000","last_peered":"2024-04-24T13:30:32.282569+0000","last_clean":"2024-04-24T13:30:32.282569+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:30:32.282569+0000","last_undegraded":"2024-04-24T13:30:32.282569+0000","last_fullsized":"2024-04-24T13:30:32.282569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273529+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:30:32.273529+0000","last_peered":"2024-04-24T13:30:32.273529+0000","last_clean":"2024-04-24T13:30:32.273529+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:30:32.273529+0000","last_undegraded":"2024-04-24T13:30:32.273529+0000","last_fullsized":"2024-04-24T13:30:32.273529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261701+0000","last_change":"2024-04-24T13:30:21.229523+0000","last_active":"2024-04-24T13:30:32.261701+0000","last_peered":"2024-04-24T13:30:32.261701+0000","last_clean":"2024-04-24T13:30:32.261701+0000","last_became_active":"2024-04-24T13:30:21.228400+0000","last_became_peered":"2024-04-24T13:30:21.228400+0000","last_unstale":"2024-04-24T13:30:32.261701+0000","last_undegraded":"2024-04-24T13:30:32.261701+0000","last_fullsized":"2024-04-24T13:30:32.261701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308937+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:30:32.308937+0000","last_peered":"2024-04-24T13:30:32.308937+0000","last_clean":"2024-04-24T13:30:32.308937+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:30:32.308937+0000","last_undegraded":"2024-04-24T13:30:32.308937+0000","last_fullsized":"2024-04-24T13:30:32.308937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280818+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:30:32.280818+0000","last_peered":"2024-04-24T13:30:32.280818+0000","last_clean":"2024-04-24T13:30:32.280818+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:30:32.280818+0000","last_undegraded":"2024-04-24T13:30:32.280818+0000","last_fullsized":"2024-04-24T13:30:32.280818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320813+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:30:32.320813+0000","last_peered":"2024-04-24T13:30:32.320813+0000","last_clean":"2024-04-24T13:30:32.320813+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:30:32.320813+0000","last_undegraded":"2024-04-24T13:30:32.320813+0000","last_fullsized":"2024-04-24T13:30:32.320813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262072+0000","last_change":"2024-04-24T13:30:21.241430+0000","last_active":"2024-04-24T13:30:32.262072+0000","last_peered":"2024-04-24T13:30:32.262072+0000","last_clean":"2024-04-24T13:30:32.262072+0000","last_became_active":"2024-04-24T13:30:21.240593+0000","last_became_peered":"2024-04-24T13:30:21.240593+0000","last_unstale":"2024-04-24T13:30:32.262072+0000","last_undegraded":"2024-04-24T13:30:32.262072+0000","last_fullsized":"2024-04-24T13:30:32.262072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308377+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:30:32.308377+0000","last_peered":"2024-04-24T13:30:32.308377+0000","last_clean":"2024-04-24T13:30:32.308377+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:30:32.308377+0000","last_undegraded":"2024-04-24T13:30:32.308377+0000","last_fullsized":"2024-04-24T13:30:32.308377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272062+0000","last_change":"2024-04-24T13:30:21.238887+0000","last_active":"2024-04-24T13:30:32.272062+0000","last_peered":"2024-04-24T13:30:32.272062+0000","last_clean":"2024-04-24T13:30:32.272062+0000","last_became_active":"2024-04-24T13:30:21.238580+0000","last_became_peered":"2024-04-24T13:30:21.238580+0000","last_unstale":"2024-04-24T13:30:32.272062+0000","last_undegraded":"2024-04-24T13:30:32.272062+0000","last_fullsized":"2024-04-24T13:30:32.272062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290977+0000","last_change":"2024-04-24T13:30:23.241254+0000","last_active":"2024-04-24T13:30:32.290977+0000","last_peered":"2024-04-24T13:30:32.290977+0000","last_clean":"2024-04-24T13:30:32.290977+0000","last_became_active":"2024-04-24T13:30:23.236897+0000","last_became_peered":"2024-04-24T13:30:23.236897+0000","last_unstale":"2024-04-24T13:30:32.290977+0000","last_undegraded":"2024-04-24T13:30:32.290977+0000","last_fullsized":"2024-04-24T13:30:32.290977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.299872+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:30:32.299872+0000","last_peered":"2024-04-24T13:30:32.299872+0000","last_clean":"2024-04-24T13:30:32.299872+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:30:32.299872+0000","last_undegraded":"2024-04-24T13:30:32.299872+0000","last_fullsized":"2024-04-24T13:30:32.299872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271102+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:30:32.271102+0000","last_peered":"2024-04-24T13:30:32.271102+0000","last_clean":"2024-04-24T13:30:32.271102+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:30:32.271102+0000","last_undegraded":"2024-04-24T13:30:32.271102+0000","last_fullsized":"2024-04-24T13:30:32.271102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292892+0000","last_change":"2024-04-24T13:30:21.251108+0000","last_active":"2024-04-24T13:30:32.292892+0000","last_peered":"2024-04-24T13:30:32.292892+0000","last_clean":"2024-04-24T13:30:32.292892+0000","last_became_active":"2024-04-24T13:30:21.250436+0000","last_became_peered":"2024-04-24T13:30:21.250436+0000","last_unstale":"2024-04-24T13:30:32.292892+0000","last_undegraded":"2024-04-24T13:30:32.292892+0000","last_fullsized":"2024-04-24T13:30:32.292892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:21.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280283+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:30:32.280283+0000","last_peered":"2024-04-24T13:30:32.280283+0000","last_clean":"2024-04-24T13:30:32.280283+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:30:32.280283+0000","last_undegraded":"2024-04-24T13:30:32.280283+0000","last_fullsized":"2024-04-24T13:30:32.280283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.321140+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:30:32.321140+0000","last_peered":"2024-04-24T13:30:32.321140+0000","last_clean":"2024-04-24T13:30:32.321140+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:30:32.321140+0000","last_undegraded":"2024-04-24T13:30:32.321140+0000","last_fullsized":"2024-04-24T13:30:32.321140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290078+0000","last_change":"2024-04-24T13:30:23.241296+0000","last_active":"2024-04-24T13:30:32.290078+0000","last_peered":"2024-04-24T13:30:32.290078+0000","last_clean":"2024-04-24T13:30:32.290078+0000","last_became_active":"2024-04-24T13:30:23.236992+0000","last_became_peered":"2024-04-24T13:30:23.236992+0000","last_unstale":"2024-04-24T13:30:32.290078+0000","last_undegraded":"2024-04-24T13:30:32.290078+0000","last_fullsized":"2024-04-24T13:30:32.290078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263919+0000","last_change":"2024-04-24T13:30:21.243438+0000","last_active":"2024-04-24T13:30:32.263919+0000","last_peered":"2024-04-24T13:30:32.263919+0000","last_clean":"2024-04-24T13:30:32.263919+0000","last_became_active":"2024-04-24T13:30:21.240665+0000","last_became_peered":"2024-04-24T13:30:21.240665+0000","last_unstale":"2024-04-24T13:30:32.263919+0000","last_undegraded":"2024-04-24T13:30:32.263919+0000","last_fullsized":"2024-04-24T13:30:32.263919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261447+0000","last_change":"2024-04-24T13:30:21.218669+0000","last_active":"2024-04-24T13:30:32.261447+0000","last_peered":"2024-04-24T13:30:32.261447+0000","last_clean":"2024-04-24T13:30:32.261447+0000","last_became_active":"2024-04-24T13:30:21.217904+0000","last_became_peered":"2024-04-24T13:30:21.217904+0000","last_unstale":"2024-04-24T13:30:32.261447+0000","last_undegraded":"2024-04-24T13:30:32.261447+0000","last_fullsized":"2024-04-24T13:30:32.261447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273270+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:30:32.273270+0000","last_peered":"2024-04-24T13:30:32.273270+0000","last_clean":"2024-04-24T13:30:32.273270+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:30:32.273270+0000","last_undegraded":"2024-04-24T13:30:32.273270+0000","last_fullsized":"2024-04-24T13:30:32.273270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258811+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:30:32.258811+0000","last_peered":"2024-04-24T13:30:32.258811+0000","last_clean":"2024-04-24T13:30:32.258811+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:30:32.258811+0000","last_undegraded":"2024-04-24T13:30:32.258811+0000","last_fullsized":"2024-04-24T13:30:32.258811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263197+0000","last_change":"2024-04-24T13:30:23.217309+0000","last_active":"2024-04-24T13:30:32.263197+0000","last_peered":"2024-04-24T13:30:32.263197+0000","last_clean":"2024-04-24T13:30:32.263197+0000","last_became_active":"2024-04-24T13:30:23.216484+0000","last_became_peered":"2024-04-24T13:30:23.216484+0000","last_unstale":"2024-04-24T13:30:32.263197+0000","last_undegraded":"2024-04-24T13:30:32.263197+0000","last_fullsized":"2024-04-24T13:30:32.263197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":76,"num_object_clones":0,"num_object_copies":152,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":76,"num_whiteouts":0,"num_read":309,"num_read_kb":182,"num_write":188,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":158,"ondisk_log_size":158,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574856,"num_pgs":64,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27932,"kb_used_data":916,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343908,"statfs":{"total":96636764160,"available":96608161792,"internally_reserved":0,"allocated":937984,"data_stored":740296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":27654602},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574856,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":149928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574857,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":151415,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574857,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":340,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":348160,"data_stored":149866,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574856,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27348,"kb_used_data":332,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344492,"statfs":{"total":96636764160,"available":96608759808,"internally_reserved":0,"allocated":339968,"data_stored":149774,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574857,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27356,"kb_used_data":336,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344484,"statfs":{"total":96636764160,"available":96608751616,"internally_reserved":0,"allocated":344064,"data_stored":149820,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574858,"num_pgs":60,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27372,"kb_used_data":348,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344468,"statfs":{"total":96636764160,"available":96608735232,"internally_reserved":0,"allocated":356352,"data_stored":151277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574857,"num_pgs":52,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27928,"kb_used_data":912,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343912,"statfs":{"total":96636764160,"available":96608165888,"internally_reserved":0,"allocated":933888,"data_stored":740142,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:30:39.162 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:30:39.538 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:30:39.543 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:30:39.554 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":41,"stamp":"2024-04-24T13:30:39.217940+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":224560,"kb_used_data":4232,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754750160,"statfs":{"total":773094113280,"available":772864163840,"internally_reserved":0,"allocated":4333568,"data_stored":2453462,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":3702,"num_objects":186,"num_object_clones":0,"num_object_copies":372,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":186,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"8.004027"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292212+0000","last_change":"2024-04-24T13:30:21.250354+0000","last_active":"2024-04-24T13:30:32.292212+0000","last_peered":"2024-04-24T13:30:32.292212+0000","last_clean":"2024-04-24T13:30:32.292212+0000","last_became_active":"2024-04-24T13:30:21.246835+0000","last_became_peered":"2024-04-24T13:30:21.246835+0000","last_unstale":"2024-04-24T13:30:32.292212+0000","last_undegraded":"2024-04-24T13:30:32.292212+0000","last_fullsized":"2024-04-24T13:30:32.292212+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:09.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261038+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:30:32.261038+0000","last_peered":"2024-04-24T13:30:32.261038+0000","last_clean":"2024-04-24T13:30:32.261038+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:30:32.261038+0000","last_undegraded":"2024-04-24T13:30:32.261038+0000","last_fullsized":"2024-04-24T13:30:32.261038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260106+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:30:32.260106+0000","last_peered":"2024-04-24T13:30:32.260106+0000","last_clean":"2024-04-24T13:30:32.260106+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:30:32.260106+0000","last_undegraded":"2024-04-24T13:30:32.260106+0000","last_fullsized":"2024-04-24T13:30:32.260106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290637+0000","last_change":"2024-04-24T13:30:23.237080+0000","last_active":"2024-04-24T13:30:32.290637+0000","last_peered":"2024-04-24T13:30:32.290637+0000","last_clean":"2024-04-24T13:30:32.290637+0000","last_became_active":"2024-04-24T13:30:23.236356+0000","last_became_peered":"2024-04-24T13:30:23.236356+0000","last_unstale":"2024-04-24T13:30:32.290637+0000","last_undegraded":"2024-04-24T13:30:32.290637+0000","last_fullsized":"2024-04-24T13:30:32.290637+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272609+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:30:32.272609+0000","last_peered":"2024-04-24T13:30:32.272609+0000","last_clean":"2024-04-24T13:30:32.272609+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:30:32.272609+0000","last_undegraded":"2024-04-24T13:30:32.272609+0000","last_fullsized":"2024-04-24T13:30:32.272609+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306985+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:30:32.306985+0000","last_peered":"2024-04-24T13:30:32.306985+0000","last_clean":"2024-04-24T13:30:32.306985+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:30:32.306985+0000","last_undegraded":"2024-04-24T13:30:32.306985+0000","last_fullsized":"2024-04-24T13:30:32.306985+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262083+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:30:32.262083+0000","last_peered":"2024-04-24T13:30:32.262083+0000","last_clean":"2024-04-24T13:30:32.262083+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:30:32.262083+0000","last_undegraded":"2024-04-24T13:30:32.262083+0000","last_fullsized":"2024-04-24T13:30:32.262083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271640+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:30:32.271640+0000","last_peered":"2024-04-24T13:30:32.271640+0000","last_clean":"2024-04-24T13:30:32.271640+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:30:32.271640+0000","last_undegraded":"2024-04-24T13:30:32.271640+0000","last_fullsized":"2024-04-24T13:30:32.271640+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.291101+0000","last_change":"2024-04-24T13:30:21.251948+0000","last_active":"2024-04-24T13:30:32.291101+0000","last_peered":"2024-04-24T13:30:32.291101+0000","last_clean":"2024-04-24T13:30:32.291101+0000","last_became_active":"2024-04-24T13:30:21.251184+0000","last_became_peered":"2024-04-24T13:30:21.251184+0000","last_unstale":"2024-04-24T13:30:32.291101+0000","last_undegraded":"2024-04-24T13:30:32.291101+0000","last_fullsized":"2024-04-24T13:30:32.291101+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.299706+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:30:32.299706+0000","last_peered":"2024-04-24T13:30:32.299706+0000","last_clean":"2024-04-24T13:30:32.299706+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:30:32.299706+0000","last_undegraded":"2024-04-24T13:30:32.299706+0000","last_fullsized":"2024-04-24T13:30:32.299706+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261742+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:30:32.261742+0000","last_peered":"2024-04-24T13:30:32.261742+0000","last_clean":"2024-04-24T13:30:32.261742+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:30:32.261742+0000","last_undegraded":"2024-04-24T13:30:32.261742+0000","last_fullsized":"2024-04-24T13:30:32.261742+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307736+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:30:32.307736+0000","last_peered":"2024-04-24T13:30:32.307736+0000","last_clean":"2024-04-24T13:30:32.307736+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:30:32.307736+0000","last_undegraded":"2024-04-24T13:30:32.307736+0000","last_fullsized":"2024-04-24T13:30:32.307736+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290888+0000","last_change":"2024-04-24T13:30:21.247080+0000","last_active":"2024-04-24T13:30:32.290888+0000","last_peered":"2024-04-24T13:30:32.290888+0000","last_clean":"2024-04-24T13:30:32.290888+0000","last_became_active":"2024-04-24T13:30:21.239363+0000","last_became_peered":"2024-04-24T13:30:21.239363+0000","last_unstale":"2024-04-24T13:30:32.290888+0000","last_undegraded":"2024-04-24T13:30:32.290888+0000","last_fullsized":"2024-04-24T13:30:32.290888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262931+0000","last_change":"2024-04-24T13:30:23.228080+0000","last_active":"2024-04-24T13:30:32.262931+0000","last_peered":"2024-04-24T13:30:32.262931+0000","last_clean":"2024-04-24T13:30:32.262931+0000","last_became_active":"2024-04-24T13:30:23.227215+0000","last_became_peered":"2024-04-24T13:30:23.227215+0000","last_unstale":"2024-04-24T13:30:32.262931+0000","last_undegraded":"2024-04-24T13:30:32.262931+0000","last_fullsized":"2024-04-24T13:30:32.262931+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280443+0000","last_change":"2024-04-24T13:30:21.232985+0000","last_active":"2024-04-24T13:30:32.280443+0000","last_peered":"2024-04-24T13:30:32.280443+0000","last_clean":"2024-04-24T13:30:32.280443+0000","last_became_active":"2024-04-24T13:30:21.229584+0000","last_became_peered":"2024-04-24T13:30:21.229584+0000","last_unstale":"2024-04-24T13:30:32.280443+0000","last_undegraded":"2024-04-24T13:30:32.280443+0000","last_fullsized":"2024-04-24T13:30:32.280443+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.321251+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:30:32.321251+0000","last_peered":"2024-04-24T13:30:32.321251+0000","last_clean":"2024-04-24T13:30:32.321251+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:30:32.321251+0000","last_undegraded":"2024-04-24T13:30:32.321251+0000","last_fullsized":"2024-04-24T13:30:32.321251+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306431+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:30:32.306431+0000","last_peered":"2024-04-24T13:30:32.306431+0000","last_clean":"2024-04-24T13:30:32.306431+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:30:32.306431+0000","last_undegraded":"2024-04-24T13:30:32.306431+0000","last_fullsized":"2024-04-24T13:30:32.306431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292313+0000","last_change":"2024-04-24T13:30:21.247071+0000","last_active":"2024-04-24T13:30:32.292313+0000","last_peered":"2024-04-24T13:30:32.292313+0000","last_clean":"2024-04-24T13:30:32.292313+0000","last_became_active":"2024-04-24T13:30:21.246454+0000","last_became_peered":"2024-04-24T13:30:21.246454+0000","last_unstale":"2024-04-24T13:30:32.292313+0000","last_undegraded":"2024-04-24T13:30:32.292313+0000","last_fullsized":"2024-04-24T13:30:32.292313+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:48.173823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290801+0000","last_change":"2024-04-24T13:30:23.241549+0000","last_active":"2024-04-24T13:30:32.290801+0000","last_peered":"2024-04-24T13:30:32.290801+0000","last_clean":"2024-04-24T13:30:32.290801+0000","last_became_active":"2024-04-24T13:30:23.236814+0000","last_became_peered":"2024-04-24T13:30:23.236814+0000","last_unstale":"2024-04-24T13:30:32.290801+0000","last_undegraded":"2024-04-24T13:30:32.290801+0000","last_fullsized":"2024-04-24T13:30:32.290801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.299830+0000","last_change":"2024-04-24T13:30:21.244607+0000","last_active":"2024-04-24T13:30:32.299830+0000","last_peered":"2024-04-24T13:30:32.299830+0000","last_clean":"2024-04-24T13:30:32.299830+0000","last_became_active":"2024-04-24T13:30:21.243828+0000","last_became_peered":"2024-04-24T13:30:21.243828+0000","last_unstale":"2024-04-24T13:30:32.299830+0000","last_undegraded":"2024-04-24T13:30:32.299830+0000","last_fullsized":"2024-04-24T13:30:32.299830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262024+0000","last_change":"2024-04-24T13:30:23.220120+0000","last_active":"2024-04-24T13:30:32.262024+0000","last_peered":"2024-04-24T13:30:32.262024+0000","last_clean":"2024-04-24T13:30:32.262024+0000","last_became_active":"2024-04-24T13:30:23.219312+0000","last_became_peered":"2024-04-24T13:30:23.219312+0000","last_unstale":"2024-04-24T13:30:32.262024+0000","last_undegraded":"2024-04-24T13:30:32.262024+0000","last_fullsized":"2024-04-24T13:30:32.262024+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300336+0000","last_change":"2024-04-24T13:30:21.243317+0000","last_active":"2024-04-24T13:30:32.300336+0000","last_peered":"2024-04-24T13:30:32.300336+0000","last_clean":"2024-04-24T13:30:32.300336+0000","last_became_active":"2024-04-24T13:30:21.239686+0000","last_became_peered":"2024-04-24T13:30:21.239686+0000","last_unstale":"2024-04-24T13:30:32.300336+0000","last_undegraded":"2024-04-24T13:30:32.300336+0000","last_fullsized":"2024-04-24T13:30:32.300336+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320287+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:30:32.320287+0000","last_peered":"2024-04-24T13:30:32.320287+0000","last_clean":"2024-04-24T13:30:32.320287+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:30:32.320287+0000","last_undegraded":"2024-04-24T13:30:32.320287+0000","last_fullsized":"2024-04-24T13:30:32.320287+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307730+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:30:32.307730+0000","last_peered":"2024-04-24T13:30:32.307730+0000","last_clean":"2024-04-24T13:30:32.307730+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:30:32.307730+0000","last_undegraded":"2024-04-24T13:30:32.307730+0000","last_fullsized":"2024-04-24T13:30:32.307730+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.321289+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:30:32.321289+0000","last_peered":"2024-04-24T13:30:32.321289+0000","last_clean":"2024-04-24T13:30:32.321289+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:30:32.321289+0000","last_undegraded":"2024-04-24T13:30:32.321289+0000","last_fullsized":"2024-04-24T13:30:32.321289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281219+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:30:32.281219+0000","last_peered":"2024-04-24T13:30:32.281219+0000","last_clean":"2024-04-24T13:30:32.281219+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:30:32.281219+0000","last_undegraded":"2024-04-24T13:30:32.281219+0000","last_fullsized":"2024-04-24T13:30:32.281219+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307989+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:30:32.307989+0000","last_peered":"2024-04-24T13:30:32.307989+0000","last_clean":"2024-04-24T13:30:32.307989+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:30:32.307989+0000","last_undegraded":"2024-04-24T13:30:32.307989+0000","last_fullsized":"2024-04-24T13:30:32.307989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271833+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:30:32.271833+0000","last_peered":"2024-04-24T13:30:32.271833+0000","last_clean":"2024-04-24T13:30:32.271833+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:30:32.271833+0000","last_undegraded":"2024-04-24T13:30:32.271833+0000","last_fullsized":"2024-04-24T13:30:32.271833+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306167+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:30:32.306167+0000","last_peered":"2024-04-24T13:30:32.306167+0000","last_clean":"2024-04-24T13:30:32.306167+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:30:32.306167+0000","last_undegraded":"2024-04-24T13:30:32.306167+0000","last_fullsized":"2024-04-24T13:30:32.306167+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282397+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:30:32.282397+0000","last_peered":"2024-04-24T13:30:32.282397+0000","last_clean":"2024-04-24T13:30:32.282397+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:30:32.282397+0000","last_undegraded":"2024-04-24T13:30:32.282397+0000","last_fullsized":"2024-04-24T13:30:32.282397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.291339+0000","last_change":"2024-04-24T13:30:21.239348+0000","last_active":"2024-04-24T13:30:32.291339+0000","last_peered":"2024-04-24T13:30:32.291339+0000","last_clean":"2024-04-24T13:30:32.291339+0000","last_became_active":"2024-04-24T13:30:21.238561+0000","last_became_peered":"2024-04-24T13:30:21.238561+0000","last_unstale":"2024-04-24T13:30:32.291339+0000","last_undegraded":"2024-04-24T13:30:32.291339+0000","last_fullsized":"2024-04-24T13:30:32.291339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262470+0000","last_change":"2024-04-24T13:30:25.234573+0000","last_active":"2024-04-24T13:30:32.262470+0000","last_peered":"2024-04-24T13:30:32.262470+0000","last_clean":"2024-04-24T13:30:32.262470+0000","last_became_active":"2024-04-24T13:30:25.233807+0000","last_became_peered":"2024-04-24T13:30:25.233807+0000","last_unstale":"2024-04-24T13:30:32.262470+0000","last_undegraded":"2024-04-24T13:30:32.262470+0000","last_fullsized":"2024-04-24T13:30:32.262470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.696027+0000","last_change":"2024-04-24T13:30:27.251872+0000","last_active":"2024-04-24T13:30:32.696027+0000","last_peered":"2024-04-24T13:30:32.696027+0000","last_clean":"2024-04-24T13:30:32.696027+0000","last_became_active":"2024-04-24T13:30:27.251286+0000","last_became_peered":"2024-04-24T13:30:27.251286+0000","last_unstale":"2024-04-24T13:30:32.696027+0000","last_undegraded":"2024-04-24T13:30:32.696027+0000","last_fullsized":"2024-04-24T13:30:32.696027+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:20.682651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292033+0000","last_change":"2024-04-24T13:30:29.281884+0000","last_active":"2024-04-24T13:30:32.292033+0000","last_peered":"2024-04-24T13:30:32.292033+0000","last_clean":"2024-04-24T13:30:32.292033+0000","last_became_active":"2024-04-24T13:30:29.281138+0000","last_became_peered":"2024-04-24T13:30:29.281138+0000","last_unstale":"2024-04-24T13:30:32.292033+0000","last_undegraded":"2024-04-24T13:30:32.292033+0000","last_fullsized":"2024-04-24T13:30:32.292033+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261008+0000","last_change":"2024-04-24T13:30:31.266582+0000","last_active":"2024-04-24T13:30:32.261008+0000","last_peered":"2024-04-24T13:30:32.261008+0000","last_clean":"2024-04-24T13:30:32.261008+0000","last_became_active":"2024-04-24T13:30:31.265452+0000","last_became_peered":"2024-04-24T13:30:31.265452+0000","last_unstale":"2024-04-24T13:30:32.261008+0000","last_undegraded":"2024-04-24T13:30:32.261008+0000","last_fullsized":"2024-04-24T13:30:32.261008+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263112+0000","last_change":"2024-04-24T13:30:23.247313+0000","last_active":"2024-04-24T13:30:32.263112+0000","last_peered":"2024-04-24T13:30:32.263112+0000","last_clean":"2024-04-24T13:30:32.263112+0000","last_became_active":"2024-04-24T13:30:23.246445+0000","last_became_peered":"2024-04-24T13:30:23.246445+0000","last_unstale":"2024-04-24T13:30:32.263112+0000","last_undegraded":"2024-04-24T13:30:32.263112+0000","last_fullsized":"2024-04-24T13:30:32.263112+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271892+0000","last_change":"2024-04-24T13:30:21.238903+0000","last_active":"2024-04-24T13:30:32.271892+0000","last_peered":"2024-04-24T13:30:32.271892+0000","last_clean":"2024-04-24T13:30:32.271892+0000","last_became_active":"2024-04-24T13:30:21.238625+0000","last_became_peered":"2024-04-24T13:30:21.238625+0000","last_unstale":"2024-04-24T13:30:32.271892+0000","last_undegraded":"2024-04-24T13:30:32.271892+0000","last_fullsized":"2024-04-24T13:30:32.271892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282011+0000","last_change":"2024-04-24T13:30:25.226046+0000","last_active":"2024-04-24T13:30:32.282011+0000","last_peered":"2024-04-24T13:30:32.282011+0000","last_clean":"2024-04-24T13:30:32.282011+0000","last_became_active":"2024-04-24T13:30:25.225623+0000","last_became_peered":"2024-04-24T13:30:25.225623+0000","last_unstale":"2024-04-24T13:30:32.282011+0000","last_undegraded":"2024-04-24T13:30:32.282011+0000","last_fullsized":"2024-04-24T13:30:32.282011+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":29,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.081886+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:30:33.081886+0000","last_peered":"2024-04-24T13:30:33.081886+0000","last_clean":"2024-04-24T13:30:33.081886+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:30:33.081886+0000","last_undegraded":"2024-04-24T13:30:33.081886+0000","last_fullsized":"2024-04-24T13:30:33.081886+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308478+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:30:32.308478+0000","last_peered":"2024-04-24T13:30:32.308478+0000","last_clean":"2024-04-24T13:30:32.308478+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:30:32.308478+0000","last_undegraded":"2024-04-24T13:30:32.308478+0000","last_fullsized":"2024-04-24T13:30:32.308478+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271430+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:30:32.271430+0000","last_peered":"2024-04-24T13:30:32.271430+0000","last_clean":"2024-04-24T13:30:32.271430+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:30:32.271430+0000","last_undegraded":"2024-04-24T13:30:32.271430+0000","last_fullsized":"2024-04-24T13:30:32.271430+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.274290+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:30:32.274290+0000","last_peered":"2024-04-24T13:30:32.274290+0000","last_clean":"2024-04-24T13:30:32.274290+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:30:32.274290+0000","last_undegraded":"2024-04-24T13:30:32.274290+0000","last_fullsized":"2024-04-24T13:30:32.274290+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.291079+0000","last_change":"2024-04-24T13:30:21.250665+0000","last_active":"2024-04-24T13:30:32.291079+0000","last_peered":"2024-04-24T13:30:32.291079+0000","last_clean":"2024-04-24T13:30:32.291079+0000","last_became_active":"2024-04-24T13:30:21.246084+0000","last_became_peered":"2024-04-24T13:30:21.246084+0000","last_unstale":"2024-04-24T13:30:32.291079+0000","last_undegraded":"2024-04-24T13:30:32.291079+0000","last_fullsized":"2024-04-24T13:30:32.291079+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282955+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:30:32.282955+0000","last_peered":"2024-04-24T13:30:32.282955+0000","last_clean":"2024-04-24T13:30:32.282955+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:30:32.282955+0000","last_undegraded":"2024-04-24T13:30:32.282955+0000","last_fullsized":"2024-04-24T13:30:32.282955+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.133911+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:30:33.133911+0000","last_peered":"2024-04-24T13:30:33.133911+0000","last_clean":"2024-04-24T13:30:33.133911+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:30:33.133911+0000","last_undegraded":"2024-04-24T13:30:33.133911+0000","last_fullsized":"2024-04-24T13:30:33.133911+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.569481+0000","last_change":"2024-04-24T13:30:29.287547+0000","last_active":"2024-04-24T13:30:32.569481+0000","last_peered":"2024-04-24T13:30:32.569481+0000","last_clean":"2024-04-24T13:30:32.569481+0000","last_became_active":"2024-04-24T13:30:29.285504+0000","last_became_peered":"2024-04-24T13:30:29.285504+0000","last_unstale":"2024-04-24T13:30:32.569481+0000","last_undegraded":"2024-04-24T13:30:32.569481+0000","last_fullsized":"2024-04-24T13:30:32.569481+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308545+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:30:32.308545+0000","last_peered":"2024-04-24T13:30:32.308545+0000","last_clean":"2024-04-24T13:30:32.308545+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:30:32.308545+0000","last_undegraded":"2024-04-24T13:30:32.308545+0000","last_fullsized":"2024-04-24T13:30:32.308545+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282437+0000","last_change":"2024-04-24T13:30:23.243719+0000","last_active":"2024-04-24T13:30:32.282437+0000","last_peered":"2024-04-24T13:30:32.282437+0000","last_clean":"2024-04-24T13:30:32.282437+0000","last_became_active":"2024-04-24T13:30:23.243202+0000","last_became_peered":"2024-04-24T13:30:23.243202+0000","last_unstale":"2024-04-24T13:30:32.282437+0000","last_undegraded":"2024-04-24T13:30:32.282437+0000","last_fullsized":"2024-04-24T13:30:32.282437+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:56.206587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298338+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:30:32.298338+0000","last_peered":"2024-04-24T13:30:32.298338+0000","last_clean":"2024-04-24T13:30:32.298338+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:30:32.298338+0000","last_undegraded":"2024-04-24T13:30:32.298338+0000","last_fullsized":"2024-04-24T13:30:32.298338+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262846+0000","last_change":"2024-04-24T13:30:25.229897+0000","last_active":"2024-04-24T13:30:32.262846+0000","last_peered":"2024-04-24T13:30:32.262846+0000","last_clean":"2024-04-24T13:30:32.262846+0000","last_became_active":"2024-04-24T13:30:25.228575+0000","last_became_peered":"2024-04-24T13:30:25.228575+0000","last_unstale":"2024-04-24T13:30:32.262846+0000","last_undegraded":"2024-04-24T13:30:32.262846+0000","last_fullsized":"2024-04-24T13:30:32.262846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.142246+0000","last_change":"2024-04-24T13:30:27.251316+0000","last_active":"2024-04-24T13:30:33.142246+0000","last_peered":"2024-04-24T13:30:33.142246+0000","last_clean":"2024-04-24T13:30:33.142246+0000","last_became_active":"2024-04-24T13:30:27.250447+0000","last_became_peered":"2024-04-24T13:30:27.250447+0000","last_unstale":"2024-04-24T13:30:33.142246+0000","last_undegraded":"2024-04-24T13:30:33.142246+0000","last_fullsized":"2024-04-24T13:30:33.142246+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.563953+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:30:32.563953+0000","last_peered":"2024-04-24T13:30:32.563953+0000","last_clean":"2024-04-24T13:30:32.563953+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:30:32.563953+0000","last_undegraded":"2024-04-24T13:30:32.563953+0000","last_fullsized":"2024-04-24T13:30:32.563953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261483+0000","last_change":"2024-04-24T13:30:23.245613+0000","last_active":"2024-04-24T13:30:32.261483+0000","last_peered":"2024-04-24T13:30:32.261483+0000","last_clean":"2024-04-24T13:30:32.261483+0000","last_became_active":"2024-04-24T13:30:23.242590+0000","last_became_peered":"2024-04-24T13:30:23.242590+0000","last_unstale":"2024-04-24T13:30:32.261483+0000","last_undegraded":"2024-04-24T13:30:32.261483+0000","last_fullsized":"2024-04-24T13:30:32.261483+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292490+0000","last_change":"2024-04-24T13:30:21.256198+0000","last_active":"2024-04-24T13:30:32.292490+0000","last_peered":"2024-04-24T13:30:32.292490+0000","last_clean":"2024-04-24T13:30:32.292490+0000","last_became_active":"2024-04-24T13:30:21.255557+0000","last_became_peered":"2024-04-24T13:30:21.255557+0000","last_unstale":"2024-04-24T13:30:32.292490+0000","last_undegraded":"2024-04-24T13:30:32.292490+0000","last_fullsized":"2024-04-24T13:30:32.292490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:09.431110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290029+0000","last_change":"2024-04-24T13:30:25.237115+0000","last_active":"2024-04-24T13:30:32.290029+0000","last_peered":"2024-04-24T13:30:32.290029+0000","last_clean":"2024-04-24T13:30:32.290029+0000","last_became_active":"2024-04-24T13:30:25.236366+0000","last_became_peered":"2024-04-24T13:30:25.236366+0000","last_unstale":"2024-04-24T13:30:32.290029+0000","last_undegraded":"2024-04-24T13:30:32.290029+0000","last_fullsized":"2024-04-24T13:30:32.290029+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:57.978574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":51,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.240738+0000","last_change":"2024-04-24T13:30:27.261028+0000","last_active":"2024-04-24T13:30:33.240738+0000","last_peered":"2024-04-24T13:30:33.240738+0000","last_clean":"2024-04-24T13:30:33.240738+0000","last_became_active":"2024-04-24T13:30:27.260231+0000","last_became_peered":"2024-04-24T13:30:27.260231+0000","last_unstale":"2024-04-24T13:30:33.240738+0000","last_undegraded":"2024-04-24T13:30:33.240738+0000","last_fullsized":"2024-04-24T13:30:33.240738+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258416+0000","last_change":"2024-04-24T13:30:29.256804+0000","last_active":"2024-04-24T13:30:32.258416+0000","last_peered":"2024-04-24T13:30:32.258416+0000","last_clean":"2024-04-24T13:30:32.258416+0000","last_became_active":"2024-04-24T13:30:29.255975+0000","last_became_peered":"2024-04-24T13:30:29.255975+0000","last_unstale":"2024-04-24T13:30:32.258416+0000","last_undegraded":"2024-04-24T13:30:32.258416+0000","last_fullsized":"2024-04-24T13:30:32.258416+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:51.521585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261809+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:30:32.261809+0000","last_peered":"2024-04-24T13:30:32.261809+0000","last_clean":"2024-04-24T13:30:32.261809+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:30:32.261809+0000","last_undegraded":"2024-04-24T13:30:32.261809+0000","last_fullsized":"2024-04-24T13:30:32.261809+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306549+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:30:32.306549+0000","last_peered":"2024-04-24T13:30:32.306549+0000","last_clean":"2024-04-24T13:30:32.306549+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:30:32.306549+0000","last_undegraded":"2024-04-24T13:30:32.306549+0000","last_fullsized":"2024-04-24T13:30:32.306549+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292436+0000","last_change":"2024-04-24T13:30:21.251719+0000","last_active":"2024-04-24T13:30:32.292436+0000","last_peered":"2024-04-24T13:30:32.292436+0000","last_clean":"2024-04-24T13:30:32.292436+0000","last_became_active":"2024-04-24T13:30:21.239440+0000","last_became_peered":"2024-04-24T13:30:21.239440+0000","last_unstale":"2024-04-24T13:30:32.292436+0000","last_undegraded":"2024-04-24T13:30:32.292436+0000","last_fullsized":"2024-04-24T13:30:32.292436+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:24.585089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.319734+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:30:32.319734+0000","last_peered":"2024-04-24T13:30:32.319734+0000","last_clean":"2024-04-24T13:30:32.319734+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:30:32.319734+0000","last_undegraded":"2024-04-24T13:30:32.319734+0000","last_fullsized":"2024-04-24T13:30:32.319734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.113673+0000","last_change":"2024-04-24T13:30:27.252640+0000","last_active":"2024-04-24T13:30:33.113673+0000","last_peered":"2024-04-24T13:30:33.113673+0000","last_clean":"2024-04-24T13:30:33.113673+0000","last_became_active":"2024-04-24T13:30:27.252211+0000","last_became_peered":"2024-04-24T13:30:27.252211+0000","last_unstale":"2024-04-24T13:30:33.113673+0000","last_undegraded":"2024-04-24T13:30:33.113673+0000","last_fullsized":"2024-04-24T13:30:33.113673+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:15.455006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280417+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:30:32.280417+0000","last_peered":"2024-04-24T13:30:32.280417+0000","last_clean":"2024-04-24T13:30:32.280417+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:30:32.280417+0000","last_undegraded":"2024-04-24T13:30:32.280417+0000","last_fullsized":"2024-04-24T13:30:32.280417+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.299596+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:30:32.299596+0000","last_peered":"2024-04-24T13:30:32.299596+0000","last_clean":"2024-04-24T13:30:32.299596+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:30:32.299596+0000","last_undegraded":"2024-04-24T13:30:32.299596+0000","last_fullsized":"2024-04-24T13:30:32.299596+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298973+0000","last_change":"2024-04-24T13:30:23.239143+0000","last_active":"2024-04-24T13:30:32.298973+0000","last_peered":"2024-04-24T13:30:32.298973+0000","last_clean":"2024-04-24T13:30:32.298973+0000","last_became_active":"2024-04-24T13:30:23.238351+0000","last_became_peered":"2024-04-24T13:30:23.238351+0000","last_unstale":"2024-04-24T13:30:32.298973+0000","last_undegraded":"2024-04-24T13:30:32.298973+0000","last_fullsized":"2024-04-24T13:30:32.298973+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292702+0000","last_change":"2024-04-24T13:30:21.250029+0000","last_active":"2024-04-24T13:30:32.292702+0000","last_peered":"2024-04-24T13:30:32.292702+0000","last_clean":"2024-04-24T13:30:32.292702+0000","last_became_active":"2024-04-24T13:30:21.247198+0000","last_became_peered":"2024-04-24T13:30:21.247198+0000","last_unstale":"2024-04-24T13:30:32.292702+0000","last_undegraded":"2024-04-24T13:30:32.292702+0000","last_fullsized":"2024-04-24T13:30:32.292702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:02.477283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320583+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:30:32.320583+0000","last_peered":"2024-04-24T13:30:32.320583+0000","last_clean":"2024-04-24T13:30:32.320583+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:30:32.320583+0000","last_undegraded":"2024-04-24T13:30:32.320583+0000","last_fullsized":"2024-04-24T13:30:32.320583+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.031504+0000","last_change":"2024-04-24T13:30:27.243504+0000","last_active":"2024-04-24T13:30:33.031504+0000","last_peered":"2024-04-24T13:30:33.031504+0000","last_clean":"2024-04-24T13:30:33.031504+0000","last_became_active":"2024-04-24T13:30:27.237695+0000","last_became_peered":"2024-04-24T13:30:27.237695+0000","last_unstale":"2024-04-24T13:30:33.031504+0000","last_undegraded":"2024-04-24T13:30:33.031504+0000","last_fullsized":"2024-04-24T13:30:33.031504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:19.623955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.570861+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:30:32.570861+0000","last_peered":"2024-04-24T13:30:32.570861+0000","last_clean":"2024-04-24T13:30:32.570861+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:30:32.570861+0000","last_undegraded":"2024-04-24T13:30:32.570861+0000","last_fullsized":"2024-04-24T13:30:32.570861+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273609+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:30:32.273609+0000","last_peered":"2024-04-24T13:30:32.273609+0000","last_clean":"2024-04-24T13:30:32.273609+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:30:32.273609+0000","last_undegraded":"2024-04-24T13:30:32.273609+0000","last_fullsized":"2024-04-24T13:30:32.273609+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273118+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:30:32.273118+0000","last_peered":"2024-04-24T13:30:32.273118+0000","last_clean":"2024-04-24T13:30:32.273118+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:30:32.273118+0000","last_undegraded":"2024-04-24T13:30:32.273118+0000","last_fullsized":"2024-04-24T13:30:32.273118+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262473+0000","last_change":"2024-04-24T13:30:21.228287+0000","last_active":"2024-04-24T13:30:32.262473+0000","last_peered":"2024-04-24T13:30:32.262473+0000","last_clean":"2024-04-24T13:30:32.262473+0000","last_became_active":"2024-04-24T13:30:21.227358+0000","last_became_peered":"2024-04-24T13:30:21.227358+0000","last_unstale":"2024-04-24T13:30:32.262473+0000","last_undegraded":"2024-04-24T13:30:32.262473+0000","last_fullsized":"2024-04-24T13:30:32.262473+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:09.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320075+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:30:32.320075+0000","last_peered":"2024-04-24T13:30:32.320075+0000","last_clean":"2024-04-24T13:30:32.320075+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:30:32.320075+0000","last_undegraded":"2024-04-24T13:30:32.320075+0000","last_fullsized":"2024-04-24T13:30:32.320075+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.656647+0000","last_change":"2024-04-24T13:30:27.249393+0000","last_active":"2024-04-24T13:30:32.656647+0000","last_peered":"2024-04-24T13:30:32.656647+0000","last_clean":"2024-04-24T13:30:32.656647+0000","last_became_active":"2024-04-24T13:30:27.248615+0000","last_became_peered":"2024-04-24T13:30:27.248615+0000","last_unstale":"2024-04-24T13:30:32.656647+0000","last_undegraded":"2024-04-24T13:30:32.656647+0000","last_fullsized":"2024-04-24T13:30:32.656647+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:19.623955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.319665+0000","last_change":"2024-04-24T13:30:29.273036+0000","last_active":"2024-04-24T13:30:32.319665+0000","last_peered":"2024-04-24T13:30:32.319665+0000","last_clean":"2024-04-24T13:30:32.319665+0000","last_became_active":"2024-04-24T13:30:29.272326+0000","last_became_peered":"2024-04-24T13:30:29.272326+0000","last_unstale":"2024-04-24T13:30:32.319665+0000","last_undegraded":"2024-04-24T13:30:32.319665+0000","last_fullsized":"2024-04-24T13:30:32.319665+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:12.872542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260720+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:30:32.260720+0000","last_peered":"2024-04-24T13:30:32.260720+0000","last_clean":"2024-04-24T13:30:32.260720+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:30:32.260720+0000","last_undegraded":"2024-04-24T13:30:32.260720+0000","last_fullsized":"2024-04-24T13:30:32.260720+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308123+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:30:32.308123+0000","last_peered":"2024-04-24T13:30:32.308123+0000","last_clean":"2024-04-24T13:30:32.308123+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:30:32.308123+0000","last_undegraded":"2024-04-24T13:30:32.308123+0000","last_fullsized":"2024-04-24T13:30:32.308123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280891+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:30:32.280891+0000","last_peered":"2024-04-24T13:30:32.280891+0000","last_clean":"2024-04-24T13:30:32.280891+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:30:32.280891+0000","last_undegraded":"2024-04-24T13:30:32.280891+0000","last_fullsized":"2024-04-24T13:30:32.280891+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320389+0000","last_change":"2024-04-24T13:30:25.226038+0000","last_active":"2024-04-24T13:30:32.320389+0000","last_peered":"2024-04-24T13:30:32.320389+0000","last_clean":"2024-04-24T13:30:32.320389+0000","last_became_active":"2024-04-24T13:30:25.225628+0000","last_became_peered":"2024-04-24T13:30:25.225628+0000","last_unstale":"2024-04-24T13:30:32.320389+0000","last_undegraded":"2024-04-24T13:30:32.320389+0000","last_fullsized":"2024-04-24T13:30:32.320389+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:33.775369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.178284+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:30:33.178284+0000","last_peered":"2024-04-24T13:30:33.178284+0000","last_clean":"2024-04-24T13:30:33.178284+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:30:33.178284+0000","last_undegraded":"2024-04-24T13:30:33.178284+0000","last_fullsized":"2024-04-24T13:30:33.178284+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273113+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:30:32.273113+0000","last_peered":"2024-04-24T13:30:32.273113+0000","last_clean":"2024-04-24T13:30:32.273113+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:30:32.273113+0000","last_undegraded":"2024-04-24T13:30:32.273113+0000","last_fullsized":"2024-04-24T13:30:32.273113+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.279945+0000","last_change":"2024-04-24T13:30:31.269459+0000","last_active":"2024-04-24T13:30:32.279945+0000","last_peered":"2024-04-24T13:30:32.279945+0000","last_clean":"2024-04-24T13:30:32.279945+0000","last_became_active":"2024-04-24T13:30:31.268604+0000","last_became_peered":"2024-04-24T13:30:31.268604+0000","last_unstale":"2024-04-24T13:30:32.279945+0000","last_undegraded":"2024-04-24T13:30:32.279945+0000","last_fullsized":"2024-04-24T13:30:32.279945+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:57.047113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308233+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:30:32.308233+0000","last_peered":"2024-04-24T13:30:32.308233+0000","last_clean":"2024-04-24T13:30:32.308233+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:30:32.308233+0000","last_undegraded":"2024-04-24T13:30:32.308233+0000","last_fullsized":"2024-04-24T13:30:32.308233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.299125+0000","last_change":"2024-04-24T13:30:21.233733+0000","last_active":"2024-04-24T13:30:32.299125+0000","last_peered":"2024-04-24T13:30:32.299125+0000","last_clean":"2024-04-24T13:30:32.299125+0000","last_became_active":"2024-04-24T13:30:21.221797+0000","last_became_peered":"2024-04-24T13:30:21.221797+0000","last_unstale":"2024-04-24T13:30:32.299125+0000","last_undegraded":"2024-04-24T13:30:32.299125+0000","last_fullsized":"2024-04-24T13:30:32.299125+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258749+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:30:32.258749+0000","last_peered":"2024-04-24T13:30:32.258749+0000","last_clean":"2024-04-24T13:30:32.258749+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:30:32.258749+0000","last_undegraded":"2024-04-24T13:30:32.258749+0000","last_fullsized":"2024-04-24T13:30:32.258749+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.245784+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:30:33.245784+0000","last_peered":"2024-04-24T13:30:33.245784+0000","last_clean":"2024-04-24T13:30:33.245784+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:30:33.245784+0000","last_undegraded":"2024-04-24T13:30:33.245784+0000","last_fullsized":"2024-04-24T13:30:33.245784+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.565508+0000","last_change":"2024-04-24T13:30:29.259692+0000","last_active":"2024-04-24T13:30:32.565508+0000","last_peered":"2024-04-24T13:30:32.565508+0000","last_clean":"2024-04-24T13:30:32.565508+0000","last_became_active":"2024-04-24T13:30:29.258945+0000","last_became_peered":"2024-04-24T13:30:29.258945+0000","last_unstale":"2024-04-24T13:30:32.565508+0000","last_undegraded":"2024-04-24T13:30:32.565508+0000","last_fullsized":"2024-04-24T13:30:32.565508+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:35.346937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258678+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:30:32.258678+0000","last_peered":"2024-04-24T13:30:32.258678+0000","last_clean":"2024-04-24T13:30:32.258678+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:30:32.258678+0000","last_undegraded":"2024-04-24T13:30:32.258678+0000","last_fullsized":"2024-04-24T13:30:32.258678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.309047+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:30:32.309047+0000","last_peered":"2024-04-24T13:30:32.309047+0000","last_clean":"2024-04-24T13:30:32.309047+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:30:32.309047+0000","last_undegraded":"2024-04-24T13:30:32.309047+0000","last_fullsized":"2024-04-24T13:30:32.309047+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307326+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:30:32.307326+0000","last_peered":"2024-04-24T13:30:32.307326+0000","last_clean":"2024-04-24T13:30:32.307326+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:30:32.307326+0000","last_undegraded":"2024-04-24T13:30:32.307326+0000","last_fullsized":"2024-04-24T13:30:32.307326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262998+0000","last_change":"2024-04-24T13:30:25.223759+0000","last_active":"2024-04-24T13:30:32.262998+0000","last_peered":"2024-04-24T13:30:32.262998+0000","last_clean":"2024-04-24T13:30:32.262998+0000","last_became_active":"2024-04-24T13:30:25.222877+0000","last_became_peered":"2024-04-24T13:30:25.222877+0000","last_unstale":"2024-04-24T13:30:32.262998+0000","last_undegraded":"2024-04-24T13:30:32.262998+0000","last_fullsized":"2024-04-24T13:30:32.262998+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.037589+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:30:33.037589+0000","last_peered":"2024-04-24T13:30:33.037589+0000","last_clean":"2024-04-24T13:30:33.037589+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:30:33.037589+0000","last_undegraded":"2024-04-24T13:30:33.037589+0000","last_fullsized":"2024-04-24T13:30:33.037589+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.563988+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:30:32.563988+0000","last_peered":"2024-04-24T13:30:32.563988+0000","last_clean":"2024-04-24T13:30:32.563988+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:30:32.563988+0000","last_undegraded":"2024-04-24T13:30:32.563988+0000","last_fullsized":"2024-04-24T13:30:32.563988+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307301+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:30:32.307301+0000","last_peered":"2024-04-24T13:30:32.307301+0000","last_clean":"2024-04-24T13:30:32.307301+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:30:32.307301+0000","last_undegraded":"2024-04-24T13:30:32.307301+0000","last_fullsized":"2024-04-24T13:30:32.307301+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260901+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:30:32.260901+0000","last_peered":"2024-04-24T13:30:32.260901+0000","last_clean":"2024-04-24T13:30:32.260901+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:30:32.260901+0000","last_undegraded":"2024-04-24T13:30:32.260901+0000","last_fullsized":"2024-04-24T13:30:32.260901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280737+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:30:32.280737+0000","last_peered":"2024-04-24T13:30:32.280737+0000","last_clean":"2024-04-24T13:30:32.280737+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:30:32.280737+0000","last_undegraded":"2024-04-24T13:30:32.280737+0000","last_fullsized":"2024-04-24T13:30:32.280737+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308828+0000","last_change":"2024-04-24T13:30:25.224875+0000","last_active":"2024-04-24T13:30:32.308828+0000","last_peered":"2024-04-24T13:30:32.308828+0000","last_clean":"2024-04-24T13:30:32.308828+0000","last_became_active":"2024-04-24T13:30:25.224128+0000","last_became_peered":"2024-04-24T13:30:25.224128+0000","last_unstale":"2024-04-24T13:30:32.308828+0000","last_undegraded":"2024-04-24T13:30:32.308828+0000","last_fullsized":"2024-04-24T13:30:32.308828+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":48,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.170429+0000","last_change":"2024-04-24T13:30:27.261440+0000","last_active":"2024-04-24T13:30:33.170429+0000","last_peered":"2024-04-24T13:30:33.170429+0000","last_clean":"2024-04-24T13:30:33.170429+0000","last_became_active":"2024-04-24T13:30:27.260655+0000","last_became_peered":"2024-04-24T13:30:27.260655+0000","last_unstale":"2024-04-24T13:30:33.170429+0000","last_undegraded":"2024-04-24T13:30:33.170429+0000","last_fullsized":"2024-04-24T13:30:33.170429+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.299391+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:30:32.299391+0000","last_peered":"2024-04-24T13:30:32.299391+0000","last_clean":"2024-04-24T13:30:32.299391+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:30:32.299391+0000","last_undegraded":"2024-04-24T13:30:32.299391+0000","last_fullsized":"2024-04-24T13:30:32.299391+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258575+0000","last_change":"2024-04-24T13:30:31.264695+0000","last_active":"2024-04-24T13:30:32.258575+0000","last_peered":"2024-04-24T13:30:32.258575+0000","last_clean":"2024-04-24T13:30:32.258575+0000","last_became_active":"2024-04-24T13:30:31.263950+0000","last_became_peered":"2024-04-24T13:30:31.263950+0000","last_unstale":"2024-04-24T13:30:32.258575+0000","last_undegraded":"2024-04-24T13:30:32.258575+0000","last_fullsized":"2024-04-24T13:30:32.258575+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:18.381332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300230+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:30:32.300230+0000","last_peered":"2024-04-24T13:30:32.300230+0000","last_clean":"2024-04-24T13:30:32.300230+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:30:32.300230+0000","last_undegraded":"2024-04-24T13:30:32.300230+0000","last_fullsized":"2024-04-24T13:30:32.300230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":194,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290695+0000","last_change":"2024-04-24T13:30:08.802517+0000","last_active":"2024-04-24T13:30:32.290695+0000","last_peered":"2024-04-24T13:30:32.290695+0000","last_clean":"2024-04-24T13:30:32.290695+0000","last_became_active":"2024-04-24T13:30:08.800555+0000","last_became_peered":"2024-04-24T13:30:08.800555+0000","last_unstale":"2024-04-24T13:30:32.290695+0000","last_undegraded":"2024-04-24T13:30:32.290695+0000","last_fullsized":"2024-04-24T13:30:32.290695+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:06.125070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262124+0000","last_change":"2024-04-24T13:30:15.154142+0000","last_active":"2024-04-24T13:30:32.262124+0000","last_peered":"2024-04-24T13:30:32.262124+0000","last_clean":"2024-04-24T13:30:32.262124+0000","last_became_active":"2024-04-24T13:30:15.153433+0000","last_became_peered":"2024-04-24T13:30:15.153433+0000","last_unstale":"2024-04-24T13:30:32.262124+0000","last_undegraded":"2024-04-24T13:30:32.262124+0000","last_fullsized":"2024-04-24T13:30:32.262124+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280753+0000","last_change":"2024-04-24T13:30:21.229655+0000","last_active":"2024-04-24T13:30:32.280753+0000","last_peered":"2024-04-24T13:30:32.280753+0000","last_clean":"2024-04-24T13:30:32.280753+0000","last_became_active":"2024-04-24T13:30:21.229312+0000","last_became_peered":"2024-04-24T13:30:21.229312+0000","last_unstale":"2024-04-24T13:30:32.280753+0000","last_undegraded":"2024-04-24T13:30:32.280753+0000","last_fullsized":"2024-04-24T13:30:32.280753+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.291603+0000","last_change":"2024-04-24T13:30:25.238663+0000","last_active":"2024-04-24T13:30:32.291603+0000","last_peered":"2024-04-24T13:30:32.291603+0000","last_clean":"2024-04-24T13:30:32.291603+0000","last_became_active":"2024-04-24T13:30:25.237978+0000","last_became_peered":"2024-04-24T13:30:25.237978+0000","last_unstale":"2024-04-24T13:30:32.291603+0000","last_undegraded":"2024-04-24T13:30:32.291603+0000","last_fullsized":"2024-04-24T13:30:32.291603+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:02.798146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":47,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.968924+0000","last_change":"2024-04-24T13:30:27.258347+0000","last_active":"2024-04-24T13:30:32.968924+0000","last_peered":"2024-04-24T13:30:32.968924+0000","last_clean":"2024-04-24T13:30:32.968924+0000","last_became_active":"2024-04-24T13:30:27.257694+0000","last_became_peered":"2024-04-24T13:30:27.257694+0000","last_unstale":"2024-04-24T13:30:32.968924+0000","last_undegraded":"2024-04-24T13:30:32.968924+0000","last_fullsized":"2024-04-24T13:30:32.968924+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273835+0000","last_change":"2024-04-24T13:30:29.280834+0000","last_active":"2024-04-24T13:30:32.273835+0000","last_peered":"2024-04-24T13:30:32.273835+0000","last_clean":"2024-04-24T13:30:32.273835+0000","last_became_active":"2024-04-24T13:30:29.280212+0000","last_became_peered":"2024-04-24T13:30:29.280212+0000","last_unstale":"2024-04-24T13:30:32.273835+0000","last_undegraded":"2024-04-24T13:30:32.273835+0000","last_fullsized":"2024-04-24T13:30:32.273835+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298354+0000","last_change":"2024-04-24T13:30:31.272077+0000","last_active":"2024-04-24T13:30:32.298354+0000","last_peered":"2024-04-24T13:30:32.298354+0000","last_clean":"2024-04-24T13:30:32.298354+0000","last_became_active":"2024-04-24T13:30:31.271268+0000","last_became_peered":"2024-04-24T13:30:31.271268+0000","last_unstale":"2024-04-24T13:30:32.298354+0000","last_undegraded":"2024-04-24T13:30:32.298354+0000","last_fullsized":"2024-04-24T13:30:32.298354+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:33.796332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.274231+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:30:32.274231+0000","last_peered":"2024-04-24T13:30:32.274231+0000","last_clean":"2024-04-24T13:30:32.274231+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:30:32.274231+0000","last_undegraded":"2024-04-24T13:30:32.274231+0000","last_fullsized":"2024-04-24T13:30:32.274231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290437+0000","last_change":"2024-04-24T13:30:15.156142+0000","last_active":"2024-04-24T13:30:32.290437+0000","last_peered":"2024-04-24T13:30:32.290437+0000","last_clean":"2024-04-24T13:30:32.290437+0000","last_became_active":"2024-04-24T13:30:15.155326+0000","last_became_peered":"2024-04-24T13:30:15.155326+0000","last_unstale":"2024-04-24T13:30:32.290437+0000","last_undegraded":"2024-04-24T13:30:32.290437+0000","last_fullsized":"2024-04-24T13:30:32.290437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:52.140457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271238+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:30:32.271238+0000","last_peered":"2024-04-24T13:30:32.271238+0000","last_clean":"2024-04-24T13:30:32.271238+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:30:32.271238+0000","last_undegraded":"2024-04-24T13:30:32.271238+0000","last_fullsized":"2024-04-24T13:30:32.271238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263627+0000","last_change":"2024-04-24T13:30:25.232972+0000","last_active":"2024-04-24T13:30:32.263627+0000","last_peered":"2024-04-24T13:30:32.263627+0000","last_clean":"2024-04-24T13:30:32.263627+0000","last_became_active":"2024-04-24T13:30:25.232265+0000","last_became_peered":"2024-04-24T13:30:25.232265+0000","last_unstale":"2024-04-24T13:30:32.263627+0000","last_undegraded":"2024-04-24T13:30:32.263627+0000","last_fullsized":"2024-04-24T13:30:32.263627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:47.489762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":63,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.157841+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:30:33.157841+0000","last_peered":"2024-04-24T13:30:33.157841+0000","last_clean":"2024-04-24T13:30:33.157841+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:30:33.157841+0000","last_undegraded":"2024-04-24T13:30:33.157841+0000","last_fullsized":"2024-04-24T13:30:33.157841+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.291746+0000","last_change":"2024-04-24T13:30:29.275359+0000","last_active":"2024-04-24T13:30:32.291746+0000","last_peered":"2024-04-24T13:30:32.291746+0000","last_clean":"2024-04-24T13:30:32.291746+0000","last_became_active":"2024-04-24T13:30:29.274589+0000","last_became_peered":"2024-04-24T13:30:29.274589+0000","last_unstale":"2024-04-24T13:30:32.291746+0000","last_undegraded":"2024-04-24T13:30:32.291746+0000","last_fullsized":"2024-04-24T13:30:32.291746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258347+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:30:32.258347+0000","last_peered":"2024-04-24T13:30:32.258347+0000","last_clean":"2024-04-24T13:30:32.258347+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:30:32.258347+0000","last_undegraded":"2024-04-24T13:30:32.258347+0000","last_fullsized":"2024-04-24T13:30:32.258347+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260907+0000","last_change":"2024-04-24T13:30:23.217937+0000","last_active":"2024-04-24T13:30:32.260907+0000","last_peered":"2024-04-24T13:30:32.260907+0000","last_clean":"2024-04-24T13:30:32.260907+0000","last_became_active":"2024-04-24T13:30:23.217577+0000","last_became_peered":"2024-04-24T13:30:23.217577+0000","last_unstale":"2024-04-24T13:30:32.260907+0000","last_undegraded":"2024-04-24T13:30:32.260907+0000","last_fullsized":"2024-04-24T13:30:32.260907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320010+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:30:32.320010+0000","last_peered":"2024-04-24T13:30:32.320010+0000","last_clean":"2024-04-24T13:30:32.320010+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:30:32.320010+0000","last_undegraded":"2024-04-24T13:30:32.320010+0000","last_fullsized":"2024-04-24T13:30:32.320010+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.257862+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:30:32.257862+0000","last_peered":"2024-04-24T13:30:32.257862+0000","last_clean":"2024-04-24T13:30:32.257862+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:30:32.257862+0000","last_undegraded":"2024-04-24T13:30:32.257862+0000","last_fullsized":"2024-04-24T13:30:32.257862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320696+0000","last_change":"2024-04-24T13:30:25.229114+0000","last_active":"2024-04-24T13:30:32.320696+0000","last_peered":"2024-04-24T13:30:32.320696+0000","last_clean":"2024-04-24T13:30:32.320696+0000","last_became_active":"2024-04-24T13:30:25.228634+0000","last_became_peered":"2024-04-24T13:30:25.228634+0000","last_unstale":"2024-04-24T13:30:32.320696+0000","last_undegraded":"2024-04-24T13:30:32.320696+0000","last_fullsized":"2024-04-24T13:30:32.320696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:13.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.166369+0000","last_change":"2024-04-24T13:30:27.255646+0000","last_active":"2024-04-24T13:30:33.166369+0000","last_peered":"2024-04-24T13:30:33.166369+0000","last_clean":"2024-04-24T13:30:33.166369+0000","last_became_active":"2024-04-24T13:30:27.254389+0000","last_became_peered":"2024-04-24T13:30:27.254389+0000","last_unstale":"2024-04-24T13:30:33.166369+0000","last_undegraded":"2024-04-24T13:30:33.166369+0000","last_fullsized":"2024-04-24T13:30:33.166369+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272651+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:30:32.272651+0000","last_peered":"2024-04-24T13:30:32.272651+0000","last_clean":"2024-04-24T13:30:32.272651+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:30:32.272651+0000","last_undegraded":"2024-04-24T13:30:32.272651+0000","last_fullsized":"2024-04-24T13:30:32.272651+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281803+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:30:32.281803+0000","last_peered":"2024-04-24T13:30:32.281803+0000","last_clean":"2024-04-24T13:30:32.281803+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:30:32.281803+0000","last_undegraded":"2024-04-24T13:30:32.281803+0000","last_fullsized":"2024-04-24T13:30:32.281803+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259241+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:30:32.259241+0000","last_peered":"2024-04-24T13:30:32.259241+0000","last_clean":"2024-04-24T13:30:32.259241+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:30:32.259241+0000","last_undegraded":"2024-04-24T13:30:32.259241+0000","last_fullsized":"2024-04-24T13:30:32.259241+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262401+0000","last_change":"2024-04-24T13:30:15.151799+0000","last_active":"2024-04-24T13:30:32.262401+0000","last_peered":"2024-04-24T13:30:32.262401+0000","last_clean":"2024-04-24T13:30:32.262401+0000","last_became_active":"2024-04-24T13:30:15.150672+0000","last_became_peered":"2024-04-24T13:30:15.150672+0000","last_unstale":"2024-04-24T13:30:32.262401+0000","last_undegraded":"2024-04-24T13:30:32.262401+0000","last_fullsized":"2024-04-24T13:30:32.262401+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307877+0000","last_change":"2024-04-24T13:30:21.222734+0000","last_active":"2024-04-24T13:30:32.307877+0000","last_peered":"2024-04-24T13:30:32.307877+0000","last_clean":"2024-04-24T13:30:32.307877+0000","last_became_active":"2024-04-24T13:30:21.220992+0000","last_became_peered":"2024-04-24T13:30:21.220992+0000","last_unstale":"2024-04-24T13:30:32.307877+0000","last_undegraded":"2024-04-24T13:30:32.307877+0000","last_fullsized":"2024-04-24T13:30:32.307877+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:05.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272010+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:30:32.272010+0000","last_peered":"2024-04-24T13:30:32.272010+0000","last_clean":"2024-04-24T13:30:32.272010+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:30:32.272010+0000","last_undegraded":"2024-04-24T13:30:32.272010+0000","last_fullsized":"2024-04-24T13:30:32.272010+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.003355+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:30:33.003355+0000","last_peered":"2024-04-24T13:30:33.003355+0000","last_clean":"2024-04-24T13:30:33.003355+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:30:33.003355+0000","last_undegraded":"2024-04-24T13:30:33.003355+0000","last_fullsized":"2024-04-24T13:30:33.003355+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300256+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:30:32.300256+0000","last_peered":"2024-04-24T13:30:32.300256+0000","last_clean":"2024-04-24T13:30:32.300256+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:30:32.300256+0000","last_undegraded":"2024-04-24T13:30:32.300256+0000","last_fullsized":"2024-04-24T13:30:32.300256+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260854+0000","last_change":"2024-04-24T13:30:31.267157+0000","last_active":"2024-04-24T13:30:32.260854+0000","last_peered":"2024-04-24T13:30:32.260854+0000","last_clean":"2024-04-24T13:30:32.260854+0000","last_became_active":"2024-04-24T13:30:31.266348+0000","last_became_peered":"2024-04-24T13:30:31.266348+0000","last_unstale":"2024-04-24T13:30:32.260854+0000","last_undegraded":"2024-04-24T13:30:32.260854+0000","last_fullsized":"2024-04-24T13:30:32.260854+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:31.837696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258886+0000","last_change":"2024-04-24T13:30:23.218086+0000","last_active":"2024-04-24T13:30:32.258886+0000","last_peered":"2024-04-24T13:30:32.258886+0000","last_clean":"2024-04-24T13:30:32.258886+0000","last_became_active":"2024-04-24T13:30:23.217750+0000","last_became_peered":"2024-04-24T13:30:23.217750+0000","last_unstale":"2024-04-24T13:30:32.258886+0000","last_undegraded":"2024-04-24T13:30:32.258886+0000","last_fullsized":"2024-04-24T13:30:32.258886+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263372+0000","last_change":"2024-04-24T13:30:21.214846+0000","last_active":"2024-04-24T13:30:32.263372+0000","last_peered":"2024-04-24T13:30:32.263372+0000","last_clean":"2024-04-24T13:30:32.263372+0000","last_became_active":"2024-04-24T13:30:21.214127+0000","last_became_peered":"2024-04-24T13:30:21.214127+0000","last_unstale":"2024-04-24T13:30:32.263372+0000","last_undegraded":"2024-04-24T13:30:32.263372+0000","last_fullsized":"2024-04-24T13:30:32.263372+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:02.477283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259647+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:30:32.259647+0000","last_peered":"2024-04-24T13:30:32.259647+0000","last_clean":"2024-04-24T13:30:32.259647+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:30:32.259647+0000","last_undegraded":"2024-04-24T13:30:32.259647+0000","last_fullsized":"2024-04-24T13:30:32.259647+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271915+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:30:32.271915+0000","last_peered":"2024-04-24T13:30:32.271915+0000","last_clean":"2024-04-24T13:30:32.271915+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:30:32.271915+0000","last_undegraded":"2024-04-24T13:30:32.271915+0000","last_fullsized":"2024-04-24T13:30:32.271915+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":52,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.093678+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:30:33.093678+0000","last_peered":"2024-04-24T13:30:33.093678+0000","last_clean":"2024-04-24T13:30:33.093678+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:30:33.093678+0000","last_undegraded":"2024-04-24T13:30:33.093678+0000","last_fullsized":"2024-04-24T13:30:33.093678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306278+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:30:32.306278+0000","last_peered":"2024-04-24T13:30:32.306278+0000","last_clean":"2024-04-24T13:30:32.306278+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:30:32.306278+0000","last_undegraded":"2024-04-24T13:30:32.306278+0000","last_fullsized":"2024-04-24T13:30:32.306278+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273165+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:30:32.273165+0000","last_peered":"2024-04-24T13:30:32.273165+0000","last_clean":"2024-04-24T13:30:32.273165+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:30:32.273165+0000","last_undegraded":"2024-04-24T13:30:32.273165+0000","last_fullsized":"2024-04-24T13:30:32.273165+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272820+0000","last_change":"2024-04-24T13:30:23.220277+0000","last_active":"2024-04-24T13:30:32.272820+0000","last_peered":"2024-04-24T13:30:32.272820+0000","last_clean":"2024-04-24T13:30:32.272820+0000","last_became_active":"2024-04-24T13:30:23.219932+0000","last_became_peered":"2024-04-24T13:30:23.219932+0000","last_unstale":"2024-04-24T13:30:32.272820+0000","last_undegraded":"2024-04-24T13:30:32.272820+0000","last_fullsized":"2024-04-24T13:30:32.272820+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259352+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:30:32.259352+0000","last_peered":"2024-04-24T13:30:32.259352+0000","last_clean":"2024-04-24T13:30:32.259352+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:30:32.259352+0000","last_undegraded":"2024-04-24T13:30:32.259352+0000","last_fullsized":"2024-04-24T13:30:32.259352+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.293005+0000","last_change":"2024-04-24T13:30:16.059514+0000","last_active":"2024-04-24T13:30:32.293005+0000","last_peered":"2024-04-24T13:30:32.293005+0000","last_clean":"2024-04-24T13:30:32.293005+0000","last_became_active":"2024-04-24T13:30:16.058864+0000","last_became_peered":"2024-04-24T13:30:16.058864+0000","last_unstale":"2024-04-24T13:30:32.293005+0000","last_undegraded":"2024-04-24T13:30:32.293005+0000","last_fullsized":"2024-04-24T13:30:32.293005+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:43.235155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298716+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:30:32.298716+0000","last_peered":"2024-04-24T13:30:32.298716+0000","last_clean":"2024-04-24T13:30:32.298716+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:30:32.298716+0000","last_undegraded":"2024-04-24T13:30:32.298716+0000","last_fullsized":"2024-04-24T13:30:32.298716+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":41,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.191163+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:30:33.191163+0000","last_peered":"2024-04-24T13:30:33.191163+0000","last_clean":"2024-04-24T13:30:33.191163+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:30:33.191163+0000","last_undegraded":"2024-04-24T13:30:33.191163+0000","last_fullsized":"2024-04-24T13:30:33.191163+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.566608+0000","last_change":"2024-04-24T13:30:29.257969+0000","last_active":"2024-04-24T13:30:32.566608+0000","last_peered":"2024-04-24T13:30:32.566608+0000","last_clean":"2024-04-24T13:30:32.566608+0000","last_became_active":"2024-04-24T13:30:29.257131+0000","last_became_peered":"2024-04-24T13:30:29.257131+0000","last_unstale":"2024-04-24T13:30:32.566608+0000","last_undegraded":"2024-04-24T13:30:32.566608+0000","last_fullsized":"2024-04-24T13:30:32.566608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282762+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:30:32.282762+0000","last_peered":"2024-04-24T13:30:32.282762+0000","last_clean":"2024-04-24T13:30:32.282762+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:30:32.282762+0000","last_undegraded":"2024-04-24T13:30:32.282762+0000","last_fullsized":"2024-04-24T13:30:32.282762+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280888+0000","last_change":"2024-04-24T13:30:23.249852+0000","last_active":"2024-04-24T13:30:32.280888+0000","last_peered":"2024-04-24T13:30:32.280888+0000","last_clean":"2024-04-24T13:30:32.280888+0000","last_became_active":"2024-04-24T13:30:23.249522+0000","last_became_peered":"2024-04-24T13:30:23.249522+0000","last_unstale":"2024-04-24T13:30:32.280888+0000","last_undegraded":"2024-04-24T13:30:32.280888+0000","last_fullsized":"2024-04-24T13:30:32.280888+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282159+0000","last_change":"2024-04-24T13:30:21.238933+0000","last_active":"2024-04-24T13:30:32.282159+0000","last_peered":"2024-04-24T13:30:32.282159+0000","last_clean":"2024-04-24T13:30:32.282159+0000","last_became_active":"2024-04-24T13:30:21.238648+0000","last_became_peered":"2024-04-24T13:30:21.238648+0000","last_unstale":"2024-04-24T13:30:32.282159+0000","last_undegraded":"2024-04-24T13:30:32.282159+0000","last_fullsized":"2024-04-24T13:30:32.282159+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260147+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:30:32.260147+0000","last_peered":"2024-04-24T13:30:32.260147+0000","last_clean":"2024-04-24T13:30:32.260147+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:30:32.260147+0000","last_undegraded":"2024-04-24T13:30:32.260147+0000","last_fullsized":"2024-04-24T13:30:32.260147+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306417+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:30:32.306417+0000","last_peered":"2024-04-24T13:30:32.306417+0000","last_clean":"2024-04-24T13:30:32.306417+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:30:32.306417+0000","last_undegraded":"2024-04-24T13:30:32.306417+0000","last_fullsized":"2024-04-24T13:30:32.306417+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.149071+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:30:33.149071+0000","last_peered":"2024-04-24T13:30:33.149071+0000","last_clean":"2024-04-24T13:30:33.149071+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:30:33.149071+0000","last_undegraded":"2024-04-24T13:30:33.149071+0000","last_fullsized":"2024-04-24T13:30:33.149071+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.563937+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:30:32.563937+0000","last_peered":"2024-04-24T13:30:32.563937+0000","last_clean":"2024-04-24T13:30:32.563937+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:30:32.563937+0000","last_undegraded":"2024-04-24T13:30:32.563937+0000","last_fullsized":"2024-04-24T13:30:32.563937+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272258+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:30:32.272258+0000","last_peered":"2024-04-24T13:30:32.272258+0000","last_clean":"2024-04-24T13:30:32.272258+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:30:32.272258+0000","last_undegraded":"2024-04-24T13:30:32.272258+0000","last_fullsized":"2024-04-24T13:30:32.272258+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306672+0000","last_change":"2024-04-24T13:30:23.219012+0000","last_active":"2024-04-24T13:30:32.306672+0000","last_peered":"2024-04-24T13:30:32.306672+0000","last_clean":"2024-04-24T13:30:32.306672+0000","last_became_active":"2024-04-24T13:30:23.218312+0000","last_became_peered":"2024-04-24T13:30:23.218312+0000","last_unstale":"2024-04-24T13:30:32.306672+0000","last_undegraded":"2024-04-24T13:30:32.306672+0000","last_fullsized":"2024-04-24T13:30:32.306672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.274470+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:30:32.274470+0000","last_peered":"2024-04-24T13:30:32.274470+0000","last_clean":"2024-04-24T13:30:32.274470+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:30:32.274470+0000","last_undegraded":"2024-04-24T13:30:32.274470+0000","last_fullsized":"2024-04-24T13:30:32.274470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":38,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300687+0000","last_change":"2024-04-24T13:30:15.161378+0000","last_active":"2024-04-24T13:30:32.300687+0000","last_peered":"2024-04-24T13:30:32.300687+0000","last_clean":"2024-04-24T13:30:32.300687+0000","last_became_active":"2024-04-24T13:30:15.160775+0000","last_became_peered":"2024-04-24T13:30:15.160775+0000","last_unstale":"2024-04-24T13:30:32.300687+0000","last_undegraded":"2024-04-24T13:30:32.300687+0000","last_fullsized":"2024-04-24T13:30:32.300687+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280159+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:30:32.280159+0000","last_peered":"2024-04-24T13:30:32.280159+0000","last_clean":"2024-04-24T13:30:32.280159+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:30:32.280159+0000","last_undegraded":"2024-04-24T13:30:32.280159+0000","last_fullsized":"2024-04-24T13:30:32.280159+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":56,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.128340+0000","last_change":"2024-04-24T13:30:27.251349+0000","last_active":"2024-04-24T13:30:33.128340+0000","last_peered":"2024-04-24T13:30:33.128340+0000","last_clean":"2024-04-24T13:30:33.128340+0000","last_became_active":"2024-04-24T13:30:27.250525+0000","last_became_peered":"2024-04-24T13:30:27.250525+0000","last_unstale":"2024-04-24T13:30:33.128340+0000","last_undegraded":"2024-04-24T13:30:33.128340+0000","last_fullsized":"2024-04-24T13:30:33.128340+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280372+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:30:32.280372+0000","last_peered":"2024-04-24T13:30:32.280372+0000","last_clean":"2024-04-24T13:30:32.280372+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:30:32.280372+0000","last_undegraded":"2024-04-24T13:30:32.280372+0000","last_fullsized":"2024-04-24T13:30:32.280372+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262641+0000","last_change":"2024-04-24T13:30:31.277358+0000","last_active":"2024-04-24T13:30:32.262641+0000","last_peered":"2024-04-24T13:30:32.262641+0000","last_clean":"2024-04-24T13:30:32.262641+0000","last_became_active":"2024-04-24T13:30:31.276606+0000","last_became_peered":"2024-04-24T13:30:31.276606+0000","last_unstale":"2024-04-24T13:30:32.262641+0000","last_undegraded":"2024-04-24T13:30:32.262641+0000","last_fullsized":"2024-04-24T13:30:32.262641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273103+0000","last_change":"2024-04-24T13:30:31.264343+0000","last_active":"2024-04-24T13:30:32.273103+0000","last_peered":"2024-04-24T13:30:32.273103+0000","last_clean":"2024-04-24T13:30:32.273103+0000","last_became_active":"2024-04-24T13:30:31.263640+0000","last_became_peered":"2024-04-24T13:30:31.263640+0000","last_unstale":"2024-04-24T13:30:32.273103+0000","last_undegraded":"2024-04-24T13:30:32.273103+0000","last_fullsized":"2024-04-24T13:30:32.273103+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:51:45.241537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307110+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:30:32.307110+0000","last_peered":"2024-04-24T13:30:32.307110+0000","last_clean":"2024-04-24T13:30:32.307110+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:30:32.307110+0000","last_undegraded":"2024-04-24T13:30:32.307110+0000","last_fullsized":"2024-04-24T13:30:32.307110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307585+0000","last_change":"2024-04-24T13:30:21.252985+0000","last_active":"2024-04-24T13:30:32.307585+0000","last_peered":"2024-04-24T13:30:32.307585+0000","last_clean":"2024-04-24T13:30:32.307585+0000","last_became_active":"2024-04-24T13:30:21.252417+0000","last_became_peered":"2024-04-24T13:30:21.252417+0000","last_unstale":"2024-04-24T13:30:32.307585+0000","last_undegraded":"2024-04-24T13:30:32.307585+0000","last_fullsized":"2024-04-24T13:30:32.307585+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259306+0000","last_change":"2024-04-24T13:30:25.228158+0000","last_active":"2024-04-24T13:30:32.259306+0000","last_peered":"2024-04-24T13:30:32.259306+0000","last_clean":"2024-04-24T13:30:32.259306+0000","last_became_active":"2024-04-24T13:30:25.226828+0000","last_became_peered":"2024-04-24T13:30:25.226828+0000","last_unstale":"2024-04-24T13:30:32.259306+0000","last_undegraded":"2024-04-24T13:30:32.259306+0000","last_fullsized":"2024-04-24T13:30:32.259306+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:11.608677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.198152+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:30:33.198152+0000","last_peered":"2024-04-24T13:30:33.198152+0000","last_clean":"2024-04-24T13:30:33.198152+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:30:33.198152+0000","last_undegraded":"2024-04-24T13:30:33.198152+0000","last_fullsized":"2024-04-24T13:30:33.198152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280148+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:30:32.280148+0000","last_peered":"2024-04-24T13:30:32.280148+0000","last_clean":"2024-04-24T13:30:32.280148+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:30:32.280148+0000","last_undegraded":"2024-04-24T13:30:32.280148+0000","last_fullsized":"2024-04-24T13:30:32.280148+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281953+0000","last_change":"2024-04-24T13:30:31.265871+0000","last_active":"2024-04-24T13:30:32.281953+0000","last_peered":"2024-04-24T13:30:32.281953+0000","last_clean":"2024-04-24T13:30:32.281953+0000","last_became_active":"2024-04-24T13:30:31.265184+0000","last_became_peered":"2024-04-24T13:30:31.265184+0000","last_unstale":"2024-04-24T13:30:32.281953+0000","last_undegraded":"2024-04-24T13:30:32.281953+0000","last_fullsized":"2024-04-24T13:30:32.281953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:22.937959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258883+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:30:32.258883+0000","last_peered":"2024-04-24T13:30:32.258883+0000","last_clean":"2024-04-24T13:30:32.258883+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:30:32.258883+0000","last_undegraded":"2024-04-24T13:30:32.258883+0000","last_fullsized":"2024-04-24T13:30:32.258883+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292573+0000","last_change":"2024-04-24T13:30:21.247573+0000","last_active":"2024-04-24T13:30:32.292573+0000","last_peered":"2024-04-24T13:30:32.292573+0000","last_clean":"2024-04-24T13:30:32.292573+0000","last_became_active":"2024-04-24T13:30:21.246433+0000","last_became_peered":"2024-04-24T13:30:21.246433+0000","last_unstale":"2024-04-24T13:30:32.292573+0000","last_undegraded":"2024-04-24T13:30:32.292573+0000","last_fullsized":"2024-04-24T13:30:32.292573+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281348+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:30:32.281348+0000","last_peered":"2024-04-24T13:30:32.281348+0000","last_clean":"2024-04-24T13:30:32.281348+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:30:32.281348+0000","last_undegraded":"2024-04-24T13:30:32.281348+0000","last_fullsized":"2024-04-24T13:30:32.281348+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'4","reported_seq":26,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.663018+0000","last_change":"2024-04-24T13:30:27.260167+0000","last_active":"2024-04-24T13:30:32.663018+0000","last_peered":"2024-04-24T13:30:32.663018+0000","last_clean":"2024-04-24T13:30:32.663018+0000","last_became_active":"2024-04-24T13:30:27.259644+0000","last_became_peered":"2024-04-24T13:30:27.259644+0000","last_unstale":"2024-04-24T13:30:32.663018+0000","last_undegraded":"2024-04-24T13:30:32.663018+0000","last_fullsized":"2024-04-24T13:30:32.663018+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:21.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290484+0000","last_change":"2024-04-24T13:30:29.273787+0000","last_active":"2024-04-24T13:30:32.290484+0000","last_peered":"2024-04-24T13:30:32.290484+0000","last_clean":"2024-04-24T13:30:32.290484+0000","last_became_active":"2024-04-24T13:30:29.273151+0000","last_became_peered":"2024-04-24T13:30:29.273151+0000","last_unstale":"2024-04-24T13:30:32.290484+0000","last_undegraded":"2024-04-24T13:30:32.290484+0000","last_fullsized":"2024-04-24T13:30:32.290484+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:23.009033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272185+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:30:32.272185+0000","last_peered":"2024-04-24T13:30:32.272185+0000","last_clean":"2024-04-24T13:30:32.272185+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:30:32.272185+0000","last_undegraded":"2024-04-24T13:30:32.272185+0000","last_fullsized":"2024-04-24T13:30:32.272185+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280527+0000","last_change":"2024-04-24T13:30:23.246371+0000","last_active":"2024-04-24T13:30:32.280527+0000","last_peered":"2024-04-24T13:30:32.280527+0000","last_clean":"2024-04-24T13:30:32.280527+0000","last_became_active":"2024-04-24T13:30:23.246084+0000","last_became_peered":"2024-04-24T13:30:23.246084+0000","last_unstale":"2024-04-24T13:30:32.280527+0000","last_undegraded":"2024-04-24T13:30:32.280527+0000","last_fullsized":"2024-04-24T13:30:32.280527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263425+0000","last_change":"2024-04-24T13:30:21.241794+0000","last_active":"2024-04-24T13:30:32.263425+0000","last_peered":"2024-04-24T13:30:32.263425+0000","last_clean":"2024-04-24T13:30:32.263425+0000","last_became_active":"2024-04-24T13:30:21.241043+0000","last_became_peered":"2024-04-24T13:30:21.241043+0000","last_unstale":"2024-04-24T13:30:32.263425+0000","last_undegraded":"2024-04-24T13:30:32.263425+0000","last_fullsized":"2024-04-24T13:30:32.263425+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:21.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.289650+0000","last_change":"2024-04-24T13:30:25.239146+0000","last_active":"2024-04-24T13:30:32.289650+0000","last_peered":"2024-04-24T13:30:32.289650+0000","last_clean":"2024-04-24T13:30:32.289650+0000","last_became_active":"2024-04-24T13:30:25.238359+0000","last_became_peered":"2024-04-24T13:30:25.238359+0000","last_unstale":"2024-04-24T13:30:32.289650+0000","last_undegraded":"2024-04-24T13:30:32.289650+0000","last_fullsized":"2024-04-24T13:30:32.289650+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.107209+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:30:33.107209+0000","last_peered":"2024-04-24T13:30:33.107209+0000","last_clean":"2024-04-24T13:30:33.107209+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:30:33.107209+0000","last_undegraded":"2024-04-24T13:30:33.107209+0000","last_fullsized":"2024-04-24T13:30:33.107209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298644+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:30:32.298644+0000","last_peered":"2024-04-24T13:30:32.298644+0000","last_clean":"2024-04-24T13:30:32.298644+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:30:32.298644+0000","last_undegraded":"2024-04-24T13:30:32.298644+0000","last_fullsized":"2024-04-24T13:30:32.298644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261378+0000","last_change":"2024-04-24T13:30:31.276150+0000","last_active":"2024-04-24T13:30:32.261378+0000","last_peered":"2024-04-24T13:30:32.261378+0000","last_clean":"2024-04-24T13:30:32.261378+0000","last_became_active":"2024-04-24T13:30:31.275437+0000","last_became_peered":"2024-04-24T13:30:31.275437+0000","last_unstale":"2024-04-24T13:30:32.261378+0000","last_undegraded":"2024-04-24T13:30:32.261378+0000","last_fullsized":"2024-04-24T13:30:32.261378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280391+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:30:32.280391+0000","last_peered":"2024-04-24T13:30:32.280391+0000","last_clean":"2024-04-24T13:30:32.280391+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:30:32.280391+0000","last_undegraded":"2024-04-24T13:30:32.280391+0000","last_fullsized":"2024-04-24T13:30:32.280391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273816+0000","last_change":"2024-04-24T13:30:21.229237+0000","last_active":"2024-04-24T13:30:32.273816+0000","last_peered":"2024-04-24T13:30:32.273816+0000","last_clean":"2024-04-24T13:30:32.273816+0000","last_became_active":"2024-04-24T13:30:21.228971+0000","last_became_peered":"2024-04-24T13:30:21.228971+0000","last_unstale":"2024-04-24T13:30:32.273816+0000","last_undegraded":"2024-04-24T13:30:32.273816+0000","last_fullsized":"2024-04-24T13:30:32.273816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298822+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:30:32.298822+0000","last_peered":"2024-04-24T13:30:32.298822+0000","last_clean":"2024-04-24T13:30:32.298822+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:30:32.298822+0000","last_undegraded":"2024-04-24T13:30:32.298822+0000","last_fullsized":"2024-04-24T13:30:32.298822+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.886658+0000","last_change":"2024-04-24T13:30:27.244776+0000","last_active":"2024-04-24T13:30:32.886658+0000","last_peered":"2024-04-24T13:30:32.886658+0000","last_clean":"2024-04-24T13:30:32.886658+0000","last_became_active":"2024-04-24T13:30:27.243967+0000","last_became_peered":"2024-04-24T13:30:27.243967+0000","last_unstale":"2024-04-24T13:30:32.886658+0000","last_undegraded":"2024-04-24T13:30:32.886658+0000","last_fullsized":"2024-04-24T13:30:32.886658+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:20.682651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271502+0000","last_change":"2024-04-24T13:30:29.279248+0000","last_active":"2024-04-24T13:30:32.271502+0000","last_peered":"2024-04-24T13:30:32.271502+0000","last_clean":"2024-04-24T13:30:32.271502+0000","last_became_active":"2024-04-24T13:30:29.278511+0000","last_became_peered":"2024-04-24T13:30:29.278511+0000","last_unstale":"2024-04-24T13:30:32.271502+0000","last_undegraded":"2024-04-24T13:30:32.271502+0000","last_fullsized":"2024-04-24T13:30:32.271502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300515+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:30:32.300515+0000","last_peered":"2024-04-24T13:30:32.300515+0000","last_clean":"2024-04-24T13:30:32.300515+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:30:32.300515+0000","last_undegraded":"2024-04-24T13:30:32.300515+0000","last_fullsized":"2024-04-24T13:30:32.300515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280622+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:30:32.280622+0000","last_peered":"2024-04-24T13:30:32.280622+0000","last_clean":"2024-04-24T13:30:32.280622+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:30:32.280622+0000","last_undegraded":"2024-04-24T13:30:32.280622+0000","last_fullsized":"2024-04-24T13:30:32.280622+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273977+0000","last_change":"2024-04-24T13:30:25.242437+0000","last_active":"2024-04-24T13:30:32.273977+0000","last_peered":"2024-04-24T13:30:32.273977+0000","last_clean":"2024-04-24T13:30:32.273977+0000","last_became_active":"2024-04-24T13:30:25.241948+0000","last_became_peered":"2024-04-24T13:30:25.241948+0000","last_unstale":"2024-04-24T13:30:32.273977+0000","last_undegraded":"2024-04-24T13:30:32.273977+0000","last_fullsized":"2024-04-24T13:30:32.273977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:57.978574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":43,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.224414+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:30:33.224414+0000","last_peered":"2024-04-24T13:30:33.224414+0000","last_clean":"2024-04-24T13:30:33.224414+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:30:33.224414+0000","last_undegraded":"2024-04-24T13:30:33.224414+0000","last_fullsized":"2024-04-24T13:30:33.224414+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261702+0000","last_change":"2024-04-24T13:30:29.277963+0000","last_active":"2024-04-24T13:30:32.261702+0000","last_peered":"2024-04-24T13:30:32.261702+0000","last_clean":"2024-04-24T13:30:32.261702+0000","last_became_active":"2024-04-24T13:30:29.277170+0000","last_became_peered":"2024-04-24T13:30:29.277170+0000","last_unstale":"2024-04-24T13:30:32.261702+0000","last_undegraded":"2024-04-24T13:30:32.261702+0000","last_fullsized":"2024-04-24T13:30:32.261702+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280740+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:30:32.280740+0000","last_peered":"2024-04-24T13:30:32.280740+0000","last_clean":"2024-04-24T13:30:32.280740+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:30:32.280740+0000","last_undegraded":"2024-04-24T13:30:32.280740+0000","last_fullsized":"2024-04-24T13:30:32.280740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.274038+0000","last_change":"2024-04-24T13:30:23.235742+0000","last_active":"2024-04-24T13:30:32.274038+0000","last_peered":"2024-04-24T13:30:32.274038+0000","last_clean":"2024-04-24T13:30:32.274038+0000","last_became_active":"2024-04-24T13:30:23.235385+0000","last_became_peered":"2024-04-24T13:30:23.235385+0000","last_unstale":"2024-04-24T13:30:32.274038+0000","last_undegraded":"2024-04-24T13:30:32.274038+0000","last_fullsized":"2024-04-24T13:30:32.274038+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258960+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:30:32.258960+0000","last_peered":"2024-04-24T13:30:32.258960+0000","last_clean":"2024-04-24T13:30:32.258960+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:30:32.258960+0000","last_undegraded":"2024-04-24T13:30:32.258960+0000","last_fullsized":"2024-04-24T13:30:32.258960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300332+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:30:32.300332+0000","last_peered":"2024-04-24T13:30:32.300332+0000","last_clean":"2024-04-24T13:30:32.300332+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:30:32.300332+0000","last_undegraded":"2024-04-24T13:30:32.300332+0000","last_fullsized":"2024-04-24T13:30:32.300332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.011345+0000","last_change":"2024-04-24T13:30:27.262590+0000","last_active":"2024-04-24T13:30:33.011345+0000","last_peered":"2024-04-24T13:30:33.011345+0000","last_clean":"2024-04-24T13:30:33.011345+0000","last_became_active":"2024-04-24T13:30:27.261920+0000","last_became_peered":"2024-04-24T13:30:27.261920+0000","last_unstale":"2024-04-24T13:30:33.011345+0000","last_undegraded":"2024-04-24T13:30:33.011345+0000","last_fullsized":"2024-04-24T13:30:33.011345+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:21.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259289+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:30:32.259289+0000","last_peered":"2024-04-24T13:30:32.259289+0000","last_clean":"2024-04-24T13:30:32.259289+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:30:32.259289+0000","last_undegraded":"2024-04-24T13:30:32.259289+0000","last_fullsized":"2024-04-24T13:30:32.259289+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298641+0000","last_change":"2024-04-24T13:30:31.284027+0000","last_active":"2024-04-24T13:30:32.298641+0000","last_peered":"2024-04-24T13:30:32.298641+0000","last_clean":"2024-04-24T13:30:32.298641+0000","last_became_active":"2024-04-24T13:30:31.283348+0000","last_became_peered":"2024-04-24T13:30:31.283348+0000","last_unstale":"2024-04-24T13:30:32.298641+0000","last_undegraded":"2024-04-24T13:30:32.298641+0000","last_fullsized":"2024-04-24T13:30:32.298641+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:42.409692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281501+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:30:32.281501+0000","last_peered":"2024-04-24T13:30:32.281501+0000","last_clean":"2024-04-24T13:30:32.281501+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:30:32.281501+0000","last_undegraded":"2024-04-24T13:30:32.281501+0000","last_fullsized":"2024-04-24T13:30:32.281501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307732+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:30:32.307732+0000","last_peered":"2024-04-24T13:30:32.307732+0000","last_clean":"2024-04-24T13:30:32.307732+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:30:32.307732+0000","last_undegraded":"2024-04-24T13:30:32.307732+0000","last_fullsized":"2024-04-24T13:30:32.307732+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308552+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:30:32.308552+0000","last_peered":"2024-04-24T13:30:32.308552+0000","last_clean":"2024-04-24T13:30:32.308552+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:30:32.308552+0000","last_undegraded":"2024-04-24T13:30:32.308552+0000","last_fullsized":"2024-04-24T13:30:32.308552+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":39,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.204282+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:30:33.204282+0000","last_peered":"2024-04-24T13:30:33.204282+0000","last_clean":"2024-04-24T13:30:33.204282+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:30:33.204282+0000","last_undegraded":"2024-04-24T13:30:33.204282+0000","last_fullsized":"2024-04-24T13:30:33.204282+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259459+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:30:32.259459+0000","last_peered":"2024-04-24T13:30:32.259459+0000","last_clean":"2024-04-24T13:30:32.259459+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:30:32.259459+0000","last_undegraded":"2024-04-24T13:30:32.259459+0000","last_fullsized":"2024-04-24T13:30:32.259459+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261174+0000","last_change":"2024-04-24T13:30:31.277531+0000","last_active":"2024-04-24T13:30:32.261174+0000","last_peered":"2024-04-24T13:30:32.261174+0000","last_clean":"2024-04-24T13:30:32.261174+0000","last_became_active":"2024-04-24T13:30:31.275550+0000","last_became_peered":"2024-04-24T13:30:31.275550+0000","last_unstale":"2024-04-24T13:30:32.261174+0000","last_undegraded":"2024-04-24T13:30:32.261174+0000","last_fullsized":"2024-04-24T13:30:32.261174+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.321417+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:30:32.321417+0000","last_peered":"2024-04-24T13:30:32.321417+0000","last_clean":"2024-04-24T13:30:32.321417+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:30:32.321417+0000","last_undegraded":"2024-04-24T13:30:32.321417+0000","last_fullsized":"2024-04-24T13:30:32.321417+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271537+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:30:32.271537+0000","last_peered":"2024-04-24T13:30:32.271537+0000","last_clean":"2024-04-24T13:30:32.271537+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:30:32.271537+0000","last_undegraded":"2024-04-24T13:30:32.271537+0000","last_fullsized":"2024-04-24T13:30:32.271537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260238+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:30:32.260238+0000","last_peered":"2024-04-24T13:30:32.260238+0000","last_clean":"2024-04-24T13:30:32.260238+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:30:32.260238+0000","last_undegraded":"2024-04-24T13:30:32.260238+0000","last_fullsized":"2024-04-24T13:30:32.260238+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":35,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.185232+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:30:33.185232+0000","last_peered":"2024-04-24T13:30:33.185232+0000","last_clean":"2024-04-24T13:30:33.185232+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:30:33.185232+0000","last_undegraded":"2024-04-24T13:30:33.185232+0000","last_fullsized":"2024-04-24T13:30:33.185232+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":20,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.564056+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:30:32.564056+0000","last_peered":"2024-04-24T13:30:32.564056+0000","last_clean":"2024-04-24T13:30:32.564056+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:30:32.564056+0000","last_undegraded":"2024-04-24T13:30:32.564056+0000","last_fullsized":"2024-04-24T13:30:32.564056+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.289897+0000","last_change":"2024-04-24T13:30:31.285910+0000","last_active":"2024-04-24T13:30:32.289897+0000","last_peered":"2024-04-24T13:30:32.289897+0000","last_clean":"2024-04-24T13:30:32.289897+0000","last_became_active":"2024-04-24T13:30:31.285205+0000","last_became_peered":"2024-04-24T13:30:31.285205+0000","last_unstale":"2024-04-24T13:30:32.289897+0000","last_undegraded":"2024-04-24T13:30:32.289897+0000","last_fullsized":"2024-04-24T13:30:32.289897+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:48.546868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306799+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:30:32.306799+0000","last_peered":"2024-04-24T13:30:32.306799+0000","last_clean":"2024-04-24T13:30:32.306799+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:30:32.306799+0000","last_undegraded":"2024-04-24T13:30:32.306799+0000","last_fullsized":"2024-04-24T13:30:32.306799+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262193+0000","last_change":"2024-04-24T13:30:21.226147+0000","last_active":"2024-04-24T13:30:32.262193+0000","last_peered":"2024-04-24T13:30:32.262193+0000","last_clean":"2024-04-24T13:30:32.262193+0000","last_became_active":"2024-04-24T13:30:21.225369+0000","last_became_peered":"2024-04-24T13:30:21.225369+0000","last_unstale":"2024-04-24T13:30:32.262193+0000","last_undegraded":"2024-04-24T13:30:32.262193+0000","last_fullsized":"2024-04-24T13:30:32.262193+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:24.585089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290334+0000","last_change":"2024-04-24T13:30:25.239519+0000","last_active":"2024-04-24T13:30:32.290334+0000","last_peered":"2024-04-24T13:30:32.290334+0000","last_clean":"2024-04-24T13:30:32.290334+0000","last_became_active":"2024-04-24T13:30:25.238779+0000","last_became_peered":"2024-04-24T13:30:25.238779+0000","last_unstale":"2024-04-24T13:30:32.290334+0000","last_undegraded":"2024-04-24T13:30:32.290334+0000","last_fullsized":"2024-04-24T13:30:32.290334+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":45,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:33.219297+0000","last_change":"2024-04-24T13:30:27.260827+0000","last_active":"2024-04-24T13:30:33.219297+0000","last_peered":"2024-04-24T13:30:33.219297+0000","last_clean":"2024-04-24T13:30:33.219297+0000","last_became_active":"2024-04-24T13:30:27.260164+0000","last_became_peered":"2024-04-24T13:30:27.260164+0000","last_unstale":"2024-04-24T13:30:33.219297+0000","last_undegraded":"2024-04-24T13:30:33.219297+0000","last_fullsized":"2024-04-24T13:30:33.219297+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.270553+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:30:32.270553+0000","last_peered":"2024-04-24T13:30:32.270553+0000","last_clean":"2024-04-24T13:30:32.270553+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:30:32.270553+0000","last_undegraded":"2024-04-24T13:30:32.270553+0000","last_fullsized":"2024-04-24T13:30:32.270553+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292635+0000","last_change":"2024-04-24T13:30:31.280268+0000","last_active":"2024-04-24T13:30:32.292635+0000","last_peered":"2024-04-24T13:30:32.292635+0000","last_clean":"2024-04-24T13:30:32.292635+0000","last_became_active":"2024-04-24T13:30:31.279721+0000","last_became_peered":"2024-04-24T13:30:31.279721+0000","last_unstale":"2024-04-24T13:30:32.292635+0000","last_undegraded":"2024-04-24T13:30:32.292635+0000","last_fullsized":"2024-04-24T13:30:32.292635+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:31.837696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307462+0000","last_change":"2024-04-24T13:30:23.225100+0000","last_active":"2024-04-24T13:30:32.307462+0000","last_peered":"2024-04-24T13:30:32.307462+0000","last_clean":"2024-04-24T13:30:32.307462+0000","last_became_active":"2024-04-24T13:30:23.224324+0000","last_became_peered":"2024-04-24T13:30:23.224324+0000","last_unstale":"2024-04-24T13:30:32.307462+0000","last_undegraded":"2024-04-24T13:30:32.307462+0000","last_fullsized":"2024-04-24T13:30:32.307462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263199+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:30:32.263199+0000","last_peered":"2024-04-24T13:30:32.263199+0000","last_clean":"2024-04-24T13:30:32.263199+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:30:32.263199+0000","last_undegraded":"2024-04-24T13:30:32.263199+0000","last_fullsized":"2024-04-24T13:30:32.263199+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261843+0000","last_change":"2024-04-24T13:30:25.238830+0000","last_active":"2024-04-24T13:30:32.261843+0000","last_peered":"2024-04-24T13:30:32.261843+0000","last_clean":"2024-04-24T13:30:32.261843+0000","last_became_active":"2024-04-24T13:30:25.237595+0000","last_became_peered":"2024-04-24T13:30:25.237595+0000","last_unstale":"2024-04-24T13:30:32.261843+0000","last_undegraded":"2024-04-24T13:30:32.261843+0000","last_fullsized":"2024-04-24T13:30:32.261843+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.608371+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:30:32.608371+0000","last_peered":"2024-04-24T13:30:32.608371+0000","last_clean":"2024-04-24T13:30:32.608371+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:30:32.608371+0000","last_undegraded":"2024-04-24T13:30:32.608371+0000","last_fullsized":"2024-04-24T13:30:32.608371+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298747+0000","last_change":"2024-04-24T13:30:29.274924+0000","last_active":"2024-04-24T13:30:32.298747+0000","last_peered":"2024-04-24T13:30:32.298747+0000","last_clean":"2024-04-24T13:30:32.298747+0000","last_became_active":"2024-04-24T13:30:29.274044+0000","last_became_peered":"2024-04-24T13:30:29.274044+0000","last_unstale":"2024-04-24T13:30:32.298747+0000","last_undegraded":"2024-04-24T13:30:32.298747+0000","last_fullsized":"2024-04-24T13:30:32.298747+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:43.398878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281944+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:30:32.281944+0000","last_peered":"2024-04-24T13:30:32.281944+0000","last_clean":"2024-04-24T13:30:32.281944+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:30:32.281944+0000","last_undegraded":"2024-04-24T13:30:32.281944+0000","last_fullsized":"2024-04-24T13:30:32.281944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280770+0000","last_change":"2024-04-24T13:30:23.214114+0000","last_active":"2024-04-24T13:30:32.280770+0000","last_peered":"2024-04-24T13:30:32.280770+0000","last_clean":"2024-04-24T13:30:32.280770+0000","last_became_active":"2024-04-24T13:30:23.213489+0000","last_became_peered":"2024-04-24T13:30:23.213489+0000","last_unstale":"2024-04-24T13:30:32.280770+0000","last_undegraded":"2024-04-24T13:30:32.280770+0000","last_fullsized":"2024-04-24T13:30:32.280770+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282450+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:30:32.282450+0000","last_peered":"2024-04-24T13:30:32.282450+0000","last_clean":"2024-04-24T13:30:32.282450+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:30:32.282450+0000","last_undegraded":"2024-04-24T13:30:32.282450+0000","last_fullsized":"2024-04-24T13:30:32.282450+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":24,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.305984+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:30:32.305984+0000","last_peered":"2024-04-24T13:30:32.305984+0000","last_clean":"2024-04-24T13:30:32.305984+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:30:32.305984+0000","last_undegraded":"2024-04-24T13:30:32.305984+0000","last_fullsized":"2024-04-24T13:30:32.305984+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":30,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.836464+0000","last_change":"2024-04-24T13:30:27.253296+0000","last_active":"2024-04-24T13:30:32.836464+0000","last_peered":"2024-04-24T13:30:32.836464+0000","last_clean":"2024-04-24T13:30:32.836464+0000","last_became_active":"2024-04-24T13:30:27.252584+0000","last_became_peered":"2024-04-24T13:30:27.252584+0000","last_unstale":"2024-04-24T13:30:32.836464+0000","last_undegraded":"2024-04-24T13:30:32.836464+0000","last_fullsized":"2024-04-24T13:30:32.836464+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306609+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:30:32.306609+0000","last_peered":"2024-04-24T13:30:32.306609+0000","last_clean":"2024-04-24T13:30:32.306609+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:30:32.306609+0000","last_undegraded":"2024-04-24T13:30:32.306609+0000","last_fullsized":"2024-04-24T13:30:32.306609+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.293279+0000","last_change":"2024-04-24T13:30:31.279466+0000","last_active":"2024-04-24T13:30:32.293279+0000","last_peered":"2024-04-24T13:30:32.293279+0000","last_clean":"2024-04-24T13:30:32.293279+0000","last_became_active":"2024-04-24T13:30:31.278784+0000","last_became_peered":"2024-04-24T13:30:31.278784+0000","last_unstale":"2024-04-24T13:30:32.293279+0000","last_undegraded":"2024-04-24T13:30:32.293279+0000","last_fullsized":"2024-04-24T13:30:32.293279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.306449+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:30:32.306449+0000","last_peered":"2024-04-24T13:30:32.306449+0000","last_clean":"2024-04-24T13:30:32.306449+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:30:32.306449+0000","last_undegraded":"2024-04-24T13:30:32.306449+0000","last_fullsized":"2024-04-24T13:30:32.306449+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273663+0000","last_change":"2024-04-24T13:30:21.229211+0000","last_active":"2024-04-24T13:30:32.273663+0000","last_peered":"2024-04-24T13:30:32.273663+0000","last_clean":"2024-04-24T13:30:32.273663+0000","last_became_active":"2024-04-24T13:30:21.228906+0000","last_became_peered":"2024-04-24T13:30:21.228906+0000","last_unstale":"2024-04-24T13:30:32.273663+0000","last_undegraded":"2024-04-24T13:30:32.273663+0000","last_fullsized":"2024-04-24T13:30:32.273663+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":25,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258045+0000","last_change":"2024-04-24T13:30:25.228645+0000","last_active":"2024-04-24T13:30:32.258045+0000","last_peered":"2024-04-24T13:30:32.258045+0000","last_clean":"2024-04-24T13:30:32.258045+0000","last_became_active":"2024-04-24T13:30:25.227801+0000","last_became_peered":"2024-04-24T13:30:25.227801+0000","last_unstale":"2024-04-24T13:30:32.258045+0000","last_undegraded":"2024-04-24T13:30:32.258045+0000","last_fullsized":"2024-04-24T13:30:32.258045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:16.778257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":36,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.905996+0000","last_change":"2024-04-24T13:30:27.264731+0000","last_active":"2024-04-24T13:30:32.905996+0000","last_peered":"2024-04-24T13:30:32.905996+0000","last_clean":"2024-04-24T13:30:32.905996+0000","last_became_active":"2024-04-24T13:30:27.263888+0000","last_became_peered":"2024-04-24T13:30:27.263888+0000","last_unstale":"2024-04-24T13:30:32.905996+0000","last_undegraded":"2024-04-24T13:30:32.905996+0000","last_fullsized":"2024-04-24T13:30:32.905996+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":16,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271359+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:30:32.271359+0000","last_peered":"2024-04-24T13:30:32.271359+0000","last_clean":"2024-04-24T13:30:32.271359+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:30:32.271359+0000","last_undegraded":"2024-04-24T13:30:32.271359+0000","last_fullsized":"2024-04-24T13:30:32.271359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":12,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307275+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:30:32.307275+0000","last_peered":"2024-04-24T13:30:32.307275+0000","last_clean":"2024-04-24T13:30:32.307275+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:30:32.307275+0000","last_undegraded":"2024-04-24T13:30:32.307275+0000","last_fullsized":"2024-04-24T13:30:32.307275+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260617+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:30:32.260617+0000","last_peered":"2024-04-24T13:30:32.260617+0000","last_clean":"2024-04-24T13:30:32.260617+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:30:32.260617+0000","last_undegraded":"2024-04-24T13:30:32.260617+0000","last_fullsized":"2024-04-24T13:30:32.260617+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298077+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:30:32.298077+0000","last_peered":"2024-04-24T13:30:32.298077+0000","last_clean":"2024-04-24T13:30:32.298077+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:30:32.298077+0000","last_undegraded":"2024-04-24T13:30:32.298077+0000","last_fullsized":"2024-04-24T13:30:32.298077+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259948+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:30:32.259948+0000","last_peered":"2024-04-24T13:30:32.259948+0000","last_clean":"2024-04-24T13:30:32.259948+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:30:32.259948+0000","last_undegraded":"2024-04-24T13:30:32.259948+0000","last_fullsized":"2024-04-24T13:30:32.259948+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.319740+0000","last_change":"2024-04-24T13:30:21.223752+0000","last_active":"2024-04-24T13:30:32.319740+0000","last_peered":"2024-04-24T13:30:32.319740+0000","last_clean":"2024-04-24T13:30:32.319740+0000","last_became_active":"2024-04-24T13:30:21.223457+0000","last_became_peered":"2024-04-24T13:30:21.223457+0000","last_unstale":"2024-04-24T13:30:32.319740+0000","last_undegraded":"2024-04-24T13:30:32.319740+0000","last_fullsized":"2024-04-24T13:30:32.319740+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:49.280399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262757+0000","last_change":"2024-04-24T13:30:23.239053+0000","last_active":"2024-04-24T13:30:32.262757+0000","last_peered":"2024-04-24T13:30:32.262757+0000","last_clean":"2024-04-24T13:30:32.262757+0000","last_became_active":"2024-04-24T13:30:23.238289+0000","last_became_peered":"2024-04-24T13:30:23.238289+0000","last_unstale":"2024-04-24T13:30:32.262757+0000","last_undegraded":"2024-04-24T13:30:32.262757+0000","last_fullsized":"2024-04-24T13:30:32.262757+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262315+0000","last_change":"2024-04-24T13:30:21.224037+0000","last_active":"2024-04-24T13:30:32.262315+0000","last_peered":"2024-04-24T13:30:32.262315+0000","last_clean":"2024-04-24T13:30:32.262315+0000","last_became_active":"2024-04-24T13:30:21.222146+0000","last_became_peered":"2024-04-24T13:30:21.222146+0000","last_unstale":"2024-04-24T13:30:32.262315+0000","last_undegraded":"2024-04-24T13:30:32.262315+0000","last_fullsized":"2024-04-24T13:30:32.262315+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.259546+0000","last_change":"2024-04-24T13:30:23.241090+0000","last_active":"2024-04-24T13:30:32.259546+0000","last_peered":"2024-04-24T13:30:32.259546+0000","last_clean":"2024-04-24T13:30:32.259546+0000","last_became_active":"2024-04-24T13:30:23.240726+0000","last_became_peered":"2024-04-24T13:30:23.240726+0000","last_unstale":"2024-04-24T13:30:32.259546+0000","last_undegraded":"2024-04-24T13:30:32.259546+0000","last_fullsized":"2024-04-24T13:30:32.259546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271825+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:30:32.271825+0000","last_peered":"2024-04-24T13:30:32.271825+0000","last_clean":"2024-04-24T13:30:32.271825+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:30:32.271825+0000","last_undegraded":"2024-04-24T13:30:32.271825+0000","last_fullsized":"2024-04-24T13:30:32.271825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.281943+0000","last_change":"2024-04-24T13:30:23.246330+0000","last_active":"2024-04-24T13:30:32.281943+0000","last_peered":"2024-04-24T13:30:32.281943+0000","last_clean":"2024-04-24T13:30:32.281943+0000","last_became_active":"2024-04-24T13:30:23.246109+0000","last_became_peered":"2024-04-24T13:30:23.246109+0000","last_unstale":"2024-04-24T13:30:32.281943+0000","last_undegraded":"2024-04-24T13:30:32.281943+0000","last_fullsized":"2024-04-24T13:30:32.281943+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282902+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:30:32.282902+0000","last_peered":"2024-04-24T13:30:32.282902+0000","last_clean":"2024-04-24T13:30:32.282902+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:30:32.282902+0000","last_undegraded":"2024-04-24T13:30:32.282902+0000","last_fullsized":"2024-04-24T13:30:32.282902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.307725+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:30:32.307725+0000","last_peered":"2024-04-24T13:30:32.307725+0000","last_clean":"2024-04-24T13:30:32.307725+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:30:32.307725+0000","last_undegraded":"2024-04-24T13:30:32.307725+0000","last_fullsized":"2024-04-24T13:30:32.307725+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.260773+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:30:32.260773+0000","last_peered":"2024-04-24T13:30:32.260773+0000","last_clean":"2024-04-24T13:30:32.260773+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:30:32.260773+0000","last_undegraded":"2024-04-24T13:30:32.260773+0000","last_fullsized":"2024-04-24T13:30:32.260773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280357+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:30:32.280357+0000","last_peered":"2024-04-24T13:30:32.280357+0000","last_clean":"2024-04-24T13:30:32.280357+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:30:32.280357+0000","last_undegraded":"2024-04-24T13:30:32.280357+0000","last_fullsized":"2024-04-24T13:30:32.280357+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.300053+0000","last_change":"2024-04-24T13:30:21.244582+0000","last_active":"2024-04-24T13:30:32.300053+0000","last_peered":"2024-04-24T13:30:32.300053+0000","last_clean":"2024-04-24T13:30:32.300053+0000","last_became_active":"2024-04-24T13:30:21.243856+0000","last_became_peered":"2024-04-24T13:30:21.243856+0000","last_unstale":"2024-04-24T13:30:32.300053+0000","last_undegraded":"2024-04-24T13:30:32.300053+0000","last_fullsized":"2024-04-24T13:30:32.300053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.298059+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:30:32.298059+0000","last_peered":"2024-04-24T13:30:32.298059+0000","last_clean":"2024-04-24T13:30:32.298059+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:30:32.298059+0000","last_undegraded":"2024-04-24T13:30:32.298059+0000","last_fullsized":"2024-04-24T13:30:32.298059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.282569+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:30:32.282569+0000","last_peered":"2024-04-24T13:30:32.282569+0000","last_clean":"2024-04-24T13:30:32.282569+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:30:32.282569+0000","last_undegraded":"2024-04-24T13:30:32.282569+0000","last_fullsized":"2024-04-24T13:30:32.282569+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273529+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:30:32.273529+0000","last_peered":"2024-04-24T13:30:32.273529+0000","last_clean":"2024-04-24T13:30:32.273529+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:30:32.273529+0000","last_undegraded":"2024-04-24T13:30:32.273529+0000","last_fullsized":"2024-04-24T13:30:32.273529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261701+0000","last_change":"2024-04-24T13:30:21.229523+0000","last_active":"2024-04-24T13:30:32.261701+0000","last_peered":"2024-04-24T13:30:32.261701+0000","last_clean":"2024-04-24T13:30:32.261701+0000","last_became_active":"2024-04-24T13:30:21.228400+0000","last_became_peered":"2024-04-24T13:30:21.228400+0000","last_unstale":"2024-04-24T13:30:32.261701+0000","last_undegraded":"2024-04-24T13:30:32.261701+0000","last_fullsized":"2024-04-24T13:30:32.261701+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308937+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:30:32.308937+0000","last_peered":"2024-04-24T13:30:32.308937+0000","last_clean":"2024-04-24T13:30:32.308937+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:30:32.308937+0000","last_undegraded":"2024-04-24T13:30:32.308937+0000","last_fullsized":"2024-04-24T13:30:32.308937+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280818+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:30:32.280818+0000","last_peered":"2024-04-24T13:30:32.280818+0000","last_clean":"2024-04-24T13:30:32.280818+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:30:32.280818+0000","last_undegraded":"2024-04-24T13:30:32.280818+0000","last_fullsized":"2024-04-24T13:30:32.280818+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.320813+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:30:32.320813+0000","last_peered":"2024-04-24T13:30:32.320813+0000","last_clean":"2024-04-24T13:30:32.320813+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:30:32.320813+0000","last_undegraded":"2024-04-24T13:30:32.320813+0000","last_fullsized":"2024-04-24T13:30:32.320813+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.262072+0000","last_change":"2024-04-24T13:30:21.241430+0000","last_active":"2024-04-24T13:30:32.262072+0000","last_peered":"2024-04-24T13:30:32.262072+0000","last_clean":"2024-04-24T13:30:32.262072+0000","last_became_active":"2024-04-24T13:30:21.240593+0000","last_became_peered":"2024-04-24T13:30:21.240593+0000","last_unstale":"2024-04-24T13:30:32.262072+0000","last_undegraded":"2024-04-24T13:30:32.262072+0000","last_fullsized":"2024-04-24T13:30:32.262072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.308377+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:30:32.308377+0000","last_peered":"2024-04-24T13:30:32.308377+0000","last_clean":"2024-04-24T13:30:32.308377+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:30:32.308377+0000","last_undegraded":"2024-04-24T13:30:32.308377+0000","last_fullsized":"2024-04-24T13:30:32.308377+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.272062+0000","last_change":"2024-04-24T13:30:21.238887+0000","last_active":"2024-04-24T13:30:32.272062+0000","last_peered":"2024-04-24T13:30:32.272062+0000","last_clean":"2024-04-24T13:30:32.272062+0000","last_became_active":"2024-04-24T13:30:21.238580+0000","last_became_peered":"2024-04-24T13:30:21.238580+0000","last_unstale":"2024-04-24T13:30:32.272062+0000","last_undegraded":"2024-04-24T13:30:32.272062+0000","last_fullsized":"2024-04-24T13:30:32.272062+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290977+0000","last_change":"2024-04-24T13:30:23.241254+0000","last_active":"2024-04-24T13:30:32.290977+0000","last_peered":"2024-04-24T13:30:32.290977+0000","last_clean":"2024-04-24T13:30:32.290977+0000","last_became_active":"2024-04-24T13:30:23.236897+0000","last_became_peered":"2024-04-24T13:30:23.236897+0000","last_unstale":"2024-04-24T13:30:32.290977+0000","last_undegraded":"2024-04-24T13:30:32.290977+0000","last_fullsized":"2024-04-24T13:30:32.290977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.299872+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:30:32.299872+0000","last_peered":"2024-04-24T13:30:32.299872+0000","last_clean":"2024-04-24T13:30:32.299872+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:30:32.299872+0000","last_undegraded":"2024-04-24T13:30:32.299872+0000","last_fullsized":"2024-04-24T13:30:32.299872+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.271102+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:30:32.271102+0000","last_peered":"2024-04-24T13:30:32.271102+0000","last_clean":"2024-04-24T13:30:32.271102+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:30:32.271102+0000","last_undegraded":"2024-04-24T13:30:32.271102+0000","last_fullsized":"2024-04-24T13:30:32.271102+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.292892+0000","last_change":"2024-04-24T13:30:21.251108+0000","last_active":"2024-04-24T13:30:32.292892+0000","last_peered":"2024-04-24T13:30:32.292892+0000","last_clean":"2024-04-24T13:30:32.292892+0000","last_became_active":"2024-04-24T13:30:21.250436+0000","last_became_peered":"2024-04-24T13:30:21.250436+0000","last_unstale":"2024-04-24T13:30:32.292892+0000","last_undegraded":"2024-04-24T13:30:32.292892+0000","last_fullsized":"2024-04-24T13:30:32.292892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:21.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.280283+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:30:32.280283+0000","last_peered":"2024-04-24T13:30:32.280283+0000","last_clean":"2024-04-24T13:30:32.280283+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:30:32.280283+0000","last_undegraded":"2024-04-24T13:30:32.280283+0000","last_fullsized":"2024-04-24T13:30:32.280283+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.321140+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:30:32.321140+0000","last_peered":"2024-04-24T13:30:32.321140+0000","last_clean":"2024-04-24T13:30:32.321140+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:30:32.321140+0000","last_undegraded":"2024-04-24T13:30:32.321140+0000","last_fullsized":"2024-04-24T13:30:32.321140+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.290078+0000","last_change":"2024-04-24T13:30:23.241296+0000","last_active":"2024-04-24T13:30:32.290078+0000","last_peered":"2024-04-24T13:30:32.290078+0000","last_clean":"2024-04-24T13:30:32.290078+0000","last_became_active":"2024-04-24T13:30:23.236992+0000","last_became_peered":"2024-04-24T13:30:23.236992+0000","last_unstale":"2024-04-24T13:30:32.290078+0000","last_undegraded":"2024-04-24T13:30:32.290078+0000","last_fullsized":"2024-04-24T13:30:32.290078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263919+0000","last_change":"2024-04-24T13:30:21.243438+0000","last_active":"2024-04-24T13:30:32.263919+0000","last_peered":"2024-04-24T13:30:32.263919+0000","last_clean":"2024-04-24T13:30:32.263919+0000","last_became_active":"2024-04-24T13:30:21.240665+0000","last_became_peered":"2024-04-24T13:30:21.240665+0000","last_unstale":"2024-04-24T13:30:32.263919+0000","last_undegraded":"2024-04-24T13:30:32.263919+0000","last_fullsized":"2024-04-24T13:30:32.263919+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.261447+0000","last_change":"2024-04-24T13:30:21.218669+0000","last_active":"2024-04-24T13:30:32.261447+0000","last_peered":"2024-04-24T13:30:32.261447+0000","last_clean":"2024-04-24T13:30:32.261447+0000","last_became_active":"2024-04-24T13:30:21.217904+0000","last_became_peered":"2024-04-24T13:30:21.217904+0000","last_unstale":"2024-04-24T13:30:32.261447+0000","last_undegraded":"2024-04-24T13:30:32.261447+0000","last_fullsized":"2024-04-24T13:30:32.261447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.273270+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:30:32.273270+0000","last_peered":"2024-04-24T13:30:32.273270+0000","last_clean":"2024-04-24T13:30:32.273270+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:30:32.273270+0000","last_undegraded":"2024-04-24T13:30:32.273270+0000","last_fullsized":"2024-04-24T13:30:32.273270+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":32,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.258811+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:30:32.258811+0000","last_peered":"2024-04-24T13:30:32.258811+0000","last_clean":"2024-04-24T13:30:32.258811+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:30:32.258811+0000","last_undegraded":"2024-04-24T13:30:32.258811+0000","last_fullsized":"2024-04-24T13:30:32.258811+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":28,"reported_epoch":32,"state":"active+clean","last_fresh":"2024-04-24T13:30:32.263197+0000","last_change":"2024-04-24T13:30:23.217309+0000","last_active":"2024-04-24T13:30:32.263197+0000","last_peered":"2024-04-24T13:30:32.263197+0000","last_clean":"2024-04-24T13:30:32.263197+0000","last_became_active":"2024-04-24T13:30:23.216484+0000","last_became_peered":"2024-04-24T13:30:23.216484+0000","last_unstale":"2024-04-24T13:30:32.263197+0000","last_undegraded":"2024-04-24T13:30:32.263197+0000","last_fullsized":"2024-04-24T13:30:32.263197+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574857,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32156,"kb_used_data":976,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339684,"statfs":{"total":96636764160,"available":96603836416,"internally_reserved":0,"allocated":999424,"data_stored":749604,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574857,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27396,"kb_used_data":372,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344444,"statfs":{"total":96636764160,"available":96608710656,"internally_reserved":0,"allocated":380928,"data_stored":158576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574858,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27448,"kb_used_data":424,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344392,"statfs":{"total":96636764160,"available":96608657408,"internally_reserved":0,"allocated":434176,"data_stored":160833,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574858,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27380,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344460,"statfs":{"total":96636764160,"available":96608727040,"internally_reserved":0,"allocated":368640,"data_stored":158074,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574857,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27408,"kb_used_data":388,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344432,"statfs":{"total":96636764160,"available":96608698368,"internally_reserved":0,"allocated":397312,"data_stored":158972,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574858,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27384,"kb_used_data":360,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344456,"statfs":{"total":96636764160,"available":96608722944,"internally_reserved":0,"allocated":368640,"data_stored":158138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574859,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27412,"kb_used_data":396,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344428,"statfs":{"total":96636764160,"available":96608694272,"internally_reserved":0,"allocated":405504,"data_stored":160255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574858,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27976,"kb_used_data":956,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343864,"statfs":{"total":96636764160,"available":96608116736,"internally_reserved":0,"allocated":978944,"data_stored":749010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:30:39.564 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T13:30:39.564 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump 2024-04-24T13:30:39.894 INFO:teuthology.orchestra.run.smithi071.stdout:epoch 32 2024-04-24T13:30:39.894 INFO:teuthology.orchestra.run.smithi071.stdout:fsid 6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8 2024-04-24T13:30:39.894 INFO:teuthology.orchestra.run.smithi071.stdout:created 2024-04-24T13:29:54.500837+0000 2024-04-24T13:30:39.894 INFO:teuthology.orchestra.run.smithi071.stdout:modified 2024-04-24T13:30:32.239611+0000 2024-04-24T13:30:39.894 INFO:teuthology.orchestra.run.smithi071.stdout:flags sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit 2024-04-24T13:30:39.894 INFO:teuthology.orchestra.run.smithi071.stdout:crush_version 4 2024-04-24T13:30:39.894 INFO:teuthology.orchestra.run.smithi071.stdout:full_ratio 0.95 2024-04-24T13:30:39.894 INFO:teuthology.orchestra.run.smithi071.stdout:backfillfull_ratio 0.9 2024-04-24T13:30:39.894 INFO:teuthology.orchestra.run.smithi071.stdout:nearfull_ratio 0.85 2024-04-24T13:30:39.894 INFO:teuthology.orchestra.run.smithi071.stdout:require_min_compat_client luminous 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:min_compat_client jewel 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:require_osd_release squid 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:stretch_mode_enabled false 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:pool 1 '.mgr' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 1 pgp_num 1 autoscale_mode off last_change 16 flags hashpspool stripe_width 0 pg_num_max 32 pg_num_min 1 application mgr read_balance_score 8.00 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:pool 2 'rbd' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 8 pgp_num 8 autoscale_mode off last_change 19 flags hashpspool stripe_width 0 application rbd read_balance_score 1.99 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:pool 3 'default.rgw.buckets.data' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 22 flags hashpspool stripe_width 0 application rgw read_balance_score 1.50 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:pool 4 'default.rgw.buckets.index' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 64 pgp_num 64 autoscale_mode off last_change 24 flags hashpspool stripe_width 0 application rgw read_balance_score 2.00 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:pool 5 '.rgw.root' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 26 flags hashpspool stripe_width 0 application rgw read_balance_score 1.25 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:pool 6 'default.rgw.log' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 28 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:pool 7 'default.rgw.control' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 30 flags hashpspool stripe_width 0 application rgw read_balance_score 1.75 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:pool 8 'default.rgw.meta' replicated size 2 min_size 1 crush_rule 0 object_hash rjenkins pg_num 32 pgp_num 32 autoscale_mode off last_change 32 flags hashpspool stripe_width 0 pg_autoscale_bias 4 application rgw read_balance_score 1.50 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:max_osd 8 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6800/1371554644,v1:172.21.15.71:6801/1371554644] [v2:172.21.15.71:6802/1371554644,v1:172.21.15.71:6803/1371554644] exists,up dcf17737-d21a-4731-8a14-4b008f82e1b8 2024-04-24T13:30:39.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6824/2907970623,v1:172.21.15.71:6825/2907970623] [v2:172.21.15.71:6826/2907970623,v1:172.21.15.71:6827/2907970623] exists,up 559511d8-704f-48ae-a330-331a8a18486a 2024-04-24T13:30:39.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2 up in weight 1 up_from 13 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6805/747727017,v1:172.21.15.71:6808/747727017] [v2:172.21.15.71:6811/747727017,v1:172.21.15.71:6813/747727017] exists,up 496cf95c-01c4-4537-ba79-35c2ad152201 2024-04-24T13:30:39.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6807/2258589678,v1:172.21.15.71:6810/2258589678] [v2:172.21.15.71:6814/2258589678,v1:172.21.15.71:6815/2258589678] exists,up 5ce9d307-23e5-4bb9-8035-0827520a6d80 2024-04-24T13:30:39.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6810/2264053969,v1:172.21.15.138:6814/2264053969] [v2:172.21.15.138:6817/2264053969,v1:172.21.15.138:6821/2264053969] exists,up 6d6e5b3c-301d-4b2c-996f-17d13224f780 2024-04-24T13:30:39.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6812/942955714,v1:172.21.15.138:6815/942955714] [v2:172.21.15.138:6819/942955714,v1:172.21.15.138:6822/942955714] exists,up b3d18c54-5a9a-4215-8b40-3e796ac2fed4 2024-04-24T13:30:39.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6808/889830629,v1:172.21.15.138:6809/889830629] [v2:172.21.15.138:6811/889830629,v1:172.21.15.138:6813/889830629] exists,up 12d21ba0-8670-470b-8fd5-a02349ecb4d4 2024-04-24T13:30:39.896 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6800/2015291049,v1:172.21.15.138:6801/2015291049] [v2:172.21.15.138:6802/2015291049,v1:172.21.15.138:6803/2015291049] exists,up dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce 2024-04-24T13:30:39.911 INFO:tasks.ceph.ceph_manager.ceph:['osd.0 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6800/1371554644,v1:172.21.15.71:6801/1371554644] [v2:172.21.15.71:6802/1371554644,v1:172.21.15.71:6803/1371554644] exists,up dcf17737-d21a-4731-8a14-4b008f82e1b8', 'osd.1 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6824/2907970623,v1:172.21.15.71:6825/2907970623] [v2:172.21.15.71:6826/2907970623,v1:172.21.15.71:6827/2907970623] exists,up 559511d8-704f-48ae-a330-331a8a18486a', 'osd.2 up in weight 1 up_from 13 up_thru 28 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6805/747727017,v1:172.21.15.71:6808/747727017] [v2:172.21.15.71:6811/747727017,v1:172.21.15.71:6813/747727017] exists,up 496cf95c-01c4-4537-ba79-35c2ad152201', 'osd.3 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.71:6807/2258589678,v1:172.21.15.71:6810/2258589678] [v2:172.21.15.71:6814/2258589678,v1:172.21.15.71:6815/2258589678] exists,up 5ce9d307-23e5-4bb9-8035-0827520a6d80', 'osd.4 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6810/2264053969,v1:172.21.15.138:6814/2264053969] [v2:172.21.15.138:6817/2264053969,v1:172.21.15.138:6821/2264053969] exists,up 6d6e5b3c-301d-4b2c-996f-17d13224f780', 'osd.5 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6812/942955714,v1:172.21.15.138:6815/942955714] [v2:172.21.15.138:6819/942955714,v1:172.21.15.138:6822/942955714] exists,up b3d18c54-5a9a-4215-8b40-3e796ac2fed4', 'osd.6 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6808/889830629,v1:172.21.15.138:6809/889830629] [v2:172.21.15.138:6811/889830629,v1:172.21.15.138:6813/889830629] exists,up 12d21ba0-8670-470b-8fd5-a02349ecb4d4', 'osd.7 up in weight 1 up_from 13 up_thru 30 down_at 0 last_clean_interval [0,0) [v2:172.21.15.138:6800/2015291049,v1:172.21.15.138:6801/2015291049] [v2:172.21.15.138:6802/2015291049,v1:172.21.15.138:6803/2015291049] exists,up dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce'] 2024-04-24T13:30:39.911 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-mon.a.asok config show 2024-04-24T13:30:40.026 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "name": "mon.a", 2024-04-24T13:30:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster": "ceph", 2024-04-24T13:30:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "admin_socket": "/var/run/ceph/ceph-mon.a.asok", 2024-04-24T13:30:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "admin_socket_mode": "", 2024-04-24T13:30:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_allow_insecure_global_id_reclaim": "true", 2024-04-24T13:30:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_client_required": "cephx, none", 2024-04-24T13:30:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_cluster_required": "cephx", 2024-04-24T13:30:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_debug": "true", 2024-04-24T13:30:40.026 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_expose_insecure_global_id_reclaim": "true", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_mon_ticket_ttl": "660.000000", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_service_required": "cephx", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_service_ticket_ttl": "240.000000", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "auth_supported": "cephx", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_aio": "true", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_aio_max_queue_depth": "1024", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_aio_poll_ms": "250", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_aio_reap_max": "16", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_async_discard_threads": "0", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_block_size": "4096", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_debug_aio": "false", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_debug_aio_log_age": "5.000000", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_debug_aio_suicide_timeout": "60.000000", 2024-04-24T13:30:40.027 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_debug_inflight_ios": "false", 2024-04-24T13:30:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_enable_discard": "false", 2024-04-24T13:30:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_flock_retry": "3", 2024-04-24T13:30:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_flock_retry_interval": "0.100000", 2024-04-24T13:30:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_inject_crash": "0", 2024-04-24T13:30:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_inject_crash_flush_delay": "2", 2024-04-24T13:30:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_ioring": "false", 2024-04-24T13:30:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_ioring_hipri": "false", 2024-04-24T13:30:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_ioring_sqthread_poll": "false", 2024-04-24T13:30:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_nvme_unbind_from_kernel": "false", 2024-04-24T13:30:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_read_buffer_alignment": "4096", 2024-04-24T13:30:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_read_preallocated_huge_buffers": "", 2024-04-24T13:30:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "bdev_type": "", 2024-04-24T13:30:40.028 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_alloc_size": "1048576", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_allocator": "hybrid", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_buffered_io": "true", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_check_for_zeros": "false", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_check_volume_selector_often": "false", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_check_volume_selector_on_umount": "false", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_compact_log_sync": "false", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_failed_shared_alloc_cooldown": "600.000000", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_log_compact_min_ratio": "5.000000", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_log_compact_min_size": "16777216", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_log_replay_check_allocations": "true", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_max_log_runway": "4194304", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_max_prefetch": "1048576", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_min_flush_size": "524288", 2024-04-24T13:30:40.029 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_min_log_runway": "1048576", 2024-04-24T13:30:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_replay_recovery": "false", 2024-04-24T13:30:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_replay_recovery_disable_compact": "false", 2024-04-24T13:30:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_shared_alloc_size": "65536", 2024-04-24T13:30:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "bluefs_sync_write": "false", 2024-04-24T13:30:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_2q_cache_kin_ratio": "0.500000", 2024-04-24T13:30:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_2q_cache_kout_ratio": "0.500000", 2024-04-24T13:30:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_alloc_stats_dump_interval": "86400.000000", 2024-04-24T13:30:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_allocation_from_file": "true", 2024-04-24T13:30:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_allocator": "hybrid", 2024-04-24T13:30:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_avl_alloc_bf_free_pct": "4", 2024-04-24T13:30:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_avl_alloc_bf_threshold": "131072", 2024-04-24T13:30:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_avl_alloc_ff_max_search_bytes": "16777216", 2024-04-24T13:30:40.030 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_avl_alloc_ff_max_search_count": "100", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bitmapallocator_blocks_per_zone": "1024", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bitmapallocator_span_size": "1024", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_blobid_prealloc": "10240", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_create": "true", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_db_create": "false", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_db_path": "", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_db_size": "0", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_path": "", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_preallocate_file": "false", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_size": "107374182400", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_wal_create": "false", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_wal_path": "", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_block_wal_size": "100663296", 2024-04-24T13:30:40.031 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs": "true", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_alloc_failure_dump_interval": "0.000000", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_env_mirror": "false", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_bluefs_max_free": "10737418240", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_age_bin_interval": "1.000000", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_age_bins_data": "1 2 6 24 120 720 0 0 0 0", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_age_bins_kv": "1 2 6 24 120 720 0 0 0 0", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_age_bins_kv_onode": "0 0 0 0 0 0 0 0 0 720", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_age_bins_meta": "1 2 6 24 120 720 0 0 0 0", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_autotune": "true", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_autotune_interval": "5.000000", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_kv_onode_ratio": "0.040000", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_kv_ratio": "0.450000", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_meta_ratio": "0.450000", 2024-04-24T13:30:40.032 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_size": "0", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_size_hdd": "1073741824", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_size_ssd": "3221225472", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_trim_interval": "0.050000", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_trim_max_skip_pinned": "1000", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cache_type": "2q", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_cleaner_sleep_interval": "5.000000", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_clone_cow": "true", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_algorithm": "snappy", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_max_blob_size": "0", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_max_blob_size_hdd": "65536", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_max_blob_size_ssd": "65536", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_min_blob_size": "0", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_min_blob_size_hdd": "8192", 2024-04-24T13:30:40.033 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_min_blob_size_ssd": "65536", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_mode": "none", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_compression_required_ratio": "0.875000", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_csum_type": "crc32c", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_enforce_min_alloc_size": "0", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_enforce_settings": "default", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_freelist": "false", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_fsck_abort": "false", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_inject_allocation_from_file_failure": "0.000000", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_inject_csum_err_probability": "0.000000", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_inject_read_err": "false", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_legacy_omap": "false", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_no_reuse_blocks": "false", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_omit_block_device_write": "false", 2024-04-24T13:30:40.034 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_omit_kv_commit": "false", 2024-04-24T13:30:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_permit_any_bdev_label": "false", 2024-04-24T13:30:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_prefill": "0.000000", 2024-04-24T13:30:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_prefragment_max": "1048576", 2024-04-24T13:30:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_random_read_err": "0.000000", 2024-04-24T13:30:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_randomize_serial_transaction": "0", 2024-04-24T13:30:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_small_allocations": "0", 2024-04-24T13:30:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_debug_too_many_blobs_threshold": "24576", 2024-04-24T13:30:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_default_buffered_read": "true", 2024-04-24T13:30:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_default_buffered_write": "false", 2024-04-24T13:30:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_deferred_batch_ops": "0", 2024-04-24T13:30:40.035 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_deferred_batch_ops_hdd": "64", 2024-04-24T13:30:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_deferred_batch_ops_ssd": "16", 2024-04-24T13:30:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_elastic_shared_blobs": "true", 2024-04-24T13:30:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_inline_shard_prealloc_size": "256", 2024-04-24T13:30:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_shard_max_size": "1200", 2024-04-24T13:30:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_shard_min_size": "150", 2024-04-24T13:30:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_shard_target_size": "500", 2024-04-24T13:30:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_extent_map_shard_target_size_slop": "0.200000", 2024-04-24T13:30:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fail_eio": "false", 2024-04-24T13:30:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_freelist_blocks_per_key": "128", 2024-04-24T13:30:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_error_on_no_per_pg_omap": "false", 2024-04-24T13:30:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_error_on_no_per_pool_omap": "false", 2024-04-24T13:30:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_error_on_no_per_pool_stats": "false", 2024-04-24T13:30:40.036 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_mkfs": "true", 2024-04-24T13:30:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_mkfs_deep": "false", 2024-04-24T13:30:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_mount": "false", 2024-04-24T13:30:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_mount_deep": "false", 2024-04-24T13:30:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_umount": "false", 2024-04-24T13:30:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_on_umount_deep": "false", 2024-04-24T13:30:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_quick_fix_on_mount": "false", 2024-04-24T13:30:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_quick_fix_threads": "2", 2024-04-24T13:30:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_read_bytes_cap": "67108864", 2024-04-24T13:30:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_fsck_shared_blob_tracker_size": "0.031250", 2024-04-24T13:30:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_gc_enable_blob_threshold": "0", 2024-04-24T13:30:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_gc_enable_total_threshold": "0", 2024-04-24T13:30:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_hybrid_alloc_mem_cap": "67108864", 2024-04-24T13:30:40.037 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_ignore_data_csum": "false", 2024-04-24T13:30:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_kv_sync_util_logging_s": "10.000000", 2024-04-24T13:30:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_kvbackend": "rocksdb", 2024-04-24T13:30:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_log_collection_list_age": "60.000000", 2024-04-24T13:30:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_log_omap_iterator_age": "5.000000", 2024-04-24T13:30:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_log_op_age": "5.000000", 2024-04-24T13:30:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_alloc_size": "0", 2024-04-24T13:30:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_blob_size": "0", 2024-04-24T13:30:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_blob_size_hdd": "65536", 2024-04-24T13:30:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_blob_size_ssd": "65536", 2024-04-24T13:30:40.038 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_defer_interval": "3.000000", 2024-04-24T13:30:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_max_deferred_txc": "32", 2024-04-24T13:30:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_min_alloc_size": "0", 2024-04-24T13:30:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_min_alloc_size_hdd": "4096", 2024-04-24T13:30:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_min_alloc_size_ssd": "4096", 2024-04-24T13:30:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_nid_prealloc": "1024", 2024-04-24T13:30:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_prefer_deferred_size": "0", 2024-04-24T13:30:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_prefer_deferred_size_hdd": "65536", 2024-04-24T13:30:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_prefer_deferred_size_ssd": "0", 2024-04-24T13:30:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_qfsck_on_mount": "true", 2024-04-24T13:30:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_retry_disk_reads": "3", 2024-04-24T13:30:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_rocksdb_cf": "true", 2024-04-24T13:30:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_rocksdb_cfs": "m(3) p(3,0-12) O(3,0-13)=block_cache={type=binned_lru} L=min_write_buffer_number_to_merge=32 P=min_write_buffer_number_to_merge=32", 2024-04-24T13:30:40.039 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_rocksdb_options": "compression=kLZ4Compression,max_write_buffer_number=64,min_write_buffer_number_to_merge=6,compaction_style=kCompactionStyleLevel,write_buffer_size=16777216,max_background_jobs=4,level0_file_num_compaction_trigger=8,max_bytes_for_level_base=1073741824,max_bytes_for_level_multiplier=8,compaction_readahead_size=2MB,max_total_wal_size=1073741824,writable_file_max_buffer_size=0", 2024-04-24T13:30:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_rocksdb_options_annex": "", 2024-04-24T13:30:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_spdk_coremask": "0x1", 2024-04-24T13:30:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_spdk_io_sleep": "5", 2024-04-24T13:30:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_spdk_max_io_completion": "0", 2024-04-24T13:30:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_spdk_mem": "512", 2024-04-24T13:30:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_sync_submit_transaction": "false", 2024-04-24T13:30:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_bytes": "67108864", 2024-04-24T13:30:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_cost_per_io": "0", 2024-04-24T13:30:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_cost_per_io_hdd": "670000", 2024-04-24T13:30:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_cost_per_io_ssd": "4000", 2024-04-24T13:30:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_deferred_bytes": "134217728", 2024-04-24T13:30:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_throttle_trace_rate": "0.000000", 2024-04-24T13:30:40.040 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_tracing": "false", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_use_optimal_io_size_for_min_alloc_size": "false", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_volume_selection_policy": "use_some_extra", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_volume_selection_reserved": "0", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_volume_selection_reserved_factor": "2.000000", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_warn_on_bluefs_spillover": "true", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_warn_on_legacy_statfs": "true", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_warn_on_no_per_pg_omap": "false", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_warn_on_no_per_pool_omap": "true", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_warn_on_spurious_read_errors": "true", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "bluestore_zero_block_detection": "false", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "cephadm_path": "/usr/sbin/cephadm", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_action_update_interval": "2", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_directory_scan_interval": "10", 2024-04-24T13:30:40.041 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_max_concurrent_directory_syncs": "3", 2024-04-24T13:30:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_max_consecutive_failures_per_directory": "10", 2024-04-24T13:30:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_max_snapshot_sync_per_cycle": "3", 2024-04-24T13:30:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_mount_timeout": "10", 2024-04-24T13:30:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_perf_stats_prio": "5", 2024-04-24T13:30:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_restart_mirror_on_blocklist_interval": "30", 2024-04-24T13:30:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_restart_mirror_on_failure_interval": "20", 2024-04-24T13:30:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "cephfs_mirror_retry_failed_directories_interval": "60", 2024-04-24T13:30:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "cephsqlite_blocklist_dead_locker": "true", 2024-04-24T13:30:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "cephsqlite_lock_renewal_interval": "2000", 2024-04-24T13:30:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "cephsqlite_lock_renewal_timeout": "30000", 2024-04-24T13:30:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_cluster_require_signatures": "false", 2024-04-24T13:30:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_cluster_require_version": "2", 2024-04-24T13:30:40.042 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_require_signatures": "false", 2024-04-24T13:30:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_require_version": "2", 2024-04-24T13:30:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_service_require_signatures": "false", 2024-04-24T13:30:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_service_require_version": "2", 2024-04-24T13:30:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "cephx_sign_messages": "true", 2024-04-24T13:30:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "chdir": "", 2024-04-24T13:30:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_acl_type": "", 2024-04-24T13:30:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_asio_thread_count": "2", 2024-04-24T13:30:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_cache_mid": "0.750000", 2024-04-24T13:30:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_cache_size": "16384", 2024-04-24T13:30:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_caps_release_delay": "5", 2024-04-24T13:30:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_check_pool_perm": "true", 2024-04-24T13:30:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_collect_and_send_global_metrics": "false", 2024-04-24T13:30:40.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_debug_force_sync_read": "false", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_debug_getattr_caps": "false", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_debug_inject_tick_delay": "0", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_die_on_failed_dentry_invalidate": "true", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_die_on_failed_remount": "false", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_dirsize_rbytes": "true", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_force_lazyio": "false", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_fs": "", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_inject_fixed_oldest_tid": "false", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_inject_release_failure": "false", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_max_inline_size": "4096", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_max_retries_on_remount_failure": "5", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mds_namespace": "", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_metadata": "", 2024-04-24T13:30:40.044 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mount_gid": "-1", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mount_timeout": "300", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mount_uid": "-1", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_mountpoint": "/", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_notify_timeout": "10", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc": "true", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_max_dirty": "104857600", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_max_dirty_age": "5.000000", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_max_objects": "1000", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_size": "209715200", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_oc_target_dirty": "8388608", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_permissions": "true", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_quota": "true", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_quota_df": "true", 2024-04-24T13:30:40.045 INFO:teuthology.orchestra.run.smithi071.stdout: "client_readahead_max_bytes": "0", 2024-04-24T13:30:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_readahead_max_periods": "4", 2024-04-24T13:30:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_readahead_min": "131072", 2024-04-24T13:30:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_reconnect_stale": "false", 2024-04-24T13:30:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_shutdown_timeout": "30", 2024-04-24T13:30:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_snapdir": ".snap", 2024-04-24T13:30:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_tick_interval": "1", 2024-04-24T13:30:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_trace": "", 2024-04-24T13:30:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_try_dentry_invalidate": "false", 2024-04-24T13:30:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_use_faked_inos": "false", 2024-04-24T13:30:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_use_random_mds": "false", 2024-04-24T13:30:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_graylog": "false", 2024-04-24T13:30:40.046 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_graylog_host": "127.0.0.1", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_graylog_port": "12201", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_monitors": "default=true", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_syslog": "false", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_syslog_facility": "default=daemon audit=local0", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "clog_to_syslog_level": "info", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "-", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_network": "", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_network_interface": "", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "compressor_zlib_isal": "false", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "compressor_zlib_level": "5", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "compressor_zlib_winsize": "-15", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "compressor_zstd_level": "1", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "container_image": "docker.io/ceph/daemon-base:latest-master-devel", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "crash_dir": "/var/lib/ceph/crash", 2024-04-24T13:30:40.047 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_alien_op_num_threads": "6", 2024-04-24T13:30:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_alien_thread_cpu_cores": "", 2024-04-24T13:30:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_osd_obc_lru_size": "512", 2024-04-24T13:30:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_osd_scheduler_concurrency": "0", 2024-04-24T13:30:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_osd_stat_interval": "0", 2024-04-24T13:30:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "crimson_seastar_cpu_cores": "", 2024-04-24T13:30:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location": "", 2024-04-24T13:30:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location_hook": "", 2024-04-24T13:30:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_location_hook_timeout": "10", 2024-04-24T13:30:40.048 INFO:teuthology.orchestra.run.smithi071.stdout: "daemonize": "false", 2024-04-24T13:30:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "daos_pool": "tank", 2024-04-24T13:30:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "dbstore_config_uri": "file:/var/lib/ceph/radosgw/dbstore-config.db", 2024-04-24T13:30:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "dbstore_db_dir": "/var/lib/ceph/radosgw", 2024-04-24T13:30:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "dbstore_db_name_prefix": "dbstore", 2024-04-24T13:30:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_alienstore": "0/5", 2024-04-24T13:30:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_allow_any_pool_priority": "false", 2024-04-24T13:30:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_asok": "1/5", 2024-04-24T13:30:40.049 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_asok_assert_abort": "false", 2024-04-24T13:30:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_asserts_on_shutdown": "true", 2024-04-24T13:30:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_auth": "20/20", 2024-04-24T13:30:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_bdev": "1/3", 2024-04-24T13:30:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_bluefs": "1/5", 2024-04-24T13:30:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_bluestore": "1/5", 2024-04-24T13:30:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_buffer": "0/1", 2024-04-24T13:30:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_ceph_exporter": "1/5", 2024-04-24T13:30:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_cephfs_mirror": "0/5", 2024-04-24T13:30:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_cephsqlite": "0/5", 2024-04-24T13:30:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_client": "0/5", 2024-04-24T13:30:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_compressor": "1/5", 2024-04-24T13:30:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_context": "0/1", 2024-04-24T13:30:40.050 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_crimson_interrupt": "0/5", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_crush": "1/1", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_crypto": "1/5", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_cyanstore": "0/5", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_deliberately_leak_memory": "false", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_disable_randomized_ping": "false", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_dpdk": "1/5", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_eventtrace": "1/5", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_filer": "0/1", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_filestore": "1/3", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_finisher": "1/1", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_fuse": "1/5", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_heartbeat_testing_span": "0", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_heartbeatmap": "1/5", 2024-04-24T13:30:40.051 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_immutable_obj_cache": "0/5", 2024-04-24T13:30:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_javaclient": "1/5", 2024-04-24T13:30:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_journal": "1/3", 2024-04-24T13:30:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_journaler": "0/5", 2024-04-24T13:30:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_kstore": "1/5", 2024-04-24T13:30:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_lockdep": "0/1", 2024-04-24T13:30:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mclock": "1/5", 2024-04-24T13:30:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds": "1/5", 2024-04-24T13:30:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_balancer": "1/5", 2024-04-24T13:30:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_locker": "1/5", 2024-04-24T13:30:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_log": "1/5", 2024-04-24T13:30:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_log_expire": "1/5", 2024-04-24T13:30:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_migrator": "1/5", 2024-04-24T13:30:40.052 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mds_quiesce": "3/5", 2024-04-24T13:30:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_memstore": "1/5", 2024-04-24T13:30:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mgr": "2/5", 2024-04-24T13:30:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mgrc": "1/5", 2024-04-24T13:30:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_mon": "20/20", 2024-04-24T13:30:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_monc": "0/10", 2024-04-24T13:30:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_ms": "1/1", 2024-04-24T13:30:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_none": "0/5", 2024-04-24T13:30:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_objclass": "0/5", 2024-04-24T13:30:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_objectcacher": "0/5", 2024-04-24T13:30:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_objecter": "0/1", 2024-04-24T13:30:40.053 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_optracker": "0/5", 2024-04-24T13:30:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_osd": "1/5", 2024-04-24T13:30:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_paxos": "20/20", 2024-04-24T13:30:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_perfcounter": "1/5", 2024-04-24T13:30:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_prioritycache": "1/5", 2024-04-24T13:30:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rados": "0/5", 2024-04-24T13:30:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rbd": "0/5", 2024-04-24T13:30:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rbd_mirror": "0/5", 2024-04-24T13:30:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rbd_pwl": "0/5", 2024-04-24T13:30:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rbd_replay": "0/5", 2024-04-24T13:30:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_refs": "0/0", 2024-04-24T13:30:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_reserver": "1/1", 2024-04-24T13:30:40.054 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw": "1/5", 2024-04-24T13:30:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_access": "1/5", 2024-04-24T13:30:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_datacache": "1/5", 2024-04-24T13:30:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_dbstore": "1/5", 2024-04-24T13:30:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_flight": "1/5", 2024-04-24T13:30:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_lifecycle": "1/5", 2024-04-24T13:30:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_notification": "1/5", 2024-04-24T13:30:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rgw_sync": "1/5", 2024-04-24T13:30:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_rocksdb": "4/5", 2024-04-24T13:30:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore": "0/5", 2024-04-24T13:30:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_backref": "0/5", 2024-04-24T13:30:40.055 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_cache": "0/5", 2024-04-24T13:30:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_cleaner": "0/5", 2024-04-24T13:30:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_device": "0/5", 2024-04-24T13:30:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_epm": "0/5", 2024-04-24T13:30:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_fixedkv_tree": "0/5", 2024-04-24T13:30:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_journal": "0/5", 2024-04-24T13:30:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_lba": "0/5", 2024-04-24T13:30:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_odata": "0/5", 2024-04-24T13:30:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_omap": "0/5", 2024-04-24T13:30:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_onode": "0/5", 2024-04-24T13:30:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_t": "0/5", 2024-04-24T13:30:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_seastore_tm": "0/5", 2024-04-24T13:30:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_striper": "0/1", 2024-04-24T13:30:40.056 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_test": "0/5", 2024-04-24T13:30:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_throttle": "1/1", 2024-04-24T13:30:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_timer": "0/1", 2024-04-24T13:30:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_tp": "0/5", 2024-04-24T13:30:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "debug_trace": "1/5", 2024-04-24T13:30:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "defer_client_eviction_on_laggy_osds": "false", 2024-04-24T13:30:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "device_failure_prediction_mode": "none", 2024-04-24T13:30:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "enable_experimental_unrecoverable_data_corrupting_features": "", 2024-04-24T13:30:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_dir": "/usr/lib/ceph/erasure-code", 2024-04-24T13:30:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "err_to_graylog": "false", 2024-04-24T13:30:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "err_to_journald": "false", 2024-04-24T13:30:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "err_to_stderr": "true", 2024-04-24T13:30:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "err_to_syslog": "false", 2024-04-24T13:30:40.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event_tracing": "false", 2024-04-24T13:30:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_addr": "0.0.0.0", 2024-04-24T13:30:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_http_port": "9926", 2024-04-24T13:30:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_prio_limit": "5", 2024-04-24T13:30:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_sock_dir": "/var/run/ceph/", 2024-04-24T13:30:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_sort_metrics": "true", 2024-04-24T13:30:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "exporter_stats_period": "5", 2024-04-24T13:30:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "fake_statfs_for_testing": "0", 2024-04-24T13:30:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "fatal_signal_handlers": "true", 2024-04-24T13:30:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "filer_max_purge_ops": "10", 2024-04-24T13:30:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "filer_max_truncate_ops": "128", 2024-04-24T13:30:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_apply_finisher_threads": "1", 2024-04-24T13:30:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_blackhole": "false", 2024-04-24T13:30:40.058 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_btrfs_clone_range": "true", 2024-04-24T13:30:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_btrfs_snap": "true", 2024-04-24T13:30:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_caller_concurrency": "10", 2024-04-24T13:30:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_collect_device_partition_information": "true", 2024-04-24T13:30:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_commit_timeout": "600.000000", 2024-04-24T13:30:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_debug_inject_read_err": "false", 2024-04-24T13:30:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_debug_omap_check": "false", 2024-04-24T13:30:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_debug_verify_split": "false", 2024-04-24T13:30:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_dump_file": "", 2024-04-24T13:30:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_expected_throughput_bytes": "209715200.000000", 2024-04-24T13:30:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_expected_throughput_ops": "200.000000", 2024-04-24T13:30:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fadvise": "true", 2024-04-24T13:30:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fail_eio": "true", 2024-04-24T13:30:40.059 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fd_cache_shards": "16", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fd_cache_size": "128", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fiemap": "false", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fiemap_threshold": "4096", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_fsync_flushes_journal_data": "false", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_index_retry_probability": "0.000000", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_inject_stall": "0", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_journal_parallel": "false", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_journal_trailing": "false", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_journal_writeahead": "false", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_kill_at": "0", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_alloc_hint_size": "1048576", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattr_size": "0", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattr_size_btrfs": "2048", 2024-04-24T13:30:40.060 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattr_size_other": "512", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattr_size_xfs": "65536", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattrs": "0", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattrs_btrfs": "10", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattrs_other": "2", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_inline_xattrs_xfs": "10", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_sync_interval": "5.000000", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_xattr_value_size": "0", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_xattr_value_size_btrfs": "65536", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_xattr_value_size_other": "1024", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_max_xattr_value_size_xfs": "65536", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_merge_threshold": "-10", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_min_sync_interval": "0.010000", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_odsync_write": "false", 2024-04-24T13:30:40.061 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_omap_backend": "rocksdb", 2024-04-24T13:30:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_omap_backend_path": "", 2024-04-24T13:30:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_omap_header_cache_size": "1024", 2024-04-24T13:30:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_ondisk_finisher_threads": "1", 2024-04-24T13:30:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_op_thread_suicide_timeout": "180", 2024-04-24T13:30:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_op_thread_timeout": "60", 2024-04-24T13:30:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_op_threads": "2", 2024-04-24T13:30:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_punch_hole": "false", 2024-04-24T13:30:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_high_delay_multiple": "0.000000", 2024-04-24T13:30:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_high_delay_multiple_bytes": "0.000000", 2024-04-24T13:30:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_high_delay_multiple_ops": "0.000000", 2024-04-24T13:30:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_high_threshhold": "0.900000", 2024-04-24T13:30:40.062 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_low_threshhold": "0.300000", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_bytes": "104857600", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_delay_multiple": "0.000000", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_delay_multiple_bytes": "0.000000", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_delay_multiple_ops": "0.000000", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_queue_max_ops": "50", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_rocksdb_options": "max_background_jobs=10,compaction_readahead_size=2097152,compression=kNoCompression", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_seek_data_hole": "false", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_sloppy_crc": "false", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_sloppy_crc_block_size": "65536", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_splice": "false", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_split_multiple": "2", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_split_rand_factor": "20", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_update_to": "1000", 2024-04-24T13:30:40.063 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_bytes_hard_limit": "419430400", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_bytes_start_flusher": "41943040", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_inodes_hard_limit": "5000", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_inodes_start_flusher": "500", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_ios_hard_limit": "5000", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_btrfs_ios_start_flusher": "500", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_enable": "true", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_bytes_hard_limit": "419430400", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_bytes_start_flusher": "41943040", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_inodes_hard_limit": "5000", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_inodes_start_flusher": "500", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_ios_hard_limit": "5000", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_wbthrottle_xfs_ios_start_flusher": "500", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_xfs_extsize": "false", 2024-04-24T13:30:40.064 INFO:teuthology.orchestra.run.smithi071.stdout: "filestore_zfs_snap": "false", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fio_dir": "/tmp/fio", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_allow_other": "true", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_atomic_o_trunc": "true", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_big_writes": "true", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_debug": "false", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_default_permissions": "false", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_disable_pagecache": "false", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_max_write": "0", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_multithreaded": "true", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_require_active_mds": "true", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_set_user_groups": "true", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_splice_move": "true", 2024-04-24T13:30:40.065 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_splice_read": "true", 2024-04-24T13:30:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_splice_write": "true", 2024-04-24T13:30:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_syncfs_on_mksnap": "true", 2024-04-24T13:30:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "fuse_use_invalidate_cb": "true", 2024-04-24T13:30:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "gss_ktab_client_file": "/var/lib/ceph/mon.a/gss_client_mon.a.ktab", 2024-04-24T13:30:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "gss_target_name": "ceph", 2024-04-24T13:30:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_file": "", 2024-04-24T13:30:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_inject_failure": "0", 2024-04-24T13:30:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_interval": "5", 2024-04-24T13:30:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "host": "smithi071", 2024-04-24T13:30:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_client_dedicated_thread_num": "2", 2024-04-24T13:30:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_max_inflight_ops": "128", 2024-04-24T13:30:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_max_size": "1073741824", 2024-04-24T13:30:40.066 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_path": "/tmp/ceph_immutable_object_cache", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_bps_burst": "0", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_bps_burst_seconds": "1", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_bps_limit": "0", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_iops_burst": "0", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_iops_burst_seconds": "1", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_iops_limit": "0", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_qos_schedule_tick_min": "50", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_sock": "/var/run/ceph/immutable_object_cache_sock", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "immutable_object_cache_watermark": "0.900000", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "inject_early_sigterm": "false", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "jaeger_agent_port": "6799", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "jaeger_tracing_enable": "false", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_aio": "true", 2024-04-24T13:30:40.067 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_align_min_size": "65536", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_block_align": "true", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_block_size": "4096", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_dio": "true", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_discard": "false", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_force_aio": "false", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_ignore_corruption": "false", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_max_write_bytes": "10485760", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_max_write_entries": "100", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_replay_from": "0", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_throttle_high_multiple": "0.000000", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_throttle_high_threshhold": "0.900000", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_throttle_low_threshhold": "0.600000", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_throttle_max_multiple": "0.000000", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_write_header_frequency": "0", 2024-04-24T13:30:40.068 INFO:teuthology.orchestra.run.smithi071.stdout: "journal_zero_on_create": "false", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "journaler_prefetch_periods": "10", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "journaler_prezero_periods": "5", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "journaler_write_head_interval": "15", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "key": "", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "keyfile": "", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "keyring": "/var/lib/ceph/mon/ceph-a/keyring", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_backend": "rocksdb", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_default_stripe_size": "65536", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_fsck_on_mount": "false", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_fsck_on_mount_deep": "true", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_max_bytes": "67108864", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_max_ops": "512", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_nid_prealloc": "1024", 2024-04-24T13:30:40.069 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_onode_map_size": "1024", 2024-04-24T13:30:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_rocksdb_options": "compression=kNoCompression", 2024-04-24T13:30:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_sync_submit_transaction": "false", 2024-04-24T13:30:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: "kstore_sync_transaction": "false", 2024-04-24T13:30:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: "librados_thread_count": "2", 2024-04-24T13:30:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: "lockdep": "false", 2024-04-24T13:30:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: "lockdep_force_backtrace": "false", 2024-04-24T13:30:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: "log_coarse_timestamps": "true", 2024-04-24T13:30:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: "log_file": "/var/log/ceph/ceph-mon.a.log", 2024-04-24T13:30:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: "log_flush_on_exit": "false", 2024-04-24T13:30:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: "log_graylog_host": "127.0.0.1", 2024-04-24T13:30:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: "log_graylog_port": "12201", 2024-04-24T13:30:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: "log_max_new": "1000", 2024-04-24T13:30:40.070 INFO:teuthology.orchestra.run.smithi071.stdout: "log_max_recent": "10000", 2024-04-24T13:30:40.071 INFO:teuthology.orchestra.run.smithi071.stdout: "log_stderr_prefix": "", 2024-04-24T13:30:40.071 INFO:teuthology.orchestra.run.smithi071.stdout: "log_stop_at_utilization": "0.970000", 2024-04-24T13:30:40.071 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_file": "true", 2024-04-24T13:30:40.071 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_graylog": "false", 2024-04-24T13:30:40.071 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_journald": "false", 2024-04-24T13:30:40.071 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_stderr": "false", 2024-04-24T13:30:40.071 INFO:teuthology.orchestra.run.smithi071.stdout: "log_to_syslog": "false", 2024-04-24T13:30:40.071 INFO:teuthology.orchestra.run.smithi071.stdout: "max_rotating_auth_attempts": "10", 2024-04-24T13:30:40.071 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_abort_on_newly_corrupt_dentry": "true", 2024-04-24T13:30:40.071 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_action_on_write_error": "1", 2024-04-24T13:30:40.071 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_alternate_name_max": "8192", 2024-04-24T13:30:40.071 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_asio_thread_count": "2", 2024-04-24T13:30:40.071 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_export_pin": "true", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_fragment_dirs": "true", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_fragment_fast_factor": "1.500000", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_fragment_interval": "5", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_fragment_size_max": "100000", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_idle_threshold": "0.000000", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_interval": "10", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_max": "-1", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_max_until": "-1", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_merge_size": "50", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_midchunk": "0.300000", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_min_rebalance": "0.100000", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_min_start": "0.200000", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_minchunk": "0.001000", 2024-04-24T13:30:40.072 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_mode": "0", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_need_max": "1.200000", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_need_min": "0.800000", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_overload_epochs": "2", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_replicate_threshold": "8000.000000", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_sample_interval": "3.000000", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_split_bits": "3", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_split_rd": "25000.000000", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_split_size": "10000", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_split_wr": "10000.000000", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_target_decay": "10.000000", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_bal_unreplicate_threshold": "0.000000", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_beacon_grace": "15.000000", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_beacon_interval": "4.000000", 2024-04-24T13:30:40.073 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_beacon_mon_down_grace": "60", 2024-04-24T13:30:40.074 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_memory_limit": "4294967296", 2024-04-24T13:30:40.074 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_mid": "0.700000", 2024-04-24T13:30:40.074 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_quiesce_decay_rate": "1.000000", 2024-04-24T13:30:40.074 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_quiesce_delay": "0", 2024-04-24T13:30:40.074 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_quiesce_sleep": "200", 2024-04-24T13:30:40.074 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_quiesce_splitauth": "true", 2024-04-24T13:30:40.074 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_quiesce_threshold": "524288", 2024-04-24T13:30:40.074 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_release_free_interval": "10", 2024-04-24T13:30:40.074 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_reservation": "0.050000", 2024-04-24T13:30:40.074 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_trim_decay_rate": "1.000000", 2024-04-24T13:30:40.074 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_trim_interval": "1", 2024-04-24T13:30:40.074 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cache_trim_threshold": "262144", 2024-04-24T13:30:40.074 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cap_acquisition_throttle_retry_request_timeout": "0.500000", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_cap_revoke_eviction_timeout": "0.000000", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_client_delegate_inos_pct": "50", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_client_prealloc_inos": "1000", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_client_writeable_range_max_inc_objs": "1024", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_connect_bootstrapping": "false", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_damage_table_max_entries": "10000", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_data": "/var/lib/ceph/mds/ceph-a", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_debug_auth_pins": "false", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_debug_frag": "false", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_debug_scatterstat": "false", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_debug_subtrees": "false", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_decay_halflife": "5.000000", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_default_dir_hash": "2", 2024-04-24T13:30:40.075 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_defer_session_stale": "true", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_deny_all_reconnect": "false", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dir_keys_per_op": "16384", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dir_max_commit_size": "10", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dir_max_entries": "0", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dir_prefetch": "true", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dirstat_min_interval": "1.000000", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dump_cache_after_rejoin": "false", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dump_cache_on_map": "false", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dump_cache_threshold_file": "0", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_dump_cache_threshold_formatter": "1073741824", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_early_reply": "true", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_enable_op_tracker": "true", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_enforce_unique_name": "true", 2024-04-24T13:30:40.076 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_export_ephemeral_distributed": "true", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_export_ephemeral_distributed_factor": "2.000000", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_export_ephemeral_random": "true", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_export_ephemeral_random_max": "0.010000", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_extraordinary_events_dump_interval": "0", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_forward_all_requests_to_auth": "false", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_freeze_tree_timeout": "30.000000", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_fscrypt_last_block_max_size": "4096", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_go_bad_corrupt_dentry": "true", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_hack_allow_loading_invalid_metadata": "false", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_health_cache_threshold": "1.500000", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_health_summarize_threshold": "10", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_heartbeat_grace": "15.000000", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_heartbeat_reset_grace": "1000", 2024-04-24T13:30:40.077 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_health_dummy": "false", 2024-04-24T13:30:40.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_journal_corrupt_dentry_first": "0.000000", 2024-04-24T13:30:40.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_migrator_session_race": "false", 2024-04-24T13:30:40.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_rename_corrupt_dentry_first": "0.000000", 2024-04-24T13:30:40.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_skip_replaying_inotable": "false", 2024-04-24T13:30:40.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_inject_traceless_reply_probability": "0.000000", 2024-04-24T13:30:40.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_join_fs": "", 2024-04-24T13:30:40.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_journal_format": "1", 2024-04-24T13:30:40.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_create_at": "0", 2024-04-24T13:30:40.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_export_at": "0", 2024-04-24T13:30:40.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_import_at": "0", 2024-04-24T13:30:40.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_journal_at": "0", 2024-04-24T13:30:40.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_journal_expire_at": "0", 2024-04-24T13:30:40.078 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_journal_replay_at": "0", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_link_at": "0", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_mdstable_at": "0", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_openc_at": "0", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_rename_at": "0", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_shutdown_at": "0", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_kill_skip_replaying_inotable": "false", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_event_large_threshold": "524288", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_events_per_segment": "1024", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_major_segment_event_ratio": "12", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_max_events": "-1", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_max_segments": "128", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_pause": "false", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_segment_size": "0", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_skip_corrupt_events": "false", 2024-04-24T13:30:40.079 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_skip_unbounded_events": "false", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_trim_decay_rate": "1.000000", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_trim_threshold": "128", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_trim_upkeep_interval": "1000", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_log_warn_factor": "2.000000", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_caps_per_client": "1048576", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_completed_flushes": "100000", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_completed_requests": "100000", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_export_size": "20971520", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_file_recover": "32", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_purge_files": "64", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_purge_ops": "8192", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_purge_ops_per_pg": "0.500000", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_scrub_ops_in_progress": "5", 2024-04-24T13:30:40.080 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_max_snaps_per_dir": "100", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_metrics_update_interval": "2", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_min_caps_per_client": "100", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_min_caps_working_set": "10000", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_mon_shutdown_timeout": "5.000000", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_numa_node": "-1", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_oft_prefetch_dirfrags": "false", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_complaint_time": "30.000000", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_history_duration": "600", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_history_size": "20", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_history_slow_op_size": "20", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_history_slow_op_threshold": "10", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_op_log_threshold": "5", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_ping_grace": "15", 2024-04-24T13:30:40.081 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_ping_interval": "5", 2024-04-24T13:30:40.082 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_purge_queue_busy_flush_period": "1.000000", 2024-04-24T13:30:40.082 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_global_max_decay_threshold": "131072", 2024-04-24T13:30:40.082 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_max_caps": "30000", 2024-04-24T13:30:40.082 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_max_decay_rate": "1.500000", 2024-04-24T13:30:40.082 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_max_decay_threshold": "131072", 2024-04-24T13:30:40.082 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_warning_decay_rate": "60.000000", 2024-04-24T13:30:40.082 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_recall_warning_threshold": "262144", 2024-04-24T13:30:40.082 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_reconnect_timeout": "45.000000", 2024-04-24T13:30:40.082 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_replay_interval": "1.000000", 2024-04-24T13:30:40.082 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_replay_unsafe_with_closed_session": "false", 2024-04-24T13:30:40.082 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_request_load_average_decay_rate": "60.000000", 2024-04-24T13:30:40.082 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_root_ino_gid": "0", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_root_ino_uid": "0", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_scatter_nudge_interval": "5.000000", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server_dispatch_client_request_delay": "0", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_server_dispatch_killpoint_random": "0.000000", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_blocklist_on_evict": "true", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_blocklist_on_timeout": "true", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_cache_liveness_decay_rate": "300.000000", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_cache_liveness_magnitude": "10", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_cap_acquisition_decay_rate": "30.000000", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_cap_acquisition_throttle": "100000", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_max_caps_throttle_ratio": "1.100000", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_session_metadata_threshold": "16777216", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sessionmap_keys_per_op": "1024", 2024-04-24T13:30:40.083 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_shutdown_check": "0", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_skip_ino": "0", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_sleep_rank_change": "0.000000", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_snap_max_uid": "4294967294", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_snap_min_uid": "0", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_snap_rstat": "false", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_standby_replay_damaged": "false", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_symlink_recovery": "true", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_task_status_update_interval": "2.000000", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_thrash_exports": "0", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_thrash_fragments": "0", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_tick_interval": "5.000000", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_valgrind_exit": "false", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_verify_backtrace": "1", 2024-04-24T13:30:40.084 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_verify_scatter": "false", 2024-04-24T13:30:40.085 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_wipe_ino_prealloc": "false", 2024-04-24T13:30:40.085 INFO:teuthology.orchestra.run.smithi071.stdout: "mds_wipe_sessions": "false", 2024-04-24T13:30:40.085 INFO:teuthology.orchestra.run.smithi071.stdout: "mempool_debug": "false", 2024-04-24T13:30:40.085 INFO:teuthology.orchestra.run.smithi071.stdout: "memstore_debug_omit_block_device_write": "false", 2024-04-24T13:30:40.085 INFO:teuthology.orchestra.run.smithi071.stdout: "memstore_device_bytes": "1073741824", 2024-04-24T13:30:40.085 INFO:teuthology.orchestra.run.smithi071.stdout: "memstore_page_set": "false", 2024-04-24T13:30:40.085 INFO:teuthology.orchestra.run.smithi071.stdout: "memstore_page_size": "65536", 2024-04-24T13:30:40.085 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_client_bytes": "134217728", 2024-04-24T13:30:40.085 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_client_messages": "512", 2024-04-24T13:30:40.085 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_client_service_daemon_unregister_timeout": "1.000000", 2024-04-24T13:30:40.085 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_connect_retry_interval": "1.000000", 2024-04-24T13:30:40.085 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_data": "/var/lib/ceph/mgr/ceph-a", 2024-04-24T13:30:40.085 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_debug_aggressive_pg_num_changes": "false", 2024-04-24T13:30:40.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_disabled_modules": "", 2024-04-24T13:30:40.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_initial_modules": "restful iostat nfs", 2024-04-24T13:30:40.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_max_pg_creating": "1024", 2024-04-24T13:30:40.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_max_pg_num_change": "128", 2024-04-24T13:30:40.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_mds_bytes": "134217728", 2024-04-24T13:30:40.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_mds_messages": "128", 2024-04-24T13:30:40.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_module_path": "/usr/share/ceph/mgr", 2024-04-24T13:30:40.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_mon_bytes": "134217728", 2024-04-24T13:30:40.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_mon_messages": "128", 2024-04-24T13:30:40.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_osd_bytes": "536870912", 2024-04-24T13:30:40.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_osd_messages": "8192", 2024-04-24T13:30:40.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_pool": "true", 2024-04-24T13:30:40.086 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_service_beacon_grace": "60.000000", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_standby_modules": "true", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_stats_period": "5", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_stats_threshold": "5", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_tick_period": "2", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr_ttl_cache_expire_seconds": "0", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_accept_timeout_factor": "2.000000", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_allow_pool_delete": "true", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_allow_pool_size_one": "true", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_auth_validate_all_caps": "true", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cache_target_full_warn_ratio": "0.660000", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_clean_pg_upmaps_per_chunk": "256", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_bytes": "104857600", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_directed_command_retry": "2", 2024-04-24T13:30:40.087 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_interval": "3.000000", 2024-04-24T13:30:40.088 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_interval_backoff": "1.500000", 2024-04-24T13:30:40.088 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_interval_max_multiple": "10.000000", 2024-04-24T13:30:40.088 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_interval_min_multiple": "1.000000", 2024-04-24T13:30:40.088 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_hunt_parallel": "3", 2024-04-24T13:30:40.088 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_log_interval": "1.000000", 2024-04-24T13:30:40.088 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_max_log_entries_per_message": "1000", 2024-04-24T13:30:40.088 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_ping_interval": "10.000000", 2024-04-24T13:30:40.088 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_ping_timeout": "30.000000", 2024-04-24T13:30:40.088 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_client_target_rank": "-1", 2024-04-24T13:30:40.088 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_clock_drift_allowed": "1.000000", 2024-04-24T13:30:40.088 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_clock_drift_warn_backoff": "5.000000", 2024-04-24T13:30:40.088 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_file": "default=/var/log/ceph/ceph.$channel.log cluster=/var/log/ceph/ceph.log", 2024-04-24T13:30:40.088 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_level": "debug", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_file": "true", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_graylog": "false", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_graylog_host": "127.0.0.1", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_graylog_port": "12201", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_journald": "false", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_stderr": "false", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_syslog": "default=false", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cluster_log_to_syslog_facility": "daemon", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_compact_on_bootstrap": "false", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_compact_on_start": "false", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_compact_on_trim": "true", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_con_tracker_persist_interval": "10", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_con_tracker_score_halflife": "43200", 2024-04-24T13:30:40.089 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_config_key_max_entry_size": "65536", 2024-04-24T13:30:40.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_cpu_threads": "4", 2024-04-24T13:30:40.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_crush_min_required_version": "hammer", 2024-04-24T13:30:40.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_daemon_bytes": "419430400", 2024-04-24T13:30:40.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_data": "/var/lib/ceph/mon/ceph-a", 2024-04-24T13:30:40.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_data_avail_crit": "5", 2024-04-24T13:30:40.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_data_avail_warn": "5", 2024-04-24T13:30:40.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_data_size_warn": "16106127360", 2024-04-24T13:30:40.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_block_osdmap_trim": "false", 2024-04-24T13:30:40.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_deprecated_as_obsolete": "false", 2024-04-24T13:30:40.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_dump_json": "false", 2024-04-24T13:30:40.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_dump_location": "/var/log/ceph/ceph-mon.a.tdump", 2024-04-24T13:30:40.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_dump_transactions": "false", 2024-04-24T13:30:40.090 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_extra_checks": "false", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_no_initial_persistent_features": "false", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_no_require_bluestore_for_ec_overwrites": "false", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_no_require_reef": "false", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_no_require_squid": "false", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_debug_unsafe_allow_tier_with_nonempty_snaps": "false", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_delta_reset_interval": "10.000000", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_dns_srv_name": "ceph-mon", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_down_mkfs_grace": "120", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_down_uptime_grace": "60", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_election_default_strategy": "1", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_election_timeout": "5.000000", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_elector_ignore_propose_margin": "0.000500", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_elector_ping_divisor": "2", 2024-04-24T13:30:40.091 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_elector_ping_timeout": "2.000000", 2024-04-24T13:30:40.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_enable_op_tracker": "true", 2024-04-24T13:30:40.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_fake_pool_delete": "false", 2024-04-24T13:30:40.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_force_quorum_join": "false", 2024-04-24T13:30:40.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_globalid_prealloc": "10000", 2024-04-24T13:30:40.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_detail_to_clog": "false", 2024-04-24T13:30:40.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_log_update_period": "5", 2024-04-24T13:30:40.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_max_detail": "50", 2024-04-24T13:30:40.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_to_clog": "true", 2024-04-24T13:30:40.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_to_clog_interval": "600", 2024-04-24T13:30:40.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_health_to_clog_tick_interval": "60.000000", 2024-04-24T13:30:40.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_host": "172.21.15.71,[v2:172.21.15.71:3301,v1:172.21.15.71:6790],172.21.15.138", 2024-04-24T13:30:40.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_host_override": "", 2024-04-24T13:30:40.092 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_initial_members": "", 2024-04-24T13:30:40.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_inject_pg_merge_bounce_probability": "0.000000", 2024-04-24T13:30:40.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_inject_sync_get_chunk_delay": "0.000000", 2024-04-24T13:30:40.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_inject_transaction_delay_max": "10.000000", 2024-04-24T13:30:40.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_inject_transaction_delay_probability": "0.000000", 2024-04-24T13:30:40.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_keyvaluedb": "rocksdb", 2024-04-24T13:30:40.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_lease": "5.000000", 2024-04-24T13:30:40.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_lease_ack_timeout_factor": "2.000000", 2024-04-24T13:30:40.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_lease_renew_interval_factor": "0.600000", 2024-04-24T13:30:40.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_log_full_interval": "50", 2024-04-24T13:30:40.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_log_max": "10000", 2024-04-24T13:30:40.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_log_max_summary": "50", 2024-04-24T13:30:40.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_log_entries_per_event": "4096", 2024-04-24T13:30:40.093 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_log_epochs": "500", 2024-04-24T13:30:40.094 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_mdsmap_epochs": "500", 2024-04-24T13:30:40.094 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_mgrmap_epochs": "500", 2024-04-24T13:30:40.094 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_osd": "10000", 2024-04-24T13:30:40.094 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_pg_per_osd": "10000", 2024-04-24T13:30:40.094 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_pool_pg_num": "65536", 2024-04-24T13:30:40.094 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_max_snap_prune_per_epoch": "100", 2024-04-24T13:30:40.094 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mds_blocklist_interval": "86400.000000", 2024-04-24T13:30:40.094 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mds_force_trim_to": "0", 2024-04-24T13:30:40.094 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mds_skip_sanity": "false", 2024-04-24T13:30:40.094 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_memory_autotune": "true", 2024-04-24T13:30:40.094 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_memory_target": "2147483648", 2024-04-24T13:30:40.094 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_beacon_grace": "30", 2024-04-24T13:30:40.095 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_blocklist_interval": "86400.000000", 2024-04-24T13:30:40.095 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_digest_period": "5", 2024-04-24T13:30:40.095 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_inactive_grace": "60", 2024-04-24T13:30:40.095 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_mkfs_grace": "240", 2024-04-24T13:30:40.095 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_mgr_proxy_client_bytes_ratio": "0.300000", 2024-04-24T13:30:40.095 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_min_osdmap_epochs": "500", 2024-04-24T13:30:40.095 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_complaint_time": "30", 2024-04-24T13:30:40.095 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_history_duration": "600", 2024-04-24T13:30:40.095 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_history_size": "20", 2024-04-24T13:30:40.095 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_history_slow_op_size": "20", 2024-04-24T13:30:40.095 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_history_slow_op_threshold": "10", 2024-04-24T13:30:40.095 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_op_log_threshold": "5", 2024-04-24T13:30:40.095 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_adjust_down_out_interval": "true", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_adjust_heartbeat_grace": "true", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_auto_mark_auto_out_in": "true", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_auto_mark_in": "false", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_auto_mark_new_in": "true", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_backfillfull_ratio": "0.900000", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_blocklist_default_expire": "3600.000000", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_cache_size": "500", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_cache_size_min": "134217728", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_crush_smoke_test": "true", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_destroyed_out_interval": "600", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_down_out_interval": "600", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_down_out_subtree_limit": "rack", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_err_op_age_ratio": "128.000000", 2024-04-24T13:30:40.096 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_force_trim_to": "0", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_full_ratio": "0.950000", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_initial_require_min_compat_client": "luminous", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_laggy_halflife": "3600", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_laggy_max_interval": "300", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_laggy_weight": "0.300000", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_mapping_pgs_per_chunk": "4096", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_max_initial_pgs": "1024", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_min_down_reporters": "2", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_min_in_ratio": "0.750000", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_min_up_ratio": "0.300000", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_nearfull_ratio": "0.850000", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_prime_pg_temp": "true", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_prime_pg_temp_max_estimate": "0.250000", 2024-04-24T13:30:40.097 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_prime_pg_temp_max_time": "0.500000", 2024-04-24T13:30:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_report_timeout": "900", 2024-04-24T13:30:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_reporter_subtree_level": "osd", 2024-04-24T13:30:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_snap_trim_queue_warn_on": "32768", 2024-04-24T13:30:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_warn_num_repaired": "10", 2024-04-24T13:30:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osd_warn_op_age": "32.000000", 2024-04-24T13:30:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osdmap_full_prune_enabled": "true", 2024-04-24T13:30:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osdmap_full_prune_interval": "10", 2024-04-24T13:30:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osdmap_full_prune_min": "10000", 2024-04-24T13:30:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_osdmap_full_prune_txsize": "100", 2024-04-24T13:30:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_check_down_all_threshold": "0.500000", 2024-04-24T13:30:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_stuck_threshold": "60", 2024-04-24T13:30:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_warn_max_object_skew": "0.000000", 2024-04-24T13:30:40.098 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_warn_min_objects": "10000", 2024-04-24T13:30:40.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_warn_min_per_osd": "0", 2024-04-24T13:30:40.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pg_warn_min_pool_objects": "1000", 2024-04-24T13:30:40.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pool_quota_crit_threshold": "0", 2024-04-24T13:30:40.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_pool_quota_warn_threshold": "0", 2024-04-24T13:30:40.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_probe_timeout": "2.000000", 2024-04-24T13:30:40.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_reweight_max_change": "0.050000", 2024-04-24T13:30:40.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_reweight_max_osds": "4", 2024-04-24T13:30:40.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_reweight_min_bytes_per_osd": "10", 2024-04-24T13:30:40.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_reweight_min_pgs_per_osd": "4", 2024-04-24T13:30:40.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_rocksdb_options": "write_buffer_size=33554432,compression=kNoCompression,level_compaction_dynamic_level_bytes=true", 2024-04-24T13:30:40.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_inject_crc_mismatch": "0.000000", 2024-04-24T13:30:40.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_inject_missing_keys": "0.000000", 2024-04-24T13:30:40.099 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_interval": "86400", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_max_keys": "100", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_scrub_timeout": "300", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_session_timeout": "300", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_smart_report_timeout": "5", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_stat_smooth_intervals": "6", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_stretch_cluster_recovery_ratio": "0.600000", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_stretch_pool_min_size": "2", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_stretch_pool_size": "4", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_stretch_recovery_min_wait": "15.000000", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_subscribe_interval": "86400.000000", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_debug": "false", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_max_payload_keys": "2000", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_max_payload_size": "1048576", 2024-04-24T13:30:40.100 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_provider_kill_at": "0", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_requester_kill_at": "0", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_sync_timeout": "60.000000", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_target_pg_per_osd": "100", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_tick_interval": "5", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_timecheck_interval": "300.000000", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_timecheck_skew_interval": "30.000000", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_use_min_delay_socket": "false", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_older_version_delay": "604800", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_cache_pools_without_hit_sets": "true", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_crush_straw_calc_version_zero": "false", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_degraded_stretch_mode": "true", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_filestore_osds": "false", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_insecure_global_id_reclaim": "false", 2024-04-24T13:30:40.101 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_insecure_global_id_reclaim_allowed": "false", 2024-04-24T13:30:40.102 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_legacy_crush_tunables": "false", 2024-04-24T13:30:40.102 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_misplaced": "false", 2024-04-24T13:30:40.102 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_msgr2_not_enabled": "true", 2024-04-24T13:30:40.102 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_older_version": "true", 2024-04-24T13:30:40.102 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_osd_down_out_interval_zero": "false", 2024-04-24T13:30:40.102 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_pool_no_app": "true", 2024-04-24T13:30:40.102 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_pool_no_redundancy": "false", 2024-04-24T13:30:40.102 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_pool_pg_num_not_power_of_two": "false", 2024-04-24T13:30:40.102 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_slow_ping_ratio": "0.050000", 2024-04-24T13:30:40.102 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_slow_ping_time": "0.000000", 2024-04-24T13:30:40.102 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_on_too_few_osds": "false", 2024-04-24T13:30:40.102 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_pg_not_deep_scrubbed_ratio": "0.750000", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "mon_warn_pg_not_scrubbed_ratio": "0.500000", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "monmap": "", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_admin_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_admin_fid": "0x7200000000000001:0x0", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_ha_endpoint": "192.168.180.182@tcp:12345:1:1", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_my_endpoint": "192.168.180.182@tcp:12345:4:1", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_my_fid": "0x7200000000000001:0x0", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_profile_fid": "0x7000000000000001:0x0", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "motr_tracing_enabled": "false", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_op_threads": "3", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_buffer_size": "131072", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_cm": "false", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_device_name": "", 2024-04-24T13:30:40.103 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_dscp": "96", 2024-04-24T13:30:40.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_enable_hugepage": "false", 2024-04-24T13:30:40.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_gid_idx": "0", 2024-04-24T13:30:40.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_local_gid": "", 2024-04-24T13:30:40.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_polling_us": "1000", 2024-04-24T13:30:40.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_port_num": "1", 2024-04-24T13:30:40.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_receive_buffers": "32768", 2024-04-24T13:30:40.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_receive_queue_len": "4096", 2024-04-24T13:30:40.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_roce_ver": "1", 2024-04-24T13:30:40.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_send_buffers": "1024", 2024-04-24T13:30:40.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_sl": "3", 2024-04-24T13:30:40.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_support_srq": "true", 2024-04-24T13:30:40.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_rdma_type": "ib", 2024-04-24T13:30:40.104 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_async_reap_threshold": "5", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_before_connect": "false", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_ipv4": "true", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_ipv6": "false", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_msgr1": "true", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_msgr2": "true", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_port_max": "7568", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_port_min": "6800", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_prefer_ipv4": "false", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_retry_count": "3", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_bind_retry_delay": "5", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_client": "false", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_mds": "false", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_mgr": "false", 2024-04-24T13:30:40.105 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_mon": "false", 2024-04-24T13:30:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_blackhole_osd": "false", 2024-04-24T13:30:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_client_mode": "crc secure", 2024-04-24T13:30:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_cluster_mode": "crc secure", 2024-04-24T13:30:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_cluster_type": "", 2024-04-24T13:30:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_compress_secure": "false", 2024-04-24T13:30:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_connection_idle_timeout": "900", 2024-04-24T13:30:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_connection_ready_timeout": "10", 2024-04-24T13:30:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_crc_data": "true", 2024-04-24T13:30:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_crc_header": "true", 2024-04-24T13:30:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_bad_msg": "false", 2024-04-24T13:30:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_bug": "true", 2024-04-24T13:30:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_old_message": "true", 2024-04-24T13:30:40.106 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_skipped_message": "false", 2024-04-24T13:30:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_die_on_unhandled_msg": "false", 2024-04-24T13:30:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dispatch_throttle_bytes": "104857600", 2024-04-24T13:30:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_coremask": "0xF", 2024-04-24T13:30:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_debug_allow_loopback": "false", 2024-04-24T13:30:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_devs_allowlist": "", 2024-04-24T13:30:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_enable_tso": "true", 2024-04-24T13:30:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_gateway_ipv4_addr": "", 2024-04-24T13:30:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_host_ipv4_addr": "", 2024-04-24T13:30:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_hugepages": "", 2024-04-24T13:30:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_hw_flow_control": "true", 2024-04-24T13:30:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_hw_queue_weight": "1.000000", 2024-04-24T13:30:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_lro": "true", 2024-04-24T13:30:40.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_memory_channel": "4", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_netmask_ipv4_addr": "", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_pmd": "", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_port_id": "0", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dpdk_rx_buffer_count_per_core": "8192", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dump_corrupt_message_level": "1", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_dump_on_send": "false", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_initial_backoff": "0.200000", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_delay_max": "1.000000", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_delay_probability": "0.000000", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_delay_type": "", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_internal_delays": "0.000000", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_network_congestion": "0", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_inject_socket_failures": "0", 2024-04-24T13:30:40.108 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_learn_addr_from_peer": "true", 2024-04-24T13:30:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_max_accept_failures": "4", 2024-04-24T13:30:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_max_backoff": "15.000000", 2024-04-24T13:30:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_mon_client_mode": "secure crc", 2024-04-24T13:30:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_mon_cluster_mode": "secure crc", 2024-04-24T13:30:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_mon_service_mode": "secure crc", 2024-04-24T13:30:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_osd_compress_min_size": "1024", 2024-04-24T13:30:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_osd_compress_mode": "none", 2024-04-24T13:30:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_osd_compression_algorithm": "snappy", 2024-04-24T13:30:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_pq_max_tokens_per_priority": "16777216", 2024-04-24T13:30:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_pq_min_cost": "65536", 2024-04-24T13:30:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_public_type": "", 2024-04-24T13:30:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_service_mode": "crc secure", 2024-04-24T13:30:40.109 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_tcp_listen_backlog": "512", 2024-04-24T13:30:40.110 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_tcp_nodelay": "true", 2024-04-24T13:30:40.110 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_tcp_prefetch_max_size": "4096", 2024-04-24T13:30:40.110 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_tcp_rcvbuf": "0", 2024-04-24T13:30:40.110 INFO:teuthology.orchestra.run.smithi071.stdout: "ms_type": "async+posix", 2024-04-24T13:30:40.110 INFO:teuthology.orchestra.run.smithi071.stdout: "no_config_file": "false", 2024-04-24T13:30:40.110 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_completion_locks_per_session": "32", 2024-04-24T13:30:40.110 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_debug_inject_relock_delay": "false", 2024-04-24T13:30:40.110 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_inflight_op_bytes": "104857600", 2024-04-24T13:30:40.110 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_inflight_ops": "1024", 2024-04-24T13:30:40.110 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_inject_no_watch_ping": "false", 2024-04-24T13:30:40.110 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_retry_writes_after_first_reply": "false", 2024-04-24T13:30:40.110 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_tick_interval": "5.000000", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "objecter_timeout": "10.000000", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "objectstore_blackhole": "false", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "objectstore_debug_throw_on_failed_txc": "false", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "openssl_engine_opts": "", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_delay_time": "5.000000", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_hist_halflife": "1000", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_max_low_ops": "2", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_max_ops": "4", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_min_evict_effort": "0.100000", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_quantize_effort": "0.100000", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_agent_slop": "0.020000", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_aggregated_slow_ops_logging": "true", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_allow_recovery_below_min_size": "true", 2024-04-24T13:30:40.111 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_asio_thread_count": "2", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_async_recovery_min_cost": "100", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_auto_mark_unfound_lost": "false", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backfill_retry_interval": "30.000000", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backfill_scan_max": "512", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backfill_scan_min": "64", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backoff_on_degraded": "false", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backoff_on_peering": "false", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_backoff_on_unfound": "true", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_beacon_report_interval": "300", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bench_duration": "30", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bench_large_size_max_throughput": "104857600", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bench_max_block_size": "67108864", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_bench_small_size_max_iops": "100", 2024-04-24T13:30:40.112 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_blkin_trace_all": "false", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_blocked_scrub_grace_period": "120", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_calc_pg_upmaps_aggressively": "true", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_calc_pg_upmaps_aggressively_fast": "true", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_calc_pg_upmaps_local_fallback_retries": "100", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_check_for_log_corruption": "false", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_check_max_object_name_len_on_startup": "true", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_class_default_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_class_dir": "/usr/lib/rados-classes", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_class_load_list": "cephfs hello journal lock log numops otp rbd refcount rgw rgw_gc timeindex user version cas cmpomap queue 2pc_queue fifo", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_class_update_on_start": "true", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_client_message_cap": "256", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_client_message_size_cap": "524288000", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_client_op_priority": "63", 2024-04-24T13:30:40.113 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_client_watch_timeout": "30", 2024-04-24T13:30:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_command_max_records": "256", 2024-04-24T13:30:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_compact_on_start": "false", 2024-04-24T13:30:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_copyfrom_max_chunk": "8388608", 2024-04-24T13:30:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_crush_chooseleaf_type": "0", 2024-04-24T13:30:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_crush_initial_weight": "-1.000000", 2024-04-24T13:30:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_crush_update_on_start": "true", 2024-04-24T13:30:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_crush_update_weight_set": "true", 2024-04-24T13:30:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_data": "/var/lib/ceph/osd/ceph-a", 2024-04-24T13:30:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_crash_on_ignored_backoff": "false", 2024-04-24T13:30:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_deep_scrub_sleep": "0.000000", 2024-04-24T13:30:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_drop_ping_duration": "0", 2024-04-24T13:30:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_drop_ping_probability": "0.000000", 2024-04-24T13:30:40.114 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_feed_pullee": "-1", 2024-04-24T13:30:40.115 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_inject_copyfrom_error": "false", 2024-04-24T13:30:40.115 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_inject_dispatch_delay_duration": "0.100000", 2024-04-24T13:30:40.115 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_inject_dispatch_delay_probability": "0.000000", 2024-04-24T13:30:40.115 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_misdirected_ops": "false", 2024-04-24T13:30:40.115 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_no_acting_change": "false", 2024-04-24T13:30:40.115 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_no_purge_strays": "false", 2024-04-24T13:30:40.115 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_op_order": "false", 2024-04-24T13:30:40.115 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_pg_log_writeout": "false", 2024-04-24T13:30:40.115 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_pretend_recovery_active": "false", 2024-04-24T13:30:40.115 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_random_push_read_error": "0.000000", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_reject_backfill_probability": "0.000000", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_shutdown": "false", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_skip_full_check_in_backfill_reservation": "false", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_skip_full_check_in_recovery": "false", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_trim_objects": "false", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_verify_cached_snaps": "false", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_verify_missing_on_start": "false", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_verify_snaps": "false", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_debug_verify_stray_on_activate": "false", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_interval": "604800.000000", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_keys": "1024", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_large_omap_object_key_threshold": "200000", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_large_omap_object_value_sum_threshold": "1073741824", 2024-04-24T13:30:40.116 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_randomize_ratio": "0.150000", 2024-04-24T13:30:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_stride": "524288", 2024-04-24T13:30:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_deep_scrub_update_digest_min_age": "7200", 2024-04-24T13:30:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_default_data_pool_replay_window": "5", 2024-04-24T13:30:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_default_notify_timeout": "30", 2024-04-24T13:30:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_delete_sleep": "0.000000", 2024-04-24T13:30:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_delete_sleep_hdd": "5.000000", 2024-04-24T13:30:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_delete_sleep_hybrid": "1.000000", 2024-04-24T13:30:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_delete_sleep_ssd": "1.000000", 2024-04-24T13:30:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_discard_disconnected_ops": "true", 2024-04-24T13:30:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_enable_op_tracker": "true", 2024-04-24T13:30:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_erasure_code_plugins": "jerasure lrc", 2024-04-24T13:30:40.117 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_extblkdev_plugins": "vdo", 2024-04-24T13:30:40.118 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_failsafe_full_ratio": "0.970000", 2024-04-24T13:30:40.118 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_fast_fail_on_connection_refused": "true", 2024-04-24T13:30:40.118 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_fast_info": "true", 2024-04-24T13:30:40.118 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_fast_shutdown": "true", 2024-04-24T13:30:40.118 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_fast_shutdown_notify_mon": "true", 2024-04-24T13:30:40.118 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_fast_shutdown_timeout": "15", 2024-04-24T13:30:40.118 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_find_best_info_ignore_history_les": "false", 2024-04-24T13:30:40.118 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_force_auth_primary_missing_objects": "100", 2024-04-24T13:30:40.118 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_force_recovery_pg_log_entries_factor": "1.300000", 2024-04-24T13:30:40.118 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_function_tracing": "false", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_grace": "20", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_interval": "6", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_min_healthy_ratio": "0.330000", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_min_peers": "10", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_min_size": "2000", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_stale": "600", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_heartbeat_use_min_delay_socket": "false", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_hit_set_max_size": "100000", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_hit_set_min_size": "1000", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_hit_set_namespace": ".ceph-internal", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_ignore_stale_divergent_priors": "false", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_inject_bad_map_crc_probability": "0.000000", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_inject_failure_on_pg_removal": "false", 2024-04-24T13:30:40.119 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_journal": "/var/lib/ceph/osd/ceph-a/journal", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_journal_flush_on_shutdown": "true", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_journal_size": "5120", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_kill_backfill_at": "0", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_loop_before_reset_tphandle": "64", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_cache_size": "50", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_dedup": "true", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_message_max": "40", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_message_max_bytes": "10485760", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_map_share_max_epochs": "40", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_attr_name_len": "100", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_attr_size": "0", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_backfills": "1", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_markdown_count": "5", 2024-04-24T13:30:40.120 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_markdown_period": "600", 2024-04-24T13:30:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_object_name_len": "2048", 2024-04-24T13:30:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_object_namespace_len": "256", 2024-04-24T13:30:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_object_size": "134217728", 2024-04-24T13:30:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_omap_bytes_per_request": "1073741824", 2024-04-24T13:30:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_omap_entries_per_request": "1024", 2024-04-24T13:30:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_pg_blocked_by": "16", 2024-04-24T13:30:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_pg_log_entries": "10000", 2024-04-24T13:30:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_pg_per_osd_hard_ratio": "3.000000", 2024-04-24T13:30:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_pgls": "1024", 2024-04-24T13:30:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_push_cost": "8388608", 2024-04-24T13:30:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_push_objects": "10", 2024-04-24T13:30:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_scrubs": "3", 2024-04-24T13:30:40.121 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_snap_prune_intervals_per_epoch": "512", 2024-04-24T13:30:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_trimming_pgs": "2", 2024-04-24T13:30:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_write_op_reply_len": "64", 2024-04-24T13:30:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_max_write_size": "90", 2024-04-24T13:30:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_force_run_benchmark_on_init": "false", 2024-04-24T13:30:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_iops_capacity_threshold_hdd": "500.000000", 2024-04-24T13:30:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_iops_capacity_threshold_ssd": "80000.000000", 2024-04-24T13:30:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_max_capacity_iops_hdd": "315.000000", 2024-04-24T13:30:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_max_capacity_iops_ssd": "21500.000000", 2024-04-24T13:30:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_max_sequential_bandwidth_hdd": "157286400", 2024-04-24T13:30:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_max_sequential_bandwidth_ssd": "1258291200", 2024-04-24T13:30:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_override_recovery_settings": "false", 2024-04-24T13:30:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_profile": "balanced", 2024-04-24T13:30:40.122 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_anticipation_timeout": "0.000000", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_best_effort_lim": "0.000000", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_best_effort_res": "0.000000", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_best_effort_wgt": "1", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_recovery_lim": "0.000000", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_recovery_res": "0.000000", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_background_recovery_wgt": "1", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_client_lim": "0.000000", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_client_res": "0.000000", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_scheduler_client_wgt": "1", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mclock_skip_benchmark": "false", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_base": "805306368", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_cache_min": "134217728", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_cache_resize_interval": "1.000000", 2024-04-24T13:30:40.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_expected_fragmentation": "0.150000", 2024-04-24T13:30:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_target": "4294967296", 2024-04-24T13:30:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_target_autotune": "false", 2024-04-24T13:30:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_memory_target_cgroup_limit_ratio": "0.800000", 2024-04-24T13:30:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_min_pg_log_entries": "250", 2024-04-24T13:30:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_min_recovery_priority": "0", 2024-04-24T13:30:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_heartbeat_interval": "30", 2024-04-24T13:30:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_heartbeat_stat_stale": "3600", 2024-04-24T13:30:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_report_interval": "5", 2024-04-24T13:30:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_report_max_in_flight": "2", 2024-04-24T13:30:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_mon_shutdown_timeout": "5.000000", 2024-04-24T13:30:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_num_cache_shards": "32", 2024-04-24T13:30:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_num_op_tracker_shard": "32", 2024-04-24T13:30:40.124 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_numa_auto_affinity": "true", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_numa_node": "-1", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_numa_prefer_iface": "true", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_object_clean_region_max_num_intervals": "10", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_objecter_finishers": "1", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_objectstore": "bluestore", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_objectstore_fuse": "false", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_objectstore_tracing": "false", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_complaint_time": "30.000000", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_history_duration": "600", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_history_size": "20", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_history_slow_op_size": "20", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_history_slow_op_threshold": "10.000000", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_log_threshold": "5", 2024-04-24T13:30:40.125 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_shards": "0", 2024-04-24T13:30:40.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_shards_hdd": "5", 2024-04-24T13:30:40.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_shards_ssd": "8", 2024-04-24T13:30:40.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_threads_per_shard": "0", 2024-04-24T13:30:40.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_threads_per_shard_hdd": "1", 2024-04-24T13:30:40.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_num_threads_per_shard_ssd": "2", 2024-04-24T13:30:40.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_pq_max_tokens_per_priority": "4194304", 2024-04-24T13:30:40.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_pq_min_cost": "65536", 2024-04-24T13:30:40.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_queue": "mclock_scheduler", 2024-04-24T13:30:40.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_queue_cut_off": "high", 2024-04-24T13:30:40.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_thread_suicide_timeout": "150", 2024-04-24T13:30:40.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_op_thread_timeout": "15", 2024-04-24T13:30:40.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_open_classes_on_start": "true", 2024-04-24T13:30:40.126 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_os_flags": "0", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_peering_op_priority": "255", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_delete_cost": "1048576", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_delete_priority": "5", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_epoch_max_lag_factor": "2.000000", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_epoch_persisted_max_stale": "40", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_log_dups_tracked": "3000", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_log_trim_max": "10000", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_log_trim_min": "100", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_max_concurrent_snap_trims": "2", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_object_context_cache_count": "64", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_stat_report_interval_max_epochs": "500", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pg_stat_report_interval_max_seconds": "5", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_max_evict_check_size": "10", 2024-04-24T13:30:40.127 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_min_evict_age": "0", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_min_flush_age": "0", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_target_dirty_high_ratio": "0.600000", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_target_dirty_ratio": "0.400000", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_cache_target_full_ratio": "0.800000", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_crimson": "false", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_crush_rule": "-1", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_ec_fast_read": "false", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_erasure_code_profile": "plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_bulk": "false", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_hashpspool": "true", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_nodelete": "false", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_nopgchange": "false", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flag_nosizechange": "false", 2024-04-24T13:30:40.128 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_flags": "0", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_hit_set_bloom_fpp": "0.050000", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_min_size": "0", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_pg_autoscale_mode": "off", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_pg_num": "32", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_pgp_num": "0", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_read_lease_ratio": "0.800000", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_read_ratio": "70", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_size": "2", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_default_type": "replicated", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_erasure_code_stripe_unit": "4096", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_pool_use_gmt_hitset": "true", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_push_per_object_cost": "1000", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_read_ec_check_for_errors": "false", 2024-04-24T13:30:40.129 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recover_clone_overlap": "true", 2024-04-24T13:30:40.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recover_clone_overlap_limit": "10", 2024-04-24T13:30:40.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_cost": "20971520", 2024-04-24T13:30:40.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_delay_start": "0.000000", 2024-04-24T13:30:40.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_active": "0", 2024-04-24T13:30:40.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_active_hdd": "3", 2024-04-24T13:30:40.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_active_ssd": "10", 2024-04-24T13:30:40.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_chunk": "8388608", 2024-04-24T13:30:40.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_omap_entries_per_chunk": "8096", 2024-04-24T13:30:40.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_max_single_start": "1", 2024-04-24T13:30:40.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_op_priority": "3", 2024-04-24T13:30:40.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_op_warn_multiple": "16", 2024-04-24T13:30:40.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_priority": "5", 2024-04-24T13:30:40.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_retry_interval": "30.000000", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_sleep": "0.000000", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_sleep_hdd": "0.100000", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_sleep_hybrid": "0.025000", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_recovery_sleep_ssd": "0.000000", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_repair_during_recovery": "false", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_requested_scrub_priority": "120", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_rocksdb_iterator_bounds_enabled": "true", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_rollback_to_cluster_snap": "", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_auto_repair": "false", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_auto_repair_num_errors": "5", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_backoff_ratio": "0.660000", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_begin_hour": "0", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_begin_week_day": "0", 2024-04-24T13:30:40.131 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_chunk_max": "25", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_chunk_min": "5", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_cost": "52428800", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_disable_reservation_queuing": "false", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_during_recovery": "false", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_end_hour": "0", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_end_week_day": "0", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_event_cost": "4096", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_extended_sleep": "0.000000", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_interval_randomize_ratio": "0.500000", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_invalid_stats": "true", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_load_threshold": "0.500000", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_max_interval": "604800.000000", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_max_preemptions": "5", 2024-04-24T13:30:40.132 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_min_interval": "86400.000000", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_priority": "5", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_reservation_timeout": "300000", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_scrub_sleep": "0.000000", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_shallow_scrub_chunk_max": "100", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_shallow_scrub_chunk_min": "50", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_shutdown_pgref_assert": "false", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_skip_check_past_interval_bounds": "false", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_skip_data_digest": "false", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_smart_report_timeout": "5", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_cost": "1048576", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_priority": "5", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_sleep": "0.000000", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_sleep_hdd": "5.000000", 2024-04-24T13:30:40.133 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_sleep_hybrid": "2.000000", 2024-04-24T13:30:40.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_snap_trim_sleep_ssd": "0.000000", 2024-04-24T13:30:40.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_stats_update_period_not_scrubbing": "120", 2024-04-24T13:30:40.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_stats_update_period_scrubbing": "15", 2024-04-24T13:30:40.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_target_pg_log_entries_per_osd": "300000", 2024-04-24T13:30:40.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_target_transaction_size": "30", 2024-04-24T13:30:40.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_count": "4", 2024-04-24T13:30:40.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_grade_decay_rate": "20", 2024-04-24T13:30:40.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_period": "1200", 2024-04-24T13:30:40.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_search_last_n": "1", 2024-04-24T13:30:40.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_hit_set_type": "bloom", 2024-04-24T13:30:40.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_min_read_recency_for_promote": "1", 2024-04-24T13:30:40.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_min_write_recency_for_promote": "1", 2024-04-24T13:30:40.134 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_default_cache_mode": "writeback", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_promote_max_bytes_sec": "5242880", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tier_promote_max_objects_sec": "25", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_tracing": "false", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_use_stale_snap": "false", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_uuid": "00000000-0000-0000-0000-000000000000", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "osdc_blkin_trace_all": "false", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_kill_at": "0", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_max_join_drift": "10", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_min": "500", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_min_wait": "0.050000", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_propose_interval": "1.000000", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_service_trim_max": "500", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_service_trim_max_multiplier": "20", 2024-04-24T13:30:40.135 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_service_trim_min": "250", 2024-04-24T13:30:40.136 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_stash_full_interval": "25", 2024-04-24T13:30:40.136 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_trim_max": "500", 2024-04-24T13:30:40.136 INFO:teuthology.orchestra.run.smithi071.stdout: "paxos_trim_min": "250", 2024-04-24T13:30:40.136 INFO:teuthology.orchestra.run.smithi071.stdout: "perf": "true", 2024-04-24T13:30:40.136 INFO:teuthology.orchestra.run.smithi071.stdout: "pid_file": "/var/run/ceph/ceph-mon.a.pid", 2024-04-24T13:30:40.136 INFO:teuthology.orchestra.run.smithi071.stdout: "plugin_crypto_accelerator": "crypto_isal", 2024-04-24T13:30:40.136 INFO:teuthology.orchestra.run.smithi071.stdout: "plugin_dir": "/usr/lib/ceph", 2024-04-24T13:30:40.136 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "-", 2024-04-24T13:30:40.136 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrv": "", 2024-04-24T13:30:40.136 INFO:teuthology.orchestra.run.smithi071.stdout: "public_bind_addr": "-", 2024-04-24T13:30:40.136 INFO:teuthology.orchestra.run.smithi071.stdout: "public_network": "", 2024-04-24T13:30:40.136 INFO:teuthology.orchestra.run.smithi071.stdout: "public_network_interface": "", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "qat_compressor_enabled": "false", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "qat_compressor_session_max_number": "256", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rados_mon_op_timeout": "0", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rados_osd_op_timeout": "0", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rados_tracing": "false", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_atime_update_interval": "60", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_auto_exclusive_lock_until_manual_request": "true", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_balance_parent_reads": "false", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_balance_snap_reads": "false", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_blkin_trace_all": "false", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_blocklist_expire_seconds": "0", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_blocklist_on_break_lock": "true", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache": "true", 2024-04-24T13:30:40.137 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_block_writes_upfront": "false", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_max_dirty": "25165824", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_max_dirty_age": "1.000000", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_max_dirty_object": "0", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_policy": "writearound", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_size": "33554432", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_target_dirty": "16777216", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_cache_writethrough_until_flush": "true", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_clone_copy_on_read": "false", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_compression_hint": "none", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_concurrent_management_ops": "10", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_config_pool_override_update_timestamp": "0", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_clone_format": "auto", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_data_pool": "", 2024-04-24T13:30:40.138 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_features": "61", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_format": "2", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_map_options": "", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_order": "22", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_pool": "rbd", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_snapshot_quiesce_mode": "required", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_stripe_count": "0", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_default_stripe_unit": "0", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_disable_zero_copy_writes": "true", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_discard_granularity_bytes": "65536", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_discard_on_zeroed_write_same": "true", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_enable_alloc_hint": "true", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_invalidate_object_map_on_timeout": "true", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_io_scheduler": "simple", 2024-04-24T13:30:40.139 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_io_scheduler_simple_max_delay": "0", 2024-04-24T13:30:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_commit_age": "5.000000", 2024-04-24T13:30:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_max_concurrent_object_sets": "0", 2024-04-24T13:30:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_max_payload_bytes": "16384", 2024-04-24T13:30:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_flush_age": "0.000000", 2024-04-24T13:30:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_flush_bytes": "1048576", 2024-04-24T13:30:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_flush_interval": "0", 2024-04-24T13:30:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_max_in_flight_appends": "0", 2024-04-24T13:30:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_object_writethrough_until_flush": "true", 2024-04-24T13:30:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_order": "24", 2024-04-24T13:30:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_pool": "", 2024-04-24T13:30:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_journal_splay_width": "4", 2024-04-24T13:30:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_localize_parent_reads": "false", 2024-04-24T13:30:40.140 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_localize_snap_reads": "false", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_concurrent_image_deletions": "1", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_concurrent_image_syncs": "5", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_delete_retry_interval": "30.000000", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_perf_stats_prio": "5", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_policy_migration_throttle": "300", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_policy_rebalance_timeout": "0.000000", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_policy_type": "simple", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_policy_update_throttle_interval": "1.000000", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_image_state_check_interval": "30", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_journal_commit_age": "5.000000", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_journal_poll_age": "5.000000", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_leader_heartbeat_interval": "5", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_leader_max_acquire_attempts_before_break": "3", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_leader_max_missed_heartbeats": "2", 2024-04-24T13:30:40.141 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_autotune": "true", 2024-04-24T13:30:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_base": "805306368", 2024-04-24T13:30:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_cache_autotune_interval": "30.000000", 2024-04-24T13:30:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_cache_min": "134217728", 2024-04-24T13:30:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_cache_resize_interval": "5.000000", 2024-04-24T13:30:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_expected_fragmentation": "0.150000", 2024-04-24T13:30:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_memory_target": "4294967296", 2024-04-24T13:30:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_perf_stats_prio": "5", 2024-04-24T13:30:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_pool_replayers_refresh_interval": "30", 2024-04-24T13:30:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirror_sync_point_update_age": "30.000000", 2024-04-24T13:30:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirroring_delete_delay": "0", 2024-04-24T13:30:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirroring_max_mirroring_snapshots": "5", 2024-04-24T13:30:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirroring_replay_delay": "0", 2024-04-24T13:30:40.142 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mirroring_resync_after_disconnect": "false", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_move_parent_to_trash_on_remove": "false", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_move_to_trash_on_remove": "false", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_move_to_trash_on_remove_expire_seconds": "0", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_mtime_update_interval": "60", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_non_blocking_aio": "true", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_op_thread_timeout": "60", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_op_threads": "1", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_parent_cache_enabled": "false", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_persistent_cache_mode": "disabled", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_persistent_cache_path": "/tmp", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_persistent_cache_size": "1073741824", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_plugins": "", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_bps_burst": "0", 2024-04-24T13:30:40.143 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_bps_burst_seconds": "1", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_bps_limit": "0", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_exclude_ops": "0", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_iops_burst": "0", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_iops_burst_seconds": "1", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_iops_limit": "0", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_bps_burst": "0", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_bps_burst_seconds": "1", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_bps_limit": "0", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_iops_burst": "0", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_iops_burst_seconds": "1", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_read_iops_limit": "0", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_schedule_tick_min": "50", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_bps_burst": "0", 2024-04-24T13:30:40.144 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_bps_burst_seconds": "1", 2024-04-24T13:30:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_bps_limit": "0", 2024-04-24T13:30:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_iops_burst": "0", 2024-04-24T13:30:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_iops_burst_seconds": "1", 2024-04-24T13:30:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_qos_write_iops_limit": "0", 2024-04-24T13:30:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_quiesce_notification_attempts": "10", 2024-04-24T13:30:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_read_from_replica_policy": "default", 2024-04-24T13:30:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_readahead_disable_after_bytes": "52428800", 2024-04-24T13:30:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_readahead_max_bytes": "524288", 2024-04-24T13:30:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_readahead_trigger_requests": "10", 2024-04-24T13:30:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_request_timed_out_seconds": "30", 2024-04-24T13:30:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_skip_partial_discard": "true", 2024-04-24T13:30:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_sparse_read_threshold_bytes": "65536", 2024-04-24T13:30:40.145 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_tracing": "false", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_validate_names": "true", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd_validate_pool": "true", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "restapi_base_url": "", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "restapi_log_level": "", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_account_default_quota_max_objects": "-1", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_account_default_quota_max_size": "-1", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_acl_grants_max_num": "100", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_admin_entry": "admin", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_allow_notification_secrets_in_cleartext": "false", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_backend_store": "rados", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_barbican_url": "", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_beast_enable_async": "true", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_counters_cache": "false", 2024-04-24T13:30:40.146 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_counters_cache_size": "10000", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_default_quota_max_objects": "-1", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_default_quota_max_size": "-1", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_index_max_aio": "128", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_index_transaction_instrumentation": "false", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_quota_cache_size": "10000", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_quota_ttl": "600", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_bucket_sync_spawn_window": "20", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cache_enabled": "true", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cache_expiry_interval": "900", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cache_lru_size": "25000", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_config_store": "rados", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_content_length_compat": "false", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_copy_obj_progress": "true", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_copy_obj_progress_every_bytes": "1048576", 2024-04-24T13:30:40.147 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cors_rules_max_num": "100", 2024-04-24T13:30:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_cross_domain_policy": "", 2024-04-24T13:30:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_default_encryption_key": "", 2024-04-24T13:30:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_addr": "", 2024-04-24T13:30:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_ca_path": "", 2024-04-24T13:30:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_client_cert": "", 2024-04-24T13:30:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_client_key": "", 2024-04-24T13:30:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_kms_key_template": "", 2024-04-24T13:30:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_password": "", 2024-04-24T13:30:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_s3_key_template": "$keyid", 2024-04-24T13:30:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_kmip_username": "", 2024-04-24T13:30:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_require_ssl": "true", 2024-04-24T13:30:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_s3_kms_backend": "barbican", 2024-04-24T13:30:40.148 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_s3_kms_encryption_keys": "", 2024-04-24T13:30:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_backend": "vault", 2024-04-24T13:30:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_key_template": "%bucket_id", 2024-04-24T13:30:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_addr": "", 2024-04-24T13:30:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_auth": "token", 2024-04-24T13:30:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_namespace": "", 2024-04-24T13:30:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_prefix": "", 2024-04-24T13:30:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_secret_engine": "transit", 2024-04-24T13:30:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_ssl_cacert": "", 2024-04-24T13:30:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_ssl_clientcert": "", 2024-04-24T13:30:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_ssl_clientkey": "", 2024-04-24T13:30:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_token_file": "", 2024-04-24T13:30:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_sse_s3_vault_verify_ssl": "true", 2024-04-24T13:30:40.149 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_suppress_logs": "true", 2024-04-24T13:30:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_addr": "", 2024-04-24T13:30:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_auth": "token", 2024-04-24T13:30:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_namespace": "", 2024-04-24T13:30:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_prefix": "", 2024-04-24T13:30:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_secret_engine": "transit", 2024-04-24T13:30:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_ssl_cacert": "", 2024-04-24T13:30:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_ssl_clientcert": "", 2024-04-24T13:30:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_ssl_clientkey": "", 2024-04-24T13:30:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_token_file": "", 2024-04-24T13:30:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_crypt_vault_verify_ssl": "true", 2024-04-24T13:30:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_curl_buffersize": "524288", 2024-04-24T13:30:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_curl_low_speed_limit": "1024", 2024-04-24T13:30:40.150 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_curl_low_speed_time": "300", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_curl_tcp_keepalive": "0", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_curl_wait_timeout_ms": "1000", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_l1_datacache_persistent_path": "/tmp/rgw_datacache/", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_l1_datacache_size": "1073741824", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_l1_evict_cache_on_start": "true", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_l1_eviction_policy": "lru", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_l1_fadvise": "4", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_l1_local_datacache_enabled": "false", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_libaio_aio_num": "64", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d3n_libaio_aio_threads": "20", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_host": "127.0.0.1", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_l1_datacache_persistent_path": "/tmp/rgw_d4n_datacache/", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_l1_datacache_size": "1073741824", 2024-04-24T13:30:40.151 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_l1_evict_cache_on_start": "true", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_l1_fadvise": "4", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_libaio_aio_num": "64", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_libaio_aio_threads": "20", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_d4n_port": "6379", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data": "/var/lib/ceph/radosgw/ceph-a", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_log_changes_size": "1000", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_log_num_shards": "128", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_log_obj_prefix": "data_log", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_log_window": "30", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_notify_interval_msec": "0", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_sync_poll_interval": "20", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_data_sync_spawn_window": "20", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_debug_inject_latency_bi_unlink": "0", 2024-04-24T13:30:40.152 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_debug_inject_olh_cancel_modification_err": "false", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_debug_inject_set_olh_err": "0", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_data_log_backing": "fifo", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_realm_info_oid": "default.realm", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_region_info_oid": "default.region", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_zone_info_oid": "default.zone", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_default_zonegroup_info_oid": "default.zonegroup", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_defer_to_bucket_acls": "", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_delete_multi_obj_max_num": "1000", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_admin_lim": "0.000000", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_admin_res": "100.000000", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_admin_wgt": "100.000000", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_auth_lim": "0.000000", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_auth_res": "200.000000", 2024-04-24T13:30:40.153 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_auth_wgt": "100.000000", 2024-04-24T13:30:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_data_lim": "0.000000", 2024-04-24T13:30:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_data_res": "500.000000", 2024-04-24T13:30:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_data_wgt": "500.000000", 2024-04-24T13:30:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_metadata_lim": "0.000000", 2024-04-24T13:30:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_metadata_res": "500.000000", 2024-04-24T13:30:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dmclock_metadata_wgt": "500.000000", 2024-04-24T13:30:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dns_name": "", 2024-04-24T13:30:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dns_s3website_name": "", 2024-04-24T13:30:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_dynamic_resharding": "true", 2024-04-24T13:30:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_apis": "s3, s3website, swift, swift_auth, admin, sts, iam, notifications", 2024-04-24T13:30:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_gc_threads": "true", 2024-04-24T13:30:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_lc_threads": "true", 2024-04-24T13:30:40.154 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_ops_log": "false", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_quota_threads": "true", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_static_website": "false", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enable_usage_log": "false", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_enforce_swift_acls": "true", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_exit_timeout_secs": "120", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_expose_bucket": "false", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_extended_http_attrs": "", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_filter": "none", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_frontend_defaults": "beast ssl_certificate=config://rgw/cert/$realm/$zone.crt ssl_private_key=config://rgw/cert/$realm/$zone.key", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_frontends": "beast port=7480", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_concurrent_io": "10", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_deferred": "50", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_deferred_entries_size": "3072", 2024-04-24T13:30:40.155 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_objs": "32", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_queue_size": "134213632", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_max_trim_chunk": "16", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_obj_min_wait": "7200", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_processor_max_time": "3600", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_gc_processor_period": "3600", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_get_obj_max_req_size": "4194304", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_get_obj_window_size": "16777216", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_healthcheck_disabling_path": "", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ignore_get_invalid_range": "false", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_init_timeout": "300", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_inject_notify_timeout_probability": "0.000000", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_json_config": "/var/lib/ceph/radosgw/config.json", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_kafka_connection_idle": "300", 2024-04-24T13:30:40.156 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_kafka_message_timeout": "5000", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_kafka_sleep_timeout": "10", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_accepted_admin_roles": "", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_accepted_reader_roles": "", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_accepted_roles": "Member, admin", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_domain": "", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_password": "", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_password_path": "", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_project": "", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_tenant": "", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_token": "", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_token_path": "", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_admin_user": "", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_api_version": "2", 2024-04-24T13:30:40.157 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_domain": "", 2024-04-24T13:30:40.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_password": "", 2024-04-24T13:30:40.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_project": "", 2024-04-24T13:30:40.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_tenant": "", 2024-04-24T13:30:40.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_barbican_user": "", 2024-04-24T13:30:40.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_expired_token_cache_expiration": "3600", 2024-04-24T13:30:40.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_implicit_tenants": "false", 2024-04-24T13:30:40.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_service_token_accepted_roles": "admin", 2024-04-24T13:30:40.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_service_token_enabled": "false", 2024-04-24T13:30:40.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_token_cache_size": "10000", 2024-04-24T13:30:40.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_url": "", 2024-04-24T13:30:40.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_keystone_verify_ssl": "true", 2024-04-24T13:30:40.158 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_debug_interval": "-1", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_lock_max_time": "90", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_max_objs": "32", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_max_rules": "1000", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_max_worker": "3", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_max_wp_worker": "3", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lc_thread_delay": "0", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_binddn": "uid=admin,cn=users,dc=example,dc=com", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_dnattr": "uid", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_searchdn": "cn=users,cn=accounts,dc=example,dc=com", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_searchfilter": "", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_secret": "/etc/openldap/secret", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ldap_uri": "", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lfuda_sync_frequency": "60", 2024-04-24T13:30:40.159 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lifecycle_work_time": "00:00-06:00", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_list_bucket_min_readahead": "1000", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_list_buckets_max_chunk": "1000", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_local_cache_address": "127.0.0.1:6379", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_log_http_headers": "", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_log_nonexistent_bucket": "false", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_log_object_name": "%Y-%m-%d-%H-%i-%n", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_log_object_name_utc": "false", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_lua_max_memory_per_state": "128000", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_luarocks_location": "/tmp/rgw_luarocks/mon.a", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_attr_name_len": "0", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_attr_size": "0", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_attrs_num_in_req": "0", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_chunk_size": "4194304", 2024-04-24T13:30:40.160 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_concurrent_requests": "1024", 2024-04-24T13:30:40.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_copy_obj_concurrent_io": "10", 2024-04-24T13:30:40.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_dynamic_shards": "1999", 2024-04-24T13:30:40.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_listing_results": "1000", 2024-04-24T13:30:40.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_notify_retries": "10", 2024-04-24T13:30:40.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_objs_per_shard": "100000", 2024-04-24T13:30:40.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_put_param_size": "1048576", 2024-04-24T13:30:40.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_put_size": "5368709120", 2024-04-24T13:30:40.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_max_slo_entries": "1000", 2024-04-24T13:30:40.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_md_log_max_shards": "64", 2024-04-24T13:30:40.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_md_notify_interval_msec": "200", 2024-04-24T13:30:40.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_meta_sync_poll_interval": "20", 2024-04-24T13:30:40.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_meta_sync_spawn_window": "20", 2024-04-24T13:30:40.161 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_mime_types_file": "/etc/mime.types", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_mp_lock_max_time": "600", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_multi_obj_del_max_aio": "16", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_multipart_min_part_size": "5242880", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_multipart_part_upload_limit": "10000", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_fhcache_partitions": "3", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_fhcache_size": "2017", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_frontends": "rgw-nfs", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_lru_lane_hiwat": "911", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_lru_lanes": "5", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_max_gc": "300", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_namespace_expire_secs": "300", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_run_gc_threads": "false", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_run_lc_threads": "false", 2024-04-24T13:30:40.162 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_run_quota_threads": "false", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_run_sync_thread": "false", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_s3_fast_attrs": "false", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_nfs_write_completion_interval_s": "10", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_num_async_rados_threads": "32", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_num_control_oids": "8", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_numa_node": "-1", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_obj_stripe_size": "4194304", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_obj_tombstone_cache_size": "1000", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_objexp_chunk_size": "100", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_objexp_gc_interval": "600", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_objexp_hints_num_shards": "127", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_olh_pending_timeout_sec": "3600", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_op_thread_suicide_timeout": "0", 2024-04-24T13:30:40.163 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_op_thread_timeout": "600", 2024-04-24T13:30:40.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_op_tracing": "false", 2024-04-24T13:30:40.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_opa_token": "", 2024-04-24T13:30:40.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_opa_url": "", 2024-04-24T13:30:40.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_opa_verify_ssl": "true", 2024-04-24T13:30:40.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ops_log_data_backlog": "5242880", 2024-04-24T13:30:40.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ops_log_file_path": "/var/log/ceph/ops-log-ceph-mon.a.log", 2024-04-24T13:30:40.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ops_log_rados": "false", 2024-04-24T13:30:40.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_ops_log_socket_path": "", 2024-04-24T13:30:40.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_override_bucket_index_max_shards": "0", 2024-04-24T13:30:40.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_pending_bucket_index_op_expiration": "120", 2024-04-24T13:30:40.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_period_latest_epoch_info_oid": ".latest_epoch", 2024-04-24T13:30:40.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_period_push_interval": "2.000000", 2024-04-24T13:30:40.164 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_period_push_interval_max": "30.000000", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_period_root_pool": ".rgw.root", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_policy_reject_invalid_principals": "true", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_posix_base_path": "/tmp/rgw_posix_driver", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_posix_cache_lanes": "3", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_posix_cache_lmdb_count": "3", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_posix_cache_max_buckets": "100", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_posix_cache_partitions": "3", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_posix_database_root": "/var/lib/ceph/radosgw", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_print_continue": "true", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_print_prohibited_content_length": "false", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_put_obj_max_window_size": "67108864", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_put_obj_min_window_size": "16777216", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_rados_pool_autoscale_bias": "4.000000", 2024-04-24T13:30:40.165 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_rados_pool_recovery_priority": "5", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_rados_tracing": "false", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_realm": "", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_realm_id": "", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_realm_root_pool": ".rgw.root", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_region": "", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_region_root_pool": ".rgw.root", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_relaxed_region_enforcement": "false", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_relaxed_s3_bucket_names": "false", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_remote_addr_param": "REMOTE_ADDR", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_request_uri": "", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_batch_size": "64", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_bucket_lock_duration": "360", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_max_aio": "128", 2024-04-24T13:30:40.166 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_num_logs": "16", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_reshard_thread_interval": "600", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_resolve_cname": "false", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_rest_getusage_op_compat": "false", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_run_sync_thread": "true", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_disable_signature_url": "false", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_order": "sts, external, local", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_use_keystone": "false", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_use_ldap": "false", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_use_rados": "true", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_auth_use_sts": "false", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_client_max_sig_ver": "-1", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_s3_success_create_obj_status": "0", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_safe_max_objects_per_shard": "102400", 2024-04-24T13:30:40.167 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_scheduler_type": "throttler", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_script_uri": "", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_service_provider_name": "", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_shard_warning_threshold": "90.000000", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_client_id": "", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_client_secret": "", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_entry": "sts", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_key": "sts", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_max_session_duration": "43200", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_min_session_duration": "900", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sts_token_introspection_url": "", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_account_in_url": "false", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_auth_entry": "auth", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_auth_url": "", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_custom_header": "", 2024-04-24T13:30:40.168 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_enforce_content_length": "false", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_need_stats": "true", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_tenant_name": "", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_token_expiration": "86400", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_url": "", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_url_prefix": "swift", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_swift_versioning_enabled": "false", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_data_full_inject_err_probability": "0.000000", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_data_inject_err_probability": "0.000000", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_lease_period": "120", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_log_trim_concurrent_buckets": "4", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_log_trim_interval": "1200", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_log_trim_max_buckets": "16", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_log_trim_min_cold_buckets": "4", 2024-04-24T13:30:40.169 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_meta_inject_err_probability": "0.000000", 2024-04-24T13:30:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_obj_etag_verify": "false", 2024-04-24T13:30:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_trace_history_size": "4096", 2024-04-24T13:30:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_trace_per_node_log_size": "32", 2024-04-24T13:30:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_sync_trace_servicemap_update_interval": "10", 2024-04-24T13:30:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_thread_pool_size": "512", 2024-04-24T13:30:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_topic_persistency_max_retries": "0", 2024-04-24T13:30:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_topic_persistency_sleep_duration": "0", 2024-04-24T13:30:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_topic_persistency_time_to_live": "0", 2024-04-24T13:30:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_topic_require_publish_policy": "false", 2024-04-24T13:30:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_comment": "", 2024-04-24T13:30:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_createby": "", 2024-04-24T13:30:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_encoding": "", 2024-04-24T13:30:40.170 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_flag": "false", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_max_size": "5368709120", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_origin": "", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_sha_unit": "524288", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_torrent_tracker": "", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_trust_forwarded_https": "false", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_usage_log_flush_threshold": "1024", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_usage_log_tick_interval": "30", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_usage_max_shards": "32", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_usage_max_user_shards": "1", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_use_opa_authz": "false", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_counters_cache": "false", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_counters_cache_size": "10000", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_default_quota_max_objects": "-1", 2024-04-24T13:30:40.171 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_default_quota_max_size": "-1", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_max_buckets": "1000", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_policies_max_num": "100", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_quota_bucket_sync_interval": "180", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_quota_sync_idle_users": "false", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_quota_sync_interval": "86400", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_quota_sync_wait_time": "86400", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_user_unique_email": "true", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_verify_ssl": "true", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_website_routing_rules_max_num": "50", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zone": "", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zone_id": "", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zone_root_pool": ".rgw.root", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zonegroup": "", 2024-04-24T13:30:40.172 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zonegroup_id": "", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw_zonegroup_root_pool": ".rgw.root", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rgwlc_auto_session_clear": "true", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rgwlc_skip_bucket_step": "false", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_block_size": "4096", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_bloom_bits_per_key": "20", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_index_and_filter_blocks": "true", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_index_and_filter_blocks_with_high_priority": "false", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_row_ratio": "0.000000", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_shard_bits": "4", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_size": "536870912", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cache_type": "binned_lru", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cf_compact_on_deletion": "true", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cf_compact_on_deletion_sliding_window": "32768", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_cf_compact_on_deletion_trigger": "16384", 2024-04-24T13:30:40.173 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_collect_compaction_stats": "false", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_collect_extended_stats": "false", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_collect_memory_stats": "false", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_delete_range_threshold": "1048576", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_index_type": "binary_search", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_log_to_ceph_log": "true", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_metadata_block_size": "4096", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_partition_filters": "false", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_perf": "false", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "rocksdb_pin_l0_filter_and_index_blocks_in_cache": "false", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "rotating_keys_bootstrap_timeout": "30", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "rotating_keys_renewal_timeout": "10", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "run_dir": "/var/run/ceph", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_block_create": "true", 2024-04-24T13:30:40.174 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_cache_lru_size": "67108864", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_cbjournal_size": "5368709120", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_data_delta_based_overwrite": "0", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_default_max_object_size": "16777216", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_default_object_metadata_reservation": "16777216", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_device_size": "53687091200", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_journal_batch_capacity": "16", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_journal_batch_flush_size": "16777216", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_journal_batch_preferred_fullness": "0.950000", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_journal_iodepth_limit": "5", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_main_device_type": "SSD", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_max_concurrent_transactions": "8", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_multiple_tiers_default_evict_ratio": "0.600000", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_multiple_tiers_fast_evict_ratio": "0.700000", 2024-04-24T13:30:40.175 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_multiple_tiers_stop_evict_ratio": "0.500000", 2024-04-24T13:30:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_obj_data_write_amplification": "1.250000", 2024-04-24T13:30:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "seastore_segment_size": "67108864", 2024-04-24T13:30:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "set_keepcaps": "false", 2024-04-24T13:30:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "setgroup": "", 2024-04-24T13:30:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "setuser": "", 2024-04-24T13:30:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "setuser_match_path": "", 2024-04-24T13:30:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_misplaced_ratio": "0.050000", 2024-04-24T13:30:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "thp": "false", 2024-04-24T13:30:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "threadpool_default_timeout": "60", 2024-04-24T13:30:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "threadpool_empty_queue_max_wait": "2", 2024-04-24T13:30:40.176 INFO:teuthology.orchestra.run.smithi071.stdout: "throttler_perf_counter": "true" 2024-04-24T13:30:40.176 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:40.178 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=0 2024-04-24T13:30:40.312 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a: {} 2024-04-24T13:30:40.312 INFO:teuthology.orchestra.run.smithi071.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-24T13:30:40.324 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b: {} 2024-04-24T13:30:40.324 INFO:teuthology.orchestra.run.smithi071.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-24T13:30:40.333 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c: {} 2024-04-24T13:30:40.333 INFO:teuthology.orchestra.run.smithi071.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-24T13:30:40.348 DEBUG:teuthology.orchestra.run.smithi138:> type ceph-objectstore-tool 2024-04-24T13:30:40.354 INFO:teuthology.orchestra.run.smithi138.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-24T13:30:40.354 DEBUG:teuthology.orchestra.run.smithi071:> type ceph-objectstore-tool 2024-04-24T13:30:40.358 INFO:teuthology.orchestra.run.smithi071.stdout:ceph-objectstore-tool is /usr/bin/ceph-objectstore-tool 2024-04-24T13:30:40.358 INFO:teuthology.run_tasks:Running task workunit... 2024-04-24T13:30:40.370 INFO:tasks.workunit:Pulling workunits from ref 882080b304cb1602e69c11bc5fe8479e7d2bc64d 2024-04-24T13:30:40.370 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-04-24T13:30:40.370 DEBUG:teuthology.orchestra.run.smithi071:> stat -- /home/ubuntu/cephtest/mnt.0 2024-04-24T13:30:40.371 INFO:tasks.thrashosds.thrasher:starting do_thrash 2024-04-24T13:30:40.371 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6, 7] out_osds: [] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-24T13:30:40.371 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-24T13:30:40.371 INFO:tasks.thrashosds.thrasher:starting do_sighup with a delay of 0.1 2024-04-24T13:30:40.372 INFO:tasks.thrashosds.thrasher:starting do_optrack_toggle with a delay of 2.0 2024-04-24T13:30:40.372 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:30:40.372 INFO:tasks.thrashosds.thrasher:starting do_dump_ops 2024-04-24T13:30:40.372 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:30:40.373 INFO:tasks.thrashosds.thrasher:starting do_noscrub_toggle with a delay of 2.0 2024-04-24T13:30:40.373 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:30:40.397 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:40.398+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:40.407 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T13:30:40.407 INFO:teuthology.orchestra.run.smithi071.stderr:stat: cannot statx '/home/ubuntu/cephtest/mnt.0': No such file or directory 2024-04-24T13:30:40.407 DEBUG:teuthology.orchestra.run.smithi071:> mkdir -- /home/ubuntu/cephtest/mnt.0 2024-04-24T13:30:40.459 INFO:tasks.workunit:Created dir /home/ubuntu/cephtest/mnt.0 2024-04-24T13:30:40.459 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/mnt.0 && mkdir -- client.0 2024-04-24T13:30:40.502 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:40.502+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:40.506 INFO:tasks.workunit:timeout=3h 2024-04-24T13:30:40.506 INFO:tasks.workunit:cleanup=True 2024-04-24T13:30:40.506 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://git.ceph.com/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 882080b304cb1602e69c11bc5fe8479e7d2bc64d 2024-04-24T13:30:40.520 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:40.520 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:40.520 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:30:40.520 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:40.525 INFO:tasks.workunit.client.0.smithi071.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-04-24T13:30:40.537 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:30:40.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:30:40.538 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:30:40.555 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:30:40.555 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:30:40.571 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:30:40.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:30:40.574 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:40.574+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:40.587 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:30:40.587 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:30:40.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:30:40.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:30:40.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:30:40.658 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:30:40.669 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:40.669 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:40.675 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:40.674+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:40.680 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:30:40.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:30:40.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:30:40.701 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:30:40.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:30:40.776 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:40.774+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:40.808 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:40.808 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:40.810 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.0 to 1 (10000) 2024-04-24T13:30:40.816 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:30:40.825 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:30:40.836 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-24T13:30:40.877 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:40.878+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:40.978 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:40.978+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:40.984 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:40.984 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:40.998 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:30:41.090 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:41.090+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:41.148 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:41.148 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:41.160 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:30:41.179 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:41.178+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:41.280 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:41.282+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:41.313 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:41.313 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:41.326 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:30:41.381 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:41.378+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:41.441 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:41.441 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:41.453 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:30:41.494 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:41.494+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:41.584 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:41.582+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:41.608 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:41.608 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:41.620 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:30:41.706 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:41.706+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:41.777 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:41.777 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:41.786 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:41.786+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:41.790 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:30:41.820 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.1 to 1 (10000) 2024-04-24T13:30:41.839 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-24T13:30:41.886 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:41.886+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:41.938 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:41.938 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:41.952 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:30:41.988 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:41.986+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:42.065 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:42.065 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:42.078 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:30:42.088 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:42.090+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:42.189 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:42.186+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:42.191 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:42.192 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:42.205 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:30:42.291 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:42.290+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:42.339 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:42.339 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:42.353 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:30:42.400 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:42.402+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:42.472 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:42.472 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:42.486 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:30:42.529 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:42.530+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:42.594 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:42.594+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:42.654 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:42.655 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:42.669 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:30:42.713 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:42.714+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:42.724 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:30:42.795 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:42.794+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:42.833 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.2 to 1 (10000) 2024-04-24T13:30:42.836 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:30:42.841 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:42.841 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:42.855 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:30:42.858 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-24T13:30:42.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:30:42.887 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:30:42.896 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:42.898+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:42.903 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:30:42.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:30:42.920 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:30:42.920 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:30:42.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:30:42.940 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:30:42.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:30:42.959 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:30:42.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:30:42.977 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:30:42.995 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:30:42.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:30:42.996 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:42.994+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:43.015 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:30:43.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:30:43.020 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:43.020 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:30:43.020 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:30:43.020 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:30:43.020 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:43.035 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:30:43.098 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:43.098+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:43.164 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:43.164 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:30:43.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:30:43.164 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:30:43.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.165 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:30:43.165 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:30:43.165 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.890854627, 2024-04-24T13:30:43.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003286134, 2024-04-24T13:30:43.165 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.165 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.166 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4440", 2024-04-24T13:30:43.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:30:43.166 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:30:43.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.166 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:30:43.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:30:43.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270374+0000", 2024-04-24T13:30:43.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9130000000000001e-06 2024-04-24T13:30:43.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270384+0000", 2024-04-24T13:30:43.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0023e-05 2024-04-24T13:30:43.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270410+0000", 2024-04-24T13:30:43.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5483e-05 2024-04-24T13:30:43.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270426+0000", 2024-04-24T13:30:43.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6413e-05 2024-04-24T13:30:43.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270524+0000", 2024-04-24T13:30:43.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8314999999999996e-05 2024-04-24T13:30:43.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270704+0000", 2024-04-24T13:30:43.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017929 2024-04-24T13:30:43.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:43.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270950+0000", 2024-04-24T13:30:43.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024601000000000001 2024-04-24T13:30:43.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.272837+0000", 2024-04-24T13:30:43.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018874600000000001 2024-04-24T13:30:43.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273498+0000", 2024-04-24T13:30:43.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066062100000000002 2024-04-24T13:30:43.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273589+0000", 2024-04-24T13:30:43.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.098e-05 2024-04-24T13:30:43.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273658+0000", 2024-04-24T13:30:43.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9626e-05 2024-04-24T13:30:43.177 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.177 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.177 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.178 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:43.178 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:43.178 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.882064759, 2024-04-24T13:30:43.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048388950000000002, 2024-04-24T13:30:43.178 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.179 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.179 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.179 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.179 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.179 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.179 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-24T13:30:43.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.180 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:43.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:43.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:30:43.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3799999999999998e-06 2024-04-24T13:30:43.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279193+0000", 2024-04-24T13:30:43.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7674e-05 2024-04-24T13:30:43.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279224+0000", 2024-04-24T13:30:43.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0654000000000002e-05 2024-04-24T13:30:43.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279244+0000", 2024-04-24T13:30:43.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:30:43.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279426+0000", 2024-04-24T13:30:43.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018255300000000001 2024-04-24T13:30:43.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279717+0000", 2024-04-24T13:30:43.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029043800000000001 2024-04-24T13:30:43.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:43.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279993+0000", 2024-04-24T13:30:43.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276786 2024-04-24T13:30:43.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282898+0000", 2024-04-24T13:30:43.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002904093 2024-04-24T13:30:43.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283731+0000", 2024-04-24T13:30:43.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00083382599999999997 2024-04-24T13:30:43.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283886+0000", 2024-04-24T13:30:43.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015512600000000001 2024-04-24T13:30:43.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284001+0000", 2024-04-24T13:30:43.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114405 2024-04-24T13:30:43.191 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.191 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.191 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.192 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410010339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:43.192 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:30:43.192 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.876940164000001, 2024-04-24T13:30:43.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044116340000000002, 2024-04-24T13:30:43.192 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.192 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.193 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.193 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-24T13:30:43.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.194 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:30:43.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:30:43.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284289+0000", 2024-04-24T13:30:43.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.125e-06 2024-04-24T13:30:43.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284299+0000", 2024-04-24T13:30:43.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0485999999999999e-05 2024-04-24T13:30:43.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284330+0000", 2024-04-24T13:30:43.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0528000000000003e-05 2024-04-24T13:30:43.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284345+0000", 2024-04-24T13:30:43.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4883e-05 2024-04-24T13:30:43.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284484+0000", 2024-04-24T13:30:43.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139708 2024-04-24T13:30:43.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284655+0000", 2024-04-24T13:30:43.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170953 2024-04-24T13:30:43.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:43.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284981+0000", 2024-04-24T13:30:43.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000325648 2024-04-24T13:30:43.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.287326+0000", 2024-04-24T13:30:43.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023452709999999999 2024-04-24T13:30:43.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288427+0000", 2024-04-24T13:30:43.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001100544 2024-04-24T13:30:43.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288551+0000", 2024-04-24T13:30:43.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012466500000000001 2024-04-24T13:30:43.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288698+0000", 2024-04-24T13:30:43.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146823 2024-04-24T13:30:43.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.203 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.204 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-24T13:30:43.204 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:30:43.204 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.897727279, 2024-04-24T13:30:43.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047820809999999997, 2024-04-24T13:30:43.204 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.205 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.205 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.205 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-24T13:30:43.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.206 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:30:43.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:30:43.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263503+0000", 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.039e-06 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263520+0000", 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7198e-05 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263548+0000", 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8158e-05 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263565+0000", 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7008e-05 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263754+0000", 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001894 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263973+0000", 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218593 2024-04-24T13:30:43.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:43.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.264373+0000", 2024-04-24T13:30:43.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040043400000000002 2024-04-24T13:30:43.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.266377+0000", 2024-04-24T13:30:43.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020033030000000001 2024-04-24T13:30:43.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268121+0000", 2024-04-24T13:30:43.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017441049999999999 2024-04-24T13:30:43.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268212+0000", 2024-04-24T13:30:43.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1490000000000007e-05 2024-04-24T13:30:43.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268282+0000", 2024-04-24T13:30:43.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9352999999999998e-05 2024-04-24T13:30:43.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.211 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.818015127000001, 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034252639999999999, 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 220 2024-04-24T13:30:43.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:30:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:30:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343214+0000", 2024-04-24T13:30:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:30:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343227+0000", 2024-04-24T13:30:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2941e-05 2024-04-24T13:30:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343259+0000", 2024-04-24T13:30:43.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1557000000000003e-05 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343274+0000", 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5401999999999999e-05 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343455+0000", 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018068700000000001 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343694+0000", 2024-04-24T13:30:43.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238552 2024-04-24T13:30:43.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:43.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.344088+0000", 2024-04-24T13:30:43.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039456400000000003 2024-04-24T13:30:43.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.345723+0000", 2024-04-24T13:30:43.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016349139999999999 2024-04-24T13:30:43.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346480+0000", 2024-04-24T13:30:43.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075738300000000004 2024-04-24T13:30:43.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346569+0000", 2024-04-24T13:30:43.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8281000000000004e-05 2024-04-24T13:30:43.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346637+0000", 2024-04-24T13:30:43.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8165999999999998e-05 2024-04-24T13:30:43.218 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.218 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.218 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.218 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.218 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:30:43.218 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.807321751, 2024-04-24T13:30:43.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032680679999999998, 2024-04-24T13:30:43.218 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.218 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.218 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.218 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.219 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.219 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.219 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 223 2024-04-24T13:30:43.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.219 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:30:43.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353907+0000", 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1560000000000002e-06 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353918+0000", 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0669000000000001e-05 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353948+0000", 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0329999999999999e-05 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353963+0000", 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4989e-05 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354076+0000", 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112704 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354300+0000", 2024-04-24T13:30:43.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022397000000000001 2024-04-24T13:30:43.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:43.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354729+0000", 2024-04-24T13:30:43.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042914100000000002 2024-04-24T13:30:43.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356223+0000", 2024-04-24T13:30:43.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001494219 2024-04-24T13:30:43.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356972+0000", 2024-04-24T13:30:43.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00074910099999999996 2024-04-24T13:30:43.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357059+0000", 2024-04-24T13:30:43.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6624000000000003e-05 2024-04-24T13:30:43.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357173+0000", 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114165 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.800274829999999, 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032957419999999999, 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.224 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360954+0000", 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.154e-06 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360965+0000", 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1321999999999999e-05 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360996+0000", 2024-04-24T13:30:43.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0902999999999999e-05 2024-04-24T13:30:43.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361012+0000", 2024-04-24T13:30:43.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:30:43.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361185+0000", 2024-04-24T13:30:43.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172072 2024-04-24T13:30:43.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361404+0000", 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021965999999999999 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361852+0000", 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000448276 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.363340+0000", 2024-04-24T13:30:43.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001487169 2024-04-24T13:30:43.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364094+0000", 2024-04-24T13:30:43.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075443699999999995 2024-04-24T13:30:43.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364184+0000", 2024-04-24T13:30:43.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9957000000000006e-05 2024-04-24T13:30:43.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364248+0000", 2024-04-24T13:30:43.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3627000000000006e-05 2024-04-24T13:30:43.230 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.230 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.230 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.230 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.230 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:30:43.230 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.796709983, 2024-04-24T13:30:43.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036426480000000001, 2024-04-24T13:30:43.230 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.230 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:30:43.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364519+0000", 2024-04-24T13:30:43.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-24T13:30:43.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364529+0000", 2024-04-24T13:30:43.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088999999999999e-05 2024-04-24T13:30:43.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364554+0000", 2024-04-24T13:30:43.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5537e-05 2024-04-24T13:30:43.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364568+0000", 2024-04-24T13:30:43.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3372e-05 2024-04-24T13:30:43.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364726+0000", 2024-04-24T13:30:43.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015809299999999999 2024-04-24T13:30:43.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365059+0000", 2024-04-24T13:30:43.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000333185 2024-04-24T13:30:43.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:43.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365758+0000", 2024-04-24T13:30:43.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069934299999999995 2024-04-24T13:30:43.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.367413+0000", 2024-04-24T13:30:43.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016552349999999999 2024-04-24T13:30:43.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368012+0000", 2024-04-24T13:30:43.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059858700000000003 2024-04-24T13:30:43.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368097+0000", 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5253999999999994e-05 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368159+0000", 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2113000000000007e-05 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.236 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.767323347, 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033998840000000002, 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:30:43.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:30:43.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393906+0000", 2024-04-24T13:30:43.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1569999999999998e-06 2024-04-24T13:30:43.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393917+0000", 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1348999999999999e-05 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393942+0000", 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.527e-05 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393957+0000", 2024-04-24T13:30:43.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4355999999999999e-05 2024-04-24T13:30:43.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394127+0000", 2024-04-24T13:30:43.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170555 2024-04-24T13:30:43.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394352+0000", 2024-04-24T13:30:43.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224539 2024-04-24T13:30:43.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394788+0000", 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043600099999999999 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.396137+0000", 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001349404 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397158+0000", 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001020738 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397237+0000", 2024-04-24T13:30:43.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9319000000000004e-05 2024-04-24T13:30:43.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397303+0000", 2024-04-24T13:30:43.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6196000000000001e-05 2024-04-24T13:30:43.242 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.242 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.242 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:237 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.756456712, 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003210517, 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 237 2024-04-24T13:30:43.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.244 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:30:43.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:30:43.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404772+0000", 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1830000000000001e-06 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404783+0000", 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1009000000000001e-05 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404814+0000", 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0822999999999999e-05 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404829+0000", 2024-04-24T13:30:43.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4808e-05 2024-04-24T13:30:43.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404965+0000", 2024-04-24T13:30:43.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013637299999999999 2024-04-24T13:30:43.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405107+0000", 2024-04-24T13:30:43.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142108 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405399+0000", 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029117900000000003 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.406507+0000", 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011081000000000001 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407732+0000", 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001225163 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407866+0000", 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013405599999999999 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407981+0000", 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114715 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.248 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.249 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:430 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.249 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:30:43.249 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.702739814999999, 2024-04-24T13:30:43.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031779590000000002, 2024-04-24T13:30:43.249 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.249 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.249 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.249 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.250 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.250 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.250 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-24T13:30:43.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.250 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:30:43.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458489+0000", 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458525+0000", 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5743e-05 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458556+0000", 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0284e-05 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458576+0000", 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0449999999999999e-05 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458738+0000", 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016177699999999999 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459047+0000", 2024-04-24T13:30:43.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030948400000000001 2024-04-24T13:30:43.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:43.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459499+0000", 2024-04-24T13:30:43.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045165199999999998 2024-04-24T13:30:43.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461152+0000", 2024-04-24T13:30:43.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001653477 2024-04-24T13:30:43.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461528+0000", 2024-04-24T13:30:43.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037554899999999998 2024-04-24T13:30:43.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461610+0000", 2024-04-24T13:30:43.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1914000000000002e-05 2024-04-24T13:30:43.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461665+0000", 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5105999999999997e-05 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.698482228, 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031563120000000001, 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.255 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 436 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462746+0000", 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8199999999999999e-06 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462756+0000", 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0005e-05 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462778+0000", 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1325e-05 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462794+0000", 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841e-05 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462940+0000", 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014605099999999999 2024-04-24T13:30:43.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463206+0000", 2024-04-24T13:30:43.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026634500000000003 2024-04-24T13:30:43.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:43.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463594+0000", 2024-04-24T13:30:43.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038760299999999998 2024-04-24T13:30:43.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465323+0000", 2024-04-24T13:30:43.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00172898 2024-04-24T13:30:43.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465593+0000", 2024-04-24T13:30:43.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027055500000000001 2024-04-24T13:30:43.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465747+0000", 2024-04-24T13:30:43.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015391999999999999 2024-04-24T13:30:43.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465901+0000", 2024-04-24T13:30:43.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153867 2024-04-24T13:30:43.261 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.261 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.261 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.261 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:437 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.261 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:30:43.261 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.697699753, 2024-04-24T13:30:43.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048056540000000003, 2024-04-24T13:30:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 437 2024-04-24T13:30:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:30:43.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:30:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463529+0000", 2024-04-24T13:30:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2479999999999999e-06 2024-04-24T13:30:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463544+0000", 2024-04-24T13:30:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:30:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463572+0000", 2024-04-24T13:30:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8294e-05 2024-04-24T13:30:43.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463590+0000", 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464092+0000", 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000502189 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464454+0000", 2024-04-24T13:30:43.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036231300000000001 2024-04-24T13:30:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464831+0000", 2024-04-24T13:30:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000377375 2024-04-24T13:30:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467473+0000", 2024-04-24T13:30:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026414659999999999 2024-04-24T13:30:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468185+0000", 2024-04-24T13:30:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071215199999999997 2024-04-24T13:30:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468271+0000", 2024-04-24T13:30:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5593999999999994e-05 2024-04-24T13:30:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468333+0000", 2024-04-24T13:30:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1957000000000003e-05 2024-04-24T13:30:43.267 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:531 6.4 e32/26 6:227f63b5:gc::gc.14:head v 32'13, mlcod=32'11)", 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.636468659, 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003260279, 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:30:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:30:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524760+0000", 2024-04-24T13:30:43.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4720000000000001e-06 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524771+0000", 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1270000000000001e-05 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524792+0000", 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1566e-05 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524805+0000", 2024-04-24T13:30:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2876e-05 2024-04-24T13:30:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524906+0000", 2024-04-24T13:30:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101084 2024-04-24T13:30:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524943+0000", 2024-04-24T13:30:43.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6538000000000002e-05 2024-04-24T13:30:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.527964+0000", 2024-04-24T13:30:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030210229999999999 2024-04-24T13:30:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.528018+0000", 2024-04-24T13:30:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4450000000000002e-05 2024-04-24T13:30:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.274 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:30:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.398645125, 2024-04-24T13:30:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032103409999999998, 2024-04-24T13:30:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.275 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-24T13:30:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:30:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:30:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762584+0000", 2024-04-24T13:30:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7039999999999999e-06 2024-04-24T13:30:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762597+0000", 2024-04-24T13:30:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2539e-05 2024-04-24T13:30:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762629+0000", 2024-04-24T13:30:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2116000000000002e-05 2024-04-24T13:30:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762644+0000", 2024-04-24T13:30:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5034999999999999e-05 2024-04-24T13:30:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762801+0000", 2024-04-24T13:30:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015653999999999999 2024-04-24T13:30:43.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763192+0000", 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000391529 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763747+0000", 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055497399999999996 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.764931+0000", 2024-04-24T13:30:43.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001184128 2024-04-24T13:30:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765643+0000", 2024-04-24T13:30:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071180500000000003 2024-04-24T13:30:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765726+0000", 2024-04-24T13:30:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3058000000000003e-05 2024-04-24T13:30:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765792+0000", 2024-04-24T13:30:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5913000000000004e-05 2024-04-24T13:30:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:30:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.292050004, 2024-04-24T13:30:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033442569999999998, 2024-04-24T13:30:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.281 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 793 2024-04-24T13:30:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:30:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:30:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869179+0000", 2024-04-24T13:30:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.323e-06 2024-04-24T13:30:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869190+0000", 2024-04-24T13:30:43.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869222+0000", 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1733999999999998e-05 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869237+0000", 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5044e-05 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869396+0000", 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158913 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869763+0000", 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367112 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.870319+0000", 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055558799999999998 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.871509+0000", 2024-04-24T13:30:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001190607 2024-04-24T13:30:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872365+0000", 2024-04-24T13:30:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085535299999999999 2024-04-24T13:30:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872449+0000", 2024-04-24T13:30:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3834999999999999e-05 2024-04-24T13:30:43.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872521+0000", 2024-04-24T13:30:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2428999999999994e-05 2024-04-24T13:30:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:30:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.106043632, 2024-04-24T13:30:43.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003340754, 2024-04-24T13:30:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 874 2024-04-24T13:30:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:30:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:30:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055185+0000", 2024-04-24T13:30:43.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:30:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055197+0000", 2024-04-24T13:30:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1606e-05 2024-04-24T13:30:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055229+0000", 2024-04-24T13:30:43.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1603000000000002e-05 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055244+0000", 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4928e-05 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055397+0000", 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015366499999999999 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055763+0000", 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036565600000000001 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.056317+0000", 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055436600000000004 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.057678+0000", 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001361283 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058258+0000", 2024-04-24T13:30:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057942400000000004 2024-04-24T13:30:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058407+0000", 2024-04-24T13:30:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000149188 2024-04-24T13:30:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058524+0000", 2024-04-24T13:30:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116805 2024-04-24T13:30:43.293 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:30:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.101324903, 2024-04-24T13:30:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032622950000000001, 2024-04-24T13:30:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.294 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 876 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059904+0000", 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.767e-06 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059912+0000", 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819999999999994e-06 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059934+0000", 2024-04-24T13:30:43.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2141e-05 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059949+0000", 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4285e-05 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060072+0000", 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012349400000000001 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060302+0000", 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022971999999999999 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060787+0000", 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048565400000000002 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062208+0000", 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014201870000000001 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062946+0000", 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073827699999999997 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063036+0000", 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9758000000000004e-05 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063164+0000", 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012852999999999999 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.299 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:924 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.9903932560000008, 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030953729999999998, 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.300 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 924 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170836+0000", 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1900000000000002e-06 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170847+0000", 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1109e-05 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170879+0000", 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2153000000000002e-05 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170898+0000", 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8785000000000001e-05 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171030+0000", 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013210300000000001 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171294+0000", 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026387600000000002 2024-04-24T13:30:43.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171790+0000", 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049596899999999997 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.172966+0000", 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011761 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173663+0000", 2024-04-24T13:30:43.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069701500000000005 2024-04-24T13:30:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173818+0000", 2024-04-24T13:30:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155427 2024-04-24T13:30:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173929+0000", 2024-04-24T13:30:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110646 2024-04-24T13:30:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.305 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.9243819999999996, 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032803860000000002, 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 952 2024-04-24T13:30:43.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236847+0000", 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236858+0000", 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0582e-05 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236900+0000", 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2463000000000003e-05 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236923+0000", 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2938e-05 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237071+0000", 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014795100000000001 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237365+0000", 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000293963 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237755+0000", 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039032599999999998 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239124+0000", 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136918 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239925+0000", 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080016699999999996 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240011+0000", 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6780999999999995e-05 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240125+0000", 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113862 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.311 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:43.313 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:30:43.313 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:43.310+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:43.414 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:43.414+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:43.492 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:43.492 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:30:43.492 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:30:43.492 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:43.506 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:30:43.514 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:43.514+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:43.615 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:43.614+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:43.630 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:30:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:30:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:30:43.630 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:43.644 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:30:43.717 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:43.714+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:43.809 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:30:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:30:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:30:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:30:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.565950063000001, 2024-04-24T13:30:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:30:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:30:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:30:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:30:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:30:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:30:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:30:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:30:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:30:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:30:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:30:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:30:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:30:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:30:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:30:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:30:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:30:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:30:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:30:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:30:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94410010338304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.531092349, 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077892999999999999, 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-24T13:30:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:30:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2770000000000001e-06 2024-04-24T13:30:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279179+0000", 2024-04-24T13:30:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3529999999999999e-05 2024-04-24T13:30:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279222+0000", 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2743000000000001e-05 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279272+0000", 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0649000000000002e-05 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279772+0000", 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000500013 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280011+0000", 2024-04-24T13:30:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023840499999999999 2024-04-24T13:30:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280408+0000", 2024-04-24T13:30:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039756999999999998 2024-04-24T13:30:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282501+0000", 2024-04-24T13:30:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020929159999999998 2024-04-24T13:30:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286583+0000", 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040820530000000004 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286748+0000", 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016431200000000001 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286951+0000", 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020383200000000001 2024-04-24T13:30:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.517846356, 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024753290000000001, 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292410+0000", 2024-04-24T13:30:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:30:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292419+0000", 2024-04-24T13:30:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8680000000000005e-06 2024-04-24T13:30:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292445+0000", 2024-04-24T13:30:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6207000000000002e-05 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292458+0000", 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292597+0000", 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013947100000000001 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292841+0000", 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024435599999999999 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.293085+0000", 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000243212 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294263+0000", 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001178171 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294758+0000", 2024-04-24T13:30:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049492199999999996 2024-04-24T13:30:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294824+0000", 2024-04-24T13:30:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6346000000000005e-05 2024-04-24T13:30:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294883+0000", 2024-04-24T13:30:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9222999999999999e-05 2024-04-24T13:30:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94410010333696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.515160467999999, 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023887449999999998, 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295096+0000", 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1660000000000001e-06 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295105+0000", 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6139999999999992e-06 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295131+0000", 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6633000000000001e-05 2024-04-24T13:30:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295146+0000", 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4168999999999999e-05 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295250+0000", 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104071 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295424+0000", 2024-04-24T13:30:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017425599999999999 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295726+0000", 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030180000000000002 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.296532+0000", 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080662400000000003 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297330+0000", 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00079793300000000002 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297392+0000", 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2112000000000004e-05 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297483+0000", 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0366999999999997e-05 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-24T13:30:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:30:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.515632196, 2024-04-24T13:30:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020133299999999998, 2024-04-24T13:30:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:30:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294623+0000", 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9999999999999996e-07 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294634+0000", 2024-04-24T13:30:43.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1292e-05 2024-04-24T13:30:43.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294666+0000", 2024-04-24T13:30:43.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1596e-05 2024-04-24T13:30:43.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294688+0000", 2024-04-24T13:30:43.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2561e-05 2024-04-24T13:30:43.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294842+0000", 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153494 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294893+0000", 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0983999999999998e-05 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296547+0000", 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016536890000000001 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296636+0000", 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8913999999999996e-05 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:215 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'2, mlcod=0'0)", 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.484466141, 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018794250000000001, 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.840 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325790+0000", 2024-04-24T13:30:43.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:30:43.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325809+0000", 2024-04-24T13:30:43.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8590999999999999e-05 2024-04-24T13:30:43.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325846+0000", 2024-04-24T13:30:43.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6875999999999997e-05 2024-04-24T13:30:43.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325868+0000", 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1585000000000001e-05 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325983+0000", 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115631 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.326022+0000", 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8618999999999997e-05 2024-04-24T13:30:43.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327579+0000", 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015573049999999999 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327668+0000", 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8588e-05 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:385 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'5, mlcod=32'2)", 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.374561807999999, 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020295980000000001, 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:30:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435694+0000", 2024-04-24T13:30:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:30:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435708+0000", 2024-04-24T13:30:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3525e-05 2024-04-24T13:30:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435733+0000", 2024-04-24T13:30:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5431000000000001e-05 2024-04-24T13:30:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435752+0000", 2024-04-24T13:30:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8465e-05 2024-04-24T13:30:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435897+0000", 2024-04-24T13:30:43.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014525000000000001 2024-04-24T13:30:43.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435963+0000", 2024-04-24T13:30:43.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6297000000000006e-05 2024-04-24T13:30:43.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437645+0000", 2024-04-24T13:30:43.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001681395 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437722+0000", 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7424999999999998e-05 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:437 6.a e32/26 6:55b0279d:reshard::reshard.0000000009:head v 32'4, mlcod=32'1)", 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.345253967, 2024-04-24T13:30:43.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002915075, 2024-04-24T13:30:43.850 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.850 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.850 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.850 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:30:43.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:30:43.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465002+0000", 2024-04-24T13:30:43.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4470000000000001e-06 2024-04-24T13:30:43.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465013+0000", 2024-04-24T13:30:43.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1532000000000001e-05 2024-04-24T13:30:43.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465035+0000", 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1138e-05 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465048+0000", 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3311e-05 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465219+0000", 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017134600000000001 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465254+0000", 2024-04-24T13:30:43.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5009999999999999e-05 2024-04-24T13:30:43.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467829+0000", 2024-04-24T13:30:43.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025744370000000002 2024-04-24T13:30:43.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467915+0000", 2024-04-24T13:30:43.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6854000000000006e-05 2024-04-24T13:30:43.853 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.854 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.854 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.854 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:466 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-24T13:30:43.854 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:30:43.854 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.330327727, 2024-04-24T13:30:43.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037830749999999999, 2024-04-24T13:30:43.854 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.854 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.854 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.854 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:30:43.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:30:43.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479928+0000", 2024-04-24T13:30:43.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7150000000000001e-06 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479941+0000", 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2999e-05 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479969+0000", 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7923999999999999e-05 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479986+0000", 2024-04-24T13:30:43.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6388e-05 2024-04-24T13:30:43.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480113+0000", 2024-04-24T13:30:43.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127594 2024-04-24T13:30:43.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480167+0000", 2024-04-24T13:30:43.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3699999999999997e-05 2024-04-24T13:30:43.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483640+0000", 2024-04-24T13:30:43.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003472742 2024-04-24T13:30:43.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483710+0000", 2024-04-24T13:30:43.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0012999999999995e-05 2024-04-24T13:30:43.858 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.858 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.858 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.859 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:468 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'6, mlcod=32'3)", 2024-04-24T13:30:43.859 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:30:43.859 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.328013743, 2024-04-24T13:30:43.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039247960000000004, 2024-04-24T13:30:43.859 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.859 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.859 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.859 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:30:43.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482242+0000", 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.57e-06 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482255+0000", 2024-04-24T13:30:43.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2418999999999999e-05 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482281+0000", 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6043000000000001e-05 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482294+0000", 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2873e-05 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482395+0000", 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101724 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482446+0000", 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0288999999999999e-05 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486063+0000", 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036179290000000002 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486165+0000", 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101949 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:473 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'8, mlcod=32'6)", 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.324917796999999, 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034165060000000001, 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.863 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.864 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:30:43.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:30:43.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485338+0000", 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.573e-06 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485350+0000", 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485377+0000", 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6897e-05 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485397+0000", 2024-04-24T13:30:43.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9287999999999999e-05 2024-04-24T13:30:43.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485521+0000", 2024-04-24T13:30:43.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012448 2024-04-24T13:30:43.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485572+0000", 2024-04-24T13:30:43.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0704000000000001e-05 2024-04-24T13:30:43.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488640+0000", 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030685589999999998 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488753+0000", 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112682 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:474 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'9, mlcod=32'6)", 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.322548039999999, 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045500480000000001, 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487708+0000", 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4389999999999999e-06 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487718+0000", 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0386e-05 2024-04-24T13:30:43.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487743+0000", 2024-04-24T13:30:43.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5106999999999999e-05 2024-04-24T13:30:43.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487762+0000", 2024-04-24T13:30:43.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8348000000000001e-05 2024-04-24T13:30:43.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487893+0000", 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130968 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487926+0000", 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3827e-05 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492194+0000", 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042671499999999999 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492256+0000", 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2823000000000005e-05 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:476 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.321756168, 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059105989999999999, 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.872 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488500+0000", 2024-04-24T13:30:43.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4169999999999999e-06 2024-04-24T13:30:43.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488510+0000", 2024-04-24T13:30:43.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0462000000000001e-05 2024-04-24T13:30:43.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488536+0000", 2024-04-24T13:30:43.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6007e-05 2024-04-24T13:30:43.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488553+0000", 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7037999999999998e-05 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488752+0000", 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019892900000000001 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488805+0000", 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2800999999999998e-05 2024-04-24T13:30:43.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494315+0000", 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055099650000000003 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494409+0000", 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3980000000000005e-05 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.876 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'7)", 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.318780333999999, 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055780020000000003, 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491476+0000", 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8479999999999999e-06 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491503+0000", 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7189e-05 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491534+0000", 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1222e-05 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491553+0000", 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9069e-05 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491769+0000", 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000215479 2024-04-24T13:30:43.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491830+0000", 2024-04-24T13:30:43.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1169999999999999e-05 2024-04-24T13:30:43.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.496974+0000", 2024-04-24T13:30:43.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051441860000000002 2024-04-24T13:30:43.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497052+0000", 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7838999999999998e-05 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:484 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'11, mlcod=32'8)", 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.312850973, 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022050070000000001, 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.881 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497405+0000", 2024-04-24T13:30:43.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5889999999999999e-06 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497418+0000", 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2700999999999999e-05 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497449+0000", 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0911000000000003e-05 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497473+0000", 2024-04-24T13:30:43.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4326000000000001e-05 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497563+0000", 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9652000000000002e-05 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497589+0000", 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6669000000000002e-05 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499542+0000", 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019529180000000001 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499608+0000", 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6241000000000005e-05 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:511 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'3, mlcod=32'1)", 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:30:43.887 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.297801047, 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020247519999999999, 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:30:43.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512455+0000", 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.463e-06 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512464+0000", 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.397e-06 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512488+0000", 2024-04-24T13:30:43.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3502e-05 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512499+0000", 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0908e-05 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512620+0000", 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012119 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512672+0000", 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2366e-05 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514389+0000", 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017172890000000001 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514478+0000", 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8636999999999999e-05 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.891 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:544 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'12, mlcod=32'10)", 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.272643123, 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020839690000000002, 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:30:43.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537613+0000", 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7710000000000001e-06 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537627+0000", 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3580999999999999e-05 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537658+0000", 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1470999999999997e-05 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537680+0000", 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1447e-05 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537779+0000", 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9049000000000007e-05 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537822+0000", 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3815e-05 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539590+0000", 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017677459999999999 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539695+0000", 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105089 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:552 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'13, mlcod=32'11)", 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.265501950000001, 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031853350000000001, 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.896 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.897 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:30:43.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:30:43.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544754+0000", 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309999999999999e-06 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544769+0000", 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4259e-05 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544803+0000", 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4650000000000002e-05 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544822+0000", 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8700999999999999e-05 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544956+0000", 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134482 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544991+0000", 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4953000000000002e-05 2024-04-24T13:30:43.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547847+0000", 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028556749999999998 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547938+0000", 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0784000000000004e-05 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:705 6.1f e32/26 6:f93251ce:::obj_delete_at_hint.0000000042:head v 32'7, mlcod=32'5)", 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.132784243, 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018230220000000001, 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677472+0000", 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677483+0000", 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1025e-05 2024-04-24T13:30:43.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677510+0000", 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6894e-05 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677522+0000", 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2367e-05 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677616+0000", 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4239000000000004e-05 2024-04-24T13:30:43.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677656+0000", 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9681999999999997e-05 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679172+0000", 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015157529999999999 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679293+0000", 2024-04-24T13:30:43.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012133099999999999 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:709 6.1e e32/26 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 32'1, mlcod=0'0)", 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.122366572000001, 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020442059999999998, 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:43.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.89e-07 2024-04-24T13:30:43.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687895+0000", 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9959999999999996e-06 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687919+0000", 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3455000000000002e-05 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687931+0000", 2024-04-24T13:30:43.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2442e-05 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688076+0000", 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014435399999999999 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688127+0000", 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1910999999999998e-05 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689827+0000", 2024-04-24T13:30:43.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00169918 2024-04-24T13:30:43.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:43.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:43.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:43.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689932+0000", 2024-04-24T13:30:43.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105379 2024-04-24T13:30:43.909 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.909 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.909 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.909 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:43.909 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:43.909 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:43.910 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:30:43.911 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.3 to 1 (10000) 2024-04-24T13:30:43.912 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:30:43.912 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:43.910+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:43.913 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-24T13:30:44.012 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:44.010+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:44.080 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:44.080 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:30:44.080 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:30:44.080 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:44.096 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:30:44.141 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:44.142+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:44.214 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:44.214+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:44.265 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:30:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:30:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:30:44.265 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:44.279 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:30:44.315 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:44.314+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:44.401 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:44.402 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:30:44.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:30:44.402 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:30:44.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.402 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.402 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:44.402 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.545689035000002, 2024-04-24T13:30:44.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:30:44.402 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.402 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.402 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.403 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.403 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.403 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.403 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:30:44.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.403 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:44.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:44.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:44.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:30:44.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:30:44.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:30:44.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:30:44.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:30:44.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:30:44.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:30:44.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:30:44.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:30:44.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:30:44.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:30:44.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:30:44.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:30:44.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:30:44.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:30:44.408 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.408 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.545666261000001, 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.409 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:30:44.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.410 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:30:44.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:30:44.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:30:44.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:30:44.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:30:44.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:30:44.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:30:44.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:30:44.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:30:44.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:30:44.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:30:44.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:30:44.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:30:44.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:30:44.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:30:44.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:30:44.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:30:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:30:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.448058828000001, 2024-04-24T13:30:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:30:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.415 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:30:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:30:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:30:44.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:30:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:30:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:30:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:30:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:30:44.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:30:44.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:30:44.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:30:44.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:30:44.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:30:44.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:30:44.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:30:44.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:30:44.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:30:44.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.421 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:30:44.422 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.447971191000001, 2024-04-24T13:30:44.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:30:44.422 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.422 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.422 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.422 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.422 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.422 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.422 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:30:44.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.422 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:30:44.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:30:44.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:30:44.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:30:44.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:30:44.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:30:44.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:30:44.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:30:44.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:30:44.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:30:44.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:30:44.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:30:44.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:30:44.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:30:44.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:30:44.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:30:44.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:30:44.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:30:44.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:30:44.428 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.428 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.428 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.428 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.428 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:30:44.428 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.342317303999998, 2024-04-24T13:30:44.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:30:44.428 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.428 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.428 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.429 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.429 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.429 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.429 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:30:44.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.429 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:30:44.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:30:44.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:30:44.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:30:44.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:30:44.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:30:44.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:30:44.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:30:44.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:30:44.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:30:44.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:30:44.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:30:44.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:30:44.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:30:44.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:30:44.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:30:44.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:30:44.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:30:44.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:30:44.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:30:44.435 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.435 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.435 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.435 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.436 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:30:44.436 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.342112786000001, 2024-04-24T13:30:44.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:30:44.436 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.436 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.436 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.436 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.436 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.436 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.437 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:30:44.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.437 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:30:44.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:30:44.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:30:44.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:30:44.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:30:44.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:30:44.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:30:44.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:30:44.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:30:44.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:30:44.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:30:44.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:30:44.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:30:44.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:30:44.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:30:44.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:30:44.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.341752962999998, 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.443 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.444 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.444 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.444 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.444 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.444 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:30:44.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.444 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:30:44.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:30:44.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:30:44.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:30:44.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:30:44.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:30:44.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:30:44.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:30:44.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:30:44.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:30:44.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:30:44.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:30:44.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:30:44.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:30:44.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:30:44.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:30:44.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:30:44.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:30:44.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:30:44.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:30:44.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:30:44.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:30:44.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:30:44.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:30:44.449 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.449 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.449 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.450 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.450 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:30:44.450 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.341584560000001, 2024-04-24T13:30:44.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:30:44.450 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.450 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.450 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.450 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.450 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.450 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.450 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:30:44.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.451 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:30:44.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:30:44.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:30:44.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:30:44.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:30:44.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:30:44.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:30:44.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:30:44.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:30:44.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:30:44.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:30:44.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:30:44.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:30:44.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:30:44.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:30:44.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:30:44.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:30:44.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:30:44.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:30:44.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:30:44.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:30:44.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:30:44.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:30:44.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:30:44.456 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.456 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.456 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.456 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.456 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:30:44.456 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.341376169, 2024-04-24T13:30:44.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:30:44.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:30:44.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:30:44.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:30:44.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:30:44.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:30:44.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:30:44.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:30:44.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:30:44.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:30:44.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:30:44.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:30:44.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:30:44.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:30:44.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:30:44.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:30:44.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:30:44.462 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.462 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.462 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.463 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.463 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:30:44.463 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.341278316, 2024-04-24T13:30:44.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:30:44.463 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.463 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.463 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.464 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.464 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.464 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.464 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:30:44.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.464 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:30:44.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:30:44.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:30:44.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:30:44.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:30:44.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:30:44.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:30:44.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:30:44.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:30:44.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:30:44.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:30:44.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:30:44.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:30:44.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:30:44.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:30:44.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:30:44.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:30:44.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:30:44.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:30:44.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:30:44.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:30:44.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:30:44.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:30:44.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:30:44.471 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.471 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.471 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.471 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.471 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:30:44.471 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.341177166999998, 2024-04-24T13:30:44.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:30:44.471 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.472 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.472 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.472 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.472 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.472 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.472 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:30:44.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.472 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:30:44.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:30:44.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:30:44.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:30:44.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:30:44.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:30:44.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:30:44.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:30:44.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:30:44.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:30:44.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:30:44.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:30:44.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:30:44.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:30:44.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:30:44.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:30:44.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:30:44.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:30:44.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:30:44.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:30:44.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:30:44.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:30:44.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:30:44.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:30:44.479 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.479 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.480 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.480 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.480 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:30:44.480 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.340920455000003, 2024-04-24T13:30:44.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:30:44.480 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.480 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.480 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.480 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.480 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.480 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:30:44.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:30:44.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:30:44.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:30:44.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:30:44.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:30:44.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:30:44.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:30:44.485 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.486 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.486 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.486 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.486 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:30:44.486 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.340810793000003, 2024-04-24T13:30:44.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:30:44.486 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.486 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.486 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.486 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.486 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.487 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.487 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:30:44.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.487 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:30:44.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:30:44.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:30:44.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:30:44.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:30:44.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:30:44.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:30:44.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:30:44.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:30:44.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:30:44.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:30:44.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:30:44.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:30:44.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:30:44.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:30:44.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:30:44.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:30:44.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:30:44.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:30:44.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.492 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.492 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.492 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.340738764000001, 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:30:44.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:30:44.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:30:44.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:30:44.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:30:44.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:30:44.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:30:44.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:30:44.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.498 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.498 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.498 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:30:44.498 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.340567728000003, 2024-04-24T13:30:44.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:30:44.499 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.499 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.499 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.499 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.499 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.499 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.499 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:30:44.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.501 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:30:44.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:30:44.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:30:44.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:30:44.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:30:44.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:30:44.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:30:44.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:30:44.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:30:44.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:30:44.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:30:44.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:30:44.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:30:44.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:30:44.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:30:44.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:30:44.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:30:44.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:30:44.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:30:44.507 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.508 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.508 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.508 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.508 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:30:44.508 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.340528235000001, 2024-04-24T13:30:44.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:30:44.508 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:30:44.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:30:44.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:30:44.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:30:44.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:30:44.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:30:44.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:30:44.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:30:44.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:30:44.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:30:44.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:30:44.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:30:44.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:30:44.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:30:44.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:30:44.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:30:44.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:30:44.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:30:44.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:30:44.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:30:44.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:30:44.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:30:44.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:30:44.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.515 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.515 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.516 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:44.516 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.087208979000003, 2024-04-24T13:30:44.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:30:44.516 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.516 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.516 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.516 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:30:44.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.517 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:44.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:44.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:44.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:30:44.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:30:44.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:30:44.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:30:44.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:30:44.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:30:44.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:30:44.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:30:44.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:30:44.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:30:44.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:30:44.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:30:44.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:30:44.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:30:44.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:30:44.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:30:44.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:30:44.522 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.522 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.523 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.523 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.523 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:44.523 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.087182931000001, 2024-04-24T13:30:44.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:30:44.523 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.523 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.523 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.523 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.523 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.523 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:30:44.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:30:44.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:30:44.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:30:44.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:30:44.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.528 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.529 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.529 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:44.529 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.087157574999999, 2024-04-24T13:30:44.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:30:44.529 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.529 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.529 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.529 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.529 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.529 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.529 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:30:44.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.530 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:44.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:44.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:44.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:30:44.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:30:44.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:30:44.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:30:44.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:30:44.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:30:44.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:30:44.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:30:44.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:30:44.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:30:44.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:30:44.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:30:44.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:30:44.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:30:44.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:30:44.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:30:44.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:30:44.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:30:44.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:30:44.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:30:44.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:30:44.535 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.535 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.535 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.536 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:44.536 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:30:44.536 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 35.087066505999999, 2024-04-24T13:30:44.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:30:44.536 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:44.536 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:44.536 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:44.536 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:44.536 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:44.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:44.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:30:44.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:30:44.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:44.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:30:44.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:30:44.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:44.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:44.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:30:44.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:30:44.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:44.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:30:44.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:30:44.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:44.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:44.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:44.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:30:44.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:30:44.542 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.542 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.542 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.542 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:44.542 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:44.542 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:44.544 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:44.542+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:44.544 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:30:44.645 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:44.642+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:44.714 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:44.714 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:44.714 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:30:44.714 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:44.714 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:30:44.745 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:44.746+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:44.847 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:44.846+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:44.848 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.4 to 1 (10000) 2024-04-24T13:30:44.871 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-24T13:30:44.886 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:44.887 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:44.887 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:30:44.887 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:30:44.887 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:44.901 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:30:44.947 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:44.945+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:45.037 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:30:45.078 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:45.078 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.154334290000001, 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:30:45.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:30:45.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:30:45.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:30:45.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:30:45.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:30:45.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:30:45.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:30:45.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:30:45.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:30:45.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:30:45.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:30:45.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.011542519999999, 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:30:45.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:30:45.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:30:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:30:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:30:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:30:45.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:30:45.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:30:45.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:30:45.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:30:45.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:30:45.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:30:45.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:30:45.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:30:45.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:30:45.088 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.088 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.089 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.089 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:30:45.089 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:30:45.089 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.009239452000003, 2024-04-24T13:30:45.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:30:45.090 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.090 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.090 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.090 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:30:45.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:30:45.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:30:45.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:30:45.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:30:45.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:30:45.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:30:45.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:30:45.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:30:45.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:30:45.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:30:45.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:30:45.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:30:45.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:30:45.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:30:45.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:30:45.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:30:45.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:30:45.095 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.095 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.095 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.095 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:30:45.095 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:45.096 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.007544934999999, 2024-04-24T13:30:45.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:30:45.096 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.096 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.096 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.096 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:45.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:45.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:45.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:30:45.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:30:45.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:30:45.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:30:45.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:30:45.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:30:45.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:30:45.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:30:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:30:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:30:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:30:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:30:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:30:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:30:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:30:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.101 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:30:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:30:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.006087323999999, 2024-04-24T13:30:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:30:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:30:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:30:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:30:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:30:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:30:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:30:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:30:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:30:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:30:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:30:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:30:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:30:45.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:30:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:30:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:30:45.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:30:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:30:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:30:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:30:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:30:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.004158234999998, 2024-04-24T13:30:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:30:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.108 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:30:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:30:45.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:30:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:30:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:30:45.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:30:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:30:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:30:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:30:45.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:30:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:30:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:30:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:30:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:30:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:30:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:30:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:30:45.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.001733698000002, 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:30:45.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:30:45.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:30:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:30:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:30:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:30:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:30:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:30:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:30:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:30:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:30:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:30:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:30:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.000530949000002, 2024-04-24T13:30:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:30:45.121 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:30:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:30:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:30:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:30:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:30:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:30:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:30:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:30:45.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:30:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:30:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:30:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:30:45.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:30:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:30:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:30:45.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:30:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:30:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:30:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:30:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:30:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.997324784, 2024-04-24T13:30:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:30:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.128 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:30:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:30:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:30:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:30:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:30:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:30:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:30:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:30:45.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:30:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:30:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:30:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:30:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:30:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:30:45.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:30:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:30:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:30:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:30:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.135 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:30:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:30:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.758269200000001, 2024-04-24T13:30:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:30:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.136 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:30:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:30:45.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:30:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:30:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:30:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:30:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:30:45.140 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.755848549, 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:30:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:30:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:30:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:30:45.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:30:45.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:30:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:30:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:30:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:30:45.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:30:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:30:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:30:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:30:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:30:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:30:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:30:45.146 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.755075331, 2024-04-24T13:30:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:30:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:30:45.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:30:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:30:45.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:30:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:30:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:30:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:30:45.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:30:45.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:30:45.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:30:45.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:30:45.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:30:45.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:30:45.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.747336277000002, 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:30:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:30:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:30:45.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:30:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:30:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:30:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:30:45.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:30:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:30:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:30:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:30:45.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:30:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:30:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:30:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:30:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:30:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.399374170000002, 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.157 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:30:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:30:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:30:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:30:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:30:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:30:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:30:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:30:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:30:45.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:30:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:30:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:30:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.398625422000002, 2024-04-24T13:30:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:30:45.162 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:30:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:30:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:30:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:30:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:30:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:30:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:30:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:30:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:30:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:30:45.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.397694297000001, 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:30:45.167 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:30:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:30:45.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:30:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:30:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:30:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:30:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:30:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:30:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:30:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:30:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:30:45.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:30:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:30:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:30:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.173 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:30:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:30:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.397202505999999, 2024-04-24T13:30:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:30:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.174 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:30:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:30:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:30:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:30:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:30:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:30:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:30:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:30:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:30:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:30:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:30:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:30:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.179 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:30:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.811121082, 2024-04-24T13:30:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:30:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.180 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:30:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:30:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:30:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:30:45.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:30:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:30:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:30:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:30:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:30:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:30:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:30:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:30:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:30:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:30:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:30:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:30:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:30:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:30:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:30:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:30:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:30:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:30:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:30:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:30:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:30:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:30:45.188 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.782273883, 2024-04-24T13:30:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:30:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:30:45.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:30:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:30:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:30:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:30:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:30:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:30:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:30:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:30:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:30:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:30:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:30:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:30:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:30:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:30:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:30:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:30:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:30:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:30:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:30:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:30:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:30:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:30:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:30:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:30:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:30:45.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.744082639, 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:45.197 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:30:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:30:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:30:45.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:45.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:45.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:30:45.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:30:45.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:45.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:30:45.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:30:45.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:30:45.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:30:45.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:45.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:30:45.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:30:45.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:45.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:45.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:30:45.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:30:45.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:45.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:45.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:45.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:30:45.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:30:45.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:45.204 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:45.204 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:45.204 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:45.078+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:45.206 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:30:45.206 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:30:45.206 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:30:45.207 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:30:45.207 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:30:45.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:30:45.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:30:45.210 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:45.209+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:45.223 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:30:45.223 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:30:45.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:30:45.246 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:30:45.266 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:30:45.266 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:30:45.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:30:45.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:30:45.311 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:45.309+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:45.317 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:30:45.317 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:30:45.322 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:45.322 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:45.336 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:30:45.422 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:45.422+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:45.483 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:45.483 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:45.496 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:30:45.513 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:45.513+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:45.614 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:45.614+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:45.657 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:45.657 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:45.672 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:30:45.715 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:45.713+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:45.817 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:45.814+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:45.831 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:45.832 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:45.846 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:30:45.861 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.5 to 1 (10000) 2024-04-24T13:30:45.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-24T13:30:45.914 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:30:45.930 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:45.930+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:45.984 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:45.984 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:46.001 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:30:46.018 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:46.017+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:46.119 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:46.118+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:46.163 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:46.163 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:46.177 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:30:46.266 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:46.266+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:46.323 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:46.322+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:46.348 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:46.348 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:46.362 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:30:46.423 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:46.421+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:46.524 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:46.522+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:46.534 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:46.535 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:46.550 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:30:46.642 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:46.642+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:46.715 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:46.715 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:46.726 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:46.725+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:46.729 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:30:46.827 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:46.825+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:46.860 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:46.860 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:46.873 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.6 to 1 (10000) 2024-04-24T13:30:46.875 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:30:46.879 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:30:46.906 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-24T13:30:46.950 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:46.950+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:47.028 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:47.026+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:47.033 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:47.034 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:47.048 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:30:47.129 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:47.126+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:47.169 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:47.169 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:47.183 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:30:47.230 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:47.230+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:47.307 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:47.307 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:47.322 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:30:47.332 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:47.330+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:47.336 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:30:47.433 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:47.430+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:47.444 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:47.444 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:47.459 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:30:47.479 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:30:47.479 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:30:47.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:30:47.495 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:30:47.510 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:30:47.510 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:30:47.526 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:30:47.526 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:30:47.533 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:47.530+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:47.545 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:30:47.545 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:30:47.565 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:30:47.565 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:30:47.583 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:30:47.583 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:30:47.588 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:47.588 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:30:47.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:30:47.588 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:30:47.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.588 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:30:47.588 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:30:47.588 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.315174311, 2024-04-24T13:30:47.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003286134, 2024-04-24T13:30:47.589 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.589 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.589 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4440", 2024-04-24T13:30:47.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:30:47.589 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:30:47.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.589 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:30:47.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:30:47.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270374+0000", 2024-04-24T13:30:47.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9130000000000001e-06 2024-04-24T13:30:47.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270384+0000", 2024-04-24T13:30:47.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0023e-05 2024-04-24T13:30:47.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270410+0000", 2024-04-24T13:30:47.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5483e-05 2024-04-24T13:30:47.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270426+0000", 2024-04-24T13:30:47.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6413e-05 2024-04-24T13:30:47.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270524+0000", 2024-04-24T13:30:47.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8314999999999996e-05 2024-04-24T13:30:47.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270704+0000", 2024-04-24T13:30:47.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017929 2024-04-24T13:30:47.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:47.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270950+0000", 2024-04-24T13:30:47.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024601000000000001 2024-04-24T13:30:47.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.272837+0000", 2024-04-24T13:30:47.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018874600000000001 2024-04-24T13:30:47.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273498+0000", 2024-04-24T13:30:47.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066062100000000002 2024-04-24T13:30:47.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273589+0000", 2024-04-24T13:30:47.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.098e-05 2024-04-24T13:30:47.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273658+0000", 2024-04-24T13:30:47.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9626e-05 2024-04-24T13:30:47.596 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.596 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.596 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.597 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:47.597 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:47.597 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.306384442999999, 2024-04-24T13:30:47.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048388950000000002, 2024-04-24T13:30:47.597 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.597 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.597 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.597 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.597 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.597 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.597 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-24T13:30:47.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.597 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:47.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:47.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3799999999999998e-06 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279193+0000", 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7674e-05 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279224+0000", 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0654000000000002e-05 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279244+0000", 2024-04-24T13:30:47.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:30:47.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279426+0000", 2024-04-24T13:30:47.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018255300000000001 2024-04-24T13:30:47.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279717+0000", 2024-04-24T13:30:47.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029043800000000001 2024-04-24T13:30:47.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279993+0000", 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276786 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282898+0000", 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002904093 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283731+0000", 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00083382599999999997 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283886+0000", 2024-04-24T13:30:47.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015512600000000001 2024-04-24T13:30:47.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284001+0000", 2024-04-24T13:30:47.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114405 2024-04-24T13:30:47.602 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.602 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.602 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410010339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.301259848000001, 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044116340000000002, 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:30:47.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:30:47.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284289+0000", 2024-04-24T13:30:47.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.125e-06 2024-04-24T13:30:47.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284299+0000", 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0485999999999999e-05 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284330+0000", 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0528000000000003e-05 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284345+0000", 2024-04-24T13:30:47.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4883e-05 2024-04-24T13:30:47.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284484+0000", 2024-04-24T13:30:47.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139708 2024-04-24T13:30:47.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284655+0000", 2024-04-24T13:30:47.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170953 2024-04-24T13:30:47.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284981+0000", 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000325648 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.287326+0000", 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023452709999999999 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288427+0000", 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001100544 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288551+0000", 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012466500000000001 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288698+0000", 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146823 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.608 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.322046963, 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047820809999999997, 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263503+0000", 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.039e-06 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263520+0000", 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7198e-05 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263548+0000", 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8158e-05 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263565+0000", 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7008e-05 2024-04-24T13:30:47.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263754+0000", 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001894 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263973+0000", 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218593 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.264373+0000", 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040043400000000002 2024-04-24T13:30:47.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.266377+0000", 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020033030000000001 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268121+0000", 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017441049999999999 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268212+0000", 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1490000000000007e-05 2024-04-24T13:30:47.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268282+0000", 2024-04-24T13:30:47.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9352999999999998e-05 2024-04-24T13:30:47.614 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.614 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.614 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.614 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.614 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:30:47.614 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.242334810999999, 2024-04-24T13:30:47.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034252639999999999, 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 220 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343214+0000", 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343227+0000", 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2941e-05 2024-04-24T13:30:47.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343259+0000", 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1557000000000003e-05 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343274+0000", 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5401999999999999e-05 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343455+0000", 2024-04-24T13:30:47.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018068700000000001 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343694+0000", 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238552 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.344088+0000", 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039456400000000003 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.345723+0000", 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016349139999999999 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346480+0000", 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075738300000000004 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346569+0000", 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8281000000000004e-05 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346637+0000", 2024-04-24T13:30:47.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8165999999999998e-05 2024-04-24T13:30:47.620 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.620 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.620 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.620 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.231641435, 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032680679999999998, 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 223 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:30:47.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:30:47.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353907+0000", 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1560000000000002e-06 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353918+0000", 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0669000000000001e-05 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353948+0000", 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0329999999999999e-05 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353963+0000", 2024-04-24T13:30:47.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4989e-05 2024-04-24T13:30:47.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354076+0000", 2024-04-24T13:30:47.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112704 2024-04-24T13:30:47.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354300+0000", 2024-04-24T13:30:47.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022397000000000001 2024-04-24T13:30:47.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:47.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354729+0000", 2024-04-24T13:30:47.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042914100000000002 2024-04-24T13:30:47.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356223+0000", 2024-04-24T13:30:47.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001494219 2024-04-24T13:30:47.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356972+0000", 2024-04-24T13:30:47.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00074910099999999996 2024-04-24T13:30:47.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357059+0000", 2024-04-24T13:30:47.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6624000000000003e-05 2024-04-24T13:30:47.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357173+0000", 2024-04-24T13:30:47.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114165 2024-04-24T13:30:47.627 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.627 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.627 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.627 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.627 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:30:47.627 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.224594514, 2024-04-24T13:30:47.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032957419999999999, 2024-04-24T13:30:47.628 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.628 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.628 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.628 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.628 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.628 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.628 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-24T13:30:47.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.628 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:30:47.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:30:47.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360954+0000", 2024-04-24T13:30:47.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.154e-06 2024-04-24T13:30:47.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360965+0000", 2024-04-24T13:30:47.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1321999999999999e-05 2024-04-24T13:30:47.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360996+0000", 2024-04-24T13:30:47.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0902999999999999e-05 2024-04-24T13:30:47.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361012+0000", 2024-04-24T13:30:47.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:30:47.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361185+0000", 2024-04-24T13:30:47.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172072 2024-04-24T13:30:47.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361404+0000", 2024-04-24T13:30:47.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021965999999999999 2024-04-24T13:30:47.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361852+0000", 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000448276 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.363340+0000", 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001487169 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364094+0000", 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075443699999999995 2024-04-24T13:30:47.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364184+0000", 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9957000000000006e-05 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364248+0000", 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3627000000000006e-05 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.221029667, 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036426480000000001, 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364519+0000", 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-24T13:30:47.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364529+0000", 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088999999999999e-05 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364554+0000", 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5537e-05 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364568+0000", 2024-04-24T13:30:47.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3372e-05 2024-04-24T13:30:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364726+0000", 2024-04-24T13:30:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015809299999999999 2024-04-24T13:30:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365059+0000", 2024-04-24T13:30:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000333185 2024-04-24T13:30:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365758+0000", 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069934299999999995 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.367413+0000", 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016552349999999999 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368012+0000", 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059858700000000003 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368097+0000", 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5253999999999994e-05 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368159+0000", 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2113000000000007e-05 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.640 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.191643031, 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033998840000000002, 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393906+0000", 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1569999999999998e-06 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393917+0000", 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1348999999999999e-05 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393942+0000", 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.527e-05 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393957+0000", 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4355999999999999e-05 2024-04-24T13:30:47.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394127+0000", 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170555 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394352+0000", 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224539 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394788+0000", 2024-04-24T13:30:47.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043600099999999999 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.396137+0000", 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001349404 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397158+0000", 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001020738 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397237+0000", 2024-04-24T13:30:47.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9319000000000004e-05 2024-04-24T13:30:47.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397303+0000", 2024-04-24T13:30:47.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6196000000000001e-05 2024-04-24T13:30:47.646 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.646 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.646 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.646 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:237 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.646 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:30:47.646 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.180776396000001, 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003210517, 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 237 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:30:47.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:30:47.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404772+0000", 2024-04-24T13:30:47.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1830000000000001e-06 2024-04-24T13:30:47.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404783+0000", 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1009000000000001e-05 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404814+0000", 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0822999999999999e-05 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404829+0000", 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4808e-05 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404965+0000", 2024-04-24T13:30:47.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013637299999999999 2024-04-24T13:30:47.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405107+0000", 2024-04-24T13:30:47.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142108 2024-04-24T13:30:47.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:47.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405399+0000", 2024-04-24T13:30:47.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029117900000000003 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.406507+0000", 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011081000000000001 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407732+0000", 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001225163 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407866+0000", 2024-04-24T13:30:47.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013405599999999999 2024-04-24T13:30:47.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407981+0000", 2024-04-24T13:30:47.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114715 2024-04-24T13:30:47.652 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.652 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.652 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.652 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:430 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.652 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:30:47.652 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.127059499, 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031779590000000002, 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:30:47.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458489+0000", 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458525+0000", 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5743e-05 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458556+0000", 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0284e-05 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458576+0000", 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0449999999999999e-05 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458738+0000", 2024-04-24T13:30:47.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016177699999999999 2024-04-24T13:30:47.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459047+0000", 2024-04-24T13:30:47.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030948400000000001 2024-04-24T13:30:47.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:47.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459499+0000", 2024-04-24T13:30:47.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045165199999999998 2024-04-24T13:30:47.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461152+0000", 2024-04-24T13:30:47.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001653477 2024-04-24T13:30:47.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461528+0000", 2024-04-24T13:30:47.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037554899999999998 2024-04-24T13:30:47.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461610+0000", 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1914000000000002e-05 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461665+0000", 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5105999999999997e-05 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.658 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.122801912, 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031563120000000001, 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 436 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462746+0000", 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8199999999999999e-06 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462756+0000", 2024-04-24T13:30:47.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0005e-05 2024-04-24T13:30:47.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462778+0000", 2024-04-24T13:30:47.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1325e-05 2024-04-24T13:30:47.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462794+0000", 2024-04-24T13:30:47.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841e-05 2024-04-24T13:30:47.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462940+0000", 2024-04-24T13:30:47.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014605099999999999 2024-04-24T13:30:47.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463206+0000", 2024-04-24T13:30:47.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026634500000000003 2024-04-24T13:30:47.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:47.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463594+0000", 2024-04-24T13:30:47.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038760299999999998 2024-04-24T13:30:47.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465323+0000", 2024-04-24T13:30:47.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00172898 2024-04-24T13:30:47.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465593+0000", 2024-04-24T13:30:47.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027055500000000001 2024-04-24T13:30:47.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465747+0000", 2024-04-24T13:30:47.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015391999999999999 2024-04-24T13:30:47.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465901+0000", 2024-04-24T13:30:47.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153867 2024-04-24T13:30:47.665 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.665 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.665 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.665 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:437 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.665 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:30:47.665 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.122019437000001, 2024-04-24T13:30:47.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048056540000000003, 2024-04-24T13:30:47.665 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.665 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.666 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.666 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 437 2024-04-24T13:30:47.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.666 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:30:47.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:30:47.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463529+0000", 2024-04-24T13:30:47.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2479999999999999e-06 2024-04-24T13:30:47.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463544+0000", 2024-04-24T13:30:47.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:30:47.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463572+0000", 2024-04-24T13:30:47.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8294e-05 2024-04-24T13:30:47.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463590+0000", 2024-04-24T13:30:47.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-24T13:30:47.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464092+0000", 2024-04-24T13:30:47.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000502189 2024-04-24T13:30:47.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464454+0000", 2024-04-24T13:30:47.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036231300000000001 2024-04-24T13:30:47.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:47.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464831+0000", 2024-04-24T13:30:47.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000377375 2024-04-24T13:30:47.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467473+0000", 2024-04-24T13:30:47.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026414659999999999 2024-04-24T13:30:47.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468185+0000", 2024-04-24T13:30:47.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071215199999999997 2024-04-24T13:30:47.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468271+0000", 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5593999999999994e-05 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468333+0000", 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1957000000000003e-05 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:531 6.4 e32/26 6:227f63b5:gc::gc.14:head v 32'13, mlcod=32'11)", 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:30:47.673 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.060788343, 2024-04-24T13:30:47.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003260279, 2024-04-24T13:30:47.674 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.674 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.674 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.674 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:30:47.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524760+0000", 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4720000000000001e-06 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524771+0000", 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1270000000000001e-05 2024-04-24T13:30:47.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524792+0000", 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1566e-05 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524805+0000", 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2876e-05 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524906+0000", 2024-04-24T13:30:47.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101084 2024-04-24T13:30:47.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524943+0000", 2024-04-24T13:30:47.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6538000000000002e-05 2024-04-24T13:30:47.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.527964+0000", 2024-04-24T13:30:47.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030210229999999999 2024-04-24T13:30:47.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.528018+0000", 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4450000000000002e-05 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.822964809, 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032103409999999998, 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.678 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762584+0000", 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7039999999999999e-06 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762597+0000", 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2539e-05 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762629+0000", 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2116000000000002e-05 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762644+0000", 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5034999999999999e-05 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762801+0000", 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015653999999999999 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763192+0000", 2024-04-24T13:30:47.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000391529 2024-04-24T13:30:47.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:47.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763747+0000", 2024-04-24T13:30:47.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055497399999999996 2024-04-24T13:30:47.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.764931+0000", 2024-04-24T13:30:47.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001184128 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765643+0000", 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071180500000000003 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765726+0000", 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3058000000000003e-05 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765792+0000", 2024-04-24T13:30:47.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5913000000000004e-05 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.716369688, 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033442569999999998, 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.684 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 793 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869179+0000", 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.323e-06 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869190+0000", 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869222+0000", 2024-04-24T13:30:47.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1733999999999998e-05 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869237+0000", 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5044e-05 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869396+0000", 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158913 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869763+0000", 2024-04-24T13:30:47.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367112 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.870319+0000", 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055558799999999998 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.871509+0000", 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001190607 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872365+0000", 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085535299999999999 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872449+0000", 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3834999999999999e-05 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872521+0000", 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2428999999999994e-05 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.689 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.690 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.690 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:30:47.690 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.530363316000001, 2024-04-24T13:30:47.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003340754, 2024-04-24T13:30:47.690 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.690 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.690 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.690 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.690 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.690 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.690 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 874 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055185+0000", 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055197+0000", 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1606e-05 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055229+0000", 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1603000000000002e-05 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055244+0000", 2024-04-24T13:30:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4928e-05 2024-04-24T13:30:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055397+0000", 2024-04-24T13:30:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015366499999999999 2024-04-24T13:30:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055763+0000", 2024-04-24T13:30:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036565600000000001 2024-04-24T13:30:47.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.056317+0000", 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055436600000000004 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.057678+0000", 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001361283 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058258+0000", 2024-04-24T13:30:47.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057942400000000004 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058407+0000", 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000149188 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058524+0000", 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116805 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.696 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.696 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:30:47.696 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.525644587, 2024-04-24T13:30:47.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032622950000000001, 2024-04-24T13:30:47.696 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.696 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.696 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.696 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.696 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.697 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.697 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 876 2024-04-24T13:30:47.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.697 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:30:47.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:30:47.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059904+0000", 2024-04-24T13:30:47.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.767e-06 2024-04-24T13:30:47.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059912+0000", 2024-04-24T13:30:47.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819999999999994e-06 2024-04-24T13:30:47.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059934+0000", 2024-04-24T13:30:47.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2141e-05 2024-04-24T13:30:47.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059949+0000", 2024-04-24T13:30:47.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4285e-05 2024-04-24T13:30:47.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060072+0000", 2024-04-24T13:30:47.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012349400000000001 2024-04-24T13:30:47.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060302+0000", 2024-04-24T13:30:47.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022971999999999999 2024-04-24T13:30:47.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:47.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060787+0000", 2024-04-24T13:30:47.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048565400000000002 2024-04-24T13:30:47.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062208+0000", 2024-04-24T13:30:47.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014201870000000001 2024-04-24T13:30:47.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062946+0000", 2024-04-24T13:30:47.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073827699999999997 2024-04-24T13:30:47.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063036+0000", 2024-04-24T13:30:47.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9758000000000004e-05 2024-04-24T13:30:47.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063164+0000", 2024-04-24T13:30:47.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012852999999999999 2024-04-24T13:30:47.702 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.702 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:924 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:30:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.414712939999999, 2024-04-24T13:30:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030953729999999998, 2024-04-24T13:30:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.703 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.704 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 924 2024-04-24T13:30:47.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.704 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:30:47.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:30:47.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170836+0000", 2024-04-24T13:30:47.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1900000000000002e-06 2024-04-24T13:30:47.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170847+0000", 2024-04-24T13:30:47.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1109e-05 2024-04-24T13:30:47.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170879+0000", 2024-04-24T13:30:47.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2153000000000002e-05 2024-04-24T13:30:47.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170898+0000", 2024-04-24T13:30:47.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8785000000000001e-05 2024-04-24T13:30:47.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171030+0000", 2024-04-24T13:30:47.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013210300000000001 2024-04-24T13:30:47.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171294+0000", 2024-04-24T13:30:47.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026387600000000002 2024-04-24T13:30:47.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:47.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171790+0000", 2024-04-24T13:30:47.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049596899999999997 2024-04-24T13:30:47.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.172966+0000", 2024-04-24T13:30:47.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011761 2024-04-24T13:30:47.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173663+0000", 2024-04-24T13:30:47.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069701500000000005 2024-04-24T13:30:47.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173818+0000", 2024-04-24T13:30:47.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155427 2024-04-24T13:30:47.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173929+0000", 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110646 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.348701684, 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032803860000000002, 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:47.710 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 952 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:47.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236847+0000", 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236858+0000", 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0582e-05 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236900+0000", 2024-04-24T13:30:47.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2463000000000003e-05 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236923+0000", 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2938e-05 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237071+0000", 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014795100000000001 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237365+0000", 2024-04-24T13:30:47.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000293963 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237755+0000", 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039032599999999998 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239124+0000", 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136918 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:47.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239925+0000", 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080016699999999996 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240011+0000", 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6780999999999995e-05 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240125+0000", 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113862 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.715 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.716 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:47.716 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:47.716 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:47.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:30:47.718 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:30:47.719 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:30:47.719 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:47.714+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:47.819 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:47.817+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:47.845 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:47.845 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:30:47.845 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:30:47.845 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:47.859 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:30:47.882 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.7 to 1 (10000) 2024-04-24T13:30:47.907 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-24T13:30:47.907 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:30:47.954 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:47.954+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:48.020 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:48.018+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:48.024 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:30:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:30:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:30:48.024 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:48.039 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:30:48.121 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:48.118+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:48.164 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:48.165 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:30:48.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:30:48.165 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:30:48.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.165 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:48.165 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:30:48.165 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.920509366000001, 2024-04-24T13:30:48.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:30:48.165 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.165 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.165 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.165 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:30:48.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:30:48.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:30:48.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94410010338304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.885651652, 2024-04-24T13:30:48.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077892999999999999, 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2770000000000001e-06 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279179+0000", 2024-04-24T13:30:48.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3529999999999999e-05 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279222+0000", 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2743000000000001e-05 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279272+0000", 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0649000000000002e-05 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279772+0000", 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000500013 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280011+0000", 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023840499999999999 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280408+0000", 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039756999999999998 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282501+0000", 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020929159999999998 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286583+0000", 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040820530000000004 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286748+0000", 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016431200000000001 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286951+0000", 2024-04-24T13:30:48.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020383200000000001 2024-04-24T13:30:48.178 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.178 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.178 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.178 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:48.178 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:30:48.178 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.872405659000002, 2024-04-24T13:30:48.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024753290000000001, 2024-04-24T13:30:48.178 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292410+0000", 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292419+0000", 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8680000000000005e-06 2024-04-24T13:30:48.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292445+0000", 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6207000000000002e-05 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292458+0000", 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292597+0000", 2024-04-24T13:30:48.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013947100000000001 2024-04-24T13:30:48.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292841+0000", 2024-04-24T13:30:48.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024435599999999999 2024-04-24T13:30:48.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:48.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.293085+0000", 2024-04-24T13:30:48.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000243212 2024-04-24T13:30:48.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294263+0000", 2024-04-24T13:30:48.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001178171 2024-04-24T13:30:48.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294758+0000", 2024-04-24T13:30:48.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049492199999999996 2024-04-24T13:30:48.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294824+0000", 2024-04-24T13:30:48.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6346000000000005e-05 2024-04-24T13:30:48.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294883+0000", 2024-04-24T13:30:48.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9222999999999999e-05 2024-04-24T13:30:48.187 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.187 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.187 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.188 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94410010333696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:48.188 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:30:48.188 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.869719771, 2024-04-24T13:30:48.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023887449999999998, 2024-04-24T13:30:48.188 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.188 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.188 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:48.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:48.188 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-24T13:30:48.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.189 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:30:48.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:30:48.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295096+0000", 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1660000000000001e-06 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295105+0000", 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6139999999999992e-06 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295131+0000", 2024-04-24T13:30:48.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6633000000000001e-05 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295146+0000", 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4168999999999999e-05 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295250+0000", 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104071 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295424+0000", 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017425599999999999 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295726+0000", 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030180000000000002 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.296532+0000", 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080662400000000003 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297330+0000", 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00079793300000000002 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297392+0000", 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2112000000000004e-05 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297483+0000", 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0366999999999997e-05 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.193 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.194 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-24T13:30:48.194 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:30:48.194 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.870191499000001, 2024-04-24T13:30:48.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020133299999999998, 2024-04-24T13:30:48.194 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.194 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.194 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.194 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294623+0000", 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9999999999999996e-07 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294634+0000", 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1292e-05 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294666+0000", 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1596e-05 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294688+0000", 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2561e-05 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294842+0000", 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153494 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294893+0000", 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0983999999999998e-05 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296547+0000", 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016536890000000001 2024-04-24T13:30:48.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296636+0000", 2024-04-24T13:30:48.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8913999999999996e-05 2024-04-24T13:30:48.198 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.198 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.198 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.198 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:215 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'2, mlcod=0'0)", 2024-04-24T13:30:48.198 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:30:48.198 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.839025444000001, 2024-04-24T13:30:48.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018794250000000001, 2024-04-24T13:30:48.199 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.199 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.199 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.199 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:30:48.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325790+0000", 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325809+0000", 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8590999999999999e-05 2024-04-24T13:30:48.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325846+0000", 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6875999999999997e-05 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325868+0000", 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1585000000000001e-05 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325983+0000", 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115631 2024-04-24T13:30:48.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.326022+0000", 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8618999999999997e-05 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327579+0000", 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015573049999999999 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327668+0000", 2024-04-24T13:30:48.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8588e-05 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:385 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'5, mlcod=32'2)", 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.729121111, 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020295980000000001, 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435694+0000", 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:30:48.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435708+0000", 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3525e-05 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435733+0000", 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5431000000000001e-05 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435752+0000", 2024-04-24T13:30:48.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8465e-05 2024-04-24T13:30:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435897+0000", 2024-04-24T13:30:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014525000000000001 2024-04-24T13:30:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435963+0000", 2024-04-24T13:30:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6297000000000006e-05 2024-04-24T13:30:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437645+0000", 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001681395 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437722+0000", 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7424999999999998e-05 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:437 6.a e32/26 6:55b0279d:reshard::reshard.0000000009:head v 32'4, mlcod=32'1)", 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:30:48.207 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.69981327, 2024-04-24T13:30:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002915075, 2024-04-24T13:30:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:30:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465002+0000", 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4470000000000001e-06 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465013+0000", 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1532000000000001e-05 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465035+0000", 2024-04-24T13:30:48.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1138e-05 2024-04-24T13:30:48.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465048+0000", 2024-04-24T13:30:48.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3311e-05 2024-04-24T13:30:48.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465219+0000", 2024-04-24T13:30:48.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017134600000000001 2024-04-24T13:30:48.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465254+0000", 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5009999999999999e-05 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467829+0000", 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025744370000000002 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467915+0000", 2024-04-24T13:30:48.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6854000000000006e-05 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:466 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.684887030000001, 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037830749999999999, 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:30:48.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:30:48.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479928+0000", 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7150000000000001e-06 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479941+0000", 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2999e-05 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479969+0000", 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7923999999999999e-05 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479986+0000", 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6388e-05 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480113+0000", 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127594 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480167+0000", 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3699999999999997e-05 2024-04-24T13:30:48.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483640+0000", 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003472742 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483710+0000", 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0012999999999995e-05 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:468 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'6, mlcod=32'3)", 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.682573046, 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039247960000000004, 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482242+0000", 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.57e-06 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482255+0000", 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2418999999999999e-05 2024-04-24T13:30:48.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482281+0000", 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6043000000000001e-05 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482294+0000", 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2873e-05 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482395+0000", 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101724 2024-04-24T13:30:48.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482446+0000", 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0288999999999999e-05 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486063+0000", 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036179290000000002 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486165+0000", 2024-04-24T13:30:48.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101949 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:473 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'8, mlcod=32'6)", 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.6794771, 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034165060000000001, 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485338+0000", 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.573e-06 2024-04-24T13:30:48.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485350+0000", 2024-04-24T13:30:48.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:30:48.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485377+0000", 2024-04-24T13:30:48.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6897e-05 2024-04-24T13:30:48.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485397+0000", 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9287999999999999e-05 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485521+0000", 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012448 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485572+0000", 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0704000000000001e-05 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488640+0000", 2024-04-24T13:30:48.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030685589999999998 2024-04-24T13:30:48.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488753+0000", 2024-04-24T13:30:48.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112682 2024-04-24T13:30:48.225 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.225 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.225 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.225 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:474 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'9, mlcod=32'6)", 2024-04-24T13:30:48.226 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:30:48.226 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.677107342999999, 2024-04-24T13:30:48.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045500480000000001, 2024-04-24T13:30:48.226 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.226 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.226 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.226 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487708+0000", 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4389999999999999e-06 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487718+0000", 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0386e-05 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487743+0000", 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5106999999999999e-05 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487762+0000", 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8348000000000001e-05 2024-04-24T13:30:48.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487893+0000", 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130968 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487926+0000", 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3827e-05 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492194+0000", 2024-04-24T13:30:48.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042671499999999999 2024-04-24T13:30:48.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492256+0000", 2024-04-24T13:30:48.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2823000000000005e-05 2024-04-24T13:30:48.230 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.230 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.230 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.230 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:476 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-24T13:30:48.230 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:30:48.230 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.676315471000001, 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059105989999999999, 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:30:48.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488500+0000", 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4169999999999999e-06 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488510+0000", 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0462000000000001e-05 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488536+0000", 2024-04-24T13:30:48.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6007e-05 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488553+0000", 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7037999999999998e-05 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488752+0000", 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019892900000000001 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488805+0000", 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2800999999999998e-05 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494315+0000", 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055099650000000003 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494409+0000", 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3980000000000005e-05 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.234 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'7)", 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.673339637, 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055780020000000003, 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:30:48.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491476+0000", 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8479999999999999e-06 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491503+0000", 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7189e-05 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491534+0000", 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1222e-05 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491553+0000", 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9069e-05 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491769+0000", 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000215479 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491830+0000", 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1169999999999999e-05 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.496974+0000", 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051441860000000002 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497052+0000", 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7838999999999998e-05 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:484 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'11, mlcod=32'8)", 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.667410276, 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022050070000000001, 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.239 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.240 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:30:48.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:30:48.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497405+0000", 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5889999999999999e-06 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497418+0000", 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2700999999999999e-05 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497449+0000", 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0911000000000003e-05 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497473+0000", 2024-04-24T13:30:48.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4326000000000001e-05 2024-04-24T13:30:48.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497563+0000", 2024-04-24T13:30:48.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9652000000000002e-05 2024-04-24T13:30:48.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497589+0000", 2024-04-24T13:30:48.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6669000000000002e-05 2024-04-24T13:30:48.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499542+0000", 2024-04-24T13:30:48.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019529180000000001 2024-04-24T13:30:48.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499608+0000", 2024-04-24T13:30:48.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6241000000000005e-05 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:511 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'3, mlcod=32'1)", 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.65236035, 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020247519999999999, 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512455+0000", 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.463e-06 2024-04-24T13:30:48.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512464+0000", 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.397e-06 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512488+0000", 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3502e-05 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512499+0000", 2024-04-24T13:30:48.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0908e-05 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512620+0000", 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012119 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512672+0000", 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2366e-05 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514389+0000", 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017172890000000001 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514478+0000", 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8636999999999999e-05 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:544 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'12, mlcod=32'10)", 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:30:48.248 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.627202426, 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020839690000000002, 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:30:48.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537613+0000", 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7710000000000001e-06 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537627+0000", 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3580999999999999e-05 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537658+0000", 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1470999999999997e-05 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537680+0000", 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1447e-05 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537779+0000", 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9049000000000007e-05 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537822+0000", 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3815e-05 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539590+0000", 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017677459999999999 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539695+0000", 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105089 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.252 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:552 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'13, mlcod=32'11)", 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.620061252999999, 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031853350000000001, 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:30:48.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:30:48.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544754+0000", 2024-04-24T13:30:48.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309999999999999e-06 2024-04-24T13:30:48.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544769+0000", 2024-04-24T13:30:48.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4259e-05 2024-04-24T13:30:48.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544803+0000", 2024-04-24T13:30:48.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4650000000000002e-05 2024-04-24T13:30:48.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544822+0000", 2024-04-24T13:30:48.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8700999999999999e-05 2024-04-24T13:30:48.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544956+0000", 2024-04-24T13:30:48.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134482 2024-04-24T13:30:48.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544991+0000", 2024-04-24T13:30:48.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4953000000000002e-05 2024-04-24T13:30:48.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547847+0000", 2024-04-24T13:30:48.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028556749999999998 2024-04-24T13:30:48.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547938+0000", 2024-04-24T13:30:48.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0784000000000004e-05 2024-04-24T13:30:48.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.257 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:705 6.1f e32/26 6:f93251ce:::obj_delete_at_hint.0000000042:head v 32'7, mlcod=32'5)", 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.487343546, 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018230220000000001, 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:30:48.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677472+0000", 2024-04-24T13:30:48.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-24T13:30:48.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677483+0000", 2024-04-24T13:30:48.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1025e-05 2024-04-24T13:30:48.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677510+0000", 2024-04-24T13:30:48.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6894e-05 2024-04-24T13:30:48.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677522+0000", 2024-04-24T13:30:48.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2367e-05 2024-04-24T13:30:48.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677616+0000", 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4239000000000004e-05 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677656+0000", 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9681999999999997e-05 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679172+0000", 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015157529999999999 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679293+0000", 2024-04-24T13:30:48.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012133099999999999 2024-04-24T13:30:48.262 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.262 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.262 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.262 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:709 6.1e e32/26 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 32'1, mlcod=0'0)", 2024-04-24T13:30:48.262 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:30:48.262 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.476925874999999, 2024-04-24T13:30:48.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020442059999999998, 2024-04-24T13:30:48.262 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.263 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.263 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.263 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:30:48.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:30:48.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.89e-07 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687895+0000", 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9959999999999996e-06 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687919+0000", 2024-04-24T13:30:48.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3455000000000002e-05 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687931+0000", 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2442e-05 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688076+0000", 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014435399999999999 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688127+0000", 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1910999999999998e-05 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689827+0000", 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00169918 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689932+0000", 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105379 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.266 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.267 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.267 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.267 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:48.270 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:30:48.274 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:30:48.279 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:30:48.281 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:48.266+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:48.282 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-04-24T13:30:47.878924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225204,"kb_used_data":4832,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749516,"statfs":{"total":773094113280,"available":772863504384,"internally_reserved":0,"allocated":4947968,"data_stored":2835562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.035380"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321933+0000","last_change":"2024-04-24T13:30:21.250354+0000","last_active":"2024-04-24T13:30:46.321933+0000","last_peered":"2024-04-24T13:30:46.321933+0000","last_clean":"2024-04-24T13:30:46.321933+0000","last_became_active":"2024-04-24T13:30:21.246835+0000","last_became_peered":"2024-04-24T13:30:21.246835+0000","last_unstale":"2024-04-24T13:30:46.321933+0000","last_undegraded":"2024-04-24T13:30:46.321933+0000","last_fullsized":"2024-04-24T13:30:46.321933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:09.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878208+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:30:46.878208+0000","last_peered":"2024-04-24T13:30:46.878208+0000","last_clean":"2024-04-24T13:30:46.878208+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:30:46.878208+0000","last_undegraded":"2024-04-24T13:30:46.878208+0000","last_fullsized":"2024-04-24T13:30:46.878208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321260+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:30:46.321260+0000","last_peered":"2024-04-24T13:30:46.321260+0000","last_clean":"2024-04-24T13:30:46.321260+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:30:46.321260+0000","last_undegraded":"2024-04-24T13:30:46.321260+0000","last_fullsized":"2024-04-24T13:30:46.321260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320693+0000","last_change":"2024-04-24T13:30:23.237080+0000","last_active":"2024-04-24T13:30:46.320693+0000","last_peered":"2024-04-24T13:30:46.320693+0000","last_clean":"2024-04-24T13:30:46.320693+0000","last_became_active":"2024-04-24T13:30:23.236356+0000","last_became_peered":"2024-04-24T13:30:23.236356+0000","last_unstale":"2024-04-24T13:30:46.320693+0000","last_undegraded":"2024-04-24T13:30:46.320693+0000","last_fullsized":"2024-04-24T13:30:46.320693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057031+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:30:46.057031+0000","last_peered":"2024-04-24T13:30:46.057031+0000","last_clean":"2024-04-24T13:30:46.057031+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:30:46.057031+0000","last_undegraded":"2024-04-24T13:30:46.057031+0000","last_fullsized":"2024-04-24T13:30:46.057031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093208+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:30:46.093208+0000","last_peered":"2024-04-24T13:30:46.093208+0000","last_clean":"2024-04-24T13:30:46.093208+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:30:46.093208+0000","last_undegraded":"2024-04-24T13:30:46.093208+0000","last_fullsized":"2024-04-24T13:30:46.093208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879070+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:30:46.879070+0000","last_peered":"2024-04-24T13:30:46.879070+0000","last_clean":"2024-04-24T13:30:46.879070+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:30:46.879070+0000","last_undegraded":"2024-04-24T13:30:46.879070+0000","last_fullsized":"2024-04-24T13:30:46.879070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058002+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:30:46.058002+0000","last_peered":"2024-04-24T13:30:46.058002+0000","last_clean":"2024-04-24T13:30:46.058002+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:30:46.058002+0000","last_undegraded":"2024-04-24T13:30:46.058002+0000","last_fullsized":"2024-04-24T13:30:46.058002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320676+0000","last_change":"2024-04-24T13:30:21.251948+0000","last_active":"2024-04-24T13:30:46.320676+0000","last_peered":"2024-04-24T13:30:46.320676+0000","last_clean":"2024-04-24T13:30:46.320676+0000","last_became_active":"2024-04-24T13:30:21.251184+0000","last_became_peered":"2024-04-24T13:30:21.251184+0000","last_unstale":"2024-04-24T13:30:46.320676+0000","last_undegraded":"2024-04-24T13:30:46.320676+0000","last_fullsized":"2024-04-24T13:30:46.320676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418088+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:30:47.418088+0000","last_peered":"2024-04-24T13:30:47.418088+0000","last_clean":"2024-04-24T13:30:47.418088+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:30:47.418088+0000","last_undegraded":"2024-04-24T13:30:47.418088+0000","last_fullsized":"2024-04-24T13:30:47.418088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878554+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:30:46.878554+0000","last_peered":"2024-04-24T13:30:46.878554+0000","last_clean":"2024-04-24T13:30:46.878554+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:30:46.878554+0000","last_undegraded":"2024-04-24T13:30:46.878554+0000","last_fullsized":"2024-04-24T13:30:46.878554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094365+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:30:46.094365+0000","last_peered":"2024-04-24T13:30:46.094365+0000","last_clean":"2024-04-24T13:30:46.094365+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:30:46.094365+0000","last_undegraded":"2024-04-24T13:30:46.094365+0000","last_fullsized":"2024-04-24T13:30:46.094365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321200+0000","last_change":"2024-04-24T13:30:21.247080+0000","last_active":"2024-04-24T13:30:46.321200+0000","last_peered":"2024-04-24T13:30:46.321200+0000","last_clean":"2024-04-24T13:30:46.321200+0000","last_became_active":"2024-04-24T13:30:21.239363+0000","last_became_peered":"2024-04-24T13:30:21.239363+0000","last_unstale":"2024-04-24T13:30:46.321200+0000","last_undegraded":"2024-04-24T13:30:46.321200+0000","last_fullsized":"2024-04-24T13:30:46.321200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878921+0000","last_change":"2024-04-24T13:30:23.228080+0000","last_active":"2024-04-24T13:30:46.878921+0000","last_peered":"2024-04-24T13:30:46.878921+0000","last_clean":"2024-04-24T13:30:46.878921+0000","last_became_active":"2024-04-24T13:30:23.227215+0000","last_became_peered":"2024-04-24T13:30:23.227215+0000","last_unstale":"2024-04-24T13:30:46.878921+0000","last_undegraded":"2024-04-24T13:30:46.878921+0000","last_fullsized":"2024-04-24T13:30:46.878921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879989+0000","last_change":"2024-04-24T13:30:21.232985+0000","last_active":"2024-04-24T13:30:46.879989+0000","last_peered":"2024-04-24T13:30:46.879989+0000","last_clean":"2024-04-24T13:30:46.879989+0000","last_became_active":"2024-04-24T13:30:21.229584+0000","last_became_peered":"2024-04-24T13:30:21.229584+0000","last_unstale":"2024-04-24T13:30:46.879989+0000","last_undegraded":"2024-04-24T13:30:46.879989+0000","last_fullsized":"2024-04-24T13:30:46.879989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.863926+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:30:45.863926+0000","last_peered":"2024-04-24T13:30:45.863926+0000","last_clean":"2024-04-24T13:30:45.863926+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:30:45.863926+0000","last_undegraded":"2024-04-24T13:30:45.863926+0000","last_fullsized":"2024-04-24T13:30:45.863926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092754+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:30:46.092754+0000","last_peered":"2024-04-24T13:30:46.092754+0000","last_clean":"2024-04-24T13:30:46.092754+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:30:46.092754+0000","last_undegraded":"2024-04-24T13:30:46.092754+0000","last_fullsized":"2024-04-24T13:30:46.092754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.322009+0000","last_change":"2024-04-24T13:30:21.247071+0000","last_active":"2024-04-24T13:30:46.322009+0000","last_peered":"2024-04-24T13:30:46.322009+0000","last_clean":"2024-04-24T13:30:46.322009+0000","last_became_active":"2024-04-24T13:30:21.246454+0000","last_became_peered":"2024-04-24T13:30:21.246454+0000","last_unstale":"2024-04-24T13:30:46.322009+0000","last_undegraded":"2024-04-24T13:30:46.322009+0000","last_fullsized":"2024-04-24T13:30:46.322009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:48.173823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320938+0000","last_change":"2024-04-24T13:30:23.241549+0000","last_active":"2024-04-24T13:30:46.320938+0000","last_peered":"2024-04-24T13:30:46.320938+0000","last_clean":"2024-04-24T13:30:46.320938+0000","last_became_active":"2024-04-24T13:30:23.236814+0000","last_became_peered":"2024-04-24T13:30:23.236814+0000","last_unstale":"2024-04-24T13:30:46.320938+0000","last_undegraded":"2024-04-24T13:30:46.320938+0000","last_fullsized":"2024-04-24T13:30:46.320938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418656+0000","last_change":"2024-04-24T13:30:21.244607+0000","last_active":"2024-04-24T13:30:47.418656+0000","last_peered":"2024-04-24T13:30:47.418656+0000","last_clean":"2024-04-24T13:30:47.418656+0000","last_became_active":"2024-04-24T13:30:21.243828+0000","last_became_peered":"2024-04-24T13:30:21.243828+0000","last_unstale":"2024-04-24T13:30:47.418656+0000","last_undegraded":"2024-04-24T13:30:47.418656+0000","last_fullsized":"2024-04-24T13:30:47.418656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878734+0000","last_change":"2024-04-24T13:30:23.220120+0000","last_active":"2024-04-24T13:30:46.878734+0000","last_peered":"2024-04-24T13:30:46.878734+0000","last_clean":"2024-04-24T13:30:46.878734+0000","last_became_active":"2024-04-24T13:30:23.219312+0000","last_became_peered":"2024-04-24T13:30:23.219312+0000","last_unstale":"2024-04-24T13:30:46.878734+0000","last_undegraded":"2024-04-24T13:30:46.878734+0000","last_fullsized":"2024-04-24T13:30:46.878734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418582+0000","last_change":"2024-04-24T13:30:21.243317+0000","last_active":"2024-04-24T13:30:47.418582+0000","last_peered":"2024-04-24T13:30:47.418582+0000","last_clean":"2024-04-24T13:30:47.418582+0000","last_became_active":"2024-04-24T13:30:21.239686+0000","last_became_peered":"2024-04-24T13:30:21.239686+0000","last_unstale":"2024-04-24T13:30:47.418582+0000","last_undegraded":"2024-04-24T13:30:47.418582+0000","last_fullsized":"2024-04-24T13:30:47.418582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.861710+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:30:45.861710+0000","last_peered":"2024-04-24T13:30:45.861710+0000","last_clean":"2024-04-24T13:30:45.861710+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:30:45.861710+0000","last_undegraded":"2024-04-24T13:30:45.861710+0000","last_fullsized":"2024-04-24T13:30:45.861710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092146+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:30:46.092146+0000","last_peered":"2024-04-24T13:30:46.092146+0000","last_clean":"2024-04-24T13:30:46.092146+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:30:46.092146+0000","last_undegraded":"2024-04-24T13:30:46.092146+0000","last_fullsized":"2024-04-24T13:30:46.092146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.862097+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:30:45.862097+0000","last_peered":"2024-04-24T13:30:45.862097+0000","last_clean":"2024-04-24T13:30:45.862097+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:30:45.862097+0000","last_undegraded":"2024-04-24T13:30:45.862097+0000","last_fullsized":"2024-04-24T13:30:45.862097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881123+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:30:46.881123+0000","last_peered":"2024-04-24T13:30:46.881123+0000","last_clean":"2024-04-24T13:30:46.881123+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:30:46.881123+0000","last_undegraded":"2024-04-24T13:30:46.881123+0000","last_fullsized":"2024-04-24T13:30:46.881123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094551+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:30:46.094551+0000","last_peered":"2024-04-24T13:30:46.094551+0000","last_clean":"2024-04-24T13:30:46.094551+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:30:46.094551+0000","last_undegraded":"2024-04-24T13:30:46.094551+0000","last_fullsized":"2024-04-24T13:30:46.094551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057703+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:30:46.057703+0000","last_peered":"2024-04-24T13:30:46.057703+0000","last_clean":"2024-04-24T13:30:46.057703+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:30:46.057703+0000","last_undegraded":"2024-04-24T13:30:46.057703+0000","last_fullsized":"2024-04-24T13:30:46.057703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092268+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:30:46.092268+0000","last_peered":"2024-04-24T13:30:46.092268+0000","last_clean":"2024-04-24T13:30:46.092268+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:30:46.092268+0000","last_undegraded":"2024-04-24T13:30:46.092268+0000","last_fullsized":"2024-04-24T13:30:46.092268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882056+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:30:46.882056+0000","last_peered":"2024-04-24T13:30:46.882056+0000","last_clean":"2024-04-24T13:30:46.882056+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:30:46.882056+0000","last_undegraded":"2024-04-24T13:30:46.882056+0000","last_fullsized":"2024-04-24T13:30:46.882056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321114+0000","last_change":"2024-04-24T13:30:21.239348+0000","last_active":"2024-04-24T13:30:46.321114+0000","last_peered":"2024-04-24T13:30:46.321114+0000","last_clean":"2024-04-24T13:30:46.321114+0000","last_became_active":"2024-04-24T13:30:21.238561+0000","last_became_peered":"2024-04-24T13:30:21.238561+0000","last_unstale":"2024-04-24T13:30:46.321114+0000","last_undegraded":"2024-04-24T13:30:46.321114+0000","last_fullsized":"2024-04-24T13:30:46.321114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879129+0000","last_change":"2024-04-24T13:30:25.234573+0000","last_active":"2024-04-24T13:30:46.879129+0000","last_peered":"2024-04-24T13:30:46.879129+0000","last_clean":"2024-04-24T13:30:46.879129+0000","last_became_active":"2024-04-24T13:30:25.233807+0000","last_became_peered":"2024-04-24T13:30:25.233807+0000","last_unstale":"2024-04-24T13:30:46.879129+0000","last_undegraded":"2024-04-24T13:30:46.879129+0000","last_fullsized":"2024-04-24T13:30:46.879129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058315+0000","last_change":"2024-04-24T13:30:27.251872+0000","last_active":"2024-04-24T13:30:46.058315+0000","last_peered":"2024-04-24T13:30:46.058315+0000","last_clean":"2024-04-24T13:30:46.058315+0000","last_became_active":"2024-04-24T13:30:27.251286+0000","last_became_peered":"2024-04-24T13:30:27.251286+0000","last_unstale":"2024-04-24T13:30:46.058315+0000","last_undegraded":"2024-04-24T13:30:46.058315+0000","last_fullsized":"2024-04-24T13:30:46.058315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:20.682651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321636+0000","last_change":"2024-04-24T13:30:29.281884+0000","last_active":"2024-04-24T13:30:46.321636+0000","last_peered":"2024-04-24T13:30:46.321636+0000","last_clean":"2024-04-24T13:30:46.321636+0000","last_became_active":"2024-04-24T13:30:29.281138+0000","last_became_peered":"2024-04-24T13:30:29.281138+0000","last_unstale":"2024-04-24T13:30:46.321636+0000","last_undegraded":"2024-04-24T13:30:46.321636+0000","last_fullsized":"2024-04-24T13:30:46.321636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878178+0000","last_change":"2024-04-24T13:30:31.266582+0000","last_active":"2024-04-24T13:30:46.878178+0000","last_peered":"2024-04-24T13:30:46.878178+0000","last_clean":"2024-04-24T13:30:46.878178+0000","last_became_active":"2024-04-24T13:30:31.265452+0000","last_became_peered":"2024-04-24T13:30:31.265452+0000","last_unstale":"2024-04-24T13:30:46.878178+0000","last_undegraded":"2024-04-24T13:30:46.878178+0000","last_fullsized":"2024-04-24T13:30:46.878178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880905+0000","last_change":"2024-04-24T13:30:23.247313+0000","last_active":"2024-04-24T13:30:46.880905+0000","last_peered":"2024-04-24T13:30:46.880905+0000","last_clean":"2024-04-24T13:30:46.880905+0000","last_became_active":"2024-04-24T13:30:23.246445+0000","last_became_peered":"2024-04-24T13:30:23.246445+0000","last_unstale":"2024-04-24T13:30:46.880905+0000","last_undegraded":"2024-04-24T13:30:46.880905+0000","last_fullsized":"2024-04-24T13:30:46.880905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057738+0000","last_change":"2024-04-24T13:30:21.238903+0000","last_active":"2024-04-24T13:30:46.057738+0000","last_peered":"2024-04-24T13:30:46.057738+0000","last_clean":"2024-04-24T13:30:46.057738+0000","last_became_active":"2024-04-24T13:30:21.238625+0000","last_became_peered":"2024-04-24T13:30:21.238625+0000","last_unstale":"2024-04-24T13:30:46.057738+0000","last_undegraded":"2024-04-24T13:30:46.057738+0000","last_fullsized":"2024-04-24T13:30:46.057738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881811+0000","last_change":"2024-04-24T13:30:25.226046+0000","last_active":"2024-04-24T13:30:46.881811+0000","last_peered":"2024-04-24T13:30:46.881811+0000","last_clean":"2024-04-24T13:30:46.881811+0000","last_became_active":"2024-04-24T13:30:25.225623+0000","last_became_peered":"2024-04-24T13:30:25.225623+0000","last_unstale":"2024-04-24T13:30:46.881811+0000","last_undegraded":"2024-04-24T13:30:46.881811+0000","last_fullsized":"2024-04-24T13:30:46.881811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094860+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:30:46.094860+0000","last_peered":"2024-04-24T13:30:46.094860+0000","last_clean":"2024-04-24T13:30:46.094860+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:30:46.094860+0000","last_undegraded":"2024-04-24T13:30:46.094860+0000","last_fullsized":"2024-04-24T13:30:46.094860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094414+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:30:46.094414+0000","last_peered":"2024-04-24T13:30:46.094414+0000","last_clean":"2024-04-24T13:30:46.094414+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:30:46.094414+0000","last_undegraded":"2024-04-24T13:30:46.094414+0000","last_fullsized":"2024-04-24T13:30:46.094414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057563+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:30:46.057563+0000","last_peered":"2024-04-24T13:30:46.057563+0000","last_clean":"2024-04-24T13:30:46.057563+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:30:46.057563+0000","last_undegraded":"2024-04-24T13:30:46.057563+0000","last_fullsized":"2024-04-24T13:30:46.057563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058816+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:30:46.058816+0000","last_peered":"2024-04-24T13:30:46.058816+0000","last_clean":"2024-04-24T13:30:46.058816+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:30:46.058816+0000","last_undegraded":"2024-04-24T13:30:46.058816+0000","last_fullsized":"2024-04-24T13:30:46.058816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321418+0000","last_change":"2024-04-24T13:30:21.250665+0000","last_active":"2024-04-24T13:30:46.321418+0000","last_peered":"2024-04-24T13:30:46.321418+0000","last_clean":"2024-04-24T13:30:46.321418+0000","last_became_active":"2024-04-24T13:30:21.246084+0000","last_became_peered":"2024-04-24T13:30:21.246084+0000","last_unstale":"2024-04-24T13:30:46.321418+0000","last_undegraded":"2024-04-24T13:30:46.321418+0000","last_fullsized":"2024-04-24T13:30:46.321418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882881+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:30:46.882881+0000","last_peered":"2024-04-24T13:30:46.882881+0000","last_clean":"2024-04-24T13:30:46.882881+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:30:46.882881+0000","last_undegraded":"2024-04-24T13:30:46.882881+0000","last_fullsized":"2024-04-24T13:30:46.882881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.861917+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:30:45.861917+0000","last_peered":"2024-04-24T13:30:45.861917+0000","last_clean":"2024-04-24T13:30:45.861917+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:30:45.861917+0000","last_undegraded":"2024-04-24T13:30:45.861917+0000","last_fullsized":"2024-04-24T13:30:45.861917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321214+0000","last_change":"2024-04-24T13:30:29.287547+0000","last_active":"2024-04-24T13:30:46.321214+0000","last_peered":"2024-04-24T13:30:46.321214+0000","last_clean":"2024-04-24T13:30:46.321214+0000","last_became_active":"2024-04-24T13:30:29.285504+0000","last_became_peered":"2024-04-24T13:30:29.285504+0000","last_unstale":"2024-04-24T13:30:46.321214+0000","last_undegraded":"2024-04-24T13:30:46.321214+0000","last_fullsized":"2024-04-24T13:30:46.321214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093112+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:30:46.093112+0000","last_peered":"2024-04-24T13:30:46.093112+0000","last_clean":"2024-04-24T13:30:46.093112+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:30:46.093112+0000","last_undegraded":"2024-04-24T13:30:46.093112+0000","last_fullsized":"2024-04-24T13:30:46.093112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882515+0000","last_change":"2024-04-24T13:30:23.243719+0000","last_active":"2024-04-24T13:30:46.882515+0000","last_peered":"2024-04-24T13:30:46.882515+0000","last_clean":"2024-04-24T13:30:46.882515+0000","last_became_active":"2024-04-24T13:30:23.243202+0000","last_became_peered":"2024-04-24T13:30:23.243202+0000","last_unstale":"2024-04-24T13:30:46.882515+0000","last_undegraded":"2024-04-24T13:30:46.882515+0000","last_fullsized":"2024-04-24T13:30:46.882515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:56.206587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417728+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:30:47.417728+0000","last_peered":"2024-04-24T13:30:47.417728+0000","last_clean":"2024-04-24T13:30:47.417728+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:30:47.417728+0000","last_undegraded":"2024-04-24T13:30:47.417728+0000","last_fullsized":"2024-04-24T13:30:47.417728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878781+0000","last_change":"2024-04-24T13:30:25.229897+0000","last_active":"2024-04-24T13:30:46.878781+0000","last_peered":"2024-04-24T13:30:46.878781+0000","last_clean":"2024-04-24T13:30:46.878781+0000","last_became_active":"2024-04-24T13:30:25.228575+0000","last_became_peered":"2024-04-24T13:30:25.228575+0000","last_unstale":"2024-04-24T13:30:46.878781+0000","last_undegraded":"2024-04-24T13:30:46.878781+0000","last_fullsized":"2024-04-24T13:30:46.878781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321527+0000","last_change":"2024-04-24T13:30:27.251316+0000","last_active":"2024-04-24T13:30:46.321527+0000","last_peered":"2024-04-24T13:30:46.321527+0000","last_clean":"2024-04-24T13:30:46.321527+0000","last_became_active":"2024-04-24T13:30:27.250447+0000","last_became_peered":"2024-04-24T13:30:27.250447+0000","last_unstale":"2024-04-24T13:30:46.321527+0000","last_undegraded":"2024-04-24T13:30:46.321527+0000","last_fullsized":"2024-04-24T13:30:46.321527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881319+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:30:46.881319+0000","last_peered":"2024-04-24T13:30:46.881319+0000","last_clean":"2024-04-24T13:30:46.881319+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:30:46.881319+0000","last_undegraded":"2024-04-24T13:30:46.881319+0000","last_fullsized":"2024-04-24T13:30:46.881319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878382+0000","last_change":"2024-04-24T13:30:23.245613+0000","last_active":"2024-04-24T13:30:46.878382+0000","last_peered":"2024-04-24T13:30:46.878382+0000","last_clean":"2024-04-24T13:30:46.878382+0000","last_became_active":"2024-04-24T13:30:23.242590+0000","last_became_peered":"2024-04-24T13:30:23.242590+0000","last_unstale":"2024-04-24T13:30:46.878382+0000","last_undegraded":"2024-04-24T13:30:46.878382+0000","last_fullsized":"2024-04-24T13:30:46.878382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.323370+0000","last_change":"2024-04-24T13:30:21.256198+0000","last_active":"2024-04-24T13:30:46.323370+0000","last_peered":"2024-04-24T13:30:46.323370+0000","last_clean":"2024-04-24T13:30:46.323370+0000","last_became_active":"2024-04-24T13:30:21.255557+0000","last_became_peered":"2024-04-24T13:30:21.255557+0000","last_unstale":"2024-04-24T13:30:46.323370+0000","last_undegraded":"2024-04-24T13:30:46.323370+0000","last_fullsized":"2024-04-24T13:30:46.323370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:09.431110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320084+0000","last_change":"2024-04-24T13:30:25.237115+0000","last_active":"2024-04-24T13:30:46.320084+0000","last_peered":"2024-04-24T13:30:46.320084+0000","last_clean":"2024-04-24T13:30:46.320084+0000","last_became_active":"2024-04-24T13:30:25.236366+0000","last_became_peered":"2024-04-24T13:30:25.236366+0000","last_unstale":"2024-04-24T13:30:46.320084+0000","last_undegraded":"2024-04-24T13:30:46.320084+0000","last_fullsized":"2024-04-24T13:30:46.320084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:57.978574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878257+0000","last_change":"2024-04-24T13:30:27.261028+0000","last_active":"2024-04-24T13:30:46.878257+0000","last_peered":"2024-04-24T13:30:46.878257+0000","last_clean":"2024-04-24T13:30:46.878257+0000","last_became_active":"2024-04-24T13:30:27.260231+0000","last_became_peered":"2024-04-24T13:30:27.260231+0000","last_unstale":"2024-04-24T13:30:46.878257+0000","last_undegraded":"2024-04-24T13:30:46.878257+0000","last_fullsized":"2024-04-24T13:30:46.878257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320028+0000","last_change":"2024-04-24T13:30:29.256804+0000","last_active":"2024-04-24T13:30:46.320028+0000","last_peered":"2024-04-24T13:30:46.320028+0000","last_clean":"2024-04-24T13:30:46.320028+0000","last_became_active":"2024-04-24T13:30:29.255975+0000","last_became_peered":"2024-04-24T13:30:29.255975+0000","last_unstale":"2024-04-24T13:30:46.320028+0000","last_undegraded":"2024-04-24T13:30:46.320028+0000","last_fullsized":"2024-04-24T13:30:46.320028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:51.521585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878823+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:30:46.878823+0000","last_peered":"2024-04-24T13:30:46.878823+0000","last_clean":"2024-04-24T13:30:46.878823+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:30:46.878823+0000","last_undegraded":"2024-04-24T13:30:46.878823+0000","last_fullsized":"2024-04-24T13:30:46.878823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092903+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:30:46.092903+0000","last_peered":"2024-04-24T13:30:46.092903+0000","last_clean":"2024-04-24T13:30:46.092903+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:30:46.092903+0000","last_undegraded":"2024-04-24T13:30:46.092903+0000","last_fullsized":"2024-04-24T13:30:46.092903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321657+0000","last_change":"2024-04-24T13:30:21.251719+0000","last_active":"2024-04-24T13:30:46.321657+0000","last_peered":"2024-04-24T13:30:46.321657+0000","last_clean":"2024-04-24T13:30:46.321657+0000","last_became_active":"2024-04-24T13:30:21.239440+0000","last_became_peered":"2024-04-24T13:30:21.239440+0000","last_unstale":"2024-04-24T13:30:46.321657+0000","last_undegraded":"2024-04-24T13:30:46.321657+0000","last_fullsized":"2024-04-24T13:30:46.321657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:24.585089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.861140+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:30:45.861140+0000","last_peered":"2024-04-24T13:30:45.861140+0000","last_clean":"2024-04-24T13:30:45.861140+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:30:45.861140+0000","last_undegraded":"2024-04-24T13:30:45.861140+0000","last_fullsized":"2024-04-24T13:30:45.861140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881485+0000","last_change":"2024-04-24T13:30:27.252640+0000","last_active":"2024-04-24T13:30:46.881485+0000","last_peered":"2024-04-24T13:30:46.881485+0000","last_clean":"2024-04-24T13:30:46.881485+0000","last_became_active":"2024-04-24T13:30:27.252211+0000","last_became_peered":"2024-04-24T13:30:27.252211+0000","last_unstale":"2024-04-24T13:30:46.881485+0000","last_undegraded":"2024-04-24T13:30:46.881485+0000","last_fullsized":"2024-04-24T13:30:46.881485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:15.455006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880329+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:30:46.880329+0000","last_peered":"2024-04-24T13:30:46.880329+0000","last_clean":"2024-04-24T13:30:46.880329+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:30:46.880329+0000","last_undegraded":"2024-04-24T13:30:46.880329+0000","last_fullsized":"2024-04-24T13:30:46.880329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418057+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:30:47.418057+0000","last_peered":"2024-04-24T13:30:47.418057+0000","last_clean":"2024-04-24T13:30:47.418057+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:30:47.418057+0000","last_undegraded":"2024-04-24T13:30:47.418057+0000","last_fullsized":"2024-04-24T13:30:47.418057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417964+0000","last_change":"2024-04-24T13:30:23.239143+0000","last_active":"2024-04-24T13:30:47.417964+0000","last_peered":"2024-04-24T13:30:47.417964+0000","last_clean":"2024-04-24T13:30:47.417964+0000","last_became_active":"2024-04-24T13:30:23.238351+0000","last_became_peered":"2024-04-24T13:30:23.238351+0000","last_unstale":"2024-04-24T13:30:47.417964+0000","last_undegraded":"2024-04-24T13:30:47.417964+0000","last_fullsized":"2024-04-24T13:30:47.417964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.322411+0000","last_change":"2024-04-24T13:30:21.250029+0000","last_active":"2024-04-24T13:30:46.322411+0000","last_peered":"2024-04-24T13:30:46.322411+0000","last_clean":"2024-04-24T13:30:46.322411+0000","last_became_active":"2024-04-24T13:30:21.247198+0000","last_became_peered":"2024-04-24T13:30:21.247198+0000","last_unstale":"2024-04-24T13:30:46.322411+0000","last_undegraded":"2024-04-24T13:30:46.322411+0000","last_fullsized":"2024-04-24T13:30:46.322411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:02.477283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.861963+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:30:45.861963+0000","last_peered":"2024-04-24T13:30:45.861963+0000","last_clean":"2024-04-24T13:30:45.861963+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:30:45.861963+0000","last_undegraded":"2024-04-24T13:30:45.861963+0000","last_fullsized":"2024-04-24T13:30:45.861963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320777+0000","last_change":"2024-04-24T13:30:27.243504+0000","last_active":"2024-04-24T13:30:46.320777+0000","last_peered":"2024-04-24T13:30:46.320777+0000","last_clean":"2024-04-24T13:30:46.320777+0000","last_became_active":"2024-04-24T13:30:27.237695+0000","last_became_peered":"2024-04-24T13:30:27.237695+0000","last_unstale":"2024-04-24T13:30:46.320777+0000","last_undegraded":"2024-04-24T13:30:46.320777+0000","last_fullsized":"2024-04-24T13:30:46.320777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:19.623955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057176+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:30:46.057176+0000","last_peered":"2024-04-24T13:30:46.057176+0000","last_clean":"2024-04-24T13:30:46.057176+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:30:46.057176+0000","last_undegraded":"2024-04-24T13:30:46.057176+0000","last_fullsized":"2024-04-24T13:30:46.057176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058405+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:30:46.058405+0000","last_peered":"2024-04-24T13:30:46.058405+0000","last_clean":"2024-04-24T13:30:46.058405+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:30:46.058405+0000","last_undegraded":"2024-04-24T13:30:46.058405+0000","last_fullsized":"2024-04-24T13:30:46.058405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058565+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:30:46.058565+0000","last_peered":"2024-04-24T13:30:46.058565+0000","last_clean":"2024-04-24T13:30:46.058565+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:30:46.058565+0000","last_undegraded":"2024-04-24T13:30:46.058565+0000","last_fullsized":"2024-04-24T13:30:46.058565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880836+0000","last_change":"2024-04-24T13:30:21.228287+0000","last_active":"2024-04-24T13:30:46.880836+0000","last_peered":"2024-04-24T13:30:46.880836+0000","last_clean":"2024-04-24T13:30:46.880836+0000","last_became_active":"2024-04-24T13:30:21.227358+0000","last_became_peered":"2024-04-24T13:30:21.227358+0000","last_unstale":"2024-04-24T13:30:46.880836+0000","last_undegraded":"2024-04-24T13:30:46.880836+0000","last_fullsized":"2024-04-24T13:30:46.880836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:09.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.862151+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:30:45.862151+0000","last_peered":"2024-04-24T13:30:45.862151+0000","last_clean":"2024-04-24T13:30:45.862151+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:30:45.862151+0000","last_undegraded":"2024-04-24T13:30:45.862151+0000","last_fullsized":"2024-04-24T13:30:45.862151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057971+0000","last_change":"2024-04-24T13:30:27.249393+0000","last_active":"2024-04-24T13:30:46.057971+0000","last_peered":"2024-04-24T13:30:46.057971+0000","last_clean":"2024-04-24T13:30:46.057971+0000","last_became_active":"2024-04-24T13:30:27.248615+0000","last_became_peered":"2024-04-24T13:30:27.248615+0000","last_unstale":"2024-04-24T13:30:46.057971+0000","last_undegraded":"2024-04-24T13:30:46.057971+0000","last_fullsized":"2024-04-24T13:30:46.057971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:19.623955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.860939+0000","last_change":"2024-04-24T13:30:29.273036+0000","last_active":"2024-04-24T13:30:45.860939+0000","last_peered":"2024-04-24T13:30:45.860939+0000","last_clean":"2024-04-24T13:30:45.860939+0000","last_became_active":"2024-04-24T13:30:29.272326+0000","last_became_peered":"2024-04-24T13:30:29.272326+0000","last_unstale":"2024-04-24T13:30:45.860939+0000","last_undegraded":"2024-04-24T13:30:45.860939+0000","last_fullsized":"2024-04-24T13:30:45.860939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:12.872542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321109+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:30:46.321109+0000","last_peered":"2024-04-24T13:30:46.321109+0000","last_clean":"2024-04-24T13:30:46.321109+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:30:46.321109+0000","last_undegraded":"2024-04-24T13:30:46.321109+0000","last_fullsized":"2024-04-24T13:30:46.321109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094215+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:30:46.094215+0000","last_peered":"2024-04-24T13:30:46.094215+0000","last_clean":"2024-04-24T13:30:46.094215+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:30:46.094215+0000","last_undegraded":"2024-04-24T13:30:46.094215+0000","last_fullsized":"2024-04-24T13:30:46.094215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880812+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:30:46.880812+0000","last_peered":"2024-04-24T13:30:46.880812+0000","last_clean":"2024-04-24T13:30:46.880812+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:30:46.880812+0000","last_undegraded":"2024-04-24T13:30:46.880812+0000","last_fullsized":"2024-04-24T13:30:46.880812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.862223+0000","last_change":"2024-04-24T13:30:25.226038+0000","last_active":"2024-04-24T13:30:45.862223+0000","last_peered":"2024-04-24T13:30:45.862223+0000","last_clean":"2024-04-24T13:30:45.862223+0000","last_became_active":"2024-04-24T13:30:25.225628+0000","last_became_peered":"2024-04-24T13:30:25.225628+0000","last_unstale":"2024-04-24T13:30:45.862223+0000","last_undegraded":"2024-04-24T13:30:45.862223+0000","last_fullsized":"2024-04-24T13:30:45.862223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:33.775369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094423+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:30:46.094423+0000","last_peered":"2024-04-24T13:30:46.094423+0000","last_clean":"2024-04-24T13:30:46.094423+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:30:46.094423+0000","last_undegraded":"2024-04-24T13:30:46.094423+0000","last_fullsized":"2024-04-24T13:30:46.094423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058364+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:30:46.058364+0000","last_peered":"2024-04-24T13:30:46.058364+0000","last_clean":"2024-04-24T13:30:46.058364+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:30:46.058364+0000","last_undegraded":"2024-04-24T13:30:46.058364+0000","last_fullsized":"2024-04-24T13:30:46.058364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879595+0000","last_change":"2024-04-24T13:30:31.269459+0000","last_active":"2024-04-24T13:30:46.879595+0000","last_peered":"2024-04-24T13:30:46.879595+0000","last_clean":"2024-04-24T13:30:46.879595+0000","last_became_active":"2024-04-24T13:30:31.268604+0000","last_became_peered":"2024-04-24T13:30:31.268604+0000","last_unstale":"2024-04-24T13:30:46.879595+0000","last_undegraded":"2024-04-24T13:30:46.879595+0000","last_fullsized":"2024-04-24T13:30:46.879595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:57.047113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094993+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:30:46.094993+0000","last_peered":"2024-04-24T13:30:46.094993+0000","last_clean":"2024-04-24T13:30:46.094993+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:30:46.094993+0000","last_undegraded":"2024-04-24T13:30:46.094993+0000","last_fullsized":"2024-04-24T13:30:46.094993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418080+0000","last_change":"2024-04-24T13:30:21.233733+0000","last_active":"2024-04-24T13:30:47.418080+0000","last_peered":"2024-04-24T13:30:47.418080+0000","last_clean":"2024-04-24T13:30:47.418080+0000","last_became_active":"2024-04-24T13:30:21.221797+0000","last_became_peered":"2024-04-24T13:30:21.221797+0000","last_unstale":"2024-04-24T13:30:47.418080+0000","last_undegraded":"2024-04-24T13:30:47.418080+0000","last_fullsized":"2024-04-24T13:30:47.418080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319077+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:30:46.319077+0000","last_peered":"2024-04-24T13:30:46.319077+0000","last_clean":"2024-04-24T13:30:46.319077+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:30:46.319077+0000","last_undegraded":"2024-04-24T13:30:46.319077+0000","last_fullsized":"2024-04-24T13:30:46.319077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.863722+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:30:45.863722+0000","last_peered":"2024-04-24T13:30:45.863722+0000","last_clean":"2024-04-24T13:30:45.863722+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:30:45.863722+0000","last_undegraded":"2024-04-24T13:30:45.863722+0000","last_fullsized":"2024-04-24T13:30:45.863722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.860935+0000","last_change":"2024-04-24T13:30:29.259692+0000","last_active":"2024-04-24T13:30:45.860935+0000","last_peered":"2024-04-24T13:30:45.860935+0000","last_clean":"2024-04-24T13:30:45.860935+0000","last_became_active":"2024-04-24T13:30:29.258945+0000","last_became_peered":"2024-04-24T13:30:29.258945+0000","last_unstale":"2024-04-24T13:30:45.860935+0000","last_undegraded":"2024-04-24T13:30:45.860935+0000","last_fullsized":"2024-04-24T13:30:45.860935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:35.346937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319874+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:30:46.319874+0000","last_peered":"2024-04-24T13:30:46.319874+0000","last_clean":"2024-04-24T13:30:46.319874+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:30:46.319874+0000","last_undegraded":"2024-04-24T13:30:46.319874+0000","last_fullsized":"2024-04-24T13:30:46.319874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094992+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:30:46.094992+0000","last_peered":"2024-04-24T13:30:46.094992+0000","last_clean":"2024-04-24T13:30:46.094992+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:30:46.094992+0000","last_undegraded":"2024-04-24T13:30:46.094992+0000","last_fullsized":"2024-04-24T13:30:46.094992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092118+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:30:46.092118+0000","last_peered":"2024-04-24T13:30:46.092118+0000","last_clean":"2024-04-24T13:30:46.092118+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:30:46.092118+0000","last_undegraded":"2024-04-24T13:30:46.092118+0000","last_fullsized":"2024-04-24T13:30:46.092118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878800+0000","last_change":"2024-04-24T13:30:25.223759+0000","last_active":"2024-04-24T13:30:46.878800+0000","last_peered":"2024-04-24T13:30:46.878800+0000","last_clean":"2024-04-24T13:30:46.878800+0000","last_became_active":"2024-04-24T13:30:25.222877+0000","last_became_peered":"2024-04-24T13:30:25.222877+0000","last_unstale":"2024-04-24T13:30:46.878800+0000","last_undegraded":"2024-04-24T13:30:46.878800+0000","last_fullsized":"2024-04-24T13:30:46.878800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881557+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:30:46.881557+0000","last_peered":"2024-04-24T13:30:46.881557+0000","last_clean":"2024-04-24T13:30:46.881557+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:30:46.881557+0000","last_undegraded":"2024-04-24T13:30:46.881557+0000","last_fullsized":"2024-04-24T13:30:46.881557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418323+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:30:47.418323+0000","last_peered":"2024-04-24T13:30:47.418323+0000","last_clean":"2024-04-24T13:30:47.418323+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:30:47.418323+0000","last_undegraded":"2024-04-24T13:30:47.418323+0000","last_fullsized":"2024-04-24T13:30:47.418323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093286+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:30:46.093286+0000","last_peered":"2024-04-24T13:30:46.093286+0000","last_clean":"2024-04-24T13:30:46.093286+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:30:46.093286+0000","last_undegraded":"2024-04-24T13:30:46.093286+0000","last_fullsized":"2024-04-24T13:30:46.093286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321261+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:30:46.321261+0000","last_peered":"2024-04-24T13:30:46.321261+0000","last_clean":"2024-04-24T13:30:46.321261+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:30:46.321261+0000","last_undegraded":"2024-04-24T13:30:46.321261+0000","last_fullsized":"2024-04-24T13:30:46.321261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880083+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:30:46.880083+0000","last_peered":"2024-04-24T13:30:46.880083+0000","last_clean":"2024-04-24T13:30:46.880083+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:30:46.880083+0000","last_undegraded":"2024-04-24T13:30:46.880083+0000","last_fullsized":"2024-04-24T13:30:46.880083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094708+0000","last_change":"2024-04-24T13:30:25.224875+0000","last_active":"2024-04-24T13:30:46.094708+0000","last_peered":"2024-04-24T13:30:46.094708+0000","last_clean":"2024-04-24T13:30:46.094708+0000","last_became_active":"2024-04-24T13:30:25.224128+0000","last_became_peered":"2024-04-24T13:30:25.224128+0000","last_unstale":"2024-04-24T13:30:46.094708+0000","last_undegraded":"2024-04-24T13:30:46.094708+0000","last_fullsized":"2024-04-24T13:30:46.094708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878773+0000","last_change":"2024-04-24T13:30:27.261440+0000","last_active":"2024-04-24T13:30:46.878773+0000","last_peered":"2024-04-24T13:30:46.878773+0000","last_clean":"2024-04-24T13:30:46.878773+0000","last_became_active":"2024-04-24T13:30:27.260655+0000","last_became_peered":"2024-04-24T13:30:27.260655+0000","last_unstale":"2024-04-24T13:30:46.878773+0000","last_undegraded":"2024-04-24T13:30:46.878773+0000","last_fullsized":"2024-04-24T13:30:46.878773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417819+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:30:47.417819+0000","last_peered":"2024-04-24T13:30:47.417819+0000","last_clean":"2024-04-24T13:30:47.417819+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:30:47.417819+0000","last_undegraded":"2024-04-24T13:30:47.417819+0000","last_fullsized":"2024-04-24T13:30:47.417819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319790+0000","last_change":"2024-04-24T13:30:31.264695+0000","last_active":"2024-04-24T13:30:46.319790+0000","last_peered":"2024-04-24T13:30:46.319790+0000","last_clean":"2024-04-24T13:30:46.319790+0000","last_became_active":"2024-04-24T13:30:31.263950+0000","last_became_peered":"2024-04-24T13:30:31.263950+0000","last_unstale":"2024-04-24T13:30:46.319790+0000","last_undegraded":"2024-04-24T13:30:46.319790+0000","last_fullsized":"2024-04-24T13:30:46.319790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:18.381332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418484+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:30:47.418484+0000","last_peered":"2024-04-24T13:30:47.418484+0000","last_clean":"2024-04-24T13:30:47.418484+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:30:47.418484+0000","last_undegraded":"2024-04-24T13:30:47.418484+0000","last_fullsized":"2024-04-24T13:30:47.418484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":205,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321048+0000","last_change":"2024-04-24T13:30:08.802517+0000","last_active":"2024-04-24T13:30:46.321048+0000","last_peered":"2024-04-24T13:30:46.321048+0000","last_clean":"2024-04-24T13:30:46.321048+0000","last_became_active":"2024-04-24T13:30:08.800555+0000","last_became_peered":"2024-04-24T13:30:08.800555+0000","last_unstale":"2024-04-24T13:30:46.321048+0000","last_undegraded":"2024-04-24T13:30:46.321048+0000","last_fullsized":"2024-04-24T13:30:46.321048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:06.125070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879101+0000","last_change":"2024-04-24T13:30:15.154142+0000","last_active":"2024-04-24T13:30:46.879101+0000","last_peered":"2024-04-24T13:30:46.879101+0000","last_clean":"2024-04-24T13:30:46.879101+0000","last_became_active":"2024-04-24T13:30:15.153433+0000","last_became_peered":"2024-04-24T13:30:15.153433+0000","last_unstale":"2024-04-24T13:30:46.879101+0000","last_undegraded":"2024-04-24T13:30:46.879101+0000","last_fullsized":"2024-04-24T13:30:46.879101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880813+0000","last_change":"2024-04-24T13:30:21.229655+0000","last_active":"2024-04-24T13:30:46.880813+0000","last_peered":"2024-04-24T13:30:46.880813+0000","last_clean":"2024-04-24T13:30:46.880813+0000","last_became_active":"2024-04-24T13:30:21.229312+0000","last_became_peered":"2024-04-24T13:30:21.229312+0000","last_unstale":"2024-04-24T13:30:46.880813+0000","last_undegraded":"2024-04-24T13:30:46.880813+0000","last_fullsized":"2024-04-24T13:30:46.880813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320517+0000","last_change":"2024-04-24T13:30:25.238663+0000","last_active":"2024-04-24T13:30:46.320517+0000","last_peered":"2024-04-24T13:30:46.320517+0000","last_clean":"2024-04-24T13:30:46.320517+0000","last_became_active":"2024-04-24T13:30:25.237978+0000","last_became_peered":"2024-04-24T13:30:25.237978+0000","last_unstale":"2024-04-24T13:30:46.320517+0000","last_undegraded":"2024-04-24T13:30:46.320517+0000","last_fullsized":"2024-04-24T13:30:46.320517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:02.798146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878850+0000","last_change":"2024-04-24T13:30:27.258347+0000","last_active":"2024-04-24T13:30:46.878850+0000","last_peered":"2024-04-24T13:30:46.878850+0000","last_clean":"2024-04-24T13:30:46.878850+0000","last_became_active":"2024-04-24T13:30:27.257694+0000","last_became_peered":"2024-04-24T13:30:27.257694+0000","last_unstale":"2024-04-24T13:30:46.878850+0000","last_undegraded":"2024-04-24T13:30:46.878850+0000","last_fullsized":"2024-04-24T13:30:46.878850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058483+0000","last_change":"2024-04-24T13:30:29.280834+0000","last_active":"2024-04-24T13:30:46.058483+0000","last_peered":"2024-04-24T13:30:46.058483+0000","last_clean":"2024-04-24T13:30:46.058483+0000","last_became_active":"2024-04-24T13:30:29.280212+0000","last_became_peered":"2024-04-24T13:30:29.280212+0000","last_unstale":"2024-04-24T13:30:46.058483+0000","last_undegraded":"2024-04-24T13:30:46.058483+0000","last_fullsized":"2024-04-24T13:30:46.058483+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417183+0000","last_change":"2024-04-24T13:30:31.272077+0000","last_active":"2024-04-24T13:30:47.417183+0000","last_peered":"2024-04-24T13:30:47.417183+0000","last_clean":"2024-04-24T13:30:47.417183+0000","last_became_active":"2024-04-24T13:30:31.271268+0000","last_became_peered":"2024-04-24T13:30:31.271268+0000","last_unstale":"2024-04-24T13:30:47.417183+0000","last_undegraded":"2024-04-24T13:30:47.417183+0000","last_fullsized":"2024-04-24T13:30:47.417183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:33.796332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058768+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:30:46.058768+0000","last_peered":"2024-04-24T13:30:46.058768+0000","last_clean":"2024-04-24T13:30:46.058768+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:30:46.058768+0000","last_undegraded":"2024-04-24T13:30:46.058768+0000","last_fullsized":"2024-04-24T13:30:46.058768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320236+0000","last_change":"2024-04-24T13:30:15.156142+0000","last_active":"2024-04-24T13:30:46.320236+0000","last_peered":"2024-04-24T13:30:46.320236+0000","last_clean":"2024-04-24T13:30:46.320236+0000","last_became_active":"2024-04-24T13:30:15.155326+0000","last_became_peered":"2024-04-24T13:30:15.155326+0000","last_unstale":"2024-04-24T13:30:46.320236+0000","last_undegraded":"2024-04-24T13:30:46.320236+0000","last_fullsized":"2024-04-24T13:30:46.320236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:52.140457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058065+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:30:46.058065+0000","last_peered":"2024-04-24T13:30:46.058065+0000","last_clean":"2024-04-24T13:30:46.058065+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:30:46.058065+0000","last_undegraded":"2024-04-24T13:30:46.058065+0000","last_fullsized":"2024-04-24T13:30:46.058065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879174+0000","last_change":"2024-04-24T13:30:25.232972+0000","last_active":"2024-04-24T13:30:46.879174+0000","last_peered":"2024-04-24T13:30:46.879174+0000","last_clean":"2024-04-24T13:30:46.879174+0000","last_became_active":"2024-04-24T13:30:25.232265+0000","last_became_peered":"2024-04-24T13:30:25.232265+0000","last_unstale":"2024-04-24T13:30:46.879174+0000","last_undegraded":"2024-04-24T13:30:46.879174+0000","last_fullsized":"2024-04-24T13:30:46.879174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:47.489762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":76,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.318967+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:30:46.318967+0000","last_peered":"2024-04-24T13:30:46.318967+0000","last_clean":"2024-04-24T13:30:46.318967+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:30:46.318967+0000","last_undegraded":"2024-04-24T13:30:46.318967+0000","last_fullsized":"2024-04-24T13:30:46.318967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321456+0000","last_change":"2024-04-24T13:30:29.275359+0000","last_active":"2024-04-24T13:30:46.321456+0000","last_peered":"2024-04-24T13:30:46.321456+0000","last_clean":"2024-04-24T13:30:46.321456+0000","last_became_active":"2024-04-24T13:30:29.274589+0000","last_became_peered":"2024-04-24T13:30:29.274589+0000","last_unstale":"2024-04-24T13:30:46.321456+0000","last_undegraded":"2024-04-24T13:30:46.321456+0000","last_fullsized":"2024-04-24T13:30:46.321456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319087+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:30:46.319087+0000","last_peered":"2024-04-24T13:30:46.319087+0000","last_clean":"2024-04-24T13:30:46.319087+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:30:46.319087+0000","last_undegraded":"2024-04-24T13:30:46.319087+0000","last_fullsized":"2024-04-24T13:30:46.319087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321352+0000","last_change":"2024-04-24T13:30:23.217937+0000","last_active":"2024-04-24T13:30:46.321352+0000","last_peered":"2024-04-24T13:30:46.321352+0000","last_clean":"2024-04-24T13:30:46.321352+0000","last_became_active":"2024-04-24T13:30:23.217577+0000","last_became_peered":"2024-04-24T13:30:23.217577+0000","last_unstale":"2024-04-24T13:30:46.321352+0000","last_undegraded":"2024-04-24T13:30:46.321352+0000","last_fullsized":"2024-04-24T13:30:46.321352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.861618+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:30:45.861618+0000","last_peered":"2024-04-24T13:30:45.861618+0000","last_clean":"2024-04-24T13:30:45.861618+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:30:45.861618+0000","last_undegraded":"2024-04-24T13:30:45.861618+0000","last_fullsized":"2024-04-24T13:30:45.861618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.318729+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:30:46.318729+0000","last_peered":"2024-04-24T13:30:46.318729+0000","last_clean":"2024-04-24T13:30:46.318729+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:30:46.318729+0000","last_undegraded":"2024-04-24T13:30:46.318729+0000","last_fullsized":"2024-04-24T13:30:46.318729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.863611+0000","last_change":"2024-04-24T13:30:25.229114+0000","last_active":"2024-04-24T13:30:45.863611+0000","last_peered":"2024-04-24T13:30:45.863611+0000","last_clean":"2024-04-24T13:30:45.863611+0000","last_became_active":"2024-04-24T13:30:25.228634+0000","last_became_peered":"2024-04-24T13:30:25.228634+0000","last_unstale":"2024-04-24T13:30:45.863611+0000","last_undegraded":"2024-04-24T13:30:45.863611+0000","last_fullsized":"2024-04-24T13:30:45.863611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:13.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321994+0000","last_change":"2024-04-24T13:30:27.255646+0000","last_active":"2024-04-24T13:30:46.321994+0000","last_peered":"2024-04-24T13:30:46.321994+0000","last_clean":"2024-04-24T13:30:46.321994+0000","last_became_active":"2024-04-24T13:30:27.254389+0000","last_became_peered":"2024-04-24T13:30:27.254389+0000","last_unstale":"2024-04-24T13:30:46.321994+0000","last_undegraded":"2024-04-24T13:30:46.321994+0000","last_fullsized":"2024-04-24T13:30:46.321994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057724+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:30:46.057724+0000","last_peered":"2024-04-24T13:30:46.057724+0000","last_clean":"2024-04-24T13:30:46.057724+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:30:46.057724+0000","last_undegraded":"2024-04-24T13:30:46.057724+0000","last_fullsized":"2024-04-24T13:30:46.057724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881246+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:30:46.881246+0000","last_peered":"2024-04-24T13:30:46.881246+0000","last_clean":"2024-04-24T13:30:46.881246+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:30:46.881246+0000","last_undegraded":"2024-04-24T13:30:46.881246+0000","last_fullsized":"2024-04-24T13:30:46.881246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319264+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:30:46.319264+0000","last_peered":"2024-04-24T13:30:46.319264+0000","last_clean":"2024-04-24T13:30:46.319264+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:30:46.319264+0000","last_undegraded":"2024-04-24T13:30:46.319264+0000","last_fullsized":"2024-04-24T13:30:46.319264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878964+0000","last_change":"2024-04-24T13:30:15.151799+0000","last_active":"2024-04-24T13:30:46.878964+0000","last_peered":"2024-04-24T13:30:46.878964+0000","last_clean":"2024-04-24T13:30:46.878964+0000","last_became_active":"2024-04-24T13:30:15.150672+0000","last_became_peered":"2024-04-24T13:30:15.150672+0000","last_unstale":"2024-04-24T13:30:46.878964+0000","last_undegraded":"2024-04-24T13:30:46.878964+0000","last_fullsized":"2024-04-24T13:30:46.878964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093780+0000","last_change":"2024-04-24T13:30:21.222734+0000","last_active":"2024-04-24T13:30:46.093780+0000","last_peered":"2024-04-24T13:30:46.093780+0000","last_clean":"2024-04-24T13:30:46.093780+0000","last_became_active":"2024-04-24T13:30:21.220992+0000","last_became_peered":"2024-04-24T13:30:21.220992+0000","last_unstale":"2024-04-24T13:30:46.093780+0000","last_undegraded":"2024-04-24T13:30:46.093780+0000","last_fullsized":"2024-04-24T13:30:46.093780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:05.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058129+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:30:46.058129+0000","last_peered":"2024-04-24T13:30:46.058129+0000","last_clean":"2024-04-24T13:30:46.058129+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:30:46.058129+0000","last_undegraded":"2024-04-24T13:30:46.058129+0000","last_fullsized":"2024-04-24T13:30:46.058129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882239+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:30:46.882239+0000","last_peered":"2024-04-24T13:30:46.882239+0000","last_clean":"2024-04-24T13:30:46.882239+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:30:46.882239+0000","last_undegraded":"2024-04-24T13:30:46.882239+0000","last_fullsized":"2024-04-24T13:30:46.882239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.419118+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:30:47.419118+0000","last_peered":"2024-04-24T13:30:47.419118+0000","last_clean":"2024-04-24T13:30:47.419118+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:30:47.419118+0000","last_undegraded":"2024-04-24T13:30:47.419118+0000","last_fullsized":"2024-04-24T13:30:47.419118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878090+0000","last_change":"2024-04-24T13:30:31.267157+0000","last_active":"2024-04-24T13:30:46.878090+0000","last_peered":"2024-04-24T13:30:46.878090+0000","last_clean":"2024-04-24T13:30:46.878090+0000","last_became_active":"2024-04-24T13:30:31.266348+0000","last_became_peered":"2024-04-24T13:30:31.266348+0000","last_unstale":"2024-04-24T13:30:46.878090+0000","last_undegraded":"2024-04-24T13:30:46.878090+0000","last_fullsized":"2024-04-24T13:30:46.878090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:31.837696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320026+0000","last_change":"2024-04-24T13:30:23.218086+0000","last_active":"2024-04-24T13:30:46.320026+0000","last_peered":"2024-04-24T13:30:46.320026+0000","last_clean":"2024-04-24T13:30:46.320026+0000","last_became_active":"2024-04-24T13:30:23.217750+0000","last_became_peered":"2024-04-24T13:30:23.217750+0000","last_unstale":"2024-04-24T13:30:46.320026+0000","last_undegraded":"2024-04-24T13:30:46.320026+0000","last_fullsized":"2024-04-24T13:30:46.320026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880909+0000","last_change":"2024-04-24T13:30:21.214846+0000","last_active":"2024-04-24T13:30:46.880909+0000","last_peered":"2024-04-24T13:30:46.880909+0000","last_clean":"2024-04-24T13:30:46.880909+0000","last_became_active":"2024-04-24T13:30:21.214127+0000","last_became_peered":"2024-04-24T13:30:21.214127+0000","last_unstale":"2024-04-24T13:30:46.880909+0000","last_undegraded":"2024-04-24T13:30:46.880909+0000","last_fullsized":"2024-04-24T13:30:46.880909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:02.477283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320339+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:30:46.320339+0000","last_peered":"2024-04-24T13:30:46.320339+0000","last_clean":"2024-04-24T13:30:46.320339+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:30:46.320339+0000","last_undegraded":"2024-04-24T13:30:46.320339+0000","last_fullsized":"2024-04-24T13:30:46.320339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058165+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:30:46.058165+0000","last_peered":"2024-04-24T13:30:46.058165+0000","last_clean":"2024-04-24T13:30:46.058165+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:30:46.058165+0000","last_undegraded":"2024-04-24T13:30:46.058165+0000","last_fullsized":"2024-04-24T13:30:46.058165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":62,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057255+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:30:46.057255+0000","last_peered":"2024-04-24T13:30:46.057255+0000","last_clean":"2024-04-24T13:30:46.057255+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:30:46.057255+0000","last_undegraded":"2024-04-24T13:30:46.057255+0000","last_fullsized":"2024-04-24T13:30:46.057255+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092524+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:30:46.092524+0000","last_peered":"2024-04-24T13:30:46.092524+0000","last_clean":"2024-04-24T13:30:46.092524+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:30:46.092524+0000","last_undegraded":"2024-04-24T13:30:46.092524+0000","last_fullsized":"2024-04-24T13:30:46.092524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058165+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:30:46.058165+0000","last_peered":"2024-04-24T13:30:46.058165+0000","last_clean":"2024-04-24T13:30:46.058165+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:30:46.058165+0000","last_undegraded":"2024-04-24T13:30:46.058165+0000","last_fullsized":"2024-04-24T13:30:46.058165+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058480+0000","last_change":"2024-04-24T13:30:23.220277+0000","last_active":"2024-04-24T13:30:46.058480+0000","last_peered":"2024-04-24T13:30:46.058480+0000","last_clean":"2024-04-24T13:30:46.058480+0000","last_became_active":"2024-04-24T13:30:23.219932+0000","last_became_peered":"2024-04-24T13:30:23.219932+0000","last_unstale":"2024-04-24T13:30:46.058480+0000","last_undegraded":"2024-04-24T13:30:46.058480+0000","last_fullsized":"2024-04-24T13:30:46.058480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319363+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:30:46.319363+0000","last_peered":"2024-04-24T13:30:46.319363+0000","last_clean":"2024-04-24T13:30:46.319363+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:30:46.319363+0000","last_undegraded":"2024-04-24T13:30:46.319363+0000","last_fullsized":"2024-04-24T13:30:46.319363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.322736+0000","last_change":"2024-04-24T13:30:16.059514+0000","last_active":"2024-04-24T13:30:46.322736+0000","last_peered":"2024-04-24T13:30:46.322736+0000","last_clean":"2024-04-24T13:30:46.322736+0000","last_became_active":"2024-04-24T13:30:16.058864+0000","last_became_peered":"2024-04-24T13:30:16.058864+0000","last_unstale":"2024-04-24T13:30:46.322736+0000","last_undegraded":"2024-04-24T13:30:46.322736+0000","last_fullsized":"2024-04-24T13:30:46.322736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:43.235155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417848+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:30:47.417848+0000","last_peered":"2024-04-24T13:30:47.417848+0000","last_clean":"2024-04-24T13:30:47.417848+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:30:47.417848+0000","last_undegraded":"2024-04-24T13:30:47.417848+0000","last_fullsized":"2024-04-24T13:30:47.417848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319208+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:30:46.319208+0000","last_peered":"2024-04-24T13:30:46.319208+0000","last_clean":"2024-04-24T13:30:46.319208+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:30:46.319208+0000","last_undegraded":"2024-04-24T13:30:46.319208+0000","last_fullsized":"2024-04-24T13:30:46.319208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878274+0000","last_change":"2024-04-24T13:30:29.257969+0000","last_active":"2024-04-24T13:30:46.878274+0000","last_peered":"2024-04-24T13:30:46.878274+0000","last_clean":"2024-04-24T13:30:46.878274+0000","last_became_active":"2024-04-24T13:30:29.257131+0000","last_became_peered":"2024-04-24T13:30:29.257131+0000","last_unstale":"2024-04-24T13:30:46.878274+0000","last_undegraded":"2024-04-24T13:30:46.878274+0000","last_fullsized":"2024-04-24T13:30:46.878274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882657+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:30:46.882657+0000","last_peered":"2024-04-24T13:30:46.882657+0000","last_clean":"2024-04-24T13:30:46.882657+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:30:46.882657+0000","last_undegraded":"2024-04-24T13:30:46.882657+0000","last_fullsized":"2024-04-24T13:30:46.882657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880137+0000","last_change":"2024-04-24T13:30:23.249852+0000","last_active":"2024-04-24T13:30:46.880137+0000","last_peered":"2024-04-24T13:30:46.880137+0000","last_clean":"2024-04-24T13:30:46.880137+0000","last_became_active":"2024-04-24T13:30:23.249522+0000","last_became_peered":"2024-04-24T13:30:23.249522+0000","last_unstale":"2024-04-24T13:30:46.880137+0000","last_undegraded":"2024-04-24T13:30:46.880137+0000","last_fullsized":"2024-04-24T13:30:46.880137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882311+0000","last_change":"2024-04-24T13:30:21.238933+0000","last_active":"2024-04-24T13:30:46.882311+0000","last_peered":"2024-04-24T13:30:46.882311+0000","last_clean":"2024-04-24T13:30:46.882311+0000","last_became_active":"2024-04-24T13:30:21.238648+0000","last_became_peered":"2024-04-24T13:30:21.238648+0000","last_unstale":"2024-04-24T13:30:46.882311+0000","last_undegraded":"2024-04-24T13:30:46.882311+0000","last_fullsized":"2024-04-24T13:30:46.882311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321268+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:30:46.321268+0000","last_peered":"2024-04-24T13:30:46.321268+0000","last_clean":"2024-04-24T13:30:46.321268+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:30:46.321268+0000","last_undegraded":"2024-04-24T13:30:46.321268+0000","last_fullsized":"2024-04-24T13:30:46.321268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092789+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:30:46.092789+0000","last_peered":"2024-04-24T13:30:46.092789+0000","last_clean":"2024-04-24T13:30:46.092789+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:30:46.092789+0000","last_undegraded":"2024-04-24T13:30:46.092789+0000","last_fullsized":"2024-04-24T13:30:46.092789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093510+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:30:46.093510+0000","last_peered":"2024-04-24T13:30:46.093510+0000","last_clean":"2024-04-24T13:30:46.093510+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:30:46.093510+0000","last_undegraded":"2024-04-24T13:30:46.093510+0000","last_fullsized":"2024-04-24T13:30:46.093510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881920+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:30:46.881920+0000","last_peered":"2024-04-24T13:30:46.881920+0000","last_clean":"2024-04-24T13:30:46.881920+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:30:46.881920+0000","last_undegraded":"2024-04-24T13:30:46.881920+0000","last_fullsized":"2024-04-24T13:30:46.881920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057796+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:30:46.057796+0000","last_peered":"2024-04-24T13:30:46.057796+0000","last_clean":"2024-04-24T13:30:46.057796+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:30:46.057796+0000","last_undegraded":"2024-04-24T13:30:46.057796+0000","last_fullsized":"2024-04-24T13:30:46.057796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093096+0000","last_change":"2024-04-24T13:30:23.219012+0000","last_active":"2024-04-24T13:30:46.093096+0000","last_peered":"2024-04-24T13:30:46.093096+0000","last_clean":"2024-04-24T13:30:46.093096+0000","last_became_active":"2024-04-24T13:30:23.218312+0000","last_became_peered":"2024-04-24T13:30:23.218312+0000","last_unstale":"2024-04-24T13:30:46.093096+0000","last_undegraded":"2024-04-24T13:30:46.093096+0000","last_fullsized":"2024-04-24T13:30:46.093096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058814+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:30:46.058814+0000","last_peered":"2024-04-24T13:30:46.058814+0000","last_clean":"2024-04-24T13:30:46.058814+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:30:46.058814+0000","last_undegraded":"2024-04-24T13:30:46.058814+0000","last_fullsized":"2024-04-24T13:30:46.058814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.419332+0000","last_change":"2024-04-24T13:30:15.161378+0000","last_active":"2024-04-24T13:30:47.419332+0000","last_peered":"2024-04-24T13:30:47.419332+0000","last_clean":"2024-04-24T13:30:47.419332+0000","last_became_active":"2024-04-24T13:30:15.160775+0000","last_became_peered":"2024-04-24T13:30:15.160775+0000","last_unstale":"2024-04-24T13:30:47.419332+0000","last_undegraded":"2024-04-24T13:30:47.419332+0000","last_fullsized":"2024-04-24T13:30:47.419332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879807+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:30:46.879807+0000","last_peered":"2024-04-24T13:30:46.879807+0000","last_clean":"2024-04-24T13:30:46.879807+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:30:46.879807+0000","last_undegraded":"2024-04-24T13:30:46.879807+0000","last_fullsized":"2024-04-24T13:30:46.879807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":67,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319869+0000","last_change":"2024-04-24T13:30:27.251349+0000","last_active":"2024-04-24T13:30:46.319869+0000","last_peered":"2024-04-24T13:30:46.319869+0000","last_clean":"2024-04-24T13:30:46.319869+0000","last_became_active":"2024-04-24T13:30:27.250525+0000","last_became_peered":"2024-04-24T13:30:27.250525+0000","last_unstale":"2024-04-24T13:30:46.319869+0000","last_undegraded":"2024-04-24T13:30:46.319869+0000","last_fullsized":"2024-04-24T13:30:46.319869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880502+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:30:46.880502+0000","last_peered":"2024-04-24T13:30:46.880502+0000","last_clean":"2024-04-24T13:30:46.880502+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:30:46.880502+0000","last_undegraded":"2024-04-24T13:30:46.880502+0000","last_fullsized":"2024-04-24T13:30:46.880502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878617+0000","last_change":"2024-04-24T13:30:31.277358+0000","last_active":"2024-04-24T13:30:46.878617+0000","last_peered":"2024-04-24T13:30:46.878617+0000","last_clean":"2024-04-24T13:30:46.878617+0000","last_became_active":"2024-04-24T13:30:31.276606+0000","last_became_peered":"2024-04-24T13:30:31.276606+0000","last_unstale":"2024-04-24T13:30:46.878617+0000","last_undegraded":"2024-04-24T13:30:46.878617+0000","last_fullsized":"2024-04-24T13:30:46.878617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058221+0000","last_change":"2024-04-24T13:30:31.264343+0000","last_active":"2024-04-24T13:30:46.058221+0000","last_peered":"2024-04-24T13:30:46.058221+0000","last_clean":"2024-04-24T13:30:46.058221+0000","last_became_active":"2024-04-24T13:30:31.263640+0000","last_became_peered":"2024-04-24T13:30:31.263640+0000","last_unstale":"2024-04-24T13:30:46.058221+0000","last_undegraded":"2024-04-24T13:30:46.058221+0000","last_fullsized":"2024-04-24T13:30:46.058221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:51:45.241537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093436+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:30:46.093436+0000","last_peered":"2024-04-24T13:30:46.093436+0000","last_clean":"2024-04-24T13:30:46.093436+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:30:46.093436+0000","last_undegraded":"2024-04-24T13:30:46.093436+0000","last_fullsized":"2024-04-24T13:30:46.093436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093975+0000","last_change":"2024-04-24T13:30:21.252985+0000","last_active":"2024-04-24T13:30:46.093975+0000","last_peered":"2024-04-24T13:30:46.093975+0000","last_clean":"2024-04-24T13:30:46.093975+0000","last_became_active":"2024-04-24T13:30:21.252417+0000","last_became_peered":"2024-04-24T13:30:21.252417+0000","last_unstale":"2024-04-24T13:30:46.093975+0000","last_undegraded":"2024-04-24T13:30:46.093975+0000","last_fullsized":"2024-04-24T13:30:46.093975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320272+0000","last_change":"2024-04-24T13:30:25.228158+0000","last_active":"2024-04-24T13:30:46.320272+0000","last_peered":"2024-04-24T13:30:46.320272+0000","last_clean":"2024-04-24T13:30:46.320272+0000","last_became_active":"2024-04-24T13:30:25.226828+0000","last_became_peered":"2024-04-24T13:30:25.226828+0000","last_unstale":"2024-04-24T13:30:46.320272+0000","last_undegraded":"2024-04-24T13:30:46.320272+0000","last_fullsized":"2024-04-24T13:30:46.320272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:11.608677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879910+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:30:46.879910+0000","last_peered":"2024-04-24T13:30:46.879910+0000","last_clean":"2024-04-24T13:30:46.879910+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:30:46.879910+0000","last_undegraded":"2024-04-24T13:30:46.879910+0000","last_fullsized":"2024-04-24T13:30:46.879910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879642+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:30:46.879642+0000","last_peered":"2024-04-24T13:30:46.879642+0000","last_clean":"2024-04-24T13:30:46.879642+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:30:46.879642+0000","last_undegraded":"2024-04-24T13:30:46.879642+0000","last_fullsized":"2024-04-24T13:30:46.879642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881847+0000","last_change":"2024-04-24T13:30:31.265871+0000","last_active":"2024-04-24T13:30:46.881847+0000","last_peered":"2024-04-24T13:30:46.881847+0000","last_clean":"2024-04-24T13:30:46.881847+0000","last_became_active":"2024-04-24T13:30:31.265184+0000","last_became_peered":"2024-04-24T13:30:31.265184+0000","last_unstale":"2024-04-24T13:30:46.881847+0000","last_undegraded":"2024-04-24T13:30:46.881847+0000","last_fullsized":"2024-04-24T13:30:46.881847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:22.937959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319785+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:30:46.319785+0000","last_peered":"2024-04-24T13:30:46.319785+0000","last_clean":"2024-04-24T13:30:46.319785+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:30:46.319785+0000","last_undegraded":"2024-04-24T13:30:46.319785+0000","last_fullsized":"2024-04-24T13:30:46.319785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.322365+0000","last_change":"2024-04-24T13:30:21.247573+0000","last_active":"2024-04-24T13:30:46.322365+0000","last_peered":"2024-04-24T13:30:46.322365+0000","last_clean":"2024-04-24T13:30:46.322365+0000","last_became_active":"2024-04-24T13:30:21.246433+0000","last_became_peered":"2024-04-24T13:30:21.246433+0000","last_unstale":"2024-04-24T13:30:46.322365+0000","last_undegraded":"2024-04-24T13:30:46.322365+0000","last_fullsized":"2024-04-24T13:30:46.322365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881255+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:30:46.881255+0000","last_peered":"2024-04-24T13:30:46.881255+0000","last_clean":"2024-04-24T13:30:46.881255+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:30:46.881255+0000","last_undegraded":"2024-04-24T13:30:46.881255+0000","last_fullsized":"2024-04-24T13:30:46.881255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'4","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057192+0000","last_change":"2024-04-24T13:30:27.260167+0000","last_active":"2024-04-24T13:30:46.057192+0000","last_peered":"2024-04-24T13:30:46.057192+0000","last_clean":"2024-04-24T13:30:46.057192+0000","last_became_active":"2024-04-24T13:30:27.259644+0000","last_became_peered":"2024-04-24T13:30:27.259644+0000","last_unstale":"2024-04-24T13:30:46.057192+0000","last_undegraded":"2024-04-24T13:30:46.057192+0000","last_fullsized":"2024-04-24T13:30:46.057192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:21.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320505+0000","last_change":"2024-04-24T13:30:29.273787+0000","last_active":"2024-04-24T13:30:46.320505+0000","last_peered":"2024-04-24T13:30:46.320505+0000","last_clean":"2024-04-24T13:30:46.320505+0000","last_became_active":"2024-04-24T13:30:29.273151+0000","last_became_peered":"2024-04-24T13:30:29.273151+0000","last_unstale":"2024-04-24T13:30:46.320505+0000","last_undegraded":"2024-04-24T13:30:46.320505+0000","last_fullsized":"2024-04-24T13:30:46.320505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:23.009033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058029+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:30:46.058029+0000","last_peered":"2024-04-24T13:30:46.058029+0000","last_clean":"2024-04-24T13:30:46.058029+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:30:46.058029+0000","last_undegraded":"2024-04-24T13:30:46.058029+0000","last_fullsized":"2024-04-24T13:30:46.058029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881146+0000","last_change":"2024-04-24T13:30:23.246371+0000","last_active":"2024-04-24T13:30:46.881146+0000","last_peered":"2024-04-24T13:30:46.881146+0000","last_clean":"2024-04-24T13:30:46.881146+0000","last_became_active":"2024-04-24T13:30:23.246084+0000","last_became_peered":"2024-04-24T13:30:23.246084+0000","last_unstale":"2024-04-24T13:30:46.881146+0000","last_undegraded":"2024-04-24T13:30:46.881146+0000","last_fullsized":"2024-04-24T13:30:46.881146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880762+0000","last_change":"2024-04-24T13:30:21.241794+0000","last_active":"2024-04-24T13:30:46.880762+0000","last_peered":"2024-04-24T13:30:46.880762+0000","last_clean":"2024-04-24T13:30:46.880762+0000","last_became_active":"2024-04-24T13:30:21.241043+0000","last_became_peered":"2024-04-24T13:30:21.241043+0000","last_unstale":"2024-04-24T13:30:46.880762+0000","last_undegraded":"2024-04-24T13:30:46.880762+0000","last_fullsized":"2024-04-24T13:30:46.880762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:21.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319251+0000","last_change":"2024-04-24T13:30:25.239146+0000","last_active":"2024-04-24T13:30:46.319251+0000","last_peered":"2024-04-24T13:30:46.319251+0000","last_clean":"2024-04-24T13:30:46.319251+0000","last_became_active":"2024-04-24T13:30:25.238359+0000","last_became_peered":"2024-04-24T13:30:25.238359+0000","last_unstale":"2024-04-24T13:30:46.319251+0000","last_undegraded":"2024-04-24T13:30:46.319251+0000","last_fullsized":"2024-04-24T13:30:46.319251+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880960+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:30:46.880960+0000","last_peered":"2024-04-24T13:30:46.880960+0000","last_clean":"2024-04-24T13:30:46.880960+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:30:46.880960+0000","last_undegraded":"2024-04-24T13:30:46.880960+0000","last_fullsized":"2024-04-24T13:30:46.880960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417767+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:30:47.417767+0000","last_peered":"2024-04-24T13:30:47.417767+0000","last_clean":"2024-04-24T13:30:47.417767+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:30:47.417767+0000","last_undegraded":"2024-04-24T13:30:47.417767+0000","last_fullsized":"2024-04-24T13:30:47.417767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878475+0000","last_change":"2024-04-24T13:30:31.276150+0000","last_active":"2024-04-24T13:30:46.878475+0000","last_peered":"2024-04-24T13:30:46.878475+0000","last_clean":"2024-04-24T13:30:46.878475+0000","last_became_active":"2024-04-24T13:30:31.275437+0000","last_became_peered":"2024-04-24T13:30:31.275437+0000","last_unstale":"2024-04-24T13:30:46.878475+0000","last_undegraded":"2024-04-24T13:30:46.878475+0000","last_fullsized":"2024-04-24T13:30:46.878475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879920+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:30:46.879920+0000","last_peered":"2024-04-24T13:30:46.879920+0000","last_clean":"2024-04-24T13:30:46.879920+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:30:46.879920+0000","last_undegraded":"2024-04-24T13:30:46.879920+0000","last_fullsized":"2024-04-24T13:30:46.879920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.059006+0000","last_change":"2024-04-24T13:30:21.229237+0000","last_active":"2024-04-24T13:30:46.059006+0000","last_peered":"2024-04-24T13:30:46.059006+0000","last_clean":"2024-04-24T13:30:46.059006+0000","last_became_active":"2024-04-24T13:30:21.228971+0000","last_became_peered":"2024-04-24T13:30:21.228971+0000","last_unstale":"2024-04-24T13:30:46.059006+0000","last_undegraded":"2024-04-24T13:30:46.059006+0000","last_fullsized":"2024-04-24T13:30:46.059006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417627+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:30:47.417627+0000","last_peered":"2024-04-24T13:30:47.417627+0000","last_clean":"2024-04-24T13:30:47.417627+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:30:47.417627+0000","last_undegraded":"2024-04-24T13:30:47.417627+0000","last_fullsized":"2024-04-24T13:30:47.417627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319749+0000","last_change":"2024-04-24T13:30:27.244776+0000","last_active":"2024-04-24T13:30:46.319749+0000","last_peered":"2024-04-24T13:30:46.319749+0000","last_clean":"2024-04-24T13:30:46.319749+0000","last_became_active":"2024-04-24T13:30:27.243967+0000","last_became_peered":"2024-04-24T13:30:27.243967+0000","last_unstale":"2024-04-24T13:30:46.319749+0000","last_undegraded":"2024-04-24T13:30:46.319749+0000","last_fullsized":"2024-04-24T13:30:46.319749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:20.682651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057833+0000","last_change":"2024-04-24T13:30:29.279248+0000","last_active":"2024-04-24T13:30:46.057833+0000","last_peered":"2024-04-24T13:30:46.057833+0000","last_clean":"2024-04-24T13:30:46.057833+0000","last_became_active":"2024-04-24T13:30:29.278511+0000","last_became_peered":"2024-04-24T13:30:29.278511+0000","last_unstale":"2024-04-24T13:30:46.057833+0000","last_undegraded":"2024-04-24T13:30:46.057833+0000","last_fullsized":"2024-04-24T13:30:46.057833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417182+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:30:47.417182+0000","last_peered":"2024-04-24T13:30:47.417182+0000","last_clean":"2024-04-24T13:30:47.417182+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:30:47.417182+0000","last_undegraded":"2024-04-24T13:30:47.417182+0000","last_fullsized":"2024-04-24T13:30:47.417182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880045+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:30:46.880045+0000","last_peered":"2024-04-24T13:30:46.880045+0000","last_clean":"2024-04-24T13:30:46.880045+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:30:46.880045+0000","last_undegraded":"2024-04-24T13:30:46.880045+0000","last_fullsized":"2024-04-24T13:30:46.880045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058564+0000","last_change":"2024-04-24T13:30:25.242437+0000","last_active":"2024-04-24T13:30:46.058564+0000","last_peered":"2024-04-24T13:30:46.058564+0000","last_clean":"2024-04-24T13:30:46.058564+0000","last_became_active":"2024-04-24T13:30:25.241948+0000","last_became_peered":"2024-04-24T13:30:25.241948+0000","last_unstale":"2024-04-24T13:30:46.058564+0000","last_undegraded":"2024-04-24T13:30:46.058564+0000","last_fullsized":"2024-04-24T13:30:46.058564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:57.978574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319705+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:30:46.319705+0000","last_peered":"2024-04-24T13:30:46.319705+0000","last_clean":"2024-04-24T13:30:46.319705+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:30:46.319705+0000","last_undegraded":"2024-04-24T13:30:46.319705+0000","last_fullsized":"2024-04-24T13:30:46.319705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878613+0000","last_change":"2024-04-24T13:30:29.277963+0000","last_active":"2024-04-24T13:30:46.878613+0000","last_peered":"2024-04-24T13:30:46.878613+0000","last_clean":"2024-04-24T13:30:46.878613+0000","last_became_active":"2024-04-24T13:30:29.277170+0000","last_became_peered":"2024-04-24T13:30:29.277170+0000","last_unstale":"2024-04-24T13:30:46.878613+0000","last_undegraded":"2024-04-24T13:30:46.878613+0000","last_fullsized":"2024-04-24T13:30:46.878613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880704+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:30:46.880704+0000","last_peered":"2024-04-24T13:30:46.880704+0000","last_clean":"2024-04-24T13:30:46.880704+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:30:46.880704+0000","last_undegraded":"2024-04-24T13:30:46.880704+0000","last_fullsized":"2024-04-24T13:30:46.880704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058676+0000","last_change":"2024-04-24T13:30:23.235742+0000","last_active":"2024-04-24T13:30:46.058676+0000","last_peered":"2024-04-24T13:30:46.058676+0000","last_clean":"2024-04-24T13:30:46.058676+0000","last_became_active":"2024-04-24T13:30:23.235385+0000","last_became_peered":"2024-04-24T13:30:23.235385+0000","last_unstale":"2024-04-24T13:30:46.058676+0000","last_undegraded":"2024-04-24T13:30:46.058676+0000","last_fullsized":"2024-04-24T13:30:46.058676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320246+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:30:46.320246+0000","last_peered":"2024-04-24T13:30:46.320246+0000","last_clean":"2024-04-24T13:30:46.320246+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:30:46.320246+0000","last_undegraded":"2024-04-24T13:30:46.320246+0000","last_fullsized":"2024-04-24T13:30:46.320246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.419181+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:30:47.419181+0000","last_peered":"2024-04-24T13:30:47.419181+0000","last_clean":"2024-04-24T13:30:47.419181+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:30:47.419181+0000","last_undegraded":"2024-04-24T13:30:47.419181+0000","last_fullsized":"2024-04-24T13:30:47.419181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320090+0000","last_change":"2024-04-24T13:30:27.262590+0000","last_active":"2024-04-24T13:30:46.320090+0000","last_peered":"2024-04-24T13:30:46.320090+0000","last_clean":"2024-04-24T13:30:46.320090+0000","last_became_active":"2024-04-24T13:30:27.261920+0000","last_became_peered":"2024-04-24T13:30:27.261920+0000","last_unstale":"2024-04-24T13:30:46.320090+0000","last_undegraded":"2024-04-24T13:30:46.320090+0000","last_fullsized":"2024-04-24T13:30:46.320090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:21.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319851+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:30:46.319851+0000","last_peered":"2024-04-24T13:30:46.319851+0000","last_clean":"2024-04-24T13:30:46.319851+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:30:46.319851+0000","last_undegraded":"2024-04-24T13:30:46.319851+0000","last_fullsized":"2024-04-24T13:30:46.319851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417451+0000","last_change":"2024-04-24T13:30:31.284027+0000","last_active":"2024-04-24T13:30:47.417451+0000","last_peered":"2024-04-24T13:30:47.417451+0000","last_clean":"2024-04-24T13:30:47.417451+0000","last_became_active":"2024-04-24T13:30:31.283348+0000","last_became_peered":"2024-04-24T13:30:31.283348+0000","last_unstale":"2024-04-24T13:30:47.417451+0000","last_undegraded":"2024-04-24T13:30:47.417451+0000","last_fullsized":"2024-04-24T13:30:47.417451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:42.409692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882078+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:30:46.882078+0000","last_peered":"2024-04-24T13:30:46.882078+0000","last_clean":"2024-04-24T13:30:46.882078+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:30:46.882078+0000","last_undegraded":"2024-04-24T13:30:46.882078+0000","last_fullsized":"2024-04-24T13:30:46.882078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093967+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:30:46.093967+0000","last_peered":"2024-04-24T13:30:46.093967+0000","last_clean":"2024-04-24T13:30:46.093967+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:30:46.093967+0000","last_undegraded":"2024-04-24T13:30:46.093967+0000","last_fullsized":"2024-04-24T13:30:46.093967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094798+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:30:46.094798+0000","last_peered":"2024-04-24T13:30:46.094798+0000","last_clean":"2024-04-24T13:30:46.094798+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:30:46.094798+0000","last_undegraded":"2024-04-24T13:30:46.094798+0000","last_fullsized":"2024-04-24T13:30:46.094798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882718+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:30:46.882718+0000","last_peered":"2024-04-24T13:30:46.882718+0000","last_clean":"2024-04-24T13:30:46.882718+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:30:46.882718+0000","last_undegraded":"2024-04-24T13:30:46.882718+0000","last_fullsized":"2024-04-24T13:30:46.882718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319383+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:30:46.319383+0000","last_peered":"2024-04-24T13:30:46.319383+0000","last_clean":"2024-04-24T13:30:46.319383+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:30:46.319383+0000","last_undegraded":"2024-04-24T13:30:46.319383+0000","last_fullsized":"2024-04-24T13:30:46.319383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878268+0000","last_change":"2024-04-24T13:30:31.277531+0000","last_active":"2024-04-24T13:30:46.878268+0000","last_peered":"2024-04-24T13:30:46.878268+0000","last_clean":"2024-04-24T13:30:46.878268+0000","last_became_active":"2024-04-24T13:30:31.275550+0000","last_became_peered":"2024-04-24T13:30:31.275550+0000","last_unstale":"2024-04-24T13:30:46.878268+0000","last_undegraded":"2024-04-24T13:30:46.878268+0000","last_fullsized":"2024-04-24T13:30:46.878268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.862184+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:30:45.862184+0000","last_peered":"2024-04-24T13:30:45.862184+0000","last_clean":"2024-04-24T13:30:45.862184+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:30:45.862184+0000","last_undegraded":"2024-04-24T13:30:45.862184+0000","last_fullsized":"2024-04-24T13:30:45.862184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057922+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:30:46.057922+0000","last_peered":"2024-04-24T13:30:46.057922+0000","last_clean":"2024-04-24T13:30:46.057922+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:30:46.057922+0000","last_undegraded":"2024-04-24T13:30:46.057922+0000","last_fullsized":"2024-04-24T13:30:46.057922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320536+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:30:46.320536+0000","last_peered":"2024-04-24T13:30:46.320536+0000","last_clean":"2024-04-24T13:30:46.320536+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:30:46.320536+0000","last_undegraded":"2024-04-24T13:30:46.320536+0000","last_fullsized":"2024-04-24T13:30:46.320536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094672+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:30:46.094672+0000","last_peered":"2024-04-24T13:30:46.094672+0000","last_clean":"2024-04-24T13:30:46.094672+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:30:46.094672+0000","last_undegraded":"2024-04-24T13:30:46.094672+0000","last_fullsized":"2024-04-24T13:30:46.094672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418751+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:30:47.418751+0000","last_peered":"2024-04-24T13:30:47.418751+0000","last_clean":"2024-04-24T13:30:47.418751+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:30:47.418751+0000","last_undegraded":"2024-04-24T13:30:47.418751+0000","last_fullsized":"2024-04-24T13:30:47.418751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319269+0000","last_change":"2024-04-24T13:30:31.285910+0000","last_active":"2024-04-24T13:30:46.319269+0000","last_peered":"2024-04-24T13:30:46.319269+0000","last_clean":"2024-04-24T13:30:46.319269+0000","last_became_active":"2024-04-24T13:30:31.285205+0000","last_became_peered":"2024-04-24T13:30:31.285205+0000","last_unstale":"2024-04-24T13:30:46.319269+0000","last_undegraded":"2024-04-24T13:30:46.319269+0000","last_fullsized":"2024-04-24T13:30:46.319269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:48.546868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093138+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:30:46.093138+0000","last_peered":"2024-04-24T13:30:46.093138+0000","last_clean":"2024-04-24T13:30:46.093138+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:30:46.093138+0000","last_undegraded":"2024-04-24T13:30:46.093138+0000","last_fullsized":"2024-04-24T13:30:46.093138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879202+0000","last_change":"2024-04-24T13:30:21.226147+0000","last_active":"2024-04-24T13:30:46.879202+0000","last_peered":"2024-04-24T13:30:46.879202+0000","last_clean":"2024-04-24T13:30:46.879202+0000","last_became_active":"2024-04-24T13:30:21.225369+0000","last_became_peered":"2024-04-24T13:30:21.225369+0000","last_unstale":"2024-04-24T13:30:46.879202+0000","last_undegraded":"2024-04-24T13:30:46.879202+0000","last_fullsized":"2024-04-24T13:30:46.879202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:24.585089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321038+0000","last_change":"2024-04-24T13:30:25.239519+0000","last_active":"2024-04-24T13:30:46.321038+0000","last_peered":"2024-04-24T13:30:46.321038+0000","last_clean":"2024-04-24T13:30:46.321038+0000","last_became_active":"2024-04-24T13:30:25.238779+0000","last_became_peered":"2024-04-24T13:30:25.238779+0000","last_unstale":"2024-04-24T13:30:46.321038+0000","last_undegraded":"2024-04-24T13:30:46.321038+0000","last_fullsized":"2024-04-24T13:30:46.321038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":58,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878570+0000","last_change":"2024-04-24T13:30:27.260827+0000","last_active":"2024-04-24T13:30:46.878570+0000","last_peered":"2024-04-24T13:30:46.878570+0000","last_clean":"2024-04-24T13:30:46.878570+0000","last_became_active":"2024-04-24T13:30:27.260164+0000","last_became_peered":"2024-04-24T13:30:27.260164+0000","last_unstale":"2024-04-24T13:30:46.878570+0000","last_undegraded":"2024-04-24T13:30:46.878570+0000","last_fullsized":"2024-04-24T13:30:46.878570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.056935+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:30:46.056935+0000","last_peered":"2024-04-24T13:30:46.056935+0000","last_clean":"2024-04-24T13:30:46.056935+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:30:46.056935+0000","last_undegraded":"2024-04-24T13:30:46.056935+0000","last_fullsized":"2024-04-24T13:30:46.056935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.323431+0000","last_change":"2024-04-24T13:30:31.280268+0000","last_active":"2024-04-24T13:30:46.323431+0000","last_peered":"2024-04-24T13:30:46.323431+0000","last_clean":"2024-04-24T13:30:46.323431+0000","last_became_active":"2024-04-24T13:30:31.279721+0000","last_became_peered":"2024-04-24T13:30:31.279721+0000","last_unstale":"2024-04-24T13:30:46.323431+0000","last_undegraded":"2024-04-24T13:30:46.323431+0000","last_fullsized":"2024-04-24T13:30:46.323431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:31.837696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093556+0000","last_change":"2024-04-24T13:30:23.225100+0000","last_active":"2024-04-24T13:30:46.093556+0000","last_peered":"2024-04-24T13:30:46.093556+0000","last_clean":"2024-04-24T13:30:46.093556+0000","last_became_active":"2024-04-24T13:30:23.224324+0000","last_became_peered":"2024-04-24T13:30:23.224324+0000","last_unstale":"2024-04-24T13:30:46.093556+0000","last_undegraded":"2024-04-24T13:30:46.093556+0000","last_fullsized":"2024-04-24T13:30:46.093556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880823+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:30:46.880823+0000","last_peered":"2024-04-24T13:30:46.880823+0000","last_clean":"2024-04-24T13:30:46.880823+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:30:46.880823+0000","last_undegraded":"2024-04-24T13:30:46.880823+0000","last_fullsized":"2024-04-24T13:30:46.880823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878876+0000","last_change":"2024-04-24T13:30:25.238830+0000","last_active":"2024-04-24T13:30:46.878876+0000","last_peered":"2024-04-24T13:30:46.878876+0000","last_clean":"2024-04-24T13:30:46.878876+0000","last_became_active":"2024-04-24T13:30:25.237595+0000","last_became_peered":"2024-04-24T13:30:25.237595+0000","last_unstale":"2024-04-24T13:30:46.878876+0000","last_undegraded":"2024-04-24T13:30:46.878876+0000","last_fullsized":"2024-04-24T13:30:46.878876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057100+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:30:46.057100+0000","last_peered":"2024-04-24T13:30:46.057100+0000","last_clean":"2024-04-24T13:30:46.057100+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:30:46.057100+0000","last_undegraded":"2024-04-24T13:30:46.057100+0000","last_fullsized":"2024-04-24T13:30:46.057100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417510+0000","last_change":"2024-04-24T13:30:29.274924+0000","last_active":"2024-04-24T13:30:47.417510+0000","last_peered":"2024-04-24T13:30:47.417510+0000","last_clean":"2024-04-24T13:30:47.417510+0000","last_became_active":"2024-04-24T13:30:29.274044+0000","last_became_peered":"2024-04-24T13:30:29.274044+0000","last_unstale":"2024-04-24T13:30:47.417510+0000","last_undegraded":"2024-04-24T13:30:47.417510+0000","last_fullsized":"2024-04-24T13:30:47.417510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:43.398878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881949+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:30:46.881949+0000","last_peered":"2024-04-24T13:30:46.881949+0000","last_clean":"2024-04-24T13:30:46.881949+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:30:46.881949+0000","last_undegraded":"2024-04-24T13:30:46.881949+0000","last_fullsized":"2024-04-24T13:30:46.881949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880685+0000","last_change":"2024-04-24T13:30:23.214114+0000","last_active":"2024-04-24T13:30:46.880685+0000","last_peered":"2024-04-24T13:30:46.880685+0000","last_clean":"2024-04-24T13:30:46.880685+0000","last_became_active":"2024-04-24T13:30:23.213489+0000","last_became_peered":"2024-04-24T13:30:23.213489+0000","last_unstale":"2024-04-24T13:30:46.880685+0000","last_undegraded":"2024-04-24T13:30:46.880685+0000","last_fullsized":"2024-04-24T13:30:46.880685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882829+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:30:46.882829+0000","last_peered":"2024-04-24T13:30:46.882829+0000","last_clean":"2024-04-24T13:30:46.882829+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:30:46.882829+0000","last_undegraded":"2024-04-24T13:30:46.882829+0000","last_fullsized":"2024-04-24T13:30:46.882829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092310+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:30:46.092310+0000","last_peered":"2024-04-24T13:30:46.092310+0000","last_clean":"2024-04-24T13:30:46.092310+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:30:46.092310+0000","last_undegraded":"2024-04-24T13:30:46.092310+0000","last_fullsized":"2024-04-24T13:30:46.092310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881546+0000","last_change":"2024-04-24T13:30:27.253296+0000","last_active":"2024-04-24T13:30:46.881546+0000","last_peered":"2024-04-24T13:30:46.881546+0000","last_clean":"2024-04-24T13:30:46.881546+0000","last_became_active":"2024-04-24T13:30:27.252584+0000","last_became_peered":"2024-04-24T13:30:27.252584+0000","last_unstale":"2024-04-24T13:30:46.881546+0000","last_undegraded":"2024-04-24T13:30:46.881546+0000","last_fullsized":"2024-04-24T13:30:46.881546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092364+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:30:46.092364+0000","last_peered":"2024-04-24T13:30:46.092364+0000","last_clean":"2024-04-24T13:30:46.092364+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:30:46.092364+0000","last_undegraded":"2024-04-24T13:30:46.092364+0000","last_fullsized":"2024-04-24T13:30:46.092364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321729+0000","last_change":"2024-04-24T13:30:31.279466+0000","last_active":"2024-04-24T13:30:46.321729+0000","last_peered":"2024-04-24T13:30:46.321729+0000","last_clean":"2024-04-24T13:30:46.321729+0000","last_became_active":"2024-04-24T13:30:31.278784+0000","last_became_peered":"2024-04-24T13:30:31.278784+0000","last_unstale":"2024-04-24T13:30:46.321729+0000","last_undegraded":"2024-04-24T13:30:46.321729+0000","last_fullsized":"2024-04-24T13:30:46.321729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092784+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:30:46.092784+0000","last_peered":"2024-04-24T13:30:46.092784+0000","last_clean":"2024-04-24T13:30:46.092784+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:30:46.092784+0000","last_undegraded":"2024-04-24T13:30:46.092784+0000","last_fullsized":"2024-04-24T13:30:46.092784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058927+0000","last_change":"2024-04-24T13:30:21.229211+0000","last_active":"2024-04-24T13:30:46.058927+0000","last_peered":"2024-04-24T13:30:46.058927+0000","last_clean":"2024-04-24T13:30:46.058927+0000","last_became_active":"2024-04-24T13:30:21.228906+0000","last_became_peered":"2024-04-24T13:30:21.228906+0000","last_unstale":"2024-04-24T13:30:46.058927+0000","last_undegraded":"2024-04-24T13:30:46.058927+0000","last_fullsized":"2024-04-24T13:30:46.058927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319470+0000","last_change":"2024-04-24T13:30:25.228645+0000","last_active":"2024-04-24T13:30:46.319470+0000","last_peered":"2024-04-24T13:30:46.319470+0000","last_clean":"2024-04-24T13:30:46.319470+0000","last_became_active":"2024-04-24T13:30:25.227801+0000","last_became_peered":"2024-04-24T13:30:25.227801+0000","last_unstale":"2024-04-24T13:30:46.319470+0000","last_undegraded":"2024-04-24T13:30:46.319470+0000","last_fullsized":"2024-04-24T13:30:46.319470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:16.778257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092868+0000","last_change":"2024-04-24T13:30:27.264731+0000","last_active":"2024-04-24T13:30:46.092868+0000","last_peered":"2024-04-24T13:30:46.092868+0000","last_clean":"2024-04-24T13:30:46.092868+0000","last_became_active":"2024-04-24T13:30:27.263888+0000","last_became_peered":"2024-04-24T13:30:27.263888+0000","last_unstale":"2024-04-24T13:30:46.092868+0000","last_undegraded":"2024-04-24T13:30:46.092868+0000","last_fullsized":"2024-04-24T13:30:46.092868+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.056935+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:30:46.056935+0000","last_peered":"2024-04-24T13:30:46.056935+0000","last_clean":"2024-04-24T13:30:46.056935+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:30:46.056935+0000","last_undegraded":"2024-04-24T13:30:46.056935+0000","last_fullsized":"2024-04-24T13:30:46.056935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093327+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:30:46.093327+0000","last_peered":"2024-04-24T13:30:46.093327+0000","last_clean":"2024-04-24T13:30:46.093327+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:30:46.093327+0000","last_undegraded":"2024-04-24T13:30:46.093327+0000","last_fullsized":"2024-04-24T13:30:46.093327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321166+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:30:46.321166+0000","last_peered":"2024-04-24T13:30:46.321166+0000","last_clean":"2024-04-24T13:30:46.321166+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:30:46.321166+0000","last_undegraded":"2024-04-24T13:30:46.321166+0000","last_fullsized":"2024-04-24T13:30:46.321166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417451+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:30:47.417451+0000","last_peered":"2024-04-24T13:30:47.417451+0000","last_clean":"2024-04-24T13:30:47.417451+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:30:47.417451+0000","last_undegraded":"2024-04-24T13:30:47.417451+0000","last_fullsized":"2024-04-24T13:30:47.417451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321068+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:30:46.321068+0000","last_peered":"2024-04-24T13:30:46.321068+0000","last_clean":"2024-04-24T13:30:46.321068+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:30:46.321068+0000","last_undegraded":"2024-04-24T13:30:46.321068+0000","last_fullsized":"2024-04-24T13:30:46.321068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.860888+0000","last_change":"2024-04-24T13:30:21.223752+0000","last_active":"2024-04-24T13:30:45.860888+0000","last_peered":"2024-04-24T13:30:45.860888+0000","last_clean":"2024-04-24T13:30:45.860888+0000","last_became_active":"2024-04-24T13:30:21.223457+0000","last_became_peered":"2024-04-24T13:30:21.223457+0000","last_unstale":"2024-04-24T13:30:45.860888+0000","last_undegraded":"2024-04-24T13:30:45.860888+0000","last_fullsized":"2024-04-24T13:30:45.860888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:49.280399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879185+0000","last_change":"2024-04-24T13:30:23.239053+0000","last_active":"2024-04-24T13:30:46.879185+0000","last_peered":"2024-04-24T13:30:46.879185+0000","last_clean":"2024-04-24T13:30:46.879185+0000","last_became_active":"2024-04-24T13:30:23.238289+0000","last_became_peered":"2024-04-24T13:30:23.238289+0000","last_unstale":"2024-04-24T13:30:46.879185+0000","last_undegraded":"2024-04-24T13:30:46.879185+0000","last_fullsized":"2024-04-24T13:30:46.879185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878910+0000","last_change":"2024-04-24T13:30:21.224037+0000","last_active":"2024-04-24T13:30:46.878910+0000","last_peered":"2024-04-24T13:30:46.878910+0000","last_clean":"2024-04-24T13:30:46.878910+0000","last_became_active":"2024-04-24T13:30:21.222146+0000","last_became_peered":"2024-04-24T13:30:21.222146+0000","last_unstale":"2024-04-24T13:30:46.878910+0000","last_undegraded":"2024-04-24T13:30:46.878910+0000","last_fullsized":"2024-04-24T13:30:46.878910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319462+0000","last_change":"2024-04-24T13:30:23.241090+0000","last_active":"2024-04-24T13:30:46.319462+0000","last_peered":"2024-04-24T13:30:46.319462+0000","last_clean":"2024-04-24T13:30:46.319462+0000","last_became_active":"2024-04-24T13:30:23.240726+0000","last_became_peered":"2024-04-24T13:30:23.240726+0000","last_unstale":"2024-04-24T13:30:46.319462+0000","last_undegraded":"2024-04-24T13:30:46.319462+0000","last_fullsized":"2024-04-24T13:30:46.319462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058084+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:30:46.058084+0000","last_peered":"2024-04-24T13:30:46.058084+0000","last_clean":"2024-04-24T13:30:46.058084+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:30:46.058084+0000","last_undegraded":"2024-04-24T13:30:46.058084+0000","last_fullsized":"2024-04-24T13:30:46.058084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881403+0000","last_change":"2024-04-24T13:30:23.246330+0000","last_active":"2024-04-24T13:30:46.881403+0000","last_peered":"2024-04-24T13:30:46.881403+0000","last_clean":"2024-04-24T13:30:46.881403+0000","last_became_active":"2024-04-24T13:30:23.246109+0000","last_became_peered":"2024-04-24T13:30:23.246109+0000","last_unstale":"2024-04-24T13:30:46.881403+0000","last_undegraded":"2024-04-24T13:30:46.881403+0000","last_fullsized":"2024-04-24T13:30:46.881403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882526+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:30:46.882526+0000","last_peered":"2024-04-24T13:30:46.882526+0000","last_clean":"2024-04-24T13:30:46.882526+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:30:46.882526+0000","last_undegraded":"2024-04-24T13:30:46.882526+0000","last_fullsized":"2024-04-24T13:30:46.882526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093830+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:30:46.093830+0000","last_peered":"2024-04-24T13:30:46.093830+0000","last_clean":"2024-04-24T13:30:46.093830+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:30:46.093830+0000","last_undegraded":"2024-04-24T13:30:46.093830+0000","last_fullsized":"2024-04-24T13:30:46.093830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320721+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:30:46.320721+0000","last_peered":"2024-04-24T13:30:46.320721+0000","last_clean":"2024-04-24T13:30:46.320721+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:30:46.320721+0000","last_undegraded":"2024-04-24T13:30:46.320721+0000","last_fullsized":"2024-04-24T13:30:46.320721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880268+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:30:46.880268+0000","last_peered":"2024-04-24T13:30:46.880268+0000","last_clean":"2024-04-24T13:30:46.880268+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:30:46.880268+0000","last_undegraded":"2024-04-24T13:30:46.880268+0000","last_fullsized":"2024-04-24T13:30:46.880268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418719+0000","last_change":"2024-04-24T13:30:21.244582+0000","last_active":"2024-04-24T13:30:47.418719+0000","last_peered":"2024-04-24T13:30:47.418719+0000","last_clean":"2024-04-24T13:30:47.418719+0000","last_became_active":"2024-04-24T13:30:21.243856+0000","last_became_peered":"2024-04-24T13:30:21.243856+0000","last_unstale":"2024-04-24T13:30:47.418719+0000","last_undegraded":"2024-04-24T13:30:47.418719+0000","last_fullsized":"2024-04-24T13:30:47.418719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417467+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:30:47.417467+0000","last_peered":"2024-04-24T13:30:47.417467+0000","last_clean":"2024-04-24T13:30:47.417467+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:30:47.417467+0000","last_undegraded":"2024-04-24T13:30:47.417467+0000","last_fullsized":"2024-04-24T13:30:47.417467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882555+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:30:46.882555+0000","last_peered":"2024-04-24T13:30:46.882555+0000","last_clean":"2024-04-24T13:30:46.882555+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:30:46.882555+0000","last_undegraded":"2024-04-24T13:30:46.882555+0000","last_fullsized":"2024-04-24T13:30:46.882555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058924+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:30:46.058924+0000","last_peered":"2024-04-24T13:30:46.058924+0000","last_clean":"2024-04-24T13:30:46.058924+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:30:46.058924+0000","last_undegraded":"2024-04-24T13:30:46.058924+0000","last_fullsized":"2024-04-24T13:30:46.058924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878483+0000","last_change":"2024-04-24T13:30:21.229523+0000","last_active":"2024-04-24T13:30:46.878483+0000","last_peered":"2024-04-24T13:30:46.878483+0000","last_clean":"2024-04-24T13:30:46.878483+0000","last_became_active":"2024-04-24T13:30:21.228400+0000","last_became_peered":"2024-04-24T13:30:21.228400+0000","last_unstale":"2024-04-24T13:30:46.878483+0000","last_undegraded":"2024-04-24T13:30:46.878483+0000","last_fullsized":"2024-04-24T13:30:46.878483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094923+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:30:46.094923+0000","last_peered":"2024-04-24T13:30:46.094923+0000","last_clean":"2024-04-24T13:30:46.094923+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:30:46.094923+0000","last_undegraded":"2024-04-24T13:30:46.094923+0000","last_fullsized":"2024-04-24T13:30:46.094923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880926+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:30:46.880926+0000","last_peered":"2024-04-24T13:30:46.880926+0000","last_clean":"2024-04-24T13:30:46.880926+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:30:46.880926+0000","last_undegraded":"2024-04-24T13:30:46.880926+0000","last_fullsized":"2024-04-24T13:30:46.880926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.862940+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:30:45.862940+0000","last_peered":"2024-04-24T13:30:45.862940+0000","last_clean":"2024-04-24T13:30:45.862940+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:30:45.862940+0000","last_undegraded":"2024-04-24T13:30:45.862940+0000","last_fullsized":"2024-04-24T13:30:45.862940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878820+0000","last_change":"2024-04-24T13:30:21.241430+0000","last_active":"2024-04-24T13:30:46.878820+0000","last_peered":"2024-04-24T13:30:46.878820+0000","last_clean":"2024-04-24T13:30:46.878820+0000","last_became_active":"2024-04-24T13:30:21.240593+0000","last_became_peered":"2024-04-24T13:30:21.240593+0000","last_unstale":"2024-04-24T13:30:46.878820+0000","last_undegraded":"2024-04-24T13:30:46.878820+0000","last_fullsized":"2024-04-24T13:30:46.878820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094492+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:30:46.094492+0000","last_peered":"2024-04-24T13:30:46.094492+0000","last_clean":"2024-04-24T13:30:46.094492+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:30:46.094492+0000","last_undegraded":"2024-04-24T13:30:46.094492+0000","last_fullsized":"2024-04-24T13:30:46.094492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058203+0000","last_change":"2024-04-24T13:30:21.238887+0000","last_active":"2024-04-24T13:30:46.058203+0000","last_peered":"2024-04-24T13:30:46.058203+0000","last_clean":"2024-04-24T13:30:46.058203+0000","last_became_active":"2024-04-24T13:30:21.238580+0000","last_became_peered":"2024-04-24T13:30:21.238580+0000","last_unstale":"2024-04-24T13:30:46.058203+0000","last_undegraded":"2024-04-24T13:30:46.058203+0000","last_fullsized":"2024-04-24T13:30:46.058203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320423+0000","last_change":"2024-04-24T13:30:23.241254+0000","last_active":"2024-04-24T13:30:46.320423+0000","last_peered":"2024-04-24T13:30:46.320423+0000","last_clean":"2024-04-24T13:30:46.320423+0000","last_became_active":"2024-04-24T13:30:23.236897+0000","last_became_peered":"2024-04-24T13:30:23.236897+0000","last_unstale":"2024-04-24T13:30:46.320423+0000","last_undegraded":"2024-04-24T13:30:46.320423+0000","last_fullsized":"2024-04-24T13:30:46.320423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418314+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:30:47.418314+0000","last_peered":"2024-04-24T13:30:47.418314+0000","last_clean":"2024-04-24T13:30:47.418314+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:30:47.418314+0000","last_undegraded":"2024-04-24T13:30:47.418314+0000","last_fullsized":"2024-04-24T13:30:47.418314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057485+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:30:46.057485+0000","last_peered":"2024-04-24T13:30:46.057485+0000","last_clean":"2024-04-24T13:30:46.057485+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:30:46.057485+0000","last_undegraded":"2024-04-24T13:30:46.057485+0000","last_fullsized":"2024-04-24T13:30:46.057485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.322650+0000","last_change":"2024-04-24T13:30:21.251108+0000","last_active":"2024-04-24T13:30:46.322650+0000","last_peered":"2024-04-24T13:30:46.322650+0000","last_clean":"2024-04-24T13:30:46.322650+0000","last_became_active":"2024-04-24T13:30:21.250436+0000","last_became_peered":"2024-04-24T13:30:21.250436+0000","last_unstale":"2024-04-24T13:30:46.322650+0000","last_undegraded":"2024-04-24T13:30:46.322650+0000","last_fullsized":"2024-04-24T13:30:46.322650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:21.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880114+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:30:46.880114+0000","last_peered":"2024-04-24T13:30:46.880114+0000","last_clean":"2024-04-24T13:30:46.880114+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:30:46.880114+0000","last_undegraded":"2024-04-24T13:30:46.880114+0000","last_fullsized":"2024-04-24T13:30:46.880114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.863731+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:30:45.863731+0000","last_peered":"2024-04-24T13:30:45.863731+0000","last_clean":"2024-04-24T13:30:45.863731+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:30:45.863731+0000","last_undegraded":"2024-04-24T13:30:45.863731+0000","last_fullsized":"2024-04-24T13:30:45.863731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319830+0000","last_change":"2024-04-24T13:30:23.241296+0000","last_active":"2024-04-24T13:30:46.319830+0000","last_peered":"2024-04-24T13:30:46.319830+0000","last_clean":"2024-04-24T13:30:46.319830+0000","last_became_active":"2024-04-24T13:30:23.236992+0000","last_became_peered":"2024-04-24T13:30:23.236992+0000","last_unstale":"2024-04-24T13:30:46.319830+0000","last_undegraded":"2024-04-24T13:30:46.319830+0000","last_fullsized":"2024-04-24T13:30:46.319830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879272+0000","last_change":"2024-04-24T13:30:21.243438+0000","last_active":"2024-04-24T13:30:46.879272+0000","last_peered":"2024-04-24T13:30:46.879272+0000","last_clean":"2024-04-24T13:30:46.879272+0000","last_became_active":"2024-04-24T13:30:21.240665+0000","last_became_peered":"2024-04-24T13:30:21.240665+0000","last_unstale":"2024-04-24T13:30:46.879272+0000","last_undegraded":"2024-04-24T13:30:46.879272+0000","last_fullsized":"2024-04-24T13:30:46.879272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878442+0000","last_change":"2024-04-24T13:30:21.218669+0000","last_active":"2024-04-24T13:30:46.878442+0000","last_peered":"2024-04-24T13:30:46.878442+0000","last_clean":"2024-04-24T13:30:46.878442+0000","last_became_active":"2024-04-24T13:30:21.217904+0000","last_became_peered":"2024-04-24T13:30:21.217904+0000","last_unstale":"2024-04-24T13:30:46.878442+0000","last_undegraded":"2024-04-24T13:30:46.878442+0000","last_fullsized":"2024-04-24T13:30:46.878442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058445+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:30:46.058445+0000","last_peered":"2024-04-24T13:30:46.058445+0000","last_clean":"2024-04-24T13:30:46.058445+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:30:46.058445+0000","last_undegraded":"2024-04-24T13:30:46.058445+0000","last_fullsized":"2024-04-24T13:30:46.058445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320090+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:30:46.320090+0000","last_peered":"2024-04-24T13:30:46.320090+0000","last_clean":"2024-04-24T13:30:46.320090+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:30:46.320090+0000","last_undegraded":"2024-04-24T13:30:46.320090+0000","last_fullsized":"2024-04-24T13:30:46.320090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879141+0000","last_change":"2024-04-24T13:30:23.217309+0000","last_active":"2024-04-24T13:30:46.879141+0000","last_peered":"2024-04-24T13:30:46.879141+0000","last_clean":"2024-04-24T13:30:46.879141+0000","last_became_active":"2024-04-24T13:30:23.216484+0000","last_became_peered":"2024-04-24T13:30:23.216484+0000","last_unstale":"2024-04-24T13:30:46.879141+0000","last_undegraded":"2024-04-24T13:30:46.879141+0000","last_fullsized":"2024-04-24T13:30:46.879141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1073152,"data_stored":795456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":204428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":214327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":203926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":483328,"data_stored":212466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":203990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":206107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1052672,"data_stored":794862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:30:48.292 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:30:48.369 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:48.369+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:48.408 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:30:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:30:48.408 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:48.423 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:30:48.513 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:48.513+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:48.571 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:48.569+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:48.592 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:48.592 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:30:48.592 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:30:48.593 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:30:48.593 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:48.606 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:30:48.643 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:30:48.650 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:30:48.661 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":53,"stamp":"2024-04-24T13:30:47.878924+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":194,"num_object_clones":0,"num_object_copies":388,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":194,"num_whiteouts":0,"num_read":808,"num_read_kb":551,"num_write":586,"num_write_kb":2456,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":526,"ondisk_log_size":526,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":225204,"kb_used_data":4832,"kb_used_omap":12,"kb_used_meta":220211,"kb_avail":754749516,"statfs":{"total":773094113280,"available":772863504384,"internally_reserved":0,"allocated":4947968,"data_stored":2835562,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":225496625},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.035380"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321933+0000","last_change":"2024-04-24T13:30:21.250354+0000","last_active":"2024-04-24T13:30:46.321933+0000","last_peered":"2024-04-24T13:30:46.321933+0000","last_clean":"2024-04-24T13:30:46.321933+0000","last_became_active":"2024-04-24T13:30:21.246835+0000","last_became_peered":"2024-04-24T13:30:21.246835+0000","last_unstale":"2024-04-24T13:30:46.321933+0000","last_undegraded":"2024-04-24T13:30:46.321933+0000","last_fullsized":"2024-04-24T13:30:46.321933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:09.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878208+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:30:46.878208+0000","last_peered":"2024-04-24T13:30:46.878208+0000","last_clean":"2024-04-24T13:30:46.878208+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:30:46.878208+0000","last_undegraded":"2024-04-24T13:30:46.878208+0000","last_fullsized":"2024-04-24T13:30:46.878208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321260+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:30:46.321260+0000","last_peered":"2024-04-24T13:30:46.321260+0000","last_clean":"2024-04-24T13:30:46.321260+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:30:46.321260+0000","last_undegraded":"2024-04-24T13:30:46.321260+0000","last_fullsized":"2024-04-24T13:30:46.321260+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320693+0000","last_change":"2024-04-24T13:30:23.237080+0000","last_active":"2024-04-24T13:30:46.320693+0000","last_peered":"2024-04-24T13:30:46.320693+0000","last_clean":"2024-04-24T13:30:46.320693+0000","last_became_active":"2024-04-24T13:30:23.236356+0000","last_became_peered":"2024-04-24T13:30:23.236356+0000","last_unstale":"2024-04-24T13:30:46.320693+0000","last_undegraded":"2024-04-24T13:30:46.320693+0000","last_fullsized":"2024-04-24T13:30:46.320693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057031+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:30:46.057031+0000","last_peered":"2024-04-24T13:30:46.057031+0000","last_clean":"2024-04-24T13:30:46.057031+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:30:46.057031+0000","last_undegraded":"2024-04-24T13:30:46.057031+0000","last_fullsized":"2024-04-24T13:30:46.057031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093208+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:30:46.093208+0000","last_peered":"2024-04-24T13:30:46.093208+0000","last_clean":"2024-04-24T13:30:46.093208+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:30:46.093208+0000","last_undegraded":"2024-04-24T13:30:46.093208+0000","last_fullsized":"2024-04-24T13:30:46.093208+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879070+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:30:46.879070+0000","last_peered":"2024-04-24T13:30:46.879070+0000","last_clean":"2024-04-24T13:30:46.879070+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:30:46.879070+0000","last_undegraded":"2024-04-24T13:30:46.879070+0000","last_fullsized":"2024-04-24T13:30:46.879070+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058002+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:30:46.058002+0000","last_peered":"2024-04-24T13:30:46.058002+0000","last_clean":"2024-04-24T13:30:46.058002+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:30:46.058002+0000","last_undegraded":"2024-04-24T13:30:46.058002+0000","last_fullsized":"2024-04-24T13:30:46.058002+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320676+0000","last_change":"2024-04-24T13:30:21.251948+0000","last_active":"2024-04-24T13:30:46.320676+0000","last_peered":"2024-04-24T13:30:46.320676+0000","last_clean":"2024-04-24T13:30:46.320676+0000","last_became_active":"2024-04-24T13:30:21.251184+0000","last_became_peered":"2024-04-24T13:30:21.251184+0000","last_unstale":"2024-04-24T13:30:46.320676+0000","last_undegraded":"2024-04-24T13:30:46.320676+0000","last_fullsized":"2024-04-24T13:30:46.320676+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418088+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:30:47.418088+0000","last_peered":"2024-04-24T13:30:47.418088+0000","last_clean":"2024-04-24T13:30:47.418088+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:30:47.418088+0000","last_undegraded":"2024-04-24T13:30:47.418088+0000","last_fullsized":"2024-04-24T13:30:47.418088+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878554+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:30:46.878554+0000","last_peered":"2024-04-24T13:30:46.878554+0000","last_clean":"2024-04-24T13:30:46.878554+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:30:46.878554+0000","last_undegraded":"2024-04-24T13:30:46.878554+0000","last_fullsized":"2024-04-24T13:30:46.878554+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094365+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:30:46.094365+0000","last_peered":"2024-04-24T13:30:46.094365+0000","last_clean":"2024-04-24T13:30:46.094365+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:30:46.094365+0000","last_undegraded":"2024-04-24T13:30:46.094365+0000","last_fullsized":"2024-04-24T13:30:46.094365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321200+0000","last_change":"2024-04-24T13:30:21.247080+0000","last_active":"2024-04-24T13:30:46.321200+0000","last_peered":"2024-04-24T13:30:46.321200+0000","last_clean":"2024-04-24T13:30:46.321200+0000","last_became_active":"2024-04-24T13:30:21.239363+0000","last_became_peered":"2024-04-24T13:30:21.239363+0000","last_unstale":"2024-04-24T13:30:46.321200+0000","last_undegraded":"2024-04-24T13:30:46.321200+0000","last_fullsized":"2024-04-24T13:30:46.321200+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878921+0000","last_change":"2024-04-24T13:30:23.228080+0000","last_active":"2024-04-24T13:30:46.878921+0000","last_peered":"2024-04-24T13:30:46.878921+0000","last_clean":"2024-04-24T13:30:46.878921+0000","last_became_active":"2024-04-24T13:30:23.227215+0000","last_became_peered":"2024-04-24T13:30:23.227215+0000","last_unstale":"2024-04-24T13:30:46.878921+0000","last_undegraded":"2024-04-24T13:30:46.878921+0000","last_fullsized":"2024-04-24T13:30:46.878921+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879989+0000","last_change":"2024-04-24T13:30:21.232985+0000","last_active":"2024-04-24T13:30:46.879989+0000","last_peered":"2024-04-24T13:30:46.879989+0000","last_clean":"2024-04-24T13:30:46.879989+0000","last_became_active":"2024-04-24T13:30:21.229584+0000","last_became_peered":"2024-04-24T13:30:21.229584+0000","last_unstale":"2024-04-24T13:30:46.879989+0000","last_undegraded":"2024-04-24T13:30:46.879989+0000","last_fullsized":"2024-04-24T13:30:46.879989+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.863926+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:30:45.863926+0000","last_peered":"2024-04-24T13:30:45.863926+0000","last_clean":"2024-04-24T13:30:45.863926+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:30:45.863926+0000","last_undegraded":"2024-04-24T13:30:45.863926+0000","last_fullsized":"2024-04-24T13:30:45.863926+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092754+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:30:46.092754+0000","last_peered":"2024-04-24T13:30:46.092754+0000","last_clean":"2024-04-24T13:30:46.092754+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:30:46.092754+0000","last_undegraded":"2024-04-24T13:30:46.092754+0000","last_fullsized":"2024-04-24T13:30:46.092754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.322009+0000","last_change":"2024-04-24T13:30:21.247071+0000","last_active":"2024-04-24T13:30:46.322009+0000","last_peered":"2024-04-24T13:30:46.322009+0000","last_clean":"2024-04-24T13:30:46.322009+0000","last_became_active":"2024-04-24T13:30:21.246454+0000","last_became_peered":"2024-04-24T13:30:21.246454+0000","last_unstale":"2024-04-24T13:30:46.322009+0000","last_undegraded":"2024-04-24T13:30:46.322009+0000","last_fullsized":"2024-04-24T13:30:46.322009+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:48.173823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320938+0000","last_change":"2024-04-24T13:30:23.241549+0000","last_active":"2024-04-24T13:30:46.320938+0000","last_peered":"2024-04-24T13:30:46.320938+0000","last_clean":"2024-04-24T13:30:46.320938+0000","last_became_active":"2024-04-24T13:30:23.236814+0000","last_became_peered":"2024-04-24T13:30:23.236814+0000","last_unstale":"2024-04-24T13:30:46.320938+0000","last_undegraded":"2024-04-24T13:30:46.320938+0000","last_fullsized":"2024-04-24T13:30:46.320938+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418656+0000","last_change":"2024-04-24T13:30:21.244607+0000","last_active":"2024-04-24T13:30:47.418656+0000","last_peered":"2024-04-24T13:30:47.418656+0000","last_clean":"2024-04-24T13:30:47.418656+0000","last_became_active":"2024-04-24T13:30:21.243828+0000","last_became_peered":"2024-04-24T13:30:21.243828+0000","last_unstale":"2024-04-24T13:30:47.418656+0000","last_undegraded":"2024-04-24T13:30:47.418656+0000","last_fullsized":"2024-04-24T13:30:47.418656+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878734+0000","last_change":"2024-04-24T13:30:23.220120+0000","last_active":"2024-04-24T13:30:46.878734+0000","last_peered":"2024-04-24T13:30:46.878734+0000","last_clean":"2024-04-24T13:30:46.878734+0000","last_became_active":"2024-04-24T13:30:23.219312+0000","last_became_peered":"2024-04-24T13:30:23.219312+0000","last_unstale":"2024-04-24T13:30:46.878734+0000","last_undegraded":"2024-04-24T13:30:46.878734+0000","last_fullsized":"2024-04-24T13:30:46.878734+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418582+0000","last_change":"2024-04-24T13:30:21.243317+0000","last_active":"2024-04-24T13:30:47.418582+0000","last_peered":"2024-04-24T13:30:47.418582+0000","last_clean":"2024-04-24T13:30:47.418582+0000","last_became_active":"2024-04-24T13:30:21.239686+0000","last_became_peered":"2024-04-24T13:30:21.239686+0000","last_unstale":"2024-04-24T13:30:47.418582+0000","last_undegraded":"2024-04-24T13:30:47.418582+0000","last_fullsized":"2024-04-24T13:30:47.418582+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.861710+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:30:45.861710+0000","last_peered":"2024-04-24T13:30:45.861710+0000","last_clean":"2024-04-24T13:30:45.861710+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:30:45.861710+0000","last_undegraded":"2024-04-24T13:30:45.861710+0000","last_fullsized":"2024-04-24T13:30:45.861710+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092146+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:30:46.092146+0000","last_peered":"2024-04-24T13:30:46.092146+0000","last_clean":"2024-04-24T13:30:46.092146+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:30:46.092146+0000","last_undegraded":"2024-04-24T13:30:46.092146+0000","last_fullsized":"2024-04-24T13:30:46.092146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.862097+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:30:45.862097+0000","last_peered":"2024-04-24T13:30:45.862097+0000","last_clean":"2024-04-24T13:30:45.862097+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:30:45.862097+0000","last_undegraded":"2024-04-24T13:30:45.862097+0000","last_fullsized":"2024-04-24T13:30:45.862097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881123+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:30:46.881123+0000","last_peered":"2024-04-24T13:30:46.881123+0000","last_clean":"2024-04-24T13:30:46.881123+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:30:46.881123+0000","last_undegraded":"2024-04-24T13:30:46.881123+0000","last_fullsized":"2024-04-24T13:30:46.881123+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094551+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:30:46.094551+0000","last_peered":"2024-04-24T13:30:46.094551+0000","last_clean":"2024-04-24T13:30:46.094551+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:30:46.094551+0000","last_undegraded":"2024-04-24T13:30:46.094551+0000","last_fullsized":"2024-04-24T13:30:46.094551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057703+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:30:46.057703+0000","last_peered":"2024-04-24T13:30:46.057703+0000","last_clean":"2024-04-24T13:30:46.057703+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:30:46.057703+0000","last_undegraded":"2024-04-24T13:30:46.057703+0000","last_fullsized":"2024-04-24T13:30:46.057703+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092268+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:30:46.092268+0000","last_peered":"2024-04-24T13:30:46.092268+0000","last_clean":"2024-04-24T13:30:46.092268+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:30:46.092268+0000","last_undegraded":"2024-04-24T13:30:46.092268+0000","last_fullsized":"2024-04-24T13:30:46.092268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882056+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:30:46.882056+0000","last_peered":"2024-04-24T13:30:46.882056+0000","last_clean":"2024-04-24T13:30:46.882056+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:30:46.882056+0000","last_undegraded":"2024-04-24T13:30:46.882056+0000","last_fullsized":"2024-04-24T13:30:46.882056+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321114+0000","last_change":"2024-04-24T13:30:21.239348+0000","last_active":"2024-04-24T13:30:46.321114+0000","last_peered":"2024-04-24T13:30:46.321114+0000","last_clean":"2024-04-24T13:30:46.321114+0000","last_became_active":"2024-04-24T13:30:21.238561+0000","last_became_peered":"2024-04-24T13:30:21.238561+0000","last_unstale":"2024-04-24T13:30:46.321114+0000","last_undegraded":"2024-04-24T13:30:46.321114+0000","last_fullsized":"2024-04-24T13:30:46.321114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":39,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879129+0000","last_change":"2024-04-24T13:30:25.234573+0000","last_active":"2024-04-24T13:30:46.879129+0000","last_peered":"2024-04-24T13:30:46.879129+0000","last_clean":"2024-04-24T13:30:46.879129+0000","last_became_active":"2024-04-24T13:30:25.233807+0000","last_became_peered":"2024-04-24T13:30:25.233807+0000","last_unstale":"2024-04-24T13:30:46.879129+0000","last_undegraded":"2024-04-24T13:30:46.879129+0000","last_fullsized":"2024-04-24T13:30:46.879129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058315+0000","last_change":"2024-04-24T13:30:27.251872+0000","last_active":"2024-04-24T13:30:46.058315+0000","last_peered":"2024-04-24T13:30:46.058315+0000","last_clean":"2024-04-24T13:30:46.058315+0000","last_became_active":"2024-04-24T13:30:27.251286+0000","last_became_peered":"2024-04-24T13:30:27.251286+0000","last_unstale":"2024-04-24T13:30:46.058315+0000","last_undegraded":"2024-04-24T13:30:46.058315+0000","last_fullsized":"2024-04-24T13:30:46.058315+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:20.682651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321636+0000","last_change":"2024-04-24T13:30:29.281884+0000","last_active":"2024-04-24T13:30:46.321636+0000","last_peered":"2024-04-24T13:30:46.321636+0000","last_clean":"2024-04-24T13:30:46.321636+0000","last_became_active":"2024-04-24T13:30:29.281138+0000","last_became_peered":"2024-04-24T13:30:29.281138+0000","last_unstale":"2024-04-24T13:30:46.321636+0000","last_undegraded":"2024-04-24T13:30:46.321636+0000","last_fullsized":"2024-04-24T13:30:46.321636+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878178+0000","last_change":"2024-04-24T13:30:31.266582+0000","last_active":"2024-04-24T13:30:46.878178+0000","last_peered":"2024-04-24T13:30:46.878178+0000","last_clean":"2024-04-24T13:30:46.878178+0000","last_became_active":"2024-04-24T13:30:31.265452+0000","last_became_peered":"2024-04-24T13:30:31.265452+0000","last_unstale":"2024-04-24T13:30:46.878178+0000","last_undegraded":"2024-04-24T13:30:46.878178+0000","last_fullsized":"2024-04-24T13:30:46.878178+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880905+0000","last_change":"2024-04-24T13:30:23.247313+0000","last_active":"2024-04-24T13:30:46.880905+0000","last_peered":"2024-04-24T13:30:46.880905+0000","last_clean":"2024-04-24T13:30:46.880905+0000","last_became_active":"2024-04-24T13:30:23.246445+0000","last_became_peered":"2024-04-24T13:30:23.246445+0000","last_unstale":"2024-04-24T13:30:46.880905+0000","last_undegraded":"2024-04-24T13:30:46.880905+0000","last_fullsized":"2024-04-24T13:30:46.880905+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057738+0000","last_change":"2024-04-24T13:30:21.238903+0000","last_active":"2024-04-24T13:30:46.057738+0000","last_peered":"2024-04-24T13:30:46.057738+0000","last_clean":"2024-04-24T13:30:46.057738+0000","last_became_active":"2024-04-24T13:30:21.238625+0000","last_became_peered":"2024-04-24T13:30:21.238625+0000","last_unstale":"2024-04-24T13:30:46.057738+0000","last_undegraded":"2024-04-24T13:30:46.057738+0000","last_fullsized":"2024-04-24T13:30:46.057738+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881811+0000","last_change":"2024-04-24T13:30:25.226046+0000","last_active":"2024-04-24T13:30:46.881811+0000","last_peered":"2024-04-24T13:30:46.881811+0000","last_clean":"2024-04-24T13:30:46.881811+0000","last_became_active":"2024-04-24T13:30:25.225623+0000","last_became_peered":"2024-04-24T13:30:25.225623+0000","last_unstale":"2024-04-24T13:30:46.881811+0000","last_undegraded":"2024-04-24T13:30:46.881811+0000","last_fullsized":"2024-04-24T13:30:46.881811+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":40,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094860+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:30:46.094860+0000","last_peered":"2024-04-24T13:30:46.094860+0000","last_clean":"2024-04-24T13:30:46.094860+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:30:46.094860+0000","last_undegraded":"2024-04-24T13:30:46.094860+0000","last_fullsized":"2024-04-24T13:30:46.094860+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094414+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:30:46.094414+0000","last_peered":"2024-04-24T13:30:46.094414+0000","last_clean":"2024-04-24T13:30:46.094414+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:30:46.094414+0000","last_undegraded":"2024-04-24T13:30:46.094414+0000","last_fullsized":"2024-04-24T13:30:46.094414+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057563+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:30:46.057563+0000","last_peered":"2024-04-24T13:30:46.057563+0000","last_clean":"2024-04-24T13:30:46.057563+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:30:46.057563+0000","last_undegraded":"2024-04-24T13:30:46.057563+0000","last_fullsized":"2024-04-24T13:30:46.057563+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058816+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:30:46.058816+0000","last_peered":"2024-04-24T13:30:46.058816+0000","last_clean":"2024-04-24T13:30:46.058816+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:30:46.058816+0000","last_undegraded":"2024-04-24T13:30:46.058816+0000","last_fullsized":"2024-04-24T13:30:46.058816+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321418+0000","last_change":"2024-04-24T13:30:21.250665+0000","last_active":"2024-04-24T13:30:46.321418+0000","last_peered":"2024-04-24T13:30:46.321418+0000","last_clean":"2024-04-24T13:30:46.321418+0000","last_became_active":"2024-04-24T13:30:21.246084+0000","last_became_peered":"2024-04-24T13:30:21.246084+0000","last_unstale":"2024-04-24T13:30:46.321418+0000","last_undegraded":"2024-04-24T13:30:46.321418+0000","last_fullsized":"2024-04-24T13:30:46.321418+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882881+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:30:46.882881+0000","last_peered":"2024-04-24T13:30:46.882881+0000","last_clean":"2024-04-24T13:30:46.882881+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:30:46.882881+0000","last_undegraded":"2024-04-24T13:30:46.882881+0000","last_fullsized":"2024-04-24T13:30:46.882881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":45,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.861917+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:30:45.861917+0000","last_peered":"2024-04-24T13:30:45.861917+0000","last_clean":"2024-04-24T13:30:45.861917+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:30:45.861917+0000","last_undegraded":"2024-04-24T13:30:45.861917+0000","last_fullsized":"2024-04-24T13:30:45.861917+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"29'2","reported_seq":33,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321214+0000","last_change":"2024-04-24T13:30:29.287547+0000","last_active":"2024-04-24T13:30:46.321214+0000","last_peered":"2024-04-24T13:30:46.321214+0000","last_clean":"2024-04-24T13:30:46.321214+0000","last_became_active":"2024-04-24T13:30:29.285504+0000","last_became_peered":"2024-04-24T13:30:29.285504+0000","last_unstale":"2024-04-24T13:30:46.321214+0000","last_undegraded":"2024-04-24T13:30:46.321214+0000","last_fullsized":"2024-04-24T13:30:46.321214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093112+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:30:46.093112+0000","last_peered":"2024-04-24T13:30:46.093112+0000","last_clean":"2024-04-24T13:30:46.093112+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:30:46.093112+0000","last_undegraded":"2024-04-24T13:30:46.093112+0000","last_fullsized":"2024-04-24T13:30:46.093112+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882515+0000","last_change":"2024-04-24T13:30:23.243719+0000","last_active":"2024-04-24T13:30:46.882515+0000","last_peered":"2024-04-24T13:30:46.882515+0000","last_clean":"2024-04-24T13:30:46.882515+0000","last_became_active":"2024-04-24T13:30:23.243202+0000","last_became_peered":"2024-04-24T13:30:23.243202+0000","last_unstale":"2024-04-24T13:30:46.882515+0000","last_undegraded":"2024-04-24T13:30:46.882515+0000","last_fullsized":"2024-04-24T13:30:46.882515+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:56.206587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417728+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:30:47.417728+0000","last_peered":"2024-04-24T13:30:47.417728+0000","last_clean":"2024-04-24T13:30:47.417728+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:30:47.417728+0000","last_undegraded":"2024-04-24T13:30:47.417728+0000","last_fullsized":"2024-04-24T13:30:47.417728+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878781+0000","last_change":"2024-04-24T13:30:25.229897+0000","last_active":"2024-04-24T13:30:46.878781+0000","last_peered":"2024-04-24T13:30:46.878781+0000","last_clean":"2024-04-24T13:30:46.878781+0000","last_became_active":"2024-04-24T13:30:25.228575+0000","last_became_peered":"2024-04-24T13:30:25.228575+0000","last_unstale":"2024-04-24T13:30:46.878781+0000","last_undegraded":"2024-04-24T13:30:46.878781+0000","last_fullsized":"2024-04-24T13:30:46.878781+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321527+0000","last_change":"2024-04-24T13:30:27.251316+0000","last_active":"2024-04-24T13:30:46.321527+0000","last_peered":"2024-04-24T13:30:46.321527+0000","last_clean":"2024-04-24T13:30:46.321527+0000","last_became_active":"2024-04-24T13:30:27.250447+0000","last_became_peered":"2024-04-24T13:30:27.250447+0000","last_unstale":"2024-04-24T13:30:46.321527+0000","last_undegraded":"2024-04-24T13:30:46.321527+0000","last_fullsized":"2024-04-24T13:30:46.321527+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881319+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:30:46.881319+0000","last_peered":"2024-04-24T13:30:46.881319+0000","last_clean":"2024-04-24T13:30:46.881319+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:30:46.881319+0000","last_undegraded":"2024-04-24T13:30:46.881319+0000","last_fullsized":"2024-04-24T13:30:46.881319+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878382+0000","last_change":"2024-04-24T13:30:23.245613+0000","last_active":"2024-04-24T13:30:46.878382+0000","last_peered":"2024-04-24T13:30:46.878382+0000","last_clean":"2024-04-24T13:30:46.878382+0000","last_became_active":"2024-04-24T13:30:23.242590+0000","last_became_peered":"2024-04-24T13:30:23.242590+0000","last_unstale":"2024-04-24T13:30:46.878382+0000","last_undegraded":"2024-04-24T13:30:46.878382+0000","last_fullsized":"2024-04-24T13:30:46.878382+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.323370+0000","last_change":"2024-04-24T13:30:21.256198+0000","last_active":"2024-04-24T13:30:46.323370+0000","last_peered":"2024-04-24T13:30:46.323370+0000","last_clean":"2024-04-24T13:30:46.323370+0000","last_became_active":"2024-04-24T13:30:21.255557+0000","last_became_peered":"2024-04-24T13:30:21.255557+0000","last_unstale":"2024-04-24T13:30:46.323370+0000","last_undegraded":"2024-04-24T13:30:46.323370+0000","last_fullsized":"2024-04-24T13:30:46.323370+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:09.431110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320084+0000","last_change":"2024-04-24T13:30:25.237115+0000","last_active":"2024-04-24T13:30:46.320084+0000","last_peered":"2024-04-24T13:30:46.320084+0000","last_clean":"2024-04-24T13:30:46.320084+0000","last_became_active":"2024-04-24T13:30:25.236366+0000","last_became_peered":"2024-04-24T13:30:25.236366+0000","last_unstale":"2024-04-24T13:30:46.320084+0000","last_undegraded":"2024-04-24T13:30:46.320084+0000","last_fullsized":"2024-04-24T13:30:46.320084+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:57.978574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":64,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878257+0000","last_change":"2024-04-24T13:30:27.261028+0000","last_active":"2024-04-24T13:30:46.878257+0000","last_peered":"2024-04-24T13:30:46.878257+0000","last_clean":"2024-04-24T13:30:46.878257+0000","last_became_active":"2024-04-24T13:30:27.260231+0000","last_became_peered":"2024-04-24T13:30:27.260231+0000","last_unstale":"2024-04-24T13:30:46.878257+0000","last_undegraded":"2024-04-24T13:30:46.878257+0000","last_fullsized":"2024-04-24T13:30:46.878257+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320028+0000","last_change":"2024-04-24T13:30:29.256804+0000","last_active":"2024-04-24T13:30:46.320028+0000","last_peered":"2024-04-24T13:30:46.320028+0000","last_clean":"2024-04-24T13:30:46.320028+0000","last_became_active":"2024-04-24T13:30:29.255975+0000","last_became_peered":"2024-04-24T13:30:29.255975+0000","last_unstale":"2024-04-24T13:30:46.320028+0000","last_undegraded":"2024-04-24T13:30:46.320028+0000","last_fullsized":"2024-04-24T13:30:46.320028+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:51.521585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878823+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:30:46.878823+0000","last_peered":"2024-04-24T13:30:46.878823+0000","last_clean":"2024-04-24T13:30:46.878823+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:30:46.878823+0000","last_undegraded":"2024-04-24T13:30:46.878823+0000","last_fullsized":"2024-04-24T13:30:46.878823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092903+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:30:46.092903+0000","last_peered":"2024-04-24T13:30:46.092903+0000","last_clean":"2024-04-24T13:30:46.092903+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:30:46.092903+0000","last_undegraded":"2024-04-24T13:30:46.092903+0000","last_fullsized":"2024-04-24T13:30:46.092903+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321657+0000","last_change":"2024-04-24T13:30:21.251719+0000","last_active":"2024-04-24T13:30:46.321657+0000","last_peered":"2024-04-24T13:30:46.321657+0000","last_clean":"2024-04-24T13:30:46.321657+0000","last_became_active":"2024-04-24T13:30:21.239440+0000","last_became_peered":"2024-04-24T13:30:21.239440+0000","last_unstale":"2024-04-24T13:30:46.321657+0000","last_undegraded":"2024-04-24T13:30:46.321657+0000","last_fullsized":"2024-04-24T13:30:46.321657+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:24.585089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.861140+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:30:45.861140+0000","last_peered":"2024-04-24T13:30:45.861140+0000","last_clean":"2024-04-24T13:30:45.861140+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:30:45.861140+0000","last_undegraded":"2024-04-24T13:30:45.861140+0000","last_fullsized":"2024-04-24T13:30:45.861140+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881485+0000","last_change":"2024-04-24T13:30:27.252640+0000","last_active":"2024-04-24T13:30:46.881485+0000","last_peered":"2024-04-24T13:30:46.881485+0000","last_clean":"2024-04-24T13:30:46.881485+0000","last_became_active":"2024-04-24T13:30:27.252211+0000","last_became_peered":"2024-04-24T13:30:27.252211+0000","last_unstale":"2024-04-24T13:30:46.881485+0000","last_undegraded":"2024-04-24T13:30:46.881485+0000","last_fullsized":"2024-04-24T13:30:46.881485+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:15.455006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880329+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:30:46.880329+0000","last_peered":"2024-04-24T13:30:46.880329+0000","last_clean":"2024-04-24T13:30:46.880329+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:30:46.880329+0000","last_undegraded":"2024-04-24T13:30:46.880329+0000","last_fullsized":"2024-04-24T13:30:46.880329+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418057+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:30:47.418057+0000","last_peered":"2024-04-24T13:30:47.418057+0000","last_clean":"2024-04-24T13:30:47.418057+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:30:47.418057+0000","last_undegraded":"2024-04-24T13:30:47.418057+0000","last_fullsized":"2024-04-24T13:30:47.418057+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417964+0000","last_change":"2024-04-24T13:30:23.239143+0000","last_active":"2024-04-24T13:30:47.417964+0000","last_peered":"2024-04-24T13:30:47.417964+0000","last_clean":"2024-04-24T13:30:47.417964+0000","last_became_active":"2024-04-24T13:30:23.238351+0000","last_became_peered":"2024-04-24T13:30:23.238351+0000","last_unstale":"2024-04-24T13:30:47.417964+0000","last_undegraded":"2024-04-24T13:30:47.417964+0000","last_fullsized":"2024-04-24T13:30:47.417964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.322411+0000","last_change":"2024-04-24T13:30:21.250029+0000","last_active":"2024-04-24T13:30:46.322411+0000","last_peered":"2024-04-24T13:30:46.322411+0000","last_clean":"2024-04-24T13:30:46.322411+0000","last_became_active":"2024-04-24T13:30:21.247198+0000","last_became_peered":"2024-04-24T13:30:21.247198+0000","last_unstale":"2024-04-24T13:30:46.322411+0000","last_undegraded":"2024-04-24T13:30:46.322411+0000","last_fullsized":"2024-04-24T13:30:46.322411+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:02.477283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.861963+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:30:45.861963+0000","last_peered":"2024-04-24T13:30:45.861963+0000","last_clean":"2024-04-24T13:30:45.861963+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:30:45.861963+0000","last_undegraded":"2024-04-24T13:30:45.861963+0000","last_fullsized":"2024-04-24T13:30:45.861963+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320777+0000","last_change":"2024-04-24T13:30:27.243504+0000","last_active":"2024-04-24T13:30:46.320777+0000","last_peered":"2024-04-24T13:30:46.320777+0000","last_clean":"2024-04-24T13:30:46.320777+0000","last_became_active":"2024-04-24T13:30:27.237695+0000","last_became_peered":"2024-04-24T13:30:27.237695+0000","last_unstale":"2024-04-24T13:30:46.320777+0000","last_undegraded":"2024-04-24T13:30:46.320777+0000","last_fullsized":"2024-04-24T13:30:46.320777+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:19.623955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057176+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:30:46.057176+0000","last_peered":"2024-04-24T13:30:46.057176+0000","last_clean":"2024-04-24T13:30:46.057176+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:30:46.057176+0000","last_undegraded":"2024-04-24T13:30:46.057176+0000","last_fullsized":"2024-04-24T13:30:46.057176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058405+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:30:46.058405+0000","last_peered":"2024-04-24T13:30:46.058405+0000","last_clean":"2024-04-24T13:30:46.058405+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:30:46.058405+0000","last_undegraded":"2024-04-24T13:30:46.058405+0000","last_fullsized":"2024-04-24T13:30:46.058405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058565+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:30:46.058565+0000","last_peered":"2024-04-24T13:30:46.058565+0000","last_clean":"2024-04-24T13:30:46.058565+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:30:46.058565+0000","last_undegraded":"2024-04-24T13:30:46.058565+0000","last_fullsized":"2024-04-24T13:30:46.058565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880836+0000","last_change":"2024-04-24T13:30:21.228287+0000","last_active":"2024-04-24T13:30:46.880836+0000","last_peered":"2024-04-24T13:30:46.880836+0000","last_clean":"2024-04-24T13:30:46.880836+0000","last_became_active":"2024-04-24T13:30:21.227358+0000","last_became_peered":"2024-04-24T13:30:21.227358+0000","last_unstale":"2024-04-24T13:30:46.880836+0000","last_undegraded":"2024-04-24T13:30:46.880836+0000","last_fullsized":"2024-04-24T13:30:46.880836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:09.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.862151+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:30:45.862151+0000","last_peered":"2024-04-24T13:30:45.862151+0000","last_clean":"2024-04-24T13:30:45.862151+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:30:45.862151+0000","last_undegraded":"2024-04-24T13:30:45.862151+0000","last_fullsized":"2024-04-24T13:30:45.862151+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":53,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057971+0000","last_change":"2024-04-24T13:30:27.249393+0000","last_active":"2024-04-24T13:30:46.057971+0000","last_peered":"2024-04-24T13:30:46.057971+0000","last_clean":"2024-04-24T13:30:46.057971+0000","last_became_active":"2024-04-24T13:30:27.248615+0000","last_became_peered":"2024-04-24T13:30:27.248615+0000","last_unstale":"2024-04-24T13:30:46.057971+0000","last_undegraded":"2024-04-24T13:30:46.057971+0000","last_fullsized":"2024-04-24T13:30:46.057971+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:19.623955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.860939+0000","last_change":"2024-04-24T13:30:29.273036+0000","last_active":"2024-04-24T13:30:45.860939+0000","last_peered":"2024-04-24T13:30:45.860939+0000","last_clean":"2024-04-24T13:30:45.860939+0000","last_became_active":"2024-04-24T13:30:29.272326+0000","last_became_peered":"2024-04-24T13:30:29.272326+0000","last_unstale":"2024-04-24T13:30:45.860939+0000","last_undegraded":"2024-04-24T13:30:45.860939+0000","last_fullsized":"2024-04-24T13:30:45.860939+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:12.872542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321109+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:30:46.321109+0000","last_peered":"2024-04-24T13:30:46.321109+0000","last_clean":"2024-04-24T13:30:46.321109+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:30:46.321109+0000","last_undegraded":"2024-04-24T13:30:46.321109+0000","last_fullsized":"2024-04-24T13:30:46.321109+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094215+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:30:46.094215+0000","last_peered":"2024-04-24T13:30:46.094215+0000","last_clean":"2024-04-24T13:30:46.094215+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:30:46.094215+0000","last_undegraded":"2024-04-24T13:30:46.094215+0000","last_fullsized":"2024-04-24T13:30:46.094215+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880812+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:30:46.880812+0000","last_peered":"2024-04-24T13:30:46.880812+0000","last_clean":"2024-04-24T13:30:46.880812+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:30:46.880812+0000","last_undegraded":"2024-04-24T13:30:46.880812+0000","last_fullsized":"2024-04-24T13:30:46.880812+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.862223+0000","last_change":"2024-04-24T13:30:25.226038+0000","last_active":"2024-04-24T13:30:45.862223+0000","last_peered":"2024-04-24T13:30:45.862223+0000","last_clean":"2024-04-24T13:30:45.862223+0000","last_became_active":"2024-04-24T13:30:25.225628+0000","last_became_peered":"2024-04-24T13:30:25.225628+0000","last_unstale":"2024-04-24T13:30:45.862223+0000","last_undegraded":"2024-04-24T13:30:45.862223+0000","last_fullsized":"2024-04-24T13:30:45.862223+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:33.775369+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":50,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094423+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:30:46.094423+0000","last_peered":"2024-04-24T13:30:46.094423+0000","last_clean":"2024-04-24T13:30:46.094423+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:30:46.094423+0000","last_undegraded":"2024-04-24T13:30:46.094423+0000","last_fullsized":"2024-04-24T13:30:46.094423+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058364+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:30:46.058364+0000","last_peered":"2024-04-24T13:30:46.058364+0000","last_clean":"2024-04-24T13:30:46.058364+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:30:46.058364+0000","last_undegraded":"2024-04-24T13:30:46.058364+0000","last_fullsized":"2024-04-24T13:30:46.058364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879595+0000","last_change":"2024-04-24T13:30:31.269459+0000","last_active":"2024-04-24T13:30:46.879595+0000","last_peered":"2024-04-24T13:30:46.879595+0000","last_clean":"2024-04-24T13:30:46.879595+0000","last_became_active":"2024-04-24T13:30:31.268604+0000","last_became_peered":"2024-04-24T13:30:31.268604+0000","last_unstale":"2024-04-24T13:30:46.879595+0000","last_undegraded":"2024-04-24T13:30:46.879595+0000","last_fullsized":"2024-04-24T13:30:46.879595+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:57.047113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094993+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:30:46.094993+0000","last_peered":"2024-04-24T13:30:46.094993+0000","last_clean":"2024-04-24T13:30:46.094993+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:30:46.094993+0000","last_undegraded":"2024-04-24T13:30:46.094993+0000","last_fullsized":"2024-04-24T13:30:46.094993+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418080+0000","last_change":"2024-04-24T13:30:21.233733+0000","last_active":"2024-04-24T13:30:47.418080+0000","last_peered":"2024-04-24T13:30:47.418080+0000","last_clean":"2024-04-24T13:30:47.418080+0000","last_became_active":"2024-04-24T13:30:21.221797+0000","last_became_peered":"2024-04-24T13:30:21.221797+0000","last_unstale":"2024-04-24T13:30:47.418080+0000","last_undegraded":"2024-04-24T13:30:47.418080+0000","last_fullsized":"2024-04-24T13:30:47.418080+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319077+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:30:46.319077+0000","last_peered":"2024-04-24T13:30:46.319077+0000","last_clean":"2024-04-24T13:30:46.319077+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:30:46.319077+0000","last_undegraded":"2024-04-24T13:30:46.319077+0000","last_fullsized":"2024-04-24T13:30:46.319077+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":55,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.863722+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:30:45.863722+0000","last_peered":"2024-04-24T13:30:45.863722+0000","last_clean":"2024-04-24T13:30:45.863722+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:30:45.863722+0000","last_undegraded":"2024-04-24T13:30:45.863722+0000","last_fullsized":"2024-04-24T13:30:45.863722+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":32,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.860935+0000","last_change":"2024-04-24T13:30:29.259692+0000","last_active":"2024-04-24T13:30:45.860935+0000","last_peered":"2024-04-24T13:30:45.860935+0000","last_clean":"2024-04-24T13:30:45.860935+0000","last_became_active":"2024-04-24T13:30:29.258945+0000","last_became_peered":"2024-04-24T13:30:29.258945+0000","last_unstale":"2024-04-24T13:30:45.860935+0000","last_undegraded":"2024-04-24T13:30:45.860935+0000","last_fullsized":"2024-04-24T13:30:45.860935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:35.346937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319874+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:30:46.319874+0000","last_peered":"2024-04-24T13:30:46.319874+0000","last_clean":"2024-04-24T13:30:46.319874+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:30:46.319874+0000","last_undegraded":"2024-04-24T13:30:46.319874+0000","last_fullsized":"2024-04-24T13:30:46.319874+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094992+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:30:46.094992+0000","last_peered":"2024-04-24T13:30:46.094992+0000","last_clean":"2024-04-24T13:30:46.094992+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:30:46.094992+0000","last_undegraded":"2024-04-24T13:30:46.094992+0000","last_fullsized":"2024-04-24T13:30:46.094992+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092118+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:30:46.092118+0000","last_peered":"2024-04-24T13:30:46.092118+0000","last_clean":"2024-04-24T13:30:46.092118+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:30:46.092118+0000","last_undegraded":"2024-04-24T13:30:46.092118+0000","last_fullsized":"2024-04-24T13:30:46.092118+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878800+0000","last_change":"2024-04-24T13:30:25.223759+0000","last_active":"2024-04-24T13:30:46.878800+0000","last_peered":"2024-04-24T13:30:46.878800+0000","last_clean":"2024-04-24T13:30:46.878800+0000","last_became_active":"2024-04-24T13:30:25.222877+0000","last_became_peered":"2024-04-24T13:30:25.222877+0000","last_unstale":"2024-04-24T13:30:46.878800+0000","last_undegraded":"2024-04-24T13:30:46.878800+0000","last_fullsized":"2024-04-24T13:30:46.878800+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":49,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881557+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:30:46.881557+0000","last_peered":"2024-04-24T13:30:46.881557+0000","last_clean":"2024-04-24T13:30:46.881557+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:30:46.881557+0000","last_undegraded":"2024-04-24T13:30:46.881557+0000","last_fullsized":"2024-04-24T13:30:46.881557+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418323+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:30:47.418323+0000","last_peered":"2024-04-24T13:30:47.418323+0000","last_clean":"2024-04-24T13:30:47.418323+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:30:47.418323+0000","last_undegraded":"2024-04-24T13:30:47.418323+0000","last_fullsized":"2024-04-24T13:30:47.418323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093286+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:30:46.093286+0000","last_peered":"2024-04-24T13:30:46.093286+0000","last_clean":"2024-04-24T13:30:46.093286+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:30:46.093286+0000","last_undegraded":"2024-04-24T13:30:46.093286+0000","last_fullsized":"2024-04-24T13:30:46.093286+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321261+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:30:46.321261+0000","last_peered":"2024-04-24T13:30:46.321261+0000","last_clean":"2024-04-24T13:30:46.321261+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:30:46.321261+0000","last_undegraded":"2024-04-24T13:30:46.321261+0000","last_fullsized":"2024-04-24T13:30:46.321261+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880083+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:30:46.880083+0000","last_peered":"2024-04-24T13:30:46.880083+0000","last_clean":"2024-04-24T13:30:46.880083+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:30:46.880083+0000","last_undegraded":"2024-04-24T13:30:46.880083+0000","last_fullsized":"2024-04-24T13:30:46.880083+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094708+0000","last_change":"2024-04-24T13:30:25.224875+0000","last_active":"2024-04-24T13:30:46.094708+0000","last_peered":"2024-04-24T13:30:46.094708+0000","last_clean":"2024-04-24T13:30:46.094708+0000","last_became_active":"2024-04-24T13:30:25.224128+0000","last_became_peered":"2024-04-24T13:30:25.224128+0000","last_unstale":"2024-04-24T13:30:46.094708+0000","last_undegraded":"2024-04-24T13:30:46.094708+0000","last_fullsized":"2024-04-24T13:30:46.094708+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":61,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878773+0000","last_change":"2024-04-24T13:30:27.261440+0000","last_active":"2024-04-24T13:30:46.878773+0000","last_peered":"2024-04-24T13:30:46.878773+0000","last_clean":"2024-04-24T13:30:46.878773+0000","last_became_active":"2024-04-24T13:30:27.260655+0000","last_became_peered":"2024-04-24T13:30:27.260655+0000","last_unstale":"2024-04-24T13:30:46.878773+0000","last_undegraded":"2024-04-24T13:30:46.878773+0000","last_fullsized":"2024-04-24T13:30:46.878773+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417819+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:30:47.417819+0000","last_peered":"2024-04-24T13:30:47.417819+0000","last_clean":"2024-04-24T13:30:47.417819+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:30:47.417819+0000","last_undegraded":"2024-04-24T13:30:47.417819+0000","last_fullsized":"2024-04-24T13:30:47.417819+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319790+0000","last_change":"2024-04-24T13:30:31.264695+0000","last_active":"2024-04-24T13:30:46.319790+0000","last_peered":"2024-04-24T13:30:46.319790+0000","last_clean":"2024-04-24T13:30:46.319790+0000","last_became_active":"2024-04-24T13:30:31.263950+0000","last_became_peered":"2024-04-24T13:30:31.263950+0000","last_unstale":"2024-04-24T13:30:46.319790+0000","last_undegraded":"2024-04-24T13:30:46.319790+0000","last_fullsized":"2024-04-24T13:30:46.319790+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:18.381332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418484+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:30:47.418484+0000","last_peered":"2024-04-24T13:30:47.418484+0000","last_clean":"2024-04-24T13:30:47.418484+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:30:47.418484+0000","last_undegraded":"2024-04-24T13:30:47.418484+0000","last_fullsized":"2024-04-24T13:30:47.418484+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":205,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321048+0000","last_change":"2024-04-24T13:30:08.802517+0000","last_active":"2024-04-24T13:30:46.321048+0000","last_peered":"2024-04-24T13:30:46.321048+0000","last_clean":"2024-04-24T13:30:46.321048+0000","last_became_active":"2024-04-24T13:30:08.800555+0000","last_became_peered":"2024-04-24T13:30:08.800555+0000","last_unstale":"2024-04-24T13:30:46.321048+0000","last_undegraded":"2024-04-24T13:30:46.321048+0000","last_fullsized":"2024-04-24T13:30:46.321048+0000","mapping_epoch":14,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":15,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:06.125070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879101+0000","last_change":"2024-04-24T13:30:15.154142+0000","last_active":"2024-04-24T13:30:46.879101+0000","last_peered":"2024-04-24T13:30:46.879101+0000","last_clean":"2024-04-24T13:30:46.879101+0000","last_became_active":"2024-04-24T13:30:15.153433+0000","last_became_peered":"2024-04-24T13:30:15.153433+0000","last_unstale":"2024-04-24T13:30:46.879101+0000","last_undegraded":"2024-04-24T13:30:46.879101+0000","last_fullsized":"2024-04-24T13:30:46.879101+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880813+0000","last_change":"2024-04-24T13:30:21.229655+0000","last_active":"2024-04-24T13:30:46.880813+0000","last_peered":"2024-04-24T13:30:46.880813+0000","last_clean":"2024-04-24T13:30:46.880813+0000","last_became_active":"2024-04-24T13:30:21.229312+0000","last_became_peered":"2024-04-24T13:30:21.229312+0000","last_unstale":"2024-04-24T13:30:46.880813+0000","last_undegraded":"2024-04-24T13:30:46.880813+0000","last_fullsized":"2024-04-24T13:30:46.880813+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320517+0000","last_change":"2024-04-24T13:30:25.238663+0000","last_active":"2024-04-24T13:30:46.320517+0000","last_peered":"2024-04-24T13:30:46.320517+0000","last_clean":"2024-04-24T13:30:46.320517+0000","last_became_active":"2024-04-24T13:30:25.237978+0000","last_became_peered":"2024-04-24T13:30:25.237978+0000","last_unstale":"2024-04-24T13:30:46.320517+0000","last_undegraded":"2024-04-24T13:30:46.320517+0000","last_fullsized":"2024-04-24T13:30:46.320517+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:02.798146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":60,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878850+0000","last_change":"2024-04-24T13:30:27.258347+0000","last_active":"2024-04-24T13:30:46.878850+0000","last_peered":"2024-04-24T13:30:46.878850+0000","last_clean":"2024-04-24T13:30:46.878850+0000","last_became_active":"2024-04-24T13:30:27.257694+0000","last_became_peered":"2024-04-24T13:30:27.257694+0000","last_unstale":"2024-04-24T13:30:46.878850+0000","last_undegraded":"2024-04-24T13:30:46.878850+0000","last_fullsized":"2024-04-24T13:30:46.878850+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058483+0000","last_change":"2024-04-24T13:30:29.280834+0000","last_active":"2024-04-24T13:30:46.058483+0000","last_peered":"2024-04-24T13:30:46.058483+0000","last_clean":"2024-04-24T13:30:46.058483+0000","last_became_active":"2024-04-24T13:30:29.280212+0000","last_became_peered":"2024-04-24T13:30:29.280212+0000","last_unstale":"2024-04-24T13:30:46.058483+0000","last_undegraded":"2024-04-24T13:30:46.058483+0000","last_fullsized":"2024-04-24T13:30:46.058483+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417183+0000","last_change":"2024-04-24T13:30:31.272077+0000","last_active":"2024-04-24T13:30:47.417183+0000","last_peered":"2024-04-24T13:30:47.417183+0000","last_clean":"2024-04-24T13:30:47.417183+0000","last_became_active":"2024-04-24T13:30:31.271268+0000","last_became_peered":"2024-04-24T13:30:31.271268+0000","last_unstale":"2024-04-24T13:30:47.417183+0000","last_undegraded":"2024-04-24T13:30:47.417183+0000","last_fullsized":"2024-04-24T13:30:47.417183+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:33.796332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058768+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:30:46.058768+0000","last_peered":"2024-04-24T13:30:46.058768+0000","last_clean":"2024-04-24T13:30:46.058768+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:30:46.058768+0000","last_undegraded":"2024-04-24T13:30:46.058768+0000","last_fullsized":"2024-04-24T13:30:46.058768+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320236+0000","last_change":"2024-04-24T13:30:15.156142+0000","last_active":"2024-04-24T13:30:46.320236+0000","last_peered":"2024-04-24T13:30:46.320236+0000","last_clean":"2024-04-24T13:30:46.320236+0000","last_became_active":"2024-04-24T13:30:15.155326+0000","last_became_peered":"2024-04-24T13:30:15.155326+0000","last_unstale":"2024-04-24T13:30:46.320236+0000","last_undegraded":"2024-04-24T13:30:46.320236+0000","last_fullsized":"2024-04-24T13:30:46.320236+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:52.140457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058065+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:30:46.058065+0000","last_peered":"2024-04-24T13:30:46.058065+0000","last_clean":"2024-04-24T13:30:46.058065+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:30:46.058065+0000","last_undegraded":"2024-04-24T13:30:46.058065+0000","last_fullsized":"2024-04-24T13:30:46.058065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879174+0000","last_change":"2024-04-24T13:30:25.232972+0000","last_active":"2024-04-24T13:30:46.879174+0000","last_peered":"2024-04-24T13:30:46.879174+0000","last_clean":"2024-04-24T13:30:46.879174+0000","last_became_active":"2024-04-24T13:30:25.232265+0000","last_became_peered":"2024-04-24T13:30:25.232265+0000","last_unstale":"2024-04-24T13:30:46.879174+0000","last_undegraded":"2024-04-24T13:30:46.879174+0000","last_fullsized":"2024-04-24T13:30:46.879174+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:47.489762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":76,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.318967+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:30:46.318967+0000","last_peered":"2024-04-24T13:30:46.318967+0000","last_clean":"2024-04-24T13:30:46.318967+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:30:46.318967+0000","last_undegraded":"2024-04-24T13:30:46.318967+0000","last_fullsized":"2024-04-24T13:30:46.318967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321456+0000","last_change":"2024-04-24T13:30:29.275359+0000","last_active":"2024-04-24T13:30:46.321456+0000","last_peered":"2024-04-24T13:30:46.321456+0000","last_clean":"2024-04-24T13:30:46.321456+0000","last_became_active":"2024-04-24T13:30:29.274589+0000","last_became_peered":"2024-04-24T13:30:29.274589+0000","last_unstale":"2024-04-24T13:30:46.321456+0000","last_undegraded":"2024-04-24T13:30:46.321456+0000","last_fullsized":"2024-04-24T13:30:46.321456+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319087+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:30:46.319087+0000","last_peered":"2024-04-24T13:30:46.319087+0000","last_clean":"2024-04-24T13:30:46.319087+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:30:46.319087+0000","last_undegraded":"2024-04-24T13:30:46.319087+0000","last_fullsized":"2024-04-24T13:30:46.319087+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321352+0000","last_change":"2024-04-24T13:30:23.217937+0000","last_active":"2024-04-24T13:30:46.321352+0000","last_peered":"2024-04-24T13:30:46.321352+0000","last_clean":"2024-04-24T13:30:46.321352+0000","last_became_active":"2024-04-24T13:30:23.217577+0000","last_became_peered":"2024-04-24T13:30:23.217577+0000","last_unstale":"2024-04-24T13:30:46.321352+0000","last_undegraded":"2024-04-24T13:30:46.321352+0000","last_fullsized":"2024-04-24T13:30:46.321352+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":48,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.861618+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:30:45.861618+0000","last_peered":"2024-04-24T13:30:45.861618+0000","last_clean":"2024-04-24T13:30:45.861618+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:30:45.861618+0000","last_undegraded":"2024-04-24T13:30:45.861618+0000","last_fullsized":"2024-04-24T13:30:45.861618+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.318729+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:30:46.318729+0000","last_peered":"2024-04-24T13:30:46.318729+0000","last_clean":"2024-04-24T13:30:46.318729+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:30:46.318729+0000","last_undegraded":"2024-04-24T13:30:46.318729+0000","last_fullsized":"2024-04-24T13:30:46.318729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.863611+0000","last_change":"2024-04-24T13:30:25.229114+0000","last_active":"2024-04-24T13:30:45.863611+0000","last_peered":"2024-04-24T13:30:45.863611+0000","last_clean":"2024-04-24T13:30:45.863611+0000","last_became_active":"2024-04-24T13:30:25.228634+0000","last_became_peered":"2024-04-24T13:30:25.228634+0000","last_unstale":"2024-04-24T13:30:45.863611+0000","last_undegraded":"2024-04-24T13:30:45.863611+0000","last_fullsized":"2024-04-24T13:30:45.863611+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:13.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"32'15","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321994+0000","last_change":"2024-04-24T13:30:27.255646+0000","last_active":"2024-04-24T13:30:46.321994+0000","last_peered":"2024-04-24T13:30:46.321994+0000","last_clean":"2024-04-24T13:30:46.321994+0000","last_became_active":"2024-04-24T13:30:27.254389+0000","last_became_peered":"2024-04-24T13:30:27.254389+0000","last_unstale":"2024-04-24T13:30:46.321994+0000","last_undegraded":"2024-04-24T13:30:46.321994+0000","last_fullsized":"2024-04-24T13:30:46.321994+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057724+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:30:46.057724+0000","last_peered":"2024-04-24T13:30:46.057724+0000","last_clean":"2024-04-24T13:30:46.057724+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:30:46.057724+0000","last_undegraded":"2024-04-24T13:30:46.057724+0000","last_fullsized":"2024-04-24T13:30:46.057724+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881246+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:30:46.881246+0000","last_peered":"2024-04-24T13:30:46.881246+0000","last_clean":"2024-04-24T13:30:46.881246+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:30:46.881246+0000","last_undegraded":"2024-04-24T13:30:46.881246+0000","last_fullsized":"2024-04-24T13:30:46.881246+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319264+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:30:46.319264+0000","last_peered":"2024-04-24T13:30:46.319264+0000","last_clean":"2024-04-24T13:30:46.319264+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:30:46.319264+0000","last_undegraded":"2024-04-24T13:30:46.319264+0000","last_fullsized":"2024-04-24T13:30:46.319264+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":51,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878964+0000","last_change":"2024-04-24T13:30:15.151799+0000","last_active":"2024-04-24T13:30:46.878964+0000","last_peered":"2024-04-24T13:30:46.878964+0000","last_clean":"2024-04-24T13:30:46.878964+0000","last_became_active":"2024-04-24T13:30:15.150672+0000","last_became_peered":"2024-04-24T13:30:15.150672+0000","last_unstale":"2024-04-24T13:30:46.878964+0000","last_undegraded":"2024-04-24T13:30:46.878964+0000","last_fullsized":"2024-04-24T13:30:46.878964+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093780+0000","last_change":"2024-04-24T13:30:21.222734+0000","last_active":"2024-04-24T13:30:46.093780+0000","last_peered":"2024-04-24T13:30:46.093780+0000","last_clean":"2024-04-24T13:30:46.093780+0000","last_became_active":"2024-04-24T13:30:21.220992+0000","last_became_peered":"2024-04-24T13:30:21.220992+0000","last_unstale":"2024-04-24T13:30:46.093780+0000","last_undegraded":"2024-04-24T13:30:46.093780+0000","last_fullsized":"2024-04-24T13:30:46.093780+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:54:05.637090+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058129+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:30:46.058129+0000","last_peered":"2024-04-24T13:30:46.058129+0000","last_clean":"2024-04-24T13:30:46.058129+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:30:46.058129+0000","last_undegraded":"2024-04-24T13:30:46.058129+0000","last_fullsized":"2024-04-24T13:30:46.058129+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":52,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882239+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:30:46.882239+0000","last_peered":"2024-04-24T13:30:46.882239+0000","last_clean":"2024-04-24T13:30:46.882239+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:30:46.882239+0000","last_undegraded":"2024-04-24T13:30:46.882239+0000","last_fullsized":"2024-04-24T13:30:46.882239+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.419118+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:30:47.419118+0000","last_peered":"2024-04-24T13:30:47.419118+0000","last_clean":"2024-04-24T13:30:47.419118+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:30:47.419118+0000","last_undegraded":"2024-04-24T13:30:47.419118+0000","last_fullsized":"2024-04-24T13:30:47.419118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878090+0000","last_change":"2024-04-24T13:30:31.267157+0000","last_active":"2024-04-24T13:30:46.878090+0000","last_peered":"2024-04-24T13:30:46.878090+0000","last_clean":"2024-04-24T13:30:46.878090+0000","last_became_active":"2024-04-24T13:30:31.266348+0000","last_became_peered":"2024-04-24T13:30:31.266348+0000","last_unstale":"2024-04-24T13:30:46.878090+0000","last_undegraded":"2024-04-24T13:30:46.878090+0000","last_fullsized":"2024-04-24T13:30:46.878090+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:31.837696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320026+0000","last_change":"2024-04-24T13:30:23.218086+0000","last_active":"2024-04-24T13:30:46.320026+0000","last_peered":"2024-04-24T13:30:46.320026+0000","last_clean":"2024-04-24T13:30:46.320026+0000","last_became_active":"2024-04-24T13:30:23.217750+0000","last_became_peered":"2024-04-24T13:30:23.217750+0000","last_unstale":"2024-04-24T13:30:46.320026+0000","last_undegraded":"2024-04-24T13:30:46.320026+0000","last_fullsized":"2024-04-24T13:30:46.320026+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880909+0000","last_change":"2024-04-24T13:30:21.214846+0000","last_active":"2024-04-24T13:30:46.880909+0000","last_peered":"2024-04-24T13:30:46.880909+0000","last_clean":"2024-04-24T13:30:46.880909+0000","last_became_active":"2024-04-24T13:30:21.214127+0000","last_became_peered":"2024-04-24T13:30:21.214127+0000","last_unstale":"2024-04-24T13:30:46.880909+0000","last_undegraded":"2024-04-24T13:30:46.880909+0000","last_fullsized":"2024-04-24T13:30:46.880909+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:02.477283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320339+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:30:46.320339+0000","last_peered":"2024-04-24T13:30:46.320339+0000","last_clean":"2024-04-24T13:30:46.320339+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:30:46.320339+0000","last_undegraded":"2024-04-24T13:30:46.320339+0000","last_fullsized":"2024-04-24T13:30:46.320339+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058165+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:30:46.058165+0000","last_peered":"2024-04-24T13:30:46.058165+0000","last_clean":"2024-04-24T13:30:46.058165+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:30:46.058165+0000","last_undegraded":"2024-04-24T13:30:46.058165+0000","last_fullsized":"2024-04-24T13:30:46.058165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":62,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057255+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:30:46.057255+0000","last_peered":"2024-04-24T13:30:46.057255+0000","last_clean":"2024-04-24T13:30:46.057255+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:30:46.057255+0000","last_undegraded":"2024-04-24T13:30:46.057255+0000","last_fullsized":"2024-04-24T13:30:46.057255+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092524+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:30:46.092524+0000","last_peered":"2024-04-24T13:30:46.092524+0000","last_clean":"2024-04-24T13:30:46.092524+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:30:46.092524+0000","last_undegraded":"2024-04-24T13:30:46.092524+0000","last_fullsized":"2024-04-24T13:30:46.092524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058165+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:30:46.058165+0000","last_peered":"2024-04-24T13:30:46.058165+0000","last_clean":"2024-04-24T13:30:46.058165+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:30:46.058165+0000","last_undegraded":"2024-04-24T13:30:46.058165+0000","last_fullsized":"2024-04-24T13:30:46.058165+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058480+0000","last_change":"2024-04-24T13:30:23.220277+0000","last_active":"2024-04-24T13:30:46.058480+0000","last_peered":"2024-04-24T13:30:46.058480+0000","last_clean":"2024-04-24T13:30:46.058480+0000","last_became_active":"2024-04-24T13:30:23.219932+0000","last_became_peered":"2024-04-24T13:30:23.219932+0000","last_unstale":"2024-04-24T13:30:46.058480+0000","last_undegraded":"2024-04-24T13:30:46.058480+0000","last_fullsized":"2024-04-24T13:30:46.058480+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319363+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:30:46.319363+0000","last_peered":"2024-04-24T13:30:46.319363+0000","last_clean":"2024-04-24T13:30:46.319363+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:30:46.319363+0000","last_undegraded":"2024-04-24T13:30:46.319363+0000","last_fullsized":"2024-04-24T13:30:46.319363+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.322736+0000","last_change":"2024-04-24T13:30:16.059514+0000","last_active":"2024-04-24T13:30:46.322736+0000","last_peered":"2024-04-24T13:30:46.322736+0000","last_clean":"2024-04-24T13:30:46.322736+0000","last_became_active":"2024-04-24T13:30:16.058864+0000","last_became_peered":"2024-04-24T13:30:16.058864+0000","last_unstale":"2024-04-24T13:30:46.322736+0000","last_undegraded":"2024-04-24T13:30:46.322736+0000","last_fullsized":"2024-04-24T13:30:46.322736+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:43.235155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417848+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:30:47.417848+0000","last_peered":"2024-04-24T13:30:47.417848+0000","last_clean":"2024-04-24T13:30:47.417848+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:30:47.417848+0000","last_undegraded":"2024-04-24T13:30:47.417848+0000","last_fullsized":"2024-04-24T13:30:47.417848+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":52,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319208+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:30:46.319208+0000","last_peered":"2024-04-24T13:30:46.319208+0000","last_clean":"2024-04-24T13:30:46.319208+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:30:46.319208+0000","last_undegraded":"2024-04-24T13:30:46.319208+0000","last_fullsized":"2024-04-24T13:30:46.319208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":35,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878274+0000","last_change":"2024-04-24T13:30:29.257969+0000","last_active":"2024-04-24T13:30:46.878274+0000","last_peered":"2024-04-24T13:30:46.878274+0000","last_clean":"2024-04-24T13:30:46.878274+0000","last_became_active":"2024-04-24T13:30:29.257131+0000","last_became_peered":"2024-04-24T13:30:29.257131+0000","last_unstale":"2024-04-24T13:30:46.878274+0000","last_undegraded":"2024-04-24T13:30:46.878274+0000","last_fullsized":"2024-04-24T13:30:46.878274+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882657+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:30:46.882657+0000","last_peered":"2024-04-24T13:30:46.882657+0000","last_clean":"2024-04-24T13:30:46.882657+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:30:46.882657+0000","last_undegraded":"2024-04-24T13:30:46.882657+0000","last_fullsized":"2024-04-24T13:30:46.882657+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880137+0000","last_change":"2024-04-24T13:30:23.249852+0000","last_active":"2024-04-24T13:30:46.880137+0000","last_peered":"2024-04-24T13:30:46.880137+0000","last_clean":"2024-04-24T13:30:46.880137+0000","last_became_active":"2024-04-24T13:30:23.249522+0000","last_became_peered":"2024-04-24T13:30:23.249522+0000","last_unstale":"2024-04-24T13:30:46.880137+0000","last_undegraded":"2024-04-24T13:30:46.880137+0000","last_fullsized":"2024-04-24T13:30:46.880137+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882311+0000","last_change":"2024-04-24T13:30:21.238933+0000","last_active":"2024-04-24T13:30:46.882311+0000","last_peered":"2024-04-24T13:30:46.882311+0000","last_clean":"2024-04-24T13:30:46.882311+0000","last_became_active":"2024-04-24T13:30:21.238648+0000","last_became_peered":"2024-04-24T13:30:21.238648+0000","last_unstale":"2024-04-24T13:30:46.882311+0000","last_undegraded":"2024-04-24T13:30:46.882311+0000","last_fullsized":"2024-04-24T13:30:46.882311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":49,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321268+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:30:46.321268+0000","last_peered":"2024-04-24T13:30:46.321268+0000","last_clean":"2024-04-24T13:30:46.321268+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:30:46.321268+0000","last_undegraded":"2024-04-24T13:30:46.321268+0000","last_fullsized":"2024-04-24T13:30:46.321268+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092789+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:30:46.092789+0000","last_peered":"2024-04-24T13:30:46.092789+0000","last_clean":"2024-04-24T13:30:46.092789+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:30:46.092789+0000","last_undegraded":"2024-04-24T13:30:46.092789+0000","last_fullsized":"2024-04-24T13:30:46.092789+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093510+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:30:46.093510+0000","last_peered":"2024-04-24T13:30:46.093510+0000","last_clean":"2024-04-24T13:30:46.093510+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:30:46.093510+0000","last_undegraded":"2024-04-24T13:30:46.093510+0000","last_fullsized":"2024-04-24T13:30:46.093510+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881920+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:30:46.881920+0000","last_peered":"2024-04-24T13:30:46.881920+0000","last_clean":"2024-04-24T13:30:46.881920+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:30:46.881920+0000","last_undegraded":"2024-04-24T13:30:46.881920+0000","last_fullsized":"2024-04-24T13:30:46.881920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057796+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:30:46.057796+0000","last_peered":"2024-04-24T13:30:46.057796+0000","last_clean":"2024-04-24T13:30:46.057796+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:30:46.057796+0000","last_undegraded":"2024-04-24T13:30:46.057796+0000","last_fullsized":"2024-04-24T13:30:46.057796+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093096+0000","last_change":"2024-04-24T13:30:23.219012+0000","last_active":"2024-04-24T13:30:46.093096+0000","last_peered":"2024-04-24T13:30:46.093096+0000","last_clean":"2024-04-24T13:30:46.093096+0000","last_became_active":"2024-04-24T13:30:23.218312+0000","last_became_peered":"2024-04-24T13:30:23.218312+0000","last_unstale":"2024-04-24T13:30:46.093096+0000","last_undegraded":"2024-04-24T13:30:46.093096+0000","last_fullsized":"2024-04-24T13:30:46.093096+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058814+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:30:46.058814+0000","last_peered":"2024-04-24T13:30:46.058814+0000","last_clean":"2024-04-24T13:30:46.058814+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:30:46.058814+0000","last_undegraded":"2024-04-24T13:30:46.058814+0000","last_fullsized":"2024-04-24T13:30:46.058814+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":50,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.419332+0000","last_change":"2024-04-24T13:30:15.161378+0000","last_active":"2024-04-24T13:30:47.419332+0000","last_peered":"2024-04-24T13:30:47.419332+0000","last_clean":"2024-04-24T13:30:47.419332+0000","last_became_active":"2024-04-24T13:30:15.160775+0000","last_became_peered":"2024-04-24T13:30:15.160775+0000","last_unstale":"2024-04-24T13:30:47.419332+0000","last_undegraded":"2024-04-24T13:30:47.419332+0000","last_fullsized":"2024-04-24T13:30:47.419332+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879807+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:30:46.879807+0000","last_peered":"2024-04-24T13:30:46.879807+0000","last_clean":"2024-04-24T13:30:46.879807+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:30:46.879807+0000","last_undegraded":"2024-04-24T13:30:46.879807+0000","last_fullsized":"2024-04-24T13:30:46.879807+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":67,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319869+0000","last_change":"2024-04-24T13:30:27.251349+0000","last_active":"2024-04-24T13:30:46.319869+0000","last_peered":"2024-04-24T13:30:46.319869+0000","last_clean":"2024-04-24T13:30:46.319869+0000","last_became_active":"2024-04-24T13:30:27.250525+0000","last_became_peered":"2024-04-24T13:30:27.250525+0000","last_unstale":"2024-04-24T13:30:46.319869+0000","last_undegraded":"2024-04-24T13:30:46.319869+0000","last_fullsized":"2024-04-24T13:30:46.319869+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":39,"num_read_kb":25,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880502+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:30:46.880502+0000","last_peered":"2024-04-24T13:30:46.880502+0000","last_clean":"2024-04-24T13:30:46.880502+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:30:46.880502+0000","last_undegraded":"2024-04-24T13:30:46.880502+0000","last_fullsized":"2024-04-24T13:30:46.880502+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878617+0000","last_change":"2024-04-24T13:30:31.277358+0000","last_active":"2024-04-24T13:30:46.878617+0000","last_peered":"2024-04-24T13:30:46.878617+0000","last_clean":"2024-04-24T13:30:46.878617+0000","last_became_active":"2024-04-24T13:30:31.276606+0000","last_became_peered":"2024-04-24T13:30:31.276606+0000","last_unstale":"2024-04-24T13:30:46.878617+0000","last_undegraded":"2024-04-24T13:30:46.878617+0000","last_fullsized":"2024-04-24T13:30:46.878617+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058221+0000","last_change":"2024-04-24T13:30:31.264343+0000","last_active":"2024-04-24T13:30:46.058221+0000","last_peered":"2024-04-24T13:30:46.058221+0000","last_clean":"2024-04-24T13:30:46.058221+0000","last_became_active":"2024-04-24T13:30:31.263640+0000","last_became_peered":"2024-04-24T13:30:31.263640+0000","last_unstale":"2024-04-24T13:30:46.058221+0000","last_undegraded":"2024-04-24T13:30:46.058221+0000","last_fullsized":"2024-04-24T13:30:46.058221+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:51:45.241537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093436+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:30:46.093436+0000","last_peered":"2024-04-24T13:30:46.093436+0000","last_clean":"2024-04-24T13:30:46.093436+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:30:46.093436+0000","last_undegraded":"2024-04-24T13:30:46.093436+0000","last_fullsized":"2024-04-24T13:30:46.093436+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093975+0000","last_change":"2024-04-24T13:30:21.252985+0000","last_active":"2024-04-24T13:30:46.093975+0000","last_peered":"2024-04-24T13:30:46.093975+0000","last_clean":"2024-04-24T13:30:46.093975+0000","last_became_active":"2024-04-24T13:30:21.252417+0000","last_became_peered":"2024-04-24T13:30:21.252417+0000","last_unstale":"2024-04-24T13:30:46.093975+0000","last_undegraded":"2024-04-24T13:30:46.093975+0000","last_fullsized":"2024-04-24T13:30:46.093975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,7],"acting":[4,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":37,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320272+0000","last_change":"2024-04-24T13:30:25.228158+0000","last_active":"2024-04-24T13:30:46.320272+0000","last_peered":"2024-04-24T13:30:46.320272+0000","last_clean":"2024-04-24T13:30:46.320272+0000","last_became_active":"2024-04-24T13:30:25.226828+0000","last_became_peered":"2024-04-24T13:30:25.226828+0000","last_unstale":"2024-04-24T13:30:46.320272+0000","last_undegraded":"2024-04-24T13:30:46.320272+0000","last_fullsized":"2024-04-24T13:30:46.320272+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:11.608677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879910+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:30:46.879910+0000","last_peered":"2024-04-24T13:30:46.879910+0000","last_clean":"2024-04-24T13:30:46.879910+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:30:46.879910+0000","last_undegraded":"2024-04-24T13:30:46.879910+0000","last_fullsized":"2024-04-24T13:30:46.879910+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879642+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:30:46.879642+0000","last_peered":"2024-04-24T13:30:46.879642+0000","last_clean":"2024-04-24T13:30:46.879642+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:30:46.879642+0000","last_undegraded":"2024-04-24T13:30:46.879642+0000","last_fullsized":"2024-04-24T13:30:46.879642+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881847+0000","last_change":"2024-04-24T13:30:31.265871+0000","last_active":"2024-04-24T13:30:46.881847+0000","last_peered":"2024-04-24T13:30:46.881847+0000","last_clean":"2024-04-24T13:30:46.881847+0000","last_became_active":"2024-04-24T13:30:31.265184+0000","last_became_peered":"2024-04-24T13:30:31.265184+0000","last_unstale":"2024-04-24T13:30:46.881847+0000","last_undegraded":"2024-04-24T13:30:46.881847+0000","last_fullsized":"2024-04-24T13:30:46.881847+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:22.937959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319785+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:30:46.319785+0000","last_peered":"2024-04-24T13:30:46.319785+0000","last_clean":"2024-04-24T13:30:46.319785+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:30:46.319785+0000","last_undegraded":"2024-04-24T13:30:46.319785+0000","last_fullsized":"2024-04-24T13:30:46.319785+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.322365+0000","last_change":"2024-04-24T13:30:21.247573+0000","last_active":"2024-04-24T13:30:46.322365+0000","last_peered":"2024-04-24T13:30:46.322365+0000","last_clean":"2024-04-24T13:30:46.322365+0000","last_became_active":"2024-04-24T13:30:21.246433+0000","last_became_peered":"2024-04-24T13:30:21.246433+0000","last_unstale":"2024-04-24T13:30:46.322365+0000","last_undegraded":"2024-04-24T13:30:46.322365+0000","last_fullsized":"2024-04-24T13:30:46.322365+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881255+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:30:46.881255+0000","last_peered":"2024-04-24T13:30:46.881255+0000","last_clean":"2024-04-24T13:30:46.881255+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:30:46.881255+0000","last_undegraded":"2024-04-24T13:30:46.881255+0000","last_fullsized":"2024-04-24T13:30:46.881255+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"32'4","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057192+0000","last_change":"2024-04-24T13:30:27.260167+0000","last_active":"2024-04-24T13:30:46.057192+0000","last_peered":"2024-04-24T13:30:46.057192+0000","last_clean":"2024-04-24T13:30:46.057192+0000","last_became_active":"2024-04-24T13:30:27.259644+0000","last_became_peered":"2024-04-24T13:30:27.259644+0000","last_unstale":"2024-04-24T13:30:46.057192+0000","last_undegraded":"2024-04-24T13:30:46.057192+0000","last_fullsized":"2024-04-24T13:30:46.057192+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:21.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320505+0000","last_change":"2024-04-24T13:30:29.273787+0000","last_active":"2024-04-24T13:30:46.320505+0000","last_peered":"2024-04-24T13:30:46.320505+0000","last_clean":"2024-04-24T13:30:46.320505+0000","last_became_active":"2024-04-24T13:30:29.273151+0000","last_became_peered":"2024-04-24T13:30:29.273151+0000","last_unstale":"2024-04-24T13:30:46.320505+0000","last_undegraded":"2024-04-24T13:30:46.320505+0000","last_fullsized":"2024-04-24T13:30:46.320505+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:23.009033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":22,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058029+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:30:46.058029+0000","last_peered":"2024-04-24T13:30:46.058029+0000","last_clean":"2024-04-24T13:30:46.058029+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:30:46.058029+0000","last_undegraded":"2024-04-24T13:30:46.058029+0000","last_fullsized":"2024-04-24T13:30:46.058029+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881146+0000","last_change":"2024-04-24T13:30:23.246371+0000","last_active":"2024-04-24T13:30:46.881146+0000","last_peered":"2024-04-24T13:30:46.881146+0000","last_clean":"2024-04-24T13:30:46.881146+0000","last_became_active":"2024-04-24T13:30:23.246084+0000","last_became_peered":"2024-04-24T13:30:23.246084+0000","last_unstale":"2024-04-24T13:30:46.881146+0000","last_undegraded":"2024-04-24T13:30:46.881146+0000","last_fullsized":"2024-04-24T13:30:46.881146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880762+0000","last_change":"2024-04-24T13:30:21.241794+0000","last_active":"2024-04-24T13:30:46.880762+0000","last_peered":"2024-04-24T13:30:46.880762+0000","last_clean":"2024-04-24T13:30:46.880762+0000","last_became_active":"2024-04-24T13:30:21.241043+0000","last_became_peered":"2024-04-24T13:30:21.241043+0000","last_unstale":"2024-04-24T13:30:46.880762+0000","last_undegraded":"2024-04-24T13:30:46.880762+0000","last_fullsized":"2024-04-24T13:30:46.880762+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:21.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319251+0000","last_change":"2024-04-24T13:30:25.239146+0000","last_active":"2024-04-24T13:30:46.319251+0000","last_peered":"2024-04-24T13:30:46.319251+0000","last_clean":"2024-04-24T13:30:46.319251+0000","last_became_active":"2024-04-24T13:30:25.238359+0000","last_became_peered":"2024-04-24T13:30:25.238359+0000","last_unstale":"2024-04-24T13:30:46.319251+0000","last_undegraded":"2024-04-24T13:30:46.319251+0000","last_fullsized":"2024-04-24T13:30:46.319251+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880960+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:30:46.880960+0000","last_peered":"2024-04-24T13:30:46.880960+0000","last_clean":"2024-04-24T13:30:46.880960+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:30:46.880960+0000","last_undegraded":"2024-04-24T13:30:46.880960+0000","last_fullsized":"2024-04-24T13:30:46.880960+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417767+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:30:47.417767+0000","last_peered":"2024-04-24T13:30:47.417767+0000","last_clean":"2024-04-24T13:30:47.417767+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:30:47.417767+0000","last_undegraded":"2024-04-24T13:30:47.417767+0000","last_fullsized":"2024-04-24T13:30:47.417767+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878475+0000","last_change":"2024-04-24T13:30:31.276150+0000","last_active":"2024-04-24T13:30:46.878475+0000","last_peered":"2024-04-24T13:30:46.878475+0000","last_clean":"2024-04-24T13:30:46.878475+0000","last_became_active":"2024-04-24T13:30:31.275437+0000","last_became_peered":"2024-04-24T13:30:31.275437+0000","last_unstale":"2024-04-24T13:30:46.878475+0000","last_undegraded":"2024-04-24T13:30:46.878475+0000","last_fullsized":"2024-04-24T13:30:46.878475+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879920+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:30:46.879920+0000","last_peered":"2024-04-24T13:30:46.879920+0000","last_clean":"2024-04-24T13:30:46.879920+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:30:46.879920+0000","last_undegraded":"2024-04-24T13:30:46.879920+0000","last_fullsized":"2024-04-24T13:30:46.879920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.059006+0000","last_change":"2024-04-24T13:30:21.229237+0000","last_active":"2024-04-24T13:30:46.059006+0000","last_peered":"2024-04-24T13:30:46.059006+0000","last_clean":"2024-04-24T13:30:46.059006+0000","last_became_active":"2024-04-24T13:30:21.228971+0000","last_became_peered":"2024-04-24T13:30:21.228971+0000","last_unstale":"2024-04-24T13:30:46.059006+0000","last_undegraded":"2024-04-24T13:30:46.059006+0000","last_fullsized":"2024-04-24T13:30:46.059006+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417627+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:30:47.417627+0000","last_peered":"2024-04-24T13:30:47.417627+0000","last_clean":"2024-04-24T13:30:47.417627+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:30:47.417627+0000","last_undegraded":"2024-04-24T13:30:47.417627+0000","last_fullsized":"2024-04-24T13:30:47.417627+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319749+0000","last_change":"2024-04-24T13:30:27.244776+0000","last_active":"2024-04-24T13:30:46.319749+0000","last_peered":"2024-04-24T13:30:46.319749+0000","last_clean":"2024-04-24T13:30:46.319749+0000","last_became_active":"2024-04-24T13:30:27.243967+0000","last_became_peered":"2024-04-24T13:30:27.243967+0000","last_unstale":"2024-04-24T13:30:46.319749+0000","last_undegraded":"2024-04-24T13:30:46.319749+0000","last_fullsized":"2024-04-24T13:30:46.319749+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:20.682651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057833+0000","last_change":"2024-04-24T13:30:29.279248+0000","last_active":"2024-04-24T13:30:46.057833+0000","last_peered":"2024-04-24T13:30:46.057833+0000","last_clean":"2024-04-24T13:30:46.057833+0000","last_became_active":"2024-04-24T13:30:29.278511+0000","last_became_peered":"2024-04-24T13:30:29.278511+0000","last_unstale":"2024-04-24T13:30:46.057833+0000","last_undegraded":"2024-04-24T13:30:46.057833+0000","last_fullsized":"2024-04-24T13:30:46.057833+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417182+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:30:47.417182+0000","last_peered":"2024-04-24T13:30:47.417182+0000","last_clean":"2024-04-24T13:30:47.417182+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:30:47.417182+0000","last_undegraded":"2024-04-24T13:30:47.417182+0000","last_fullsized":"2024-04-24T13:30:47.417182+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880045+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:30:46.880045+0000","last_peered":"2024-04-24T13:30:46.880045+0000","last_clean":"2024-04-24T13:30:46.880045+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:30:46.880045+0000","last_undegraded":"2024-04-24T13:30:46.880045+0000","last_fullsized":"2024-04-24T13:30:46.880045+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":34,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058564+0000","last_change":"2024-04-24T13:30:25.242437+0000","last_active":"2024-04-24T13:30:46.058564+0000","last_peered":"2024-04-24T13:30:46.058564+0000","last_clean":"2024-04-24T13:30:46.058564+0000","last_became_active":"2024-04-24T13:30:25.241948+0000","last_became_peered":"2024-04-24T13:30:25.241948+0000","last_unstale":"2024-04-24T13:30:46.058564+0000","last_undegraded":"2024-04-24T13:30:46.058564+0000","last_fullsized":"2024-04-24T13:30:46.058564+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:57.978574+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":54,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319705+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:30:46.319705+0000","last_peered":"2024-04-24T13:30:46.319705+0000","last_clean":"2024-04-24T13:30:46.319705+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:30:46.319705+0000","last_undegraded":"2024-04-24T13:30:46.319705+0000","last_fullsized":"2024-04-24T13:30:46.319705+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":29,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878613+0000","last_change":"2024-04-24T13:30:29.277963+0000","last_active":"2024-04-24T13:30:46.878613+0000","last_peered":"2024-04-24T13:30:46.878613+0000","last_clean":"2024-04-24T13:30:46.878613+0000","last_became_active":"2024-04-24T13:30:29.277170+0000","last_became_peered":"2024-04-24T13:30:29.277170+0000","last_unstale":"2024-04-24T13:30:46.878613+0000","last_undegraded":"2024-04-24T13:30:46.878613+0000","last_fullsized":"2024-04-24T13:30:46.878613+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880704+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:30:46.880704+0000","last_peered":"2024-04-24T13:30:46.880704+0000","last_clean":"2024-04-24T13:30:46.880704+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:30:46.880704+0000","last_undegraded":"2024-04-24T13:30:46.880704+0000","last_fullsized":"2024-04-24T13:30:46.880704+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058676+0000","last_change":"2024-04-24T13:30:23.235742+0000","last_active":"2024-04-24T13:30:46.058676+0000","last_peered":"2024-04-24T13:30:46.058676+0000","last_clean":"2024-04-24T13:30:46.058676+0000","last_became_active":"2024-04-24T13:30:23.235385+0000","last_became_peered":"2024-04-24T13:30:23.235385+0000","last_unstale":"2024-04-24T13:30:46.058676+0000","last_undegraded":"2024-04-24T13:30:46.058676+0000","last_fullsized":"2024-04-24T13:30:46.058676+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320246+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:30:46.320246+0000","last_peered":"2024-04-24T13:30:46.320246+0000","last_clean":"2024-04-24T13:30:46.320246+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:30:46.320246+0000","last_undegraded":"2024-04-24T13:30:46.320246+0000","last_fullsized":"2024-04-24T13:30:46.320246+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":36,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.419181+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:30:47.419181+0000","last_peered":"2024-04-24T13:30:47.419181+0000","last_clean":"2024-04-24T13:30:47.419181+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:30:47.419181+0000","last_undegraded":"2024-04-24T13:30:47.419181+0000","last_fullsized":"2024-04-24T13:30:47.419181+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":56,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320090+0000","last_change":"2024-04-24T13:30:27.262590+0000","last_active":"2024-04-24T13:30:46.320090+0000","last_peered":"2024-04-24T13:30:46.320090+0000","last_clean":"2024-04-24T13:30:46.320090+0000","last_became_active":"2024-04-24T13:30:27.261920+0000","last_became_peered":"2024-04-24T13:30:27.261920+0000","last_unstale":"2024-04-24T13:30:46.320090+0000","last_undegraded":"2024-04-24T13:30:46.320090+0000","last_fullsized":"2024-04-24T13:30:46.320090+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:21.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319851+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:30:46.319851+0000","last_peered":"2024-04-24T13:30:46.319851+0000","last_clean":"2024-04-24T13:30:46.319851+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:30:46.319851+0000","last_undegraded":"2024-04-24T13:30:46.319851+0000","last_fullsized":"2024-04-24T13:30:46.319851+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":24,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417451+0000","last_change":"2024-04-24T13:30:31.284027+0000","last_active":"2024-04-24T13:30:47.417451+0000","last_peered":"2024-04-24T13:30:47.417451+0000","last_clean":"2024-04-24T13:30:47.417451+0000","last_became_active":"2024-04-24T13:30:31.283348+0000","last_became_peered":"2024-04-24T13:30:31.283348+0000","last_unstale":"2024-04-24T13:30:47.417451+0000","last_undegraded":"2024-04-24T13:30:47.417451+0000","last_fullsized":"2024-04-24T13:30:47.417451+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:42.409692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882078+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:30:46.882078+0000","last_peered":"2024-04-24T13:30:46.882078+0000","last_clean":"2024-04-24T13:30:46.882078+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:30:46.882078+0000","last_undegraded":"2024-04-24T13:30:46.882078+0000","last_fullsized":"2024-04-24T13:30:46.882078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093967+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:30:46.093967+0000","last_peered":"2024-04-24T13:30:46.093967+0000","last_clean":"2024-04-24T13:30:46.093967+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:30:46.093967+0000","last_undegraded":"2024-04-24T13:30:46.093967+0000","last_fullsized":"2024-04-24T13:30:46.093967+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094798+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:30:46.094798+0000","last_peered":"2024-04-24T13:30:46.094798+0000","last_clean":"2024-04-24T13:30:46.094798+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:30:46.094798+0000","last_undegraded":"2024-04-24T13:30:46.094798+0000","last_fullsized":"2024-04-24T13:30:46.094798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":53,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882718+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:30:46.882718+0000","last_peered":"2024-04-24T13:30:46.882718+0000","last_clean":"2024-04-24T13:30:46.882718+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:30:46.882718+0000","last_undegraded":"2024-04-24T13:30:46.882718+0000","last_fullsized":"2024-04-24T13:30:46.882718+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319383+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:30:46.319383+0000","last_peered":"2024-04-24T13:30:46.319383+0000","last_clean":"2024-04-24T13:30:46.319383+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:30:46.319383+0000","last_undegraded":"2024-04-24T13:30:46.319383+0000","last_fullsized":"2024-04-24T13:30:46.319383+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":25,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878268+0000","last_change":"2024-04-24T13:30:31.277531+0000","last_active":"2024-04-24T13:30:46.878268+0000","last_peered":"2024-04-24T13:30:46.878268+0000","last_clean":"2024-04-24T13:30:46.878268+0000","last_became_active":"2024-04-24T13:30:31.275550+0000","last_became_peered":"2024-04-24T13:30:31.275550+0000","last_unstale":"2024-04-24T13:30:46.878268+0000","last_undegraded":"2024-04-24T13:30:46.878268+0000","last_fullsized":"2024-04-24T13:30:46.878268+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.862184+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:30:45.862184+0000","last_peered":"2024-04-24T13:30:45.862184+0000","last_clean":"2024-04-24T13:30:45.862184+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:30:45.862184+0000","last_undegraded":"2024-04-24T13:30:45.862184+0000","last_fullsized":"2024-04-24T13:30:45.862184+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057922+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:30:46.057922+0000","last_peered":"2024-04-24T13:30:46.057922+0000","last_clean":"2024-04-24T13:30:46.057922+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:30:46.057922+0000","last_undegraded":"2024-04-24T13:30:46.057922+0000","last_fullsized":"2024-04-24T13:30:46.057922+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320536+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:30:46.320536+0000","last_peered":"2024-04-24T13:30:46.320536+0000","last_clean":"2024-04-24T13:30:46.320536+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:30:46.320536+0000","last_undegraded":"2024-04-24T13:30:46.320536+0000","last_fullsized":"2024-04-24T13:30:46.320536+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094672+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:30:46.094672+0000","last_peered":"2024-04-24T13:30:46.094672+0000","last_clean":"2024-04-24T13:30:46.094672+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:30:46.094672+0000","last_undegraded":"2024-04-24T13:30:46.094672+0000","last_fullsized":"2024-04-24T13:30:46.094672+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":34,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418751+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:30:47.418751+0000","last_peered":"2024-04-24T13:30:47.418751+0000","last_clean":"2024-04-24T13:30:47.418751+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:30:47.418751+0000","last_undegraded":"2024-04-24T13:30:47.418751+0000","last_fullsized":"2024-04-24T13:30:47.418751+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319269+0000","last_change":"2024-04-24T13:30:31.285910+0000","last_active":"2024-04-24T13:30:46.319269+0000","last_peered":"2024-04-24T13:30:46.319269+0000","last_clean":"2024-04-24T13:30:46.319269+0000","last_became_active":"2024-04-24T13:30:31.285205+0000","last_became_peered":"2024-04-24T13:30:31.285205+0000","last_unstale":"2024-04-24T13:30:46.319269+0000","last_undegraded":"2024-04-24T13:30:46.319269+0000","last_fullsized":"2024-04-24T13:30:46.319269+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:48.546868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093138+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:30:46.093138+0000","last_peered":"2024-04-24T13:30:46.093138+0000","last_clean":"2024-04-24T13:30:46.093138+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:30:46.093138+0000","last_undegraded":"2024-04-24T13:30:46.093138+0000","last_fullsized":"2024-04-24T13:30:46.093138+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879202+0000","last_change":"2024-04-24T13:30:21.226147+0000","last_active":"2024-04-24T13:30:46.879202+0000","last_peered":"2024-04-24T13:30:46.879202+0000","last_clean":"2024-04-24T13:30:46.879202+0000","last_became_active":"2024-04-24T13:30:21.225369+0000","last_became_peered":"2024-04-24T13:30:21.225369+0000","last_unstale":"2024-04-24T13:30:46.879202+0000","last_undegraded":"2024-04-24T13:30:46.879202+0000","last_fullsized":"2024-04-24T13:30:46.879202+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:24.585089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321038+0000","last_change":"2024-04-24T13:30:25.239519+0000","last_active":"2024-04-24T13:30:46.321038+0000","last_peered":"2024-04-24T13:30:46.321038+0000","last_clean":"2024-04-24T13:30:46.321038+0000","last_became_active":"2024-04-24T13:30:25.238779+0000","last_became_peered":"2024-04-24T13:30:25.238779+0000","last_unstale":"2024-04-24T13:30:46.321038+0000","last_undegraded":"2024-04-24T13:30:46.321038+0000","last_fullsized":"2024-04-24T13:30:46.321038+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":58,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878570+0000","last_change":"2024-04-24T13:30:27.260827+0000","last_active":"2024-04-24T13:30:46.878570+0000","last_peered":"2024-04-24T13:30:46.878570+0000","last_clean":"2024-04-24T13:30:46.878570+0000","last_became_active":"2024-04-24T13:30:27.260164+0000","last_became_peered":"2024-04-24T13:30:27.260164+0000","last_unstale":"2024-04-24T13:30:46.878570+0000","last_undegraded":"2024-04-24T13:30:46.878570+0000","last_fullsized":"2024-04-24T13:30:46.878570+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.056935+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:30:46.056935+0000","last_peered":"2024-04-24T13:30:46.056935+0000","last_clean":"2024-04-24T13:30:46.056935+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:30:46.056935+0000","last_undegraded":"2024-04-24T13:30:46.056935+0000","last_fullsized":"2024-04-24T13:30:46.056935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.323431+0000","last_change":"2024-04-24T13:30:31.280268+0000","last_active":"2024-04-24T13:30:46.323431+0000","last_peered":"2024-04-24T13:30:46.323431+0000","last_clean":"2024-04-24T13:30:46.323431+0000","last_became_active":"2024-04-24T13:30:31.279721+0000","last_became_peered":"2024-04-24T13:30:31.279721+0000","last_unstale":"2024-04-24T13:30:46.323431+0000","last_undegraded":"2024-04-24T13:30:46.323431+0000","last_fullsized":"2024-04-24T13:30:46.323431+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:31.837696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093556+0000","last_change":"2024-04-24T13:30:23.225100+0000","last_active":"2024-04-24T13:30:46.093556+0000","last_peered":"2024-04-24T13:30:46.093556+0000","last_clean":"2024-04-24T13:30:46.093556+0000","last_became_active":"2024-04-24T13:30:23.224324+0000","last_became_peered":"2024-04-24T13:30:23.224324+0000","last_unstale":"2024-04-24T13:30:46.093556+0000","last_undegraded":"2024-04-24T13:30:46.093556+0000","last_fullsized":"2024-04-24T13:30:46.093556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880823+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:30:46.880823+0000","last_peered":"2024-04-24T13:30:46.880823+0000","last_clean":"2024-04-24T13:30:46.880823+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:30:46.880823+0000","last_undegraded":"2024-04-24T13:30:46.880823+0000","last_fullsized":"2024-04-24T13:30:46.880823+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":37,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878876+0000","last_change":"2024-04-24T13:30:25.238830+0000","last_active":"2024-04-24T13:30:46.878876+0000","last_peered":"2024-04-24T13:30:46.878876+0000","last_clean":"2024-04-24T13:30:46.878876+0000","last_became_active":"2024-04-24T13:30:25.237595+0000","last_became_peered":"2024-04-24T13:30:25.237595+0000","last_unstale":"2024-04-24T13:30:46.878876+0000","last_undegraded":"2024-04-24T13:30:46.878876+0000","last_fullsized":"2024-04-24T13:30:46.878876+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":46,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057100+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:30:46.057100+0000","last_peered":"2024-04-24T13:30:46.057100+0000","last_clean":"2024-04-24T13:30:46.057100+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:30:46.057100+0000","last_undegraded":"2024-04-24T13:30:46.057100+0000","last_fullsized":"2024-04-24T13:30:46.057100+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":28,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417510+0000","last_change":"2024-04-24T13:30:29.274924+0000","last_active":"2024-04-24T13:30:47.417510+0000","last_peered":"2024-04-24T13:30:47.417510+0000","last_clean":"2024-04-24T13:30:47.417510+0000","last_became_active":"2024-04-24T13:30:29.274044+0000","last_became_peered":"2024-04-24T13:30:29.274044+0000","last_unstale":"2024-04-24T13:30:47.417510+0000","last_undegraded":"2024-04-24T13:30:47.417510+0000","last_fullsized":"2024-04-24T13:30:47.417510+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:43.398878+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":26,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881949+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:30:46.881949+0000","last_peered":"2024-04-24T13:30:46.881949+0000","last_clean":"2024-04-24T13:30:46.881949+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:30:46.881949+0000","last_undegraded":"2024-04-24T13:30:46.881949+0000","last_fullsized":"2024-04-24T13:30:46.881949+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880685+0000","last_change":"2024-04-24T13:30:23.214114+0000","last_active":"2024-04-24T13:30:46.880685+0000","last_peered":"2024-04-24T13:30:46.880685+0000","last_clean":"2024-04-24T13:30:46.880685+0000","last_became_active":"2024-04-24T13:30:23.213489+0000","last_became_peered":"2024-04-24T13:30:23.213489+0000","last_unstale":"2024-04-24T13:30:46.880685+0000","last_undegraded":"2024-04-24T13:30:46.880685+0000","last_fullsized":"2024-04-24T13:30:46.880685+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882829+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:30:46.882829+0000","last_peered":"2024-04-24T13:30:46.882829+0000","last_clean":"2024-04-24T13:30:46.882829+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:30:46.882829+0000","last_undegraded":"2024-04-24T13:30:46.882829+0000","last_fullsized":"2024-04-24T13:30:46.882829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":35,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092310+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:30:46.092310+0000","last_peered":"2024-04-24T13:30:46.092310+0000","last_clean":"2024-04-24T13:30:46.092310+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:30:46.092310+0000","last_undegraded":"2024-04-24T13:30:46.092310+0000","last_fullsized":"2024-04-24T13:30:46.092310+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881546+0000","last_change":"2024-04-24T13:30:27.253296+0000","last_active":"2024-04-24T13:30:46.881546+0000","last_peered":"2024-04-24T13:30:46.881546+0000","last_clean":"2024-04-24T13:30:46.881546+0000","last_became_active":"2024-04-24T13:30:27.252584+0000","last_became_peered":"2024-04-24T13:30:27.252584+0000","last_unstale":"2024-04-24T13:30:46.881546+0000","last_undegraded":"2024-04-24T13:30:46.881546+0000","last_fullsized":"2024-04-24T13:30:46.881546+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":27,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092364+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:30:46.092364+0000","last_peered":"2024-04-24T13:30:46.092364+0000","last_clean":"2024-04-24T13:30:46.092364+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:30:46.092364+0000","last_undegraded":"2024-04-24T13:30:46.092364+0000","last_fullsized":"2024-04-24T13:30:46.092364+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321729+0000","last_change":"2024-04-24T13:30:31.279466+0000","last_active":"2024-04-24T13:30:46.321729+0000","last_peered":"2024-04-24T13:30:46.321729+0000","last_clean":"2024-04-24T13:30:46.321729+0000","last_became_active":"2024-04-24T13:30:31.278784+0000","last_became_peered":"2024-04-24T13:30:31.278784+0000","last_unstale":"2024-04-24T13:30:46.321729+0000","last_undegraded":"2024-04-24T13:30:46.321729+0000","last_fullsized":"2024-04-24T13:30:46.321729+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092784+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:30:46.092784+0000","last_peered":"2024-04-24T13:30:46.092784+0000","last_clean":"2024-04-24T13:30:46.092784+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:30:46.092784+0000","last_undegraded":"2024-04-24T13:30:46.092784+0000","last_fullsized":"2024-04-24T13:30:46.092784+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058927+0000","last_change":"2024-04-24T13:30:21.229211+0000","last_active":"2024-04-24T13:30:46.058927+0000","last_peered":"2024-04-24T13:30:46.058927+0000","last_clean":"2024-04-24T13:30:46.058927+0000","last_became_active":"2024-04-24T13:30:21.228906+0000","last_became_peered":"2024-04-24T13:30:21.228906+0000","last_unstale":"2024-04-24T13:30:46.058927+0000","last_undegraded":"2024-04-24T13:30:46.058927+0000","last_fullsized":"2024-04-24T13:30:46.058927+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":36,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319470+0000","last_change":"2024-04-24T13:30:25.228645+0000","last_active":"2024-04-24T13:30:46.319470+0000","last_peered":"2024-04-24T13:30:46.319470+0000","last_clean":"2024-04-24T13:30:46.319470+0000","last_became_active":"2024-04-24T13:30:25.227801+0000","last_became_peered":"2024-04-24T13:30:25.227801+0000","last_unstale":"2024-04-24T13:30:46.319470+0000","last_undegraded":"2024-04-24T13:30:46.319470+0000","last_fullsized":"2024-04-24T13:30:46.319470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:16.778257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":47,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.092868+0000","last_change":"2024-04-24T13:30:27.264731+0000","last_active":"2024-04-24T13:30:46.092868+0000","last_peered":"2024-04-24T13:30:46.092868+0000","last_clean":"2024-04-24T13:30:46.092868+0000","last_became_active":"2024-04-24T13:30:27.263888+0000","last_became_peered":"2024-04-24T13:30:27.263888+0000","last_unstale":"2024-04-24T13:30:46.092868+0000","last_undegraded":"2024-04-24T13:30:46.092868+0000","last_fullsized":"2024-04-24T13:30:46.092868+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":26,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.056935+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:30:46.056935+0000","last_peered":"2024-04-24T13:30:46.056935+0000","last_clean":"2024-04-24T13:30:46.056935+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:30:46.056935+0000","last_undegraded":"2024-04-24T13:30:46.056935+0000","last_fullsized":"2024-04-24T13:30:46.056935+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":23,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093327+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:30:46.093327+0000","last_peered":"2024-04-24T13:30:46.093327+0000","last_clean":"2024-04-24T13:30:46.093327+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:30:46.093327+0000","last_undegraded":"2024-04-24T13:30:46.093327+0000","last_fullsized":"2024-04-24T13:30:46.093327+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321166+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:30:46.321166+0000","last_peered":"2024-04-24T13:30:46.321166+0000","last_clean":"2024-04-24T13:30:46.321166+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:30:46.321166+0000","last_undegraded":"2024-04-24T13:30:46.321166+0000","last_fullsized":"2024-04-24T13:30:46.321166+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417451+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:30:47.417451+0000","last_peered":"2024-04-24T13:30:47.417451+0000","last_clean":"2024-04-24T13:30:47.417451+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:30:47.417451+0000","last_undegraded":"2024-04-24T13:30:47.417451+0000","last_fullsized":"2024-04-24T13:30:47.417451+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.321068+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:30:46.321068+0000","last_peered":"2024-04-24T13:30:46.321068+0000","last_clean":"2024-04-24T13:30:46.321068+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:30:46.321068+0000","last_undegraded":"2024-04-24T13:30:46.321068+0000","last_fullsized":"2024-04-24T13:30:46.321068+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.860888+0000","last_change":"2024-04-24T13:30:21.223752+0000","last_active":"2024-04-24T13:30:45.860888+0000","last_peered":"2024-04-24T13:30:45.860888+0000","last_clean":"2024-04-24T13:30:45.860888+0000","last_became_active":"2024-04-24T13:30:21.223457+0000","last_became_peered":"2024-04-24T13:30:21.223457+0000","last_unstale":"2024-04-24T13:30:45.860888+0000","last_undegraded":"2024-04-24T13:30:45.860888+0000","last_fullsized":"2024-04-24T13:30:45.860888+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:49.280399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879185+0000","last_change":"2024-04-24T13:30:23.239053+0000","last_active":"2024-04-24T13:30:46.879185+0000","last_peered":"2024-04-24T13:30:46.879185+0000","last_clean":"2024-04-24T13:30:46.879185+0000","last_became_active":"2024-04-24T13:30:23.238289+0000","last_became_peered":"2024-04-24T13:30:23.238289+0000","last_unstale":"2024-04-24T13:30:46.879185+0000","last_undegraded":"2024-04-24T13:30:46.879185+0000","last_fullsized":"2024-04-24T13:30:46.879185+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878910+0000","last_change":"2024-04-24T13:30:21.224037+0000","last_active":"2024-04-24T13:30:46.878910+0000","last_peered":"2024-04-24T13:30:46.878910+0000","last_clean":"2024-04-24T13:30:46.878910+0000","last_became_active":"2024-04-24T13:30:21.222146+0000","last_became_peered":"2024-04-24T13:30:21.222146+0000","last_unstale":"2024-04-24T13:30:46.878910+0000","last_undegraded":"2024-04-24T13:30:46.878910+0000","last_fullsized":"2024-04-24T13:30:46.878910+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319462+0000","last_change":"2024-04-24T13:30:23.241090+0000","last_active":"2024-04-24T13:30:46.319462+0000","last_peered":"2024-04-24T13:30:46.319462+0000","last_clean":"2024-04-24T13:30:46.319462+0000","last_became_active":"2024-04-24T13:30:23.240726+0000","last_became_peered":"2024-04-24T13:30:23.240726+0000","last_unstale":"2024-04-24T13:30:46.319462+0000","last_undegraded":"2024-04-24T13:30:46.319462+0000","last_fullsized":"2024-04-24T13:30:46.319462+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058084+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:30:46.058084+0000","last_peered":"2024-04-24T13:30:46.058084+0000","last_clean":"2024-04-24T13:30:46.058084+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:30:46.058084+0000","last_undegraded":"2024-04-24T13:30:46.058084+0000","last_fullsized":"2024-04-24T13:30:46.058084+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.881403+0000","last_change":"2024-04-24T13:30:23.246330+0000","last_active":"2024-04-24T13:30:46.881403+0000","last_peered":"2024-04-24T13:30:46.881403+0000","last_clean":"2024-04-24T13:30:46.881403+0000","last_became_active":"2024-04-24T13:30:23.246109+0000","last_became_peered":"2024-04-24T13:30:23.246109+0000","last_unstale":"2024-04-24T13:30:46.881403+0000","last_undegraded":"2024-04-24T13:30:46.881403+0000","last_fullsized":"2024-04-24T13:30:46.881403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882526+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:30:46.882526+0000","last_peered":"2024-04-24T13:30:46.882526+0000","last_clean":"2024-04-24T13:30:46.882526+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:30:46.882526+0000","last_undegraded":"2024-04-24T13:30:46.882526+0000","last_fullsized":"2024-04-24T13:30:46.882526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.093830+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:30:46.093830+0000","last_peered":"2024-04-24T13:30:46.093830+0000","last_clean":"2024-04-24T13:30:46.093830+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:30:46.093830+0000","last_undegraded":"2024-04-24T13:30:46.093830+0000","last_fullsized":"2024-04-24T13:30:46.093830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320721+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:30:46.320721+0000","last_peered":"2024-04-24T13:30:46.320721+0000","last_clean":"2024-04-24T13:30:46.320721+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:30:46.320721+0000","last_undegraded":"2024-04-24T13:30:46.320721+0000","last_fullsized":"2024-04-24T13:30:46.320721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880268+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:30:46.880268+0000","last_peered":"2024-04-24T13:30:46.880268+0000","last_clean":"2024-04-24T13:30:46.880268+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:30:46.880268+0000","last_undegraded":"2024-04-24T13:30:46.880268+0000","last_fullsized":"2024-04-24T13:30:46.880268+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418719+0000","last_change":"2024-04-24T13:30:21.244582+0000","last_active":"2024-04-24T13:30:47.418719+0000","last_peered":"2024-04-24T13:30:47.418719+0000","last_clean":"2024-04-24T13:30:47.418719+0000","last_became_active":"2024-04-24T13:30:21.243856+0000","last_became_peered":"2024-04-24T13:30:21.243856+0000","last_unstale":"2024-04-24T13:30:47.418719+0000","last_undegraded":"2024-04-24T13:30:47.418719+0000","last_fullsized":"2024-04-24T13:30:47.418719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":40,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.417467+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:30:47.417467+0000","last_peered":"2024-04-24T13:30:47.417467+0000","last_clean":"2024-04-24T13:30:47.417467+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:30:47.417467+0000","last_undegraded":"2024-04-24T13:30:47.417467+0000","last_fullsized":"2024-04-24T13:30:47.417467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.882555+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:30:46.882555+0000","last_peered":"2024-04-24T13:30:46.882555+0000","last_clean":"2024-04-24T13:30:46.882555+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:30:46.882555+0000","last_undegraded":"2024-04-24T13:30:46.882555+0000","last_fullsized":"2024-04-24T13:30:46.882555+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058924+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:30:46.058924+0000","last_peered":"2024-04-24T13:30:46.058924+0000","last_clean":"2024-04-24T13:30:46.058924+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:30:46.058924+0000","last_undegraded":"2024-04-24T13:30:46.058924+0000","last_fullsized":"2024-04-24T13:30:46.058924+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878483+0000","last_change":"2024-04-24T13:30:21.229523+0000","last_active":"2024-04-24T13:30:46.878483+0000","last_peered":"2024-04-24T13:30:46.878483+0000","last_clean":"2024-04-24T13:30:46.878483+0000","last_became_active":"2024-04-24T13:30:21.228400+0000","last_became_peered":"2024-04-24T13:30:21.228400+0000","last_unstale":"2024-04-24T13:30:46.878483+0000","last_undegraded":"2024-04-24T13:30:46.878483+0000","last_fullsized":"2024-04-24T13:30:46.878483+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094923+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:30:46.094923+0000","last_peered":"2024-04-24T13:30:46.094923+0000","last_clean":"2024-04-24T13:30:46.094923+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:30:46.094923+0000","last_undegraded":"2024-04-24T13:30:46.094923+0000","last_fullsized":"2024-04-24T13:30:46.094923+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":46,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880926+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:30:46.880926+0000","last_peered":"2024-04-24T13:30:46.880926+0000","last_clean":"2024-04-24T13:30:46.880926+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:30:46.880926+0000","last_undegraded":"2024-04-24T13:30:46.880926+0000","last_fullsized":"2024-04-24T13:30:46.880926+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.862940+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:30:45.862940+0000","last_peered":"2024-04-24T13:30:45.862940+0000","last_clean":"2024-04-24T13:30:45.862940+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:30:45.862940+0000","last_undegraded":"2024-04-24T13:30:45.862940+0000","last_fullsized":"2024-04-24T13:30:45.862940+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878820+0000","last_change":"2024-04-24T13:30:21.241430+0000","last_active":"2024-04-24T13:30:46.878820+0000","last_peered":"2024-04-24T13:30:46.878820+0000","last_clean":"2024-04-24T13:30:46.878820+0000","last_became_active":"2024-04-24T13:30:21.240593+0000","last_became_peered":"2024-04-24T13:30:21.240593+0000","last_unstale":"2024-04-24T13:30:46.878820+0000","last_undegraded":"2024-04-24T13:30:46.878820+0000","last_fullsized":"2024-04-24T13:30:46.878820+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.094492+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:30:46.094492+0000","last_peered":"2024-04-24T13:30:46.094492+0000","last_clean":"2024-04-24T13:30:46.094492+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:30:46.094492+0000","last_undegraded":"2024-04-24T13:30:46.094492+0000","last_fullsized":"2024-04-24T13:30:46.094492+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058203+0000","last_change":"2024-04-24T13:30:21.238887+0000","last_active":"2024-04-24T13:30:46.058203+0000","last_peered":"2024-04-24T13:30:46.058203+0000","last_clean":"2024-04-24T13:30:46.058203+0000","last_became_active":"2024-04-24T13:30:21.238580+0000","last_became_peered":"2024-04-24T13:30:21.238580+0000","last_unstale":"2024-04-24T13:30:46.058203+0000","last_undegraded":"2024-04-24T13:30:46.058203+0000","last_fullsized":"2024-04-24T13:30:46.058203+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320423+0000","last_change":"2024-04-24T13:30:23.241254+0000","last_active":"2024-04-24T13:30:46.320423+0000","last_peered":"2024-04-24T13:30:46.320423+0000","last_clean":"2024-04-24T13:30:46.320423+0000","last_became_active":"2024-04-24T13:30:23.236897+0000","last_became_peered":"2024-04-24T13:30:23.236897+0000","last_unstale":"2024-04-24T13:30:46.320423+0000","last_undegraded":"2024-04-24T13:30:46.320423+0000","last_fullsized":"2024-04-24T13:30:46.320423+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":44,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:47.418314+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:30:47.418314+0000","last_peered":"2024-04-24T13:30:47.418314+0000","last_clean":"2024-04-24T13:30:47.418314+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:30:47.418314+0000","last_undegraded":"2024-04-24T13:30:47.418314+0000","last_fullsized":"2024-04-24T13:30:47.418314+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.057485+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:30:46.057485+0000","last_peered":"2024-04-24T13:30:46.057485+0000","last_clean":"2024-04-24T13:30:46.057485+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:30:46.057485+0000","last_undegraded":"2024-04-24T13:30:46.057485+0000","last_fullsized":"2024-04-24T13:30:46.057485+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.322650+0000","last_change":"2024-04-24T13:30:21.251108+0000","last_active":"2024-04-24T13:30:46.322650+0000","last_peered":"2024-04-24T13:30:46.322650+0000","last_clean":"2024-04-24T13:30:46.322650+0000","last_became_active":"2024-04-24T13:30:21.250436+0000","last_became_peered":"2024-04-24T13:30:21.250436+0000","last_unstale":"2024-04-24T13:30:46.322650+0000","last_undegraded":"2024-04-24T13:30:46.322650+0000","last_fullsized":"2024-04-24T13:30:46.322650+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:21.639009+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":42,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.880114+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:30:46.880114+0000","last_peered":"2024-04-24T13:30:46.880114+0000","last_clean":"2024-04-24T13:30:46.880114+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:30:46.880114+0000","last_undegraded":"2024-04-24T13:30:46.880114+0000","last_fullsized":"2024-04-24T13:30:46.880114+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":42,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:45.863731+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:30:45.863731+0000","last_peered":"2024-04-24T13:30:45.863731+0000","last_clean":"2024-04-24T13:30:45.863731+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:30:45.863731+0000","last_undegraded":"2024-04-24T13:30:45.863731+0000","last_fullsized":"2024-04-24T13:30:45.863731+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":39,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.319830+0000","last_change":"2024-04-24T13:30:23.241296+0000","last_active":"2024-04-24T13:30:46.319830+0000","last_peered":"2024-04-24T13:30:46.319830+0000","last_clean":"2024-04-24T13:30:46.319830+0000","last_became_active":"2024-04-24T13:30:23.236992+0000","last_became_peered":"2024-04-24T13:30:23.236992+0000","last_unstale":"2024-04-24T13:30:46.319830+0000","last_undegraded":"2024-04-24T13:30:46.319830+0000","last_fullsized":"2024-04-24T13:30:46.319830+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879272+0000","last_change":"2024-04-24T13:30:21.243438+0000","last_active":"2024-04-24T13:30:46.879272+0000","last_peered":"2024-04-24T13:30:46.879272+0000","last_clean":"2024-04-24T13:30:46.879272+0000","last_became_active":"2024-04-24T13:30:21.240665+0000","last_became_peered":"2024-04-24T13:30:21.240665+0000","last_unstale":"2024-04-24T13:30:46.879272+0000","last_undegraded":"2024-04-24T13:30:46.879272+0000","last_fullsized":"2024-04-24T13:30:46.879272+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":45,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.878442+0000","last_change":"2024-04-24T13:30:21.218669+0000","last_active":"2024-04-24T13:30:46.878442+0000","last_peered":"2024-04-24T13:30:46.878442+0000","last_clean":"2024-04-24T13:30:46.878442+0000","last_became_active":"2024-04-24T13:30:21.217904+0000","last_became_peered":"2024-04-24T13:30:21.217904+0000","last_unstale":"2024-04-24T13:30:46.878442+0000","last_undegraded":"2024-04-24T13:30:46.878442+0000","last_fullsized":"2024-04-24T13:30:46.878442+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":38,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.058445+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:30:46.058445+0000","last_peered":"2024-04-24T13:30:46.058445+0000","last_clean":"2024-04-24T13:30:46.058445+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:30:46.058445+0000","last_undegraded":"2024-04-24T13:30:46.058445+0000","last_fullsized":"2024-04-24T13:30:46.058445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":43,"reported_epoch":38,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.320090+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:30:46.320090+0000","last_peered":"2024-04-24T13:30:46.320090+0000","last_clean":"2024-04-24T13:30:46.320090+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:30:46.320090+0000","last_undegraded":"2024-04-24T13:30:46.320090+0000","last_fullsized":"2024-04-24T13:30:46.320090+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":41,"reported_epoch":39,"state":"active+clean","last_fresh":"2024-04-24T13:30:46.879141+0000","last_change":"2024-04-24T13:30:23.217309+0000","last_active":"2024-04-24T13:30:46.879141+0000","last_peered":"2024-04-24T13:30:46.879141+0000","last_clean":"2024-04-24T13:30:46.879141+0000","last_became_active":"2024-04-24T13:30:23.216484+0000","last_became_peered":"2024-04-24T13:30:23.216484+0000","last_unstale":"2024-04-24T13:30:46.879141+0000","last_undegraded":"2024-04-24T13:30:46.879141+0000","last_fullsized":"2024-04-24T13:30:46.879141+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":178,"num_object_clones":0,"num_object_copies":356,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":178,"num_whiteouts":0,"num_read":688,"num_read_kb":447,"num_write":417,"num_write_kb":34,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":387,"ondisk_log_size":387,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":7},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574859,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":32240,"kb_used_data":1048,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94339600,"statfs":{"total":96636764160,"available":96603750400,"internally_reserved":0,"allocated":1073152,"data_stored":795456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":31914442},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574859,"num_pgs":56,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27472,"kb_used_data":444,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344368,"statfs":{"total":96636764160,"available":96608632832,"internally_reserved":0,"allocated":454656,"data_stored":204428,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574860,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27532,"kb_used_data":508,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344308,"statfs":{"total":96636764160,"available":96608571392,"internally_reserved":0,"allocated":520192,"data_stored":214327,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574860,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":203926,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574859,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27496,"kb_used_data":472,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344344,"statfs":{"total":96636764160,"available":96608608256,"internally_reserved":0,"allocated":483328,"data_stored":212466,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574860,"num_pgs":47,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27460,"kb_used_data":432,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344380,"statfs":{"total":96636764160,"available":96608645120,"internally_reserved":0,"allocated":442368,"data_stored":203990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574861,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":206107,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574860,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28052,"kb_used_data":1028,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343788,"statfs":{"total":96636764160,"available":96608038912,"internally_reserved":0,"allocated":1052672,"data_stored":794862,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":330,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1210,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:30:48.676 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-24T13:30:48.676 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-24T13:30:48.676 INFO:tasks.thrashosds.thrasher:Removing osd 7, in_osds are: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-24T13:30:48.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd out 7 2024-04-24T13:30:48.703 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:48.702+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:48.773 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:48.774 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:30:48.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:30:48.774 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:30:48.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.774 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.774 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:48.774 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.915629215999999, 2024-04-24T13:30:48.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:30:48.774 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.774 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.774 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:30:48.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:30:48.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:30:48.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:30:48.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:30:48.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:30:48.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:30:48.780 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.780 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.780 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.780 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.780 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:30:48.780 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.915606441999998, 2024-04-24T13:30:48.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:30:48.780 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.780 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:30:48.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:30:48.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:30:48.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:30:48.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.817999008999998, 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.786 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.787 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.787 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.787 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.787 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:30:48.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.787 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:48.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:48.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:48.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:30:48.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:30:48.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:30:48.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:30:48.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:30:48.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:30:48.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:30:48.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:30:48.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:30:48.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:30:48.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:30:48.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:30:48.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:30:48.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:30:48.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:30:48.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.796 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.796 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.796 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:30:48.796 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.817911371999998, 2024-04-24T13:30:48.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:30:48.796 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:30:48.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:30:48.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:30:48.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:30:48.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:30:48.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:30:48.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:30:48.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:30:48.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:30:48.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:30:48.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:30:48.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:30:48.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:30:48.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.712257485000002, 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:30:48.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:30:48.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:30:48.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:30:48.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:30:48.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:30:48.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:30:48.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:30:48.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:30:48.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:30:48.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:30:48.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:30:48.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:30:48.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:30:48.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.712052966999998, 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.809 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.810 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:30:48.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.810 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:30:48.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:30:48.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:30:48.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:30:48.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:30:48.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:30:48.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:30:48.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:30:48.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:30:48.814 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.711693144000002, 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.815 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:30:48.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:30:48.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:30:48.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:30:48.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:30:48.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:30:48.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:30:48.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:30:48.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:30:48.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:30:48.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:30:48.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:30:48.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:30:48.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:30:48.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:30:48.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:30:48.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:30:48.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:30:48.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:30:48.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:30:48.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:30:48.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:30:48.822 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.822 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.822 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.822 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.822 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:30:48.822 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.711524740999998, 2024-04-24T13:30:48.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:30:48.822 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.822 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.822 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.823 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:30:48.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.823 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:30:48.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:30:48.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:30:48.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:30:48.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:30:48.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:30:48.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:30:48.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:30:48.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:30:48.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:30:48.828 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.828 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.828 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.828 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.828 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:30:48.828 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.711316349999997, 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:30:48.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:30:48.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:30:48.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:30:48.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:30:48.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:30:48.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:30:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:30:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:30:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:30:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:30:48.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:30:48.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:30:48.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:30:48.834 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.834 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.834 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.834 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.834 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:30:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.711218496999997, 2024-04-24T13:30:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:30:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:30:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:30:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:30:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:30:48.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:30:48.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:30:48.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:30:48.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:30:48.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:30:48.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:30:48.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:30:48.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:30:48.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:30:48.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:30:48.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.841 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.841 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:30:48.841 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.711117348000002, 2024-04-24T13:30:48.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:30:48.841 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.841 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.841 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.841 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.841 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.841 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.841 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:30:48.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:30:48.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:30:48.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:30:48.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:30:48.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:30:48.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:30:48.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:30:48.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:30:48.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:30:48.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:30:48.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:30:48.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:30:48.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:30:48.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:30:48.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:30:48.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:30:48.846 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.847 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.847 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.847 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.847 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:30:48.847 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.710860636, 2024-04-24T13:30:48.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:30:48.847 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.848 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.848 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.848 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.848 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.848 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.848 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:30:48.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.848 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:30:48.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:30:48.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:30:48.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:30:48.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:30:48.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:30:48.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:30:48.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:30:48.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:30:48.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:30:48.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:30:48.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:30:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:30:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:30:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:30:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:30:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:30:48.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:30:48.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:30:48.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:30:48.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:30:48.854 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.854 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.854 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.854 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.854 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:30:48.854 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.710750974, 2024-04-24T13:30:48.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:30:48.854 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.854 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.854 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:30:48.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:30:48.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:30:48.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:30:48.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:30:48.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:30:48.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:30:48.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:30:48.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:30:48.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:30:48.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:30:48.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:30:48.860 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.860 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.860 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.860 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.860 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:30:48.860 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.710678944999998, 2024-04-24T13:30:48.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:30:48.860 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.860 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:30:48.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:30:48.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:30:48.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:30:48.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:30:48.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:30:48.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:30:48.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:30:48.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:30:48.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:30:48.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:30:48.866 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.866 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.866 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.866 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.866 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:30:48.866 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.710507909, 2024-04-24T13:30:48.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:30:48.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:30:48.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:30:48.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:30:48.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:30:48.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:30:48.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:30:48.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:30:48.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:30:48.872 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.872 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.872 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.872 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.872 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:30:48.872 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.710468415999998, 2024-04-24T13:30:48.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:30:48.872 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:30:48.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:30:48.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:30:48.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:30:48.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.45714916, 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.878 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.879 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.879 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.879 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.879 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:30:48.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.879 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:48.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:30:48.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:30:48.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:30:48.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:30:48.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:30:48.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:30:48.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:30:48.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:30:48.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:30:48.884 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.884 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.884 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.884 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.884 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:48.885 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.457123111999998, 2024-04-24T13:30:48.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:30:48.885 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.885 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.885 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.885 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.885 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.885 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.885 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:30:48.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.885 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:48.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:48.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:48.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:30:48.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:30:48.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:30:48.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:30:48.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:30:48.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:30:48.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:30:48.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:30:48.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:30:48.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:30:48.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:30:48.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:30:48.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:30:48.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:30:48.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:30:48.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:30:48.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:30:48.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:30:48.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:30:48.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:30:48.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:30:48.891 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.891 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.891 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.891 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.891 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:48.891 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.457097756000003, 2024-04-24T13:30:48.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:30:48.891 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.891 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.891 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:30:48.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:30:48.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:30:48.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:30:48.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:30:48.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:30:48.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:30:48.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:30:48.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:30:48.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:30:48.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:30:48.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:30:48.897 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.897 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.897 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.897 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:48.897 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:30:48.897 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 39.457006687000003, 2024-04-24T13:30:48.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:30:48.897 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:48.897 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:48.898 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:48.898 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:48.898 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:48.898 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:48.898 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:30:48.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.898 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:48.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:48.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:30:48.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:48.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:30:48.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:48.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:48.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:30:48.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:30:48.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:48.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:30:48.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:30:48.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:48.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:30:48.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:30:48.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:48.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:48.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:30:48.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:30:48.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:48.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:30:48.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:30:48.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:48.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:30:48.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.903 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:48.904 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:48.904 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:48.905 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:30:48.906 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:48.902+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:48.910 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:30:49.003 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-04-24T13:30:49.002+0000 7fe3769ab640 -1 mon.a@0(leader).osd e40 definitely_dead 0 2024-04-24T13:30:49.005 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:49.002+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:49.023 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:49.023 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:49.023 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:30:49.023 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:49.037 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:30:49.126 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:49.126+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:49.184 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:49.184 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:30:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:30:49.185 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:49.198 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:30:49.242 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:49.242+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:49.308 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:49.306+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:49.369 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:30:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:30:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:30:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:30:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:30:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.443924330000002, 2024-04-24T13:30:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:30:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.370 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:30:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:30:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:30:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:30:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:30:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:30:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:30:49.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:30:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:30:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:30:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:30:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.301132559999999, 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:30:49.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:30:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:30:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:30:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:30:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:30:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:30:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.298829492000003, 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.379 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:30:49.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:30:49.383 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.297134974999999, 2024-04-24T13:30:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:30:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:30:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:30:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:30:49.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:30:49.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.295677363999999, 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.388 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:30:49.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:30:49.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:30:49.392 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.293748274999999, 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:30:49.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:30:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:30:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:30:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:30:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:30:49.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.291323738000003, 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:30:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:30:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:30:49.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:30:49.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:30:49.401 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.290120989000002, 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:30:49.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:30:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:30:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:30:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:30:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:30:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:30:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:30:49.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.286914824, 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:30:49.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:30:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:30:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:30:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:30:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.047859240000001, 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.413 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:30:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:30:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:30:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:30:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:30:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:30:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:30:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:30:49.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.045438589, 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:30:49.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:30:49.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:30:49.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.044665371000001, 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:30:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:30:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:30:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:30:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.036926317000002, 2024-04-24T13:30:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:30:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.426 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:30:49.430 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:30:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.688964210000002, 2024-04-24T13:30:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:30:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:30:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:30:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:30:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:30:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:30:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:30:49.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:30:49.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:30:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:30:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:30:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:30:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:30:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.688215462000002, 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.435 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:30:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:30:49.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.439 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.687284337000001, 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:30:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:30:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:30:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:30:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.686792546, 2024-04-24T13:30:49.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:30:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:30:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:30:49.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.448 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:30:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.100711122, 2024-04-24T13:30:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:30:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.449 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:30:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:30:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:30:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:30:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:30:49.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.071863922999999, 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:30:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:30:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:30:49.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:49.461 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.033672678999999, 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:49.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:30:49.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:30:49.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:30:49.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:49.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:49.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:49.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:30:49.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:30:49.467 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.467 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.467 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.467 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:49.467 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:49.467 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:49.469 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:30:49.469 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:49.469+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:49.569 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:49.566+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:49.636 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:49.636 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:49.636 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:30:49.636 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:49.649 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:30:49.698 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:49.698+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:49.720 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:30:49.787 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:49.786+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:49.822 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:49.823 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:49.823 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:30:49.823 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:30:49.823 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:49.837 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:30:49.872 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:49.869+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:49.885 INFO:teuthology.orchestra.run.smithi071.stderr:marked out osd.7. 2024-04-24T13:30:49.888 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:30:49.888 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:30:49.891 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:30:49.925 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:30:49.925 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:30:49.941 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:30:49.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:30:49.957 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:30:49.957 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:30:49.972 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:49.970+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:49.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:30:49.977 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:30:49.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:30:49.998 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:30:50.005 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:50.005 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:50.019 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:30:50.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:30:50.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:30:50.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:30:50.040 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:30:50.074 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:50.073+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:50.146 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:50.146 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:50.159 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:30:50.210 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:50.210+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:50.276 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:50.273+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:50.282 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:50.282 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:50.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:30:50.386 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:50.386+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:50.463 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:50.463 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:50.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:30:50.518 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:50.518+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:50.579 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:50.578+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:50.635 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:50.635 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:50.649 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:30:50.690 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:50.690+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:50.780 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:50.778+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:50.807 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:50.807 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:50.821 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:30:50.881 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:50.881+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:50.981 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:50.978+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:51.010 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:51.011 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:51.025 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:30:51.083 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:51.081+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:51.153 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:51.153 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:51.167 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:30:51.184 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:51.182+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:51.285 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:51.282+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:51.334 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:51.334 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:51.348 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:30:51.385 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:51.382+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:51.474 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:51.474 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:51.487 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:51.486+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:51.488 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:30:51.588 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:51.585+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:51.605 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:51.605 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:51.619 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:30:51.709 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:51.709+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:51.787 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:51.788 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:51.790 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:51.790+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:51.801 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:30:51.891 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:51.889+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:51.928 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:30:51.970 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:51.970 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:51.984 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:30:52.025 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:52.025+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:52.057 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:30:52.093 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:52.093+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:52.143 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:52.143 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:52.156 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:30:52.194 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:52.194+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:52.196 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:30:52.197 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:30:52.213 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:30:52.213 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:30:52.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:30:52.229 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:30:52.245 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:30:52.245 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:30:52.263 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:30:52.263 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:30:52.282 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:30:52.282 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:30:52.295 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:52.293+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:52.303 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:30:52.303 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:30:52.323 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:30:52.324 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:30:52.327 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:52.327 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:30:52.327 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:30:52.328 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:30:52.328 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:52.343 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:30:52.396 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:52.393+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:52.467 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:52.467 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:30:52.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:30:52.467 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.221441763000001, 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.468 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:30:52.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:30:52.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:30:52.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:52.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:30:52.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:30:52.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:52.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94410010338304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.186584049, 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077892999999999999, 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.475 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.476 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:52.476 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:52.476 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:52.476 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-24T13:30:52.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.476 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:52.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:30:52.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:30:52.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2770000000000001e-06 2024-04-24T13:30:52.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279179+0000", 2024-04-24T13:30:52.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3529999999999999e-05 2024-04-24T13:30:52.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279222+0000", 2024-04-24T13:30:52.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2743000000000001e-05 2024-04-24T13:30:52.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279272+0000", 2024-04-24T13:30:52.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0649000000000002e-05 2024-04-24T13:30:52.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279772+0000", 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000500013 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280011+0000", 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023840499999999999 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280408+0000", 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039756999999999998 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282501+0000", 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020929159999999998 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286583+0000", 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040820530000000004 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286748+0000", 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016431200000000001 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286951+0000", 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020383200000000001 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.173338055999999, 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024753290000000001, 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.481 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292410+0000", 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292419+0000", 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8680000000000005e-06 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292445+0000", 2024-04-24T13:30:52.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6207000000000002e-05 2024-04-24T13:30:52.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292458+0000", 2024-04-24T13:30:52.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:30:52.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292597+0000", 2024-04-24T13:30:52.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013947100000000001 2024-04-24T13:30:52.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292841+0000", 2024-04-24T13:30:52.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024435599999999999 2024-04-24T13:30:52.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:52.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.293085+0000", 2024-04-24T13:30:52.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000243212 2024-04-24T13:30:52.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294263+0000", 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001178171 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294758+0000", 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049492199999999996 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294824+0000", 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6346000000000005e-05 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294883+0000", 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9222999999999999e-05 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94410010333696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.170652168, 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023887449999999998, 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.487 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295096+0000", 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1660000000000001e-06 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295105+0000", 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6139999999999992e-06 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295131+0000", 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6633000000000001e-05 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295146+0000", 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4168999999999999e-05 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295250+0000", 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104071 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295424+0000", 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017425599999999999 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295726+0000", 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030180000000000002 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.296532+0000", 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080662400000000003 2024-04-24T13:30:52.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:52.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297330+0000", 2024-04-24T13:30:52.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00079793300000000002 2024-04-24T13:30:52.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297392+0000", 2024-04-24T13:30:52.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2112000000000004e-05 2024-04-24T13:30:52.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297483+0000", 2024-04-24T13:30:52.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0366999999999997e-05 2024-04-24T13:30:52.493 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.493 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.493 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.493 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-24T13:30:52.493 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:30:52.493 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 20.171123896000001, 2024-04-24T13:30:52.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020133299999999998, 2024-04-24T13:30:52.493 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.493 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294623+0000", 2024-04-24T13:30:52.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9999999999999996e-07 2024-04-24T13:30:52.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294634+0000", 2024-04-24T13:30:52.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1292e-05 2024-04-24T13:30:52.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294666+0000", 2024-04-24T13:30:52.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1596e-05 2024-04-24T13:30:52.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294688+0000", 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2561e-05 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294842+0000", 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153494 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294893+0000", 2024-04-24T13:30:52.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0983999999999998e-05 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296547+0000", 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016536890000000001 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296636+0000", 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8913999999999996e-05 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:215 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'2, mlcod=0'0)", 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 20.139957841000001, 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018794250000000001, 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325790+0000", 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325809+0000", 2024-04-24T13:30:52.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8590999999999999e-05 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325846+0000", 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6875999999999997e-05 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325868+0000", 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1585000000000001e-05 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325983+0000", 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115631 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.326022+0000", 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8618999999999997e-05 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327579+0000", 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015573049999999999 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327668+0000", 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8588e-05 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:385 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'5, mlcod=32'2)", 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 20.030053508000002, 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020295980000000001, 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.502 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435694+0000", 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435708+0000", 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3525e-05 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435733+0000", 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5431000000000001e-05 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435752+0000", 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8465e-05 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435897+0000", 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014525000000000001 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435963+0000", 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6297000000000006e-05 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437645+0000", 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001681395 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437722+0000", 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7424999999999998e-05 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.506 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:437 6.a e32/26 6:55b0279d:reshard::reshard.0000000009:head v 32'4, mlcod=32'1)", 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 20.000745667, 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002915075, 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465002+0000", 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4470000000000001e-06 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465013+0000", 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1532000000000001e-05 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465035+0000", 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1138e-05 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465048+0000", 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3311e-05 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465219+0000", 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017134600000000001 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465254+0000", 2024-04-24T13:30:52.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5009999999999999e-05 2024-04-24T13:30:52.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467829+0000", 2024-04-24T13:30:52.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025744370000000002 2024-04-24T13:30:52.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467915+0000", 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6854000000000006e-05 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:466 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.985819426999999, 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037830749999999999, 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.511 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479928+0000", 2024-04-24T13:30:52.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7150000000000001e-06 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479941+0000", 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2999e-05 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479969+0000", 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7923999999999999e-05 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479986+0000", 2024-04-24T13:30:52.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6388e-05 2024-04-24T13:30:52.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480113+0000", 2024-04-24T13:30:52.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127594 2024-04-24T13:30:52.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480167+0000", 2024-04-24T13:30:52.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3699999999999997e-05 2024-04-24T13:30:52.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483640+0000", 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003472742 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483710+0000", 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0012999999999995e-05 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.515 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:468 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'6, mlcod=32'3)", 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.983505442999999, 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039247960000000004, 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482242+0000", 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.57e-06 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482255+0000", 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2418999999999999e-05 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482281+0000", 2024-04-24T13:30:52.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6043000000000001e-05 2024-04-24T13:30:52.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482294+0000", 2024-04-24T13:30:52.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2873e-05 2024-04-24T13:30:52.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482395+0000", 2024-04-24T13:30:52.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101724 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482446+0000", 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0288999999999999e-05 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486063+0000", 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036179290000000002 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486165+0000", 2024-04-24T13:30:52.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101949 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:473 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'8, mlcod=32'6)", 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.980409497, 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034165060000000001, 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485338+0000", 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.573e-06 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485350+0000", 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485377+0000", 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6897e-05 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485397+0000", 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9287999999999999e-05 2024-04-24T13:30:52.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485521+0000", 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012448 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485572+0000", 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0704000000000001e-05 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488640+0000", 2024-04-24T13:30:52.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030685589999999998 2024-04-24T13:30:52.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488753+0000", 2024-04-24T13:30:52.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112682 2024-04-24T13:30:52.524 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.524 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.524 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.524 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:474 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'9, mlcod=32'6)", 2024-04-24T13:30:52.524 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:30:52.524 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.97803974, 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045500480000000001, 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:30:52.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487708+0000", 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4389999999999999e-06 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487718+0000", 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0386e-05 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487743+0000", 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5106999999999999e-05 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487762+0000", 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8348000000000001e-05 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487893+0000", 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130968 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487926+0000", 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3827e-05 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492194+0000", 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042671499999999999 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492256+0000", 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2823000000000005e-05 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.528 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:476 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.977247867999999, 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059105989999999999, 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:30:52.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488500+0000", 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4169999999999999e-06 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488510+0000", 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0462000000000001e-05 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488536+0000", 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6007e-05 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488553+0000", 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7037999999999998e-05 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488752+0000", 2024-04-24T13:30:52.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019892900000000001 2024-04-24T13:30:52.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488805+0000", 2024-04-24T13:30:52.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2800999999999998e-05 2024-04-24T13:30:52.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494315+0000", 2024-04-24T13:30:52.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055099650000000003 2024-04-24T13:30:52.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494409+0000", 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3980000000000005e-05 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'7)", 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.974272033999998, 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055780020000000003, 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.533 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.534 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.534 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:30:52.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:30:52.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491476+0000", 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8479999999999999e-06 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491503+0000", 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7189e-05 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491534+0000", 2024-04-24T13:30:52.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1222e-05 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491553+0000", 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9069e-05 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491769+0000", 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000215479 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491830+0000", 2024-04-24T13:30:52.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1169999999999999e-05 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.496974+0000", 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051441860000000002 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497052+0000", 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7838999999999998e-05 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:484 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'11, mlcod=32'8)", 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.968342672999999, 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022050070000000001, 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497405+0000", 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5889999999999999e-06 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497418+0000", 2024-04-24T13:30:52.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2700999999999999e-05 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497449+0000", 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0911000000000003e-05 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497473+0000", 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4326000000000001e-05 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497563+0000", 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9652000000000002e-05 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497589+0000", 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6669000000000002e-05 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499542+0000", 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019529180000000001 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499608+0000", 2024-04-24T13:30:52.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6241000000000005e-05 2024-04-24T13:30:52.542 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.542 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.542 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.542 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:511 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'3, mlcod=32'1)", 2024-04-24T13:30:52.542 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:30:52.542 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.953292746999999, 2024-04-24T13:30:52.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020247519999999999, 2024-04-24T13:30:52.542 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.542 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.543 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.543 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:30:52.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:30:52.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512455+0000", 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.463e-06 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512464+0000", 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.397e-06 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512488+0000", 2024-04-24T13:30:52.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3502e-05 2024-04-24T13:30:52.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512499+0000", 2024-04-24T13:30:52.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0908e-05 2024-04-24T13:30:52.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512620+0000", 2024-04-24T13:30:52.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012119 2024-04-24T13:30:52.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512672+0000", 2024-04-24T13:30:52.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2366e-05 2024-04-24T13:30:52.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514389+0000", 2024-04-24T13:30:52.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017172890000000001 2024-04-24T13:30:52.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514478+0000", 2024-04-24T13:30:52.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8636999999999999e-05 2024-04-24T13:30:52.546 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:544 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'12, mlcod=32'10)", 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.928134823000001, 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020839690000000002, 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:30:52.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:30:52.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537613+0000", 2024-04-24T13:30:52.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7710000000000001e-06 2024-04-24T13:30:52.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537627+0000", 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3580999999999999e-05 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537658+0000", 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1470999999999997e-05 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537680+0000", 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1447e-05 2024-04-24T13:30:52.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537779+0000", 2024-04-24T13:30:52.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9049000000000007e-05 2024-04-24T13:30:52.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537822+0000", 2024-04-24T13:30:52.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3815e-05 2024-04-24T13:30:52.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539590+0000", 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017677459999999999 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539695+0000", 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105089 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:552 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'13, mlcod=32'11)", 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.92099365, 2024-04-24T13:30:52.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031853350000000001, 2024-04-24T13:30:52.552 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.552 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.552 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.552 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:30:52.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:30:52.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544754+0000", 2024-04-24T13:30:52.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309999999999999e-06 2024-04-24T13:30:52.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544769+0000", 2024-04-24T13:30:52.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4259e-05 2024-04-24T13:30:52.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544803+0000", 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4650000000000002e-05 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544822+0000", 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8700999999999999e-05 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544956+0000", 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134482 2024-04-24T13:30:52.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544991+0000", 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4953000000000002e-05 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547847+0000", 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028556749999999998 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547938+0000", 2024-04-24T13:30:52.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0784000000000004e-05 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:705 6.1f e32/26 6:f93251ce:::obj_delete_at_hint.0000000042:head v 32'7, mlcod=32'5)", 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.788275942999999, 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018230220000000001, 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677472+0000", 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677483+0000", 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1025e-05 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677510+0000", 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6894e-05 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677522+0000", 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2367e-05 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677616+0000", 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4239000000000004e-05 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677656+0000", 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9681999999999997e-05 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679172+0000", 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015157529999999999 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679293+0000", 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012133099999999999 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:709 6.1e e32/26 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 32'1, mlcod=0'0)", 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.777858272, 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020442059999999998, 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:52.560 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:52.561 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:52.561 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:52.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:52.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:30:52.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:52.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:30:52.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:52.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.89e-07 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687895+0000", 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9959999999999996e-06 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687919+0000", 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3455000000000002e-05 2024-04-24T13:30:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687931+0000", 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2442e-05 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688076+0000", 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014435399999999999 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688127+0000", 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1910999999999998e-05 2024-04-24T13:30:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689827+0000", 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00169918 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689932+0000", 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105379 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:52.564 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:52.565 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:52.566 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:30:52.566 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:52.565+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:52.667 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:52.665+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:52.736 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:52.736 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:30:52.737 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:30:52.737 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:52.751 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:30:52.769 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:52.765+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:52.870 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:52.869+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:52.874 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:52.874 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:30:52.874 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:30:52.874 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:30:52.874 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:52.888 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:30:52.904 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:30:52.973 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:52.973+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:53.058 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:53.058 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:30:53.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:30:53.058 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:30:53.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.058 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.058 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:53.058 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.199948655999997, 2024-04-24T13:30:53.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:30:53.058 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.059 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.059 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.059 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.059 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.059 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.059 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:30:53.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.059 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:53.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:30:53.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:30:53.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:30:53.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:30:53.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:30:53.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:30:53.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:30:53.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:30:53.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:30:53.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:30:53.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:30:53.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:30:53.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:30:53.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:30:53.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:30:53.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:30:53.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:30:53.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:30:53.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.199925882000002, 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.065 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.066 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.066 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.066 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:30:53.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.066 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:30:53.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:30:53.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:30:53.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:30:53.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:30:53.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:30:53.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:30:53.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:30:53.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:30:53.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:30:53.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:30:53.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:30:53.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:30:53.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:30:53.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.070 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.070 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:30:53.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:30:53.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.070 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.070 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:30:53.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:30:53.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:30:53.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:30:53.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:30:53.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:30:53.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:30:53.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:30:53.072 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.072 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.072 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.072 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.072 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:53.072 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.102318449000002, 2024-04-24T13:30:53.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:30:53.073 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.073 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.073 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.073 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.073 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.073 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.073 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:30:53.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.073 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:53.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:53.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:53.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:30:53.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:30:53.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:30:53.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:30:53.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:30:53.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:30:53.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:30:53.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:30:53.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.102230812000002, 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.079 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.080 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.080 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:30:53.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.080 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:30:53.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:30:53.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.082 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:30:53.084 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.996576924999999, 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.085 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.086 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:30:53.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.086 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:30:53.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:30:53.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:30:53.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.088 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:30:53.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:30:53.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:30:53.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:30:53.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:30:53.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:30:53.090 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.091 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.091 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.094 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.094 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:30:53.094 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.996372407000003, 2024-04-24T13:30:53.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:30:53.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:30:53.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:30:53.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:30:53.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:30:53.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:30:53.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:30:53.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:30:53.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:30:53.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:30:53.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:30:53.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.996012583999999, 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:30:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:30:53.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:30:53.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:30:53.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:30:53.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:30:53.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:30:53.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:30:53.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:30:53.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:30:53.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:30:53.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:30:53.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:30:53.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:30:53.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:30:53.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:30:53.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:30:53.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:30:53.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:30:53.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:30:53.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:30:53.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:30:53.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:30:53.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:30:53.106 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.106 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.107 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.107 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.107 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:30:53.107 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.995844181000002, 2024-04-24T13:30:53.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:30:53.107 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.107 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.107 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:30:53.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:30:53.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:30:53.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:30:53.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:30:53.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:30:53.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:30:53.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:30:53.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:30:53.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:30:53.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:30:53.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:30:53.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:30:53.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:30:53.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:30:53.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:30:53.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:30:53.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:30:53.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:30:53.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:30:53.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:30:53.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:30:53.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:30:53.113 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.113 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.114 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.114 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.114 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:30:53.114 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.995635790000001, 2024-04-24T13:30:53.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:30:53.114 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.114 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.114 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.114 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.114 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.114 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.115 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:30:53.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.115 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:30:53.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:30:53.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:30:53.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:30:53.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:30:53.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:30:53.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:30:53.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:30:53.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:30:53.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:30:53.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:30:53.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:30:53.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:30:53.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.995537937000002, 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:30:53.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:30:53.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.126 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.995436787999999, 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:30:53.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:30:53.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:30:53.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:30:53.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:30:53.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.995180075999997, 2024-04-24T13:30:53.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:30:53.133 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.133 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.133 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.133 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.133 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.133 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.133 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:30:53.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.133 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:30:53.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:30:53.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:30:53.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:30:53.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:30:53.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:30:53.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:30:53.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:30:53.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:30:53.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:30:53.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:30:53.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:30:53.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:30:53.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:30:53.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:30:53.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:30:53.138 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.138 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.138 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.138 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.138 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:30:53.139 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.995070413999997, 2024-04-24T13:30:53.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:30:53.139 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.139 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.139 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.139 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.139 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.139 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.139 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:30:53.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.139 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:30:53.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:30:53.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:30:53.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:30:53.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:30:53.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:30:53.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:30:53.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:30:53.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:30:53.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:30:53.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:30:53.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:30:53.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:30:53.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:30:53.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.144 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.145 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.145 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.145 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:30:53.145 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.994998385000002, 2024-04-24T13:30:53.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:30:53.145 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.145 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.145 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.145 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.146 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.146 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.146 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:30:53.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.146 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:30:53.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:30:53.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:30:53.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:30:53.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:30:53.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:30:53.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:30:53.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:30:53.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:30:53.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:30:53.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.152 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.152 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:30:53.152 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.994827348999998, 2024-04-24T13:30:53.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:30:53.152 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.152 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.152 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.152 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.152 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.152 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.153 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:30:53.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.153 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:30:53.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:30:53.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:30:53.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:30:53.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:30:53.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:30:53.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:30:53.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:30:53.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:30:53.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:30:53.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:30:53.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:30:53.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:30:53.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:30:53.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:30:53.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:30:53.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:30:53.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:30:53.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:30:53.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.994787856000002, 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.159 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:30:53.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.164 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.741468599999997, 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:30:53.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.166 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:53.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:53.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:30:53.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:30:53.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:30:53.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:30:53.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:30:53.170 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.170 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.170 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.741442552000002, 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:30:53.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:30:53.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:30:53.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:30:53.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:30:53.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:30:53.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:30:53.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:30:53.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.176 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.741417196, 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:53.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:53.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:53.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:30:53.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:30:53.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:30:53.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:30:53.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:30:53.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:30:53.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:30:53.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:30:53.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:30:53.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:30:53.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:30:53.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:30:53.182 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.741326127000001, 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:53.183 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:30:53.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.184 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:53.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:53.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:30:53.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:30:53.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:30:53.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:30:53.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:30:53.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:30:53.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:53.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:30:53.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:30:53.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:53.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:53.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:53.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:30:53.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:30:53.189 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.189 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.189 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.189 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:53.189 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:53.189 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:53.191 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:53.189+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:53.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:30:53.291 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:53.289+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:53.324 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:53.325 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:53.325 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:30:53.325 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:53.339 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:30:53.392 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:53.389+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:53.462 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:53.462 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:53.462 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:30:53.462 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:30:53.462 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:53.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:30:53.493 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:53.493+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:53.594 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:53.593+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:53.600 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:30:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:30:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:30:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:30:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:30:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.676052443000003, 2024-04-24T13:30:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:30:53.600 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:30:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:30:53.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:30:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:30:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:30:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:30:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:30:53.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:30:53.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.533260673000001, 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:30:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:30:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:30:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:30:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:30:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:30:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:30:53.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:30:53.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:30:53.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:30:53.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:30:53.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:30:53.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:30:53.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:30:53.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:30:53.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:30:53.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:30:53.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:30:53.610 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.610 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.610 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.610 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:30:53.610 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:30:53.610 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.530957604999998, 2024-04-24T13:30:53.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:30:53.611 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.611 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.611 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.611 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:30:53.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:30:53.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:30:53.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:30:53.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:30:53.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:30:53.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:30:53.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:30:53.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:30:53.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:30:53.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:30:53.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:30:53.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:30:53.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:30:53.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:30:53.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:30:53.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:30:53.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:30:53.615 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.615 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.616 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.616 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:30:53.616 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:53.616 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.529263088, 2024-04-24T13:30:53.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:30:53.616 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.616 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.616 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.617 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:53.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:53.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:53.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:30:53.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:30:53.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:30:53.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:30:53.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:30:53.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:30:53.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:30:53.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:30:53.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:30:53.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:30:53.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:30:53.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.621 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:30:53.622 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:30:53.622 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.527805477000001, 2024-04-24T13:30:53.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:30:53.622 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.622 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.622 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.622 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:30:53.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:30:53.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:30:53.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:30:53.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:30:53.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:30:53.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:30:53.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:30:53.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:30:53.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:30:53.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:30:53.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:30:53.626 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.626 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.626 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.626 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:30:53.626 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:30:53.626 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.525876388, 2024-04-24T13:30:53.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:30:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:30:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:30:53.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:30:53.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:30:53.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:30:53.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:30:53.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:30:53.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:30:53.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:30:53.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:30:53.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:30:53.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:30:53.630 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.523451850999997, 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:30:53.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:30:53.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:30:53.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:30:53.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:30:53.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:30:53.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.522249102000004, 2024-04-24T13:30:53.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:30:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:30:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:30:53.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:30:53.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:30:53.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:30:53.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:30:53.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:30:53.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:30:53.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:30:53.639 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.519042937000002, 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:30:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:30:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:30:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:30:53.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:30:53.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:30:53.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:30:53.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:30:53.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.644 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.645 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:30:53.645 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:30:53.645 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.279987353000003, 2024-04-24T13:30:53.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:30:53.645 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.645 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.645 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.645 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:30:53.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:30:53.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:30:53.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:30:53.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:30:53.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:30:53.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:30:53.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:30:53.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:30:53.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:30:53.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:30:53.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:30:53.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:30:53.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:30:53.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:30:53.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:30:53.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:30:53.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:30:53.650 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.650 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.650 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.650 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:30:53.650 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:30:53.650 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.277566702000001, 2024-04-24T13:30:53.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:30:53.651 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.651 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.651 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.651 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:30:53.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:30:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:30:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:30:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:30:53.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:30:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:30:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:30:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:30:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:30:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:30:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:30:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:30:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:30:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:30:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:30:53.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:30:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:30:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:30:53.656 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:30:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.276793484000002, 2024-04-24T13:30:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:30:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:30:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:30:53.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:30:53.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:30:53.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:30:53.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:30:53.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:30:53.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:30:53.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:30:53.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:30:53.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:30:53.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:30:53.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:30:53.661 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.661 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.661 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.661 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:30:53.661 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:30:53.661 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.269054429999997, 2024-04-24T13:30:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:30:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:30:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:30:53.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:30:53.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:30:53.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:30:53.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:30:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:30:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:30:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:30:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.921092323000003, 2024-04-24T13:30:53.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:30:53.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:30:53.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:30:53.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:30:53.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:30:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:30:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:30:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:30:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:30:53.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:30:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:30:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:30:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:30:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:30:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:30:53.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:30:53.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.671 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.671 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:30:53.671 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:30:53.671 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.920343574999997, 2024-04-24T13:30:53.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:30:53.671 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.672 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.672 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.672 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:30:53.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:30:53.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:30:53.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:30:53.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:30:53.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:30:53.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:30:53.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:30:53.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:30:53.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:30:53.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:30:53.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:30:53.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:30:53.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:30:53.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:30:53.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:30:53.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:30:53.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:30:53.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.676 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.676 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:30:53.676 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:30:53.676 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.919412450000003, 2024-04-24T13:30:53.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:30:53.677 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.677 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.677 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:30:53.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:30:53.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:30:53.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:30:53.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:30:53.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:30:53.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:30:53.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:30:53.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:30:53.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:30:53.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:30:53.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:30:53.681 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.681 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.681 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.681 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:30:53.681 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:30:53.681 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.918920659000001, 2024-04-24T13:30:53.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:30:53.681 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.682 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.682 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.682 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:30:53.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:30:53.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:30:53.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:30:53.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:30:53.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:30:53.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:30:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:30:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:30:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:30:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.332839235000002, 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.686 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:53.687 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:53.687 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:53.687 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:30:53.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.687 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:30:53.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:30:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:30:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:30:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:30:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:30:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:30:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:30:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:30:53.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:30:53.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:30:53.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:30:53.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:30:53.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:30:53.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:30:53.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:30:53.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:30:53.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:30:53.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:30:53.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:53.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:30:53.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:30:53.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:53.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:30:53.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:30:53.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:30:53.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:30:53.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:30:53.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:30:53.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:30:53.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:30:53.694 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.694 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.694 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.695 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:53.695 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:30:53.695 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.303992036, 2024-04-24T13:30:53.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:30:53.695 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.695 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.695 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.695 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:53.695 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:53.696 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:53.696 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:30:53.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.696 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:30:53.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:30:53.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:30:53.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:30:53.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:30:53.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:30:53.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:53.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:30:53.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.265800792, 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:53.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:30:53.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:53.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:30:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:30:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:30:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:30:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:30:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:30:53.706 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:53.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:53.707 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:53.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:30:53.709 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:53.705+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:53.809 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:53.809+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:53.877 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:53.878 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:53.878 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:30:53.878 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:53.892 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:30:53.911 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:53.909+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:54.012 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:30:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:30:54.012 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:54.013 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:54.009+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:54.026 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:30:54.115 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:54.113+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:54.153 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:54.154 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:30:54.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:30:54.154 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:30:54.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.154 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:30:54.154 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:30:54.154 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.934137902, 2024-04-24T13:30:54.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:30:54.154 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.154 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.154 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:30:54.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:30:54.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:30:54.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:30:54.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:30:54.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:30:54.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:30:54.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:30:54.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:30:54.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:30:54.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:30:54.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:30:54.159 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.160 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.160 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.160 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:30:54.160 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:30:54.161 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.878428822, 2024-04-24T13:30:54.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:30:54.161 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.161 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.161 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.161 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.161 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:30:54.161 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:30:54.161 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:30:54.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.161 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:30:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:30:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:30:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:30:54.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:30:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:30:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:30:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:30:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:30:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:30:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:30:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:30:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.874361682, 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:30:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:30:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:30:54.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:30:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:30:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:30:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:30:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:30:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:30:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:30:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:30:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:30:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:30:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:30:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:30:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:30:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:30:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:30:54.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:30:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.872007790000001, 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:30:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:30:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:30:54.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:54.177 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:30:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.770981987999999, 2024-04-24T13:30:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:30:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:30:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:30:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:30:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:30:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:30:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:30:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:30:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:30:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:30:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:30:54.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.863232997000001, 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.185 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:30:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:30:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.190 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.839437024999999, 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:30:54.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:30:54.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.812741904999999, 2024-04-24T13:30:54.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:30:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:30:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:30:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.794999984, 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:30:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:30:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:30:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:30:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:30:54.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:30:54.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.761829775999999, 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.208 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:30:54.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:30:54.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.713797569, 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.214 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:30:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:30:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.219 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.687549914000002, 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:30:54.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.628167511000001, 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:30:54.225 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:30:54.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:30:54.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.579700404, 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:30:54.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:30:54.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.236 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.194009830999999, 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:30:54.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:30:54.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.999921936, 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:30:54.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:30:54.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:30:54.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.995908663000002, 2024-04-24T13:30:54.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:30:54.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:30:54.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:30:54.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.963855524, 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.254 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:30:54.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:30:54.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.959311523, 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:30:54.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:30:54.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:30:54.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 20.926160515999999, 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:30:54.265 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:30:54.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:30:54.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:30:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:30:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:30:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:30:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:54.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:30:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:30:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:54.271 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:54.271 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:54.272 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:30:54.273 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:54.269+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:54.342 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:30:54.374 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:54.373+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:54.400 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:54.401 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:54.401 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:30:54.401 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:54.417 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:30:54.475 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:54.473+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:54.482 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:30:54.483 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:30:54.500 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:30:54.500 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:30:54.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:30:54.516 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:30:54.533 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:30:54.533 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:30:54.536 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:54.536 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:54.550 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:30:54.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:30:54.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:30:54.575 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:30:54.575 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:30:54.575 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:54.573+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:54.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:30:54.595 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:30:54.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:30:54.616 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:30:54.669 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:54.669 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:54.676 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:54.673+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:54.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:30:54.777 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:54.777+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:54.841 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:54.841 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:54.855 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:30:54.902 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:54.901+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:54.934 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:30:54.973 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:54.973 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:54.978 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:54.977+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:54.988 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:30:55.079 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:55.077+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:55.153 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:55.154 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:55.174 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:30:55.180 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:55.177+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:55.281 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:55.277+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:55.310 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:55.310 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:55.325 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:30:55.383 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:55.381+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:55.454 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:55.455 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:55.469 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:30:55.484 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:55.481+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:55.588 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:55.581+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:55.636 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:55.637 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:55.651 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:30:55.687 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:55.685+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:55.790 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:55.789+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:55.822 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:55.822 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:55.836 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:30:55.889 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:55.885+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:55.924 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:30:55.963 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:55.963 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:55.978 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:30:55.997 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:55.993+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:56.091 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:56.089+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:56.148 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:56.148 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:56.162 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:30:56.206 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:56.205+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:56.293 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:56.293+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:56.329 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:56.329 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:56.343 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:30:56.433 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:56.433+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:56.495 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:56.493+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:56.507 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:56.507 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:56.521 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:30:56.613 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:56.613+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:56.635 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:30:56.684 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:56.684 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:56.696 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:56.693+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:56.698 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:30:56.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:30:56.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:30:56.797 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:56.793+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:56.806 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:30:56.806 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:30:56.823 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:30:56.824 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:30:56.840 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:30:56.840 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:30:56.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:30:56.859 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:30:56.865 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:56.865 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:56.879 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:30:56.880 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:30:56.880 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:30:56.898 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:56.897+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:56.899 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:30:56.899 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:30:56.917 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:30:56.917 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:30:56.997 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:56.997 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:30:56.998 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:30:56.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:30:56.998 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:56.999 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:56.997+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:57.012 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:30:57.100 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:57.097+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:57.178 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:30:57.178 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:30:57.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:30:57.178 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:30:57.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.179 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.179 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:57.179 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.322070429999997, 2024-04-24T13:30:57.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:30:57.179 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.179 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.179 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.179 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.179 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.179 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.179 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:30:57.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.180 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:57.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:57.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:30:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:30:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:30:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:30:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:30:57.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:30:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:30:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:30:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:30:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:30:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.184 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.185 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.185 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.185 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:30:57.185 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.322047656000002, 2024-04-24T13:30:57.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:30:57.185 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.185 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.185 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.185 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.185 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.185 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.186 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:30:57.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.186 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:30:57.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:30:57.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:30:57.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:30:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:30:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:30:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:30:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:30:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:30:57.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:30:57.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:30:57.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:30:57.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:30:57.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:30:57.190 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.224440223000002, 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.191 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:30:57.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:30:57.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:30:57.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:30:57.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:30:57.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.196 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.224352586000002, 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:30:57.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.198 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:30:57.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:30:57.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:30:57.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:30:57.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:30:57.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:30:57.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:30:57.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:30:57.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:30:57.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:30:57.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:30:57.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:30:57.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:30:57.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.118698698999999, 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.203 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:30:57.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:30:57.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:30:57.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:30:57.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:30:57.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:30:57.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:30:57.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:30:57.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:30:57.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:30:57.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:30:57.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.118494181000003, 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.209 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.210 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:30:57.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.210 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:30:57.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:30:57.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:30:57.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:30:57.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:30:57.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:30:57.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:30:57.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:30:57.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.118134357999999, 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.215 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.216 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:30:57.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.216 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:30:57.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:30:57.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:30:57.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:30:57.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:30:57.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:30:57.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:30:57.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:30:57.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:30:57.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:30:57.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:30:57.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:30:57.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.221 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.222 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.222 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.222 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:30:57.222 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.117965955000003, 2024-04-24T13:30:57.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:30:57.222 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.222 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.222 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.223 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:30:57.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.223 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:30:57.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:30:57.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:30:57.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:30:57.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:30:57.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:30:57.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:30:57.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:30:57.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:30:57.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:30:57.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:30:57.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:30:57.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:30:57.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:30:57.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.117757564000001, 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.228 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:30:57.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:30:57.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:30:57.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:30:57.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:30:57.233 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.234 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.234 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.234 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.234 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:30:57.234 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.117659711000002, 2024-04-24T13:30:57.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:30:57.234 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.234 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.234 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.234 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.234 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.235 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.235 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:30:57.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.235 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:30:57.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:30:57.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:30:57.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:30:57.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:30:57.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:30:57.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:30:57.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:30:57.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:30:57.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:30:57.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:30:57.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:30:57.240 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.240 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.240 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.240 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.240 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:30:57.240 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.117558561999999, 2024-04-24T13:30:57.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:30:57.240 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.240 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:30:57.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:30:57.245 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.117301849999997, 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.246 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:30:57.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:30:57.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:30:57.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:30:57.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:30:57.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:30:57.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:30:57.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:30:57.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:30:57.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:30:57.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.251 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.117192187999997, 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:30:57.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.257 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.117120159000002, 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:30:57.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:30:57.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:30:57.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:30:57.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:30:57.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:30:57.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:30:57.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:30:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:30:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:30:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:30:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.116949122999998, 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:30:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:30:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:30:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:30:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:30:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:30:57.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:30:57.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:30:57.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:30:57.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:30:57.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:30:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:30:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:30:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:30:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.269 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.116909630000002, 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:30:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:30:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:30:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:30:57.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:30:57.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:30:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:30:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:30:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:30:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.275 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.863590373999997, 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:57.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:57.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:30:57.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:30:57.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:30:57.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.281 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.863564326000002, 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:30:57.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:30:57.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:30:57.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:30:57.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:30:57.287 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.287 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.287 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.287 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.287 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:57.287 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.86353897, 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:57.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:30:57.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:30:57.293 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.293 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.293 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.293 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:30:57.293 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:30:57.293 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.863447901000001, 2024-04-24T13:30:57.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:30:57.293 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:30:57.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:30:57.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:30:57.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:30:57.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:30:57.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:30:57.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:30:57.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:30:57.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:30:57.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:30:57.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:30:57.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:30:57.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:30:57.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:30:57.299 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.299 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.299 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.299 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:30:57.299 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:30:57.299 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:30:57.301 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:57.297+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:57.301 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:30:57.402 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:57.401+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:57.434 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:57.434 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:57.434 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:30:57.434 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:57.448 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:30:57.503 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:57.501+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:57.573 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:57.573 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:57.573 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:30:57.573 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:30:57.573 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:57.587 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:30:57.634 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:57.633+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:57.704 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:57.701+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:57.710 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:57.710 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:30:57.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:30:57.710 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:30:57.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.710 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:30:57.710 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.785982857999997, 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:30:57.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:30:57.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:30:57.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:30:57.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:30:57.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:30:57.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:30:57.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:30:57.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.714 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.643191088000002, 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:30:57.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:30:57.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:30:57.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:30:57.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:30:57.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:30:57.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:30:57.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:30:57.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:30:57.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.719 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.640888019999998, 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:30:57.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:30:57.723 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.639193503000001, 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:57.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:57.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:30:57.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.637735892000002, 2024-04-24T13:30:57.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:30:57.729 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.729 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.729 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.729 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:30:57.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:30:57.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:30:57.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:30:57.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:30:57.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:30:57.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:30:57.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:30:57.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:30:57.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:30:57.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:30:57.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:30:57.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:30:57.733 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.733 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.733 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.733 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:30:57.734 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:30:57.734 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.635806803000001, 2024-04-24T13:30:57.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:30:57.734 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.734 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.734 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.734 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:30:57.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:30:57.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:30:57.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:30:57.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:30:57.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:30:57.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:30:57.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:30:57.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:30:57.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:30:57.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:30:57.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:30:57.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:30:57.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:30:57.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:30:57.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:30:57.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:30:57.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:30:57.739 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.739 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.739 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.739 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:30:57.739 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:30:57.739 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.633382265999998, 2024-04-24T13:30:57.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:30:57.740 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.740 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.740 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.740 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:30:57.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:30:57.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:30:57.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:30:57.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:30:57.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:30:57.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:30:57.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:30:57.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.632179516999997, 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:30:57.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.628973352000003, 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:30:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:30:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:30:57.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:30:57.753 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.389917767999997, 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:30:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:30:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:30:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:30:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:30:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:30:57.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:30:57.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.387497117000002, 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:30:57.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:30:57.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:30:57.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:30:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:30:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:30:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:30:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.386723899000003, 2024-04-24T13:30:57.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:30:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:30:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:30:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:30:57.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:30:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:30:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:30:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:30:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:30:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:30:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:30:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:30:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:30:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:30:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.378984844999998, 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.767 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:30:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:30:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:30:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:30:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:30:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:30:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:30:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:30:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:30:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:30:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:30:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:30:57.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:30:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:30:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:30:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:30:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.031022737999997, 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:30:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:30:57.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:30:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:30:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:30:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:30:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:30:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:30:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:30:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:30:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:30:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:30:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:30:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:30:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:30:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:30:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:30:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:30:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:30:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:30:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.030273989999998, 2024-04-24T13:30:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:30:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.778 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:30:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:30:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:30:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:30:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:30:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:30:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:30:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:30:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:30:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:30:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:30:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:30:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:30:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:30:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:30:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:30:57.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.029342864999997, 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:30:57.783 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:30:57.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:30:57.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.028851074000002, 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:30:57.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:30:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:30:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:30:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:30:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.442769649999999, 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.792 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:30:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:30:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:30:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:30:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:30:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:30:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:30:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:30:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:30:57.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:30:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:30:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:30:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:30:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:30:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:30:57.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:30:57.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:30:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:30:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:30:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.413922451000001, 2024-04-24T13:30:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:30:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.800 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:30:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:30:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:30:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:30:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:30:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:30:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:30:57.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:30:57.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:30:57.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:30:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:30:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:30:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:30:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:30:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:30:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.806 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:30:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.375731207000001, 2024-04-24T13:30:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:30:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:57.807 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:30:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:30:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:30:57.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:30:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:30:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:30:57.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:57.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:30:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:30:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:30:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:30:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:30:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:30:57.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:30:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:30:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:30:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:30:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:57.814 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:57.814 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:57.816 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:30:57.816 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:57.813+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:57.917 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:57.913+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:57.949 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:30:57.988 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:57.988 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:30:57.988 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:58.003 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:30:58.050 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:58.049+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:58.118 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:58.117+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:58.166 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:30:58.167 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:30:58.167 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:58.180 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:30:58.219 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:58.217+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:30:58.320 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:58.317+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:58.343 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:30:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:30:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:30:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:30:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:30:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.123730037999998, 2024-04-24T13:30:58.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:30:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:30:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:30:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:30:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:30:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.344 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:30:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:30:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:30:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:30:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:30:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:30:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:30:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:30:58.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:30:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:30:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:30:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:30:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:30:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:30:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:30:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:30:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:30:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:30:58.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:30:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:30:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:30:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.068020957999998, 2024-04-24T13:30:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:30:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.349 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:30:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:30:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:30:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:30:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:30:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:30:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:30:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:30:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:30:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:30:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:30:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:30:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:30:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:30:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:30:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:30:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:30:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:30:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:30:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:30:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:30:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:30:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:30:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:30:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:30:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:30:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:30:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:30:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:30:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.063953818000002, 2024-04-24T13:30:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:30:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:30:58.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:30:58.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:30:58.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.061599926, 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:30:58.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:30:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:30:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:30:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:30:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:30:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:30:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.960574124000001, 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:30:58.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:30:58.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.052825132999999, 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:30:58.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:30:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:30:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:30:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:30:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:30:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:30:58.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:30:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.029029161, 2024-04-24T13:30:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:30:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:30:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:30:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:30:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:30:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:30:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:30:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:30:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:30:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:30:58.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:30:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:30:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:30:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:30:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:30:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:30:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:30:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:30:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:30:58.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:30:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:30:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:30:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:30:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:30:58.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:30:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.002334041000001, 2024-04-24T13:30:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:30:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.386 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:30:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:30:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:30:58.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:30:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:30:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:30:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:30:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:30:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:30:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:30:58.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:30:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:30:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:30:58.392 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.984592119999999, 2024-04-24T13:30:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:30:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.393 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:30:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:30:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:30:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:30:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:30:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:30:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:30:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:30:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:30:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:30:58.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:30:58.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.951421912000001, 2024-04-24T13:30:58.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:30:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:30:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:30:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:30:58.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.903389704999999, 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.405 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:30:58.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:30:58.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.87714205, 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.411 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:30:58.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:30:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:30:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:30:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:30:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:30:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:30:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:30:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:30:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:30:58.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:30:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:30:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:30:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:30:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:30:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:30:58.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:30:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:30:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.817759646999999, 2024-04-24T13:30:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:30:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:30:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:30:58.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:30:58.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:30:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:30:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:30:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:30:58.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:30:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:30:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:30:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:30:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:30:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:30:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:30:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:30:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:30:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:30:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:30:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:30:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:30:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:30:58.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:30:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:30:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.769292539999999, 2024-04-24T13:30:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:30:58.425 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:30:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:30:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:30:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:30:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:30:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:30:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:30:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:30:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:30:58.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:30:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:30:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:30:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:30:58.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:30:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:30:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:30:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:30:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:30:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:30:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.383601967000001, 2024-04-24T13:30:58.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:30:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:30:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:30:58.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:30:58.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.189514072000001, 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:30:58.438 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:30:58.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:30:58.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.185500799, 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.444 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:30:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:30:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:30:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:30:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:30:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:30:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:30:58.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:30:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:30:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:30:58.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:30:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:30:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:30:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:30:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:30:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:30:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:30:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:30:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:30:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:30:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:30:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:30:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:30:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:30:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:30:58.450 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:30:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.153447660000001, 2024-04-24T13:30:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:30:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.451 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:30:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:30:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:30:58.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:30:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:30:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:30:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:30:58.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:30:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:30:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:30:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:30:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:30:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:30:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:30:58.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:30:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.148903658999998, 2024-04-24T13:30:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:30:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.458 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:30:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:30:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:30:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:30:58.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:30:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:30:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:30:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:30:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:30:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:30:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:30:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:30:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:30:58.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:30:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:30:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:30:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:30:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:30:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:30:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:30:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:30:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:30:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:30:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.464 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.115752652000001, 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.465 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:30:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:30:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:30:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:30:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:30:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:30:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:30:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:30:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:30:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:30:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:30:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:30:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:30:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:30:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:30:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:30:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:30:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:30:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:30:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.472 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.472 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:58.473 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:30:58.474 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:30:58.469+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:30:58.575 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:58.573+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:58.641 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:30:58.642 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:58.655 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:30:58.702 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:58.701+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:58.772 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:30:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:30:58.772 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:30:58.772 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:58.777 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:30:58.773+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:30:58.786 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:30:58.877 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:58.877+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:58.936 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:30:58.951 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:30:58.963 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:30:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:30:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:30:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:30:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:30:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:30:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.679821384, 2024-04-24T13:30:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026500819999999998, 2024-04-24T13:30:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.964 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:30:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:30:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 42 2024-04-24T13:30:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:30:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:30:58.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283130+0000", 2024-04-24T13:30:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3599999999999999e-06 2024-04-24T13:30:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283143+0000", 2024-04-24T13:30:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2989999999999999e-05 2024-04-24T13:30:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283175+0000", 2024-04-24T13:30:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1262e-05 2024-04-24T13:30:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283190+0000", 2024-04-24T13:30:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5333999999999999e-05 2024-04-24T13:30:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283279+0000", 2024-04-24T13:30:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8616000000000007e-05 2024-04-24T13:30:58.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283443+0000", 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016473200000000001 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283600+0000", 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015686500000000001 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.284799+0000", 2024-04-24T13:30:58.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011988229999999999 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285616+0000", 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081652500000000002 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285709+0000", 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3109999999999995e-05 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285778+0000", 2024-04-24T13:30:58.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9465e-05 2024-04-24T13:30:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:30:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:30:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.674947115999998, 2024-04-24T13:30:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025615049999999999, 2024-04-24T13:30:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.970 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 52 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:30:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288005+0000", 2024-04-24T13:30:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:30:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288017+0000", 2024-04-24T13:30:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1995e-05 2024-04-24T13:30:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288050+0000", 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2555999999999998e-05 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288063+0000", 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3774999999999999e-05 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288165+0000", 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101394 2024-04-24T13:30:58.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288357+0000", 2024-04-24T13:30:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019187800000000001 2024-04-24T13:30:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:30:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288525+0000", 2024-04-24T13:30:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016830600000000001 2024-04-24T13:30:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.289691+0000", 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011659629999999999 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290333+0000", 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064243099999999995 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290439+0000", 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105689 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290564+0000", 2024-04-24T13:30:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012480600000000001 2024-04-24T13:30:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:30:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.563504502000001, 2024-04-24T13:30:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:30:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.976 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:30:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:30:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:30:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:30:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:30:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:30:58.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:30:58.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:30:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:30:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:30:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.551427123, 2024-04-24T13:30:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029424360000000001, 2024-04-24T13:30:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.982 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 279 2024-04-24T13:30:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:30:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:30:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411523+0000", 2024-04-24T13:30:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0899999999999999e-06 2024-04-24T13:30:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411539+0000", 2024-04-24T13:30:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:30:58.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411556+0000", 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6588000000000001e-05 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411564+0000", 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6929999999999996e-06 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411638+0000", 2024-04-24T13:30:58.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3244999999999994e-05 2024-04-24T13:30:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411745+0000", 2024-04-24T13:30:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107876 2024-04-24T13:30:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411936+0000", 2024-04-24T13:30:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000190819 2024-04-24T13:30:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.412644+0000", 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070752499999999997 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414368+0000", 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017246850000000001 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414419+0000", 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0513999999999998e-05 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414465+0000", 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5862000000000002e-05 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.547720743999999, 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.988 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:30:58.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:30:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:30:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:30:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:30:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:30:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:30:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:691 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:30:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.304568907, 2024-04-24T13:30:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027367860000000002, 2024-04-24T13:30:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:58.994 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 691 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:30:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658383+0000", 2024-04-24T13:30:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7719999999999999e-06 2024-04-24T13:30:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658393+0000", 2024-04-24T13:30:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1840000000000005e-06 2024-04-24T13:30:58.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658414+0000", 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0967000000000001e-05 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658424+0000", 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0961000000000001e-05 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658556+0000", 2024-04-24T13:30:58.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013183199999999999 2024-04-24T13:30:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658781+0000", 2024-04-24T13:30:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022427499999999999 2024-04-24T13:30:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.659230+0000", 2024-04-24T13:30:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044896299999999998 2024-04-24T13:30:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660178+0000", 2024-04-24T13:30:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094838799999999999 2024-04-24T13:30:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660868+0000", 2024-04-24T13:30:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000689575 2024-04-24T13:30:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661012+0000", 2024-04-24T13:30:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000144735 2024-04-24T13:30:58.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661117+0000", 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105134 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.104447952000001, 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.000 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:30:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:30:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:30:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:30:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:30:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:30:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:30:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:30:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:30:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:30:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:30:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:30:59.004 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.041104434000001, 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:59.005 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:30:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:30:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:30:59.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:30:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:30:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:30:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:30:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:30:59.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:30:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:30:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.036428739000002, 2024-04-24T13:30:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:30:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.011 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:30:59.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:30:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:30:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:30:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:30:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:30:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:30:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:30:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:30:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:30:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:30:59.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:30:59.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.98450489, 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028643660000000001, 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:59.017 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 841 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978447+0000", 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978459+0000", 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.224e-05 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978489+0000", 2024-04-24T13:30:59.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9583000000000001e-05 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978504+0000", 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978612+0000", 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107327 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978831+0000", 2024-04-24T13:30:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021982300000000001 2024-04-24T13:30:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.979160+0000", 2024-04-24T13:30:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032855299999999998 2024-04-24T13:30:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.980242+0000", 2024-04-24T13:30:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010821649999999999 2024-04-24T13:30:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981019+0000", 2024-04-24T13:30:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00077641199999999998 2024-04-24T13:30:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981185+0000", 2024-04-24T13:30:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016605499999999999 2024-04-24T13:30:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981309+0000", 2024-04-24T13:30:59.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012434300000000001 2024-04-24T13:30:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:30:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.980384008000001, 2024-04-24T13:30:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:30:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:30:59.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:30:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:30:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:30:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:30:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:30:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:30:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:30:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:30:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:30:59.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:30:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:30:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:30:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.029 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:30:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.970637972999999, 2024-04-24T13:30:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:30:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:30:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:30:59.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:30:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:30:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:30:59.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:30:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:30:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:30:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:30:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:30:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:30:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:30:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:30:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:30:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:30:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:30:59.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:30:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:30:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.966091161000001, 2024-04-24T13:30:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002954763, 2024-04-24T13:30:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.036 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 849 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:30:59.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996861+0000", 2024-04-24T13:30:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2069999999999998e-06 2024-04-24T13:30:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996871+0000", 2024-04-24T13:30:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0753e-05 2024-04-24T13:30:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996903+0000", 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996922+0000", 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8595999999999999e-05 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997042+0000", 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119646 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997271+0000", 2024-04-24T13:30:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228963 2024-04-24T13:30:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997736+0000", 2024-04-24T13:30:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000465181 2024-04-24T13:30:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999022+0000", 2024-04-24T13:30:59.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012864829999999999 2024-04-24T13:30:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999529+0000", 2024-04-24T13:30:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050722400000000002 2024-04-24T13:30:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999697+0000", 2024-04-24T13:30:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016795499999999999 2024-04-24T13:30:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999813+0000", 2024-04-24T13:30:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115746 2024-04-24T13:30:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:30:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.921805908, 2024-04-24T13:30:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027316710000000002, 2024-04-24T13:30:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 868 2024-04-24T13:30:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:30:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041146+0000", 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041156+0000", 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0772e-05 2024-04-24T13:30:59.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041184+0000", 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7616000000000001e-05 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041199+0000", 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4582e-05 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041309+0000", 2024-04-24T13:30:59.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011029799999999999 2024-04-24T13:30:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041532+0000", 2024-04-24T13:30:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022316 2024-04-24T13:30:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041846+0000", 2024-04-24T13:30:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031406700000000001 2024-04-24T13:30:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043088+0000", 2024-04-24T13:30:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001241409 2024-04-24T13:30:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043667+0000", 2024-04-24T13:30:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057961000000000004 2024-04-24T13:30:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043767+0000", 2024-04-24T13:30:59.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100166 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043875+0000", 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107871 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.832628639999999, 2024-04-24T13:30:59.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003049946, 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 907 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:30:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130323+0000", 2024-04-24T13:30:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5859999999999999e-06 2024-04-24T13:30:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130336+0000", 2024-04-24T13:30:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.218e-05 2024-04-24T13:30:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130367+0000", 2024-04-24T13:30:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1665000000000003e-05 2024-04-24T13:30:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130382+0000", 2024-04-24T13:30:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5113000000000001e-05 2024-04-24T13:30:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130510+0000", 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012778999999999999 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130749+0000", 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238669 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.131082+0000", 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033360300000000002 2024-04-24T13:30:59.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.132266+0000", 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001183627 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133172+0000", 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090542200000000002 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133259+0000", 2024-04-24T13:30:59.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:30:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133371+0000", 2024-04-24T13:30:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011194 2024-04-24T13:30:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:30:59.054 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.828809791000001, 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002722543, 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 909 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:30:59.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:30:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134141+0000", 2024-04-24T13:30:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:30:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134150+0000", 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9430000000000006e-06 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134172+0000", 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1296000000000001e-05 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134187+0000", 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5659e-05 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134275+0000", 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7787000000000005e-05 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134403+0000", 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127677 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134686+0000", 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028353500000000002 2024-04-24T13:30:59.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.135742+0000", 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010557800000000001 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136663+0000", 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092043500000000005 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136753+0000", 2024-04-24T13:30:59.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0871000000000005e-05 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136862+0000", 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010883 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.735114909, 2024-04-24T13:30:59.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029521759999999999, 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 949 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:30:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227837+0000", 2024-04-24T13:30:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2189999999999998e-06 2024-04-24T13:30:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227848+0000", 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-05 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227876+0000", 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8972999999999999e-05 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227892+0000", 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5965999999999999e-05 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228028+0000", 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135322 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228256+0000", 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228237 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228706+0000", 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045042599999999997 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.229990+0000", 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012836799999999999 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230579+0000", 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058925199999999996 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230673+0000", 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3484000000000001e-05 2024-04-24T13:30:59.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230787+0000", 2024-04-24T13:30:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113917 2024-04-24T13:30:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:30:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.731007818999998, 2024-04-24T13:30:59.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:30:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:30:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.067 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:30:59.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:30:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:30:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:30:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:30:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:30:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:30:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:30:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:30:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:30:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:30:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:30:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:30:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:30:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:30:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:30:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:30:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:30:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:30:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:30:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:30:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:30:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:30:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.720808035000001, 2024-04-24T13:30:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030452859999999999, 2024-04-24T13:30:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:59.074 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 955 2024-04-24T13:30:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:30:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:30:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242144+0000", 2024-04-24T13:30:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2500000000000001e-06 2024-04-24T13:30:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242155+0000", 2024-04-24T13:30:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1779e-05 2024-04-24T13:30:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242186+0000", 2024-04-24T13:30:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0879e-05 2024-04-24T13:30:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242202+0000", 2024-04-24T13:30:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5566e-05 2024-04-24T13:30:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242338+0000", 2024-04-24T13:30:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013631299999999999 2024-04-24T13:30:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242700+0000", 2024-04-24T13:30:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036144900000000002 2024-04-24T13:30:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.243261+0000", 2024-04-24T13:30:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056143600000000001 2024-04-24T13:30:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.244736+0000", 2024-04-24T13:30:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001475248 2024-04-24T13:30:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245034+0000", 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029792099999999998 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245119+0000", 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4876999999999994e-05 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245187+0000", 2024-04-24T13:30:59.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7568000000000001e-05 2024-04-24T13:30:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:30:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:30:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.716882600000002, 2024-04-24T13:30:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026970509999999998, 2024-04-24T13:30:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:30:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:30:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:30:59.081 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:30:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:30:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:30:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 957 2024-04-24T13:30:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:30:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:30:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:30:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:30:59.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:30:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:30:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:30:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246069+0000", 2024-04-24T13:30:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4600000000000002e-06 2024-04-24T13:30:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:30:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246081+0000", 2024-04-24T13:30:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1780000000000001e-05 2024-04-24T13:30:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246105+0000", 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3805999999999999e-05 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246120+0000", 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5415999999999999e-05 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246221+0000", 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010027 2024-04-24T13:30:59.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246367+0000", 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014653299999999999 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246645+0000", 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000277681 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.247868+0000", 2024-04-24T13:30:59.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001223373 2024-04-24T13:30:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:30:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248563+0000", 2024-04-24T13:30:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694781 2024-04-24T13:30:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:30:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248648+0000", 2024-04-24T13:30:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5187999999999998e-05 2024-04-24T13:30:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:30:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:30:59.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:30:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248764+0000", 2024-04-24T13:30:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115763 2024-04-24T13:30:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:30:59.087 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:30:59.087 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:30:59.089 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:30:59.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:30:59.090 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:30:59.090 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:30:59.085+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:30:59.097 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:30:59.097 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:30:59.113 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:30:59.114 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:30:59.130 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:30:59.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:30:59.151 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:30:59.151 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:30:59.172 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:30:59.172 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:30:59.189 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:59.185+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:59.193 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:30:59.193 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:30:59.211 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:59.211 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:59.214 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:30:59.214 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:30:59.227 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:30:59.326 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:59.325+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:59.391 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:59.389+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:59.397 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:59.397 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:59.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:30:59.494 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:30:59.489+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:30:59.581 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:59.582 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:59.593 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:59.589+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:59.595 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:30:59.694 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:30:59.693+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:30:59.727 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:59.727 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:59.741 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:30:59.794 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:30:59.793+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:30:59.895 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:30:59.893+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:30:59.910 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:30:59.910 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:30:59.924 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:30:59.996 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:30:59.993+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:00.050 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:00.050 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:00.064 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:00.105 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:00.105+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:00.197 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:00.197+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:00.226 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:00.227 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:00.240 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:00.325 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:00.325+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:00.399 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:00.397+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:00.403 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:00.403 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:00.417 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:00.500 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:00.497+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:00.580 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:00.580 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:00.595 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:00.602 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:00.597+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:00.702 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:00.701+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:00.716 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:00.716 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:00.730 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:00.803 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:00.801+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:00.903 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:00.903 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:00.907 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:00.905+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:00.917 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:01.014 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:01.013+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:01.090 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:31:01.091 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:01.092 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:01.106 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:01.150 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:01.149+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:01.205 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:01.205+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:01.235 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:31:01.271 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:01.272 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:01.286 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:01.330 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:01.329+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:01.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:01.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:01.392 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:01.393 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:01.407 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:01.405+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:01.409 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:01.409 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:01.425 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:01.426 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:01.445 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:01.445 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:01.452 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:01.452 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:01.465 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:01.466 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:01.467 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:01.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:01.483 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:01.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:01.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:01.513 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:01.512+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:01.593 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:01.593 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:01.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:01.593 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:01.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.594 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.594 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:01.594 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.735019602999998, 2024-04-24T13:31:01.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:31:01.594 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.594 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.594 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.594 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:31:01.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.595 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:01.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:01.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:01.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:31:01.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:31:01.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:31:01.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:31:01.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:31:01.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:31:01.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:31:01.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:31:01.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:31:01.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:31:01.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:31:01.599 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.734996828999996, 2024-04-24T13:31:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:31:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:31:01.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:31:01.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:31:01.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:31:01.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:31:01.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:31:01.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:31:01.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:31:01.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:31:01.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:31:01.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:31:01.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:31:01.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:31:01.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:31:01.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:31:01.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:31:01.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:31:01.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:31:01.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:31:01.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:31:01.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.637389396000003, 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.606 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:31:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:01.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:01.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:31:01.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:31:01.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:31:01.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:31:01.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:31:01.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:31:01.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:31:01.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:31:01.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:31:01.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:31:01.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:31:01.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:31:01.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:31:01.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:31:01.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:31:01.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:31:01.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:31:01.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:31:01.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:31:01.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:31:01.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:31:01.612 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.612 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.612 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.613 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.613 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:01.613 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.637301759000003, 2024-04-24T13:31:01.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:31:01.613 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.613 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.613 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.613 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.613 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.613 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.613 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:31:01.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.613 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:01.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:01.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:31:01.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:31:01.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:31:01.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:31:01.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:31:01.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:31:01.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:31:01.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:31:01.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:31:01.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:31:01.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:31:01.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:31:01.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:31:01.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:31:01.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:31:01.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:31:01.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:31:01.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:31:01.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:31:01.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:31:01.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:31:01.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:31:01.620 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.620 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.620 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.620 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.620 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:01.620 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.531647872000001, 2024-04-24T13:31:01.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:31:01.621 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.621 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.621 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.621 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.621 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.621 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.621 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:31:01.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.621 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:01.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:01.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:31:01.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:31:01.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:31:01.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:31:01.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:31:01.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:31:01.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:31:01.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:31:01.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:31:01.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:31:01.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:31:01.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:31:01.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:31:01.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:31:01.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:31:01.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:31:01.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:31:01.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:31:01.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.531443353999997, 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:01.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:01.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:31:01.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:31:01.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:31:01.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:31:01.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:31:01.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:31:01.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:31:01.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:31:01.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:31:01.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:31:01.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:31:01.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:31:01.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:31:01.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:31:01.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:31:01.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:31:01.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:31:01.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:31:01.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:31:01.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:31:01.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:31:01.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:31:01.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.634 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.634 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.634 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.531083531, 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:01.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:01.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:31:01.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:31:01.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:31:01.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:31:01.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:31:01.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:31:01.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:31:01.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:31:01.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:31:01.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:31:01.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:31:01.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:31:01.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:31:01.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:31:01.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:31:01.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:31:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:31:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:31:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:31:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:31:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:31:01.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:31:01.641 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.641 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.641 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.641 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.641 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:01.641 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.530915127999997, 2024-04-24T13:31:01.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:31:01.641 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.641 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.642 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.642 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.642 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.642 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.642 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:31:01.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.642 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:01.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:01.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:31:01.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:31:01.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:31:01.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:31:01.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:31:01.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:31:01.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:31:01.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:31:01.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:31:01.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:31:01.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:31:01.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:31:01.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:31:01.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:31:01.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:31:01.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:31:01.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:31:01.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:31:01.647 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.647 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.647 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.647 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.530706737000003, 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:31:01.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:31:01.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:31:01.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:31:01.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:31:01.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:31:01.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:31:01.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:31:01.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:31:01.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:31:01.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:31:01.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:31:01.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:31:01.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:31:01.653 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.653 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.653 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.654 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.654 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:01.654 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.530608884000003, 2024-04-24T13:31:01.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:31:01.654 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.654 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.654 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.654 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.654 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.654 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.654 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:31:01.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.655 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:01.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:01.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:31:01.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:31:01.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:31:01.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:31:01.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:31:01.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:31:01.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:31:01.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.659 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.530507735, 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.660 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:31:01.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.661 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:01.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:01.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:31:01.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:31:01.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:31:01.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:31:01.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:31:01.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.665 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.666 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.666 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.666 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:01.666 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.530251022999998, 2024-04-24T13:31:01.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:31:01.666 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.666 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.666 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:31:01.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:31:01.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:31:01.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:31:01.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:31:01.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:31:01.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:31:01.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.671 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.530141360999998, 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:31:01.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.673 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:01.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:01.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:31:01.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:31:01.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:31:01.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:31:01.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:31:01.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:31:01.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:31:01.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:31:01.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:31:01.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:31:01.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:31:01.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:31:01.677 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.677 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.677 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.678 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.678 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:01.678 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.530069331999997, 2024-04-24T13:31:01.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:31:01.678 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.678 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.678 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.678 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.678 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.678 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.678 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:31:01.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:31:01.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:31:01.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:31:01.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:31:01.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:31:01.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:31:01.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:31:01.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:31:01.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:31:01.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:31:01.683 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.683 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.683 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.683 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.684 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:01.684 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.529898295999999, 2024-04-24T13:31:01.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:31:01.684 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.684 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.684 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.684 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.684 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.684 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.684 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:31:01.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.684 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:01.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:01.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:31:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:31:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:31:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:31:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:31:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:31:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:31:01.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:31:01.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:31:01.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:31:01.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:31:01.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:31:01.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:31:01.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:31:01.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:31:01.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:31:01.689 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.690 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.690 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.690 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.690 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:01.690 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.529858803000003, 2024-04-24T13:31:01.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:31:01.690 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.690 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.690 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.690 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.690 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.691 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.691 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:31:01.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.691 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:01.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:01.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:31:01.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:31:01.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:31:01.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:31:01.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:31:01.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:31:01.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.276539546999999, 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.696 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:01.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:31:01.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:31:01.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:31:01.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:31:01.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:31:01.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:31:01.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:31:01.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:31:01.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.276513499000004, 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.702 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.703 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.703 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:31:01.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.703 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:01.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:01.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:31:01.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:31:01.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:31:01.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:31:01.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:31:01.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:31:01.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:31:01.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:31:01.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:31:01.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:31:01.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:31:01.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:31:01.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.276488143000002, 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.708 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.709 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:31:01.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.709 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:01.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:01.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:01.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:31:01.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:31:01.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:31:01.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:31:01.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:31:01.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:31:01.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:31:01.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:31:01.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:31:01.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:31:01.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:31:01.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:31:01.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:31:01.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:31:01.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:31:01.714 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.714 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.714 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.714 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:01.714 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:01.714 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.276397074000002, 2024-04-24T13:31:01.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:31:01.714 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:01.714 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:01.714 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:01.714 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:01.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:01.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:31:01.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:31:01.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:01.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:31:01.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:31:01.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:01.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:31:01.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:31:01.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:01.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:31:01.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:31:01.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:01.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:31:01.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:31:01.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:01.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:31:01.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:31:01.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:01.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:01.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:31:01.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:31:01.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:01.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:01.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:01.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:31:01.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:31:01.720 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.720 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.720 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.720 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:01.720 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:01.720 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:01.722 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:01.720+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:01.722 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:01.822 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:01.821+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:01.854 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:01.854 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:01.854 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:01.854 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:01.868 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:01.923 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:01.920+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:01.968 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:31:02.023 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:02.020+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:02.035 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:02.035 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:02.035 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:02.035 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:02.035 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:02.049 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:02.124 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:02.121+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:02.171 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:02.172 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:02.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:02.172 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:02.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.172 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:31:02.172 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:02.172 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.245589152000001, 2024-04-24T13:31:02.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:31:02.172 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.172 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.172 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.172 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:31:02.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:31:02.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:31:02.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:31:02.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:31:02.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:31:02.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:31:02.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:31:02.176 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.102797381999999, 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:31:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:31:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:31:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:31:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:31:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:31:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:31:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:31:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:31:02.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.100494314000002, 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:31:02.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:31:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:31:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:31:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:31:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:31:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:31:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:31:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:31:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:31:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:31:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:31:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.098799796999998, 2024-04-24T13:31:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:31:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:31:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:31:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:31:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.097342185999999, 2024-04-24T13:31:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:31:02.190 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:31:02.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:31:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:31:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:31:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:31:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.194 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.095413096999998, 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:31:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:31:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:31:02.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.092988560000002, 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:31:02.199 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:02.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:31:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:31:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:31:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:31:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:31:02.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:31:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.091785811000001, 2024-04-24T13:31:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:31:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:02.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:02.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:31:02.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:02.208 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.088579645999999, 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:02.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.849524062, 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:02.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:02.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:31:02.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:31:02.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:31:02.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:31:02.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:31:02.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:31:02.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:31:02.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:02.217 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.847103410999999, 2024-04-24T13:31:02.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:31:02.218 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.218 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.218 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.218 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:02.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:31:02.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.222 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.222 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.222 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:31:02.222 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:02.222 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.846330193, 2024-04-24T13:31:02.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:31:02.222 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.222 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.222 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:02.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:02.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:31:02.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.838591139000002, 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:31:02.226 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:31:02.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.230 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.490629032000001, 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:31:02.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:31:02.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:31:02.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:31:02.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:31:02.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:31:02.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:31:02.235 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.235 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.235 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.235 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:31:02.235 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:02.235 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.489880284000002, 2024-04-24T13:31:02.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:31:02.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:31:02.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:31:02.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:31:02.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.239 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.488949159000001, 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:31:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:31:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:31:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:31:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:31:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:31:02.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.488457367999999, 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:31:02.244 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:31:02.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:31:02.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.902375943999999, 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:31:02.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:31:02.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:31:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:31:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:31:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:31:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:31:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:31:02.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:31:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:31:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.873528745000002, 2024-04-24T13:31:02.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:31:02.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:31:02.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:31:02.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:31:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:31:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:31:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:31:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:31:02.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.835337501000001, 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.261 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:31:02.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:31:02.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:31:02.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.267 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.267 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.267 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:02.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:02.269 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:02.265+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:02.369 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:02.365+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:02.442 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:02.442 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:02.443 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:02.457 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:02.470 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:02.468+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:02.571 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:02.569+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:02.623 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:02.623 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:02.623 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:02.637 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:02.672 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:02.668+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:02.772 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:02.768+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:02.807 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:02.807 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:02.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:02.807 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:02.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.807 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:02.807 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:02.807 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.587376917, 2024-04-24T13:31:02.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:31:02.807 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.807 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.807 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:02.808 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.808 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:02.808 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:02.808 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:31:02.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.808 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:02.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:31:02.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:31:02.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.531667837000001, 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:31:02.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:31:02.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:31:02.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:31:02.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:31:02.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.527600696999997, 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:02.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:02.819 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:31:02.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.819 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:02.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:02.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:31:02.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:31:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:31:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:31:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:31:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:31:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:31:02.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.525246805000002, 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:31:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:31:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:31:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:31:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:31:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:31:02.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:31:02.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.424221003, 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:31:02.828 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:31:02.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:31:02.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:31:02.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:31:02.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:31:02.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.834 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.834 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.834 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:02.834 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.516472012000001, 2024-04-24T13:31:02.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:31:02.834 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.834 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.834 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.834 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:02.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:31:02.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:31:02.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:31:02.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:31:02.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:31:02.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:31:02.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:31:02.839 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.492676039999999, 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.840 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:31:02.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.845 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.46598092, 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:31:02.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.448238999000001, 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:31:02.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:31:02.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.415068790999999, 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.857 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:31:02.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:31:02.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.862 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.367036584000001, 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:31:02.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:31:02.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:31:02.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:31:02.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.340788928999999, 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.868 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:31:02.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:31:02.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.281406526000001, 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.874 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:31:02.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:31:02.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:31:02.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:02.879 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.232939419000001, 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:31:02.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:31:02.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:31:02.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:31:02.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:31:02.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:31:02.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.847248845999999, 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.885 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:02.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:31:02.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:02.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:31:02.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:31:02.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:31:02.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:31:02.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:31:02.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:31:02.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:31:02.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:31:02.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:31:02.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:31:02.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:31:02.891 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.891 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.891 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.891 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.891 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.653160951, 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:02.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:02.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:31:02.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:31:02.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:31:02.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.649147677999999, 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.897 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:31:02.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:31:02.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.617094539, 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.903 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:31:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:31:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:31:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:31:02.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:31:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:31:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:31:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:31:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:31:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.908 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.612550538000001, 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:31:02.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:31:02.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:31:02.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.579399531, 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:02.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:31:02.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:31:02.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:02.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:31:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:31:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:31:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:31:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:02.920 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:02.920 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:02.922 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:02.922 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:02.920+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:03.023 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:03.021+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:03.049 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:03.049 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:03.049 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:03.063 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:03.150 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:03.149+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:03.224 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:03.221+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:03.234 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:03.234 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:03.234 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:03.234 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:03.234 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:03.249 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:03.326 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:03.324+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:03.418 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.132186081, 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026500819999999998, 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 42 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283130+0000", 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3599999999999999e-06 2024-04-24T13:31:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283143+0000", 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2989999999999999e-05 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283175+0000", 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1262e-05 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283190+0000", 2024-04-24T13:31:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5333999999999999e-05 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283279+0000", 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8616000000000007e-05 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283443+0000", 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016473200000000001 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283600+0000", 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015686500000000001 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.284799+0000", 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011988229999999999 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285616+0000", 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081652500000000002 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285709+0000", 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3109999999999995e-05 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285778+0000", 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9465e-05 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.127311812999999, 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025615049999999999, 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 52 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288005+0000", 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288017+0000", 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1995e-05 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288050+0000", 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2555999999999998e-05 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288063+0000", 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3774999999999999e-05 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288165+0000", 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101394 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288357+0000", 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019187800000000001 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288525+0000", 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016830600000000001 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.289691+0000", 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011659629999999999 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290333+0000", 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064243099999999995 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290439+0000", 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105689 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290564+0000", 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012480600000000001 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.015869199000001, 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:31:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:31:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:31:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:31:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:31:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:31:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:31:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:31:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:31:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:31:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:31:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:31:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:31:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:31:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.00379182, 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029424360000000001, 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 279 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411523+0000", 2024-04-24T13:31:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0899999999999999e-06 2024-04-24T13:31:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411539+0000", 2024-04-24T13:31:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:31:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411556+0000", 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6588000000000001e-05 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411564+0000", 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6929999999999996e-06 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411638+0000", 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3244999999999994e-05 2024-04-24T13:31:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411745+0000", 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107876 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411936+0000", 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000190819 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.412644+0000", 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070752499999999997 2024-04-24T13:31:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414368+0000", 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017246850000000001 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414419+0000", 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0513999999999998e-05 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414465+0000", 2024-04-24T13:31:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5862000000000002e-05 2024-04-24T13:31:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.000085441, 2024-04-24T13:31:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:31:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:31:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:31:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:31:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:31:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:31:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:31:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:31:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:31:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:31:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:691 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.756933604, 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027367860000000002, 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 691 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658383+0000", 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7719999999999999e-06 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658393+0000", 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1840000000000005e-06 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658414+0000", 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0967000000000001e-05 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658424+0000", 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0961000000000001e-05 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658556+0000", 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013183199999999999 2024-04-24T13:31:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658781+0000", 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022427499999999999 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.659230+0000", 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044896299999999998 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660178+0000", 2024-04-24T13:31:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094838799999999999 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660868+0000", 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000689575 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661012+0000", 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000144735 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661117+0000", 2024-04-24T13:31:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105134 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.556812649000001, 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:31:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:31:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:31:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.493469131000001, 2024-04-24T13:31:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:31:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:31:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:31:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.488793436000002, 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:31:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:31:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:31:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.436869587, 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028643660000000001, 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 841 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978447+0000", 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978459+0000", 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.224e-05 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978489+0000", 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9583000000000001e-05 2024-04-24T13:31:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978504+0000", 2024-04-24T13:31:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:31:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978612+0000", 2024-04-24T13:31:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107327 2024-04-24T13:31:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978831+0000", 2024-04-24T13:31:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021982300000000001 2024-04-24T13:31:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.979160+0000", 2024-04-24T13:31:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032855299999999998 2024-04-24T13:31:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.980242+0000", 2024-04-24T13:31:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010821649999999999 2024-04-24T13:31:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981019+0000", 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00077641199999999998 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981185+0000", 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016605499999999999 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981309+0000", 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012434300000000001 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.432748705000002, 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.423002669999999, 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:31:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:31:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:31:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:31:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:31:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:31:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:31:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:31:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:31:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:31:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:31:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.418455858000002, 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002954763, 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 849 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996861+0000", 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2069999999999998e-06 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996871+0000", 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0753e-05 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996903+0000", 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996922+0000", 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8595999999999999e-05 2024-04-24T13:31:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997042+0000", 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119646 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997271+0000", 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228963 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997736+0000", 2024-04-24T13:31:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000465181 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999022+0000", 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012864829999999999 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999529+0000", 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050722400000000002 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999697+0000", 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016795499999999999 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999813+0000", 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115746 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.374170605, 2024-04-24T13:31:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027316710000000002, 2024-04-24T13:31:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 868 2024-04-24T13:31:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041146+0000", 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041156+0000", 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0772e-05 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041184+0000", 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7616000000000001e-05 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041199+0000", 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4582e-05 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041309+0000", 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011029799999999999 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041532+0000", 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022316 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041846+0000", 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031406700000000001 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043088+0000", 2024-04-24T13:31:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001241409 2024-04-24T13:31:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043667+0000", 2024-04-24T13:31:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057961000000000004 2024-04-24T13:31:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043767+0000", 2024-04-24T13:31:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100166 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043875+0000", 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107871 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.284993337, 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003049946, 2024-04-24T13:31:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 907 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130323+0000", 2024-04-24T13:31:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5859999999999999e-06 2024-04-24T13:31:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130336+0000", 2024-04-24T13:31:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.218e-05 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130367+0000", 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1665000000000003e-05 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130382+0000", 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5113000000000001e-05 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130510+0000", 2024-04-24T13:31:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012778999999999999 2024-04-24T13:31:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130749+0000", 2024-04-24T13:31:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238669 2024-04-24T13:31:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.131082+0000", 2024-04-24T13:31:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033360300000000002 2024-04-24T13:31:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.132266+0000", 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001183627 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133172+0000", 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090542200000000002 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133259+0000", 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:31:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133371+0000", 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011194 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.281174488000001, 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002722543, 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 909 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134141+0000", 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134150+0000", 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9430000000000006e-06 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134172+0000", 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1296000000000001e-05 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134187+0000", 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5659e-05 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134275+0000", 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7787000000000005e-05 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134403+0000", 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127677 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134686+0000", 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028353500000000002 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.135742+0000", 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010557800000000001 2024-04-24T13:31:03.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136663+0000", 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092043500000000005 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136753+0000", 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0871000000000005e-05 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136862+0000", 2024-04-24T13:31:03.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010883 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.187479606, 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029521759999999999, 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.511 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 949 2024-04-24T13:31:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227837+0000", 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2189999999999998e-06 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227848+0000", 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-05 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227876+0000", 2024-04-24T13:31:03.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8972999999999999e-05 2024-04-24T13:31:03.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227892+0000", 2024-04-24T13:31:03.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5965999999999999e-05 2024-04-24T13:31:03.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228028+0000", 2024-04-24T13:31:03.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135322 2024-04-24T13:31:03.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228256+0000", 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228237 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228706+0000", 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045042599999999997 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.229990+0000", 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012836799999999999 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230579+0000", 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058925199999999996 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230673+0000", 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3484000000000001e-05 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230787+0000", 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113917 2024-04-24T13:31:03.516 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.183372515999999, 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.517 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:31:03.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:31:03.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.173172732000001, 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030452859999999999, 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 955 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.523 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242144+0000", 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2500000000000001e-06 2024-04-24T13:31:03.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242155+0000", 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1779e-05 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242186+0000", 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0879e-05 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242202+0000", 2024-04-24T13:31:03.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5566e-05 2024-04-24T13:31:03.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242338+0000", 2024-04-24T13:31:03.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013631299999999999 2024-04-24T13:31:03.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242700+0000", 2024-04-24T13:31:03.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036144900000000002 2024-04-24T13:31:03.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.243261+0000", 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056143600000000001 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.244736+0000", 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001475248 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245034+0000", 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029792099999999998 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245119+0000", 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4876999999999994e-05 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245187+0000", 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7568000000000001e-05 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:03.528 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.169247296999998, 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026970509999999998, 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 957 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:03.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246069+0000", 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4600000000000002e-06 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246081+0000", 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1780000000000001e-05 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246105+0000", 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3805999999999999e-05 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246120+0000", 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5415999999999999e-05 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246221+0000", 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010027 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246367+0000", 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014653299999999999 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246645+0000", 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000277681 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.247868+0000", 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001223373 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248563+0000", 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694781 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248648+0000", 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5187999999999998e-05 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:03.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248764+0000", 2024-04-24T13:31:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115763 2024-04-24T13:31:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:03.534 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:03.534 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:03.535 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:31:03.536 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:31:03.537 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:03.532+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:03.636 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:03.633+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:03.701 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:03.702 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:03.702 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:03.702 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:03.717 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:31:03.726 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:03.726 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:03.738 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:03.736+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:03.743 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:03.744 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:03.762 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:03.762 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:03.778 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:03.778 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:03.799 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:03.799 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:03.819 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:03.820 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:03.839 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:03.837+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:03.841 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:03.841 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:03.844 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:03.844 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:03.859 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:31:03.862 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:03.862 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:03.941 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:03.937+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:03.977 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:03.992 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:31:03.993 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:31:04.040 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:04.036+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:04.124 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:04.124 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:04.138 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:31:04.142 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:04.141+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:04.242 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:04.240+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:04.302 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:04.302 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:04.316 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:31:04.358 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:04.356+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:04.444 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:04.440+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:04.481 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:04.482 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:04.495 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:04.581 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:04.580+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:04.645 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:04.644+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:04.660 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:04.660 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:04.674 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:04.762 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:04.760+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:04.841 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:04.841 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:04.847 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:04.844+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:04.855 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:04.948 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:04.944+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:04.995 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:31:05.025 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:05.026 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:05.040 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:05.062 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:05.061+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:05.149 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:05.148+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:05.205 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:05.205 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:05.219 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:05.251 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:05.249+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:05.352 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:05.349+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:05.389 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:05.390 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:05.404 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:05.453 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:05.448+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:05.526 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:05.527 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:05.541 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:05.582 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:05.580+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:05.654 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:05.652+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:05.704 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:05.705 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:05.719 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:05.761 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:05.760+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:05.855 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:05.853+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:05.881 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:31:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:05.887 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:05.903 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:05.957 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:05.952+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:06.029 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:06.029 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:06.037 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:06.037 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:06.043 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:06.054 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:06.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:06.057 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:06.053+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:06.070 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:06.070 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:06.088 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:06.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:06.109 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:06.109 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:06.129 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:06.129 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:06.150 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:06.150 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:06.159 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:06.156+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:06.160 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:06.160 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:06.160 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:06.160 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:06.171 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:06.171 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:06.175 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:06.274 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:06.273+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:06.351 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:06.351 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:06.360 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:06.356+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:06.365 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:06.461 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:06.457+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:06.533 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:06.533 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:06.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:06.533 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:06.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.534 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:31:06.534 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:06.534 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.607183608, 2024-04-24T13:31:06.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:31:06.534 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.534 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.534 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:06.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:06.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:31:06.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:31:06.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:31:06.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:31:06.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.538 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.538 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:31:06.538 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:06.538 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.464391837999997, 2024-04-24T13:31:06.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:31:06.539 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.539 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.539 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:06.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:06.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.542 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.543 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.543 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:31:06.543 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:06.543 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.462088770000001, 2024-04-24T13:31:06.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:31:06.543 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.543 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.543 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:31:06.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:31:06.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:31:06.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:31:06.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:31:06.547 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.547 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.547 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.547 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:31:06.547 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:06.547 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.460394252999997, 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:31:06.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:31:06.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:31:06.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:31:06.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:31:06.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:31:06.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.551 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.458936641999998, 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:31:06.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:31:06.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:31:06.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:31:06.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:31:06.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.457007552999997, 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:31:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:31:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:31:06.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:31:06.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:31:06.561 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.561 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.561 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.561 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:31:06.561 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:06.561 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.454583016000001, 2024-04-24T13:31:06.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:31:06.561 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.561 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.562 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.562 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:06.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:06.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:31:06.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:31:06.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:31:06.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:31:06.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:31:06.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:31:06.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:31:06.565 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.565 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.565 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.453380267, 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:06.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:31:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:31:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:31:06.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.450174101999998, 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:31:06.570 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.571 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.571 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.571 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:06.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:06.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:31:06.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:31:06.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:31:06.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:31:06.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:31:06.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:31:06.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.574 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.575 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.575 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:31:06.575 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:06.575 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.211118517999999, 2024-04-24T13:31:06.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:31:06.575 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.575 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.575 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.575 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:06.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:06.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:31:06.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:31:06.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:31:06.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:31:06.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:31:06.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:31:06.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:31:06.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:31:06.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:31:06.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:31:06.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:31:06.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:31:06.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:31:06.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:31:06.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:31:06.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:31:06.580 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.580 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.580 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.580 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:31:06.580 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:06.580 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.208697866999998, 2024-04-24T13:31:06.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:31:06.580 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.580 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.580 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.580 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:31:06.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:31:06.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:31:06.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:31:06.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:31:06.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:31:06.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:31:06.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.584 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.207924648999999, 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:06.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:31:06.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:31:06.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:31:06.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:06.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:31:06.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:31:06.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.200185595000001, 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:31:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:31:06.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:31:06.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:06.593 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.852223488, 2024-04-24T13:31:06.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:31:06.594 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.594 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.594 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.594 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:06.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:06.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:31:06.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:31:06.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:31:06.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:31:06.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:31:06.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:31:06.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:31:06.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:31:06.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.85147474, 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.598 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.599 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:06.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:06.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:31:06.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:31:06.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:31:06.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:31:06.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:31:06.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:31:06.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:31:06.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:31:06.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:31:06.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:31:06.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:31:06.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:31:06.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:31:06.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:31:06.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:31:06.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:31:06.603 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.603 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.603 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.603 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:31:06.603 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:06.603 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.850543614999999, 2024-04-24T13:31:06.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:31:06.604 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.604 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.604 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.604 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:06.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:06.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:31:06.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:31:06.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:31:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:31:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:31:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:31:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:31:06.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:31:06.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:31:06.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:31:06.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:31:06.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:31:06.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:31:06.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:31:06.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:31:06.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:31:06.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.609 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.609 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:31:06.609 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:06.609 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.850051823999998, 2024-04-24T13:31:06.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:31:06.609 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.610 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.610 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.610 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:06.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:06.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:31:06.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:31:06.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:31:06.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:31:06.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:31:06.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:31:06.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:31:06.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:31:06.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:31:06.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:31:06.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:31:06.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:31:06.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.614 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.615 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:06.615 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:06.615 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.263970399999998, 2024-04-24T13:31:06.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:31:06.615 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.615 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.615 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.615 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:06.615 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:06.615 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:06.615 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:31:06.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:31:06.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:31:06.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:31:06.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:31:06.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:06.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:31:06.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:31:06.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.235123201, 2024-04-24T13:31:06.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:31:06.622 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.622 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.622 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.622 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:06.622 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:06.622 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:06.622 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:31:06.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.622 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:06.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:06.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:31:06.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:31:06.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:31:06.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:31:06.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:31:06.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:31:06.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:06.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:31:06.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:31:06.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:06.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:31:06.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:31:06.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:06.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:31:06.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:31:06.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:31:06.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:31:06.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:31:06.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:31:06.627 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.627 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.627 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.196931956999997, 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:31:06.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:06.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:06.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:31:06.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:31:06.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:06.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:31:06.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:31:06.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:06.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:31:06.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:06.634 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:06.634 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:06.635 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:06.636 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:06.636+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:06.737 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:06.732+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:06.804 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:06.804 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:06.804 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:06.804 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:06.818 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:06.837 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:06.836+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:06.938 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:06.937+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:06.939 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:06.939 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:06.939 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:06.953 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:07.020 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:31:07.039 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:07.036+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:07.125 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:07.125 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:07.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:07.125 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:07.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.125 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:07.125 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:07.125 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.907302727000001, 2024-04-24T13:31:07.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:31:07.125 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.126 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:07.126 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.126 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:07.126 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:07.126 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:31:07.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.126 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:07.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:07.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:31:07.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:31:07.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:31:07.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:31:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:31:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:31:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:31:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:31:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:31:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:31:07.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:31:07.130 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.130 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.130 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.130 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:07.130 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:07.130 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.851593647000001, 2024-04-24T13:31:07.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:31:07.130 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:31:07.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.847526506999998, 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.136 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.137 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.137 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.137 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:07.137 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:07.137 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:31:07.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.137 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:07.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:31:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:31:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:31:07.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:31:07.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:31:07.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:31:07.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:31:07.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:31:07.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:31:07.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:31:07.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:31:07.142 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.142 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.142 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.142 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:31:07.142 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:07.142 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.845172615000003, 2024-04-24T13:31:07.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:31:07.142 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:31:07.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:31:07.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:31:07.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:31:07.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:31:07.146 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.146 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.146 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.744146813, 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.147 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:31:07.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:31:07.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:31:07.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:31:07.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:31:07.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:31:07.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:31:07.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:31:07.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:31:07.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:31:07.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:31:07.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:31:07.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:31:07.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:31:07.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:31:07.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:31:07.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:31:07.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:31:07.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:31:07.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:31:07.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.836397822000002, 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.153 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.154 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.154 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.154 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.154 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.154 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:31:07.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.154 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:07.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:31:07.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:31:07.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:31:07.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:31:07.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:31:07.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:31:07.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:31:07.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:31:07.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:31:07.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:31:07.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:31:07.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:31:07.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:31:07.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:31:07.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:31:07.159 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.159 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.159 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.159 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.159 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:07.159 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.81260185, 2024-04-24T13:31:07.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:07.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:31:07.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:07.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:31:07.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:31:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:31:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:31:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:31:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:31:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:31:07.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:31:07.165 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.165 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.165 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.165 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.165 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:07.165 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.785906730000001, 2024-04-24T13:31:07.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:31:07.165 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.166 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.166 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.166 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.166 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.166 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.166 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:31:07.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.166 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:07.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:07.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:31:07.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:31:07.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:31:07.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:31:07.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:31:07.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:31:07.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:31:07.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:31:07.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:31:07.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:31:07.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:31:07.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:31:07.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:31:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:31:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:31:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:31:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.171 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.768164808999998, 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:31:07.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:31:07.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:31:07.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:31:07.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:31:07.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.177 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.734994600999997, 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:31:07.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:31:07.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:31:07.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:31:07.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:31:07.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.183 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.686962393999998, 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:07.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:07.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:31:07.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:31:07.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:31:07.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:31:07.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:31:07.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:31:07.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:31:07.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:31:07.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:31:07.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:31:07.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:31:07.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.189 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.189 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.190 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:07.190 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.660714738999999, 2024-04-24T13:31:07.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:31:07.190 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.190 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.190 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.190 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.190 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.190 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:31:07.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.190 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:31:07.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:31:07.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:31:07.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:31:07.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:31:07.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:31:07.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:31:07.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:31:07.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.195 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.196 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:07.196 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.601332335999999, 2024-04-24T13:31:07.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:31:07.196 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.196 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.196 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:31:07.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.197 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:07.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:07.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:31:07.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:31:07.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:31:07.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:31:07.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:31:07.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:31:07.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:31:07.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:31:07.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:31:07.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:31:07.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.202 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.202 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.202 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:07.202 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.552865228999998, 2024-04-24T13:31:07.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:31:07.202 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.202 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.202 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.202 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.202 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:31:07.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:31:07.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:31:07.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:31:07.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:31:07.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:31:07.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:31:07.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.207 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.208 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.208 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.208 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:07.208 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.167174656, 2024-04-24T13:31:07.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:31:07.208 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.208 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.208 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.208 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.208 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.209 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:31:07.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.209 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:07.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:07.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:31:07.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:07.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:31:07.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:31:07.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:31:07.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:31:07.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:31:07.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:31:07.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:31:07.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:31:07.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:31:07.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:31:07.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:31:07.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:31:07.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:31:07.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.973086760999998, 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.214 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:31:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:31:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:31:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:31:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:31:07.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:31:07.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:31:07.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:31:07.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:31:07.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:31:07.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:31:07.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:31:07.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:31:07.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:07.220 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.969073487999999, 2024-04-24T13:31:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:31:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:31:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:31:07.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:31:07.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:31:07.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:31:07.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:31:07.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:31:07.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:31:07.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:31:07.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:31:07.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.226 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.226 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.226 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:07.226 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.937020349000001, 2024-04-24T13:31:07.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:07.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:31:07.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:07.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:31:07.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:31:07.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:31:07.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:31:07.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:07.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:31:07.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:31:07.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:31:07.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:31:07.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:31:07.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:31:07.232 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.232 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.232 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.232 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.232 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:07.232 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.932476348000002, 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:07.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:31:07.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:31:07.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:31:07.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:31:07.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:31:07.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:31:07.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:31:07.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.238 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.238 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.238 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:07.238 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.899325341000001, 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:07.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:07.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:31:07.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:31:07.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:31:07.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:31:07.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:31:07.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:31:07.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:31:07.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:31:07.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:31:07.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:31:07.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:31:07.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.244 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.244 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.244 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:07.246 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:07.246 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:07.241+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:07.347 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:07.344+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:07.407 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:07.408 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:07.408 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:07.408 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:07.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:07.448 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:07.444+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:07.543 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:07.543 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:07.543 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:07.543 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:07.543 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:07.549 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:07.548+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:07.557 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:07.650 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:07.649+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:07.683 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:07.683 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:07.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:07.683 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:07.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.684 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:07.684 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:07.684 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.397532392000002, 2024-04-24T13:31:07.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026500819999999998, 2024-04-24T13:31:07.684 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.684 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:07.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:07.684 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 42 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283130+0000", 2024-04-24T13:31:07.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3599999999999999e-06 2024-04-24T13:31:07.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283143+0000", 2024-04-24T13:31:07.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2989999999999999e-05 2024-04-24T13:31:07.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283175+0000", 2024-04-24T13:31:07.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1262e-05 2024-04-24T13:31:07.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283190+0000", 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5333999999999999e-05 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283279+0000", 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8616000000000007e-05 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283443+0000", 2024-04-24T13:31:07.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016473200000000001 2024-04-24T13:31:07.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283600+0000", 2024-04-24T13:31:07.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015686500000000001 2024-04-24T13:31:07.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.284799+0000", 2024-04-24T13:31:07.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011988229999999999 2024-04-24T13:31:07.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285616+0000", 2024-04-24T13:31:07.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081652500000000002 2024-04-24T13:31:07.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285709+0000", 2024-04-24T13:31:07.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3109999999999995e-05 2024-04-24T13:31:07.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285778+0000", 2024-04-24T13:31:07.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9465e-05 2024-04-24T13:31:07.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.690 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.392658124, 2024-04-24T13:31:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025615049999999999, 2024-04-24T13:31:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 52 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288005+0000", 2024-04-24T13:31:07.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:31:07.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288017+0000", 2024-04-24T13:31:07.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1995e-05 2024-04-24T13:31:07.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288050+0000", 2024-04-24T13:31:07.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2555999999999998e-05 2024-04-24T13:31:07.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288063+0000", 2024-04-24T13:31:07.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3774999999999999e-05 2024-04-24T13:31:07.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288165+0000", 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101394 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288357+0000", 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019187800000000001 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288525+0000", 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016830600000000001 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.289691+0000", 2024-04-24T13:31:07.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011659629999999999 2024-04-24T13:31:07.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290333+0000", 2024-04-24T13:31:07.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064243099999999995 2024-04-24T13:31:07.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290439+0000", 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105689 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290564+0000", 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012480600000000001 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:07.697 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.281215510000003, 2024-04-24T13:31:07.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:31:07.698 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.698 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.698 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:31:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:31:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:31:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:31:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:31:07.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:31:07.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:31:07.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:07.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:31:07.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:31:07.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:31:07.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.269138130999998, 2024-04-24T13:31:07.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029424360000000001, 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 279 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411523+0000", 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0899999999999999e-06 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411539+0000", 2024-04-24T13:31:07.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411556+0000", 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6588000000000001e-05 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411564+0000", 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6929999999999996e-06 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411638+0000", 2024-04-24T13:31:07.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3244999999999994e-05 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411745+0000", 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107876 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411936+0000", 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000190819 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.412644+0000", 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070752499999999997 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414368+0000", 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017246850000000001 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414419+0000", 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0513999999999998e-05 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414465+0000", 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5862000000000002e-05 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.265431751999998, 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:07.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:31:07.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.715 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.716 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.716 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:691 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.716 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:07.716 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.022279914999999, 2024-04-24T13:31:07.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027367860000000002, 2024-04-24T13:31:07.716 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.716 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.716 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.716 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 691 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:07.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658383+0000", 2024-04-24T13:31:07.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7719999999999999e-06 2024-04-24T13:31:07.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658393+0000", 2024-04-24T13:31:07.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1840000000000005e-06 2024-04-24T13:31:07.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658414+0000", 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0967000000000001e-05 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658424+0000", 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0961000000000001e-05 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658556+0000", 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013183199999999999 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658781+0000", 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022427499999999999 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.659230+0000", 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044896299999999998 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660178+0000", 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094838799999999999 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660868+0000", 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000689575 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661012+0000", 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000144735 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661117+0000", 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105134 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.822158960000003, 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:07.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:31:07.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:31:07.726 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.726 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.726 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.726 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.726 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:07.726 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.758815442, 2024-04-24T13:31:07.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:31:07.726 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.726 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:31:07.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:31:07.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:07.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:31:07.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:31:07.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:31:07.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:31:07.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:31:07.732 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.732 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.732 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.732 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.732 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:07.732 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.754139746999996, 2024-04-24T13:31:07.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:31:07.732 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:31:07.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:31:07.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.702215897999999, 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028643660000000001, 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.738 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 841 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:07.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978447+0000", 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978459+0000", 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.224e-05 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978489+0000", 2024-04-24T13:31:07.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9583000000000001e-05 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978504+0000", 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978612+0000", 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107327 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978831+0000", 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021982300000000001 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.979160+0000", 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032855299999999998 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.980242+0000", 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010821649999999999 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981019+0000", 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00077641199999999998 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981185+0000", 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016605499999999999 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981309+0000", 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012434300000000001 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.743 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.698095016000003, 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:31:07.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:31:07.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:07.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:07.749 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.688348980999997, 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:07.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:31:07.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:31:07.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:31:07.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:31:07.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:31:07.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:31:07.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:31:07.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:31:07.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.683802169000003, 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002954763, 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.755 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 849 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:07.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996861+0000", 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2069999999999998e-06 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996871+0000", 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0753e-05 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996903+0000", 2024-04-24T13:31:07.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:31:07.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996922+0000", 2024-04-24T13:31:07.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8595999999999999e-05 2024-04-24T13:31:07.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997042+0000", 2024-04-24T13:31:07.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119646 2024-04-24T13:31:07.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997271+0000", 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228963 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997736+0000", 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000465181 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999022+0000", 2024-04-24T13:31:07.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012864829999999999 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999529+0000", 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050722400000000002 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999697+0000", 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016795499999999999 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999813+0000", 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115746 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.639516915999998, 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027316710000000002, 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.761 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 868 2024-04-24T13:31:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041146+0000", 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041156+0000", 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0772e-05 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041184+0000", 2024-04-24T13:31:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7616000000000001e-05 2024-04-24T13:31:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041199+0000", 2024-04-24T13:31:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4582e-05 2024-04-24T13:31:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041309+0000", 2024-04-24T13:31:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011029799999999999 2024-04-24T13:31:07.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041532+0000", 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022316 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041846+0000", 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031406700000000001 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043088+0000", 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001241409 2024-04-24T13:31:07.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043667+0000", 2024-04-24T13:31:07.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057961000000000004 2024-04-24T13:31:07.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043767+0000", 2024-04-24T13:31:07.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100166 2024-04-24T13:31:07.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043875+0000", 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107871 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.550339647999998, 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003049946, 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.767 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.768 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 907 2024-04-24T13:31:07.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.768 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:07.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130323+0000", 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5859999999999999e-06 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130336+0000", 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.218e-05 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130367+0000", 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1665000000000003e-05 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130382+0000", 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5113000000000001e-05 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130510+0000", 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012778999999999999 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130749+0000", 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238669 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.131082+0000", 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033360300000000002 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.132266+0000", 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001183627 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133172+0000", 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090542200000000002 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133259+0000", 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133371+0000", 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011194 2024-04-24T13:31:07.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.546520799, 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002722543, 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.773 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 909 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134141+0000", 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134150+0000", 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9430000000000006e-06 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134172+0000", 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1296000000000001e-05 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134187+0000", 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5659e-05 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134275+0000", 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7787000000000005e-05 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134403+0000", 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127677 2024-04-24T13:31:07.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134686+0000", 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028353500000000002 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.135742+0000", 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010557800000000001 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136663+0000", 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092043500000000005 2024-04-24T13:31:07.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136753+0000", 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0871000000000005e-05 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136862+0000", 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010883 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.452825916999998, 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029521759999999999, 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 949 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227837+0000", 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2189999999999998e-06 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227848+0000", 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-05 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227876+0000", 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8972999999999999e-05 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227892+0000", 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5965999999999999e-05 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228028+0000", 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135322 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228256+0000", 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228237 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228706+0000", 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045042599999999997 2024-04-24T13:31:07.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.229990+0000", 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012836799999999999 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230579+0000", 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058925199999999996 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230673+0000", 2024-04-24T13:31:07.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3484000000000001e-05 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230787+0000", 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113917 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.448718827, 2024-04-24T13:31:07.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:31:07.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:31:07.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:31:07.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:31:07.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.438519042999999, 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030452859999999999, 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.790 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 955 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242144+0000", 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2500000000000001e-06 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242155+0000", 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1779e-05 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242186+0000", 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0879e-05 2024-04-24T13:31:07.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242202+0000", 2024-04-24T13:31:07.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5566e-05 2024-04-24T13:31:07.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242338+0000", 2024-04-24T13:31:07.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013631299999999999 2024-04-24T13:31:07.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242700+0000", 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036144900000000002 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.243261+0000", 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056143600000000001 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.244736+0000", 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001475248 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245034+0000", 2024-04-24T13:31:07.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029792099999999998 2024-04-24T13:31:07.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245119+0000", 2024-04-24T13:31:07.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4876999999999994e-05 2024-04-24T13:31:07.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245187+0000", 2024-04-24T13:31:07.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7568000000000001e-05 2024-04-24T13:31:07.795 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 34.434593608, 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026970509999999998, 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:07.796 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:07.797 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 957 2024-04-24T13:31:07.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.797 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:07.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:07.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:07.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:07.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:07.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:07.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:07.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246069+0000", 2024-04-24T13:31:07.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4600000000000002e-06 2024-04-24T13:31:07.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:07.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246081+0000", 2024-04-24T13:31:07.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1780000000000001e-05 2024-04-24T13:31:07.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:07.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246105+0000", 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3805999999999999e-05 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246120+0000", 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5415999999999999e-05 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246221+0000", 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010027 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246367+0000", 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014653299999999999 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246645+0000", 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000277681 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.247868+0000", 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001223373 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248563+0000", 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694781 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248648+0000", 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5187999999999998e-05 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248764+0000", 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115763 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.801 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:07.802 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:07.802 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:07.803 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:31:07.804 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:07.801+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:07.904 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:07.900+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:07.971 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:07.971 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:07.971 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:07.984 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:31:08.010 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:31:08.011 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:08.009+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:08.106 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:08.105+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:08.118 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:08.118 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:08.118 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:08.118 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:08.118 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:08.133 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:31:08.190 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:31:08.218 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:08.217+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:08.307 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:31:08.307 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.056839770000003, 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057346300000000001, 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247277+0000", 2024-04-24T13:31:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3459999999999998e-06 2024-04-24T13:31:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247344+0000", 2024-04-24T13:31:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6768999999999997e-05 2024-04-24T13:31:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247379+0000", 2024-04-24T13:31:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4573999999999998e-05 2024-04-24T13:31:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247402+0000", 2024-04-24T13:31:08.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3303e-05 2024-04-24T13:31:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247599+0000", 2024-04-24T13:31:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019720499999999999 2024-04-24T13:31:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247622+0000", 2024-04-24T13:31:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2512999999999999e-05 2024-04-24T13:31:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.252825+0000", 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052035270000000003 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.253009+0000", 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018339300000000001 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.312 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.028197257000002, 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:31:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:31:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:31:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:31:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:31:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:31:08.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:31:08.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:31:08.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.977157616, 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031751589999999999, 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.319 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 216 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:08.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326959+0000", 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6170000000000001e-06 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326972+0000", 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327005+0000", 2024-04-24T13:31:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2845000000000001e-05 2024-04-24T13:31:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327023+0000", 2024-04-24T13:31:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8179999999999999e-05 2024-04-24T13:31:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327132+0000", 2024-04-24T13:31:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010878300000000001 2024-04-24T13:31:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327351+0000", 2024-04-24T13:31:08.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021952000000000001 2024-04-24T13:31:08.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:08.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327770+0000", 2024-04-24T13:31:08.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041895600000000001 2024-04-24T13:31:08.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329354+0000", 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00158388 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329982+0000", 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062821700000000003 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330066+0000", 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4153999999999994e-05 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330131+0000", 2024-04-24T13:31:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4920999999999997e-05 2024-04-24T13:31:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.937186543999999, 2024-04-24T13:31:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031663630000000002, 2024-04-24T13:31:08.325 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 227 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366930+0000", 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3800000000000001e-06 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366941+0000", 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1466e-05 2024-04-24T13:31:08.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366973+0000", 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1588999999999999e-05 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366987+0000", 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4663e-05 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367166+0000", 2024-04-24T13:31:08.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017905699999999999 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367388+0000", 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022201299999999999 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367820+0000", 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000431357 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369320+0000", 2024-04-24T13:31:08.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015007359999999999 2024-04-24T13:31:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369944+0000", 2024-04-24T13:31:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062337299999999998 2024-04-24T13:31:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370026+0000", 2024-04-24T13:31:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2437999999999999e-05 2024-04-24T13:31:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370094+0000", 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7291000000000003e-05 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.929875099, 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030833050000000002, 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.331 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 229 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:08.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374241+0000", 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5660000000000001e-06 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374253+0000", 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2094e-05 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374284+0000", 2024-04-24T13:31:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0824999999999997e-05 2024-04-24T13:31:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374299+0000", 2024-04-24T13:31:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.483e-05 2024-04-24T13:31:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374410+0000", 2024-04-24T13:31:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110956 2024-04-24T13:31:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374631+0000", 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221117 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.375006+0000", 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000375041 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.376480+0000", 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00147434 2024-04-24T13:31:08.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377172+0000", 2024-04-24T13:31:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00069190799999999998 2024-04-24T13:31:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377255+0000", 2024-04-24T13:31:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2536999999999999e-05 2024-04-24T13:31:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377322+0000", 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7090999999999999e-05 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.92324309, 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040131660000000003, 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 231 2024-04-24T13:31:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380873+0000", 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2400000000000002e-06 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380884+0000", 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0645999999999999e-05 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380919+0000", 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5026e-05 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380934+0000", 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.522e-05 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381077+0000", 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014362500000000001 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381453+0000", 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037581799999999999 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.382170+0000", 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071714999999999995 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.383955+0000", 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017847710000000001 2024-04-24T13:31:08.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384619+0000", 2024-04-24T13:31:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066381600000000002 2024-04-24T13:31:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384770+0000", 2024-04-24T13:31:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015067800000000001 2024-04-24T13:31:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384884+0000", 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114176 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:324 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.885211226000003, 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029016649999999999, 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.343 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 324 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418904+0000", 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-06 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418911+0000", 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.759e-06 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418928+0000", 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7105e-05 2024-04-24T13:31:08.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418935+0000", 2024-04-24T13:31:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7309999999999993e-06 2024-04-24T13:31:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419024+0000", 2024-04-24T13:31:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8524999999999997e-05 2024-04-24T13:31:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419121+0000", 2024-04-24T13:31:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6978000000000006e-05 2024-04-24T13:31:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419329+0000", 2024-04-24T13:31:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020806399999999999 2024-04-24T13:31:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419835+0000", 2024-04-24T13:31:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050625300000000002 2024-04-24T13:31:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421631+0000", 2024-04-24T13:31:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001795615 2024-04-24T13:31:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421694+0000", 2024-04-24T13:31:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3398999999999994e-05 2024-04-24T13:31:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421804+0000", 2024-04-24T13:31:08.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109894 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:562 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.751279857, 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048608870000000004, 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.349 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 562 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552837+0000", 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8499999999999998e-06 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552852+0000", 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4866e-05 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552890+0000", 2024-04-24T13:31:08.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8166e-05 2024-04-24T13:31:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552905+0000", 2024-04-24T13:31:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5255e-05 2024-04-24T13:31:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553053+0000", 2024-04-24T13:31:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014824599999999999 2024-04-24T13:31:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553425+0000", 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000371512 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553969+0000", 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054421500000000002 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.554987+0000", 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001017855 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557606+0000", 2024-04-24T13:31:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026195839999999999 2024-04-24T13:31:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557655+0000", 2024-04-24T13:31:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8575000000000002e-05 2024-04-24T13:31:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557695+0000", 2024-04-24T13:31:08.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9762999999999999e-05 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:607 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.711410614000002, 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003243737, 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.355 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 607 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592705+0000", 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592714+0000", 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7630000000000006e-06 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592733+0000", 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9656e-05 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592745+0000", 2024-04-24T13:31:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592881+0000", 2024-04-24T13:31:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013627999999999999 2024-04-24T13:31:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593221+0000", 2024-04-24T13:31:08.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033945600000000002 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593765+0000", 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054456600000000002 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.594969+0000", 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012034649999999999 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595779+0000", 2024-04-24T13:31:08.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000810161 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595893+0000", 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114481 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595947+0000", 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3352e-05 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.560302747999998, 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027976260000000001, 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 736 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.361 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743813+0000", 2024-04-24T13:31:08.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0899999999999999e-06 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743824+0000", 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.111e-05 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743853+0000", 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909000000000001e-05 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743867+0000", 2024-04-24T13:31:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4036000000000001e-05 2024-04-24T13:31:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743980+0000", 2024-04-24T13:31:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011266 2024-04-24T13:31:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744205+0000", 2024-04-24T13:31:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000225016 2024-04-24T13:31:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744515+0000", 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030974000000000003 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.745485+0000", 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097096300000000003 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746512+0000", 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001026873 2024-04-24T13:31:08.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746563+0000", 2024-04-24T13:31:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1017000000000003e-05 2024-04-24T13:31:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746609+0000", 2024-04-24T13:31:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5212e-05 2024-04-24T13:31:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.471075368999998, 2024-04-24T13:31:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028606399999999998, 2024-04-24T13:31:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 778 2024-04-24T13:31:08.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833041+0000", 2024-04-24T13:31:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3539999999999998e-06 2024-04-24T13:31:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833052+0000", 2024-04-24T13:31:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:31:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833084+0000", 2024-04-24T13:31:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:31:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833111+0000", 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6869e-05 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833245+0000", 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000133576 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833460+0000", 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021584600000000001 2024-04-24T13:31:08.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833761+0000", 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000300477 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.834890+0000", 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011292050000000001 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835731+0000", 2024-04-24T13:31:08.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000841423 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835829+0000", 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7337000000000007e-05 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835899+0000", 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0151e-05 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.360595023000002, 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002884246, 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 826 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.373 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943521+0000", 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4530000000000001e-06 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943532+0000", 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943563+0000", 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0982000000000003e-05 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943582+0000", 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8406e-05 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943781+0000", 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000199624 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944019+0000", 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000237972 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944345+0000", 2024-04-24T13:31:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032530699999999999 2024-04-24T13:31:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.945581+0000", 2024-04-24T13:31:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012363809999999999 2024-04-24T13:31:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946252+0000", 2024-04-24T13:31:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067128499999999998 2024-04-24T13:31:08.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946339+0000", 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6193999999999995e-05 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946403+0000", 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4364999999999998e-05 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.333171561999997, 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034937589999999999, 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 838 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970944+0000", 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3360000000000002e-06 2024-04-24T13:31:08.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970959+0000", 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.469e-05 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970989+0000", 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0159e-05 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971004+0000", 2024-04-24T13:31:08.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971147+0000", 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014242500000000001 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971514+0000", 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036720900000000001 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:08.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.972113+0000", 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00059902100000000004 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.973403+0000", 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012904189999999999 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974152+0000", 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074879600000000003 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974316+0000", 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164308 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974436+0000", 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119453 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.384 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.328863642000002, 2024-04-24T13:31:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030693220000000002, 2024-04-24T13:31:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 840 2024-04-24T13:31:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975252+0000", 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975261+0000", 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5089999999999999e-06 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975284+0000", 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2719999999999999e-05 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975297+0000", 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2666e-05 2024-04-24T13:31:08.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975425+0000", 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012792899999999999 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975661+0000", 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023588299999999999 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.976159+0000", 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000498264 2024-04-24T13:31:08.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.977419+0000", 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012604859999999999 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978048+0000", 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062885000000000003 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978211+0000", 2024-04-24T13:31:08.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016268899999999999 2024-04-24T13:31:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978319+0000", 2024-04-24T13:31:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108596 2024-04-24T13:31:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:08.390 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.270625340000002, 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033625529999999999, 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 865 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:08.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033491+0000", 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033502+0000", 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1693e-05 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033532+0000", 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0165999999999999e-05 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033549+0000", 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6113e-05 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033691+0000", 2024-04-24T13:31:08.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142445 2024-04-24T13:31:08.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034025+0000", 2024-04-24T13:31:08.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000334407 2024-04-24T13:31:08.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:08.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034537+0000", 2024-04-24T13:31:08.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051115299999999998 2024-04-24T13:31:08.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.035646+0000", 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011090169999999999 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036588+0000", 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094208599999999997 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036741+0000", 2024-04-24T13:31:08.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153055 2024-04-24T13:31:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036851+0000", 2024-04-24T13:31:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110245 2024-04-24T13:31:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:08.396 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.266125232, 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029772050000000001, 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 867 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:08.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037991+0000", 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1040000000000001e-06 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038001+0000", 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0910000000000001e-05 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038032+0000", 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0648999999999997e-05 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038050+0000", 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8151999999999998e-05 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038165+0000", 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115058 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038379+0000", 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021330000000000001 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038813+0000", 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00043452299999999997 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.039972+0000", 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001158793 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040723+0000", 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075142000000000004 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040864+0000", 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140624 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040966+0000", 2024-04-24T13:31:08.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101672 2024-04-24T13:31:08.402 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.402 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.402 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.402 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:888 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.402 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:08.402 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.217055494999997, 2024-04-24T13:31:08.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031285739999999999, 2024-04-24T13:31:08.402 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 888 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087060+0000", 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.516e-06 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087067+0000", 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2400000000000001e-06 2024-04-24T13:31:08.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087086+0000", 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9446e-05 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087096+0000", 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087221+0000", 2024-04-24T13:31:08.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012472300000000001 2024-04-24T13:31:08.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087467+0000", 2024-04-24T13:31:08.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024638200000000001 2024-04-24T13:31:08.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:08.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087959+0000", 2024-04-24T13:31:08.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049190900000000001 2024-04-24T13:31:08.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.089236+0000", 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001277037 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090046+0000", 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00080988200000000005 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090124+0000", 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7670999999999995e-05 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090187+0000", 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2798000000000004e-05 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.200334122000001, 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028897739999999999, 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.409 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.409 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.409 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.409 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.409 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 895 2024-04-24T13:31:08.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.409 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:08.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103782+0000", 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2029999999999999e-06 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103794+0000", 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1746000000000001e-05 2024-04-24T13:31:08.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103824+0000", 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0942999999999998e-05 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103846+0000", 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1086000000000001e-05 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104008+0000", 2024-04-24T13:31:08.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016265499999999999 2024-04-24T13:31:08.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104236+0000", 2024-04-24T13:31:08.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022747300000000001 2024-04-24T13:31:08.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:08.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104551+0000", 2024-04-24T13:31:08.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031555400000000001 2024-04-24T13:31:08.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.105734+0000", 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011832290000000001 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106519+0000", 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078438599999999998 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106603+0000", 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4455000000000004e-05 2024-04-24T13:31:08.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106669+0000", 2024-04-24T13:31:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6044000000000007e-05 2024-04-24T13:31:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.196606312999997, 2024-04-24T13:31:08.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027864140000000001, 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 897 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107509+0000", 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2500000000000001e-06 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107516+0000", 2024-04-24T13:31:08.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0929999999999997e-06 2024-04-24T13:31:08.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107535+0000", 2024-04-24T13:31:08.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9176000000000001e-05 2024-04-24T13:31:08.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107546+0000", 2024-04-24T13:31:08.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0596e-05 2024-04-24T13:31:08.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107647+0000", 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010131700000000001 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107791+0000", 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014395900000000001 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.108057+0000", 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026571500000000003 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.109123+0000", 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010666969999999999 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110108+0000", 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00098528700000000006 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110199+0000", 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0080000000000005e-05 2024-04-24T13:31:08.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110294+0000", 2024-04-24T13:31:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5243999999999998e-05 2024-04-24T13:31:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.190203943999997, 2024-04-24T13:31:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028668890000000001, 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 900 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113911+0000", 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5540000000000001e-06 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113919+0000", 2024-04-24T13:31:08.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4730000000000003e-06 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113937+0000", 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8462e-05 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113947+0000", 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5869999999999999e-06 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:08.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114061+0000", 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011431599999999999 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114188+0000", 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012727300000000001 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114460+0000", 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027200500000000002 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.115591+0000", 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011307719999999999 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116635+0000", 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044278 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116713+0000", 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7484000000000006e-05 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:08.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:08.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116777+0000", 2024-04-24T13:31:08.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3684999999999998e-05 2024-04-24T13:31:08.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.426 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.426 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:08.426 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:08.426 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:08.428 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:31:08.428 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:08.428 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:08.429 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:08.429 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:08.429 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:08.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:08.430 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:08.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:08.430 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:08.425+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:08.433 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:08.433 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:08.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:08.454 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:08.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:08.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:08.494 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:08.494 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:08.528 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:08.524+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:08.564 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:08.564 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:08.578 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:31:08.666 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:08.664+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:08.731 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:08.729+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:08.741 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:08.742 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:08.756 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:31:08.831 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:08.829+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:08.922 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:08.923 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:08.932 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:08.929+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:08.936 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:09.033 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:09.029+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:09.061 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:09.061 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:09.075 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:09.134 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:09.133+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:09.197 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:09.197 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:09.211 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:09.257 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:09.256+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:09.330 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:09.331 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:09.336 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:09.332+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:09.345 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:09.436 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:09.432+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:09.502 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:09.502 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:09.516 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:09.538 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:09.537+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:09.639 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:09.637+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:09.668 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:09.668 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:09.681 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:09.740 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:09.736+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:09.802 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:09.803 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:09.816 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:09.858 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:09.856+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:09.943 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:09.940+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:09.974 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:09.974 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:09.989 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:10.038 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:31:10.073 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:10.072+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:10.145 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:10.140+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:10.153 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:10.153 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:10.167 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:10.253 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:10.252+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:10.332 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:10.332 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:10.346 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:10.344+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:10.346 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:10.447 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:10.444+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:10.465 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:10.465 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:10.479 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:10.512 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:31:10.549 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:10.548+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:10.602 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:10.602 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:10.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:10.649 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:10.648+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:10.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:10.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:10.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:10.684 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:10.702 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:10.702 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:10.719 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:10.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:10.735 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:31:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.811509708000003, 2024-04-24T13:31:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:31:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:31:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:31:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:31:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:31:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:31:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:31:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:31:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:31:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:31:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:31:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.668717938, 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:31:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:31:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:31:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:31:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:31:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.666414869999997, 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:31:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:31:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:31:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:31:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:31:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:31:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:31:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:31:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:31:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.664720353, 2024-04-24T13:31:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:31:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.663262742000001, 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.661333653, 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:31:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:31:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:31:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:31:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.658909115999997, 2024-04-24T13:31:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:31:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.657706367000003, 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:31:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:31:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:31:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:31:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:31:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.654500202000001, 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:31:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:31:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:31:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:31:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.415444618000002, 2024-04-24T13:31:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:31:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:31:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:31:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:31:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:31:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.413023967000001, 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.412250749000002, 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:31:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:31:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:31:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:31:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:31:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:31:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.404511694999997, 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:31:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:31:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:31:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:31:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:31:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:31:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:31:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.056549588000003, 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:31:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:31:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.055800840000003, 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:31:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:31:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:31:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:31:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:31:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:31:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:31:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:31:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:31:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.054869715000002, 2024-04-24T13:31:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:31:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:31:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:31:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:31:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:31:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:31:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:31:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:31:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:31:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:31:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:31:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.054377924000001, 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:31:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:31:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:31:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:31:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:31:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:31:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:31:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.468296500000001, 2024-04-24T13:31:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:31:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:31:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:31:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:31:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:31:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:31:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:31:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:31:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:31:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.439449301000003, 2024-04-24T13:31:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:31:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:31:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:31:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:31:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:31:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:31:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:31:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:31:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:31:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.401258057, 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:31:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:31:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:31:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:31:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:31:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:31:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:10.829 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:10.830 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:10.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:10.831 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:10.832 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:10.832 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:10.832 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:10.833 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:10.833 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:10.834 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:10.834 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:10.829+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:10.931 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:10.932+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:10.994 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:10.994 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:10.994 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:10.994 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:11.008 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:11.030 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:31:11.032 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:11.028+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:11.133 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:11.132+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:11.134 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:11.134 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:11.135 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:11.135 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:11.135 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:11.149 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:11.234 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:11.233+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:11.274 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.056283051000001, 2024-04-24T13:31:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:31:11.274 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:31:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:31:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:31:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:31:11.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:31:11.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.000573971000001, 2024-04-24T13:31:11.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:31:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:31:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:31:11.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:31:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:31:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.996506830999998, 2024-04-24T13:31:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:31:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.285 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:31:11.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:31:11.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.994152939000003, 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:31:11.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:31:11.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:31:11.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.893127137, 2024-04-24T13:31:11.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:31:11.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:31:11.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:31:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:31:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.985378146000002, 2024-04-24T13:31:11.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:31:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:31:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:11.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.961582174, 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.307 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:31:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:31:11.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:31:11.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.934887054000001, 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.313 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:31:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:31:11.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:31:11.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.917145132999998, 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.319 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:11.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:31:11.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.324 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.883974924999997, 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.325 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:31:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:31:11.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:31:11.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:31:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:31:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:31:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:31:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:31:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:31:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.330 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.835942717999998, 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.331 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.336 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.809695062999999, 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:31:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:31:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.750312659999999, 2024-04-24T13:31:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:31:11.342 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:31:11.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:31:11.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:31:11.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.701845552999998, 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.348 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:31:11.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:31:11.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:31:11.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.31615498, 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.354 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:11.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:31:11.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:11.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:11.359 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.122067084999998, 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:11.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:31:11.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.118053811999999, 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.365 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.370 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.086000673000001, 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:31:11.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.376 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.081456672000002, 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.048305665000001, 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.382 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.387 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.388 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:11.389 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:11.390 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:11.385+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:11.490 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:11.488+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:11.560 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:11.560 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:11.560 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:11.560 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:11.574 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:11.591 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:11.592+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:11.691 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:11.691 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:11.691 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:11.691 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:11.691 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:11.692 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:11.689+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:11.705 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:11.794 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:11.793+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:11.875 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:11.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.58921634, 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026500819999999998, 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 42 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283130+0000", 2024-04-24T13:31:11.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3599999999999999e-06 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283143+0000", 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2989999999999999e-05 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283175+0000", 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1262e-05 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283190+0000", 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5333999999999999e-05 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283279+0000", 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8616000000000007e-05 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283443+0000", 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016473200000000001 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283600+0000", 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015686500000000001 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.284799+0000", 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011988229999999999 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285616+0000", 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081652500000000002 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285709+0000", 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3109999999999995e-05 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285778+0000", 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9465e-05 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.881 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.584342071999998, 2024-04-24T13:31:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025615049999999999, 2024-04-24T13:31:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 52 2024-04-24T13:31:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.882 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288005+0000", 2024-04-24T13:31:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:31:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288017+0000", 2024-04-24T13:31:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1995e-05 2024-04-24T13:31:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288050+0000", 2024-04-24T13:31:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2555999999999998e-05 2024-04-24T13:31:11.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288063+0000", 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3774999999999999e-05 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288165+0000", 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101394 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288357+0000", 2024-04-24T13:31:11.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019187800000000001 2024-04-24T13:31:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288525+0000", 2024-04-24T13:31:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016830600000000001 2024-04-24T13:31:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.289691+0000", 2024-04-24T13:31:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011659629999999999 2024-04-24T13:31:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290333+0000", 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064243099999999995 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290439+0000", 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105689 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290564+0000", 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012480600000000001 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.887 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.472899458000001, 2024-04-24T13:31:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:31:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.888 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:31:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:31:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:31:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:31:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:31:11.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.893 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.460822079000003, 2024-04-24T13:31:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029424360000000001, 2024-04-24T13:31:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.895 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 279 2024-04-24T13:31:11.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.895 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:11.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:11.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411523+0000", 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0899999999999999e-06 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411539+0000", 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411556+0000", 2024-04-24T13:31:11.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6588000000000001e-05 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411564+0000", 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6929999999999996e-06 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411638+0000", 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3244999999999994e-05 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411745+0000", 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107876 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411936+0000", 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000190819 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.412644+0000", 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070752499999999997 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414368+0000", 2024-04-24T13:31:11.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017246850000000001 2024-04-24T13:31:11.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414419+0000", 2024-04-24T13:31:11.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0513999999999998e-05 2024-04-24T13:31:11.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414465+0000", 2024-04-24T13:31:11.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5862000000000002e-05 2024-04-24T13:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.457115700000003, 2024-04-24T13:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.900 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.901 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:31:11.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.901 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:11.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:11.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:31:11.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:31:11.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:31:11.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:31:11.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:31:11.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:31:11.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:31:11.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:11.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:31:11.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:31:11.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:31:11.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:31:11.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.906 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.906 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:691 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.906 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:11.906 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.213963862999996, 2024-04-24T13:31:11.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027367860000000002, 2024-04-24T13:31:11.906 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 691 2024-04-24T13:31:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658383+0000", 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7719999999999999e-06 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658393+0000", 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1840000000000005e-06 2024-04-24T13:31:11.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658414+0000", 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0967000000000001e-05 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658424+0000", 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0961000000000001e-05 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658556+0000", 2024-04-24T13:31:11.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013183199999999999 2024-04-24T13:31:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658781+0000", 2024-04-24T13:31:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022427499999999999 2024-04-24T13:31:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.659230+0000", 2024-04-24T13:31:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044896299999999998 2024-04-24T13:31:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660178+0000", 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094838799999999999 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660868+0000", 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000689575 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661012+0000", 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000144735 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661117+0000", 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105134 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.013842908000001, 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.912 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:31:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:31:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:31:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:31:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:31:11.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:31:11.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.950499389999997, 2024-04-24T13:31:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:31:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:31:11.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:31:11.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.945823695000001, 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:31:11.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:31:11.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:11.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:11.928 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.893899845999997, 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028643660000000001, 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 841 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:11.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978447+0000", 2024-04-24T13:31:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-24T13:31:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978459+0000", 2024-04-24T13:31:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.224e-05 2024-04-24T13:31:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978489+0000", 2024-04-24T13:31:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9583000000000001e-05 2024-04-24T13:31:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978504+0000", 2024-04-24T13:31:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:31:11.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978612+0000", 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107327 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978831+0000", 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021982300000000001 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.979160+0000", 2024-04-24T13:31:11.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032855299999999998 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.980242+0000", 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010821649999999999 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981019+0000", 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00077641199999999998 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981185+0000", 2024-04-24T13:31:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016605499999999999 2024-04-24T13:31:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981309+0000", 2024-04-24T13:31:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012434300000000001 2024-04-24T13:31:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.934 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.889778964000001, 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:31:11.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:31:11.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:31:11.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:31:11.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:11.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:31:11.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:11.940 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.880032929000002, 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:11.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.875486117000001, 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002954763, 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.946 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 849 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996861+0000", 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2069999999999998e-06 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996871+0000", 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0753e-05 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996903+0000", 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996922+0000", 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8595999999999999e-05 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997042+0000", 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119646 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997271+0000", 2024-04-24T13:31:11.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228963 2024-04-24T13:31:11.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:11.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997736+0000", 2024-04-24T13:31:11.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000465181 2024-04-24T13:31:11.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999022+0000", 2024-04-24T13:31:11.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012864829999999999 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999529+0000", 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050722400000000002 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999697+0000", 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016795499999999999 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999813+0000", 2024-04-24T13:31:11.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115746 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.831200864000003, 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027316710000000002, 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.952 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 868 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041146+0000", 2024-04-24T13:31:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:31:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041156+0000", 2024-04-24T13:31:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0772e-05 2024-04-24T13:31:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041184+0000", 2024-04-24T13:31:11.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7616000000000001e-05 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041199+0000", 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4582e-05 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041309+0000", 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011029799999999999 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041532+0000", 2024-04-24T13:31:11.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022316 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041846+0000", 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031406700000000001 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043088+0000", 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001241409 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043667+0000", 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057961000000000004 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043767+0000", 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100166 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043875+0000", 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107871 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.742023596000003, 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003049946, 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 907 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.958 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130323+0000", 2024-04-24T13:31:11.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5859999999999999e-06 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130336+0000", 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.218e-05 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130367+0000", 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1665000000000003e-05 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130382+0000", 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5113000000000001e-05 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130510+0000", 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012778999999999999 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130749+0000", 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238669 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.131082+0000", 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033360300000000002 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.132266+0000", 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001183627 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133172+0000", 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090542200000000002 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133259+0000", 2024-04-24T13:31:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:31:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133371+0000", 2024-04-24T13:31:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011194 2024-04-24T13:31:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.738204746999997, 2024-04-24T13:31:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002722543, 2024-04-24T13:31:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 909 2024-04-24T13:31:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.964 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134141+0000", 2024-04-24T13:31:11.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:31:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134150+0000", 2024-04-24T13:31:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9430000000000006e-06 2024-04-24T13:31:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134172+0000", 2024-04-24T13:31:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1296000000000001e-05 2024-04-24T13:31:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134187+0000", 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5659e-05 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134275+0000", 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7787000000000005e-05 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134403+0000", 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127677 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134686+0000", 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028353500000000002 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.135742+0000", 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010557800000000001 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136663+0000", 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092043500000000005 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136753+0000", 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0871000000000005e-05 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136862+0000", 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010883 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.969 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.644509865000003, 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029521759999999999, 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 949 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227837+0000", 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2189999999999998e-06 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227848+0000", 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-05 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227876+0000", 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8972999999999999e-05 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227892+0000", 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5965999999999999e-05 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228028+0000", 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135322 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228256+0000", 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228237 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228706+0000", 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045042599999999997 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.229990+0000", 2024-04-24T13:31:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012836799999999999 2024-04-24T13:31:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230579+0000", 2024-04-24T13:31:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058925199999999996 2024-04-24T13:31:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230673+0000", 2024-04-24T13:31:11.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3484000000000001e-05 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230787+0000", 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113917 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.640402774999998, 2024-04-24T13:31:11.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:31:11.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.630202990999997, 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030452859999999999, 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.981 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 955 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242144+0000", 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2500000000000001e-06 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242155+0000", 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1779e-05 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242186+0000", 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0879e-05 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242202+0000", 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5566e-05 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242338+0000", 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013631299999999999 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242700+0000", 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036144900000000002 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.243261+0000", 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056143600000000001 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.244736+0000", 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001475248 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245034+0000", 2024-04-24T13:31:11.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029792099999999998 2024-04-24T13:31:11.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245119+0000", 2024-04-24T13:31:11.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4876999999999994e-05 2024-04-24T13:31:11.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245187+0000", 2024-04-24T13:31:11.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7568000000000001e-05 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.626277555999998, 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026970509999999998, 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:11.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 957 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:11.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246069+0000", 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4600000000000002e-06 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246081+0000", 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1780000000000001e-05 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246105+0000", 2024-04-24T13:31:11.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3805999999999999e-05 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246120+0000", 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5415999999999999e-05 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246221+0000", 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010027 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:11.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246367+0000", 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014653299999999999 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246645+0000", 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000277681 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.247868+0000", 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001223373 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:11.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248563+0000", 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694781 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248648+0000", 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5187999999999998e-05 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248764+0000", 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115763 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.993 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:11.993 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:11.993 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:11.994 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:31:11.995 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:11.993+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:12.095 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:12.093+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:12.169 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:12.170 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:12.170 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:12.170 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:12.184 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:31:12.196 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:12.192+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:12.297 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:12.293+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:12.351 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:12.352 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:12.352 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:12.352 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:12.352 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:12.365 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:31:12.406 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:12.405+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:12.499 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:12.496+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:12.532 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:31:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.281908129999998, 2024-04-24T13:31:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057346300000000001, 2024-04-24T13:31:12.532 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44 2024-04-24T13:31:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247277+0000", 2024-04-24T13:31:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3459999999999998e-06 2024-04-24T13:31:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247344+0000", 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6768999999999997e-05 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247379+0000", 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4573999999999998e-05 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247402+0000", 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3303e-05 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247599+0000", 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019720499999999999 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247622+0000", 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2512999999999999e-05 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.252825+0000", 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052035270000000003 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.253009+0000", 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018339300000000001 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.253265616999997, 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.537 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:31:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:31:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:31:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:31:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:31:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:31:12.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:12.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:31:12.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:31:12.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:31:12.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:31:12.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:31:12.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:31:12.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:12.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:31:12.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:31:12.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:31:12.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:31:12.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:31:12.543 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.202225976000001, 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031751589999999999, 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.544 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 216 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326959+0000", 2024-04-24T13:31:12.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6170000000000001e-06 2024-04-24T13:31:12.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326972+0000", 2024-04-24T13:31:12.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:31:12.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327005+0000", 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2845000000000001e-05 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327023+0000", 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8179999999999999e-05 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327132+0000", 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010878300000000001 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327351+0000", 2024-04-24T13:31:12.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021952000000000001 2024-04-24T13:31:12.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:12.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327770+0000", 2024-04-24T13:31:12.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041895600000000001 2024-04-24T13:31:12.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329354+0000", 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00158388 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329982+0000", 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062821700000000003 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330066+0000", 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4153999999999994e-05 2024-04-24T13:31:12.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330131+0000", 2024-04-24T13:31:12.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4920999999999997e-05 2024-04-24T13:31:12.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.551 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.551 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.551 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.551 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:12.551 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.162254904000001, 2024-04-24T13:31:12.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031663630000000002, 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 227 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:12.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366930+0000", 2024-04-24T13:31:12.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3800000000000001e-06 2024-04-24T13:31:12.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366941+0000", 2024-04-24T13:31:12.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1466e-05 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366973+0000", 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1588999999999999e-05 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366987+0000", 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4663e-05 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367166+0000", 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017905699999999999 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367388+0000", 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022201299999999999 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367820+0000", 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000431357 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369320+0000", 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015007359999999999 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369944+0000", 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062337299999999998 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370026+0000", 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2437999999999999e-05 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370094+0000", 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7291000000000003e-05 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.154943459000002, 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030833050000000002, 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.557 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 229 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:12.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374241+0000", 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5660000000000001e-06 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374253+0000", 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2094e-05 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374284+0000", 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0824999999999997e-05 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374299+0000", 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.483e-05 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374410+0000", 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110956 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374631+0000", 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221117 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.375006+0000", 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000375041 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.376480+0000", 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00147434 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377172+0000", 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00069190799999999998 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377255+0000", 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2536999999999999e-05 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377322+0000", 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7090999999999999e-05 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.562 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.563 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.563 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.563 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:12.563 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.148311450000001, 2024-04-24T13:31:12.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040131660000000003, 2024-04-24T13:31:12.563 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.563 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.563 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.563 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.563 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.563 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 231 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380873+0000", 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2400000000000002e-06 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380884+0000", 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0645999999999999e-05 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380919+0000", 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5026e-05 2024-04-24T13:31:12.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380934+0000", 2024-04-24T13:31:12.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.522e-05 2024-04-24T13:31:12.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381077+0000", 2024-04-24T13:31:12.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014362500000000001 2024-04-24T13:31:12.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381453+0000", 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037581799999999999 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.382170+0000", 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071714999999999995 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.383955+0000", 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017847710000000001 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384619+0000", 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066381600000000002 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384770+0000", 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015067800000000001 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384884+0000", 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114176 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.568 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:324 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.110279585999997, 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029016649999999999, 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.569 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 324 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418904+0000", 2024-04-24T13:31:12.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-06 2024-04-24T13:31:12.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418911+0000", 2024-04-24T13:31:12.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.759e-06 2024-04-24T13:31:12.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418928+0000", 2024-04-24T13:31:12.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7105e-05 2024-04-24T13:31:12.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418935+0000", 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7309999999999993e-06 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419024+0000", 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8524999999999997e-05 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419121+0000", 2024-04-24T13:31:12.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6978000000000006e-05 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419329+0000", 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020806399999999999 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419835+0000", 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050625300000000002 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421631+0000", 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001795615 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421694+0000", 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3398999999999994e-05 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421804+0000", 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109894 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.574 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:562 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.976348217000002, 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048608870000000004, 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 562 2024-04-24T13:31:12.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552837+0000", 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8499999999999998e-06 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552852+0000", 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4866e-05 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552890+0000", 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8166e-05 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552905+0000", 2024-04-24T13:31:12.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5255e-05 2024-04-24T13:31:12.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553053+0000", 2024-04-24T13:31:12.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014824599999999999 2024-04-24T13:31:12.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553425+0000", 2024-04-24T13:31:12.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000371512 2024-04-24T13:31:12.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553969+0000", 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054421500000000002 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.554987+0000", 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001017855 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557606+0000", 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026195839999999999 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557655+0000", 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8575000000000002e-05 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557695+0000", 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9762999999999999e-05 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:607 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.580 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.936478974000003, 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003243737, 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 607 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:12.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592705+0000", 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592714+0000", 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7630000000000006e-06 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592733+0000", 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9656e-05 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592745+0000", 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592881+0000", 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013627999999999999 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593221+0000", 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033945600000000002 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593765+0000", 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054456600000000002 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.594969+0000", 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012034649999999999 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595779+0000", 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000810161 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595893+0000", 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114481 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595947+0000", 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3352e-05 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.785371108, 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027976260000000001, 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.586 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.587 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.587 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.587 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.587 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.587 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 736 2024-04-24T13:31:12.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.587 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:12.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743813+0000", 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0899999999999999e-06 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743824+0000", 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.111e-05 2024-04-24T13:31:12.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743853+0000", 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909000000000001e-05 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743867+0000", 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4036000000000001e-05 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743980+0000", 2024-04-24T13:31:12.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011266 2024-04-24T13:31:12.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744205+0000", 2024-04-24T13:31:12.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000225016 2024-04-24T13:31:12.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:12.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744515+0000", 2024-04-24T13:31:12.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030974000000000003 2024-04-24T13:31:12.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.745485+0000", 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097096300000000003 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746512+0000", 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001026873 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746563+0000", 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1017000000000003e-05 2024-04-24T13:31:12.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746609+0000", 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5212e-05 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.696143728999999, 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028606399999999998, 2024-04-24T13:31:12.592 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.593 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.593 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.593 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.593 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.593 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.593 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 778 2024-04-24T13:31:12.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.593 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:12.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:12.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833041+0000", 2024-04-24T13:31:12.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3539999999999998e-06 2024-04-24T13:31:12.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833052+0000", 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833084+0000", 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833111+0000", 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6869e-05 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833245+0000", 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000133576 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833460+0000", 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021584600000000001 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833761+0000", 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000300477 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.834890+0000", 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011292050000000001 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835731+0000", 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000841423 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835829+0000", 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7337000000000007e-05 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835899+0000", 2024-04-24T13:31:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0151e-05 2024-04-24T13:31:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.585663382999996, 2024-04-24T13:31:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002884246, 2024-04-24T13:31:12.598 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 826 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943521+0000", 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4530000000000001e-06 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943532+0000", 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943563+0000", 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0982000000000003e-05 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943582+0000", 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8406e-05 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943781+0000", 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000199624 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944019+0000", 2024-04-24T13:31:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000237972 2024-04-24T13:31:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944345+0000", 2024-04-24T13:31:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032530699999999999 2024-04-24T13:31:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.945581+0000", 2024-04-24T13:31:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012363809999999999 2024-04-24T13:31:12.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946252+0000", 2024-04-24T13:31:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067128499999999998 2024-04-24T13:31:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946339+0000", 2024-04-24T13:31:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6193999999999995e-05 2024-04-24T13:31:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946403+0000", 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4364999999999998e-05 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.558239921999999, 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034937589999999999, 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.604 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 838 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970944+0000", 2024-04-24T13:31:12.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3360000000000002e-06 2024-04-24T13:31:12.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970959+0000", 2024-04-24T13:31:12.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.469e-05 2024-04-24T13:31:12.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970989+0000", 2024-04-24T13:31:12.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0159e-05 2024-04-24T13:31:12.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971004+0000", 2024-04-24T13:31:12.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:31:12.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971147+0000", 2024-04-24T13:31:12.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014242500000000001 2024-04-24T13:31:12.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971514+0000", 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036720900000000001 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.972113+0000", 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00059902100000000004 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.973403+0000", 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012904189999999999 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974152+0000", 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074879600000000003 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974316+0000", 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164308 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974436+0000", 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119453 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.609 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.553932002000003, 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030693220000000002, 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.610 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 840 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975252+0000", 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975261+0000", 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5089999999999999e-06 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975284+0000", 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2719999999999999e-05 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975297+0000", 2024-04-24T13:31:12.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2666e-05 2024-04-24T13:31:12.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975425+0000", 2024-04-24T13:31:12.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012792899999999999 2024-04-24T13:31:12.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975661+0000", 2024-04-24T13:31:12.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023588299999999999 2024-04-24T13:31:12.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.976159+0000", 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000498264 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.977419+0000", 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012604859999999999 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978048+0000", 2024-04-24T13:31:12.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062885000000000003 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978211+0000", 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016268899999999999 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978319+0000", 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108596 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.495693699999997, 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033625529999999999, 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 865 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033491+0000", 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:31:12.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033502+0000", 2024-04-24T13:31:12.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1693e-05 2024-04-24T13:31:12.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033532+0000", 2024-04-24T13:31:12.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0165999999999999e-05 2024-04-24T13:31:12.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033549+0000", 2024-04-24T13:31:12.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6113e-05 2024-04-24T13:31:12.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033691+0000", 2024-04-24T13:31:12.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142445 2024-04-24T13:31:12.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034025+0000", 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000334407 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034537+0000", 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051115299999999998 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.035646+0000", 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011090169999999999 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036588+0000", 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094208599999999997 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036741+0000", 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153055 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036851+0000", 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110245 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.621 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.622 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.622 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.622 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:12.622 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.491193592000002, 2024-04-24T13:31:12.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029772050000000001, 2024-04-24T13:31:12.622 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.622 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.622 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.622 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.622 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.622 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 867 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037991+0000", 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1040000000000001e-06 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038001+0000", 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0910000000000001e-05 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038032+0000", 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0648999999999997e-05 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038050+0000", 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8151999999999998e-05 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038165+0000", 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115058 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038379+0000", 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021330000000000001 2024-04-24T13:31:12.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:12.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038813+0000", 2024-04-24T13:31:12.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00043452299999999997 2024-04-24T13:31:12.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.039972+0000", 2024-04-24T13:31:12.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001158793 2024-04-24T13:31:12.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040723+0000", 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075142000000000004 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040864+0000", 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140624 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040966+0000", 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101672 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:888 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.442123854999998, 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031285739999999999, 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 888 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.628 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087060+0000", 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.516e-06 2024-04-24T13:31:12.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087067+0000", 2024-04-24T13:31:12.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2400000000000001e-06 2024-04-24T13:31:12.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087086+0000", 2024-04-24T13:31:12.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9446e-05 2024-04-24T13:31:12.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087096+0000", 2024-04-24T13:31:12.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:31:12.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087221+0000", 2024-04-24T13:31:12.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012472300000000001 2024-04-24T13:31:12.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087467+0000", 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024638200000000001 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087959+0000", 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049190900000000001 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.089236+0000", 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001277037 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090046+0000", 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00080988200000000005 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090124+0000", 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7670999999999995e-05 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090187+0000", 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2798000000000004e-05 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.425402482000003, 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028897739999999999, 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 895 2024-04-24T13:31:12.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103782+0000", 2024-04-24T13:31:12.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2029999999999999e-06 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103794+0000", 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1746000000000001e-05 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103824+0000", 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0942999999999998e-05 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103846+0000", 2024-04-24T13:31:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1086000000000001e-05 2024-04-24T13:31:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104008+0000", 2024-04-24T13:31:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016265499999999999 2024-04-24T13:31:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104236+0000", 2024-04-24T13:31:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022747300000000001 2024-04-24T13:31:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104551+0000", 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031555400000000001 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.105734+0000", 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011832290000000001 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106519+0000", 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078438599999999998 2024-04-24T13:31:12.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106603+0000", 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4455000000000004e-05 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106669+0000", 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6044000000000007e-05 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.421674672999998, 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027864140000000001, 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 897 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107509+0000", 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2500000000000001e-06 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107516+0000", 2024-04-24T13:31:12.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0929999999999997e-06 2024-04-24T13:31:12.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107535+0000", 2024-04-24T13:31:12.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9176000000000001e-05 2024-04-24T13:31:12.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107546+0000", 2024-04-24T13:31:12.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0596e-05 2024-04-24T13:31:12.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107647+0000", 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010131700000000001 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107791+0000", 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014395900000000001 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.108057+0000", 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026571500000000003 2024-04-24T13:31:12.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.109123+0000", 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010666969999999999 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110108+0000", 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00098528700000000006 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110199+0000", 2024-04-24T13:31:12.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0080000000000005e-05 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110294+0000", 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5243999999999998e-05 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 39.415272303999998, 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028668890000000001, 2024-04-24T13:31:12.645 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 900 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113911+0000", 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5540000000000001e-06 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113919+0000", 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4730000000000003e-06 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113937+0000", 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8462e-05 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113947+0000", 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5869999999999999e-06 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114061+0000", 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011431599999999999 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114188+0000", 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012727300000000001 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114460+0000", 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027200500000000002 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.115591+0000", 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011307719999999999 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116635+0000", 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044278 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116713+0000", 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7484000000000006e-05 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116777+0000", 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3684999999999998e-05 2024-04-24T13:31:12.650 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.651 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:12.651 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:12.651 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:12.652 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:31:12.653 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:12.652+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:12.754 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:12.753+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:12.783 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:12.783 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:12.784 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:12.784 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:12.798 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:31:12.834 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:31:12.854 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:12.852+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:12.916 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:12.917 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:12.917 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:12.917 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:12.917 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:12.930 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:31:12.973 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:12.972+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:12.989 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:12.989 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:13.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:13.006 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:13.022 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:13.022 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:13.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:13.039 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:13.053 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:31:13.056 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:13.052+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:13.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:13.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:13.081 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:13.081 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:13.092 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:13.092 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:13.101 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:13.101 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:13.106 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:13.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:13.120 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:13.194 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:13.192+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:13.258 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:13.253+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:13.272 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:13.272 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:13.286 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:13.382 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:13.380+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:13.458 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:13.458 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:13.459 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:13.457+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:13.472 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:13.559 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:13.556+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:13.630 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:13.630 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:13.644 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:13.660 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:13.657+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:13.761 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:13.760+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:13.810 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:13.810 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:13.825 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:13.870 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:13.868+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:13.963 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:13.961+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:13.985 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:13.985 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:14.000 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:14.055 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:31:14.064 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:14.060+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:14.126 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:14.126 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:14.142 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:14.186 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:14.184+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:14.266 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:14.261+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:14.311 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:14.312 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:14.326 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:14.367 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:14.365+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:14.444 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:14.444 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:14.458 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:14.467 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:14.465+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:14.568 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:14.565+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:14.574 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:14.574 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:14.588 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:14.670 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:14.669+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:14.718 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:14.718 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:14.732 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:14.774 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:14.773+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:14.872 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:14.869+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:14.898 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:14.898 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:14.912 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:14.973 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:14.968+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:15.074 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:15.072+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:15.078 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:15.078 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:15.093 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:15.138 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:31:15.175 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:15.172+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:15.216 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:15.216 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:15.231 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:15.282 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:15.281+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:15.292 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:15.292 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:15.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:15.309 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:15.326 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:15.326 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:15.344 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:15.344 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:15.354 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:15.354 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:15.354 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:15.354 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:15.354 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:15.365 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:15.365 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:15.368 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:15.376 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:15.372+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:15.386 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:15.387 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:15.408 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:15.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:15.429 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:15.430 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:15.494 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:15.493+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:15.510 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:15.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.293117272000003, 2024-04-24T13:31:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:31:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:31:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.511 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:31:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:31:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:31:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:31:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:31:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:31:15.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:31:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:31:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:31:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:31:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:31:15.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:31:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:31:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:31:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:31:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:31:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.237408191999997, 2024-04-24T13:31:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:31:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.517 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:31:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:31:15.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:31:15.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:31:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:31:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.233341052, 2024-04-24T13:31:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:31:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:31:15.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:31:15.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.230987159999998, 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.529 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:31:15.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:15.533 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.129961358000003, 2024-04-24T13:31:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:31:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:31:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:31:15.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:31:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:31:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:31:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:31:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:31:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:31:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:31:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:31:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:31:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:31:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:31:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:31:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:31:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:31:15.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:31:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:31:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:15.540 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.222212366999997, 2024-04-24T13:31:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:31:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:31:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.541 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:31:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:31:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:31:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:31:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:31:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:31:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:31:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:31:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:31:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:31:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:31:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:31:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:31:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:31:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:31:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:31:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:31:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:31:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:31:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:31:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:31:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:31:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.198416395000002, 2024-04-24T13:31:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:31:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.548 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:31:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:31:15.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:31:15.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:31:15.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:31:15.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:31:15.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:31:15.553 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.171721275000003, 2024-04-24T13:31:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:31:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.554 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:31:15.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:31:15.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:31:15.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:31:15.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:31:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:31:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:31:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:31:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:31:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:31:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:31:15.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:31:15.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:31:15.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:31:15.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:31:15.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.153979354000001, 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.560 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:15.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:31:15.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:31:15.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:31:15.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:31:15.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:31:15.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:31:15.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.120809145999999, 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.566 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:31:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:15.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:31:15.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:31:15.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:31:15.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:31:15.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:31:15.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:31:15.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:31:15.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:31:15.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:31:15.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:31:15.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:31:15.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:31:15.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:31:15.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:31:15.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:31:15.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:31:15.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:31:15.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:31:15.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:31:15.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:31:15.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:31:15.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:31:15.572 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.572 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.573 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.573 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.573 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:15.573 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.072776939000001, 2024-04-24T13:31:15.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:31:15.573 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.573 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.573 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.573 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.573 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.573 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.574 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:31:15.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.574 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:15.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:31:15.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:31:15.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:31:15.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:31:15.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:31:15.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:31:15.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:31:15.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:31:15.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:31:15.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:31:15.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:31:15.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:31:15.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:31:15.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:31:15.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:31:15.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:31:15.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:31:15.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:31:15.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:31:15.579 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.579 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.579 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.046529284000002, 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.580 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:31:15.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:31:15.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:31:15.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:31:15.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:31:15.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:31:15.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:31:15.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:31:15.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:31:15.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:31:15.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:31:15.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:31:15.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:31:15.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:31:15.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:31:15.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:31:15.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:31:15.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:31:15.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.586 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.987146881000001, 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.589 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:31:15.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.938679774000001, 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:31:15.592 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:31:15.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:31:15.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.552989201000003, 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.598 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:15.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:31:15.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:31:15.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:15.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:31:15.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:31:15.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:31:15.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:31:15.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:31:15.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:31:15.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:31:15.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:31:15.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.358901306, 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.604 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:15.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:31:15.609 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.354888033000002, 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.610 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:31:15.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:31:15.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:31:15.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:31:15.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:31:15.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:31:15.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:31:15.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:31:15.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:31:15.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:31:15.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:31:15.615 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.322834894000003, 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.616 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:31:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:31:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:31:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:31:15.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:31:15.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:31:15.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:31:15.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:31:15.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:31:15.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.621 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.622 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.622 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.622 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:15.622 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.318290892999997, 2024-04-24T13:31:15.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:31:15.622 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.622 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.622 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.622 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.622 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.622 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:31:15.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:31:15.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:31:15.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:15.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:31:15.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:31:15.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:31:15.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:31:15.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.627 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.285139886000003, 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:15.628 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:31:15.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.629 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:15.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:15.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:15.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:15.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:15.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:15.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:31:15.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:31:15.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:15.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.633 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:15.634 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:15.634 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:15.635 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:15.636 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:15.633+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:15.736 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:15.733+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:15.808 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:15.808 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:15.809 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:15.809 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:15.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:15.837 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:15.832+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:15.938 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:15.936+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:15.992 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:15.992 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:15.992 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:15.992 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:16.006 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:16.039 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:16.036+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:16.077 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:31:16.131 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:16.188 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:16.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:16.188 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:16.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.189 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:16.189 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:16.189 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.847484098000002, 2024-04-24T13:31:16.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026500819999999998, 2024-04-24T13:31:16.189 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.189 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.189 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.189 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:16.189 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:16.189 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 42 2024-04-24T13:31:16.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.190 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:16.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:16.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283130+0000", 2024-04-24T13:31:16.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3599999999999999e-06 2024-04-24T13:31:16.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283143+0000", 2024-04-24T13:31:16.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2989999999999999e-05 2024-04-24T13:31:16.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283175+0000", 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1262e-05 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283190+0000", 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5333999999999999e-05 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283279+0000", 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8616000000000007e-05 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283443+0000", 2024-04-24T13:31:16.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016473200000000001 2024-04-24T13:31:16.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:16.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283600+0000", 2024-04-24T13:31:16.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015686500000000001 2024-04-24T13:31:16.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.284799+0000", 2024-04-24T13:31:16.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011988229999999999 2024-04-24T13:31:16.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285616+0000", 2024-04-24T13:31:16.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081652500000000002 2024-04-24T13:31:16.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285709+0000", 2024-04-24T13:31:16.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3109999999999995e-05 2024-04-24T13:31:16.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285778+0000", 2024-04-24T13:31:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9465e-05 2024-04-24T13:31:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.842609830000001, 2024-04-24T13:31:16.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025615049999999999, 2024-04-24T13:31:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 52 2024-04-24T13:31:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:16.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288005+0000", 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288017+0000", 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1995e-05 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288050+0000", 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2555999999999998e-05 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288063+0000", 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3774999999999999e-05 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288165+0000", 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101394 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288357+0000", 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019187800000000001 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288525+0000", 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016830600000000001 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.289691+0000", 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011659629999999999 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290333+0000", 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064243099999999995 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290439+0000", 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105689 2024-04-24T13:31:16.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290564+0000", 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012480600000000001 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.731167216000003, 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:31:16.201 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:31:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:31:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:31:16.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:31:16.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:31:16.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:31:16.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:31:16.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:31:16.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:31:16.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:31:16.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:31:16.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.207 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.207 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.207 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.207 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:16.207 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.719089836999999, 2024-04-24T13:31:16.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029424360000000001, 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 279 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:16.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411523+0000", 2024-04-24T13:31:16.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0899999999999999e-06 2024-04-24T13:31:16.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411539+0000", 2024-04-24T13:31:16.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:31:16.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411556+0000", 2024-04-24T13:31:16.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6588000000000001e-05 2024-04-24T13:31:16.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411564+0000", 2024-04-24T13:31:16.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6929999999999996e-06 2024-04-24T13:31:16.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411638+0000", 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3244999999999994e-05 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411745+0000", 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107876 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411936+0000", 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000190819 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.412644+0000", 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070752499999999997 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414368+0000", 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017246850000000001 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414419+0000", 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0513999999999998e-05 2024-04-24T13:31:16.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414465+0000", 2024-04-24T13:31:16.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5862000000000002e-05 2024-04-24T13:31:16.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.213 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.213 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.213 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:16.213 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.715383457999998, 2024-04-24T13:31:16.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:31:16.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:31:16.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:31:16.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:31:16.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:31:16.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:31:16.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:31:16.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:31:16.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:31:16.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:31:16.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.219 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.219 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:691 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.219 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:16.219 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.472231620999999, 2024-04-24T13:31:16.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027367860000000002, 2024-04-24T13:31:16.219 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 691 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658383+0000", 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7719999999999999e-06 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658393+0000", 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1840000000000005e-06 2024-04-24T13:31:16.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658414+0000", 2024-04-24T13:31:16.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0967000000000001e-05 2024-04-24T13:31:16.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658424+0000", 2024-04-24T13:31:16.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0961000000000001e-05 2024-04-24T13:31:16.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658556+0000", 2024-04-24T13:31:16.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013183199999999999 2024-04-24T13:31:16.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658781+0000", 2024-04-24T13:31:16.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022427499999999999 2024-04-24T13:31:16.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:16.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.659230+0000", 2024-04-24T13:31:16.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044896299999999998 2024-04-24T13:31:16.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660178+0000", 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094838799999999999 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660868+0000", 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000689575 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661012+0000", 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000144735 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661117+0000", 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105134 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.272110666000003, 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.225 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:31:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:31:16.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:31:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:31:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:31:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:31:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.232 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.208767148, 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:31:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:31:16.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:31:16.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:16.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:31:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:31:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:31:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:31:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.238 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.204091452999997, 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:31:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:31:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:31:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:31:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:31:16.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:16.244 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.152167603999999, 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028643660000000001, 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 841 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:16.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978447+0000", 2024-04-24T13:31:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-24T13:31:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978459+0000", 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.224e-05 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978489+0000", 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9583000000000001e-05 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978504+0000", 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978612+0000", 2024-04-24T13:31:16.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107327 2024-04-24T13:31:16.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978831+0000", 2024-04-24T13:31:16.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021982300000000001 2024-04-24T13:31:16.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:16.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.979160+0000", 2024-04-24T13:31:16.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032855299999999998 2024-04-24T13:31:16.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.980242+0000", 2024-04-24T13:31:16.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010821649999999999 2024-04-24T13:31:16.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981019+0000", 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00077641199999999998 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981185+0000", 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016605499999999999 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981309+0000", 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012434300000000001 2024-04-24T13:31:16.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.251 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.251 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.251 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.251 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:16.251 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.148046721999997, 2024-04-24T13:31:16.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:31:16.251 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.251 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.252 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:31:16.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.252 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:16.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:16.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.256 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.138300686999997, 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.257 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:31:16.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:31:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:31:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:31:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:31:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.133753874999996, 2024-04-24T13:31:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002954763, 2024-04-24T13:31:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 849 2024-04-24T13:31:16.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996861+0000", 2024-04-24T13:31:16.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2069999999999998e-06 2024-04-24T13:31:16.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996871+0000", 2024-04-24T13:31:16.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0753e-05 2024-04-24T13:31:16.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996903+0000", 2024-04-24T13:31:16.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:31:16.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996922+0000", 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8595999999999999e-05 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997042+0000", 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119646 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997271+0000", 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228963 2024-04-24T13:31:16.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997736+0000", 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000465181 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999022+0000", 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012864829999999999 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999529+0000", 2024-04-24T13:31:16.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050722400000000002 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999697+0000", 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016795499999999999 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999813+0000", 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115746 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.089468621999998, 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027316710000000002, 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 868 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.269 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:16.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:16.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041146+0000", 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041156+0000", 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0772e-05 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041184+0000", 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7616000000000001e-05 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041199+0000", 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4582e-05 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041309+0000", 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011029799999999999 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041532+0000", 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022316 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041846+0000", 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031406700000000001 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043088+0000", 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001241409 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043667+0000", 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057961000000000004 2024-04-24T13:31:16.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043767+0000", 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100166 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043875+0000", 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107871 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.000291353999998, 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003049946, 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 907 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:16.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:16.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130323+0000", 2024-04-24T13:31:16.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5859999999999999e-06 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130336+0000", 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.218e-05 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130367+0000", 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1665000000000003e-05 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130382+0000", 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5113000000000001e-05 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130510+0000", 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012778999999999999 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130749+0000", 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238669 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.131082+0000", 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033360300000000002 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.132266+0000", 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001183627 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133172+0000", 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090542200000000002 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133259+0000", 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133371+0000", 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011194 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.280 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.996472505, 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002722543, 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 909 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:16.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:16.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134141+0000", 2024-04-24T13:31:16.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:31:16.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134150+0000", 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9430000000000006e-06 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134172+0000", 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1296000000000001e-05 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134187+0000", 2024-04-24T13:31:16.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5659e-05 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134275+0000", 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7787000000000005e-05 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134403+0000", 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127677 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134686+0000", 2024-04-24T13:31:16.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028353500000000002 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.135742+0000", 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010557800000000001 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136663+0000", 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092043500000000005 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136753+0000", 2024-04-24T13:31:16.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0871000000000005e-05 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136862+0000", 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010883 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.902777622999999, 2024-04-24T13:31:16.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029521759999999999, 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 949 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227837+0000", 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2189999999999998e-06 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227848+0000", 2024-04-24T13:31:16.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-05 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227876+0000", 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8972999999999999e-05 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227892+0000", 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5965999999999999e-05 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228028+0000", 2024-04-24T13:31:16.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135322 2024-04-24T13:31:16.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228256+0000", 2024-04-24T13:31:16.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228237 2024-04-24T13:31:16.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:16.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228706+0000", 2024-04-24T13:31:16.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045042599999999997 2024-04-24T13:31:16.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.229990+0000", 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012836799999999999 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230579+0000", 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058925199999999996 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230673+0000", 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3484000000000001e-05 2024-04-24T13:31:16.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230787+0000", 2024-04-24T13:31:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113917 2024-04-24T13:31:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.898670533000001, 2024-04-24T13:31:16.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:31:16.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.888470749, 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030452859999999999, 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.298 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.299 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 955 2024-04-24T13:31:16.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.299 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:16.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242144+0000", 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2500000000000001e-06 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242155+0000", 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1779e-05 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242186+0000", 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0879e-05 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242202+0000", 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5566e-05 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242338+0000", 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013631299999999999 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242700+0000", 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036144900000000002 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.243261+0000", 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056143600000000001 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.244736+0000", 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001475248 2024-04-24T13:31:16.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245034+0000", 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029792099999999998 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245119+0000", 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4876999999999994e-05 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245187+0000", 2024-04-24T13:31:16.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7568000000000001e-05 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.884545314, 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026970509999999998, 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 957 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246069+0000", 2024-04-24T13:31:16.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4600000000000002e-06 2024-04-24T13:31:16.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246081+0000", 2024-04-24T13:31:16.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1780000000000001e-05 2024-04-24T13:31:16.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246105+0000", 2024-04-24T13:31:16.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3805999999999999e-05 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246120+0000", 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5415999999999999e-05 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246221+0000", 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010027 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246367+0000", 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014653299999999999 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246645+0000", 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000277681 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.247868+0000", 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001223373 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248563+0000", 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694781 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248648+0000", 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5187999999999998e-05 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248764+0000", 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115763 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.309 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.310 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.310 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:16.311 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:31:16.312 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:16.308+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:16.412 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:16.409+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:16.430 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:16.430 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:16.430 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:16.444 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:31:16.513 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:16.508+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:16.610 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:16.610 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:16.611 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:16.611 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:16.614 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:16.612+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:16.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:31:16.715 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:16.713+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:16.752 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:16.752 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 49.502028668999998, 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057346300000000001, 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.753 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44 2024-04-24T13:31:16.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.754 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:16.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:16.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247277+0000", 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3459999999999998e-06 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247344+0000", 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6768999999999997e-05 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247379+0000", 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4573999999999998e-05 2024-04-24T13:31:16.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247402+0000", 2024-04-24T13:31:16.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3303e-05 2024-04-24T13:31:16.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247599+0000", 2024-04-24T13:31:16.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019720499999999999 2024-04-24T13:31:16.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:16.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247622+0000", 2024-04-24T13:31:16.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2512999999999999e-05 2024-04-24T13:31:16.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.252825+0000", 2024-04-24T13:31:16.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052035270000000003 2024-04-24T13:31:16.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.253009+0000", 2024-04-24T13:31:16.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018339300000000001 2024-04-24T13:31:16.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.758 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.758 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.758 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:16.758 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.473386155999997, 2024-04-24T13:31:16.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:31:16.758 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.758 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.758 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.764 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.422346515000001, 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031751589999999999, 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 216 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:16.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:16.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326959+0000", 2024-04-24T13:31:16.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6170000000000001e-06 2024-04-24T13:31:16.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326972+0000", 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327005+0000", 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2845000000000001e-05 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327023+0000", 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8179999999999999e-05 2024-04-24T13:31:16.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327132+0000", 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010878300000000001 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327351+0000", 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021952000000000001 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327770+0000", 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041895600000000001 2024-04-24T13:31:16.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329354+0000", 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00158388 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329982+0000", 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062821700000000003 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330066+0000", 2024-04-24T13:31:16.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4153999999999994e-05 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330131+0000", 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4920999999999997e-05 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.382375443000001, 2024-04-24T13:31:16.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031663630000000002, 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 227 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366930+0000", 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3800000000000001e-06 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366941+0000", 2024-04-24T13:31:16.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1466e-05 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366973+0000", 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1588999999999999e-05 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366987+0000", 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4663e-05 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367166+0000", 2024-04-24T13:31:16.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017905699999999999 2024-04-24T13:31:16.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367388+0000", 2024-04-24T13:31:16.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022201299999999999 2024-04-24T13:31:16.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:16.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367820+0000", 2024-04-24T13:31:16.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000431357 2024-04-24T13:31:16.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369320+0000", 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015007359999999999 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369944+0000", 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062337299999999998 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370026+0000", 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2437999999999999e-05 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370094+0000", 2024-04-24T13:31:16.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7291000000000003e-05 2024-04-24T13:31:16.776 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.776 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.776 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.776 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.776 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:16.776 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.375063998000002, 2024-04-24T13:31:16.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030833050000000002, 2024-04-24T13:31:16.777 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.777 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.777 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.777 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.777 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.777 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.777 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 229 2024-04-24T13:31:16.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.777 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374241+0000", 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5660000000000001e-06 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374253+0000", 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2094e-05 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374284+0000", 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0824999999999997e-05 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374299+0000", 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.483e-05 2024-04-24T13:31:16.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374410+0000", 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110956 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374631+0000", 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221117 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.375006+0000", 2024-04-24T13:31:16.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000375041 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.376480+0000", 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00147434 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377172+0000", 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00069190799999999998 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377255+0000", 2024-04-24T13:31:16.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2536999999999999e-05 2024-04-24T13:31:16.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377322+0000", 2024-04-24T13:31:16.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7090999999999999e-05 2024-04-24T13:31:16.782 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.782 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.782 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.782 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.782 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.368431989000001, 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040131660000000003, 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 231 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:16.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380873+0000", 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2400000000000002e-06 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380884+0000", 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0645999999999999e-05 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380919+0000", 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5026e-05 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380934+0000", 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.522e-05 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381077+0000", 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014362500000000001 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381453+0000", 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037581799999999999 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.382170+0000", 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071714999999999995 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.383955+0000", 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017847710000000001 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384619+0000", 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066381600000000002 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384770+0000", 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015067800000000001 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384884+0000", 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114176 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:324 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.330400124999997, 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029016649999999999, 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 324 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418904+0000", 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-06 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418911+0000", 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.759e-06 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418928+0000", 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7105e-05 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418935+0000", 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7309999999999993e-06 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419024+0000", 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8524999999999997e-05 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419121+0000", 2024-04-24T13:31:16.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6978000000000006e-05 2024-04-24T13:31:16.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:16.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419329+0000", 2024-04-24T13:31:16.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020806399999999999 2024-04-24T13:31:16.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419835+0000", 2024-04-24T13:31:16.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050625300000000002 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421631+0000", 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001795615 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421694+0000", 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3398999999999994e-05 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421804+0000", 2024-04-24T13:31:16.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109894 2024-04-24T13:31:16.794 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.794 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.794 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.794 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:562 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.794 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:16.794 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.196468756000002, 2024-04-24T13:31:16.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048608870000000004, 2024-04-24T13:31:16.794 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.794 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.794 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 562 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552837+0000", 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8499999999999998e-06 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552852+0000", 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4866e-05 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552890+0000", 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8166e-05 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552905+0000", 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5255e-05 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553053+0000", 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014824599999999999 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553425+0000", 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000371512 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553969+0000", 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054421500000000002 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.554987+0000", 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001017855 2024-04-24T13:31:16.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557606+0000", 2024-04-24T13:31:16.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026195839999999999 2024-04-24T13:31:16.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557655+0000", 2024-04-24T13:31:16.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8575000000000002e-05 2024-04-24T13:31:16.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557695+0000", 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9762999999999999e-05 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:607 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.156599513000003, 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003243737, 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.800 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 607 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:16.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592705+0000", 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592714+0000", 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7630000000000006e-06 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592733+0000", 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9656e-05 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592745+0000", 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592881+0000", 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013627999999999999 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593221+0000", 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033945600000000002 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593765+0000", 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054456600000000002 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.594969+0000", 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012034649999999999 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595779+0000", 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000810161 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595893+0000", 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114481 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595947+0000", 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3352e-05 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.805 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.005491646999999, 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027976260000000001, 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 736 2024-04-24T13:31:16.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743813+0000", 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0899999999999999e-06 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743824+0000", 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.111e-05 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743853+0000", 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909000000000001e-05 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743867+0000", 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4036000000000001e-05 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743980+0000", 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011266 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744205+0000", 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000225016 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744515+0000", 2024-04-24T13:31:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030974000000000003 2024-04-24T13:31:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.745485+0000", 2024-04-24T13:31:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097096300000000003 2024-04-24T13:31:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746512+0000", 2024-04-24T13:31:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001026873 2024-04-24T13:31:16.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746563+0000", 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1017000000000003e-05 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746609+0000", 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5212e-05 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.916264267999999, 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028606399999999998, 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 778 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833041+0000", 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3539999999999998e-06 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833052+0000", 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833084+0000", 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833111+0000", 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6869e-05 2024-04-24T13:31:16.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833245+0000", 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000133576 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833460+0000", 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021584600000000001 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833761+0000", 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000300477 2024-04-24T13:31:16.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.834890+0000", 2024-04-24T13:31:16.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011292050000000001 2024-04-24T13:31:16.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835731+0000", 2024-04-24T13:31:16.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000841423 2024-04-24T13:31:16.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835829+0000", 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7337000000000007e-05 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835899+0000", 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0151e-05 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.817 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.818 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:16.818 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.805783922000003, 2024-04-24T13:31:16.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002884246, 2024-04-24T13:31:16.818 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.818 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.818 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.818 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 826 2024-04-24T13:31:16.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.818 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943521+0000", 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4530000000000001e-06 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943532+0000", 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943563+0000", 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0982000000000003e-05 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943582+0000", 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8406e-05 2024-04-24T13:31:16.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943781+0000", 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000199624 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944019+0000", 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000237972 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944345+0000", 2024-04-24T13:31:16.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032530699999999999 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.945581+0000", 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012363809999999999 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946252+0000", 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067128499999999998 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946339+0000", 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6193999999999995e-05 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946403+0000", 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4364999999999998e-05 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:16.823 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.778360460999998, 2024-04-24T13:31:16.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034937589999999999, 2024-04-24T13:31:16.824 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.824 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.824 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.824 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.824 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.824 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.824 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 838 2024-04-24T13:31:16.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.824 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970944+0000", 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3360000000000002e-06 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970959+0000", 2024-04-24T13:31:16.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.469e-05 2024-04-24T13:31:16.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970989+0000", 2024-04-24T13:31:16.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0159e-05 2024-04-24T13:31:16.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971004+0000", 2024-04-24T13:31:16.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:31:16.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971147+0000", 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014242500000000001 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971514+0000", 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036720900000000001 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.972113+0000", 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00059902100000000004 2024-04-24T13:31:16.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.973403+0000", 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012904189999999999 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974152+0000", 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074879600000000003 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974316+0000", 2024-04-24T13:31:16.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164308 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974436+0000", 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119453 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.774052541000003, 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030693220000000002, 2024-04-24T13:31:16.829 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 840 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975252+0000", 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975261+0000", 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5089999999999999e-06 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975284+0000", 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2719999999999999e-05 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975297+0000", 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2666e-05 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975425+0000", 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012792899999999999 2024-04-24T13:31:16.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975661+0000", 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023588299999999999 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.976159+0000", 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000498264 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.977419+0000", 2024-04-24T13:31:16.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012604859999999999 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978048+0000", 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062885000000000003 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978211+0000", 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016268899999999999 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978319+0000", 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108596 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.715814238999997, 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033625529999999999, 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.835 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 865 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:16.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033491+0000", 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033502+0000", 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1693e-05 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033532+0000", 2024-04-24T13:31:16.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0165999999999999e-05 2024-04-24T13:31:16.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033549+0000", 2024-04-24T13:31:16.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6113e-05 2024-04-24T13:31:16.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033691+0000", 2024-04-24T13:31:16.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142445 2024-04-24T13:31:16.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034025+0000", 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000334407 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034537+0000", 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051115299999999998 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.035646+0000", 2024-04-24T13:31:16.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011090169999999999 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036588+0000", 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094208599999999997 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036741+0000", 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153055 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036851+0000", 2024-04-24T13:31:16.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110245 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.711314131000002, 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029772050000000001, 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 867 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037991+0000", 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1040000000000001e-06 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038001+0000", 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0910000000000001e-05 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038032+0000", 2024-04-24T13:31:16.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0648999999999997e-05 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038050+0000", 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8151999999999998e-05 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038165+0000", 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115058 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038379+0000", 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021330000000000001 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038813+0000", 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00043452299999999997 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.039972+0000", 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001158793 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040723+0000", 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075142000000000004 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040864+0000", 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140624 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040966+0000", 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101672 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.846 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.847 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.847 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:888 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.847 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:16.847 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.662244393999998, 2024-04-24T13:31:16.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031285739999999999, 2024-04-24T13:31:16.847 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.847 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.847 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.847 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.847 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.847 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.848 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 888 2024-04-24T13:31:16.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.848 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:16.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:16.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087060+0000", 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.516e-06 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087067+0000", 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2400000000000001e-06 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087086+0000", 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9446e-05 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087096+0000", 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087221+0000", 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012472300000000001 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087467+0000", 2024-04-24T13:31:16.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024638200000000001 2024-04-24T13:31:16.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:16.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087959+0000", 2024-04-24T13:31:16.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049190900000000001 2024-04-24T13:31:16.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.089236+0000", 2024-04-24T13:31:16.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001277037 2024-04-24T13:31:16.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090046+0000", 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00080988200000000005 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090124+0000", 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7670999999999995e-05 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090187+0000", 2024-04-24T13:31:16.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2798000000000004e-05 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.645523021000002, 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028897739999999999, 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.853 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.854 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.854 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 895 2024-04-24T13:31:16.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.854 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:16.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:16.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103782+0000", 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2029999999999999e-06 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103794+0000", 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1746000000000001e-05 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103824+0000", 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0942999999999998e-05 2024-04-24T13:31:16.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103846+0000", 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1086000000000001e-05 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104008+0000", 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016265499999999999 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104236+0000", 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022747300000000001 2024-04-24T13:31:16.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104551+0000", 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031555400000000001 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.105734+0000", 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011832290000000001 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106519+0000", 2024-04-24T13:31:16.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078438599999999998 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106603+0000", 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4455000000000004e-05 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106669+0000", 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6044000000000007e-05 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.641795211999998, 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027864140000000001, 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 897 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.859 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107509+0000", 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2500000000000001e-06 2024-04-24T13:31:16.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107516+0000", 2024-04-24T13:31:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0929999999999997e-06 2024-04-24T13:31:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107535+0000", 2024-04-24T13:31:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9176000000000001e-05 2024-04-24T13:31:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107546+0000", 2024-04-24T13:31:16.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0596e-05 2024-04-24T13:31:16.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107647+0000", 2024-04-24T13:31:16.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010131700000000001 2024-04-24T13:31:16.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107791+0000", 2024-04-24T13:31:16.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014395900000000001 2024-04-24T13:31:16.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.108057+0000", 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026571500000000003 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.109123+0000", 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010666969999999999 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110108+0000", 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00098528700000000006 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110199+0000", 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0080000000000005e-05 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110294+0000", 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5243999999999998e-05 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.864 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.635392842999998, 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028668890000000001, 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 900 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113911+0000", 2024-04-24T13:31:16.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5540000000000001e-06 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113919+0000", 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4730000000000003e-06 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113937+0000", 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8462e-05 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:16.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113947+0000", 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5869999999999999e-06 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114061+0000", 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011431599999999999 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114188+0000", 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012727300000000001 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:16.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114460+0000", 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027200500000000002 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.115591+0000", 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011307719999999999 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116635+0000", 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044278 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116713+0000", 2024-04-24T13:31:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7484000000000006e-05 2024-04-24T13:31:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116777+0000", 2024-04-24T13:31:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3684999999999998e-05 2024-04-24T13:31:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:16.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:16.870 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:16.872 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:31:16.872 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:16.872+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:16.973 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:16.973+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:17.004 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:17.005 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:17.005 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:17.005 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:17.018 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:31:17.064 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:31:17.074 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:17.073+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:17.143 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:17.143 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:17.143 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:17.143 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:17.143 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:17.157 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:31:17.175 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:17.173+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:17.275 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:17.273+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:17.280 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:31:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 50.054085674, 2024-04-24T13:31:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020457065, 2024-04-24T13:31:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-24T13:31:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.281 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-24T13:31:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:17.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225903+0000", 2024-04-24T13:31:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7100000000000001e-06 2024-04-24T13:31:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225922+0000", 2024-04-24T13:31:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8919999999999998e-05 2024-04-24T13:31:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225960+0000", 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7240000000000003e-05 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225987+0000", 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6919000000000001e-05 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226300+0000", 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000313701 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226317+0000", 2024-04-24T13:31:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6463000000000001e-05 2024-04-24T13:31:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231091+0000", 2024-04-24T13:31:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047739169999999999 2024-04-24T13:31:17.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:31:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231111+0000", 2024-04-24T13:31:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0605999999999999e-05 2024-04-24T13:31:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246073+0000", 2024-04-24T13:31:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014961264 2024-04-24T13:31:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246357+0000", 2024-04-24T13:31:17.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028432499999999999 2024-04-24T13:31:17.287 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.287 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.287 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.287 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-24T13:31:17.287 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:17.287 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.012946026999998, 2024-04-24T13:31:17.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056987720000000004, 2024-04-24T13:31:17.288 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.288 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.288 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.288 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:17.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:17.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267040+0000", 2024-04-24T13:31:17.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3e-07 2024-04-24T13:31:17.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267050+0000", 2024-04-24T13:31:17.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8560000000000002e-06 2024-04-24T13:31:17.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267205+0000", 2024-04-24T13:31:17.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520200000000001 2024-04-24T13:31:17.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267244+0000", 2024-04-24T13:31:17.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8587000000000002e-05 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267346+0000", 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010223200000000001 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267374+0000", 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8214000000000001e-05 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272631+0000", 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052563089999999998 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272738+0000", 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107642 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:47 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'2, mlcod=0'0)", 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.999035270999997, 2024-04-24T13:31:17.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052089900000000001, 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280951+0000", 2024-04-24T13:31:17.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7199999999999997e-07 2024-04-24T13:31:17.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280962+0000", 2024-04-24T13:31:17.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1094000000000001e-05 2024-04-24T13:31:17.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280981+0000", 2024-04-24T13:31:17.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9066e-05 2024-04-24T13:31:17.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280999+0000", 2024-04-24T13:31:17.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8148e-05 2024-04-24T13:31:17.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281144+0000", 2024-04-24T13:31:17.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014454999999999999 2024-04-24T13:31:17.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281190+0000", 2024-04-24T13:31:17.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5649000000000003e-05 2024-04-24T13:31:17.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286063+0000", 2024-04-24T13:31:17.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048732549999999999 2024-04-24T13:31:17.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286159+0000", 2024-04-24T13:31:17.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6355999999999997e-05 2024-04-24T13:31:17.297 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.298 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.298 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.298 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.298 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:17.298 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.977647390000001, 2024-04-24T13:31:17.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010258288000000001, 2024-04-24T13:31:17.298 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.298 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.299 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.299 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.299 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.299 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.299 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-24T13:31:17.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.299 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:17.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:17.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302342+0000", 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6059999999999999e-06 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302357+0000", 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5201999999999999e-05 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302393+0000", 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6386e-05 2024-04-24T13:31:17.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302411+0000", 2024-04-24T13:31:17.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7864999999999999e-05 2024-04-24T13:31:17.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302544+0000", 2024-04-24T13:31:17.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132526 2024-04-24T13:31:17.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:17.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302554+0000", 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0479000000000001e-05 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309290+0000", 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006735937 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309474+0000", 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000183981 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:17.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309873+0000", 2024-04-24T13:31:17.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000398618 2024-04-24T13:31:17.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.311131+0000", 2024-04-24T13:31:17.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012578929999999999 2024-04-24T13:31:17.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312443+0000", 2024-04-24T13:31:17.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001312648 2024-04-24T13:31:17.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312535+0000", 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1620999999999996e-05 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312596+0000", 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1525999999999993e-05 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.306 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.306 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:17.306 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.893352503000003, 2024-04-24T13:31:17.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035352830000000002, 2024-04-24T13:31:17.306 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.306 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.306 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.306 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.306 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.306 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.306 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 232 2024-04-24T13:31:17.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.306 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386636+0000", 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8329999999999998e-06 2024-04-24T13:31:17.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386649+0000", 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3586e-05 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386681+0000", 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1529000000000003e-05 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386697+0000", 2024-04-24T13:31:17.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6412000000000001e-05 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386869+0000", 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000171998 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.387124+0000", 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025514 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:17.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.387553+0000", 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000428758 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.389079+0000", 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015254089999999999 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390010+0000", 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00093115799999999996 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390099+0000", 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8826999999999995e-05 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390168+0000", 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9633000000000002e-05 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:283 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.311 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:17.312 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.865994463, 2024-04-24T13:31:17.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040489189999999998, 2024-04-24T13:31:17.312 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.312 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.312 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.312 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.312 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.312 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.312 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 283 2024-04-24T13:31:17.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.312 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413993+0000", 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0770000000000002e-06 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414006+0000", 2024-04-24T13:31:17.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2696e-05 2024-04-24T13:31:17.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414031+0000", 2024-04-24T13:31:17.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5639999999999998e-05 2024-04-24T13:31:17.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414046+0000", 2024-04-24T13:31:17.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4412e-05 2024-04-24T13:31:17.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414206+0000", 2024-04-24T13:31:17.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015972299999999999 2024-04-24T13:31:17.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414646+0000", 2024-04-24T13:31:17.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000440023 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.415227+0000", 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00058130599999999997 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.416668+0000", 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00144118 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417911+0000", 2024-04-24T13:31:17.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012426690000000001 2024-04-24T13:31:17.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417980+0000", 2024-04-24T13:31:17.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8942999999999994e-05 2024-04-24T13:31:17.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.418040+0000", 2024-04-24T13:31:17.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0250000000000001e-05 2024-04-24T13:31:17.318 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.318 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.318 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.318 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:299 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-04-24T13:31:17.318 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:17.318 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.862786282000002, 2024-04-24T13:31:17.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033212430000000002, 2024-04-24T13:31:17.318 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.318 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.318 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417201+0000", 2024-04-24T13:31:17.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.784e-06 2024-04-24T13:31:17.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417216+0000", 2024-04-24T13:31:17.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5464999999999998e-05 2024-04-24T13:31:17.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417238+0000", 2024-04-24T13:31:17.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1474000000000001e-05 2024-04-24T13:31:17.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417254+0000", 2024-04-24T13:31:17.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5954999999999999e-05 2024-04-24T13:31:17.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417425+0000", 2024-04-24T13:31:17.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017128799999999999 2024-04-24T13:31:17.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417457+0000", 2024-04-24T13:31:17.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1844000000000002e-05 2024-04-24T13:31:17.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.420406+0000", 2024-04-24T13:31:17.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002948895 2024-04-24T13:31:17.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.420520+0000", 2024-04-24T13:31:17.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011453799999999999 2024-04-24T13:31:17.323 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.323 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.323 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.323 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:319 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.323 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:17.323 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.860795717999999, 2024-04-24T13:31:17.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040866640000000003, 2024-04-24T13:31:17.324 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.324 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.324 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.324 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.324 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.324 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.324 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 319 2024-04-24T13:31:17.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.324 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:17.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:17.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419192+0000", 2024-04-24T13:31:17.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8759999999999999e-06 2024-04-24T13:31:17.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419217+0000", 2024-04-24T13:31:17.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5077000000000001e-05 2024-04-24T13:31:17.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419247+0000", 2024-04-24T13:31:17.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0054000000000001e-05 2024-04-24T13:31:17.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419262+0000", 2024-04-24T13:31:17.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4885000000000001e-05 2024-04-24T13:31:17.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419410+0000", 2024-04-24T13:31:17.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148701 2024-04-24T13:31:17.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419603+0000", 2024-04-24T13:31:17.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019235899999999999 2024-04-24T13:31:17.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:17.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419892+0000", 2024-04-24T13:31:17.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028910699999999998 2024-04-24T13:31:17.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.421211+0000", 2024-04-24T13:31:17.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013190599999999999 2024-04-24T13:31:17.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423024+0000", 2024-04-24T13:31:17.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001812971 2024-04-24T13:31:17.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423184+0000", 2024-04-24T13:31:17.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000160323 2024-04-24T13:31:17.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423276+0000", 2024-04-24T13:31:17.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2250999999999995e-05 2024-04-24T13:31:17.331 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.331 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.331 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.331 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:505 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.331 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:17.331 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.773236283000003, 2024-04-24T13:31:17.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031283859999999999, 2024-04-24T13:31:17.332 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.332 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.332 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.332 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.332 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.332 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.332 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 505 2024-04-24T13:31:17.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.332 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:17.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:17.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506752+0000", 2024-04-24T13:31:17.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7630000000000001e-06 2024-04-24T13:31:17.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506764+0000", 2024-04-24T13:31:17.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2318e-05 2024-04-24T13:31:17.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506794+0000", 2024-04-24T13:31:17.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9674000000000001e-05 2024-04-24T13:31:17.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506811+0000", 2024-04-24T13:31:17.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7507e-05 2024-04-24T13:31:17.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506914+0000", 2024-04-24T13:31:17.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010252 2024-04-24T13:31:17.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.507140+0000", 2024-04-24T13:31:17.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022651999999999999 2024-04-24T13:31:17.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:17.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.507604+0000", 2024-04-24T13:31:17.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046387099999999998 2024-04-24T13:31:17.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.508700+0000", 2024-04-24T13:31:17.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010960200000000001 2024-04-24T13:31:17.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509671+0000", 2024-04-24T13:31:17.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000970754 2024-04-24T13:31:17.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509777+0000", 2024-04-24T13:31:17.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105664 2024-04-24T13:31:17.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509878+0000", 2024-04-24T13:31:17.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100775 2024-04-24T13:31:17.339 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.339 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.339 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.339 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:545 6.2 6:479ba34f:::obj_delete_at_hint.0000000021:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.339 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:17.339 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.741374041, 2024-04-24T13:31:17.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003146893, 2024-04-24T13:31:17.339 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.339 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.339 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.340 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.340 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.340 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.340 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 545 2024-04-24T13:31:17.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.340 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:17.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:17.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538614+0000", 2024-04-24T13:31:17.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5790000000000002e-06 2024-04-24T13:31:17.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538627+0000", 2024-04-24T13:31:17.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2536e-05 2024-04-24T13:31:17.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538657+0000", 2024-04-24T13:31:17.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0363000000000001e-05 2024-04-24T13:31:17.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538673+0000", 2024-04-24T13:31:17.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5735000000000001e-05 2024-04-24T13:31:17.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538782+0000", 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010905599999999999 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539002+0000", 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022079900000000001 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539510+0000", 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00050796700000000001 2024-04-24T13:31:17.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.540770+0000", 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012598850000000001 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541525+0000", 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075419500000000004 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541678+0000", 2024-04-24T13:31:17.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153258 2024-04-24T13:31:17.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541758+0000", 2024-04-24T13:31:17.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0519999999999995e-05 2024-04-24T13:31:17.345 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.345 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.345 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.345 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:631 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.345 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:17.345 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.667292818, 2024-04-24T13:31:17.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003398257, 2024-04-24T13:31:17.346 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.346 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.346 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.346 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.346 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.346 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.346 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 631 2024-04-24T13:31:17.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.346 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612695+0000", 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7300000000000001e-06 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612708+0000", 2024-04-24T13:31:17.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2808e-05 2024-04-24T13:31:17.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612741+0000", 2024-04-24T13:31:17.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2676999999999999e-05 2024-04-24T13:31:17.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612757+0000", 2024-04-24T13:31:17.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6611000000000001e-05 2024-04-24T13:31:17.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612924+0000", 2024-04-24T13:31:17.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016621 2024-04-24T13:31:17.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.613299+0000", 2024-04-24T13:31:17.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037503299999999999 2024-04-24T13:31:17.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:17.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.613869+0000", 2024-04-24T13:31:17.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057067299999999995 2024-04-24T13:31:17.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615041+0000", 2024-04-24T13:31:17.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001171248 2024-04-24T13:31:17.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615795+0000", 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000754785 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615967+0000", 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017142200000000001 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.616091+0000", 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012406 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.351 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:647 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.654284541000003, 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028765370000000002, 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.352 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 647 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625703+0000", 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9850000000000001e-06 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625713+0000", 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8279999999999998e-06 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625740+0000", 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7174000000000001e-05 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625760+0000", 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9966000000000002e-05 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625912+0000", 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151815 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.626278+0000", 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036677200000000002 2024-04-24T13:31:17.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:17.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.626837+0000", 2024-04-24T13:31:17.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055886 2024-04-24T13:31:17.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628073+0000", 2024-04-24T13:31:17.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001235877 2024-04-24T13:31:17.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628338+0000", 2024-04-24T13:31:17.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026515499999999999 2024-04-24T13:31:17.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628479+0000", 2024-04-24T13:31:17.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014045799999999999 2024-04-24T13:31:17.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628577+0000", 2024-04-24T13:31:17.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8647000000000006e-05 2024-04-24T13:31:17.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.358 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.358 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.358 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:17.358 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.593052608000001, 2024-04-24T13:31:17.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034770059999999999, 2024-04-24T13:31:17.358 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.358 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.359 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.359 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 709 2024-04-24T13:31:17.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.359 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:17.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:17.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686935+0000", 2024-04-24T13:31:17.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4760000000000001e-06 2024-04-24T13:31:17.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686948+0000", 2024-04-24T13:31:17.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2846e-05 2024-04-24T13:31:17.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686979+0000", 2024-04-24T13:31:17.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0987e-05 2024-04-24T13:31:17.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686995+0000", 2024-04-24T13:31:17.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5580999999999999e-05 2024-04-24T13:31:17.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687121+0000", 2024-04-24T13:31:17.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012667399999999999 2024-04-24T13:31:17.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687328+0000", 2024-04-24T13:31:17.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000206741 2024-04-24T13:31:17.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:17.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687614+0000", 2024-04-24T13:31:17.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028608300000000002 2024-04-24T13:31:17.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688763+0000", 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001148533 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690207+0000", 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00144458 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690293+0000", 2024-04-24T13:31:17.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5858000000000004e-05 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690410+0000", 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116647 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.553797944999999, 2024-04-24T13:31:17.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029468519999999998, 2024-04-24T13:31:17.366 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.366 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.366 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.366 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.366 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.366 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.366 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 727 2024-04-24T13:31:17.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.366 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:17.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:17.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726190+0000", 2024-04-24T13:31:17.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.26e-06 2024-04-24T13:31:17.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726201+0000", 2024-04-24T13:31:17.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1615e-05 2024-04-24T13:31:17.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726233+0000", 2024-04-24T13:31:17.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1547000000000001e-05 2024-04-24T13:31:17.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726252+0000", 2024-04-24T13:31:17.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8681e-05 2024-04-24T13:31:17.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726381+0000", 2024-04-24T13:31:17.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012944000000000001 2024-04-24T13:31:17.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726611+0000", 2024-04-24T13:31:17.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023025500000000001 2024-04-24T13:31:17.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:17.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726950+0000", 2024-04-24T13:31:17.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033885399999999998 2024-04-24T13:31:17.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.728086+0000", 2024-04-24T13:31:17.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011360039999999999 2024-04-24T13:31:17.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.728982+0000", 2024-04-24T13:31:17.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00089614899999999995 2024-04-24T13:31:17.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.729067+0000", 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4968000000000004e-05 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.729134+0000", 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7078999999999999e-05 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:729 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.549717039000001, 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030005850000000001, 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 729 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:17.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:17.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730270+0000", 2024-04-24T13:31:17.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8059999999999999e-06 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730278+0000", 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2789999999999998e-06 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730298+0000", 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9488e-05 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730309+0000", 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1294999999999999e-05 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730436+0000", 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012690999999999999 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730677+0000", 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000241275 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:17.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.731167+0000", 2024-04-24T13:31:17.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048962799999999998 2024-04-24T13:31:17.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.732344+0000", 2024-04-24T13:31:17.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011773619999999999 2024-04-24T13:31:17.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733135+0000", 2024-04-24T13:31:17.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000790213 2024-04-24T13:31:17.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733209+0000", 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4488999999999998e-05 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733269+0000", 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9840000000000003e-05 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.380 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.380 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:17.380 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.363939741000003, 2024-04-24T13:31:17.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034749830000000001, 2024-04-24T13:31:17.380 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.380 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.380 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.380 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.380 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.381 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.381 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 814 2024-04-24T13:31:17.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.381 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:17.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:17.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916048+0000", 2024-04-24T13:31:17.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2330000000000001e-06 2024-04-24T13:31:17.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916059+0000", 2024-04-24T13:31:17.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1266e-05 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916090+0000", 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0993e-05 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916109+0000", 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8751999999999999e-05 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916265+0000", 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015573 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916632+0000", 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367597 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.917180+0000", 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054785599999999999 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.918555+0000", 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001374781 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919250+0000", 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069470700000000003 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919404+0000", 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015483000000000001 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919521+0000", 2024-04-24T13:31:17.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011623799999999999 2024-04-24T13:31:17.386 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.386 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.386 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.386 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.386 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:17.386 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.209107912, 2024-04-24T13:31:17.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029290919999999999, 2024-04-24T13:31:17.386 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.386 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 880 2024-04-24T13:31:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:17.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070880+0000", 2024-04-24T13:31:17.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8660000000000002e-06 2024-04-24T13:31:17.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070911+0000", 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0783e-05 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070942+0000", 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0979999999999998e-05 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070958+0000", 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5858999999999998e-05 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071120+0000", 2024-04-24T13:31:17.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016239999999999999 2024-04-24T13:31:17.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071370+0000", 2024-04-24T13:31:17.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000249301 2024-04-24T13:31:17.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:17.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071695+0000", 2024-04-24T13:31:17.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032495000000000001 2024-04-24T13:31:17.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.072963+0000", 2024-04-24T13:31:17.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001268443 2024-04-24T13:31:17.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073655+0000", 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069215800000000001 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073741+0000", 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5731999999999998e-05 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073807+0000", 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5619999999999999e-05 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.392 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.393 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.393 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.393 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:17.393 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.201766792999997, 2024-04-24T13:31:17.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002986266, 2024-04-24T13:31:17.393 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.393 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.393 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.393 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.394 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.394 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.394 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 883 2024-04-24T13:31:17.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.394 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:17.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:17.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078221+0000", 2024-04-24T13:31:17.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.889e-06 2024-04-24T13:31:17.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078230+0000", 2024-04-24T13:31:17.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5990000000000008e-06 2024-04-24T13:31:17.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078261+0000", 2024-04-24T13:31:17.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1080000000000001e-05 2024-04-24T13:31:17.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078280+0000", 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8678999999999999e-05 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078405+0000", 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012481699999999999 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078649+0000", 2024-04-24T13:31:17.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244045 2024-04-24T13:31:17.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:17.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078997+0000", 2024-04-24T13:31:17.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347821 2024-04-24T13:31:17.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.080294+0000", 2024-04-24T13:31:17.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012972470000000001 2024-04-24T13:31:17.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081048+0000", 2024-04-24T13:31:17.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075421500000000003 2024-04-24T13:31:17.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081136+0000", 2024-04-24T13:31:17.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8184999999999997e-05 2024-04-24T13:31:17.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081205+0000", 2024-04-24T13:31:17.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8689000000000006e-05 2024-04-24T13:31:17.400 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.400 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.400 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.401 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.401 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:17.401 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.105729169, 2024-04-24T13:31:17.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003313323, 2024-04-24T13:31:17.401 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.401 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.402 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.402 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.402 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.402 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.402 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 925 2024-04-24T13:31:17.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.402 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:17.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:17.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174258+0000", 2024-04-24T13:31:17.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2170000000000001e-06 2024-04-24T13:31:17.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174270+0000", 2024-04-24T13:31:17.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1185e-05 2024-04-24T13:31:17.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174301+0000", 2024-04-24T13:31:17.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1167000000000002e-05 2024-04-24T13:31:17.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174316+0000", 2024-04-24T13:31:17.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5398000000000001e-05 2024-04-24T13:31:17.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174471+0000", 2024-04-24T13:31:17.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015502800000000001 2024-04-24T13:31:17.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174834+0000", 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036226299999999998 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.175395+0000", 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00056120499999999995 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.176785+0000", 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001390584 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177301+0000", 2024-04-24T13:31:17.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00051609300000000002 2024-04-24T13:31:17.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177459+0000", 2024-04-24T13:31:17.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015735400000000001 2024-04-24T13:31:17.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177570+0000", 2024-04-24T13:31:17.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011082900000000001 2024-04-24T13:31:17.408 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.409 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.409 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.409 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:17.409 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:17.409 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 44.098457639000003, 2024-04-24T13:31:17.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030825470000000002, 2024-04-24T13:31:17.409 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:17.409 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:17.409 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:17.409 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:17.410 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:17.410 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:17.410 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 928 2024-04-24T13:31:17.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.410 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:17.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:17.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:17.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:17.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:17.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:17.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:17.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181530+0000", 2024-04-24T13:31:17.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.75e-06 2024-04-24T13:31:17.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:17.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181539+0000", 2024-04-24T13:31:17.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0350000000000007e-06 2024-04-24T13:31:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181565+0000", 2024-04-24T13:31:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6523999999999999e-05 2024-04-24T13:31:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181579+0000", 2024-04-24T13:31:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3732e-05 2024-04-24T13:31:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181703+0000", 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012400099999999999 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.182049+0000", 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000346461 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.182596+0000", 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054673999999999999 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.183810+0000", 2024-04-24T13:31:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001213769 2024-04-24T13:31:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184460+0000", 2024-04-24T13:31:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00065003000000000001 2024-04-24T13:31:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:17.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184543+0000", 2024-04-24T13:31:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3545000000000001e-05 2024-04-24T13:31:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184610+0000", 2024-04-24T13:31:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6959999999999996e-05 2024-04-24T13:31:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:17.415 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:17.416 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:17.417 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:17.417 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:17.413+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:17.449 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:31:17.518 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:17.516+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:17.549 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:17.549 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:17.549 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:17.549 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:17.563 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:17.603 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:17.603 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:17.618 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:17.617+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:17.619 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:17.619 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:17.635 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:17.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:17.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:17.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:17.670 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:17.670 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:17.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:17.689 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:17.709 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:17.709 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:17.720 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:17.716+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:17.723 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:17.723 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:17.729 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:17.729 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:17.738 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:17.826 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:17.824+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:17.906 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:17.906 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:17.920 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:17.922 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:17.921+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:18.023 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:18.021+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:18.087 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:18.087 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:18.101 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:18.124 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:18.121+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:18.226 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:18.226 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:18.226 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:18.221+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:18.241 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:18.326 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:18.324+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:18.364 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:18.364 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:18.378 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:18.466 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:18.464+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:18.527 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:18.524+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:18.543 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:18.543 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:18.557 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:18.628 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:18.625+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:18.726 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:18.726 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:18.729 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:18.725+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:18.740 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:18.830 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:18.828+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:18.860 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:18.860 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:18.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:18.931 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:18.929+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:19.005 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:19.005 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:19.019 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:19.062 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:19.061+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:19.087 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:31:19.154 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:19.153+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:19.187 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:19.187 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:19.202 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:19.234 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:19.232+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:19.335 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:19.333+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:19.361 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:19.361 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:19.375 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:19.462 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:19.461+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:19.537 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:19.532+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:19.539 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:19.539 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:19.554 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:19.638 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:19.636+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:19.719 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:19.721 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:19.732 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:19.739 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:19.740+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:19.748 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:31:19.840 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:19.836+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:19.860 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:19.861 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:19.876 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:19.919 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-24T13:31:19.919 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-24T13:31:19.919 INFO:tasks.thrashosds.thrasher:inject_pause on osd.5 2024-04-24T13:31:19.919 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-24T13:31:19.919 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-24T13:31:19.919 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok config set filestore_inject_stall 3 2024-04-24T13:31:19.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:19.928 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:19.946 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:19.947 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:19.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:19.964 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:19.965 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:19.964+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:19.980 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:19.981 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:19.994 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:19.995 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:19.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:19.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:20.008 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:20.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:20.018 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:20.041 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:20.040+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:20.051 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:20.051 INFO:teuthology.orchestra.run.smithi138.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-24T13:31:20.051 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:20.052 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:20.052 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:20.086 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:20.086 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:20.143 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:20.143 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:20.143 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:20.143 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:20.143 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:20.143 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:20.140+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:20.156 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:20.243 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:20.241+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:20.296 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:31:20.331 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.046155974000001, 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026500819999999998, 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:20.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 42 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283130+0000", 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3599999999999999e-06 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283143+0000", 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2989999999999999e-05 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283175+0000", 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1262e-05 2024-04-24T13:31:20.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283190+0000", 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5333999999999999e-05 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283279+0000", 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8616000000000007e-05 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283443+0000", 2024-04-24T13:31:20.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016473200000000001 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283600+0000", 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015686500000000001 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.284799+0000", 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011988229999999999 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285616+0000", 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081652500000000002 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285709+0000", 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3109999999999995e-05 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285778+0000", 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9465e-05 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.041281705999999, 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025615049999999999, 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 52 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.338 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:20.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:20.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288005+0000", 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288017+0000", 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1995e-05 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288050+0000", 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2555999999999998e-05 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288063+0000", 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3774999999999999e-05 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288165+0000", 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101394 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288357+0000", 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019187800000000001 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:20.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288525+0000", 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016830600000000001 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.289691+0000", 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011659629999999999 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290333+0000", 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064243099999999995 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290439+0000", 2024-04-24T13:31:20.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105689 2024-04-24T13:31:20.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290564+0000", 2024-04-24T13:31:20.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012480600000000001 2024-04-24T13:31:20.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.343 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.343 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.929839092000002, 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:31:20.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:31:20.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:31:20.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:31:20.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:31:20.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.917761712999997, 2024-04-24T13:31:20.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029424360000000001, 2024-04-24T13:31:20.350 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.350 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.350 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 279 2024-04-24T13:31:20.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.350 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:20.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411523+0000", 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0899999999999999e-06 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411539+0000", 2024-04-24T13:31:20.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411556+0000", 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6588000000000001e-05 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411564+0000", 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6929999999999996e-06 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411638+0000", 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3244999999999994e-05 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411745+0000", 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107876 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411936+0000", 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000190819 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.412644+0000", 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070752499999999997 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414368+0000", 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017246850000000001 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414419+0000", 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0513999999999998e-05 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414465+0000", 2024-04-24T13:31:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5862000000000002e-05 2024-04-24T13:31:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.914055333999997, 2024-04-24T13:31:20.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:31:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:31:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:31:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:31:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:31:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:31:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:31:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:31:20.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:31:20.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:31:20.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:691 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.670903496999998, 2024-04-24T13:31:20.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027367860000000002, 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 691 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658383+0000", 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7719999999999999e-06 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658393+0000", 2024-04-24T13:31:20.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1840000000000005e-06 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658414+0000", 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0967000000000001e-05 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658424+0000", 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0961000000000001e-05 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658556+0000", 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013183199999999999 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658781+0000", 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022427499999999999 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.659230+0000", 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044896299999999998 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660178+0000", 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094838799999999999 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660868+0000", 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000689575 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661012+0000", 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000144735 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661117+0000", 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105134 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.470782542000002, 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.367 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:31:20.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:31:20.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:20.371 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.407439023999999, 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:31:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:31:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.402763329000003, 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.377 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.382 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.350839479999998, 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028643660000000001, 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 841 2024-04-24T13:31:20.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978447+0000", 2024-04-24T13:31:20.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978459+0000", 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.224e-05 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978489+0000", 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9583000000000001e-05 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978504+0000", 2024-04-24T13:31:20.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:31:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978612+0000", 2024-04-24T13:31:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107327 2024-04-24T13:31:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978831+0000", 2024-04-24T13:31:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021982300000000001 2024-04-24T13:31:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.979160+0000", 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032855299999999998 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.980242+0000", 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010821649999999999 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981019+0000", 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00077641199999999998 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981185+0000", 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016605499999999999 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981309+0000", 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012434300000000001 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.388 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.346718598000002, 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:31:20.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:31:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:31:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:31:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:31:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:31:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:31:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:31:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.395 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.336972563000003, 2024-04-24T13:31:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:31:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.396 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:31:20.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.332425751000002, 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002954763, 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 849 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996861+0000", 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2069999999999998e-06 2024-04-24T13:31:20.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996871+0000", 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0753e-05 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996903+0000", 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996922+0000", 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8595999999999999e-05 2024-04-24T13:31:20.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997042+0000", 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119646 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997271+0000", 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228963 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997736+0000", 2024-04-24T13:31:20.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000465181 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999022+0000", 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012864829999999999 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999529+0000", 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050722400000000002 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999697+0000", 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016795499999999999 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999813+0000", 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115746 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.288140497999997, 2024-04-24T13:31:20.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027316710000000002, 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 868 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041146+0000", 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041156+0000", 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0772e-05 2024-04-24T13:31:20.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041184+0000", 2024-04-24T13:31:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7616000000000001e-05 2024-04-24T13:31:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041199+0000", 2024-04-24T13:31:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4582e-05 2024-04-24T13:31:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041309+0000", 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011029799999999999 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041532+0000", 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022316 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041846+0000", 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031406700000000001 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043088+0000", 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001241409 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043667+0000", 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057961000000000004 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043767+0000", 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100166 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043875+0000", 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107871 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.198963229999997, 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003049946, 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.413 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 907 2024-04-24T13:31:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130323+0000", 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5859999999999999e-06 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130336+0000", 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.218e-05 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130367+0000", 2024-04-24T13:31:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1665000000000003e-05 2024-04-24T13:31:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130382+0000", 2024-04-24T13:31:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5113000000000001e-05 2024-04-24T13:31:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130510+0000", 2024-04-24T13:31:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012778999999999999 2024-04-24T13:31:20.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130749+0000", 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238669 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.131082+0000", 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033360300000000002 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.132266+0000", 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001183627 2024-04-24T13:31:20.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133172+0000", 2024-04-24T13:31:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090542200000000002 2024-04-24T13:31:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133259+0000", 2024-04-24T13:31:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:31:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133371+0000", 2024-04-24T13:31:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011194 2024-04-24T13:31:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.195144380999999, 2024-04-24T13:31:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002722543, 2024-04-24T13:31:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.419 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 909 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:20.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134141+0000", 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134150+0000", 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9430000000000006e-06 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134172+0000", 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1296000000000001e-05 2024-04-24T13:31:20.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134187+0000", 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5659e-05 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134275+0000", 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7787000000000005e-05 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134403+0000", 2024-04-24T13:31:20.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127677 2024-04-24T13:31:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134686+0000", 2024-04-24T13:31:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028353500000000002 2024-04-24T13:31:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.135742+0000", 2024-04-24T13:31:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010557800000000001 2024-04-24T13:31:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136663+0000", 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092043500000000005 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136753+0000", 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0871000000000005e-05 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136862+0000", 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010883 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.424 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.101449498999997, 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029521759999999999, 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 949 2024-04-24T13:31:20.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227837+0000", 2024-04-24T13:31:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2189999999999998e-06 2024-04-24T13:31:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227848+0000", 2024-04-24T13:31:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-05 2024-04-24T13:31:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227876+0000", 2024-04-24T13:31:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8972999999999999e-05 2024-04-24T13:31:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227892+0000", 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5965999999999999e-05 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228028+0000", 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135322 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228256+0000", 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228237 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228706+0000", 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045042599999999997 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.229990+0000", 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012836799999999999 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230579+0000", 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058925199999999996 2024-04-24T13:31:20.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230673+0000", 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3484000000000001e-05 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230787+0000", 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113917 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.097342408999999, 2024-04-24T13:31:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:31:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:31:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.431 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:31:20.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:31:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:31:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:31:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:31:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:31:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:31:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:31:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:31:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:31:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:31:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:31:20.436 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.087142624999998, 2024-04-24T13:31:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030452859999999999, 2024-04-24T13:31:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.437 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 955 2024-04-24T13:31:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:20.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242144+0000", 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2500000000000001e-06 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242155+0000", 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1779e-05 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242186+0000", 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0879e-05 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242202+0000", 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5566e-05 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242338+0000", 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013631299999999999 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242700+0000", 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036144900000000002 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.243261+0000", 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056143600000000001 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.244736+0000", 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001475248 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245034+0000", 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029792099999999998 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245119+0000", 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4876999999999994e-05 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245187+0000", 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7568000000000001e-05 2024-04-24T13:31:20.442 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.083217189999999, 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026970509999999998, 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.443 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 957 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246069+0000", 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4600000000000002e-06 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246081+0000", 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1780000000000001e-05 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246105+0000", 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3805999999999999e-05 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246120+0000", 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5415999999999999e-05 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246221+0000", 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010027 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246367+0000", 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014653299999999999 2024-04-24T13:31:20.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:20.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246645+0000", 2024-04-24T13:31:20.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000277681 2024-04-24T13:31:20.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.247868+0000", 2024-04-24T13:31:20.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001223373 2024-04-24T13:31:20.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248563+0000", 2024-04-24T13:31:20.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694781 2024-04-24T13:31:20.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248648+0000", 2024-04-24T13:31:20.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5187999999999998e-05 2024-04-24T13:31:20.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248764+0000", 2024-04-24T13:31:20.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115763 2024-04-24T13:31:20.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.449 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.449 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.449 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:20.450 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:31:20.451 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:20.448+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:20.551 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:20.552+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:20.620 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:20.620 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:20.620 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:20.620 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:20.634 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:31:20.682 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:20.681+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:20.753 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:20.753 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:20.753 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:20.753 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:20.753 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:20.754 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:20.752+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:20.767 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:31:20.854 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:20.853+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:20.936 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:31:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:20.936 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.685939402999999, 2024-04-24T13:31:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057346300000000001, 2024-04-24T13:31:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44 2024-04-24T13:31:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247277+0000", 2024-04-24T13:31:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3459999999999998e-06 2024-04-24T13:31:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247344+0000", 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6768999999999997e-05 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247379+0000", 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4573999999999998e-05 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247402+0000", 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3303e-05 2024-04-24T13:31:20.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247599+0000", 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019720499999999999 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247622+0000", 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2512999999999999e-05 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.252825+0000", 2024-04-24T13:31:20.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052035270000000003 2024-04-24T13:31:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.253009+0000", 2024-04-24T13:31:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018339300000000001 2024-04-24T13:31:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:20.941 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.657296889999998, 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:20.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:31:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:31:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:31:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:31:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:31:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:31:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:31:20.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.606257249000002, 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031751589999999999, 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.948 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 216 2024-04-24T13:31:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326959+0000", 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6170000000000001e-06 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326972+0000", 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327005+0000", 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2845000000000001e-05 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327023+0000", 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8179999999999999e-05 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327132+0000", 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010878300000000001 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327351+0000", 2024-04-24T13:31:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021952000000000001 2024-04-24T13:31:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327770+0000", 2024-04-24T13:31:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041895600000000001 2024-04-24T13:31:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329354+0000", 2024-04-24T13:31:20.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00158388 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329982+0000", 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062821700000000003 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330066+0000", 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4153999999999994e-05 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330131+0000", 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4920999999999997e-05 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.566286177000002, 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031663630000000002, 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.954 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 227 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:20.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366930+0000", 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3800000000000001e-06 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366941+0000", 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1466e-05 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366973+0000", 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1588999999999999e-05 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366987+0000", 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4663e-05 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367166+0000", 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017905699999999999 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367388+0000", 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022201299999999999 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367820+0000", 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000431357 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369320+0000", 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015007359999999999 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369944+0000", 2024-04-24T13:31:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062337299999999998 2024-04-24T13:31:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370026+0000", 2024-04-24T13:31:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2437999999999999e-05 2024-04-24T13:31:20.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370094+0000", 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7291000000000003e-05 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.558974732000003, 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030833050000000002, 2024-04-24T13:31:20.960 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 229 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374241+0000", 2024-04-24T13:31:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5660000000000001e-06 2024-04-24T13:31:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374253+0000", 2024-04-24T13:31:20.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2094e-05 2024-04-24T13:31:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374284+0000", 2024-04-24T13:31:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0824999999999997e-05 2024-04-24T13:31:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374299+0000", 2024-04-24T13:31:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.483e-05 2024-04-24T13:31:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374410+0000", 2024-04-24T13:31:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110956 2024-04-24T13:31:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374631+0000", 2024-04-24T13:31:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221117 2024-04-24T13:31:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.375006+0000", 2024-04-24T13:31:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000375041 2024-04-24T13:31:20.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.376480+0000", 2024-04-24T13:31:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00147434 2024-04-24T13:31:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377172+0000", 2024-04-24T13:31:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00069190799999999998 2024-04-24T13:31:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377255+0000", 2024-04-24T13:31:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2536999999999999e-05 2024-04-24T13:31:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377322+0000", 2024-04-24T13:31:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7090999999999999e-05 2024-04-24T13:31:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.966 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.552342723000002, 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040131660000000003, 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 231 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:20.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380873+0000", 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2400000000000002e-06 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380884+0000", 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0645999999999999e-05 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380919+0000", 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5026e-05 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380934+0000", 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.522e-05 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381077+0000", 2024-04-24T13:31:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014362500000000001 2024-04-24T13:31:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381453+0000", 2024-04-24T13:31:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037581799999999999 2024-04-24T13:31:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.382170+0000", 2024-04-24T13:31:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071714999999999995 2024-04-24T13:31:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.383955+0000", 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017847710000000001 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384619+0000", 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066381600000000002 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384770+0000", 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015067800000000001 2024-04-24T13:31:20.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384884+0000", 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114176 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:324 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.514310858999998, 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029016649999999999, 2024-04-24T13:31:20.972 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 324 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418904+0000", 2024-04-24T13:31:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-06 2024-04-24T13:31:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418911+0000", 2024-04-24T13:31:20.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.759e-06 2024-04-24T13:31:20.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418928+0000", 2024-04-24T13:31:20.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7105e-05 2024-04-24T13:31:20.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418935+0000", 2024-04-24T13:31:20.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7309999999999993e-06 2024-04-24T13:31:20.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419024+0000", 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8524999999999997e-05 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419121+0000", 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6978000000000006e-05 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419329+0000", 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020806399999999999 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419835+0000", 2024-04-24T13:31:20.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050625300000000002 2024-04-24T13:31:20.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421631+0000", 2024-04-24T13:31:20.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001795615 2024-04-24T13:31:20.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421694+0000", 2024-04-24T13:31:20.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3398999999999994e-05 2024-04-24T13:31:20.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421804+0000", 2024-04-24T13:31:20.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109894 2024-04-24T13:31:20.978 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.978 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.978 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.978 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:562 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.380379490000003, 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048608870000000004, 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 562 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552837+0000", 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8499999999999998e-06 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552852+0000", 2024-04-24T13:31:20.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4866e-05 2024-04-24T13:31:20.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552890+0000", 2024-04-24T13:31:20.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8166e-05 2024-04-24T13:31:20.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552905+0000", 2024-04-24T13:31:20.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5255e-05 2024-04-24T13:31:20.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553053+0000", 2024-04-24T13:31:20.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014824599999999999 2024-04-24T13:31:20.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553425+0000", 2024-04-24T13:31:20.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000371512 2024-04-24T13:31:20.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:20.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553969+0000", 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054421500000000002 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.554987+0000", 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001017855 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557606+0000", 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026195839999999999 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557655+0000", 2024-04-24T13:31:20.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8575000000000002e-05 2024-04-24T13:31:20.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557695+0000", 2024-04-24T13:31:20.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9762999999999999e-05 2024-04-24T13:31:20.984 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.984 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.984 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.984 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:607 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.340510246999997, 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003243737, 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 607 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:20.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:20.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592705+0000", 2024-04-24T13:31:20.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:20.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592714+0000", 2024-04-24T13:31:20.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7630000000000006e-06 2024-04-24T13:31:20.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592733+0000", 2024-04-24T13:31:20.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9656e-05 2024-04-24T13:31:20.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592745+0000", 2024-04-24T13:31:20.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:20.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592881+0000", 2024-04-24T13:31:20.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013627999999999999 2024-04-24T13:31:20.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593221+0000", 2024-04-24T13:31:20.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033945600000000002 2024-04-24T13:31:20.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:20.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593765+0000", 2024-04-24T13:31:20.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054456600000000002 2024-04-24T13:31:20.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.594969+0000", 2024-04-24T13:31:20.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012034649999999999 2024-04-24T13:31:20.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595779+0000", 2024-04-24T13:31:20.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000810161 2024-04-24T13:31:20.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595893+0000", 2024-04-24T13:31:20.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114481 2024-04-24T13:31:20.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595947+0000", 2024-04-24T13:31:20.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3352e-05 2024-04-24T13:31:20.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.990 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.991 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.991 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.991 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:20.991 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.189402381000001, 2024-04-24T13:31:20.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027976260000000001, 2024-04-24T13:31:20.991 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.991 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.991 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 736 2024-04-24T13:31:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743813+0000", 2024-04-24T13:31:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0899999999999999e-06 2024-04-24T13:31:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743824+0000", 2024-04-24T13:31:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.111e-05 2024-04-24T13:31:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:20.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743853+0000", 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909000000000001e-05 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743867+0000", 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4036000000000001e-05 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743980+0000", 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011266 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744205+0000", 2024-04-24T13:31:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000225016 2024-04-24T13:31:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744515+0000", 2024-04-24T13:31:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030974000000000003 2024-04-24T13:31:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.745485+0000", 2024-04-24T13:31:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097096300000000003 2024-04-24T13:31:20.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746512+0000", 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001026873 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746563+0000", 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1017000000000003e-05 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746609+0000", 2024-04-24T13:31:20.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5212e-05 2024-04-24T13:31:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 48.100175002, 2024-04-24T13:31:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028606399999999998, 2024-04-24T13:31:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:20.997 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 778 2024-04-24T13:31:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:20.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833041+0000", 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3539999999999998e-06 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833052+0000", 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:20.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833084+0000", 2024-04-24T13:31:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:31:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833111+0000", 2024-04-24T13:31:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6869e-05 2024-04-24T13:31:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833245+0000", 2024-04-24T13:31:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000133576 2024-04-24T13:31:21.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833460+0000", 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021584600000000001 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833761+0000", 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000300477 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.834890+0000", 2024-04-24T13:31:21.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011292050000000001 2024-04-24T13:31:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835731+0000", 2024-04-24T13:31:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000841423 2024-04-24T13:31:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835829+0000", 2024-04-24T13:31:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7337000000000007e-05 2024-04-24T13:31:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835899+0000", 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0151e-05 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.989694655999998, 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002884246, 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:21.003 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 826 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943521+0000", 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4530000000000001e-06 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943532+0000", 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943563+0000", 2024-04-24T13:31:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0982000000000003e-05 2024-04-24T13:31:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943582+0000", 2024-04-24T13:31:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8406e-05 2024-04-24T13:31:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943781+0000", 2024-04-24T13:31:21.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000199624 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944019+0000", 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000237972 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944345+0000", 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032530699999999999 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:21.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.945581+0000", 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012363809999999999 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946252+0000", 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067128499999999998 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946339+0000", 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6193999999999995e-05 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946403+0000", 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4364999999999998e-05 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.962271195, 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034937589999999999, 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:21.009 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 838 2024-04-24T13:31:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970944+0000", 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3360000000000002e-06 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970959+0000", 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.469e-05 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970989+0000", 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0159e-05 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971004+0000", 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971147+0000", 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014242500000000001 2024-04-24T13:31:21.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971514+0000", 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036720900000000001 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.972113+0000", 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00059902100000000004 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.973403+0000", 2024-04-24T13:31:21.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012904189999999999 2024-04-24T13:31:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974152+0000", 2024-04-24T13:31:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074879600000000003 2024-04-24T13:31:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974316+0000", 2024-04-24T13:31:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164308 2024-04-24T13:31:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974436+0000", 2024-04-24T13:31:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119453 2024-04-24T13:31:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.957963274999997, 2024-04-24T13:31:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030693220000000002, 2024-04-24T13:31:21.015 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 840 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975252+0000", 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975261+0000", 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5089999999999999e-06 2024-04-24T13:31:21.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975284+0000", 2024-04-24T13:31:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2719999999999999e-05 2024-04-24T13:31:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975297+0000", 2024-04-24T13:31:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2666e-05 2024-04-24T13:31:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:21.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975425+0000", 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012792899999999999 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975661+0000", 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023588299999999999 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.976159+0000", 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000498264 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:21.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.977419+0000", 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012604859999999999 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978048+0000", 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062885000000000003 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978211+0000", 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016268899999999999 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978319+0000", 2024-04-24T13:31:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108596 2024-04-24T13:31:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.899724972999998, 2024-04-24T13:31:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033625529999999999, 2024-04-24T13:31:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:21.021 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 865 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033491+0000", 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033502+0000", 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1693e-05 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033532+0000", 2024-04-24T13:31:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0165999999999999e-05 2024-04-24T13:31:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033549+0000", 2024-04-24T13:31:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6113e-05 2024-04-24T13:31:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033691+0000", 2024-04-24T13:31:21.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142445 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034025+0000", 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000334407 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034537+0000", 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051115299999999998 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:21.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.035646+0000", 2024-04-24T13:31:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011090169999999999 2024-04-24T13:31:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036588+0000", 2024-04-24T13:31:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094208599999999997 2024-04-24T13:31:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036741+0000", 2024-04-24T13:31:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153055 2024-04-24T13:31:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036851+0000", 2024-04-24T13:31:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110245 2024-04-24T13:31:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.895224865000003, 2024-04-24T13:31:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029772050000000001, 2024-04-24T13:31:21.027 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 867 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037991+0000", 2024-04-24T13:31:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1040000000000001e-06 2024-04-24T13:31:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:21.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038001+0000", 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0910000000000001e-05 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038032+0000", 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0648999999999997e-05 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038050+0000", 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8151999999999998e-05 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038165+0000", 2024-04-24T13:31:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115058 2024-04-24T13:31:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038379+0000", 2024-04-24T13:31:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021330000000000001 2024-04-24T13:31:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038813+0000", 2024-04-24T13:31:21.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00043452299999999997 2024-04-24T13:31:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.039972+0000", 2024-04-24T13:31:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001158793 2024-04-24T13:31:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040723+0000", 2024-04-24T13:31:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075142000000000004 2024-04-24T13:31:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040864+0000", 2024-04-24T13:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140624 2024-04-24T13:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040966+0000", 2024-04-24T13:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101672 2024-04-24T13:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.033 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:888 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.846155127999999, 2024-04-24T13:31:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031285739999999999, 2024-04-24T13:31:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 888 2024-04-24T13:31:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:21.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087060+0000", 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.516e-06 2024-04-24T13:31:21.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087067+0000", 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2400000000000001e-06 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087086+0000", 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9446e-05 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087096+0000", 2024-04-24T13:31:21.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087221+0000", 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012472300000000001 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087467+0000", 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024638200000000001 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:21.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087959+0000", 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049190900000000001 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.089236+0000", 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001277037 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090046+0000", 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00080988200000000005 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090124+0000", 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7670999999999995e-05 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090187+0000", 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2798000000000004e-05 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.039 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.829433754999997, 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028897739999999999, 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 895 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:21.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103782+0000", 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2029999999999999e-06 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:21.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103794+0000", 2024-04-24T13:31:21.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1746000000000001e-05 2024-04-24T13:31:21.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:21.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103824+0000", 2024-04-24T13:31:21.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0942999999999998e-05 2024-04-24T13:31:21.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103846+0000", 2024-04-24T13:31:21.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1086000000000001e-05 2024-04-24T13:31:21.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:21.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104008+0000", 2024-04-24T13:31:21.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016265499999999999 2024-04-24T13:31:21.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:21.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104236+0000", 2024-04-24T13:31:21.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022747300000000001 2024-04-24T13:31:21.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:21.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104551+0000", 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031555400000000001 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.105734+0000", 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011832290000000001 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106519+0000", 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078438599999999998 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:21.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106603+0000", 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4455000000000004e-05 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106669+0000", 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6044000000000007e-05 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:21.045 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.825705945999999, 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027864140000000001, 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 897 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:21.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107509+0000", 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2500000000000001e-06 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:21.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107516+0000", 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0929999999999997e-06 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107535+0000", 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9176000000000001e-05 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107546+0000", 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0596e-05 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:21.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107647+0000", 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010131700000000001 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107791+0000", 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014395900000000001 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.108057+0000", 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026571500000000003 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:21.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.109123+0000", 2024-04-24T13:31:21.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010666969999999999 2024-04-24T13:31:21.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110108+0000", 2024-04-24T13:31:21.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00098528700000000006 2024-04-24T13:31:21.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:21.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110199+0000", 2024-04-24T13:31:21.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0080000000000005e-05 2024-04-24T13:31:21.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110294+0000", 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5243999999999998e-05 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.819303576999999, 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028668890000000001, 2024-04-24T13:31:21.051 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 900 2024-04-24T13:31:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113911+0000", 2024-04-24T13:31:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5540000000000001e-06 2024-04-24T13:31:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:21.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113919+0000", 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4730000000000003e-06 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113937+0000", 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8462e-05 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113947+0000", 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5869999999999999e-06 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114061+0000", 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011431599999999999 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114188+0000", 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012727300000000001 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114460+0000", 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027200500000000002 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.115591+0000", 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011307719999999999 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116635+0000", 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044278 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116713+0000", 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7484000000000006e-05 2024-04-24T13:31:21.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:21.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:21.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:21.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116777+0000", 2024-04-24T13:31:21.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3684999999999998e-05 2024-04-24T13:31:21.057 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.057 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:21.057 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.057 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:21.057 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:21.057 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:21.059 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:31:21.059 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:21.057+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:21.159 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:21.156+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:21.191 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:21.191 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:21.191 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:21.205 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:31:21.295 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:21.292+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:21.361 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:21.360+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:21.374 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:21.374 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:21.374 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:21.374 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:21.375 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:21.389 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:31:21.462 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:21.461+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:21.557 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:21.558 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:21.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:21.558 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:21.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.558 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:31:21.558 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:21.558 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.328702174, 2024-04-24T13:31:21.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020457065, 2024-04-24T13:31:21.558 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.558 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.559 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-24T13:31:21.559 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.559 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.559 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.559 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-24T13:31:21.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.559 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:21.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225903+0000", 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7100000000000001e-06 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225922+0000", 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8919999999999998e-05 2024-04-24T13:31:21.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225960+0000", 2024-04-24T13:31:21.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7240000000000003e-05 2024-04-24T13:31:21.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225987+0000", 2024-04-24T13:31:21.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6919000000000001e-05 2024-04-24T13:31:21.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226300+0000", 2024-04-24T13:31:21.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000313701 2024-04-24T13:31:21.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:21.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226317+0000", 2024-04-24T13:31:21.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6463000000000001e-05 2024-04-24T13:31:21.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231091+0000", 2024-04-24T13:31:21.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047739169999999999 2024-04-24T13:31:21.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:31:21.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231111+0000", 2024-04-24T13:31:21.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0605999999999999e-05 2024-04-24T13:31:21.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246073+0000", 2024-04-24T13:31:21.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014961264 2024-04-24T13:31:21.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246357+0000", 2024-04-24T13:31:21.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028432499999999999 2024-04-24T13:31:21.570 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.570 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.570 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.570 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-24T13:31:21.570 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:21.570 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.287562526999999, 2024-04-24T13:31:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056987720000000004, 2024-04-24T13:31:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267040+0000", 2024-04-24T13:31:21.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3e-07 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267050+0000", 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8560000000000002e-06 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267205+0000", 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520200000000001 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267244+0000", 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8587000000000002e-05 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267346+0000", 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010223200000000001 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267374+0000", 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8214000000000001e-05 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272631+0000", 2024-04-24T13:31:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052563089999999998 2024-04-24T13:31:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272738+0000", 2024-04-24T13:31:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107642 2024-04-24T13:31:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.575 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:47 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'2, mlcod=0'0)", 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.273651770999997, 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052089900000000001, 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280951+0000", 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7199999999999997e-07 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280962+0000", 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1094000000000001e-05 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280981+0000", 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9066e-05 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280999+0000", 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8148e-05 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281144+0000", 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014454999999999999 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281190+0000", 2024-04-24T13:31:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5649000000000003e-05 2024-04-24T13:31:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286063+0000", 2024-04-24T13:31:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048732549999999999 2024-04-24T13:31:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286159+0000", 2024-04-24T13:31:21.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6355999999999997e-05 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.252263890000002, 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010258288000000001, 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.580 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302342+0000", 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6059999999999999e-06 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302357+0000", 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5201999999999999e-05 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302393+0000", 2024-04-24T13:31:21.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6386e-05 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302411+0000", 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7864999999999999e-05 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302544+0000", 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132526 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:21.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302554+0000", 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0479000000000001e-05 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309290+0000", 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006735937 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309474+0000", 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000183981 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309873+0000", 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000398618 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.311131+0000", 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012578929999999999 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312443+0000", 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001312648 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312535+0000", 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1620999999999996e-05 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312596+0000", 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1525999999999993e-05 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:21.586 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.167969003000003, 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035352830000000002, 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 232 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:21.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386636+0000", 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8329999999999998e-06 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386649+0000", 2024-04-24T13:31:21.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3586e-05 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386681+0000", 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1529000000000003e-05 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386697+0000", 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6412000000000001e-05 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386869+0000", 2024-04-24T13:31:21.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000171998 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.387124+0000", 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025514 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.387553+0000", 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000428758 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.389079+0000", 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015254089999999999 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390010+0000", 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00093115799999999996 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390099+0000", 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8826999999999995e-05 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390168+0000", 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9633000000000002e-05 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:283 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.140610963, 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040489189999999998, 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.592 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 283 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:21.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413993+0000", 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0770000000000002e-06 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414006+0000", 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2696e-05 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414031+0000", 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5639999999999998e-05 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414046+0000", 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4412e-05 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414206+0000", 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015972299999999999 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414646+0000", 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000440023 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.415227+0000", 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00058130599999999997 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.416668+0000", 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00144118 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417911+0000", 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012426690000000001 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417980+0000", 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8942999999999994e-05 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.418040+0000", 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0250000000000001e-05 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.597 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:299 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.137402782000002, 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033212430000000002, 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:21.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417201+0000", 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.784e-06 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417216+0000", 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5464999999999998e-05 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417238+0000", 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1474000000000001e-05 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417254+0000", 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5954999999999999e-05 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417425+0000", 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017128799999999999 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417457+0000", 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1844000000000002e-05 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.420406+0000", 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002948895 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.420520+0000", 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011453799999999999 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:319 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.135412217999999, 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040866640000000003, 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.602 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 319 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419192+0000", 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8759999999999999e-06 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419217+0000", 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5077000000000001e-05 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419247+0000", 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0054000000000001e-05 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419262+0000", 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4885000000000001e-05 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419410+0000", 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148701 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419603+0000", 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019235899999999999 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419892+0000", 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028910699999999998 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.421211+0000", 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013190599999999999 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423024+0000", 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001812971 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423184+0000", 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000160323 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423276+0000", 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2250999999999995e-05 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.607 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:505 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.047852783000003, 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031283859999999999, 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 505 2024-04-24T13:31:21.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506752+0000", 2024-04-24T13:31:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7630000000000001e-06 2024-04-24T13:31:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506764+0000", 2024-04-24T13:31:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2318e-05 2024-04-24T13:31:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506794+0000", 2024-04-24T13:31:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9674000000000001e-05 2024-04-24T13:31:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506811+0000", 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7507e-05 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506914+0000", 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010252 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.507140+0000", 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022651999999999999 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.507604+0000", 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046387099999999998 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.508700+0000", 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010960200000000001 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509671+0000", 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000970754 2024-04-24T13:31:21.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509777+0000", 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105664 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509878+0000", 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100775 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.613 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:545 6.2 6:479ba34f:::obj_delete_at_hint.0000000021:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.015990541000001, 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003146893, 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 545 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538614+0000", 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5790000000000002e-06 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538627+0000", 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2536e-05 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538657+0000", 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0363000000000001e-05 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538673+0000", 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5735000000000001e-05 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538782+0000", 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010905599999999999 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539002+0000", 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022079900000000001 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539510+0000", 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00050796700000000001 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.540770+0000", 2024-04-24T13:31:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012598850000000001 2024-04-24T13:31:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541525+0000", 2024-04-24T13:31:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075419500000000004 2024-04-24T13:31:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541678+0000", 2024-04-24T13:31:21.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153258 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541758+0000", 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0519999999999995e-05 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:631 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.941909318, 2024-04-24T13:31:21.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003398257, 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 631 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612695+0000", 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7300000000000001e-06 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612708+0000", 2024-04-24T13:31:21.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2808e-05 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612741+0000", 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2676999999999999e-05 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612757+0000", 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6611000000000001e-05 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612924+0000", 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016621 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.613299+0000", 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037503299999999999 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.613869+0000", 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057067299999999995 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615041+0000", 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001171248 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615795+0000", 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000754785 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615967+0000", 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017142200000000001 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.616091+0000", 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012406 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:647 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.928901041000003, 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028765370000000002, 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.625 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 647 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625703+0000", 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9850000000000001e-06 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625713+0000", 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8279999999999998e-06 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625740+0000", 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7174000000000001e-05 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625760+0000", 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9966000000000002e-05 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625912+0000", 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151815 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.626278+0000", 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036677200000000002 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.626837+0000", 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055886 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628073+0000", 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001235877 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628338+0000", 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026515499999999999 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628479+0000", 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014045799999999999 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628577+0000", 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8647000000000006e-05 2024-04-24T13:31:21.630 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.867669108000001, 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034770059999999999, 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.631 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 709 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686935+0000", 2024-04-24T13:31:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4760000000000001e-06 2024-04-24T13:31:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686948+0000", 2024-04-24T13:31:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2846e-05 2024-04-24T13:31:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686979+0000", 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0987e-05 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686995+0000", 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5580999999999999e-05 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687121+0000", 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012667399999999999 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687328+0000", 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000206741 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687614+0000", 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028608300000000002 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688763+0000", 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001148533 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690207+0000", 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00144458 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690293+0000", 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5858000000000004e-05 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690410+0000", 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116647 2024-04-24T13:31:21.636 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.828414445, 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029468519999999998, 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 727 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726190+0000", 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.26e-06 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726201+0000", 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1615e-05 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726233+0000", 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1547000000000001e-05 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726252+0000", 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8681e-05 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726381+0000", 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012944000000000001 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726611+0000", 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023025500000000001 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726950+0000", 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033885399999999998 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.728086+0000", 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011360039999999999 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.728982+0000", 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00089614899999999995 2024-04-24T13:31:21.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.729067+0000", 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4968000000000004e-05 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.729134+0000", 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7078999999999999e-05 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:729 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.824333539000001, 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030005850000000001, 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 729 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730270+0000", 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8059999999999999e-06 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730278+0000", 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2789999999999998e-06 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730298+0000", 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9488e-05 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730309+0000", 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1294999999999999e-05 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730436+0000", 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012690999999999999 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730677+0000", 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000241275 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.731167+0000", 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048962799999999998 2024-04-24T13:31:21.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.732344+0000", 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011773619999999999 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733135+0000", 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000790213 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733209+0000", 2024-04-24T13:31:21.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4488999999999998e-05 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733269+0000", 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9840000000000003e-05 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.638556241000003, 2024-04-24T13:31:21.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034749830000000001, 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 814 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916048+0000", 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2330000000000001e-06 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916059+0000", 2024-04-24T13:31:21.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1266e-05 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916090+0000", 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0993e-05 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916109+0000", 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8751999999999999e-05 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916265+0000", 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015573 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916632+0000", 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367597 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.917180+0000", 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054785599999999999 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.918555+0000", 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001374781 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919250+0000", 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069470700000000003 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919404+0000", 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015483000000000001 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919521+0000", 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011623799999999999 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.483724412000001, 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029290919999999999, 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.654 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 880 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:21.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070880+0000", 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8660000000000002e-06 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070911+0000", 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0783e-05 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070942+0000", 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0979999999999998e-05 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070958+0000", 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5858999999999998e-05 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071120+0000", 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016239999999999999 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071370+0000", 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000249301 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071695+0000", 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032495000000000001 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.072963+0000", 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001268443 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073655+0000", 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069215800000000001 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073741+0000", 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5731999999999998e-05 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073807+0000", 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5619999999999999e-05 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.659 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.476383292999998, 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002986266, 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 883 2024-04-24T13:31:21.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078221+0000", 2024-04-24T13:31:21.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.889e-06 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078230+0000", 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5990000000000008e-06 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078261+0000", 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1080000000000001e-05 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078280+0000", 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8678999999999999e-05 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078405+0000", 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012481699999999999 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078649+0000", 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244045 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078997+0000", 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347821 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.080294+0000", 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012972470000000001 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081048+0000", 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075421500000000003 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081136+0000", 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8184999999999997e-05 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081205+0000", 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8689000000000006e-05 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.665 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.380345669, 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003313323, 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 925 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174258+0000", 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2170000000000001e-06 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174270+0000", 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1185e-05 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174301+0000", 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1167000000000002e-05 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174316+0000", 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5398000000000001e-05 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174471+0000", 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015502800000000001 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174834+0000", 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036226299999999998 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.175395+0000", 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00056120499999999995 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.176785+0000", 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001390584 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177301+0000", 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00051609300000000002 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177459+0000", 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015735400000000001 2024-04-24T13:31:21.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177570+0000", 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011082900000000001 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.373074139000003, 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030825470000000002, 2024-04-24T13:31:21.671 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 928 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181530+0000", 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.75e-06 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181539+0000", 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0350000000000007e-06 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181565+0000", 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6523999999999999e-05 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181579+0000", 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3732e-05 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181703+0000", 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012400099999999999 2024-04-24T13:31:21.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.182049+0000", 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000346461 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.182596+0000", 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054673999999999999 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.183810+0000", 2024-04-24T13:31:21.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001213769 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184460+0000", 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00065003000000000001 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184543+0000", 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3545000000000001e-05 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184610+0000", 2024-04-24T13:31:21.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6959999999999996e-05 2024-04-24T13:31:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:21.677 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:21.677 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:21.678 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:21.679 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:21.677+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:21.785 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:21.780+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:21.808 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:21.808 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:21.808 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:21.808 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:21.822 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:21.883 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:21.877+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:21.983 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:21.976+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:21.993 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:21.993 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:21.993 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:21.993 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:21.993 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:22.011 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:22.081 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:22.077+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:22.104 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:31:22.183 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:22.180+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:22.186 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:22.186 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:22.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:22.186 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:22.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.187 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:22.187 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:22.187 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.913131163000003, 2024-04-24T13:31:22.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003286134, 2024-04-24T13:31:22.187 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.187 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.187 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.187 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.187 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4440", 2024-04-24T13:31:22.187 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:22.187 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:31:22.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.187 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270374+0000", 2024-04-24T13:31:22.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9130000000000001e-06 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270384+0000", 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0023e-05 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270410+0000", 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5483e-05 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270426+0000", 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6413e-05 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270524+0000", 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8314999999999996e-05 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270704+0000", 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017929 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270950+0000", 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024601000000000001 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.272837+0000", 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018874600000000001 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273498+0000", 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066062100000000002 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273589+0000", 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.098e-05 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273658+0000", 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9626e-05 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:22.192 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.904341295000002, 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048388950000000002, 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3799999999999998e-06 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279193+0000", 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7674e-05 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279224+0000", 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0654000000000002e-05 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279244+0000", 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279426+0000", 2024-04-24T13:31:22.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018255300000000001 2024-04-24T13:31:22.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279717+0000", 2024-04-24T13:31:22.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029043800000000001 2024-04-24T13:31:22.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:22.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279993+0000", 2024-04-24T13:31:22.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276786 2024-04-24T13:31:22.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282898+0000", 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002904093 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283731+0000", 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00083382599999999997 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283886+0000", 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015512600000000001 2024-04-24T13:31:22.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284001+0000", 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114405 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410010339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.899216699999997, 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044116340000000002, 2024-04-24T13:31:22.198 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284289+0000", 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.125e-06 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284299+0000", 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0485999999999999e-05 2024-04-24T13:31:22.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284330+0000", 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0528000000000003e-05 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284345+0000", 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4883e-05 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284484+0000", 2024-04-24T13:31:22.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139708 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284655+0000", 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170953 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284981+0000", 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000325648 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.287326+0000", 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023452709999999999 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288427+0000", 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001100544 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288551+0000", 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012466500000000001 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288698+0000", 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146823 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.920003815000001, 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047820809999999997, 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263503+0000", 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.039e-06 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263520+0000", 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7198e-05 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263548+0000", 2024-04-24T13:31:22.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8158e-05 2024-04-24T13:31:22.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263565+0000", 2024-04-24T13:31:22.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7008e-05 2024-04-24T13:31:22.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263754+0000", 2024-04-24T13:31:22.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001894 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263973+0000", 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218593 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.264373+0000", 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040043400000000002 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.266377+0000", 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020033030000000001 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268121+0000", 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017441049999999999 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268212+0000", 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1490000000000007e-05 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268282+0000", 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9352999999999998e-05 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.840291663000002, 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034252639999999999, 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 220 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343214+0000", 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343227+0000", 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2941e-05 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343259+0000", 2024-04-24T13:31:22.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1557000000000003e-05 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343274+0000", 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5401999999999999e-05 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343455+0000", 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018068700000000001 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343694+0000", 2024-04-24T13:31:22.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238552 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.344088+0000", 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039456400000000003 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.345723+0000", 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016349139999999999 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346480+0000", 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075738300000000004 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346569+0000", 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8281000000000004e-05 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346637+0000", 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8165999999999998e-05 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.829598287000003, 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032680679999999998, 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 223 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.216 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353907+0000", 2024-04-24T13:31:22.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1560000000000002e-06 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353918+0000", 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0669000000000001e-05 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353948+0000", 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0329999999999999e-05 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353963+0000", 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4989e-05 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354076+0000", 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112704 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354300+0000", 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022397000000000001 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354729+0000", 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042914100000000002 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356223+0000", 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001494219 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356972+0000", 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00074910099999999996 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357059+0000", 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6624000000000003e-05 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357173+0000", 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114165 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.221 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.822551365999999, 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032957419999999999, 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360954+0000", 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.154e-06 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360965+0000", 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1321999999999999e-05 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360996+0000", 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0902999999999999e-05 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361012+0000", 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361185+0000", 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172072 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361404+0000", 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021965999999999999 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361852+0000", 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000448276 2024-04-24T13:31:22.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.363340+0000", 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001487169 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364094+0000", 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075443699999999995 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364184+0000", 2024-04-24T13:31:22.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9957000000000006e-05 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364248+0000", 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3627000000000006e-05 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.818986518999999, 2024-04-24T13:31:22.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036426480000000001, 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364519+0000", 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364529+0000", 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088999999999999e-05 2024-04-24T13:31:22.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364554+0000", 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5537e-05 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364568+0000", 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3372e-05 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364726+0000", 2024-04-24T13:31:22.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015809299999999999 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365059+0000", 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000333185 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365758+0000", 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069934299999999995 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.367413+0000", 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016552349999999999 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368012+0000", 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059858700000000003 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368097+0000", 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5253999999999994e-05 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368159+0000", 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2113000000000007e-05 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.789599883000001, 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033998840000000002, 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.233 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:22.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393906+0000", 2024-04-24T13:31:22.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1569999999999998e-06 2024-04-24T13:31:22.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393917+0000", 2024-04-24T13:31:22.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1348999999999999e-05 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393942+0000", 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.527e-05 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393957+0000", 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4355999999999999e-05 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394127+0000", 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170555 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394352+0000", 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224539 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394788+0000", 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043600099999999999 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.396137+0000", 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001349404 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397158+0000", 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001020738 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397237+0000", 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9319000000000004e-05 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397303+0000", 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6196000000000001e-05 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:237 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.778733248000002, 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003210517, 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.239 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.240 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.240 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.240 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 237 2024-04-24T13:31:22.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.240 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:22.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:22.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404772+0000", 2024-04-24T13:31:22.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1830000000000001e-06 2024-04-24T13:31:22.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404783+0000", 2024-04-24T13:31:22.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1009000000000001e-05 2024-04-24T13:31:22.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404814+0000", 2024-04-24T13:31:22.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0822999999999999e-05 2024-04-24T13:31:22.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404829+0000", 2024-04-24T13:31:22.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4808e-05 2024-04-24T13:31:22.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404965+0000", 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013637299999999999 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405107+0000", 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142108 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405399+0000", 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029117900000000003 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.406507+0000", 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011081000000000001 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407732+0000", 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001225163 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407866+0000", 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013405599999999999 2024-04-24T13:31:22.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407981+0000", 2024-04-24T13:31:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114715 2024-04-24T13:31:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:430 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.725016351000001, 2024-04-24T13:31:22.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031779590000000002, 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458489+0000", 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458525+0000", 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5743e-05 2024-04-24T13:31:22.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458556+0000", 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0284e-05 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458576+0000", 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0449999999999999e-05 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458738+0000", 2024-04-24T13:31:22.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016177699999999999 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459047+0000", 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030948400000000001 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459499+0000", 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045165199999999998 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461152+0000", 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001653477 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461528+0000", 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037554899999999998 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461610+0000", 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1914000000000002e-05 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461665+0000", 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5105999999999997e-05 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.720758764000003, 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031563120000000001, 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 436 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:22.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462746+0000", 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8199999999999999e-06 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462756+0000", 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0005e-05 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462778+0000", 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1325e-05 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462794+0000", 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841e-05 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462940+0000", 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014605099999999999 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463206+0000", 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026634500000000003 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463594+0000", 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038760299999999998 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465323+0000", 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00172898 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465593+0000", 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027055500000000001 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465747+0000", 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015391999999999999 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465901+0000", 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153867 2024-04-24T13:31:22.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:437 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.719976289000002, 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048056540000000003, 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 437 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463529+0000", 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2479999999999999e-06 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463544+0000", 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463572+0000", 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8294e-05 2024-04-24T13:31:22.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463590+0000", 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464092+0000", 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000502189 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464454+0000", 2024-04-24T13:31:22.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036231300000000001 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464831+0000", 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000377375 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467473+0000", 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026414659999999999 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468185+0000", 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071215199999999997 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468271+0000", 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5593999999999994e-05 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468333+0000", 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1957000000000003e-05 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.263 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:531 6.4 e32/26 6:227f63b5:gc::gc.14:head v 32'13, mlcod=32'11)", 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.658745195000002, 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003260279, 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524760+0000", 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4720000000000001e-06 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524771+0000", 2024-04-24T13:31:22.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1270000000000001e-05 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524792+0000", 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1566e-05 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524805+0000", 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2876e-05 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524906+0000", 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101084 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524943+0000", 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6538000000000002e-05 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.527964+0000", 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030210229999999999 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.528018+0000", 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4450000000000002e-05 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.420921661000001, 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032103409999999998, 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.268 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:22.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762584+0000", 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7039999999999999e-06 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762597+0000", 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2539e-05 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762629+0000", 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2116000000000002e-05 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762644+0000", 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5034999999999999e-05 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762801+0000", 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015653999999999999 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763192+0000", 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000391529 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763747+0000", 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055497399999999996 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.764931+0000", 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001184128 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765643+0000", 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071180500000000003 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765726+0000", 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3058000000000003e-05 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765792+0000", 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5913000000000004e-05 2024-04-24T13:31:22.273 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.274 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.274 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.274 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.274 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:22.274 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.314326540000003, 2024-04-24T13:31:22.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033442569999999998, 2024-04-24T13:31:22.274 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.274 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.274 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.274 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.274 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 793 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869179+0000", 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.323e-06 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869190+0000", 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869222+0000", 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1733999999999998e-05 2024-04-24T13:31:22.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869237+0000", 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5044e-05 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869396+0000", 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158913 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869763+0000", 2024-04-24T13:31:22.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367112 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.870319+0000", 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055558799999999998 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.871509+0000", 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001190607 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872365+0000", 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085535299999999999 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872449+0000", 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3834999999999999e-05 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872521+0000", 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2428999999999994e-05 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.128320168000002, 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003340754, 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 874 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.280 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055185+0000", 2024-04-24T13:31:22.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:31:22.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055197+0000", 2024-04-24T13:31:22.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1606e-05 2024-04-24T13:31:22.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055229+0000", 2024-04-24T13:31:22.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1603000000000002e-05 2024-04-24T13:31:22.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055244+0000", 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4928e-05 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055397+0000", 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015366499999999999 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055763+0000", 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036565600000000001 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.056317+0000", 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055436600000000004 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.057678+0000", 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001361283 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058258+0000", 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057942400000000004 2024-04-24T13:31:22.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058407+0000", 2024-04-24T13:31:22.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000149188 2024-04-24T13:31:22.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058524+0000", 2024-04-24T13:31:22.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116805 2024-04-24T13:31:22.286 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.286 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.286 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.286 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.286 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:22.286 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.123601438999998, 2024-04-24T13:31:22.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032622950000000001, 2024-04-24T13:31:22.286 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.286 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.286 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.286 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 876 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:22.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059904+0000", 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.767e-06 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059912+0000", 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819999999999994e-06 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059934+0000", 2024-04-24T13:31:22.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2141e-05 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059949+0000", 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4285e-05 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060072+0000", 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012349400000000001 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060302+0000", 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022971999999999999 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060787+0000", 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048565400000000002 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062208+0000", 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014201870000000001 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062946+0000", 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073827699999999997 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063036+0000", 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9758000000000004e-05 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063164+0000", 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012852999999999999 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.291 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:924 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 49.012669791999997, 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030953729999999998, 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 924 2024-04-24T13:31:22.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170836+0000", 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1900000000000002e-06 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170847+0000", 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1109e-05 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170879+0000", 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2153000000000002e-05 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170898+0000", 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8785000000000001e-05 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171030+0000", 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013210300000000001 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171294+0000", 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026387600000000002 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171790+0000", 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049596899999999997 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.172966+0000", 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011761 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173663+0000", 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069701500000000005 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173818+0000", 2024-04-24T13:31:22.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155427 2024-04-24T13:31:22.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173929+0000", 2024-04-24T13:31:22.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110646 2024-04-24T13:31:22.297 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.297 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.297 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.946658536000001, 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032803860000000002, 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 952 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:22.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236847+0000", 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:31:22.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236858+0000", 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0582e-05 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236900+0000", 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2463000000000003e-05 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236923+0000", 2024-04-24T13:31:22.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2938e-05 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237071+0000", 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014795100000000001 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237365+0000", 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000293963 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237755+0000", 2024-04-24T13:31:22.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039032599999999998 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239124+0000", 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136918 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239925+0000", 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080016699999999996 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:22.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240011+0000", 2024-04-24T13:31:22.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6780999999999995e-05 2024-04-24T13:31:22.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:22.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:22.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:22.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240125+0000", 2024-04-24T13:31:22.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113862 2024-04-24T13:31:22.303 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.303 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.303 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.303 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:22.303 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:22.303 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:22.304 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:22.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:22.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:22.305 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:22.306 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:22.306 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:22.307 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:22.305+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:22.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:22.315 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:22.321 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:31:22.333 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:22.334 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:22.352 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:22.352 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:22.370 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:22.370 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:22.388 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:22.389 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:22.407 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:22.405+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:22.440 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:22.440 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:22.455 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:22.508 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:22.504+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:22.575 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:22.575 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:22.591 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:22.608 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:22.605+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:22.709 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:22.708+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:22.753 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:22.753 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:22.767 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:22.812 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:22.809+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:22.912 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:22.909+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:22.933 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:22.933 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:22.948 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:23.012 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:23.009+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:23.072 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:23.073 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:23.086 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:23.114 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:23.113+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:23.211 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:23.211 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:23.214 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:23.212+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:23.226 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:23.315 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:23.313+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:23.321 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:31:23.362 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:23.362 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:23.376 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:23.419 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:23.417+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:23.517 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:23.513+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:23.542 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:23.542 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:23.557 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:23.618 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:23.616+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:23.717 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:23.717 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:23.719 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:23.716+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:23.730 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:23.820 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:23.817+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:23.843 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:23.843 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:23.856 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:23.946 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:23.945+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:24.023 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:24.017+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:24.023 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:24.024 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:24.036 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:24.122 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:24.121+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:24.201 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:24.202 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:24.215 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:24.258 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:24.257+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:24.324 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:24.320+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:24.380 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:24.394 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:24.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:31:24.424 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:24.424+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:24.517 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:24.525 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:24.524+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:24.531 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:24.582 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:24.582 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:24.599 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:24.599 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:24.615 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:24.616 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:24.626 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:24.624+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:24.634 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:24.635 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:24.654 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:24.654 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:24.656 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:24.656 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:24.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:24.657 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:24.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.657 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:24.657 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:24.657 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.372233571000002, 2024-04-24T13:31:24.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026500819999999998, 2024-04-24T13:31:24.658 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.658 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.658 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.658 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.658 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:24.658 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:24.658 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 42 2024-04-24T13:31:24.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.659 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:24.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:31:24.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283130+0000", 2024-04-24T13:31:24.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3599999999999999e-06 2024-04-24T13:31:24.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283143+0000", 2024-04-24T13:31:24.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2989999999999999e-05 2024-04-24T13:31:24.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283175+0000", 2024-04-24T13:31:24.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1262e-05 2024-04-24T13:31:24.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283190+0000", 2024-04-24T13:31:24.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5333999999999999e-05 2024-04-24T13:31:24.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283279+0000", 2024-04-24T13:31:24.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8616000000000007e-05 2024-04-24T13:31:24.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283443+0000", 2024-04-24T13:31:24.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016473200000000001 2024-04-24T13:31:24.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:24.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283600+0000", 2024-04-24T13:31:24.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015686500000000001 2024-04-24T13:31:24.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.284799+0000", 2024-04-24T13:31:24.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011988229999999999 2024-04-24T13:31:24.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285616+0000", 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081652500000000002 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285709+0000", 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3109999999999995e-05 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285778+0000", 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9465e-05 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.664 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.367359303000001, 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025615049999999999, 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.665 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 52 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288005+0000", 2024-04-24T13:31:24.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:31:24.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288017+0000", 2024-04-24T13:31:24.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1995e-05 2024-04-24T13:31:24.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288050+0000", 2024-04-24T13:31:24.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2555999999999998e-05 2024-04-24T13:31:24.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288063+0000", 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3774999999999999e-05 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288165+0000", 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101394 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288357+0000", 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019187800000000001 2024-04-24T13:31:24.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288525+0000", 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016830600000000001 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.289691+0000", 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011659629999999999 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290333+0000", 2024-04-24T13:31:24.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064243099999999995 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290439+0000", 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105689 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290564+0000", 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012480600000000001 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.255916689000003, 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.671 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:31:24.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.676 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.243839309999998, 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029424360000000001, 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 279 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411523+0000", 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0899999999999999e-06 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411539+0000", 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411556+0000", 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6588000000000001e-05 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411564+0000", 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6929999999999996e-06 2024-04-24T13:31:24.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411638+0000", 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3244999999999994e-05 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411745+0000", 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107876 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411936+0000", 2024-04-24T13:31:24.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000190819 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.412644+0000", 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070752499999999997 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414368+0000", 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017246850000000001 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414419+0000", 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0513999999999998e-05 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414465+0000", 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5862000000000002e-05 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.240132930999998, 2024-04-24T13:31:24.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:31:24.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:31:24.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:31:24.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:31:24.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:31:24.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:24.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:31:24.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:31:24.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:691 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.996981093999999, 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027367860000000002, 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.688 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.689 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.689 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.689 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.689 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 691 2024-04-24T13:31:24.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.689 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:24.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658383+0000", 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7719999999999999e-06 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658393+0000", 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1840000000000005e-06 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658414+0000", 2024-04-24T13:31:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0967000000000001e-05 2024-04-24T13:31:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658424+0000", 2024-04-24T13:31:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0961000000000001e-05 2024-04-24T13:31:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658556+0000", 2024-04-24T13:31:24.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013183199999999999 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658781+0000", 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022427499999999999 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.659230+0000", 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044896299999999998 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660178+0000", 2024-04-24T13:31:24.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094838799999999999 2024-04-24T13:31:24.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660868+0000", 2024-04-24T13:31:24.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000689575 2024-04-24T13:31:24.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661012+0000", 2024-04-24T13:31:24.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000144735 2024-04-24T13:31:24.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661117+0000", 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105134 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.796860139000003, 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.694 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:31:24.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:31:24.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:31:24.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:31:24.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:31:24.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.698 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.733516621, 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.699 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:24.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:31:24.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:31:24.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.728840925999997, 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:31:24.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:31:24.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:31:24.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.676917076999999, 2024-04-24T13:31:24.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028643660000000001, 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 841 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978447+0000", 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978459+0000", 2024-04-24T13:31:24.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.224e-05 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978489+0000", 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9583000000000001e-05 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978504+0000", 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978612+0000", 2024-04-24T13:31:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107327 2024-04-24T13:31:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978831+0000", 2024-04-24T13:31:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021982300000000001 2024-04-24T13:31:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.979160+0000", 2024-04-24T13:31:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032855299999999998 2024-04-24T13:31:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.980242+0000", 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010821649999999999 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981019+0000", 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00077641199999999998 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981185+0000", 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016605499999999999 2024-04-24T13:31:24.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981309+0000", 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012434300000000001 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.672796194999997, 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:31:24.716 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.717 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.717 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.717 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.717 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.717 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.717 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:31:24.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.717 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:24.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:31:24.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:31:24.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:31:24.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.722 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.722 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.722 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:24.722 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.663050159999997, 2024-04-24T13:31:24.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:31:24.722 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:31:24.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:31:24.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.658503347999996, 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002954763, 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.728 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 849 2024-04-24T13:31:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:31:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996861+0000", 2024-04-24T13:31:24.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2069999999999998e-06 2024-04-24T13:31:24.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996871+0000", 2024-04-24T13:31:24.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0753e-05 2024-04-24T13:31:24.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996903+0000", 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996922+0000", 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8595999999999999e-05 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997042+0000", 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119646 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997271+0000", 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228963 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997736+0000", 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000465181 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999022+0000", 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012864829999999999 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999529+0000", 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050722400000000002 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999697+0000", 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016795499999999999 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999813+0000", 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115746 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.733 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.614218094999998, 2024-04-24T13:31:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027316710000000002, 2024-04-24T13:31:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.734 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 868 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041146+0000", 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041156+0000", 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0772e-05 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041184+0000", 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7616000000000001e-05 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041199+0000", 2024-04-24T13:31:24.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4582e-05 2024-04-24T13:31:24.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041309+0000", 2024-04-24T13:31:24.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011029799999999999 2024-04-24T13:31:24.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041532+0000", 2024-04-24T13:31:24.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022316 2024-04-24T13:31:24.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041846+0000", 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031406700000000001 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043088+0000", 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001241409 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043667+0000", 2024-04-24T13:31:24.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057961000000000004 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043767+0000", 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100166 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043875+0000", 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107871 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.525040826999998, 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003049946, 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 907 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.740 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:31:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130323+0000", 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5859999999999999e-06 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130336+0000", 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.218e-05 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130367+0000", 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1665000000000003e-05 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130382+0000", 2024-04-24T13:31:24.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5113000000000001e-05 2024-04-24T13:31:24.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130510+0000", 2024-04-24T13:31:24.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012778999999999999 2024-04-24T13:31:24.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130749+0000", 2024-04-24T13:31:24.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238669 2024-04-24T13:31:24.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.131082+0000", 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033360300000000002 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.132266+0000", 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001183627 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133172+0000", 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090542200000000002 2024-04-24T13:31:24.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133259+0000", 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133371+0000", 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011194 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.521221978, 2024-04-24T13:31:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002722543, 2024-04-24T13:31:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 909 2024-04-24T13:31:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.746 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:24.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:31:24.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134141+0000", 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134150+0000", 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9430000000000006e-06 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134172+0000", 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1296000000000001e-05 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134187+0000", 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5659e-05 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134275+0000", 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7787000000000005e-05 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134403+0000", 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127677 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134686+0000", 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028353500000000002 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.135742+0000", 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010557800000000001 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136663+0000", 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092043500000000005 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136753+0000", 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0871000000000005e-05 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136862+0000", 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010883 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.751 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.427527095999999, 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029521759999999999, 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 949 2024-04-24T13:31:24.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227837+0000", 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2189999999999998e-06 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227848+0000", 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-05 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227876+0000", 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8972999999999999e-05 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227892+0000", 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5965999999999999e-05 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228028+0000", 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135322 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228256+0000", 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228237 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228706+0000", 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045042599999999997 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.229990+0000", 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012836799999999999 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230579+0000", 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058925199999999996 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230673+0000", 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3484000000000001e-05 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230787+0000", 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113917 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.757 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.423420006000001, 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:31:24.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:31:24.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:24.763 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.413220222, 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030452859999999999, 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 955 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:24.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242144+0000", 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2500000000000001e-06 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242155+0000", 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1779e-05 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242186+0000", 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0879e-05 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242202+0000", 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5566e-05 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242338+0000", 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013631299999999999 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242700+0000", 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036144900000000002 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.243261+0000", 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056143600000000001 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.244736+0000", 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001475248 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245034+0000", 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029792099999999998 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245119+0000", 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4876999999999994e-05 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245187+0000", 2024-04-24T13:31:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7568000000000001e-05 2024-04-24T13:31:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.409294787, 2024-04-24T13:31:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026970509999999998, 2024-04-24T13:31:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:24.769 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 957 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246069+0000", 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4600000000000002e-06 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246081+0000", 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1780000000000001e-05 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246105+0000", 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3805999999999999e-05 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246120+0000", 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5415999999999999e-05 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246221+0000", 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010027 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246367+0000", 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014653299999999999 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246645+0000", 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000277681 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.247868+0000", 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001223373 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248563+0000", 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694781 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248648+0000", 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5187999999999998e-05 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248764+0000", 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115763 2024-04-24T13:31:24.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:24.775 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:24.775 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:24.777 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:31:24.777 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:24.777 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:24.777 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:24.778 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:24.778 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:24.779 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:24.779 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:24.773+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:24.878 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:24.876+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:24.945 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:24.945 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:24.945 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:24.962 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:31:24.978 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:24.976+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:25.079 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:25.077+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:25.089 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:25.089 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:25.103 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:31:25.194 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:25.193+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:25.279 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:25.280 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:25.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:25.280 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:25.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.280 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:31:25.280 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:25.280 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 58.029174306000002, 2024-04-24T13:31:25.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057346300000000001, 2024-04-24T13:31:25.280 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.280 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.280 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:25.280 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.280 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.281 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.281 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44 2024-04-24T13:31:25.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.281 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:25.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:25.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247277+0000", 2024-04-24T13:31:25.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3459999999999998e-06 2024-04-24T13:31:25.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247344+0000", 2024-04-24T13:31:25.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6768999999999997e-05 2024-04-24T13:31:25.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247379+0000", 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4573999999999998e-05 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247402+0000", 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3303e-05 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247599+0000", 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019720499999999999 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247622+0000", 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2512999999999999e-05 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.252825+0000", 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052035270000000003 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.253009+0000", 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018339300000000001 2024-04-24T13:31:25.284 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 53.000531793, 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.285 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:31:25.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:31:25.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:31:25.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:31:25.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:31:25.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:31:25.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:31:25.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:31:25.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:31:25.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:31:25.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:31:25.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:31:25.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.949492151999998, 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031751589999999999, 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 216 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.293 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326959+0000", 2024-04-24T13:31:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6170000000000001e-06 2024-04-24T13:31:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326972+0000", 2024-04-24T13:31:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:31:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327005+0000", 2024-04-24T13:31:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2845000000000001e-05 2024-04-24T13:31:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327023+0000", 2024-04-24T13:31:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8179999999999999e-05 2024-04-24T13:31:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327132+0000", 2024-04-24T13:31:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010878300000000001 2024-04-24T13:31:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327351+0000", 2024-04-24T13:31:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021952000000000001 2024-04-24T13:31:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327770+0000", 2024-04-24T13:31:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041895600000000001 2024-04-24T13:31:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329354+0000", 2024-04-24T13:31:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00158388 2024-04-24T13:31:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329982+0000", 2024-04-24T13:31:25.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062821700000000003 2024-04-24T13:31:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330066+0000", 2024-04-24T13:31:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4153999999999994e-05 2024-04-24T13:31:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330131+0000", 2024-04-24T13:31:25.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4920999999999997e-05 2024-04-24T13:31:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.909521079999998, 2024-04-24T13:31:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031663630000000002, 2024-04-24T13:31:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 227 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:25.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366930+0000", 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3800000000000001e-06 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366941+0000", 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1466e-05 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366973+0000", 2024-04-24T13:31:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1588999999999999e-05 2024-04-24T13:31:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366987+0000", 2024-04-24T13:31:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4663e-05 2024-04-24T13:31:25.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367166+0000", 2024-04-24T13:31:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017905699999999999 2024-04-24T13:31:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367388+0000", 2024-04-24T13:31:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022201299999999999 2024-04-24T13:31:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:25.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367820+0000", 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000431357 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369320+0000", 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015007359999999999 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369944+0000", 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062337299999999998 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370026+0000", 2024-04-24T13:31:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2437999999999999e-05 2024-04-24T13:31:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370094+0000", 2024-04-24T13:31:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7291000000000003e-05 2024-04-24T13:31:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.306 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.902209634999998, 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030833050000000002, 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 229 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374241+0000", 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5660000000000001e-06 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374253+0000", 2024-04-24T13:31:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2094e-05 2024-04-24T13:31:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374284+0000", 2024-04-24T13:31:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0824999999999997e-05 2024-04-24T13:31:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374299+0000", 2024-04-24T13:31:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.483e-05 2024-04-24T13:31:25.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374410+0000", 2024-04-24T13:31:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110956 2024-04-24T13:31:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374631+0000", 2024-04-24T13:31:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221117 2024-04-24T13:31:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.375006+0000", 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000375041 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.376480+0000", 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00147434 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377172+0000", 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00069190799999999998 2024-04-24T13:31:25.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377255+0000", 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2536999999999999e-05 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377322+0000", 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7090999999999999e-05 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.895577625999998, 2024-04-24T13:31:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040131660000000003, 2024-04-24T13:31:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 231 2024-04-24T13:31:25.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380873+0000", 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2400000000000002e-06 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380884+0000", 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0645999999999999e-05 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380919+0000", 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5026e-05 2024-04-24T13:31:25.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380934+0000", 2024-04-24T13:31:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.522e-05 2024-04-24T13:31:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381077+0000", 2024-04-24T13:31:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014362500000000001 2024-04-24T13:31:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381453+0000", 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037581799999999999 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.382170+0000", 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071714999999999995 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.383955+0000", 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017847710000000001 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384619+0000", 2024-04-24T13:31:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066381600000000002 2024-04-24T13:31:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384770+0000", 2024-04-24T13:31:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015067800000000001 2024-04-24T13:31:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384884+0000", 2024-04-24T13:31:25.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114176 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:324 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.857545762000001, 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029016649999999999, 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.319 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 324 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418904+0000", 2024-04-24T13:31:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-06 2024-04-24T13:31:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418911+0000", 2024-04-24T13:31:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.759e-06 2024-04-24T13:31:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418928+0000", 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7105e-05 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418935+0000", 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7309999999999993e-06 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419024+0000", 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8524999999999997e-05 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419121+0000", 2024-04-24T13:31:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6978000000000006e-05 2024-04-24T13:31:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419329+0000", 2024-04-24T13:31:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020806399999999999 2024-04-24T13:31:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419835+0000", 2024-04-24T13:31:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050625300000000002 2024-04-24T13:31:25.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421631+0000", 2024-04-24T13:31:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001795615 2024-04-24T13:31:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421694+0000", 2024-04-24T13:31:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3398999999999994e-05 2024-04-24T13:31:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421804+0000", 2024-04-24T13:31:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109894 2024-04-24T13:31:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:562 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.723614392999998, 2024-04-24T13:31:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048608870000000004, 2024-04-24T13:31:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.325 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 562 2024-04-24T13:31:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552837+0000", 2024-04-24T13:31:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8499999999999998e-06 2024-04-24T13:31:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552852+0000", 2024-04-24T13:31:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4866e-05 2024-04-24T13:31:25.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552890+0000", 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8166e-05 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552905+0000", 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5255e-05 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553053+0000", 2024-04-24T13:31:25.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014824599999999999 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553425+0000", 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000371512 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553969+0000", 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054421500000000002 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.554987+0000", 2024-04-24T13:31:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001017855 2024-04-24T13:31:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557606+0000", 2024-04-24T13:31:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026195839999999999 2024-04-24T13:31:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557655+0000", 2024-04-24T13:31:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8575000000000002e-05 2024-04-24T13:31:25.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557695+0000", 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9762999999999999e-05 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:607 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.68374515, 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003243737, 2024-04-24T13:31:25.331 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 607 2024-04-24T13:31:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592705+0000", 2024-04-24T13:31:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592714+0000", 2024-04-24T13:31:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7630000000000006e-06 2024-04-24T13:31:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592733+0000", 2024-04-24T13:31:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9656e-05 2024-04-24T13:31:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592745+0000", 2024-04-24T13:31:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592881+0000", 2024-04-24T13:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013627999999999999 2024-04-24T13:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593221+0000", 2024-04-24T13:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033945600000000002 2024-04-24T13:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593765+0000", 2024-04-24T13:31:25.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054456600000000002 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.594969+0000", 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012034649999999999 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595779+0000", 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000810161 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595893+0000", 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114481 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595947+0000", 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3352e-05 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:25.337 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.532637284000003, 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027976260000000001, 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 736 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:25.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743813+0000", 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0899999999999999e-06 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743824+0000", 2024-04-24T13:31:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.111e-05 2024-04-24T13:31:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743853+0000", 2024-04-24T13:31:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909000000000001e-05 2024-04-24T13:31:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743867+0000", 2024-04-24T13:31:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4036000000000001e-05 2024-04-24T13:31:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743980+0000", 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011266 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744205+0000", 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000225016 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744515+0000", 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030974000000000003 2024-04-24T13:31:25.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.745485+0000", 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097096300000000003 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746512+0000", 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001026873 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746563+0000", 2024-04-24T13:31:25.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1017000000000003e-05 2024-04-24T13:31:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746609+0000", 2024-04-24T13:31:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5212e-05 2024-04-24T13:31:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.343 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.443409905000003, 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028606399999999998, 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 778 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833041+0000", 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3539999999999998e-06 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833052+0000", 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833084+0000", 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833111+0000", 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6869e-05 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833245+0000", 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000133576 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833460+0000", 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021584600000000001 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833761+0000", 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000300477 2024-04-24T13:31:25.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.834890+0000", 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011292050000000001 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835731+0000", 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000841423 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835829+0000", 2024-04-24T13:31:25.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7337000000000007e-05 2024-04-24T13:31:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835899+0000", 2024-04-24T13:31:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0151e-05 2024-04-24T13:31:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.349 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.332929559, 2024-04-24T13:31:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002884246, 2024-04-24T13:31:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 826 2024-04-24T13:31:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.350 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943521+0000", 2024-04-24T13:31:25.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4530000000000001e-06 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943532+0000", 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943563+0000", 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0982000000000003e-05 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943582+0000", 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8406e-05 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943781+0000", 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000199624 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944019+0000", 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000237972 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944345+0000", 2024-04-24T13:31:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032530699999999999 2024-04-24T13:31:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.945581+0000", 2024-04-24T13:31:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012363809999999999 2024-04-24T13:31:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946252+0000", 2024-04-24T13:31:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067128499999999998 2024-04-24T13:31:25.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946339+0000", 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6193999999999995e-05 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946403+0000", 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4364999999999998e-05 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.355 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.305506098000002, 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034937589999999999, 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 838 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970944+0000", 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3360000000000002e-06 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970959+0000", 2024-04-24T13:31:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.469e-05 2024-04-24T13:31:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970989+0000", 2024-04-24T13:31:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0159e-05 2024-04-24T13:31:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971004+0000", 2024-04-24T13:31:25.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971147+0000", 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014242500000000001 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971514+0000", 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036720900000000001 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.972113+0000", 2024-04-24T13:31:25.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00059902100000000004 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.973403+0000", 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012904189999999999 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974152+0000", 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074879600000000003 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974316+0000", 2024-04-24T13:31:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164308 2024-04-24T13:31:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974436+0000", 2024-04-24T13:31:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119453 2024-04-24T13:31:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.361 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.301198178, 2024-04-24T13:31:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030693220000000002, 2024-04-24T13:31:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 840 2024-04-24T13:31:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975252+0000", 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:31:25.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975261+0000", 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5089999999999999e-06 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975284+0000", 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2719999999999999e-05 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975297+0000", 2024-04-24T13:31:25.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2666e-05 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975425+0000", 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012792899999999999 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975661+0000", 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023588299999999999 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:25.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.976159+0000", 2024-04-24T13:31:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000498264 2024-04-24T13:31:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.977419+0000", 2024-04-24T13:31:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012604859999999999 2024-04-24T13:31:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978048+0000", 2024-04-24T13:31:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062885000000000003 2024-04-24T13:31:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978211+0000", 2024-04-24T13:31:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016268899999999999 2024-04-24T13:31:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978319+0000", 2024-04-24T13:31:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108596 2024-04-24T13:31:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.242959876, 2024-04-24T13:31:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033625529999999999, 2024-04-24T13:31:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 865 2024-04-24T13:31:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.368 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033491+0000", 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033502+0000", 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1693e-05 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033532+0000", 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0165999999999999e-05 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033549+0000", 2024-04-24T13:31:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6113e-05 2024-04-24T13:31:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033691+0000", 2024-04-24T13:31:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142445 2024-04-24T13:31:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034025+0000", 2024-04-24T13:31:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000334407 2024-04-24T13:31:25.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034537+0000", 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051115299999999998 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.035646+0000", 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011090169999999999 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036588+0000", 2024-04-24T13:31:25.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094208599999999997 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036741+0000", 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153055 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036851+0000", 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110245 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.238459767999998, 2024-04-24T13:31:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029772050000000001, 2024-04-24T13:31:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 867 2024-04-24T13:31:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.374 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037991+0000", 2024-04-24T13:31:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1040000000000001e-06 2024-04-24T13:31:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038001+0000", 2024-04-24T13:31:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0910000000000001e-05 2024-04-24T13:31:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038032+0000", 2024-04-24T13:31:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0648999999999997e-05 2024-04-24T13:31:25.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038050+0000", 2024-04-24T13:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8151999999999998e-05 2024-04-24T13:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038165+0000", 2024-04-24T13:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115058 2024-04-24T13:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038379+0000", 2024-04-24T13:31:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021330000000000001 2024-04-24T13:31:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038813+0000", 2024-04-24T13:31:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00043452299999999997 2024-04-24T13:31:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.039972+0000", 2024-04-24T13:31:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001158793 2024-04-24T13:31:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040723+0000", 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075142000000000004 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040864+0000", 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140624 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040966+0000", 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101672 2024-04-24T13:31:25.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:888 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.189390031000002, 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031285739999999999, 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 888 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087060+0000", 2024-04-24T13:31:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.516e-06 2024-04-24T13:31:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087067+0000", 2024-04-24T13:31:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2400000000000001e-06 2024-04-24T13:31:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087086+0000", 2024-04-24T13:31:25.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9446e-05 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087096+0000", 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087221+0000", 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012472300000000001 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087467+0000", 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024638200000000001 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087959+0000", 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049190900000000001 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.089236+0000", 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001277037 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090046+0000", 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00080988200000000005 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090124+0000", 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7670999999999995e-05 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090187+0000", 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2798000000000004e-05 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.385 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.172668657999999, 2024-04-24T13:31:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028897739999999999, 2024-04-24T13:31:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.386 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 895 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103782+0000", 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2029999999999999e-06 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103794+0000", 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1746000000000001e-05 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103824+0000", 2024-04-24T13:31:25.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0942999999999998e-05 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103846+0000", 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1086000000000001e-05 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104008+0000", 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016265499999999999 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104236+0000", 2024-04-24T13:31:25.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022747300000000001 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104551+0000", 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031555400000000001 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.105734+0000", 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011832290000000001 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106519+0000", 2024-04-24T13:31:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078438599999999998 2024-04-24T13:31:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106603+0000", 2024-04-24T13:31:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4455000000000004e-05 2024-04-24T13:31:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106669+0000", 2024-04-24T13:31:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6044000000000007e-05 2024-04-24T13:31:25.391 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.168940849000002, 2024-04-24T13:31:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027864140000000001, 2024-04-24T13:31:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.392 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 897 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107509+0000", 2024-04-24T13:31:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2500000000000001e-06 2024-04-24T13:31:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107516+0000", 2024-04-24T13:31:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0929999999999997e-06 2024-04-24T13:31:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107535+0000", 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9176000000000001e-05 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107546+0000", 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0596e-05 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107647+0000", 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010131700000000001 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107791+0000", 2024-04-24T13:31:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014395900000000001 2024-04-24T13:31:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.108057+0000", 2024-04-24T13:31:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026571500000000003 2024-04-24T13:31:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.109123+0000", 2024-04-24T13:31:25.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010666969999999999 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110108+0000", 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00098528700000000006 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110199+0000", 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0080000000000005e-05 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110294+0000", 2024-04-24T13:31:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5243999999999998e-05 2024-04-24T13:31:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.162538480000002, 2024-04-24T13:31:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028668890000000001, 2024-04-24T13:31:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:25.398 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 900 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:25.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113911+0000", 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5540000000000001e-06 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113919+0000", 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4730000000000003e-06 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:25.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113937+0000", 2024-04-24T13:31:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8462e-05 2024-04-24T13:31:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113947+0000", 2024-04-24T13:31:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5869999999999999e-06 2024-04-24T13:31:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114061+0000", 2024-04-24T13:31:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011431599999999999 2024-04-24T13:31:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114188+0000", 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012727300000000001 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114460+0000", 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027200500000000002 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.115591+0000", 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011307719999999999 2024-04-24T13:31:25.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116635+0000", 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044278 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116713+0000", 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7484000000000006e-05 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116777+0000", 2024-04-24T13:31:25.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3684999999999998e-05 2024-04-24T13:31:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:25.404 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:25.404 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:25.404 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:31:25.406 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:25.404+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:25.406 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:31:25.507 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:25.504+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:25.536 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:25.536 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:25.537 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:25.537 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:25.551 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:31:25.638 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:25.636+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:25.709 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:25.704+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:25.713 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:25.713 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:25.713 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:25.728 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:31:25.814 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:25.812+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:25.896 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:25.896 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:25.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:25.896 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:25.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.896 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:31:25.896 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:25.896 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.666834323000003, 2024-04-24T13:31:25.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020457065, 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:25.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225903+0000", 2024-04-24T13:31:25.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7100000000000001e-06 2024-04-24T13:31:25.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225922+0000", 2024-04-24T13:31:25.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8919999999999998e-05 2024-04-24T13:31:25.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225960+0000", 2024-04-24T13:31:25.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7240000000000003e-05 2024-04-24T13:31:25.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225987+0000", 2024-04-24T13:31:25.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6919000000000001e-05 2024-04-24T13:31:25.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226300+0000", 2024-04-24T13:31:25.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000313701 2024-04-24T13:31:25.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:25.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226317+0000", 2024-04-24T13:31:25.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6463000000000001e-05 2024-04-24T13:31:25.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231091+0000", 2024-04-24T13:31:25.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047739169999999999 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231111+0000", 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0605999999999999e-05 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246073+0000", 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014961264 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246357+0000", 2024-04-24T13:31:25.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028432499999999999 2024-04-24T13:31:25.902 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.902 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.902 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.902 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-24T13:31:25.902 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:25.902 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.625694676000002, 2024-04-24T13:31:25.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056987720000000004, 2024-04-24T13:31:25.902 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.902 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267040+0000", 2024-04-24T13:31:25.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3e-07 2024-04-24T13:31:25.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267050+0000", 2024-04-24T13:31:25.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8560000000000002e-06 2024-04-24T13:31:25.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267205+0000", 2024-04-24T13:31:25.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520200000000001 2024-04-24T13:31:25.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267244+0000", 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8587000000000002e-05 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267346+0000", 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010223200000000001 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267374+0000", 2024-04-24T13:31:25.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8214000000000001e-05 2024-04-24T13:31:25.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272631+0000", 2024-04-24T13:31:25.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052563089999999998 2024-04-24T13:31:25.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272738+0000", 2024-04-24T13:31:25.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107642 2024-04-24T13:31:25.906 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.906 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.906 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:47 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'2, mlcod=0'0)", 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.611783920000001, 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052089900000000001, 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:25.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280951+0000", 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7199999999999997e-07 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280962+0000", 2024-04-24T13:31:25.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1094000000000001e-05 2024-04-24T13:31:25.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280981+0000", 2024-04-24T13:31:25.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9066e-05 2024-04-24T13:31:25.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280999+0000", 2024-04-24T13:31:25.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8148e-05 2024-04-24T13:31:25.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281144+0000", 2024-04-24T13:31:25.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014454999999999999 2024-04-24T13:31:25.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281190+0000", 2024-04-24T13:31:25.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5649000000000003e-05 2024-04-24T13:31:25.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286063+0000", 2024-04-24T13:31:25.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048732549999999999 2024-04-24T13:31:25.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286159+0000", 2024-04-24T13:31:25.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6355999999999997e-05 2024-04-24T13:31:25.911 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.911 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.911 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.911 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.911 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:25.911 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.590396038999998, 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010258288000000001, 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:25.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302342+0000", 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6059999999999999e-06 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302357+0000", 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5201999999999999e-05 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302393+0000", 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6386e-05 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302411+0000", 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7864999999999999e-05 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302544+0000", 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132526 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302554+0000", 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0479000000000001e-05 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309290+0000", 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006735937 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309474+0000", 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000183981 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309873+0000", 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000398618 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.311131+0000", 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012578929999999999 2024-04-24T13:31:25.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312443+0000", 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001312648 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312535+0000", 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1620999999999996e-05 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312596+0000", 2024-04-24T13:31:25.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1525999999999993e-05 2024-04-24T13:31:25.918 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.918 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.918 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.918 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.918 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:25.918 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.506101151999999, 2024-04-24T13:31:25.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035352830000000002, 2024-04-24T13:31:25.918 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.918 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.918 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.918 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 232 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386636+0000", 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8329999999999998e-06 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386649+0000", 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3586e-05 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386681+0000", 2024-04-24T13:31:25.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1529000000000003e-05 2024-04-24T13:31:25.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386697+0000", 2024-04-24T13:31:25.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6412000000000001e-05 2024-04-24T13:31:25.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386869+0000", 2024-04-24T13:31:25.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000171998 2024-04-24T13:31:25.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.387124+0000", 2024-04-24T13:31:25.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025514 2024-04-24T13:31:25.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:25.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.387553+0000", 2024-04-24T13:31:25.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000428758 2024-04-24T13:31:25.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.389079+0000", 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015254089999999999 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390010+0000", 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00093115799999999996 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390099+0000", 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8826999999999995e-05 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390168+0000", 2024-04-24T13:31:25.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9633000000000002e-05 2024-04-24T13:31:25.924 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.924 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.924 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.924 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:283 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.924 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:25.924 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.478743111999997, 2024-04-24T13:31:25.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040489189999999998, 2024-04-24T13:31:25.924 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 283 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:25.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413993+0000", 2024-04-24T13:31:25.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0770000000000002e-06 2024-04-24T13:31:25.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414006+0000", 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2696e-05 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414031+0000", 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5639999999999998e-05 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414046+0000", 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4412e-05 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414206+0000", 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015972299999999999 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414646+0000", 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000440023 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.415227+0000", 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00058130599999999997 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.416668+0000", 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00144118 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417911+0000", 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012426690000000001 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417980+0000", 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8942999999999994e-05 2024-04-24T13:31:25.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.418040+0000", 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0250000000000001e-05 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:299 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.475534930999999, 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033212430000000002, 2024-04-24T13:31:25.930 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417201+0000", 2024-04-24T13:31:25.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.784e-06 2024-04-24T13:31:25.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417216+0000", 2024-04-24T13:31:25.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5464999999999998e-05 2024-04-24T13:31:25.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417238+0000", 2024-04-24T13:31:25.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1474000000000001e-05 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417254+0000", 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5954999999999999e-05 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417425+0000", 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017128799999999999 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417457+0000", 2024-04-24T13:31:25.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1844000000000002e-05 2024-04-24T13:31:25.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.420406+0000", 2024-04-24T13:31:25.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002948895 2024-04-24T13:31:25.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.420520+0000", 2024-04-24T13:31:25.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011453799999999999 2024-04-24T13:31:25.934 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.934 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.934 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:319 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.473544367000002, 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040866640000000003, 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 319 2024-04-24T13:31:25.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419192+0000", 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8759999999999999e-06 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419217+0000", 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5077000000000001e-05 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419247+0000", 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0054000000000001e-05 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419262+0000", 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4885000000000001e-05 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419410+0000", 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148701 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419603+0000", 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019235899999999999 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:25.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419892+0000", 2024-04-24T13:31:25.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028910699999999998 2024-04-24T13:31:25.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.421211+0000", 2024-04-24T13:31:25.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013190599999999999 2024-04-24T13:31:25.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:25.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423024+0000", 2024-04-24T13:31:25.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001812971 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423184+0000", 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000160323 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423276+0000", 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2250999999999995e-05 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:505 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.385984932, 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031283859999999999, 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 505 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.941 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:25.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:25.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506752+0000", 2024-04-24T13:31:25.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7630000000000001e-06 2024-04-24T13:31:25.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506764+0000", 2024-04-24T13:31:25.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2318e-05 2024-04-24T13:31:25.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506794+0000", 2024-04-24T13:31:25.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9674000000000001e-05 2024-04-24T13:31:25.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506811+0000", 2024-04-24T13:31:25.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7507e-05 2024-04-24T13:31:25.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506914+0000", 2024-04-24T13:31:25.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010252 2024-04-24T13:31:25.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.507140+0000", 2024-04-24T13:31:25.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022651999999999999 2024-04-24T13:31:25.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:25.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.507604+0000", 2024-04-24T13:31:25.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046387099999999998 2024-04-24T13:31:25.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:25.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.508700+0000", 2024-04-24T13:31:25.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010960200000000001 2024-04-24T13:31:25.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509671+0000", 2024-04-24T13:31:25.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000970754 2024-04-24T13:31:25.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509777+0000", 2024-04-24T13:31:25.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105664 2024-04-24T13:31:25.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509878+0000", 2024-04-24T13:31:25.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100775 2024-04-24T13:31:25.947 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.947 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.947 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.948 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:545 6.2 6:479ba34f:::obj_delete_at_hint.0000000021:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.948 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:25.948 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.354122689999997, 2024-04-24T13:31:25.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003146893, 2024-04-24T13:31:25.948 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.948 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.948 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.949 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 545 2024-04-24T13:31:25.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.949 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:25.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:25.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538614+0000", 2024-04-24T13:31:25.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5790000000000002e-06 2024-04-24T13:31:25.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538627+0000", 2024-04-24T13:31:25.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2536e-05 2024-04-24T13:31:25.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538657+0000", 2024-04-24T13:31:25.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0363000000000001e-05 2024-04-24T13:31:25.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538673+0000", 2024-04-24T13:31:25.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5735000000000001e-05 2024-04-24T13:31:25.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538782+0000", 2024-04-24T13:31:25.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010905599999999999 2024-04-24T13:31:25.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539002+0000", 2024-04-24T13:31:25.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022079900000000001 2024-04-24T13:31:25.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:25.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539510+0000", 2024-04-24T13:31:25.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00050796700000000001 2024-04-24T13:31:25.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:25.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.540770+0000", 2024-04-24T13:31:25.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012598850000000001 2024-04-24T13:31:25.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541525+0000", 2024-04-24T13:31:25.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075419500000000004 2024-04-24T13:31:25.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541678+0000", 2024-04-24T13:31:25.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153258 2024-04-24T13:31:25.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541758+0000", 2024-04-24T13:31:25.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0519999999999995e-05 2024-04-24T13:31:25.955 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.955 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.955 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.955 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:631 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.955 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:25.955 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.280041466999997, 2024-04-24T13:31:25.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003398257, 2024-04-24T13:31:25.956 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.956 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.956 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.956 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.956 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.956 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.956 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 631 2024-04-24T13:31:25.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.956 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:25.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:25.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612695+0000", 2024-04-24T13:31:25.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7300000000000001e-06 2024-04-24T13:31:25.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612708+0000", 2024-04-24T13:31:25.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2808e-05 2024-04-24T13:31:25.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612741+0000", 2024-04-24T13:31:25.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2676999999999999e-05 2024-04-24T13:31:25.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612757+0000", 2024-04-24T13:31:25.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6611000000000001e-05 2024-04-24T13:31:25.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612924+0000", 2024-04-24T13:31:25.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016621 2024-04-24T13:31:25.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.613299+0000", 2024-04-24T13:31:25.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037503299999999999 2024-04-24T13:31:25.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:25.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.613869+0000", 2024-04-24T13:31:25.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057067299999999995 2024-04-24T13:31:25.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:25.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615041+0000", 2024-04-24T13:31:25.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001171248 2024-04-24T13:31:25.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615795+0000", 2024-04-24T13:31:25.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000754785 2024-04-24T13:31:25.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615967+0000", 2024-04-24T13:31:25.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017142200000000001 2024-04-24T13:31:25.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.616091+0000", 2024-04-24T13:31:25.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012406 2024-04-24T13:31:25.962 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.962 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.962 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.962 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:647 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.962 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:25.962 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.267033189999999, 2024-04-24T13:31:25.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028765370000000002, 2024-04-24T13:31:25.963 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.963 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.963 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.963 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.963 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.963 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.963 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 647 2024-04-24T13:31:25.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.963 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:25.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:25.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625703+0000", 2024-04-24T13:31:25.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9850000000000001e-06 2024-04-24T13:31:25.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625713+0000", 2024-04-24T13:31:25.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8279999999999998e-06 2024-04-24T13:31:25.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625740+0000", 2024-04-24T13:31:25.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7174000000000001e-05 2024-04-24T13:31:25.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625760+0000", 2024-04-24T13:31:25.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9966000000000002e-05 2024-04-24T13:31:25.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625912+0000", 2024-04-24T13:31:25.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151815 2024-04-24T13:31:25.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.626278+0000", 2024-04-24T13:31:25.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036677200000000002 2024-04-24T13:31:25.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:25.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.626837+0000", 2024-04-24T13:31:25.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055886 2024-04-24T13:31:25.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:25.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628073+0000", 2024-04-24T13:31:25.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001235877 2024-04-24T13:31:25.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628338+0000", 2024-04-24T13:31:25.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026515499999999999 2024-04-24T13:31:25.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628479+0000", 2024-04-24T13:31:25.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014045799999999999 2024-04-24T13:31:25.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628577+0000", 2024-04-24T13:31:25.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8647000000000006e-05 2024-04-24T13:31:25.969 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.969 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.969 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.969 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.969 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:25.969 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.205801256999997, 2024-04-24T13:31:25.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034770059999999999, 2024-04-24T13:31:25.970 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.970 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.970 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.970 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.970 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.970 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.970 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 709 2024-04-24T13:31:25.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.970 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:25.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:25.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686935+0000", 2024-04-24T13:31:25.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4760000000000001e-06 2024-04-24T13:31:25.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686948+0000", 2024-04-24T13:31:25.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2846e-05 2024-04-24T13:31:25.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686979+0000", 2024-04-24T13:31:25.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0987e-05 2024-04-24T13:31:25.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686995+0000", 2024-04-24T13:31:25.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5580999999999999e-05 2024-04-24T13:31:25.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687121+0000", 2024-04-24T13:31:25.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012667399999999999 2024-04-24T13:31:25.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687328+0000", 2024-04-24T13:31:25.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000206741 2024-04-24T13:31:25.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:25.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687614+0000", 2024-04-24T13:31:25.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028608300000000002 2024-04-24T13:31:25.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:25.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688763+0000", 2024-04-24T13:31:25.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001148533 2024-04-24T13:31:25.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690207+0000", 2024-04-24T13:31:25.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00144458 2024-04-24T13:31:25.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690293+0000", 2024-04-24T13:31:25.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5858000000000004e-05 2024-04-24T13:31:25.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690410+0000", 2024-04-24T13:31:25.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116647 2024-04-24T13:31:25.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.977 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.977 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.977 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:25.977 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.166546594000003, 2024-04-24T13:31:25.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029468519999999998, 2024-04-24T13:31:25.977 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.977 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.978 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.978 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 727 2024-04-24T13:31:25.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.978 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:25.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:25.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726190+0000", 2024-04-24T13:31:25.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.26e-06 2024-04-24T13:31:25.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726201+0000", 2024-04-24T13:31:25.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1615e-05 2024-04-24T13:31:25.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726233+0000", 2024-04-24T13:31:25.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1547000000000001e-05 2024-04-24T13:31:25.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726252+0000", 2024-04-24T13:31:25.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8681e-05 2024-04-24T13:31:25.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726381+0000", 2024-04-24T13:31:25.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012944000000000001 2024-04-24T13:31:25.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726611+0000", 2024-04-24T13:31:25.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023025500000000001 2024-04-24T13:31:25.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:25.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726950+0000", 2024-04-24T13:31:25.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033885399999999998 2024-04-24T13:31:25.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:25.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.728086+0000", 2024-04-24T13:31:25.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011360039999999999 2024-04-24T13:31:25.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.728982+0000", 2024-04-24T13:31:25.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00089614899999999995 2024-04-24T13:31:25.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.729067+0000", 2024-04-24T13:31:25.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4968000000000004e-05 2024-04-24T13:31:25.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.729134+0000", 2024-04-24T13:31:25.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7078999999999999e-05 2024-04-24T13:31:25.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.984 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.984 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:729 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.984 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:25.984 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.162465687999997, 2024-04-24T13:31:25.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030005850000000001, 2024-04-24T13:31:25.984 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.984 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.984 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.985 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 729 2024-04-24T13:31:25.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.985 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:25.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:25.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730270+0000", 2024-04-24T13:31:25.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8059999999999999e-06 2024-04-24T13:31:25.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730278+0000", 2024-04-24T13:31:25.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2789999999999998e-06 2024-04-24T13:31:25.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730298+0000", 2024-04-24T13:31:25.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9488e-05 2024-04-24T13:31:25.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730309+0000", 2024-04-24T13:31:25.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1294999999999999e-05 2024-04-24T13:31:25.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730436+0000", 2024-04-24T13:31:25.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012690999999999999 2024-04-24T13:31:25.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730677+0000", 2024-04-24T13:31:25.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000241275 2024-04-24T13:31:25.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:25.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.731167+0000", 2024-04-24T13:31:25.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048962799999999998 2024-04-24T13:31:25.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:25.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.732344+0000", 2024-04-24T13:31:25.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011773619999999999 2024-04-24T13:31:25.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733135+0000", 2024-04-24T13:31:25.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000790213 2024-04-24T13:31:25.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733209+0000", 2024-04-24T13:31:25.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4488999999999998e-05 2024-04-24T13:31:25.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733269+0000", 2024-04-24T13:31:25.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9840000000000003e-05 2024-04-24T13:31:25.991 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.991 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.991 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.991 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.991 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:25.991 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.97668839, 2024-04-24T13:31:25.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034749830000000001, 2024-04-24T13:31:25.991 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.991 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.991 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.992 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.992 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.992 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.992 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 814 2024-04-24T13:31:25.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.992 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:25.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:25.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:25.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:25.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:25.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:25.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:25.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916048+0000", 2024-04-24T13:31:25.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2330000000000001e-06 2024-04-24T13:31:25.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:25.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916059+0000", 2024-04-24T13:31:25.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1266e-05 2024-04-24T13:31:25.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:25.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916090+0000", 2024-04-24T13:31:25.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0993e-05 2024-04-24T13:31:25.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:25.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916109+0000", 2024-04-24T13:31:25.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8751999999999999e-05 2024-04-24T13:31:25.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:25.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916265+0000", 2024-04-24T13:31:25.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015573 2024-04-24T13:31:25.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:25.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916632+0000", 2024-04-24T13:31:25.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367597 2024-04-24T13:31:25.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:25.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.917180+0000", 2024-04-24T13:31:25.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054785599999999999 2024-04-24T13:31:25.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:25.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.918555+0000", 2024-04-24T13:31:25.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001374781 2024-04-24T13:31:25.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:25.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919250+0000", 2024-04-24T13:31:25.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069470700000000003 2024-04-24T13:31:25.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:25.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919404+0000", 2024-04-24T13:31:25.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015483000000000001 2024-04-24T13:31:25.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:25.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919521+0000", 2024-04-24T13:31:25.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011623799999999999 2024-04-24T13:31:25.998 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.998 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:25.998 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:25.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:25.998 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:25.999 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:25.999 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.821856560999997, 2024-04-24T13:31:25.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029290919999999999, 2024-04-24T13:31:25.999 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:25.999 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:25.999 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:25.999 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:25.999 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:25.999 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:25.999 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 880 2024-04-24T13:31:25.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:25.999 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:26.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:26.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070880+0000", 2024-04-24T13:31:26.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8660000000000002e-06 2024-04-24T13:31:26.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070911+0000", 2024-04-24T13:31:26.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0783e-05 2024-04-24T13:31:26.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070942+0000", 2024-04-24T13:31:26.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0979999999999998e-05 2024-04-24T13:31:26.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070958+0000", 2024-04-24T13:31:26.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5858999999999998e-05 2024-04-24T13:31:26.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071120+0000", 2024-04-24T13:31:26.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016239999999999999 2024-04-24T13:31:26.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071370+0000", 2024-04-24T13:31:26.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000249301 2024-04-24T13:31:26.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:26.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071695+0000", 2024-04-24T13:31:26.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032495000000000001 2024-04-24T13:31:26.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.072963+0000", 2024-04-24T13:31:26.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001268443 2024-04-24T13:31:26.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073655+0000", 2024-04-24T13:31:26.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069215800000000001 2024-04-24T13:31:26.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073741+0000", 2024-04-24T13:31:26.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5731999999999998e-05 2024-04-24T13:31:26.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073807+0000", 2024-04-24T13:31:26.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5619999999999999e-05 2024-04-24T13:31:26.005 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.005 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.005 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.006 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.006 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:26.006 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.814515442000001, 2024-04-24T13:31:26.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002986266, 2024-04-24T13:31:26.006 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.006 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.006 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.006 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.006 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.007 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.007 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 883 2024-04-24T13:31:26.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.007 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:26.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:26.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078221+0000", 2024-04-24T13:31:26.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.889e-06 2024-04-24T13:31:26.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078230+0000", 2024-04-24T13:31:26.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5990000000000008e-06 2024-04-24T13:31:26.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078261+0000", 2024-04-24T13:31:26.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1080000000000001e-05 2024-04-24T13:31:26.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078280+0000", 2024-04-24T13:31:26.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8678999999999999e-05 2024-04-24T13:31:26.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078405+0000", 2024-04-24T13:31:26.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012481699999999999 2024-04-24T13:31:26.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078649+0000", 2024-04-24T13:31:26.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244045 2024-04-24T13:31:26.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:26.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078997+0000", 2024-04-24T13:31:26.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347821 2024-04-24T13:31:26.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.080294+0000", 2024-04-24T13:31:26.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012972470000000001 2024-04-24T13:31:26.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081048+0000", 2024-04-24T13:31:26.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075421500000000003 2024-04-24T13:31:26.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081136+0000", 2024-04-24T13:31:26.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8184999999999997e-05 2024-04-24T13:31:26.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081205+0000", 2024-04-24T13:31:26.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8689000000000006e-05 2024-04-24T13:31:26.012 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.012 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.012 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.013 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.013 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:26.013 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.718477817999997, 2024-04-24T13:31:26.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003313323, 2024-04-24T13:31:26.013 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.013 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.013 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.013 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.013 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.013 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.013 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 925 2024-04-24T13:31:26.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.014 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:26.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:26.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174258+0000", 2024-04-24T13:31:26.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2170000000000001e-06 2024-04-24T13:31:26.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174270+0000", 2024-04-24T13:31:26.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1185e-05 2024-04-24T13:31:26.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174301+0000", 2024-04-24T13:31:26.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1167000000000002e-05 2024-04-24T13:31:26.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174316+0000", 2024-04-24T13:31:26.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5398000000000001e-05 2024-04-24T13:31:26.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174471+0000", 2024-04-24T13:31:26.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015502800000000001 2024-04-24T13:31:26.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174834+0000", 2024-04-24T13:31:26.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036226299999999998 2024-04-24T13:31:26.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:26.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.175395+0000", 2024-04-24T13:31:26.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00056120499999999995 2024-04-24T13:31:26.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.176785+0000", 2024-04-24T13:31:26.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001390584 2024-04-24T13:31:26.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177301+0000", 2024-04-24T13:31:26.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00051609300000000002 2024-04-24T13:31:26.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177459+0000", 2024-04-24T13:31:26.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015735400000000001 2024-04-24T13:31:26.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177570+0000", 2024-04-24T13:31:26.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011082900000000001 2024-04-24T13:31:26.019 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.019 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.019 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.020 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.020 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:26.020 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.711206288, 2024-04-24T13:31:26.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030825470000000002, 2024-04-24T13:31:26.020 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.020 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.020 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.020 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 928 2024-04-24T13:31:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:26.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181530+0000", 2024-04-24T13:31:26.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.75e-06 2024-04-24T13:31:26.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181539+0000", 2024-04-24T13:31:26.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0350000000000007e-06 2024-04-24T13:31:26.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181565+0000", 2024-04-24T13:31:26.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6523999999999999e-05 2024-04-24T13:31:26.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181579+0000", 2024-04-24T13:31:26.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3732e-05 2024-04-24T13:31:26.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181703+0000", 2024-04-24T13:31:26.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012400099999999999 2024-04-24T13:31:26.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.182049+0000", 2024-04-24T13:31:26.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000346461 2024-04-24T13:31:26.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:26.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.182596+0000", 2024-04-24T13:31:26.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054673999999999999 2024-04-24T13:31:26.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.183810+0000", 2024-04-24T13:31:26.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001213769 2024-04-24T13:31:26.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184460+0000", 2024-04-24T13:31:26.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00065003000000000001 2024-04-24T13:31:26.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184543+0000", 2024-04-24T13:31:26.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3545000000000001e-05 2024-04-24T13:31:26.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184610+0000", 2024-04-24T13:31:26.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6959999999999996e-05 2024-04-24T13:31:26.027 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.027 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.028 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.028 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.028 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.028 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:26.030 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:26.030 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:26.025+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:26.130 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:26.128+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:26.207 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:26.207 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:26.207 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:26.207 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:26.221 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:26.266 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:26.264+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:26.329 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:31:26.331 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:26.328+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:26.389 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:26.390 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:26.390 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:26.390 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:26.390 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:26.403 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:26.446 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:26.444+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:26.533 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:26.529+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:26.570 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:26.570 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:26.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:26.570 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:26.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.571 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:26.571 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:26.571 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.297109657999997, 2024-04-24T13:31:26.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003286134, 2024-04-24T13:31:26.571 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.571 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.571 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4440", 2024-04-24T13:31:26.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:26.571 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:31:26.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.571 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270374+0000", 2024-04-24T13:31:26.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9130000000000001e-06 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270384+0000", 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0023e-05 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270410+0000", 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5483e-05 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270426+0000", 2024-04-24T13:31:26.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6413e-05 2024-04-24T13:31:26.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270524+0000", 2024-04-24T13:31:26.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8314999999999996e-05 2024-04-24T13:31:26.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270704+0000", 2024-04-24T13:31:26.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017929 2024-04-24T13:31:26.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:26.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270950+0000", 2024-04-24T13:31:26.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024601000000000001 2024-04-24T13:31:26.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.272837+0000", 2024-04-24T13:31:26.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018874600000000001 2024-04-24T13:31:26.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273498+0000", 2024-04-24T13:31:26.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066062100000000002 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273589+0000", 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.098e-05 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273658+0000", 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9626e-05 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.577 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:26.577 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:26.577 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.288319790000003, 2024-04-24T13:31:26.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048388950000000002, 2024-04-24T13:31:26.577 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.577 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.577 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.577 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.577 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-24T13:31:26.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.578 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:26.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:26.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:31:26.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3799999999999998e-06 2024-04-24T13:31:26.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279193+0000", 2024-04-24T13:31:26.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7674e-05 2024-04-24T13:31:26.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279224+0000", 2024-04-24T13:31:26.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0654000000000002e-05 2024-04-24T13:31:26.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279244+0000", 2024-04-24T13:31:26.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:31:26.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279426+0000", 2024-04-24T13:31:26.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018255300000000001 2024-04-24T13:31:26.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279717+0000", 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029043800000000001 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279993+0000", 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276786 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282898+0000", 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002904093 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283731+0000", 2024-04-24T13:31:26.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00083382599999999997 2024-04-24T13:31:26.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283886+0000", 2024-04-24T13:31:26.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015512600000000001 2024-04-24T13:31:26.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284001+0000", 2024-04-24T13:31:26.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114405 2024-04-24T13:31:26.582 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410010339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.283195194999998, 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044116340000000002, 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.583 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-24T13:31:26.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.584 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:26.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:26.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284289+0000", 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.125e-06 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284299+0000", 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0485999999999999e-05 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284330+0000", 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0528000000000003e-05 2024-04-24T13:31:26.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284345+0000", 2024-04-24T13:31:26.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4883e-05 2024-04-24T13:31:26.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284484+0000", 2024-04-24T13:31:26.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139708 2024-04-24T13:31:26.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284655+0000", 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170953 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284981+0000", 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000325648 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.287326+0000", 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023452709999999999 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288427+0000", 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001100544 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288551+0000", 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012466500000000001 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288698+0000", 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146823 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.588 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.303982310000002, 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047820809999999997, 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-24T13:31:26.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.590 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:26.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:26.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263503+0000", 2024-04-24T13:31:26.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.039e-06 2024-04-24T13:31:26.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263520+0000", 2024-04-24T13:31:26.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7198e-05 2024-04-24T13:31:26.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263548+0000", 2024-04-24T13:31:26.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8158e-05 2024-04-24T13:31:26.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263565+0000", 2024-04-24T13:31:26.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7008e-05 2024-04-24T13:31:26.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263754+0000", 2024-04-24T13:31:26.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001894 2024-04-24T13:31:26.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263973+0000", 2024-04-24T13:31:26.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218593 2024-04-24T13:31:26.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:26.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.264373+0000", 2024-04-24T13:31:26.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040043400000000002 2024-04-24T13:31:26.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.266377+0000", 2024-04-24T13:31:26.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020033030000000001 2024-04-24T13:31:26.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268121+0000", 2024-04-24T13:31:26.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017441049999999999 2024-04-24T13:31:26.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268212+0000", 2024-04-24T13:31:26.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1490000000000007e-05 2024-04-24T13:31:26.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268282+0000", 2024-04-24T13:31:26.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9352999999999998e-05 2024-04-24T13:31:26.596 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.596 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.596 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.596 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.596 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:26.596 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.224270158000003, 2024-04-24T13:31:26.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034252639999999999, 2024-04-24T13:31:26.596 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.597 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.597 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.597 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.597 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.597 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.597 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 220 2024-04-24T13:31:26.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.597 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:26.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:26.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343214+0000", 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343227+0000", 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2941e-05 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343259+0000", 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1557000000000003e-05 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343274+0000", 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5401999999999999e-05 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343455+0000", 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018068700000000001 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343694+0000", 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238552 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:26.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.344088+0000", 2024-04-24T13:31:26.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039456400000000003 2024-04-24T13:31:26.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.345723+0000", 2024-04-24T13:31:26.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016349139999999999 2024-04-24T13:31:26.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346480+0000", 2024-04-24T13:31:26.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075738300000000004 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346569+0000", 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8281000000000004e-05 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346637+0000", 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8165999999999998e-05 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.213576781999997, 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032680679999999998, 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 223 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.603 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353907+0000", 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1560000000000002e-06 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353918+0000", 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0669000000000001e-05 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353948+0000", 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0329999999999999e-05 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353963+0000", 2024-04-24T13:31:26.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4989e-05 2024-04-24T13:31:26.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354076+0000", 2024-04-24T13:31:26.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112704 2024-04-24T13:31:26.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354300+0000", 2024-04-24T13:31:26.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022397000000000001 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354729+0000", 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042914100000000002 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356223+0000", 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001494219 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356972+0000", 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00074910099999999996 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357059+0000", 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6624000000000003e-05 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357173+0000", 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114165 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.608 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.206529861, 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032957419999999999, 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.609 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:26.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:26.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360954+0000", 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.154e-06 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360965+0000", 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1321999999999999e-05 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360996+0000", 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0902999999999999e-05 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361012+0000", 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361185+0000", 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172072 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361404+0000", 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021965999999999999 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361852+0000", 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000448276 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.363340+0000", 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001487169 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364094+0000", 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075443699999999995 2024-04-24T13:31:26.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364184+0000", 2024-04-24T13:31:26.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9957000000000006e-05 2024-04-24T13:31:26.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364248+0000", 2024-04-24T13:31:26.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3627000000000006e-05 2024-04-24T13:31:26.614 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.614 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.614 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.202965014, 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036426480000000001, 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.615 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:26.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:26.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364519+0000", 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364529+0000", 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088999999999999e-05 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364554+0000", 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5537e-05 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364568+0000", 2024-04-24T13:31:26.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3372e-05 2024-04-24T13:31:26.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364726+0000", 2024-04-24T13:31:26.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015809299999999999 2024-04-24T13:31:26.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365059+0000", 2024-04-24T13:31:26.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000333185 2024-04-24T13:31:26.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:26.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365758+0000", 2024-04-24T13:31:26.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069934299999999995 2024-04-24T13:31:26.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.367413+0000", 2024-04-24T13:31:26.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016552349999999999 2024-04-24T13:31:26.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368012+0000", 2024-04-24T13:31:26.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059858700000000003 2024-04-24T13:31:26.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368097+0000", 2024-04-24T13:31:26.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5253999999999994e-05 2024-04-24T13:31:26.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368159+0000", 2024-04-24T13:31:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2113000000000007e-05 2024-04-24T13:31:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.173578378000002, 2024-04-24T13:31:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033998840000000002, 2024-04-24T13:31:26.621 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.622 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.622 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.622 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.622 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.622 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.622 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-24T13:31:26.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.622 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393906+0000", 2024-04-24T13:31:26.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1569999999999998e-06 2024-04-24T13:31:26.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393917+0000", 2024-04-24T13:31:26.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1348999999999999e-05 2024-04-24T13:31:26.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393942+0000", 2024-04-24T13:31:26.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.527e-05 2024-04-24T13:31:26.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393957+0000", 2024-04-24T13:31:26.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4355999999999999e-05 2024-04-24T13:31:26.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394127+0000", 2024-04-24T13:31:26.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170555 2024-04-24T13:31:26.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394352+0000", 2024-04-24T13:31:26.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224539 2024-04-24T13:31:26.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:26.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394788+0000", 2024-04-24T13:31:26.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043600099999999999 2024-04-24T13:31:26.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.396137+0000", 2024-04-24T13:31:26.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001349404 2024-04-24T13:31:26.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397158+0000", 2024-04-24T13:31:26.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001020738 2024-04-24T13:31:26.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397237+0000", 2024-04-24T13:31:26.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9319000000000004e-05 2024-04-24T13:31:26.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397303+0000", 2024-04-24T13:31:26.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6196000000000001e-05 2024-04-24T13:31:26.629 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.629 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.629 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.629 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:237 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.630 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:26.630 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.162711743000003, 2024-04-24T13:31:26.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003210517, 2024-04-24T13:31:26.630 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.630 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.630 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.630 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.630 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.630 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.631 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 237 2024-04-24T13:31:26.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.631 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:26.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:26.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404772+0000", 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1830000000000001e-06 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404783+0000", 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1009000000000001e-05 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404814+0000", 2024-04-24T13:31:26.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0822999999999999e-05 2024-04-24T13:31:26.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404829+0000", 2024-04-24T13:31:26.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4808e-05 2024-04-24T13:31:26.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404965+0000", 2024-04-24T13:31:26.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013637299999999999 2024-04-24T13:31:26.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405107+0000", 2024-04-24T13:31:26.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142108 2024-04-24T13:31:26.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:26.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405399+0000", 2024-04-24T13:31:26.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029117900000000003 2024-04-24T13:31:26.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.406507+0000", 2024-04-24T13:31:26.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011081000000000001 2024-04-24T13:31:26.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407732+0000", 2024-04-24T13:31:26.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001225163 2024-04-24T13:31:26.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407866+0000", 2024-04-24T13:31:26.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013405599999999999 2024-04-24T13:31:26.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407981+0000", 2024-04-24T13:31:26.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114715 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:430 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.108994846000002, 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031779590000000002, 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.638 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.638 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-24T13:31:26.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.638 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:26.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:26.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458489+0000", 2024-04-24T13:31:26.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-24T13:31:26.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458525+0000", 2024-04-24T13:31:26.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5743e-05 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458556+0000", 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0284e-05 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458576+0000", 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0449999999999999e-05 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458738+0000", 2024-04-24T13:31:26.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016177699999999999 2024-04-24T13:31:26.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459047+0000", 2024-04-24T13:31:26.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030948400000000001 2024-04-24T13:31:26.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:26.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459499+0000", 2024-04-24T13:31:26.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045165199999999998 2024-04-24T13:31:26.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461152+0000", 2024-04-24T13:31:26.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001653477 2024-04-24T13:31:26.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461528+0000", 2024-04-24T13:31:26.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037554899999999998 2024-04-24T13:31:26.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461610+0000", 2024-04-24T13:31:26.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1914000000000002e-05 2024-04-24T13:31:26.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461665+0000", 2024-04-24T13:31:26.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5105999999999997e-05 2024-04-24T13:31:26.643 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.643 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.643 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.644 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.644 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:26.644 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.104737258999997, 2024-04-24T13:31:26.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031563120000000001, 2024-04-24T13:31:26.644 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.644 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.644 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.644 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.644 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.644 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.644 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 436 2024-04-24T13:31:26.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.644 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:26.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:26.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462746+0000", 2024-04-24T13:31:26.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8199999999999999e-06 2024-04-24T13:31:26.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462756+0000", 2024-04-24T13:31:26.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0005e-05 2024-04-24T13:31:26.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462778+0000", 2024-04-24T13:31:26.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1325e-05 2024-04-24T13:31:26.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462794+0000", 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841e-05 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462940+0000", 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014605099999999999 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463206+0000", 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026634500000000003 2024-04-24T13:31:26.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:26.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463594+0000", 2024-04-24T13:31:26.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038760299999999998 2024-04-24T13:31:26.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465323+0000", 2024-04-24T13:31:26.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00172898 2024-04-24T13:31:26.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465593+0000", 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027055500000000001 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465747+0000", 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015391999999999999 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465901+0000", 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153867 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.649 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.650 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:437 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.650 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:26.650 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.103954784000003, 2024-04-24T13:31:26.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048056540000000003, 2024-04-24T13:31:26.650 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.650 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.650 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.650 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.650 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.650 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.650 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 437 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463529+0000", 2024-04-24T13:31:26.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2479999999999999e-06 2024-04-24T13:31:26.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463544+0000", 2024-04-24T13:31:26.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:31:26.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463572+0000", 2024-04-24T13:31:26.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8294e-05 2024-04-24T13:31:26.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463590+0000", 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464092+0000", 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000502189 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464454+0000", 2024-04-24T13:31:26.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036231300000000001 2024-04-24T13:31:26.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:26.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464831+0000", 2024-04-24T13:31:26.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000377375 2024-04-24T13:31:26.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467473+0000", 2024-04-24T13:31:26.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026414659999999999 2024-04-24T13:31:26.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468185+0000", 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071215199999999997 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468271+0000", 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5593999999999994e-05 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468333+0000", 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1957000000000003e-05 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.655 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:531 6.4 e32/26 6:227f63b5:gc::gc.14:head v 32'13, mlcod=32'11)", 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 54.042723690000003, 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003260279, 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:26.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:26.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524760+0000", 2024-04-24T13:31:26.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4720000000000001e-06 2024-04-24T13:31:26.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524771+0000", 2024-04-24T13:31:26.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1270000000000001e-05 2024-04-24T13:31:26.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524792+0000", 2024-04-24T13:31:26.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1566e-05 2024-04-24T13:31:26.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524805+0000", 2024-04-24T13:31:26.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2876e-05 2024-04-24T13:31:26.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524906+0000", 2024-04-24T13:31:26.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101084 2024-04-24T13:31:26.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524943+0000", 2024-04-24T13:31:26.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6538000000000002e-05 2024-04-24T13:31:26.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.527964+0000", 2024-04-24T13:31:26.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030210229999999999 2024-04-24T13:31:26.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.528018+0000", 2024-04-24T13:31:26.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4450000000000002e-05 2024-04-24T13:31:26.661 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.661 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.661 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.662 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.662 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:26.662 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.804900156000002, 2024-04-24T13:31:26.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032103409999999998, 2024-04-24T13:31:26.662 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.662 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.662 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.663 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.663 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.663 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.663 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-24T13:31:26.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.663 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:26.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:26.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762584+0000", 2024-04-24T13:31:26.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7039999999999999e-06 2024-04-24T13:31:26.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762597+0000", 2024-04-24T13:31:26.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2539e-05 2024-04-24T13:31:26.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762629+0000", 2024-04-24T13:31:26.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2116000000000002e-05 2024-04-24T13:31:26.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762644+0000", 2024-04-24T13:31:26.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5034999999999999e-05 2024-04-24T13:31:26.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762801+0000", 2024-04-24T13:31:26.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015653999999999999 2024-04-24T13:31:26.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763192+0000", 2024-04-24T13:31:26.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000391529 2024-04-24T13:31:26.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:26.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763747+0000", 2024-04-24T13:31:26.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055497399999999996 2024-04-24T13:31:26.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.764931+0000", 2024-04-24T13:31:26.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001184128 2024-04-24T13:31:26.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765643+0000", 2024-04-24T13:31:26.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071180500000000003 2024-04-24T13:31:26.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765726+0000", 2024-04-24T13:31:26.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3058000000000003e-05 2024-04-24T13:31:26.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765792+0000", 2024-04-24T13:31:26.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5913000000000004e-05 2024-04-24T13:31:26.671 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.671 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.671 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.671 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.671 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:26.671 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.698305034999997, 2024-04-24T13:31:26.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033442569999999998, 2024-04-24T13:31:26.671 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.671 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.672 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.672 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 793 2024-04-24T13:31:26.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.672 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:26.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869179+0000", 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.323e-06 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869190+0000", 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-24T13:31:26.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869222+0000", 2024-04-24T13:31:26.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1733999999999998e-05 2024-04-24T13:31:26.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869237+0000", 2024-04-24T13:31:26.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5044e-05 2024-04-24T13:31:26.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869396+0000", 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158913 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869763+0000", 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367112 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.870319+0000", 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055558799999999998 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.871509+0000", 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001190607 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872365+0000", 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085535299999999999 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872449+0000", 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3834999999999999e-05 2024-04-24T13:31:26.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872521+0000", 2024-04-24T13:31:26.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2428999999999994e-05 2024-04-24T13:31:26.677 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.677 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.677 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.677 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.677 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:26.677 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.512298663000003, 2024-04-24T13:31:26.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003340754, 2024-04-24T13:31:26.678 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.678 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.678 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.678 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.678 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.678 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.678 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 874 2024-04-24T13:31:26.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.678 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:26.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055185+0000", 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055197+0000", 2024-04-24T13:31:26.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1606e-05 2024-04-24T13:31:26.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055229+0000", 2024-04-24T13:31:26.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1603000000000002e-05 2024-04-24T13:31:26.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055244+0000", 2024-04-24T13:31:26.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4928e-05 2024-04-24T13:31:26.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055397+0000", 2024-04-24T13:31:26.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015366499999999999 2024-04-24T13:31:26.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055763+0000", 2024-04-24T13:31:26.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036565600000000001 2024-04-24T13:31:26.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:26.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.056317+0000", 2024-04-24T13:31:26.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055436600000000004 2024-04-24T13:31:26.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.057678+0000", 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001361283 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058258+0000", 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057942400000000004 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058407+0000", 2024-04-24T13:31:26.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000149188 2024-04-24T13:31:26.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058524+0000", 2024-04-24T13:31:26.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116805 2024-04-24T13:31:26.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.686 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.686 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.686 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:26.686 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.507579933999999, 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032622950000000001, 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 876 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:26.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059904+0000", 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.767e-06 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059912+0000", 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819999999999994e-06 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059934+0000", 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2141e-05 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059949+0000", 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4285e-05 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060072+0000", 2024-04-24T13:31:26.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012349400000000001 2024-04-24T13:31:26.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060302+0000", 2024-04-24T13:31:26.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022971999999999999 2024-04-24T13:31:26.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:26.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060787+0000", 2024-04-24T13:31:26.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048565400000000002 2024-04-24T13:31:26.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062208+0000", 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014201870000000001 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062946+0000", 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073827699999999997 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063036+0000", 2024-04-24T13:31:26.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9758000000000004e-05 2024-04-24T13:31:26.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063164+0000", 2024-04-24T13:31:26.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012852999999999999 2024-04-24T13:31:26.692 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.692 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.692 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.692 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:924 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.692 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.396648286999998, 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030953729999999998, 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 924 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:26.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:26.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170836+0000", 2024-04-24T13:31:26.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1900000000000002e-06 2024-04-24T13:31:26.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170847+0000", 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1109e-05 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170879+0000", 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2153000000000002e-05 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170898+0000", 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8785000000000001e-05 2024-04-24T13:31:26.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171030+0000", 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013210300000000001 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171294+0000", 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026387600000000002 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171790+0000", 2024-04-24T13:31:26.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049596899999999997 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.172966+0000", 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011761 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173663+0000", 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069701500000000005 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173818+0000", 2024-04-24T13:31:26.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155427 2024-04-24T13:31:26.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173929+0000", 2024-04-24T13:31:26.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110646 2024-04-24T13:31:26.698 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.698 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.698 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.698 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:26.698 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 53.330637031000002, 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032803860000000002, 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 952 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:26.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:26.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:26.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:26.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:26.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:26.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236847+0000", 2024-04-24T13:31:26.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:31:26.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236858+0000", 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0582e-05 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236900+0000", 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2463000000000003e-05 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236923+0000", 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2938e-05 2024-04-24T13:31:26.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237071+0000", 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014795100000000001 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237365+0000", 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000293963 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237755+0000", 2024-04-24T13:31:26.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039032599999999998 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239124+0000", 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136918 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239925+0000", 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080016699999999996 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:26.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240011+0000", 2024-04-24T13:31:26.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6780999999999995e-05 2024-04-24T13:31:26.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:26.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:26.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:26.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240125+0000", 2024-04-24T13:31:26.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113862 2024-04-24T13:31:26.704 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.704 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.704 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.704 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:26.704 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:26.704 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:26.706 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:26.707 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:26.705+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:26.780 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:31:26.826 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:26.825+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:26.833 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:26.834 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:26.834 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:26.834 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:26.848 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:26.908 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:26.905+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:26.933 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:26.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:26.950 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:26.950 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:26.967 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:26.967 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:26.972 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:26.972 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:26.972 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:26.972 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:26.972 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:26.983 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:26.983 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:26.986 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:27.000 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:27.001 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:27.008 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:27.005+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:27.018 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:27.019 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:27.036 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:27.036 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:27.054 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:27.054 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:27.111 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:27.111 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:27.114 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:27.113+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:27.125 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:27.210 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:27.208+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:27.250 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:27.250 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:27.264 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:27.311 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:27.309+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:27.412 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:27.409+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:27.431 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:27.431 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:27.444 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:27.513 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:27.509+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:27.567 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:27.567 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:27.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:27.630 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:27.629+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:27.714 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:27.714 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:27.715 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:27.713+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:27.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:27.815 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:27.816+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:27.895 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:27.895 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:27.911 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:27.916 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:27.916+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:28.017 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:28.013+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:28.035 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:28.035 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:28.048 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:28.118 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:28.116+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:28.214 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:28.214 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:28.219 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:28.217+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:28.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:28.320 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:28.316+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:28.356 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:31:28.390 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:28.390 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:28.406 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:28.450 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:28.449+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:28.523 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:28.521+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:28.566 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:28.566 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:28.580 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:28.623 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:28.620+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:28.726 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:28.725+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:28.738 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:28.739 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:28.752 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:28.842 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:28.841+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:28.914 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:28.914 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:28.927 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:28.931 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:28.932+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:29.032 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:29.032+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:29.072 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:31:29.094 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:29.094 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:29.109 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:31:29.154 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:29.153+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:29.223 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:29.223 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:29.232 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:29.229+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:29.242 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:29.242 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:29.259 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:29.259 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:29.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:29.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:29.283 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:29.283 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:29.283 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:29.297 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:31:29.298 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:29.298 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:29.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:29.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:29.333 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:29.329+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:29.342 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:29.342 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:29.350 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:31:29.369 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:29.369 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:29.418 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:29.419 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:29.419 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:29.434 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:31:29.435 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:29.432+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:29.536 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:29.532+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:29.607 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:31:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 62.356979725000002, 2024-04-24T13:31:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057346300000000001, 2024-04-24T13:31:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44 2024-04-24T13:31:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247277+0000", 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3459999999999998e-06 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247344+0000", 2024-04-24T13:31:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6768999999999997e-05 2024-04-24T13:31:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247379+0000", 2024-04-24T13:31:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4573999999999998e-05 2024-04-24T13:31:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247402+0000", 2024-04-24T13:31:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3303e-05 2024-04-24T13:31:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247599+0000", 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019720499999999999 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247622+0000", 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2512999999999999e-05 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.252825+0000", 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052035270000000003 2024-04-24T13:31:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.253009+0000", 2024-04-24T13:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018339300000000001 2024-04-24T13:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.328337212000001, 2024-04-24T13:31:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:31:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:31:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:31:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:31:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:31:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:31:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:31:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:31:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.277297570999998, 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031751589999999999, 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 216 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326959+0000", 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6170000000000001e-06 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326972+0000", 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327005+0000", 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2845000000000001e-05 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327023+0000", 2024-04-24T13:31:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8179999999999999e-05 2024-04-24T13:31:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327132+0000", 2024-04-24T13:31:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010878300000000001 2024-04-24T13:31:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327351+0000", 2024-04-24T13:31:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021952000000000001 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327770+0000", 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041895600000000001 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329354+0000", 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00158388 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329982+0000", 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062821700000000003 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330066+0000", 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4153999999999994e-05 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330131+0000", 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4920999999999997e-05 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.237326498999998, 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031663630000000002, 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 227 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:31:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366930+0000", 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3800000000000001e-06 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366941+0000", 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1466e-05 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366973+0000", 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1588999999999999e-05 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366987+0000", 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4663e-05 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367166+0000", 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017905699999999999 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367388+0000", 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022201299999999999 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367820+0000", 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000431357 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369320+0000", 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015007359999999999 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369944+0000", 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062337299999999998 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370026+0000", 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2437999999999999e-05 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370094+0000", 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7291000000000003e-05 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.230015053999999, 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030833050000000002, 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 229 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374241+0000", 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5660000000000001e-06 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374253+0000", 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2094e-05 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374284+0000", 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0824999999999997e-05 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374299+0000", 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.483e-05 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374410+0000", 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110956 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374631+0000", 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221117 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.375006+0000", 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000375041 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.376480+0000", 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00147434 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377172+0000", 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00069190799999999998 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377255+0000", 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2536999999999999e-05 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377322+0000", 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7090999999999999e-05 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.223383044999999, 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040131660000000003, 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 231 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:31:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380873+0000", 2024-04-24T13:31:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2400000000000002e-06 2024-04-24T13:31:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380884+0000", 2024-04-24T13:31:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0645999999999999e-05 2024-04-24T13:31:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380919+0000", 2024-04-24T13:31:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5026e-05 2024-04-24T13:31:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380934+0000", 2024-04-24T13:31:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.522e-05 2024-04-24T13:31:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381077+0000", 2024-04-24T13:31:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014362500000000001 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381453+0000", 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037581799999999999 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.382170+0000", 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071714999999999995 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.383955+0000", 2024-04-24T13:31:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017847710000000001 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384619+0000", 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066381600000000002 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384770+0000", 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015067800000000001 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384884+0000", 2024-04-24T13:31:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114176 2024-04-24T13:31:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:324 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.185351181000001, 2024-04-24T13:31:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029016649999999999, 2024-04-24T13:31:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 324 2024-04-24T13:31:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418904+0000", 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-06 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418911+0000", 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.759e-06 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418928+0000", 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7105e-05 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418935+0000", 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7309999999999993e-06 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419024+0000", 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8524999999999997e-05 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419121+0000", 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6978000000000006e-05 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419329+0000", 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020806399999999999 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419835+0000", 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050625300000000002 2024-04-24T13:31:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421631+0000", 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001795615 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421694+0000", 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3398999999999994e-05 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421804+0000", 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109894 2024-04-24T13:31:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:562 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.051419811999999, 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048608870000000004, 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 562 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552837+0000", 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8499999999999998e-06 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552852+0000", 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4866e-05 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552890+0000", 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8166e-05 2024-04-24T13:31:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552905+0000", 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5255e-05 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553053+0000", 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014824599999999999 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553425+0000", 2024-04-24T13:31:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000371512 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553969+0000", 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054421500000000002 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.554987+0000", 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001017855 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557606+0000", 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026195839999999999 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557655+0000", 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8575000000000002e-05 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557695+0000", 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9762999999999999e-05 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:607 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 57.011550569000001, 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003243737, 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 607 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592705+0000", 2024-04-24T13:31:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592714+0000", 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7630000000000006e-06 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592733+0000", 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9656e-05 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592745+0000", 2024-04-24T13:31:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592881+0000", 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013627999999999999 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593221+0000", 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033945600000000002 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593765+0000", 2024-04-24T13:31:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054456600000000002 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.594969+0000", 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012034649999999999 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595779+0000", 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000810161 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595893+0000", 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114481 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595947+0000", 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3352e-05 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.860442702999997, 2024-04-24T13:31:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027976260000000001, 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 736 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743813+0000", 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0899999999999999e-06 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743824+0000", 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.111e-05 2024-04-24T13:31:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743853+0000", 2024-04-24T13:31:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909000000000001e-05 2024-04-24T13:31:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743867+0000", 2024-04-24T13:31:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4036000000000001e-05 2024-04-24T13:31:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743980+0000", 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011266 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744205+0000", 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000225016 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744515+0000", 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030974000000000003 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.745485+0000", 2024-04-24T13:31:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097096300000000003 2024-04-24T13:31:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746512+0000", 2024-04-24T13:31:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001026873 2024-04-24T13:31:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746563+0000", 2024-04-24T13:31:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1017000000000003e-05 2024-04-24T13:31:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746609+0000", 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5212e-05 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.771215324000003, 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028606399999999998, 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.665 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 778 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833041+0000", 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3539999999999998e-06 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833052+0000", 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833084+0000", 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833111+0000", 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6869e-05 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833245+0000", 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000133576 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833460+0000", 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021584600000000001 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833761+0000", 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000300477 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.834890+0000", 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011292050000000001 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835731+0000", 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000841423 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835829+0000", 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7337000000000007e-05 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835899+0000", 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0151e-05 2024-04-24T13:31:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.660734978000001, 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002884246, 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 826 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943521+0000", 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4530000000000001e-06 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943532+0000", 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943563+0000", 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0982000000000003e-05 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943582+0000", 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8406e-05 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943781+0000", 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000199624 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944019+0000", 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000237972 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944345+0000", 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032530699999999999 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.945581+0000", 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012363809999999999 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946252+0000", 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067128499999999998 2024-04-24T13:31:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946339+0000", 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6193999999999995e-05 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946403+0000", 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4364999999999998e-05 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.633311517000003, 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034937589999999999, 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 838 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970944+0000", 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3360000000000002e-06 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970959+0000", 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.469e-05 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970989+0000", 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0159e-05 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971004+0000", 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:31:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971147+0000", 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014242500000000001 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971514+0000", 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036720900000000001 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.972113+0000", 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00059902100000000004 2024-04-24T13:31:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.973403+0000", 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012904189999999999 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974152+0000", 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074879600000000003 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974316+0000", 2024-04-24T13:31:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164308 2024-04-24T13:31:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974436+0000", 2024-04-24T13:31:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119453 2024-04-24T13:31:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.629003597000001, 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030693220000000002, 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 840 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975252+0000", 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975261+0000", 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5089999999999999e-06 2024-04-24T13:31:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975284+0000", 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2719999999999999e-05 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975297+0000", 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2666e-05 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975425+0000", 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012792899999999999 2024-04-24T13:31:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975661+0000", 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023588299999999999 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.976159+0000", 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000498264 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.977419+0000", 2024-04-24T13:31:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012604859999999999 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978048+0000", 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062885000000000003 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978211+0000", 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016268899999999999 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978319+0000", 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108596 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.570765295000001, 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033625529999999999, 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 865 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033491+0000", 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033502+0000", 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1693e-05 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033532+0000", 2024-04-24T13:31:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0165999999999999e-05 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033549+0000", 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6113e-05 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033691+0000", 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142445 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034025+0000", 2024-04-24T13:31:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000334407 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034537+0000", 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051115299999999998 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.035646+0000", 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011090169999999999 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036588+0000", 2024-04-24T13:31:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094208599999999997 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036741+0000", 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153055 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036851+0000", 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110245 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.566265186999999, 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029772050000000001, 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 867 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037991+0000", 2024-04-24T13:31:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1040000000000001e-06 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038001+0000", 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0910000000000001e-05 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038032+0000", 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0648999999999997e-05 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038050+0000", 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8151999999999998e-05 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038165+0000", 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115058 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038379+0000", 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021330000000000001 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038813+0000", 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00043452299999999997 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.039972+0000", 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001158793 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040723+0000", 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075142000000000004 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040864+0000", 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140624 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040966+0000", 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101672 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:888 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.517195450000003, 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031285739999999999, 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 888 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087060+0000", 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.516e-06 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087067+0000", 2024-04-24T13:31:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2400000000000001e-06 2024-04-24T13:31:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087086+0000", 2024-04-24T13:31:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9446e-05 2024-04-24T13:31:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087096+0000", 2024-04-24T13:31:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:31:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087221+0000", 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012472300000000001 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087467+0000", 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024638200000000001 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087959+0000", 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049190900000000001 2024-04-24T13:31:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.089236+0000", 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001277037 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090046+0000", 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00080988200000000005 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090124+0000", 2024-04-24T13:31:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7670999999999995e-05 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090187+0000", 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2798000000000004e-05 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.500474077, 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028897739999999999, 2024-04-24T13:31:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 895 2024-04-24T13:31:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103782+0000", 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2029999999999999e-06 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103794+0000", 2024-04-24T13:31:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1746000000000001e-05 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103824+0000", 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0942999999999998e-05 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103846+0000", 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1086000000000001e-05 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104008+0000", 2024-04-24T13:31:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016265499999999999 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104236+0000", 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022747300000000001 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104551+0000", 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031555400000000001 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.105734+0000", 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011832290000000001 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106519+0000", 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078438599999999998 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106603+0000", 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4455000000000004e-05 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106669+0000", 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6044000000000007e-05 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.496746268000003, 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027864140000000001, 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 897 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:31:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107509+0000", 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2500000000000001e-06 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107516+0000", 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0929999999999997e-06 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107535+0000", 2024-04-24T13:31:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9176000000000001e-05 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107546+0000", 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0596e-05 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107647+0000", 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010131700000000001 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107791+0000", 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014395900000000001 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.108057+0000", 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026571500000000003 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.109123+0000", 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010666969999999999 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110108+0000", 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00098528700000000006 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110199+0000", 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0080000000000005e-05 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110294+0000", 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5243999999999998e-05 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.490343899000003, 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028668890000000001, 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 900 2024-04-24T13:31:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113911+0000", 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5540000000000001e-06 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113919+0000", 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4730000000000003e-06 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113937+0000", 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8462e-05 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113947+0000", 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5869999999999999e-06 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114061+0000", 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011431599999999999 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114188+0000", 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012727300000000001 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114460+0000", 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027200500000000002 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.115591+0000", 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011307719999999999 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116635+0000", 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044278 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116713+0000", 2024-04-24T13:31:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7484000000000006e-05 2024-04-24T13:31:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116777+0000", 2024-04-24T13:31:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3684999999999998e-05 2024-04-24T13:31:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:29.722 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:29.724 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:31:29.724 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:29.720+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:29.825 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:29.820+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:29.857 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:29.857 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:29.857 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:29.857 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:29.871 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:31:29.959 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:29.956+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:30.026 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:30.025+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:30.038 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:30.038 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:30.039 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:30.039 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:30.039 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:30.054 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:31:30.128 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:30.125+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:30.226 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:30.226 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:30.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:30.226 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:30.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.226 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:31:30.226 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:30.226 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.996820423999999, 2024-04-24T13:31:30.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020457065, 2024-04-24T13:31:30.226 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.226 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225903+0000", 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7100000000000001e-06 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225922+0000", 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8919999999999998e-05 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225960+0000", 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7240000000000003e-05 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225987+0000", 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6919000000000001e-05 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226300+0000", 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000313701 2024-04-24T13:31:30.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226317+0000", 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6463000000000001e-05 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231091+0000", 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047739169999999999 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231111+0000", 2024-04-24T13:31:30.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0605999999999999e-05 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246073+0000", 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014961264 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246357+0000", 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028432499999999999 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 60.955680776999998, 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056987720000000004, 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267040+0000", 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3e-07 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267050+0000", 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8560000000000002e-06 2024-04-24T13:31:30.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267205+0000", 2024-04-24T13:31:30.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520200000000001 2024-04-24T13:31:30.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267244+0000", 2024-04-24T13:31:30.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8587000000000002e-05 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267346+0000", 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010223200000000001 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267374+0000", 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8214000000000001e-05 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272631+0000", 2024-04-24T13:31:30.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052563089999999998 2024-04-24T13:31:30.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272738+0000", 2024-04-24T13:31:30.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107642 2024-04-24T13:31:30.236 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.236 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.236 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.237 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:47 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'2, mlcod=0'0)", 2024-04-24T13:31:30.237 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:30.237 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 60.941770020999996, 2024-04-24T13:31:30.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052089900000000001, 2024-04-24T13:31:30.237 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.237 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.237 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.237 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:30.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:30.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280951+0000", 2024-04-24T13:31:30.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7199999999999997e-07 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280962+0000", 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1094000000000001e-05 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280981+0000", 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9066e-05 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280999+0000", 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8148e-05 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281144+0000", 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014454999999999999 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281190+0000", 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5649000000000003e-05 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286063+0000", 2024-04-24T13:31:30.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048732549999999999 2024-04-24T13:31:30.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286159+0000", 2024-04-24T13:31:30.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6355999999999997e-05 2024-04-24T13:31:30.241 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.241 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.241 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.241 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.242 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:30.242 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.920382140000001, 2024-04-24T13:31:30.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010258288000000001, 2024-04-24T13:31:30.242 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.242 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.242 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.242 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.242 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.242 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.242 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-24T13:31:30.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.242 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302342+0000", 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6059999999999999e-06 2024-04-24T13:31:30.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302357+0000", 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5201999999999999e-05 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302393+0000", 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6386e-05 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302411+0000", 2024-04-24T13:31:30.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7864999999999999e-05 2024-04-24T13:31:30.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302544+0000", 2024-04-24T13:31:30.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132526 2024-04-24T13:31:30.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:30.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302554+0000", 2024-04-24T13:31:30.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0479000000000001e-05 2024-04-24T13:31:30.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309290+0000", 2024-04-24T13:31:30.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006735937 2024-04-24T13:31:30.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309474+0000", 2024-04-24T13:31:30.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000183981 2024-04-24T13:31:30.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309873+0000", 2024-04-24T13:31:30.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000398618 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.311131+0000", 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012578929999999999 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312443+0000", 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001312648 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312535+0000", 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1620999999999996e-05 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312596+0000", 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1525999999999993e-05 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:30.248 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.836087253000002, 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035352830000000002, 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 232 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:30.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:30.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386636+0000", 2024-04-24T13:31:30.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8329999999999998e-06 2024-04-24T13:31:30.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386649+0000", 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3586e-05 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386681+0000", 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1529000000000003e-05 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386697+0000", 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6412000000000001e-05 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386869+0000", 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000171998 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.387124+0000", 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025514 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.387553+0000", 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000428758 2024-04-24T13:31:30.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.389079+0000", 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015254089999999999 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390010+0000", 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00093115799999999996 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390099+0000", 2024-04-24T13:31:30.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8826999999999995e-05 2024-04-24T13:31:30.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390168+0000", 2024-04-24T13:31:30.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9633000000000002e-05 2024-04-24T13:31:30.254 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.254 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.254 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.254 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:283 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.254 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:30.254 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.808729212999999, 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040489189999999998, 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 283 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:30.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413993+0000", 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0770000000000002e-06 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414006+0000", 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2696e-05 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414031+0000", 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5639999999999998e-05 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414046+0000", 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4412e-05 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414206+0000", 2024-04-24T13:31:30.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015972299999999999 2024-04-24T13:31:30.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414646+0000", 2024-04-24T13:31:30.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000440023 2024-04-24T13:31:30.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.415227+0000", 2024-04-24T13:31:30.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00058130599999999997 2024-04-24T13:31:30.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.416668+0000", 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00144118 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417911+0000", 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012426690000000001 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417980+0000", 2024-04-24T13:31:30.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8942999999999994e-05 2024-04-24T13:31:30.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.418040+0000", 2024-04-24T13:31:30.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0250000000000001e-05 2024-04-24T13:31:30.260 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.260 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.260 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.260 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:299 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-04-24T13:31:30.260 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:30.260 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.805521032000001, 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033212430000000002, 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:30.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417201+0000", 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.784e-06 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417216+0000", 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5464999999999998e-05 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417238+0000", 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1474000000000001e-05 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417254+0000", 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5954999999999999e-05 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417425+0000", 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017128799999999999 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417457+0000", 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1844000000000002e-05 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.420406+0000", 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002948895 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.420520+0000", 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011453799999999999 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.264 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:319 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.803530467999998, 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040866640000000003, 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 319 2024-04-24T13:31:30.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.266 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:30.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:30.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419192+0000", 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8759999999999999e-06 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419217+0000", 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5077000000000001e-05 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419247+0000", 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0054000000000001e-05 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419262+0000", 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4885000000000001e-05 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419410+0000", 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148701 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419603+0000", 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019235899999999999 2024-04-24T13:31:30.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419892+0000", 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028910699999999998 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.421211+0000", 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013190599999999999 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423024+0000", 2024-04-24T13:31:30.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001812971 2024-04-24T13:31:30.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423184+0000", 2024-04-24T13:31:30.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000160323 2024-04-24T13:31:30.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423276+0000", 2024-04-24T13:31:30.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2250999999999995e-05 2024-04-24T13:31:30.270 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.270 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.270 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:505 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.715971033000002, 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031283859999999999, 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 505 2024-04-24T13:31:30.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506752+0000", 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7630000000000001e-06 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506764+0000", 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2318e-05 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506794+0000", 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9674000000000001e-05 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506811+0000", 2024-04-24T13:31:30.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7507e-05 2024-04-24T13:31:30.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506914+0000", 2024-04-24T13:31:30.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010252 2024-04-24T13:31:30.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.507140+0000", 2024-04-24T13:31:30.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022651999999999999 2024-04-24T13:31:30.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.507604+0000", 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046387099999999998 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.508700+0000", 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010960200000000001 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509671+0000", 2024-04-24T13:31:30.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000970754 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509777+0000", 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105664 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509878+0000", 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100775 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:545 6.2 6:479ba34f:::obj_delete_at_hint.0000000021:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.684108791, 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003146893, 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 545 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.277 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:30.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:30.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538614+0000", 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5790000000000002e-06 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538627+0000", 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2536e-05 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538657+0000", 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0363000000000001e-05 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538673+0000", 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5735000000000001e-05 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538782+0000", 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010905599999999999 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539002+0000", 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022079900000000001 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539510+0000", 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00050796700000000001 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.540770+0000", 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012598850000000001 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541525+0000", 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075419500000000004 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541678+0000", 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153258 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541758+0000", 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0519999999999995e-05 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.282 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:631 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.610027568, 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003398257, 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 631 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:30.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:30.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612695+0000", 2024-04-24T13:31:30.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7300000000000001e-06 2024-04-24T13:31:30.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612708+0000", 2024-04-24T13:31:30.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2808e-05 2024-04-24T13:31:30.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612741+0000", 2024-04-24T13:31:30.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2676999999999999e-05 2024-04-24T13:31:30.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612757+0000", 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6611000000000001e-05 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612924+0000", 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016621 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.613299+0000", 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037503299999999999 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:30.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.613869+0000", 2024-04-24T13:31:30.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057067299999999995 2024-04-24T13:31:30.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615041+0000", 2024-04-24T13:31:30.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001171248 2024-04-24T13:31:30.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615795+0000", 2024-04-24T13:31:30.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000754785 2024-04-24T13:31:30.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615967+0000", 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017142200000000001 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.616091+0000", 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012406 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:647 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.597019291000002, 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028765370000000002, 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 647 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:30.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:30.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625703+0000", 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9850000000000001e-06 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625713+0000", 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8279999999999998e-06 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625740+0000", 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7174000000000001e-05 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625760+0000", 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9966000000000002e-05 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625912+0000", 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151815 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.626278+0000", 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036677200000000002 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.626837+0000", 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055886 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628073+0000", 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001235877 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628338+0000", 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026515499999999999 2024-04-24T13:31:30.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628479+0000", 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014045799999999999 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628577+0000", 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8647000000000006e-05 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.295 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.295 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:30.295 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.535787358, 2024-04-24T13:31:30.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034770059999999999, 2024-04-24T13:31:30.295 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.295 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.295 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.295 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.295 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.295 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.295 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 709 2024-04-24T13:31:30.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.295 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686935+0000", 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4760000000000001e-06 2024-04-24T13:31:30.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686948+0000", 2024-04-24T13:31:30.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2846e-05 2024-04-24T13:31:30.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686979+0000", 2024-04-24T13:31:30.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0987e-05 2024-04-24T13:31:30.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686995+0000", 2024-04-24T13:31:30.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5580999999999999e-05 2024-04-24T13:31:30.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687121+0000", 2024-04-24T13:31:30.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012667399999999999 2024-04-24T13:31:30.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687328+0000", 2024-04-24T13:31:30.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000206741 2024-04-24T13:31:30.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:30.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687614+0000", 2024-04-24T13:31:30.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028608300000000002 2024-04-24T13:31:30.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688763+0000", 2024-04-24T13:31:30.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001148533 2024-04-24T13:31:30.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690207+0000", 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00144458 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690293+0000", 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5858000000000004e-05 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690410+0000", 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116647 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.300 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.301 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.301 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.301 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:30.301 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.496532694999999, 2024-04-24T13:31:30.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029468519999999998, 2024-04-24T13:31:30.301 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.301 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.301 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.301 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.301 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.301 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 727 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726190+0000", 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.26e-06 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726201+0000", 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1615e-05 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726233+0000", 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1547000000000001e-05 2024-04-24T13:31:30.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726252+0000", 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8681e-05 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726381+0000", 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012944000000000001 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726611+0000", 2024-04-24T13:31:30.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023025500000000001 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726950+0000", 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033885399999999998 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.728086+0000", 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011360039999999999 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.728982+0000", 2024-04-24T13:31:30.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00089614899999999995 2024-04-24T13:31:30.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.729067+0000", 2024-04-24T13:31:30.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4968000000000004e-05 2024-04-24T13:31:30.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.729134+0000", 2024-04-24T13:31:30.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7078999999999999e-05 2024-04-24T13:31:30.306 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.306 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:729 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.492451789, 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030005850000000001, 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.307 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 729 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730270+0000", 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8059999999999999e-06 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730278+0000", 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2789999999999998e-06 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730298+0000", 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9488e-05 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730309+0000", 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1294999999999999e-05 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730436+0000", 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012690999999999999 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730677+0000", 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000241275 2024-04-24T13:31:30.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:30.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.731167+0000", 2024-04-24T13:31:30.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048962799999999998 2024-04-24T13:31:30.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.732344+0000", 2024-04-24T13:31:30.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011773619999999999 2024-04-24T13:31:30.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733135+0000", 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000790213 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733209+0000", 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4488999999999998e-05 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733269+0000", 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9840000000000003e-05 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.313 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.313 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:30.313 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.306674491000003, 2024-04-24T13:31:30.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034749830000000001, 2024-04-24T13:31:30.313 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.313 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.313 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.313 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.313 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.313 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.313 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 814 2024-04-24T13:31:30.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916048+0000", 2024-04-24T13:31:30.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2330000000000001e-06 2024-04-24T13:31:30.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916059+0000", 2024-04-24T13:31:30.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1266e-05 2024-04-24T13:31:30.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916090+0000", 2024-04-24T13:31:30.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0993e-05 2024-04-24T13:31:30.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916109+0000", 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8751999999999999e-05 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916265+0000", 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015573 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916632+0000", 2024-04-24T13:31:30.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367597 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.917180+0000", 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054785599999999999 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.918555+0000", 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001374781 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919250+0000", 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069470700000000003 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919404+0000", 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015483000000000001 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919521+0000", 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011623799999999999 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.318 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.151842662, 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029290919999999999, 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 880 2024-04-24T13:31:30.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070880+0000", 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8660000000000002e-06 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070911+0000", 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0783e-05 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070942+0000", 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0979999999999998e-05 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070958+0000", 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5858999999999998e-05 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071120+0000", 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016239999999999999 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071370+0000", 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000249301 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071695+0000", 2024-04-24T13:31:30.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032495000000000001 2024-04-24T13:31:30.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.072963+0000", 2024-04-24T13:31:30.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001268443 2024-04-24T13:31:30.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073655+0000", 2024-04-24T13:31:30.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069215800000000001 2024-04-24T13:31:30.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073741+0000", 2024-04-24T13:31:30.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5731999999999998e-05 2024-04-24T13:31:30.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073807+0000", 2024-04-24T13:31:30.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5619999999999999e-05 2024-04-24T13:31:30.324 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.324 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.324 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.144501542999997, 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002986266, 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 883 2024-04-24T13:31:30.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.326 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:30.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:30.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078221+0000", 2024-04-24T13:31:30.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.889e-06 2024-04-24T13:31:30.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078230+0000", 2024-04-24T13:31:30.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5990000000000008e-06 2024-04-24T13:31:30.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078261+0000", 2024-04-24T13:31:30.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1080000000000001e-05 2024-04-24T13:31:30.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078280+0000", 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8678999999999999e-05 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078405+0000", 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012481699999999999 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078649+0000", 2024-04-24T13:31:30.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244045 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078997+0000", 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347821 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.080294+0000", 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012972470000000001 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081048+0000", 2024-04-24T13:31:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075421500000000003 2024-04-24T13:31:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081136+0000", 2024-04-24T13:31:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8184999999999997e-05 2024-04-24T13:31:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081205+0000", 2024-04-24T13:31:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8689000000000006e-05 2024-04-24T13:31:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.330 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.048463919, 2024-04-24T13:31:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003313323, 2024-04-24T13:31:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.331 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 925 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174258+0000", 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2170000000000001e-06 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174270+0000", 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1185e-05 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174301+0000", 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1167000000000002e-05 2024-04-24T13:31:30.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174316+0000", 2024-04-24T13:31:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5398000000000001e-05 2024-04-24T13:31:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174471+0000", 2024-04-24T13:31:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015502800000000001 2024-04-24T13:31:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174834+0000", 2024-04-24T13:31:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036226299999999998 2024-04-24T13:31:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.175395+0000", 2024-04-24T13:31:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00056120499999999995 2024-04-24T13:31:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.176785+0000", 2024-04-24T13:31:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001390584 2024-04-24T13:31:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177301+0000", 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00051609300000000002 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177459+0000", 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015735400000000001 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177570+0000", 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011082900000000001 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.336 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.041192389000003, 2024-04-24T13:31:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030825470000000002, 2024-04-24T13:31:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.337 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 928 2024-04-24T13:31:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181530+0000", 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.75e-06 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181539+0000", 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0350000000000007e-06 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181565+0000", 2024-04-24T13:31:30.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6523999999999999e-05 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181579+0000", 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3732e-05 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181703+0000", 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012400099999999999 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.182049+0000", 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000346461 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.182596+0000", 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054673999999999999 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.183810+0000", 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001213769 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184460+0000", 2024-04-24T13:31:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00065003000000000001 2024-04-24T13:31:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184543+0000", 2024-04-24T13:31:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3545000000000001e-05 2024-04-24T13:31:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184610+0000", 2024-04-24T13:31:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6959999999999996e-05 2024-04-24T13:31:30.342 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.343 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.343 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:30.344 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:30.345 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:30.341+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:30.446 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:30.443+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:30.471 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:30.471 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:30.471 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:30.472 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:30.486 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:30.574 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:30.571+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:30.647 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:30.643+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:30.654 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:30.655 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:30.655 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:30.655 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:30.655 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:30.669 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:30.749 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:30.745+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:30.838 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:30.839 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:30.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:30.839 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:30.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.839 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:30.839 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:30.839 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.565328363000006, 2024-04-24T13:31:30.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003286134, 2024-04-24T13:31:30.839 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.839 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.839 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.839 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.839 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4440", 2024-04-24T13:31:30.840 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:30.840 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:31:30.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.840 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:30.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:30.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270374+0000", 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9130000000000001e-06 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270384+0000", 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0023e-05 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270410+0000", 2024-04-24T13:31:30.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5483e-05 2024-04-24T13:31:30.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270426+0000", 2024-04-24T13:31:30.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6413e-05 2024-04-24T13:31:30.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270524+0000", 2024-04-24T13:31:30.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8314999999999996e-05 2024-04-24T13:31:30.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270704+0000", 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017929 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270950+0000", 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024601000000000001 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.272837+0000", 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018874600000000001 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273498+0000", 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066062100000000002 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273589+0000", 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.098e-05 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273658+0000", 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9626e-05 2024-04-24T13:31:30.844 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.556538494999998, 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048388950000000002, 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.845 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3799999999999998e-06 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279193+0000", 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7674e-05 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279224+0000", 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0654000000000002e-05 2024-04-24T13:31:30.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279244+0000", 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279426+0000", 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018255300000000001 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279717+0000", 2024-04-24T13:31:30.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029043800000000001 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279993+0000", 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276786 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282898+0000", 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002904093 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283731+0000", 2024-04-24T13:31:30.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00083382599999999997 2024-04-24T13:31:30.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283886+0000", 2024-04-24T13:31:30.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015512600000000001 2024-04-24T13:31:30.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284001+0000", 2024-04-24T13:31:30.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114405 2024-04-24T13:31:30.850 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.850 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.850 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410010339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.5514139, 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044116340000000002, 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-24T13:31:30.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.852 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:30.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:30.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284289+0000", 2024-04-24T13:31:30.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.125e-06 2024-04-24T13:31:30.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284299+0000", 2024-04-24T13:31:30.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0485999999999999e-05 2024-04-24T13:31:30.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284330+0000", 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0528000000000003e-05 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284345+0000", 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4883e-05 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284484+0000", 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139708 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284655+0000", 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170953 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284981+0000", 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000325648 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.287326+0000", 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023452709999999999 2024-04-24T13:31:30.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288427+0000", 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001100544 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288551+0000", 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012466500000000001 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288698+0000", 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146823 2024-04-24T13:31:30.856 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.572201014999997, 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047820809999999997, 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.857 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.858 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-24T13:31:30.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.858 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:30.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:30.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263503+0000", 2024-04-24T13:31:30.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.039e-06 2024-04-24T13:31:30.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263520+0000", 2024-04-24T13:31:30.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7198e-05 2024-04-24T13:31:30.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263548+0000", 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8158e-05 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263565+0000", 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7008e-05 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263754+0000", 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001894 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263973+0000", 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218593 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.264373+0000", 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040043400000000002 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.266377+0000", 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020033030000000001 2024-04-24T13:31:30.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268121+0000", 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017441049999999999 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268212+0000", 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1490000000000007e-05 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268282+0000", 2024-04-24T13:31:30.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9352999999999998e-05 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.492488862999998, 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034252639999999999, 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.863 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 220 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343214+0000", 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343227+0000", 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2941e-05 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343259+0000", 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1557000000000003e-05 2024-04-24T13:31:30.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343274+0000", 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5401999999999999e-05 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343455+0000", 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018068700000000001 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343694+0000", 2024-04-24T13:31:30.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238552 2024-04-24T13:31:30.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:30.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.344088+0000", 2024-04-24T13:31:30.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039456400000000003 2024-04-24T13:31:30.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.345723+0000", 2024-04-24T13:31:30.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016349139999999999 2024-04-24T13:31:30.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346480+0000", 2024-04-24T13:31:30.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075738300000000004 2024-04-24T13:31:30.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346569+0000", 2024-04-24T13:31:30.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8281000000000004e-05 2024-04-24T13:31:30.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346637+0000", 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8165999999999998e-05 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.481795486999999, 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032680679999999998, 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.869 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.870 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.870 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.870 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 223 2024-04-24T13:31:30.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.870 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:30.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353907+0000", 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1560000000000002e-06 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353918+0000", 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0669000000000001e-05 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353948+0000", 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0329999999999999e-05 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353963+0000", 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4989e-05 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354076+0000", 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112704 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354300+0000", 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022397000000000001 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354729+0000", 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042914100000000002 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356223+0000", 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001494219 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356972+0000", 2024-04-24T13:31:30.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00074910099999999996 2024-04-24T13:31:30.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357059+0000", 2024-04-24T13:31:30.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6624000000000003e-05 2024-04-24T13:31:30.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357173+0000", 2024-04-24T13:31:30.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114165 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.474748566000002, 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032957419999999999, 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.875 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360954+0000", 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.154e-06 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360965+0000", 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1321999999999999e-05 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360996+0000", 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0902999999999999e-05 2024-04-24T13:31:30.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361012+0000", 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361185+0000", 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172072 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361404+0000", 2024-04-24T13:31:30.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021965999999999999 2024-04-24T13:31:30.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:30.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361852+0000", 2024-04-24T13:31:30.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000448276 2024-04-24T13:31:30.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.363340+0000", 2024-04-24T13:31:30.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001487169 2024-04-24T13:31:30.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364094+0000", 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075443699999999995 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364184+0000", 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9957000000000006e-05 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364248+0000", 2024-04-24T13:31:30.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3627000000000006e-05 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.471183719000003, 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036426480000000001, 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.881 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.882 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.882 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-24T13:31:30.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.882 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:30.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:30.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364519+0000", 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364529+0000", 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088999999999999e-05 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364554+0000", 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5537e-05 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364568+0000", 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3372e-05 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364726+0000", 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015809299999999999 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365059+0000", 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000333185 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365758+0000", 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069934299999999995 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.367413+0000", 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016552349999999999 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368012+0000", 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059858700000000003 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368097+0000", 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5253999999999994e-05 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368159+0000", 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2113000000000007e-05 2024-04-24T13:31:30.886 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.441797082999997, 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033998840000000002, 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.887 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393906+0000", 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1569999999999998e-06 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393917+0000", 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1348999999999999e-05 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393942+0000", 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.527e-05 2024-04-24T13:31:30.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393957+0000", 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4355999999999999e-05 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394127+0000", 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170555 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394352+0000", 2024-04-24T13:31:30.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224539 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394788+0000", 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043600099999999999 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.396137+0000", 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001349404 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397158+0000", 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001020738 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397237+0000", 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9319000000000004e-05 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397303+0000", 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6196000000000001e-05 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.892 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:237 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.430930447999998, 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003210517, 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 237 2024-04-24T13:31:30.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.894 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:30.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:30.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404772+0000", 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1830000000000001e-06 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404783+0000", 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1009000000000001e-05 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404814+0000", 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0822999999999999e-05 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404829+0000", 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4808e-05 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404965+0000", 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013637299999999999 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405107+0000", 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142108 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405399+0000", 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029117900000000003 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.406507+0000", 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011081000000000001 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407732+0000", 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001225163 2024-04-24T13:31:30.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407866+0000", 2024-04-24T13:31:30.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013405599999999999 2024-04-24T13:31:30.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407981+0000", 2024-04-24T13:31:30.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114715 2024-04-24T13:31:30.898 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.898 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.898 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:430 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.377213550999997, 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031779590000000002, 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-24T13:31:30.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458489+0000", 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458525+0000", 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5743e-05 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458556+0000", 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0284e-05 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458576+0000", 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0449999999999999e-05 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458738+0000", 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016177699999999999 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459047+0000", 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030948400000000001 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459499+0000", 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045165199999999998 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461152+0000", 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001653477 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461528+0000", 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037554899999999998 2024-04-24T13:31:30.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461610+0000", 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1914000000000002e-05 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461665+0000", 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5105999999999997e-05 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.904 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.372955963999999, 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031563120000000001, 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 436 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462746+0000", 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8199999999999999e-06 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462756+0000", 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0005e-05 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462778+0000", 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1325e-05 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462794+0000", 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841e-05 2024-04-24T13:31:30.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462940+0000", 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014605099999999999 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463206+0000", 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026634500000000003 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463594+0000", 2024-04-24T13:31:30.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038760299999999998 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465323+0000", 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00172898 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465593+0000", 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027055500000000001 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465747+0000", 2024-04-24T13:31:30.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015391999999999999 2024-04-24T13:31:30.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465901+0000", 2024-04-24T13:31:30.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153867 2024-04-24T13:31:30.910 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.910 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.910 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.910 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:437 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.910 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.372173488999998, 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048056540000000003, 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 437 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463529+0000", 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2479999999999999e-06 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463544+0000", 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463572+0000", 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8294e-05 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463590+0000", 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464092+0000", 2024-04-24T13:31:30.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000502189 2024-04-24T13:31:30.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464454+0000", 2024-04-24T13:31:30.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036231300000000001 2024-04-24T13:31:30.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:30.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464831+0000", 2024-04-24T13:31:30.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000377375 2024-04-24T13:31:30.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467473+0000", 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026414659999999999 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468185+0000", 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071215199999999997 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468271+0000", 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5593999999999994e-05 2024-04-24T13:31:30.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468333+0000", 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1957000000000003e-05 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:531 6.4 e32/26 6:227f63b5:gc::gc.14:head v 32'13, mlcod=32'11)", 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.310942394999998, 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003260279, 2024-04-24T13:31:30.916 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524760+0000", 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4720000000000001e-06 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524771+0000", 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1270000000000001e-05 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524792+0000", 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1566e-05 2024-04-24T13:31:30.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524805+0000", 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2876e-05 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524906+0000", 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101084 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524943+0000", 2024-04-24T13:31:30.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6538000000000002e-05 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.527964+0000", 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030210229999999999 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.528018+0000", 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4450000000000002e-05 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.073118860999998, 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032103409999999998, 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:30.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:30.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762584+0000", 2024-04-24T13:31:30.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7039999999999999e-06 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762597+0000", 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2539e-05 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762629+0000", 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2116000000000002e-05 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762644+0000", 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5034999999999999e-05 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762801+0000", 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015653999999999999 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763192+0000", 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000391529 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763747+0000", 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055497399999999996 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.764931+0000", 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001184128 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765643+0000", 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071180500000000003 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765726+0000", 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3058000000000003e-05 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765792+0000", 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5913000000000004e-05 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.926 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.96652374, 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033442569999999998, 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 793 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869179+0000", 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.323e-06 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869190+0000", 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869222+0000", 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1733999999999998e-05 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869237+0000", 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5044e-05 2024-04-24T13:31:30.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869396+0000", 2024-04-24T13:31:30.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158913 2024-04-24T13:31:30.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869763+0000", 2024-04-24T13:31:30.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367112 2024-04-24T13:31:30.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.870319+0000", 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055558799999999998 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.871509+0000", 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001190607 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872365+0000", 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085535299999999999 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872449+0000", 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3834999999999999e-05 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872521+0000", 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2428999999999994e-05 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.932 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.780517367999998, 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003340754, 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 874 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:30.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:30.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055185+0000", 2024-04-24T13:31:30.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:31:30.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055197+0000", 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1606e-05 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055229+0000", 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1603000000000002e-05 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055244+0000", 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4928e-05 2024-04-24T13:31:30.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055397+0000", 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015366499999999999 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055763+0000", 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036565600000000001 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.056317+0000", 2024-04-24T13:31:30.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055436600000000004 2024-04-24T13:31:30.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.057678+0000", 2024-04-24T13:31:30.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001361283 2024-04-24T13:31:30.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058258+0000", 2024-04-24T13:31:30.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057942400000000004 2024-04-24T13:31:30.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058407+0000", 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000149188 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058524+0000", 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116805 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.938 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.775798639000001, 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032622950000000001, 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 876 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059904+0000", 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.767e-06 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059912+0000", 2024-04-24T13:31:30.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819999999999994e-06 2024-04-24T13:31:30.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059934+0000", 2024-04-24T13:31:30.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2141e-05 2024-04-24T13:31:30.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059949+0000", 2024-04-24T13:31:30.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4285e-05 2024-04-24T13:31:30.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060072+0000", 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012349400000000001 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060302+0000", 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022971999999999999 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060787+0000", 2024-04-24T13:31:30.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048565400000000002 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062208+0000", 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014201870000000001 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062946+0000", 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073827699999999997 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063036+0000", 2024-04-24T13:31:30.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9758000000000004e-05 2024-04-24T13:31:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063164+0000", 2024-04-24T13:31:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012852999999999999 2024-04-24T13:31:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:924 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:30.944 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.664866992, 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030953729999999998, 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 924 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:30.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170836+0000", 2024-04-24T13:31:30.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1900000000000002e-06 2024-04-24T13:31:30.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170847+0000", 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1109e-05 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170879+0000", 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2153000000000002e-05 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170898+0000", 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8785000000000001e-05 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171030+0000", 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013210300000000001 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171294+0000", 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026387600000000002 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171790+0000", 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049596899999999997 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.172966+0000", 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011761 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173663+0000", 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069701500000000005 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173818+0000", 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155427 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173929+0000", 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110646 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.598855735999997, 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032803860000000002, 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:30.950 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 952 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:30.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:30.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:30.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:30.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236847+0000", 2024-04-24T13:31:30.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:31:30.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:30.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236858+0000", 2024-04-24T13:31:30.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0582e-05 2024-04-24T13:31:30.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236900+0000", 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2463000000000003e-05 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236923+0000", 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2938e-05 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237071+0000", 2024-04-24T13:31:30.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014795100000000001 2024-04-24T13:31:30.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:30.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237365+0000", 2024-04-24T13:31:30.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000293963 2024-04-24T13:31:30.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:30.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237755+0000", 2024-04-24T13:31:30.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039032599999999998 2024-04-24T13:31:30.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239124+0000", 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136918 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239925+0000", 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080016699999999996 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240011+0000", 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6780999999999995e-05 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:30.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:30.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240125+0000", 2024-04-24T13:31:30.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113862 2024-04-24T13:31:30.956 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.956 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.956 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.956 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:30.956 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:30.956 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:30.958 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:30.958 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:30.953+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:31.059 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:31.057+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:31.085 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:31.085 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:31.085 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:31.085 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:31.100 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:31.160 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:31.157+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:31.222 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:31.222 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:31.222 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:31.222 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:31.222 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:31.236 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:31.282 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:31.279+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:31.359 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:31.359 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:31.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.114486769999999, 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:31:31.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.361 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:31:31.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:31:31.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:31:31.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:31:31.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:31:31.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:31:31.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:31:31.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:31.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:31:31.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:31:31.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:31.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:31:31.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:31:31.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:31.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:31:31.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:31:31.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.367 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94410010338304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.079629056000002, 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077892999999999999, 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2770000000000001e-06 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279179+0000", 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3529999999999999e-05 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279222+0000", 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2743000000000001e-05 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279272+0000", 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0649000000000002e-05 2024-04-24T13:31:31.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279772+0000", 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000500013 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280011+0000", 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023840499999999999 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280408+0000", 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039756999999999998 2024-04-24T13:31:31.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282501+0000", 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020929159999999998 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286583+0000", 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040820530000000004 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286748+0000", 2024-04-24T13:31:31.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016431200000000001 2024-04-24T13:31:31.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286951+0000", 2024-04-24T13:31:31.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020383200000000001 2024-04-24T13:31:31.373 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.373 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.373 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.373 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:31.373 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:31:31.373 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.066383063000004, 2024-04-24T13:31:31.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024753290000000001, 2024-04-24T13:31:31.374 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.374 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.374 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.374 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:31.374 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:31.374 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:31.374 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-24T13:31:31.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.374 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292410+0000", 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292419+0000", 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8680000000000005e-06 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292445+0000", 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6207000000000002e-05 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292458+0000", 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292597+0000", 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013947100000000001 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292841+0000", 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024435599999999999 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.293085+0000", 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000243212 2024-04-24T13:31:31.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:31.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294263+0000", 2024-04-24T13:31:31.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001178171 2024-04-24T13:31:31.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:31.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294758+0000", 2024-04-24T13:31:31.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049492199999999996 2024-04-24T13:31:31.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294824+0000", 2024-04-24T13:31:31.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6346000000000005e-05 2024-04-24T13:31:31.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294883+0000", 2024-04-24T13:31:31.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9222999999999999e-05 2024-04-24T13:31:31.383 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.383 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94410010333696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.063697175000001, 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023887449999999998, 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-24T13:31:31.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.385 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:31:31.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:31:31.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295096+0000", 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1660000000000001e-06 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295105+0000", 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6139999999999992e-06 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295131+0000", 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6633000000000001e-05 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295146+0000", 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4168999999999999e-05 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295250+0000", 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104071 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295424+0000", 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017425599999999999 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295726+0000", 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030180000000000002 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.296532+0000", 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080662400000000003 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297330+0000", 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00079793300000000002 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297392+0000", 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2112000000000004e-05 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297483+0000", 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0366999999999997e-05 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.389 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 59.064168903000002, 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020133299999999998, 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:31:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294623+0000", 2024-04-24T13:31:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9999999999999996e-07 2024-04-24T13:31:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294634+0000", 2024-04-24T13:31:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1292e-05 2024-04-24T13:31:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294666+0000", 2024-04-24T13:31:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1596e-05 2024-04-24T13:31:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294688+0000", 2024-04-24T13:31:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2561e-05 2024-04-24T13:31:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294842+0000", 2024-04-24T13:31:31.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153494 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294893+0000", 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0983999999999998e-05 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296547+0000", 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016536890000000001 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296636+0000", 2024-04-24T13:31:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8913999999999996e-05 2024-04-24T13:31:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:215 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'2, mlcod=0'0)", 2024-04-24T13:31:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:31:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 59.033002848000002, 2024-04-24T13:31:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018794250000000001, 2024-04-24T13:31:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.394 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:31:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:31:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325790+0000", 2024-04-24T13:31:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:31:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325809+0000", 2024-04-24T13:31:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8590999999999999e-05 2024-04-24T13:31:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325846+0000", 2024-04-24T13:31:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6875999999999997e-05 2024-04-24T13:31:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325868+0000", 2024-04-24T13:31:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1585000000000001e-05 2024-04-24T13:31:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325983+0000", 2024-04-24T13:31:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115631 2024-04-24T13:31:31.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.326022+0000", 2024-04-24T13:31:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8618999999999997e-05 2024-04-24T13:31:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327579+0000", 2024-04-24T13:31:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015573049999999999 2024-04-24T13:31:31.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327668+0000", 2024-04-24T13:31:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8588e-05 2024-04-24T13:31:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:385 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'5, mlcod=32'2)", 2024-04-24T13:31:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:31:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.923098515, 2024-04-24T13:31:31.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020295980000000001, 2024-04-24T13:31:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:31:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:31:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435694+0000", 2024-04-24T13:31:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:31:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435708+0000", 2024-04-24T13:31:31.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3525e-05 2024-04-24T13:31:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435733+0000", 2024-04-24T13:31:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5431000000000001e-05 2024-04-24T13:31:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435752+0000", 2024-04-24T13:31:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8465e-05 2024-04-24T13:31:31.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435897+0000", 2024-04-24T13:31:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014525000000000001 2024-04-24T13:31:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435963+0000", 2024-04-24T13:31:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6297000000000006e-05 2024-04-24T13:31:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437645+0000", 2024-04-24T13:31:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001681395 2024-04-24T13:31:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437722+0000", 2024-04-24T13:31:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7424999999999998e-05 2024-04-24T13:31:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.404 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:437 6.a e32/26 6:55b0279d:reshard::reshard.0000000009:head v 32'4, mlcod=32'1)", 2024-04-24T13:31:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:31:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.893790674000002, 2024-04-24T13:31:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002915075, 2024-04-24T13:31:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:31:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:31:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465002+0000", 2024-04-24T13:31:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4470000000000001e-06 2024-04-24T13:31:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465013+0000", 2024-04-24T13:31:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1532000000000001e-05 2024-04-24T13:31:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465035+0000", 2024-04-24T13:31:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1138e-05 2024-04-24T13:31:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465048+0000", 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3311e-05 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465219+0000", 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017134600000000001 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465254+0000", 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5009999999999999e-05 2024-04-24T13:31:31.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467829+0000", 2024-04-24T13:31:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025744370000000002 2024-04-24T13:31:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467915+0000", 2024-04-24T13:31:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6854000000000006e-05 2024-04-24T13:31:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:466 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-24T13:31:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:31:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.878864434, 2024-04-24T13:31:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037830749999999999, 2024-04-24T13:31:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:31:31.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479928+0000", 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7150000000000001e-06 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479941+0000", 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2999e-05 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479969+0000", 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7923999999999999e-05 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479986+0000", 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6388e-05 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480113+0000", 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127594 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480167+0000", 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3699999999999997e-05 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483640+0000", 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003472742 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483710+0000", 2024-04-24T13:31:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0012999999999995e-05 2024-04-24T13:31:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:468 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'6, mlcod=32'3)", 2024-04-24T13:31:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:31:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.876550450000003, 2024-04-24T13:31:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039247960000000004, 2024-04-24T13:31:31.414 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482242+0000", 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.57e-06 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482255+0000", 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2418999999999999e-05 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482281+0000", 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6043000000000001e-05 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482294+0000", 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2873e-05 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482395+0000", 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101724 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482446+0000", 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0288999999999999e-05 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486063+0000", 2024-04-24T13:31:31.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036179290000000002 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486165+0000", 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101949 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:473 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'8, mlcod=32'6)", 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.873454504000001, 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034165060000000001, 2024-04-24T13:31:31.418 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485338+0000", 2024-04-24T13:31:31.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.573e-06 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485350+0000", 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485377+0000", 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6897e-05 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485397+0000", 2024-04-24T13:31:31.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9287999999999999e-05 2024-04-24T13:31:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485521+0000", 2024-04-24T13:31:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012448 2024-04-24T13:31:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485572+0000", 2024-04-24T13:31:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0704000000000001e-05 2024-04-24T13:31:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488640+0000", 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030685589999999998 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488753+0000", 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112682 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:474 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'9, mlcod=32'6)", 2024-04-24T13:31:31.422 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.871084746999998, 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045500480000000001, 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487708+0000", 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4389999999999999e-06 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487718+0000", 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0386e-05 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487743+0000", 2024-04-24T13:31:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5106999999999999e-05 2024-04-24T13:31:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487762+0000", 2024-04-24T13:31:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8348000000000001e-05 2024-04-24T13:31:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487893+0000", 2024-04-24T13:31:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130968 2024-04-24T13:31:31.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487926+0000", 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3827e-05 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492194+0000", 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042671499999999999 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492256+0000", 2024-04-24T13:31:31.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2823000000000005e-05 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:476 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.870292874999997, 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059105989999999999, 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488500+0000", 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4169999999999999e-06 2024-04-24T13:31:31.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488510+0000", 2024-04-24T13:31:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0462000000000001e-05 2024-04-24T13:31:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488536+0000", 2024-04-24T13:31:31.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6007e-05 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488553+0000", 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7037999999999998e-05 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488752+0000", 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019892900000000001 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488805+0000", 2024-04-24T13:31:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2800999999999998e-05 2024-04-24T13:31:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494315+0000", 2024-04-24T13:31:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055099650000000003 2024-04-24T13:31:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494409+0000", 2024-04-24T13:31:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3980000000000005e-05 2024-04-24T13:31:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'7)", 2024-04-24T13:31:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:31:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.867317041, 2024-04-24T13:31:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055780020000000003, 2024-04-24T13:31:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.432 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:31:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:31:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491476+0000", 2024-04-24T13:31:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8479999999999999e-06 2024-04-24T13:31:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491503+0000", 2024-04-24T13:31:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7189e-05 2024-04-24T13:31:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491534+0000", 2024-04-24T13:31:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1222e-05 2024-04-24T13:31:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491553+0000", 2024-04-24T13:31:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9069e-05 2024-04-24T13:31:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491769+0000", 2024-04-24T13:31:31.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000215479 2024-04-24T13:31:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491830+0000", 2024-04-24T13:31:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1169999999999999e-05 2024-04-24T13:31:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.496974+0000", 2024-04-24T13:31:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051441860000000002 2024-04-24T13:31:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497052+0000", 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7838999999999998e-05 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:484 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'11, mlcod=32'8)", 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.86138768, 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022050070000000001, 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.437 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:31:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:31:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497405+0000", 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5889999999999999e-06 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497418+0000", 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2700999999999999e-05 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497449+0000", 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0911000000000003e-05 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497473+0000", 2024-04-24T13:31:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4326000000000001e-05 2024-04-24T13:31:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497563+0000", 2024-04-24T13:31:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9652000000000002e-05 2024-04-24T13:31:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497589+0000", 2024-04-24T13:31:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6669000000000002e-05 2024-04-24T13:31:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499542+0000", 2024-04-24T13:31:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019529180000000001 2024-04-24T13:31:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499608+0000", 2024-04-24T13:31:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6241000000000005e-05 2024-04-24T13:31:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:511 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'3, mlcod=32'1)", 2024-04-24T13:31:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:31:31.442 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.846337753999997, 2024-04-24T13:31:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020247519999999999, 2024-04-24T13:31:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:31:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:31:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512455+0000", 2024-04-24T13:31:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.463e-06 2024-04-24T13:31:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512464+0000", 2024-04-24T13:31:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.397e-06 2024-04-24T13:31:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512488+0000", 2024-04-24T13:31:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3502e-05 2024-04-24T13:31:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512499+0000", 2024-04-24T13:31:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0908e-05 2024-04-24T13:31:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512620+0000", 2024-04-24T13:31:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012119 2024-04-24T13:31:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512672+0000", 2024-04-24T13:31:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2366e-05 2024-04-24T13:31:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514389+0000", 2024-04-24T13:31:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017172890000000001 2024-04-24T13:31:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514478+0000", 2024-04-24T13:31:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8636999999999999e-05 2024-04-24T13:31:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.447 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:544 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'12, mlcod=32'10)", 2024-04-24T13:31:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:31:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.821179829999998, 2024-04-24T13:31:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020839690000000002, 2024-04-24T13:31:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537613+0000", 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7710000000000001e-06 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537627+0000", 2024-04-24T13:31:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3580999999999999e-05 2024-04-24T13:31:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537658+0000", 2024-04-24T13:31:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1470999999999997e-05 2024-04-24T13:31:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537680+0000", 2024-04-24T13:31:31.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1447e-05 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537779+0000", 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9049000000000007e-05 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537822+0000", 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3815e-05 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539590+0000", 2024-04-24T13:31:31.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017677459999999999 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539695+0000", 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105089 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:552 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'13, mlcod=32'11)", 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.814038656999998, 2024-04-24T13:31:31.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031853350000000001, 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544754+0000", 2024-04-24T13:31:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309999999999999e-06 2024-04-24T13:31:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544769+0000", 2024-04-24T13:31:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4259e-05 2024-04-24T13:31:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544803+0000", 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4650000000000002e-05 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544822+0000", 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8700999999999999e-05 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544956+0000", 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134482 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544991+0000", 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4953000000000002e-05 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547847+0000", 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028556749999999998 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547938+0000", 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0784000000000004e-05 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.456 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:705 6.1f e32/26 6:f93251ce:::obj_delete_at_hint.0000000042:head v 32'7, mlcod=32'5)", 2024-04-24T13:31:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:31:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.68132095, 2024-04-24T13:31:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018230220000000001, 2024-04-24T13:31:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677472+0000", 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677483+0000", 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1025e-05 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677510+0000", 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6894e-05 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677522+0000", 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2367e-05 2024-04-24T13:31:31.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677616+0000", 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4239000000000004e-05 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677656+0000", 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9681999999999997e-05 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679172+0000", 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015157529999999999 2024-04-24T13:31:31.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679293+0000", 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012133099999999999 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:709 6.1e e32/26 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 32'1, mlcod=0'0)", 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.670903279000001, 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020442059999999998, 2024-04-24T13:31:31.461 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.89e-07 2024-04-24T13:31:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687895+0000", 2024-04-24T13:31:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9959999999999996e-06 2024-04-24T13:31:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687919+0000", 2024-04-24T13:31:31.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3455000000000002e-05 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687931+0000", 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2442e-05 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688076+0000", 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014435399999999999 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688127+0000", 2024-04-24T13:31:31.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1910999999999998e-05 2024-04-24T13:31:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689827+0000", 2024-04-24T13:31:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00169918 2024-04-24T13:31:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689932+0000", 2024-04-24T13:31:31.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105379 2024-04-24T13:31:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:31.466 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:31.466 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:31.467 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:31:31.467 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:31:31.468 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:31.465+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:31.469 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:31.569 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:31.563+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:31.613 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:31.613 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:31.629 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:31.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:31.640 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:31.640 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:31.640 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:31.640 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:31.645 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:31.645 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:31.654 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:31.661 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:31.661 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:31.669 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:31.665+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:31.678 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:31.678 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:31.698 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:31.698 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:31.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:31.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:31.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:31.737 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:31.794 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:31.793+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:31.822 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:31.822 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:31.837 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:31.871 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:31.869+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:31.959 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:31.959 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:31.972 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:31.969+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:31.973 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:32.073 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:32.071+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:32.119 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:32.119 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:32.133 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:32.182 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:32.181+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:32.244 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:32.245 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:32.258 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:32.274 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:32.271+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:32.350 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:31:32.375 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:32.373+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:32.427 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:32.428 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:32.440 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:32.486 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:32.485+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:32.571 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:32.571 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:32.577 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:32.573+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:32.585 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:32.678 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:32.677+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:32.743 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:32.743 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:32.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:32.779 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:32.779+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:32.880 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:32.877+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:32.915 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:32.916 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:32.929 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:33.018 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:33.017+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:33.082 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:33.077+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:33.094 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:33.095 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:33.109 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:33.183 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:33.179+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:33.274 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:33.283 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:33.279+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:33.289 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:33.383 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:33.379+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:33.408 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:33.421 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:31:33.485 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:33.483+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:33.532 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:33.532 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:33.546 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:31:33.585 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:33.583+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:33.658 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:33.658 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:33.671 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:31:33.686 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:33.683+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:33.754 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:31:33.780 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:33.780 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:33.787 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:33.783+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:33.793 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:31:33.887 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:33.885+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:33.895 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:33.895 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:33.912 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:33.912 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:33.924 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:33.924 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:33.929 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:33.929 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:33.939 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:31:33.946 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:33.947 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:33.964 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:33.964 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:33.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:33.981 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:33.989 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:33.985+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:33.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:33.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:34.017 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:34.017 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:34.058 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:34.058 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:34.058 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:34.058 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:34.058 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:34.072 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:31:34.090 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:34.089+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:34.190 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:34.187+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:34.201 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:34.201 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:34.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:34.201 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:34.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.201 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:31:34.201 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:34.201 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.971457498000007, 2024-04-24T13:31:34.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020457065, 2024-04-24T13:31:34.201 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.202 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.202 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-24T13:31:34.202 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.202 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.202 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.202 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-24T13:31:34.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.202 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:34.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:31:34.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225903+0000", 2024-04-24T13:31:34.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7100000000000001e-06 2024-04-24T13:31:34.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225922+0000", 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8919999999999998e-05 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225960+0000", 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7240000000000003e-05 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225987+0000", 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6919000000000001e-05 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226300+0000", 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000313701 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226317+0000", 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6463000000000001e-05 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231091+0000", 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047739169999999999 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:31:34.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231111+0000", 2024-04-24T13:31:34.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0605999999999999e-05 2024-04-24T13:31:34.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246073+0000", 2024-04-24T13:31:34.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014961264 2024-04-24T13:31:34.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246357+0000", 2024-04-24T13:31:34.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028432499999999999 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 64.930317850999998, 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056987720000000004, 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267040+0000", 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3e-07 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267050+0000", 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8560000000000002e-06 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267205+0000", 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520200000000001 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267244+0000", 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8587000000000002e-05 2024-04-24T13:31:34.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267346+0000", 2024-04-24T13:31:34.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010223200000000001 2024-04-24T13:31:34.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267374+0000", 2024-04-24T13:31:34.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8214000000000001e-05 2024-04-24T13:31:34.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272631+0000", 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052563089999999998 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272738+0000", 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107642 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:47 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'2, mlcod=0'0)", 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:34.211 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 64.916407094999997, 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052089900000000001, 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:31:34.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280951+0000", 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7199999999999997e-07 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280962+0000", 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1094000000000001e-05 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280981+0000", 2024-04-24T13:31:34.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9066e-05 2024-04-24T13:31:34.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280999+0000", 2024-04-24T13:31:34.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8148e-05 2024-04-24T13:31:34.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281144+0000", 2024-04-24T13:31:34.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014454999999999999 2024-04-24T13:31:34.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281190+0000", 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5649000000000003e-05 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286063+0000", 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048732549999999999 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286159+0000", 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6355999999999997e-05 2024-04-24T13:31:34.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.216 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.216 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.216 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.216 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:34.216 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.895019214000001, 2024-04-24T13:31:34.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010258288000000001, 2024-04-24T13:31:34.216 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.216 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.216 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302342+0000", 2024-04-24T13:31:34.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6059999999999999e-06 2024-04-24T13:31:34.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302357+0000", 2024-04-24T13:31:34.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5201999999999999e-05 2024-04-24T13:31:34.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302393+0000", 2024-04-24T13:31:34.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6386e-05 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302411+0000", 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7864999999999999e-05 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302544+0000", 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132526 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302554+0000", 2024-04-24T13:31:34.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0479000000000001e-05 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309290+0000", 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006735937 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309474+0000", 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000183981 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309873+0000", 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000398618 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.311131+0000", 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012578929999999999 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312443+0000", 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001312648 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312535+0000", 2024-04-24T13:31:34.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1620999999999996e-05 2024-04-24T13:31:34.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312596+0000", 2024-04-24T13:31:34.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1525999999999993e-05 2024-04-24T13:31:34.222 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.222 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.222 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.222 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:232 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.810724327000003, 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035352830000000002, 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 232 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386633+0000", 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386636+0000", 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8329999999999998e-06 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386649+0000", 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3586e-05 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386681+0000", 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1529000000000003e-05 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386697+0000", 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6412000000000001e-05 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.386869+0000", 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000171998 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.387124+0000", 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025514 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.387553+0000", 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000428758 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.389079+0000", 2024-04-24T13:31:34.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015254089999999999 2024-04-24T13:31:34.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390010+0000", 2024-04-24T13:31:34.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00093115799999999996 2024-04-24T13:31:34.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390099+0000", 2024-04-24T13:31:34.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8826999999999995e-05 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.390168+0000", 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9633000000000002e-05 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:283 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.783366287, 2024-04-24T13:31:34.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040489189999999998, 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 283 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413991+0000", 2024-04-24T13:31:34.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.413993+0000", 2024-04-24T13:31:34.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0770000000000002e-06 2024-04-24T13:31:34.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414006+0000", 2024-04-24T13:31:34.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2696e-05 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414031+0000", 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5639999999999998e-05 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414046+0000", 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4412e-05 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414206+0000", 2024-04-24T13:31:34.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015972299999999999 2024-04-24T13:31:34.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.414646+0000", 2024-04-24T13:31:34.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000440023 2024-04-24T13:31:34.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.415227+0000", 2024-04-24T13:31:34.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00058130599999999997 2024-04-24T13:31:34.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.416668+0000", 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00144118 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417911+0000", 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012426690000000001 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417980+0000", 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8942999999999994e-05 2024-04-24T13:31:34.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.418040+0000", 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0250000000000001e-05 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:299 6.14 e32/26 6:2c0c0c23:reshard::reshard.0000000001:head v 32'2, mlcod=0'0)", 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.780158106000002, 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033212430000000002, 2024-04-24T13:31:34.234 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417199+0000", 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417201+0000", 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.784e-06 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417216+0000", 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5464999999999998e-05 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417238+0000", 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1474000000000001e-05 2024-04-24T13:31:34.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417254+0000", 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5954999999999999e-05 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417425+0000", 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017128799999999999 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.417457+0000", 2024-04-24T13:31:34.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1844000000000002e-05 2024-04-24T13:31:34.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.420406+0000", 2024-04-24T13:31:34.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002948895 2024-04-24T13:31:34.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.420520+0000", 2024-04-24T13:31:34.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011453799999999999 2024-04-24T13:31:34.238 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.238 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.238 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:319 6.e 6:703a9e16:::obj_delete_at_hint.0000000002:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.778167541999998, 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040866640000000003, 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 319 2024-04-24T13:31:34.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419190+0000", 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419192+0000", 2024-04-24T13:31:34.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8759999999999999e-06 2024-04-24T13:31:34.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419217+0000", 2024-04-24T13:31:34.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5077000000000001e-05 2024-04-24T13:31:34.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419247+0000", 2024-04-24T13:31:34.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0054000000000001e-05 2024-04-24T13:31:34.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419262+0000", 2024-04-24T13:31:34.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4885000000000001e-05 2024-04-24T13:31:34.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419410+0000", 2024-04-24T13:31:34.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148701 2024-04-24T13:31:34.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419603+0000", 2024-04-24T13:31:34.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019235899999999999 2024-04-24T13:31:34.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.419892+0000", 2024-04-24T13:31:34.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028910699999999998 2024-04-24T13:31:34.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.421211+0000", 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013190599999999999 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423024+0000", 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001812971 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423184+0000", 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000160323 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.423276+0000", 2024-04-24T13:31:34.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2250999999999995e-05 2024-04-24T13:31:34.245 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.245 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.245 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.245 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:505 6.1a 6:5c7e8a6d:reshard::reshard.0000000015:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.245 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:34.245 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.690608107000003, 2024-04-24T13:31:34.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031283859999999999, 2024-04-24T13:31:34.245 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 505 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506749+0000", 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506752+0000", 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7630000000000001e-06 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506764+0000", 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2318e-05 2024-04-24T13:31:34.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506794+0000", 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9674000000000001e-05 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506811+0000", 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7507e-05 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.506914+0000", 2024-04-24T13:31:34.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010252 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.507140+0000", 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022651999999999999 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.507604+0000", 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046387099999999998 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.508700+0000", 2024-04-24T13:31:34.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010960200000000001 2024-04-24T13:31:34.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509671+0000", 2024-04-24T13:31:34.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000970754 2024-04-24T13:31:34.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509777+0000", 2024-04-24T13:31:34.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105664 2024-04-24T13:31:34.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.509878+0000", 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100775 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:545 6.2 6:479ba34f:::obj_delete_at_hint.0000000021:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.658745865, 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003146893, 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.251 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 545 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538611+0000", 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538614+0000", 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5790000000000002e-06 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538627+0000", 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2536e-05 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538657+0000", 2024-04-24T13:31:34.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0363000000000001e-05 2024-04-24T13:31:34.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538673+0000", 2024-04-24T13:31:34.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5735000000000001e-05 2024-04-24T13:31:34.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.538782+0000", 2024-04-24T13:31:34.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010905599999999999 2024-04-24T13:31:34.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539002+0000", 2024-04-24T13:31:34.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022079900000000001 2024-04-24T13:31:34.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:34.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539510+0000", 2024-04-24T13:31:34.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00050796700000000001 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.540770+0000", 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012598850000000001 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541525+0000", 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075419500000000004 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541678+0000", 2024-04-24T13:31:34.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153258 2024-04-24T13:31:34.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.541758+0000", 2024-04-24T13:31:34.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0519999999999995e-05 2024-04-24T13:31:34.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.257 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.258 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:631 6.1a 6:5ae4284b:::obj_delete_at_hint.0000000032:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.258 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:34.258 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.584664642, 2024-04-24T13:31:34.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003398257, 2024-04-24T13:31:34.258 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.258 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.258 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.258 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 631 2024-04-24T13:31:34.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.259 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:34.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612693+0000", 2024-04-24T13:31:34.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612695+0000", 2024-04-24T13:31:34.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7300000000000001e-06 2024-04-24T13:31:34.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612708+0000", 2024-04-24T13:31:34.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2808e-05 2024-04-24T13:31:34.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612741+0000", 2024-04-24T13:31:34.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2676999999999999e-05 2024-04-24T13:31:34.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612757+0000", 2024-04-24T13:31:34.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6611000000000001e-05 2024-04-24T13:31:34.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.612924+0000", 2024-04-24T13:31:34.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016621 2024-04-24T13:31:34.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.613299+0000", 2024-04-24T13:31:34.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037503299999999999 2024-04-24T13:31:34.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:34.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.613869+0000", 2024-04-24T13:31:34.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057067299999999995 2024-04-24T13:31:34.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615041+0000", 2024-04-24T13:31:34.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001171248 2024-04-24T13:31:34.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615795+0000", 2024-04-24T13:31:34.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000754785 2024-04-24T13:31:34.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.615967+0000", 2024-04-24T13:31:34.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017142200000000001 2024-04-24T13:31:34.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.616091+0000", 2024-04-24T13:31:34.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012406 2024-04-24T13:31:34.265 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.265 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.265 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.265 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:647 6.e 6:75339078:::obj_delete_at_hint.0000000034:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.266 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:34.266 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.571656365000003, 2024-04-24T13:31:34.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028765370000000002, 2024-04-24T13:31:34.266 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.266 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.266 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.266 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.266 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.266 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.266 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 647 2024-04-24T13:31:34.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.266 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:34.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625701+0000", 2024-04-24T13:31:34.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625703+0000", 2024-04-24T13:31:34.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9850000000000001e-06 2024-04-24T13:31:34.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625713+0000", 2024-04-24T13:31:34.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8279999999999998e-06 2024-04-24T13:31:34.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625740+0000", 2024-04-24T13:31:34.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7174000000000001e-05 2024-04-24T13:31:34.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625760+0000", 2024-04-24T13:31:34.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9966000000000002e-05 2024-04-24T13:31:34.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.625912+0000", 2024-04-24T13:31:34.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151815 2024-04-24T13:31:34.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.626278+0000", 2024-04-24T13:31:34.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036677200000000002 2024-04-24T13:31:34.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.626837+0000", 2024-04-24T13:31:34.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055886 2024-04-24T13:31:34.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628073+0000", 2024-04-24T13:31:34.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001235877 2024-04-24T13:31:34.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628338+0000", 2024-04-24T13:31:34.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026515499999999999 2024-04-24T13:31:34.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628479+0000", 2024-04-24T13:31:34.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014045799999999999 2024-04-24T13:31:34.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.628577+0000", 2024-04-24T13:31:34.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8647000000000006e-05 2024-04-24T13:31:34.272 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.272 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:709 6.1e 6:7af5a05b:::obj_delete_at_hint.0000000044:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.510424432000001, 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034770059999999999, 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 709 2024-04-24T13:31:34.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.274 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:34.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686933+0000", 2024-04-24T13:31:34.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686935+0000", 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4760000000000001e-06 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686948+0000", 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2846e-05 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686979+0000", 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0987e-05 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.686995+0000", 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5580999999999999e-05 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687121+0000", 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012667399999999999 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687328+0000", 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000206741 2024-04-24T13:31:34.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687614+0000", 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028608300000000002 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688763+0000", 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001148533 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690207+0000", 2024-04-24T13:31:34.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00144458 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690293+0000", 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5858000000000004e-05 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.690410+0000", 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116647 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:727 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.471169768999999, 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029468519999999998, 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 727 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.279 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726187+0000", 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726190+0000", 2024-04-24T13:31:34.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.26e-06 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726201+0000", 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1615e-05 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726233+0000", 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1547000000000001e-05 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726252+0000", 2024-04-24T13:31:34.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8681e-05 2024-04-24T13:31:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726381+0000", 2024-04-24T13:31:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012944000000000001 2024-04-24T13:31:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726611+0000", 2024-04-24T13:31:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023025500000000001 2024-04-24T13:31:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.726950+0000", 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033885399999999998 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.728086+0000", 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011360039999999999 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.728982+0000", 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00089614899999999995 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.729067+0000", 2024-04-24T13:31:34.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4968000000000004e-05 2024-04-24T13:31:34.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.729134+0000", 2024-04-24T13:31:34.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7078999999999999e-05 2024-04-24T13:31:34.284 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.284 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.284 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.284 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:729 6.17 6:ec529b31:::obj_delete_at_hint.0000000050:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.467088863000001, 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030005850000000001, 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 729 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730268+0000", 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730270+0000", 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8059999999999999e-06 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730278+0000", 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2789999999999998e-06 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730298+0000", 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9488e-05 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730309+0000", 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1294999999999999e-05 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730436+0000", 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012690999999999999 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.730677+0000", 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000241275 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.731167+0000", 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048962799999999998 2024-04-24T13:31:34.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.732344+0000", 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011773619999999999 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733135+0000", 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000790213 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733209+0000", 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4488999999999998e-05 2024-04-24T13:31:34.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.733269+0000", 2024-04-24T13:31:34.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9840000000000003e-05 2024-04-24T13:31:34.290 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.290 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.290 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.290 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:814 6.1e 6:7a480f67:::obj_delete_at_hint.0000000079:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.290 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:34.290 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.281311565000003, 2024-04-24T13:31:34.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034749830000000001, 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 814 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916046+0000", 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916048+0000", 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2330000000000001e-06 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916059+0000", 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1266e-05 2024-04-24T13:31:34.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916090+0000", 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0993e-05 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916109+0000", 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8751999999999999e-05 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916265+0000", 2024-04-24T13:31:34.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015573 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.916632+0000", 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367597 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.917180+0000", 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054785599999999999 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.918555+0000", 2024-04-24T13:31:34.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001374781 2024-04-24T13:31:34.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919250+0000", 2024-04-24T13:31:34.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069470700000000003 2024-04-24T13:31:34.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919404+0000", 2024-04-24T13:31:34.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015483000000000001 2024-04-24T13:31:34.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.919521+0000", 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011623799999999999 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:880 6.e 6:76853009:::obj_delete_at_hint.0000000101:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.126479736, 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029290919999999999, 2024-04-24T13:31:34.296 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.297 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.297 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.297 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.297 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.297 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.297 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 880 2024-04-24T13:31:34.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.297 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:34.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070878+0000", 2024-04-24T13:31:34.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070880+0000", 2024-04-24T13:31:34.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8660000000000002e-06 2024-04-24T13:31:34.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070911+0000", 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0783e-05 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070942+0000", 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0979999999999998e-05 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.070958+0000", 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5858999999999998e-05 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071120+0000", 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016239999999999999 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071370+0000", 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000249301 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.071695+0000", 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00032495000000000001 2024-04-24T13:31:34.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.072963+0000", 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001268443 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073655+0000", 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069215800000000001 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073741+0000", 2024-04-24T13:31:34.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5731999999999998e-05 2024-04-24T13:31:34.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.073807+0000", 2024-04-24T13:31:34.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5619999999999999e-05 2024-04-24T13:31:34.302 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.302 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.302 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.302 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:883 6.17 6:ece66ccb:::obj_delete_at_hint.0000000102:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.302 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:34.302 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.119138616999997, 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002986266, 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 883 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:34.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078219+0000", 2024-04-24T13:31:34.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078221+0000", 2024-04-24T13:31:34.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.889e-06 2024-04-24T13:31:34.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078230+0000", 2024-04-24T13:31:34.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5990000000000008e-06 2024-04-24T13:31:34.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078261+0000", 2024-04-24T13:31:34.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1080000000000001e-05 2024-04-24T13:31:34.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078280+0000", 2024-04-24T13:31:34.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8678999999999999e-05 2024-04-24T13:31:34.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078405+0000", 2024-04-24T13:31:34.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012481699999999999 2024-04-24T13:31:34.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078649+0000", 2024-04-24T13:31:34.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000244045 2024-04-24T13:31:34.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.078997+0000", 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000347821 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.080294+0000", 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012972470000000001 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081048+0000", 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075421500000000003 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081136+0000", 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8184999999999997e-05 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.081205+0000", 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8689000000000006e-05 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.308 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:925 6.e 6:72a25e0e:::obj_delete_at_hint.0000000116:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.023100993, 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003313323, 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 925 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174256+0000", 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174258+0000", 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2170000000000001e-06 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174270+0000", 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1185e-05 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174301+0000", 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1167000000000002e-05 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174316+0000", 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5398000000000001e-05 2024-04-24T13:31:34.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174471+0000", 2024-04-24T13:31:34.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015502800000000001 2024-04-24T13:31:34.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.174834+0000", 2024-04-24T13:31:34.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036226299999999998 2024-04-24T13:31:34.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.175395+0000", 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00056120499999999995 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.176785+0000", 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001390584 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177301+0000", 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00051609300000000002 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177459+0000", 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015735400000000001 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.177570+0000", 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011082900000000001 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:928 6.1e 6:7adbb485:::obj_delete_at_hint.0000000117:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:34.314 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.015829463000003, 2024-04-24T13:31:34.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030825470000000002, 2024-04-24T13:31:34.315 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.315 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.315 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.315 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.315 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.315 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.315 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 928 2024-04-24T13:31:34.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.315 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181528+0000", 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181530+0000", 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.75e-06 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181539+0000", 2024-04-24T13:31:34.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0350000000000007e-06 2024-04-24T13:31:34.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181565+0000", 2024-04-24T13:31:34.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6523999999999999e-05 2024-04-24T13:31:34.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181579+0000", 2024-04-24T13:31:34.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3732e-05 2024-04-24T13:31:34.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.181703+0000", 2024-04-24T13:31:34.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012400099999999999 2024-04-24T13:31:34.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.182049+0000", 2024-04-24T13:31:34.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000346461 2024-04-24T13:31:34.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:34.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.182596+0000", 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054673999999999999 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.183810+0000", 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001213769 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184460+0000", 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00065003000000000001 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184543+0000", 2024-04-24T13:31:34.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3545000000000001e-05 2024-04-24T13:31:34.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.184610+0000", 2024-04-24T13:31:34.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6959999999999996e-05 2024-04-24T13:31:34.320 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.320 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.320 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.320 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.320 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.320 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:34.322 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:34.322 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:34.319+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:34.376 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:31:34.422 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:34.421+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:34.492 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:34.493 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:34.493 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:34.493 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:34.507 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:34.523 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:34.521+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:34.624 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:34.619+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:34.625 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:34.625 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:34.625 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:34.625 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:34.625 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:34.639 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:34.726 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:34.723+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:34.804 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:34.804 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:34.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:34.804 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:34.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.805 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:34.805 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:34.805 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 69.530227550999996, 2024-04-24T13:31:34.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003286134, 2024-04-24T13:31:34.805 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.805 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.805 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.805 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.805 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4440", 2024-04-24T13:31:34.805 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:34.805 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:31:34.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.805 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:34.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:34.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270374+0000", 2024-04-24T13:31:34.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9130000000000001e-06 2024-04-24T13:31:34.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270384+0000", 2024-04-24T13:31:34.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0023e-05 2024-04-24T13:31:34.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270410+0000", 2024-04-24T13:31:34.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5483e-05 2024-04-24T13:31:34.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270426+0000", 2024-04-24T13:31:34.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6413e-05 2024-04-24T13:31:34.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270524+0000", 2024-04-24T13:31:34.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8314999999999996e-05 2024-04-24T13:31:34.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270704+0000", 2024-04-24T13:31:34.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017929 2024-04-24T13:31:34.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:34.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270950+0000", 2024-04-24T13:31:34.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024601000000000001 2024-04-24T13:31:34.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.272837+0000", 2024-04-24T13:31:34.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018874600000000001 2024-04-24T13:31:34.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273498+0000", 2024-04-24T13:31:34.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066062100000000002 2024-04-24T13:31:34.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273589+0000", 2024-04-24T13:31:34.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.098e-05 2024-04-24T13:31:34.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273658+0000", 2024-04-24T13:31:34.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9626e-05 2024-04-24T13:31:34.811 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.811 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.811 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.811 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:34.811 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:34.811 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.521437683000002, 2024-04-24T13:31:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048388950000000002, 2024-04-24T13:31:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-24T13:31:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:34.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:34.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:31:34.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3799999999999998e-06 2024-04-24T13:31:34.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279193+0000", 2024-04-24T13:31:34.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7674e-05 2024-04-24T13:31:34.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279224+0000", 2024-04-24T13:31:34.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0654000000000002e-05 2024-04-24T13:31:34.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279244+0000", 2024-04-24T13:31:34.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279426+0000", 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018255300000000001 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279717+0000", 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029043800000000001 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279993+0000", 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276786 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282898+0000", 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002904093 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283731+0000", 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00083382599999999997 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283886+0000", 2024-04-24T13:31:34.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015512600000000001 2024-04-24T13:31:34.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284001+0000", 2024-04-24T13:31:34.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114405 2024-04-24T13:31:34.817 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.817 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.817 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.818 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410010339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:34.818 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:34.818 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.516313088000004, 2024-04-24T13:31:34.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044116340000000002, 2024-04-24T13:31:34.818 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.818 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.818 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.818 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-24T13:31:34.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.819 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:34.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:34.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284289+0000", 2024-04-24T13:31:34.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.125e-06 2024-04-24T13:31:34.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284299+0000", 2024-04-24T13:31:34.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0485999999999999e-05 2024-04-24T13:31:34.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284330+0000", 2024-04-24T13:31:34.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0528000000000003e-05 2024-04-24T13:31:34.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284345+0000", 2024-04-24T13:31:34.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4883e-05 2024-04-24T13:31:34.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284484+0000", 2024-04-24T13:31:34.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139708 2024-04-24T13:31:34.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284655+0000", 2024-04-24T13:31:34.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170953 2024-04-24T13:31:34.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284981+0000", 2024-04-24T13:31:34.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000325648 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.287326+0000", 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023452709999999999 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288427+0000", 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001100544 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288551+0000", 2024-04-24T13:31:34.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012466500000000001 2024-04-24T13:31:34.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288698+0000", 2024-04-24T13:31:34.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146823 2024-04-24T13:31:34.824 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.824 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.824 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.824 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-24T13:31:34.824 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.537100203000001, 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047820809999999997, 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:34.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:34.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263503+0000", 2024-04-24T13:31:34.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.039e-06 2024-04-24T13:31:34.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263520+0000", 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7198e-05 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263548+0000", 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8158e-05 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263565+0000", 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7008e-05 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263754+0000", 2024-04-24T13:31:34.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001894 2024-04-24T13:31:34.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263973+0000", 2024-04-24T13:31:34.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218593 2024-04-24T13:31:34.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.264373+0000", 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040043400000000002 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.266377+0000", 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020033030000000001 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268121+0000", 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017441049999999999 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268212+0000", 2024-04-24T13:31:34.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1490000000000007e-05 2024-04-24T13:31:34.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268282+0000", 2024-04-24T13:31:34.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9352999999999998e-05 2024-04-24T13:31:34.830 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.830 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.830 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.830 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.830 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.457388051000002, 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034252639999999999, 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 220 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343214+0000", 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343227+0000", 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2941e-05 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343259+0000", 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1557000000000003e-05 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343274+0000", 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5401999999999999e-05 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343455+0000", 2024-04-24T13:31:34.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018068700000000001 2024-04-24T13:31:34.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343694+0000", 2024-04-24T13:31:34.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238552 2024-04-24T13:31:34.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:34.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.344088+0000", 2024-04-24T13:31:34.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039456400000000003 2024-04-24T13:31:34.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.345723+0000", 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016349139999999999 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346480+0000", 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075738300000000004 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346569+0000", 2024-04-24T13:31:34.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8281000000000004e-05 2024-04-24T13:31:34.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346637+0000", 2024-04-24T13:31:34.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8165999999999998e-05 2024-04-24T13:31:34.836 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.836 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.836 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.836 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.836 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:34.837 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.446694675000003, 2024-04-24T13:31:34.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032680679999999998, 2024-04-24T13:31:34.837 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.837 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.837 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.837 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.837 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.837 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.837 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 223 2024-04-24T13:31:34.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.837 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:34.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:34.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353907+0000", 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1560000000000002e-06 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353918+0000", 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0669000000000001e-05 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353948+0000", 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0329999999999999e-05 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353963+0000", 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4989e-05 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354076+0000", 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112704 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354300+0000", 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022397000000000001 2024-04-24T13:31:34.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354729+0000", 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042914100000000002 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356223+0000", 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001494219 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356972+0000", 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00074910099999999996 2024-04-24T13:31:34.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357059+0000", 2024-04-24T13:31:34.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6624000000000003e-05 2024-04-24T13:31:34.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357173+0000", 2024-04-24T13:31:34.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114165 2024-04-24T13:31:34.842 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.842 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.842 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.439647753999999, 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032957419999999999, 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.843 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:34.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:34.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360954+0000", 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.154e-06 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360965+0000", 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1321999999999999e-05 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360996+0000", 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0902999999999999e-05 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361012+0000", 2024-04-24T13:31:34.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:31:34.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361185+0000", 2024-04-24T13:31:34.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172072 2024-04-24T13:31:34.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361404+0000", 2024-04-24T13:31:34.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021965999999999999 2024-04-24T13:31:34.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361852+0000", 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000448276 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.363340+0000", 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001487169 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364094+0000", 2024-04-24T13:31:34.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075443699999999995 2024-04-24T13:31:34.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364184+0000", 2024-04-24T13:31:34.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9957000000000006e-05 2024-04-24T13:31:34.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364248+0000", 2024-04-24T13:31:34.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3627000000000006e-05 2024-04-24T13:31:34.848 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.848 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.849 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.849 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:34.849 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.436082906999999, 2024-04-24T13:31:34.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036426480000000001, 2024-04-24T13:31:34.849 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.849 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.849 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.849 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.850 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-24T13:31:34.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.850 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:34.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364519+0000", 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364529+0000", 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088999999999999e-05 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364554+0000", 2024-04-24T13:31:34.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5537e-05 2024-04-24T13:31:34.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364568+0000", 2024-04-24T13:31:34.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3372e-05 2024-04-24T13:31:34.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364726+0000", 2024-04-24T13:31:34.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015809299999999999 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365059+0000", 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000333185 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365758+0000", 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069934299999999995 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.367413+0000", 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016552349999999999 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368012+0000", 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059858700000000003 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368097+0000", 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5253999999999994e-05 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368159+0000", 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2113000000000007e-05 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.406696271000001, 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033998840000000002, 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.855 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.856 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.856 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.856 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.856 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-24T13:31:34.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.856 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:34.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:34.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393906+0000", 2024-04-24T13:31:34.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1569999999999998e-06 2024-04-24T13:31:34.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393917+0000", 2024-04-24T13:31:34.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1348999999999999e-05 2024-04-24T13:31:34.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393942+0000", 2024-04-24T13:31:34.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.527e-05 2024-04-24T13:31:34.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393957+0000", 2024-04-24T13:31:34.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4355999999999999e-05 2024-04-24T13:31:34.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394127+0000", 2024-04-24T13:31:34.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170555 2024-04-24T13:31:34.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394352+0000", 2024-04-24T13:31:34.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224539 2024-04-24T13:31:34.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394788+0000", 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043600099999999999 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.396137+0000", 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001349404 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397158+0000", 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001020738 2024-04-24T13:31:34.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397237+0000", 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9319000000000004e-05 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397303+0000", 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6196000000000001e-05 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.861 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:237 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.862 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:34.862 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.395829636000002, 2024-04-24T13:31:34.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003210517, 2024-04-24T13:31:34.862 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.862 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.863 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.863 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.863 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.863 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.863 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 237 2024-04-24T13:31:34.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.863 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404772+0000", 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1830000000000001e-06 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404783+0000", 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1009000000000001e-05 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404814+0000", 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0822999999999999e-05 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404829+0000", 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4808e-05 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404965+0000", 2024-04-24T13:31:34.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013637299999999999 2024-04-24T13:31:34.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405107+0000", 2024-04-24T13:31:34.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142108 2024-04-24T13:31:34.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405399+0000", 2024-04-24T13:31:34.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029117900000000003 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.406507+0000", 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011081000000000001 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407732+0000", 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001225163 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407866+0000", 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013405599999999999 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407981+0000", 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114715 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:430 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:34.868 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.342112739000001, 2024-04-24T13:31:34.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031779590000000002, 2024-04-24T13:31:34.869 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.869 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.869 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.869 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.869 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.869 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.869 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-24T13:31:34.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.869 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:34.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:34.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458489+0000", 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458525+0000", 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5743e-05 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458556+0000", 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0284e-05 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458576+0000", 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0449999999999999e-05 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458738+0000", 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016177699999999999 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459047+0000", 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030948400000000001 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459499+0000", 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045165199999999998 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461152+0000", 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001653477 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461528+0000", 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037554899999999998 2024-04-24T13:31:34.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461610+0000", 2024-04-24T13:31:34.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1914000000000002e-05 2024-04-24T13:31:34.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461665+0000", 2024-04-24T13:31:34.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5105999999999997e-05 2024-04-24T13:31:34.875 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.875 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.875 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.875 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.875 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:34.875 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.337855152000003, 2024-04-24T13:31:34.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031563120000000001, 2024-04-24T13:31:34.875 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 436 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462746+0000", 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8199999999999999e-06 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462756+0000", 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0005e-05 2024-04-24T13:31:34.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462778+0000", 2024-04-24T13:31:34.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1325e-05 2024-04-24T13:31:34.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462794+0000", 2024-04-24T13:31:34.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841e-05 2024-04-24T13:31:34.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462940+0000", 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014605099999999999 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463206+0000", 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026634500000000003 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463594+0000", 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038760299999999998 2024-04-24T13:31:34.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465323+0000", 2024-04-24T13:31:34.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00172898 2024-04-24T13:31:34.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465593+0000", 2024-04-24T13:31:34.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027055500000000001 2024-04-24T13:31:34.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465747+0000", 2024-04-24T13:31:34.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015391999999999999 2024-04-24T13:31:34.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465901+0000", 2024-04-24T13:31:34.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153867 2024-04-24T13:31:34.881 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.881 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.881 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.881 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:437 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.882 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:34.882 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.337072677000002, 2024-04-24T13:31:34.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048056540000000003, 2024-04-24T13:31:34.882 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.882 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.882 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.882 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.882 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.882 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.882 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 437 2024-04-24T13:31:34.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463529+0000", 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2479999999999999e-06 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463544+0000", 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463572+0000", 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8294e-05 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463590+0000", 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464092+0000", 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000502189 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464454+0000", 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036231300000000001 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:34.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464831+0000", 2024-04-24T13:31:34.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000377375 2024-04-24T13:31:34.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467473+0000", 2024-04-24T13:31:34.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026414659999999999 2024-04-24T13:31:34.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468185+0000", 2024-04-24T13:31:34.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071215199999999997 2024-04-24T13:31:34.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468271+0000", 2024-04-24T13:31:34.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5593999999999994e-05 2024-04-24T13:31:34.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468333+0000", 2024-04-24T13:31:34.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1957000000000003e-05 2024-04-24T13:31:34.887 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.888 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.888 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.888 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:531 6.4 e32/26 6:227f63b5:gc::gc.14:head v 32'13, mlcod=32'11)", 2024-04-24T13:31:34.888 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:34.888 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.275841583000002, 2024-04-24T13:31:34.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003260279, 2024-04-24T13:31:34.888 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.888 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.888 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.888 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:34.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:34.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524760+0000", 2024-04-24T13:31:34.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4720000000000001e-06 2024-04-24T13:31:34.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524771+0000", 2024-04-24T13:31:34.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1270000000000001e-05 2024-04-24T13:31:34.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524792+0000", 2024-04-24T13:31:34.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1566e-05 2024-04-24T13:31:34.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524805+0000", 2024-04-24T13:31:34.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2876e-05 2024-04-24T13:31:34.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524906+0000", 2024-04-24T13:31:34.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101084 2024-04-24T13:31:34.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524943+0000", 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6538000000000002e-05 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.527964+0000", 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030210229999999999 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.528018+0000", 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4450000000000002e-05 2024-04-24T13:31:34.893 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.894 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.894 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.894 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.894 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:34.894 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.038018049000001, 2024-04-24T13:31:34.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032103409999999998, 2024-04-24T13:31:34.894 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.894 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.894 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762584+0000", 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7039999999999999e-06 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762597+0000", 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2539e-05 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762629+0000", 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2116000000000002e-05 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762644+0000", 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5034999999999999e-05 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762801+0000", 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015653999999999999 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763192+0000", 2024-04-24T13:31:34.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000391529 2024-04-24T13:31:34.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763747+0000", 2024-04-24T13:31:34.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055497399999999996 2024-04-24T13:31:34.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.764931+0000", 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001184128 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765643+0000", 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071180500000000003 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765726+0000", 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3058000000000003e-05 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765792+0000", 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5913000000000004e-05 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.931422928000003, 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033442569999999998, 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.900 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 793 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:34.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869179+0000", 2024-04-24T13:31:34.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.323e-06 2024-04-24T13:31:34.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869190+0000", 2024-04-24T13:31:34.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-24T13:31:34.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869222+0000", 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1733999999999998e-05 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869237+0000", 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5044e-05 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869396+0000", 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158913 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869763+0000", 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367112 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.870319+0000", 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055558799999999998 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.871509+0000", 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001190607 2024-04-24T13:31:34.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872365+0000", 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085535299999999999 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872449+0000", 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3834999999999999e-05 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872521+0000", 2024-04-24T13:31:34.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2428999999999994e-05 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.745416556000002, 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003340754, 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.906 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.907 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.907 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 874 2024-04-24T13:31:34.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.907 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:34.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:34.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055185+0000", 2024-04-24T13:31:34.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:31:34.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055197+0000", 2024-04-24T13:31:34.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1606e-05 2024-04-24T13:31:34.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055229+0000", 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1603000000000002e-05 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055244+0000", 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4928e-05 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055397+0000", 2024-04-24T13:31:34.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015366499999999999 2024-04-24T13:31:34.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055763+0000", 2024-04-24T13:31:34.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036565600000000001 2024-04-24T13:31:34.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.056317+0000", 2024-04-24T13:31:34.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055436600000000004 2024-04-24T13:31:34.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.057678+0000", 2024-04-24T13:31:34.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001361283 2024-04-24T13:31:34.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058258+0000", 2024-04-24T13:31:34.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057942400000000004 2024-04-24T13:31:34.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058407+0000", 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000149188 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058524+0000", 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116805 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:34.912 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.740697826999998, 2024-04-24T13:31:34.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032622950000000001, 2024-04-24T13:31:34.913 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.913 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.913 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.913 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.913 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.913 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.913 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 876 2024-04-24T13:31:34.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.913 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:34.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:34.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059904+0000", 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.767e-06 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059912+0000", 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819999999999994e-06 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059934+0000", 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2141e-05 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059949+0000", 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4285e-05 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060072+0000", 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012349400000000001 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060302+0000", 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022971999999999999 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060787+0000", 2024-04-24T13:31:34.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048565400000000002 2024-04-24T13:31:34.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062208+0000", 2024-04-24T13:31:34.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014201870000000001 2024-04-24T13:31:34.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062946+0000", 2024-04-24T13:31:34.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073827699999999997 2024-04-24T13:31:34.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063036+0000", 2024-04-24T13:31:34.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9758000000000004e-05 2024-04-24T13:31:34.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063164+0000", 2024-04-24T13:31:34.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012852999999999999 2024-04-24T13:31:34.920 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.920 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.920 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.920 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:924 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.920 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:34.920 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.629766179999997, 2024-04-24T13:31:34.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030953729999999998, 2024-04-24T13:31:34.920 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 924 2024-04-24T13:31:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:34.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170836+0000", 2024-04-24T13:31:34.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1900000000000002e-06 2024-04-24T13:31:34.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170847+0000", 2024-04-24T13:31:34.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1109e-05 2024-04-24T13:31:34.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170879+0000", 2024-04-24T13:31:34.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2153000000000002e-05 2024-04-24T13:31:34.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170898+0000", 2024-04-24T13:31:34.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8785000000000001e-05 2024-04-24T13:31:34.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171030+0000", 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013210300000000001 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171294+0000", 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026387600000000002 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171790+0000", 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049596899999999997 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.172966+0000", 2024-04-24T13:31:34.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011761 2024-04-24T13:31:34.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173663+0000", 2024-04-24T13:31:34.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069701500000000005 2024-04-24T13:31:34.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173818+0000", 2024-04-24T13:31:34.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155427 2024-04-24T13:31:34.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173929+0000", 2024-04-24T13:31:34.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110646 2024-04-24T13:31:34.926 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.926 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.926 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.926 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:34.926 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 61.563754924000001, 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032803860000000002, 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 952 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:34.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236847+0000", 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236858+0000", 2024-04-24T13:31:34.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0582e-05 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236900+0000", 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2463000000000003e-05 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236923+0000", 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2938e-05 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:34.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237071+0000", 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014795100000000001 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237365+0000", 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000293963 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237755+0000", 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039032599999999998 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239124+0000", 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136918 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239925+0000", 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080016699999999996 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240011+0000", 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6780999999999995e-05 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:34.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:34.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240125+0000", 2024-04-24T13:31:34.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113862 2024-04-24T13:31:34.932 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.932 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.932 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.932 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:34.932 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:34.932 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:34.934 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:34.934 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:34.931+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:35.035 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:35.031+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:35.106 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:35.106 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:35.107 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:35.107 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:35.120 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:35.166 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:35.163+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:35.236 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:35.231+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:35.291 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:35.292 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:35.292 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:35.292 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:35.292 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:35.306 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:35.337 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:35.333+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:35.376 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:31:35.442 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:35.441+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:35.471 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:35.471 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:35.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:35.471 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:35.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.471 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:35.471 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:31:35.471 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.226154860999998, 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:31:35.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:31:35.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:31:35.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:31:35.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:31:35.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:31:35.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:31:35.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:31:35.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:31:35.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:31:35.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:31:35.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:31:35.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:35.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:31:35.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:31:35.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:35.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:31:35.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:31:35.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:31:35.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:31:35.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94410010338304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.191297147, 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077892999999999999, 2024-04-24T13:31:35.479 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2770000000000001e-06 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279179+0000", 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3529999999999999e-05 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279222+0000", 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2743000000000001e-05 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279272+0000", 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0649000000000002e-05 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279772+0000", 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000500013 2024-04-24T13:31:35.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280011+0000", 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023840499999999999 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280408+0000", 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039756999999999998 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282501+0000", 2024-04-24T13:31:35.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020929159999999998 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286583+0000", 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040820530000000004 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286748+0000", 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016431200000000001 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286951+0000", 2024-04-24T13:31:35.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020383200000000001 2024-04-24T13:31:35.485 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.485 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.485 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.485 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:35.485 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:31:35.485 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.178051154000002, 2024-04-24T13:31:35.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024753290000000001, 2024-04-24T13:31:35.485 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.485 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.485 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.486 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:35.486 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:35.486 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:35.486 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-24T13:31:35.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.486 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:31:35.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292410+0000", 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292419+0000", 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8680000000000005e-06 2024-04-24T13:31:35.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292445+0000", 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6207000000000002e-05 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292458+0000", 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292597+0000", 2024-04-24T13:31:35.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013947100000000001 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292841+0000", 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024435599999999999 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.293085+0000", 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000243212 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:35.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294263+0000", 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001178171 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294758+0000", 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049492199999999996 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294824+0000", 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6346000000000005e-05 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294883+0000", 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9222999999999999e-05 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94410010333696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.175365266, 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023887449999999998, 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.491 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-24T13:31:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:31:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:31:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295096+0000", 2024-04-24T13:31:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1660000000000001e-06 2024-04-24T13:31:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295105+0000", 2024-04-24T13:31:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6139999999999992e-06 2024-04-24T13:31:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295131+0000", 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6633000000000001e-05 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295146+0000", 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4168999999999999e-05 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295250+0000", 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104071 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295424+0000", 2024-04-24T13:31:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017425599999999999 2024-04-24T13:31:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295726+0000", 2024-04-24T13:31:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030180000000000002 2024-04-24T13:31:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.296532+0000", 2024-04-24T13:31:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080662400000000003 2024-04-24T13:31:35.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297330+0000", 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00079793300000000002 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297392+0000", 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2112000000000004e-05 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297483+0000", 2024-04-24T13:31:35.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0366999999999997e-05 2024-04-24T13:31:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-24T13:31:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:31:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 63.175836994000001, 2024-04-24T13:31:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020133299999999998, 2024-04-24T13:31:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.498 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:31:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:31:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294623+0000", 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9999999999999996e-07 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294634+0000", 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1292e-05 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294666+0000", 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1596e-05 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294688+0000", 2024-04-24T13:31:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2561e-05 2024-04-24T13:31:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294842+0000", 2024-04-24T13:31:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153494 2024-04-24T13:31:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294893+0000", 2024-04-24T13:31:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0983999999999998e-05 2024-04-24T13:31:35.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296547+0000", 2024-04-24T13:31:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016536890000000001 2024-04-24T13:31:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296636+0000", 2024-04-24T13:31:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8913999999999996e-05 2024-04-24T13:31:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:215 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'2, mlcod=0'0)", 2024-04-24T13:31:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:31:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 63.144670939000001, 2024-04-24T13:31:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018794250000000001, 2024-04-24T13:31:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:31:35.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:31:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325790+0000", 2024-04-24T13:31:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:31:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325809+0000", 2024-04-24T13:31:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8590999999999999e-05 2024-04-24T13:31:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325846+0000", 2024-04-24T13:31:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6875999999999997e-05 2024-04-24T13:31:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325868+0000", 2024-04-24T13:31:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1585000000000001e-05 2024-04-24T13:31:35.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325983+0000", 2024-04-24T13:31:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115631 2024-04-24T13:31:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.326022+0000", 2024-04-24T13:31:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8618999999999997e-05 2024-04-24T13:31:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327579+0000", 2024-04-24T13:31:35.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015573049999999999 2024-04-24T13:31:35.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327668+0000", 2024-04-24T13:31:35.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8588e-05 2024-04-24T13:31:35.507 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.507 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.507 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.507 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:385 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'5, mlcod=32'2)", 2024-04-24T13:31:35.507 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 63.034766605999998, 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020295980000000001, 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:31:35.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435694+0000", 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435708+0000", 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3525e-05 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435733+0000", 2024-04-24T13:31:35.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5431000000000001e-05 2024-04-24T13:31:35.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435752+0000", 2024-04-24T13:31:35.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8465e-05 2024-04-24T13:31:35.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435897+0000", 2024-04-24T13:31:35.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014525000000000001 2024-04-24T13:31:35.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435963+0000", 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6297000000000006e-05 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437645+0000", 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001681395 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437722+0000", 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7424999999999998e-05 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.511 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:437 6.a e32/26 6:55b0279d:reshard::reshard.0000000009:head v 32'4, mlcod=32'1)", 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 63.005458765, 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002915075, 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465002+0000", 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4470000000000001e-06 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465013+0000", 2024-04-24T13:31:35.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1532000000000001e-05 2024-04-24T13:31:35.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465035+0000", 2024-04-24T13:31:35.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1138e-05 2024-04-24T13:31:35.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465048+0000", 2024-04-24T13:31:35.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3311e-05 2024-04-24T13:31:35.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465219+0000", 2024-04-24T13:31:35.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017134600000000001 2024-04-24T13:31:35.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465254+0000", 2024-04-24T13:31:35.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5009999999999999e-05 2024-04-24T13:31:35.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467829+0000", 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025744370000000002 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467915+0000", 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6854000000000006e-05 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:466 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:31:35.516 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.990532524999999, 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037830749999999999, 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:31:35.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479928+0000", 2024-04-24T13:31:35.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7150000000000001e-06 2024-04-24T13:31:35.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479941+0000", 2024-04-24T13:31:35.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2999e-05 2024-04-24T13:31:35.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479969+0000", 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7923999999999999e-05 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479986+0000", 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6388e-05 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480113+0000", 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127594 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480167+0000", 2024-04-24T13:31:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3699999999999997e-05 2024-04-24T13:31:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483640+0000", 2024-04-24T13:31:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003472742 2024-04-24T13:31:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483710+0000", 2024-04-24T13:31:35.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0012999999999995e-05 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:468 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'6, mlcod=32'3)", 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.988218541000002, 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039247960000000004, 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:31:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:31:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482242+0000", 2024-04-24T13:31:35.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.57e-06 2024-04-24T13:31:35.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482255+0000", 2024-04-24T13:31:35.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2418999999999999e-05 2024-04-24T13:31:35.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482281+0000", 2024-04-24T13:31:35.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6043000000000001e-05 2024-04-24T13:31:35.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482294+0000", 2024-04-24T13:31:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2873e-05 2024-04-24T13:31:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482395+0000", 2024-04-24T13:31:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101724 2024-04-24T13:31:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482446+0000", 2024-04-24T13:31:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0288999999999999e-05 2024-04-24T13:31:35.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486063+0000", 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036179290000000002 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486165+0000", 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101949 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.526 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:473 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'8, mlcod=32'6)", 2024-04-24T13:31:35.526 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:31:35.526 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.985122595, 2024-04-24T13:31:35.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034165060000000001, 2024-04-24T13:31:35.526 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.526 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.526 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.526 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:31:35.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485338+0000", 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.573e-06 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485350+0000", 2024-04-24T13:31:35.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485377+0000", 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6897e-05 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485397+0000", 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9287999999999999e-05 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485521+0000", 2024-04-24T13:31:35.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012448 2024-04-24T13:31:35.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485572+0000", 2024-04-24T13:31:35.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0704000000000001e-05 2024-04-24T13:31:35.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488640+0000", 2024-04-24T13:31:35.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030685589999999998 2024-04-24T13:31:35.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488753+0000", 2024-04-24T13:31:35.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112682 2024-04-24T13:31:35.530 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.530 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.530 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.530 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:474 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'9, mlcod=32'6)", 2024-04-24T13:31:35.530 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:31:35.530 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.982752838000003, 2024-04-24T13:31:35.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045500480000000001, 2024-04-24T13:31:35.531 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.531 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.531 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.531 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:31:35.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:31:35.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487708+0000", 2024-04-24T13:31:35.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4389999999999999e-06 2024-04-24T13:31:35.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487718+0000", 2024-04-24T13:31:35.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0386e-05 2024-04-24T13:31:35.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487743+0000", 2024-04-24T13:31:35.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5106999999999999e-05 2024-04-24T13:31:35.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487762+0000", 2024-04-24T13:31:35.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8348000000000001e-05 2024-04-24T13:31:35.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487893+0000", 2024-04-24T13:31:35.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130968 2024-04-24T13:31:35.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487926+0000", 2024-04-24T13:31:35.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3827e-05 2024-04-24T13:31:35.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492194+0000", 2024-04-24T13:31:35.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042671499999999999 2024-04-24T13:31:35.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492256+0000", 2024-04-24T13:31:35.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2823000000000005e-05 2024-04-24T13:31:35.535 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.535 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.535 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.535 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:476 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-24T13:31:35.535 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:31:35.535 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.981960966000003, 2024-04-24T13:31:35.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059105989999999999, 2024-04-24T13:31:35.535 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488500+0000", 2024-04-24T13:31:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4169999999999999e-06 2024-04-24T13:31:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488510+0000", 2024-04-24T13:31:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0462000000000001e-05 2024-04-24T13:31:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488536+0000", 2024-04-24T13:31:35.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6007e-05 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488553+0000", 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7037999999999998e-05 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488752+0000", 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019892900000000001 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488805+0000", 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2800999999999998e-05 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494315+0000", 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055099650000000003 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494409+0000", 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3980000000000005e-05 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.539 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'7)", 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.978985131999998, 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055780020000000003, 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:31:35.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:31:35.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491476+0000", 2024-04-24T13:31:35.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8479999999999999e-06 2024-04-24T13:31:35.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491503+0000", 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7189e-05 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491534+0000", 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1222e-05 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491553+0000", 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9069e-05 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491769+0000", 2024-04-24T13:31:35.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000215479 2024-04-24T13:31:35.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491830+0000", 2024-04-24T13:31:35.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1169999999999999e-05 2024-04-24T13:31:35.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.496974+0000", 2024-04-24T13:31:35.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051441860000000002 2024-04-24T13:31:35.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497052+0000", 2024-04-24T13:31:35.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7838999999999998e-05 2024-04-24T13:31:35.544 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.544 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.544 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.544 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:484 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'11, mlcod=32'8)", 2024-04-24T13:31:35.544 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:31:35.544 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.973055770999999, 2024-04-24T13:31:35.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022050070000000001, 2024-04-24T13:31:35.545 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.545 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.545 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.545 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:31:35.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:31:35.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497405+0000", 2024-04-24T13:31:35.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5889999999999999e-06 2024-04-24T13:31:35.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497418+0000", 2024-04-24T13:31:35.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2700999999999999e-05 2024-04-24T13:31:35.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497449+0000", 2024-04-24T13:31:35.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0911000000000003e-05 2024-04-24T13:31:35.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497473+0000", 2024-04-24T13:31:35.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4326000000000001e-05 2024-04-24T13:31:35.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497563+0000", 2024-04-24T13:31:35.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9652000000000002e-05 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497589+0000", 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6669000000000002e-05 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499542+0000", 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019529180000000001 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499608+0000", 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6241000000000005e-05 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:511 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'3, mlcod=32'1)", 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.958005845000002, 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020247519999999999, 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.549 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:31:35.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:31:35.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512455+0000", 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.463e-06 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512464+0000", 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.397e-06 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512488+0000", 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3502e-05 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512499+0000", 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0908e-05 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512620+0000", 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012119 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512672+0000", 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2366e-05 2024-04-24T13:31:35.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514389+0000", 2024-04-24T13:31:35.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017172890000000001 2024-04-24T13:31:35.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514478+0000", 2024-04-24T13:31:35.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8636999999999999e-05 2024-04-24T13:31:35.553 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.553 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.553 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.554 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:544 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'12, mlcod=32'10)", 2024-04-24T13:31:35.554 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:31:35.554 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.932847920999997, 2024-04-24T13:31:35.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020839690000000002, 2024-04-24T13:31:35.554 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.554 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.554 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.554 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:31:35.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537613+0000", 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7710000000000001e-06 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537627+0000", 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3580999999999999e-05 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537658+0000", 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1470999999999997e-05 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537680+0000", 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1447e-05 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537779+0000", 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9049000000000007e-05 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537822+0000", 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3815e-05 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539590+0000", 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017677459999999999 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539695+0000", 2024-04-24T13:31:35.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105089 2024-04-24T13:31:35.558 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.558 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.558 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.558 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:552 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'13, mlcod=32'11)", 2024-04-24T13:31:35.558 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:31:35.558 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.925706748000003, 2024-04-24T13:31:35.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031853350000000001, 2024-04-24T13:31:35.558 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544754+0000", 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309999999999999e-06 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544769+0000", 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4259e-05 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544803+0000", 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4650000000000002e-05 2024-04-24T13:31:35.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544822+0000", 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8700999999999999e-05 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544956+0000", 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134482 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544991+0000", 2024-04-24T13:31:35.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4953000000000002e-05 2024-04-24T13:31:35.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547847+0000", 2024-04-24T13:31:35.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028556749999999998 2024-04-24T13:31:35.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547938+0000", 2024-04-24T13:31:35.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0784000000000004e-05 2024-04-24T13:31:35.562 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.562 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.562 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:705 6.1f e32/26 6:f93251ce:::obj_delete_at_hint.0000000042:head v 32'7, mlcod=32'5)", 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.792989040999998, 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018230220000000001, 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:31:35.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:31:35.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677472+0000", 2024-04-24T13:31:35.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-24T13:31:35.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677483+0000", 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1025e-05 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677510+0000", 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6894e-05 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677522+0000", 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2367e-05 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677616+0000", 2024-04-24T13:31:35.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4239000000000004e-05 2024-04-24T13:31:35.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677656+0000", 2024-04-24T13:31:35.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9681999999999997e-05 2024-04-24T13:31:35.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679172+0000", 2024-04-24T13:31:35.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015157529999999999 2024-04-24T13:31:35.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679293+0000", 2024-04-24T13:31:35.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012133099999999999 2024-04-24T13:31:35.567 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.567 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.567 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.567 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:709 6.1e e32/26 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 32'1, mlcod=0'0)", 2024-04-24T13:31:35.567 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 62.782571369999999, 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020442059999999998, 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:35.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.89e-07 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687895+0000", 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9959999999999996e-06 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:35.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687919+0000", 2024-04-24T13:31:35.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3455000000000002e-05 2024-04-24T13:31:35.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:35.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687931+0000", 2024-04-24T13:31:35.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2442e-05 2024-04-24T13:31:35.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:35.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688076+0000", 2024-04-24T13:31:35.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014435399999999999 2024-04-24T13:31:35.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:35.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688127+0000", 2024-04-24T13:31:35.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1910999999999998e-05 2024-04-24T13:31:35.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:35.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689827+0000", 2024-04-24T13:31:35.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00169918 2024-04-24T13:31:35.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:35.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:35.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:35.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689932+0000", 2024-04-24T13:31:35.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105379 2024-04-24T13:31:35.572 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.572 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.572 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.572 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:35.572 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:35.572 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:35.573 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:35.574 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:35.569+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:35.675 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:35.671+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:35.700 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:35.700 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:35.700 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:35.700 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:35.715 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:35.776 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:35.773+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:35.874 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:35.874 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:35.874 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:35.874 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:35.874 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:35.877 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:35.873+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:35.888 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:35.978 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:35.975+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:36.004 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:36.004 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 87.147884653999995, 2024-04-24T13:31:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:31:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.005 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:31:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:36.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:31:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:31:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:31:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:31:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:31:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:31:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:31:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:31:36.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:31:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:31:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:31:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:31:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:31:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 87.147861879999994, 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.011 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:31:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:31:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:31:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:31:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:31:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:31:36.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 87.050254447, 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.017 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:31:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:31:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:31:36.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:31:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:31:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 87.050166809999993, 2024-04-24T13:31:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:31:36.023 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:31:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:31:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:31:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:31:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:31:36.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:31:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:31:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:31:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:31:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:31:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:31:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:31:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.944512923000005, 2024-04-24T13:31:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:31:36.029 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:31:36.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:31:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:31:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:31:36.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:31:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:31:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:31:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:31:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:31:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:31:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.035 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.944308405000001, 2024-04-24T13:31:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:31:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:31:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:31:36.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:31:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:31:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:31:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:31:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:31:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:31:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:31:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:31:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:31:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:31:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:31:36.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:31:36.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.943948582000004, 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:31:36.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:31:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:31:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:31:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:31:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:31:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:31:36.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:31:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:31:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:31:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:31:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.943780179000001, 2024-04-24T13:31:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:31:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:31:36.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:31:36.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:31:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:31:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:31:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:31:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:31:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:31:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:31:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:31:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:31:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:31:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:31:36.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:31:36.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.943571788, 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:31:36.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:31:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:31:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:31:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:31:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:31:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.059 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.943473935, 2024-04-24T13:31:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:31:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:31:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:31:36.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:31:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:31:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:31:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:31:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:31:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:31:36.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:31:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:31:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:31:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:31:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.066 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.066 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:36.066 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.943372785999998, 2024-04-24T13:31:36.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:31:36.066 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.066 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.066 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.066 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.066 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.066 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.066 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:31:36.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:31:36.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:31:36.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:31:36.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:31:36.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:31:36.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:31:36.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:31:36.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.070 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.070 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:31:36.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:31:36.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.070 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.070 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:31:36.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:31:36.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.070 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:31:36.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:31:36.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:31:36.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:31:36.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:31:36.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:31:36.071 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.072 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.072 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.072 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.072 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:36.072 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.943116074000002, 2024-04-24T13:31:36.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:31:36.072 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.072 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.072 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.072 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.072 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:31:36.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:31:36.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:31:36.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:31:36.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:31:36.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:31:36.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:31:36.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:31:36.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:31:36.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:31:36.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:31:36.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:31:36.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:31:36.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:31:36.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:31:36.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:31:36.078 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.078 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.078 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.078 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.078 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:36.078 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.943006412000003, 2024-04-24T13:31:36.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:31:36.078 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:36.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:31:36.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:31:36.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:31:36.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.082 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:31:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:31:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:31:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:31:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:31:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:31:36.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:31:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:31:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.942934382999994, 2024-04-24T13:31:36.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:36.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:31:36.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:31:36.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.088 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:31:36.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:31:36.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.088 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.088 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:31:36.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:31:36.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:31:36.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:31:36.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:31:36.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:31:36.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:31:36.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:31:36.091 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.091 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.091 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.942763346999996, 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:31:36.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:31:36.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.098 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.098 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:36.098 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.942723853999993, 2024-04-24T13:31:36.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:31:36.098 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.098 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.098 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.098 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.098 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.098 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.098 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:31:36.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.098 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:31:36.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:31:36.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:31:36.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:31:36.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:31:36.103 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.103 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.103 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.689404597999996, 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:36.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:36.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:36.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:31:36.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:31:36.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:31:36.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:31:36.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:31:36.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:31:36.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:31:36.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:31:36.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:31:36.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:31:36.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:31:36.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.110 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.110 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:36.110 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.689378550000001, 2024-04-24T13:31:36.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:31:36.110 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.110 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.110 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.110 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.110 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.110 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.110 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:31:36.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.111 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:36.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:36.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:31:36.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:31:36.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:31:36.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:31:36.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:31:36.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:31:36.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:31:36.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.115 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.689353194000006, 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.116 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:36.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:31:36.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:31:36.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:31:36.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:31:36.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:31:36.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:31:36.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:31:36.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:31:36.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:31:36.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.121 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.122 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.122 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:36.122 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:36.122 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 86.689262124999999, 2024-04-24T13:31:36.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:31:36.122 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:36.122 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:36.122 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:36.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:36.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:36.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:36.123 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:31:36.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.123 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:36.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:36.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:36.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:36.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:36.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:36.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:31:36.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:36.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:31:36.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:31:36.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:36.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:31:36.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:31:36.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:36.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:31:36.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:31:36.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:31:36.127 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.128 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.128 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.128 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:36.128 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:36.128 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:36.128 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:31:36.130 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:36.131 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:36.129+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:36.231 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:36.227+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:36.261 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:36.261 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:36.273 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:36.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:36.276 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:36.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:36.291 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:36.309 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:36.309 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:36.325 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:36.326 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:36.332 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:36.327+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:36.347 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:36.347 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:36.383 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:36.383 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:36.403 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:36.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:36.407 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:36.408 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:36.423 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:36.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:36.424 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:36.433 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:36.427+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:36.534 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:36.533+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:36.539 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:36.539 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:36.553 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:36.636 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:36.635+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:36.705 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:36.705 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:36.718 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:36.737 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:36.735+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:36.837 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:36.835+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:36.843 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:36.843 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:36.856 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:36.939 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:36.939+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:36.978 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:36.978 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:36.991 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:37.050 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:37.045+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:37.109 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:37.109 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:37.122 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:37.167 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:37.165+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:37.244 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:37.239+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:37.278 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:37.278 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:37.290 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:37.344 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:37.343+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:37.400 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:31:37.403 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:37.403 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:37.417 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:31:37.445 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:37.439+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:37.546 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:37.543+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:37.606 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:37.606 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:37.620 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:31:37.667 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:37.665+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:37.738 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:37.738 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:37.746 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:37.745+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:37.751 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:31:37.848 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:37.845+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:37.908 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:37.908 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:37.921 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:31:37.962 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:37.961+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:38.049 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:38.045+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:38.051 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:38.051 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:38.066 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:31:38.150 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:38.147+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:38.183 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:38.183 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:38.198 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:31:38.286 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:38.283+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:38.351 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:38.349+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:38.364 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:38.364 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:38.378 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:38.388 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:31:38.444 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:31:38.454 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:38.453+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:38.545 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:38.545 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:38.554 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:38.549+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:38.559 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:38.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:38.595 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:38.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:38.611 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:38.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:38.628 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:38.645 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:38.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:38.654 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:38.651+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:38.667 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:38.668 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:38.683 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:38.683 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:38.689 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:38.689 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:38.697 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:38.711 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:38.711 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:38.729 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:38.729 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:38.790 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:38.789+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:38.855 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:38.853+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:38.861 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:38.861 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:38.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:38.861 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:38.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.862 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:38.862 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:38.862 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 73.588059017000006, 2024-04-24T13:31:38.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003286134, 2024-04-24T13:31:38.862 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.862 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.862 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.862 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.862 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4440", 2024-04-24T13:31:38.862 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:31:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:31:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270374+0000", 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9130000000000001e-06 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270384+0000", 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0023e-05 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270410+0000", 2024-04-24T13:31:38.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5483e-05 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270426+0000", 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6413e-05 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270524+0000", 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8314999999999996e-05 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270704+0000", 2024-04-24T13:31:38.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017929 2024-04-24T13:31:38.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:38.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270950+0000", 2024-04-24T13:31:38.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024601000000000001 2024-04-24T13:31:38.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.272837+0000", 2024-04-24T13:31:38.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018874600000000001 2024-04-24T13:31:38.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273498+0000", 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066062100000000002 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273589+0000", 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.098e-05 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273658+0000", 2024-04-24T13:31:38.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9626e-05 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 69.579269148999998, 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048388950000000002, 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.868 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3799999999999998e-06 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279193+0000", 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7674e-05 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279224+0000", 2024-04-24T13:31:38.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0654000000000002e-05 2024-04-24T13:31:38.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279244+0000", 2024-04-24T13:31:38.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:31:38.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279426+0000", 2024-04-24T13:31:38.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018255300000000001 2024-04-24T13:31:38.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279717+0000", 2024-04-24T13:31:38.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029043800000000001 2024-04-24T13:31:38.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:38.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279993+0000", 2024-04-24T13:31:38.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276786 2024-04-24T13:31:38.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282898+0000", 2024-04-24T13:31:38.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002904093 2024-04-24T13:31:38.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283731+0000", 2024-04-24T13:31:38.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00083382599999999997 2024-04-24T13:31:38.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283886+0000", 2024-04-24T13:31:38.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015512600000000001 2024-04-24T13:31:38.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284001+0000", 2024-04-24T13:31:38.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114405 2024-04-24T13:31:38.875 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.875 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.875 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.876 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410010339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:38.876 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:38.876 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 69.574144554, 2024-04-24T13:31:38.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044116340000000002, 2024-04-24T13:31:38.876 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.876 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.876 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.877 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.877 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.877 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.877 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-24T13:31:38.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.877 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:38.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:31:38.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284289+0000", 2024-04-24T13:31:38.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.125e-06 2024-04-24T13:31:38.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284299+0000", 2024-04-24T13:31:38.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0485999999999999e-05 2024-04-24T13:31:38.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284330+0000", 2024-04-24T13:31:38.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0528000000000003e-05 2024-04-24T13:31:38.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284345+0000", 2024-04-24T13:31:38.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4883e-05 2024-04-24T13:31:38.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284484+0000", 2024-04-24T13:31:38.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139708 2024-04-24T13:31:38.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284655+0000", 2024-04-24T13:31:38.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170953 2024-04-24T13:31:38.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:38.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284981+0000", 2024-04-24T13:31:38.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000325648 2024-04-24T13:31:38.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.287326+0000", 2024-04-24T13:31:38.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023452709999999999 2024-04-24T13:31:38.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288427+0000", 2024-04-24T13:31:38.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001100544 2024-04-24T13:31:38.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288551+0000", 2024-04-24T13:31:38.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012466500000000001 2024-04-24T13:31:38.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288698+0000", 2024-04-24T13:31:38.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146823 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.594931669000005, 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047820809999999997, 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.887 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263503+0000", 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.039e-06 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263520+0000", 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7198e-05 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263548+0000", 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8158e-05 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263565+0000", 2024-04-24T13:31:38.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7008e-05 2024-04-24T13:31:38.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263754+0000", 2024-04-24T13:31:38.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001894 2024-04-24T13:31:38.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263973+0000", 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218593 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.264373+0000", 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040043400000000002 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.266377+0000", 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020033030000000001 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268121+0000", 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017441049999999999 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268212+0000", 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1490000000000007e-05 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268282+0000", 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9352999999999998e-05 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.892 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.893 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.893 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.893 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:38.893 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.515219517000006, 2024-04-24T13:31:38.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034252639999999999, 2024-04-24T13:31:38.893 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.893 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.893 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.894 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.894 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.894 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.894 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 220 2024-04-24T13:31:38.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.894 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:38.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:31:38.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343214+0000", 2024-04-24T13:31:38.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:31:38.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343227+0000", 2024-04-24T13:31:38.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2941e-05 2024-04-24T13:31:38.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343259+0000", 2024-04-24T13:31:38.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1557000000000003e-05 2024-04-24T13:31:38.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343274+0000", 2024-04-24T13:31:38.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5401999999999999e-05 2024-04-24T13:31:38.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343455+0000", 2024-04-24T13:31:38.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018068700000000001 2024-04-24T13:31:38.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343694+0000", 2024-04-24T13:31:38.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238552 2024-04-24T13:31:38.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:38.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.344088+0000", 2024-04-24T13:31:38.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039456400000000003 2024-04-24T13:31:38.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.345723+0000", 2024-04-24T13:31:38.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016349139999999999 2024-04-24T13:31:38.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346480+0000", 2024-04-24T13:31:38.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075738300000000004 2024-04-24T13:31:38.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346569+0000", 2024-04-24T13:31:38.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8281000000000004e-05 2024-04-24T13:31:38.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346637+0000", 2024-04-24T13:31:38.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8165999999999998e-05 2024-04-24T13:31:38.899 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.899 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.504526140999999, 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032680679999999998, 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.900 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 223 2024-04-24T13:31:38.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.901 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:38.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:31:38.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353907+0000", 2024-04-24T13:31:38.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1560000000000002e-06 2024-04-24T13:31:38.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353918+0000", 2024-04-24T13:31:38.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0669000000000001e-05 2024-04-24T13:31:38.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353948+0000", 2024-04-24T13:31:38.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0329999999999999e-05 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353963+0000", 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4989e-05 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354076+0000", 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112704 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354300+0000", 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022397000000000001 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354729+0000", 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042914100000000002 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356223+0000", 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001494219 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356972+0000", 2024-04-24T13:31:38.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00074910099999999996 2024-04-24T13:31:38.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357059+0000", 2024-04-24T13:31:38.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6624000000000003e-05 2024-04-24T13:31:38.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357173+0000", 2024-04-24T13:31:38.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114165 2024-04-24T13:31:38.905 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.906 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.906 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.906 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.906 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:38.906 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.497479220000002, 2024-04-24T13:31:38.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032957419999999999, 2024-04-24T13:31:38.906 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.906 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.906 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.906 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.906 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.907 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.907 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-24T13:31:38.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.907 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:38.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360954+0000", 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.154e-06 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360965+0000", 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1321999999999999e-05 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360996+0000", 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0902999999999999e-05 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361012+0000", 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361185+0000", 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172072 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361404+0000", 2024-04-24T13:31:38.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021965999999999999 2024-04-24T13:31:38.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:38.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361852+0000", 2024-04-24T13:31:38.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000448276 2024-04-24T13:31:38.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.363340+0000", 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001487169 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364094+0000", 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075443699999999995 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364184+0000", 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9957000000000006e-05 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364248+0000", 2024-04-24T13:31:38.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3627000000000006e-05 2024-04-24T13:31:38.912 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.912 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.912 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.912 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.912 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:38.912 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.493914372999996, 2024-04-24T13:31:38.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036426480000000001, 2024-04-24T13:31:38.912 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.912 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:31:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364519+0000", 2024-04-24T13:31:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-24T13:31:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364529+0000", 2024-04-24T13:31:38.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088999999999999e-05 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364554+0000", 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5537e-05 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364568+0000", 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3372e-05 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364726+0000", 2024-04-24T13:31:38.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015809299999999999 2024-04-24T13:31:38.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365059+0000", 2024-04-24T13:31:38.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000333185 2024-04-24T13:31:38.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365758+0000", 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069934299999999995 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.367413+0000", 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016552349999999999 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368012+0000", 2024-04-24T13:31:38.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059858700000000003 2024-04-24T13:31:38.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368097+0000", 2024-04-24T13:31:38.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5253999999999994e-05 2024-04-24T13:31:38.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368159+0000", 2024-04-24T13:31:38.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2113000000000007e-05 2024-04-24T13:31:38.918 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.918 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.464527736999997, 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033998840000000002, 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.919 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-24T13:31:38.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.920 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:38.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:31:38.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393906+0000", 2024-04-24T13:31:38.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1569999999999998e-06 2024-04-24T13:31:38.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393917+0000", 2024-04-24T13:31:38.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1348999999999999e-05 2024-04-24T13:31:38.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393942+0000", 2024-04-24T13:31:38.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.527e-05 2024-04-24T13:31:38.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393957+0000", 2024-04-24T13:31:38.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4355999999999999e-05 2024-04-24T13:31:38.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394127+0000", 2024-04-24T13:31:38.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170555 2024-04-24T13:31:38.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394352+0000", 2024-04-24T13:31:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224539 2024-04-24T13:31:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394788+0000", 2024-04-24T13:31:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043600099999999999 2024-04-24T13:31:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.396137+0000", 2024-04-24T13:31:38.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001349404 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397158+0000", 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001020738 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397237+0000", 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9319000000000004e-05 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397303+0000", 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6196000000000001e-05 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:237 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.453661101999998, 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003210517, 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.925 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.926 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.926 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.926 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 237 2024-04-24T13:31:38.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.926 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:38.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404770+0000", 2024-04-24T13:31:38.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404772+0000", 2024-04-24T13:31:38.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1830000000000001e-06 2024-04-24T13:31:38.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404783+0000", 2024-04-24T13:31:38.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1009000000000001e-05 2024-04-24T13:31:38.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404814+0000", 2024-04-24T13:31:38.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0822999999999999e-05 2024-04-24T13:31:38.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404829+0000", 2024-04-24T13:31:38.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4808e-05 2024-04-24T13:31:38.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.404965+0000", 2024-04-24T13:31:38.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013637299999999999 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405107+0000", 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142108 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.405399+0000", 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029117900000000003 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.406507+0000", 2024-04-24T13:31:38.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011081000000000001 2024-04-24T13:31:38.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407732+0000", 2024-04-24T13:31:38.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001225163 2024-04-24T13:31:38.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407866+0000", 2024-04-24T13:31:38.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013405599999999999 2024-04-24T13:31:38.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.407981+0000", 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114715 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:430 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.399944204999997, 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031779590000000002, 2024-04-24T13:31:38.931 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 430 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458487+0000", 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458489+0000", 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458525+0000", 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5743e-05 2024-04-24T13:31:38.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458556+0000", 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0284e-05 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458576+0000", 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0449999999999999e-05 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.458738+0000", 2024-04-24T13:31:38.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016177699999999999 2024-04-24T13:31:38.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459047+0000", 2024-04-24T13:31:38.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030948400000000001 2024-04-24T13:31:38.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:38.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.459499+0000", 2024-04-24T13:31:38.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045165199999999998 2024-04-24T13:31:38.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461152+0000", 2024-04-24T13:31:38.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001653477 2024-04-24T13:31:38.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461528+0000", 2024-04-24T13:31:38.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037554899999999998 2024-04-24T13:31:38.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461610+0000", 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1914000000000002e-05 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.461665+0000", 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5105999999999997e-05 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:436 6.a 6:50d64734:::obj_delete_at_hint.0000000009:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:38.937 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.395686617999999, 2024-04-24T13:31:38.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031563120000000001, 2024-04-24T13:31:38.938 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.938 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.938 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.938 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.938 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.938 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.938 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 436 2024-04-24T13:31:38.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.938 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:38.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462745+0000", 2024-04-24T13:31:38.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462746+0000", 2024-04-24T13:31:38.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8199999999999999e-06 2024-04-24T13:31:38.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462756+0000", 2024-04-24T13:31:38.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0005e-05 2024-04-24T13:31:38.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462778+0000", 2024-04-24T13:31:38.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1325e-05 2024-04-24T13:31:38.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462794+0000", 2024-04-24T13:31:38.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5841e-05 2024-04-24T13:31:38.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.462940+0000", 2024-04-24T13:31:38.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014605099999999999 2024-04-24T13:31:38.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463206+0000", 2024-04-24T13:31:38.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026634500000000003 2024-04-24T13:31:38.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:38.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463594+0000", 2024-04-24T13:31:38.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038760299999999998 2024-04-24T13:31:38.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465323+0000", 2024-04-24T13:31:38.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00172898 2024-04-24T13:31:38.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465593+0000", 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027055500000000001 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465747+0000", 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015391999999999999 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465901+0000", 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153867 2024-04-24T13:31:38.943 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.944 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.944 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.944 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:437 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.944 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:38.944 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.394904143000005, 2024-04-24T13:31:38.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048056540000000003, 2024-04-24T13:31:38.944 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.944 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.944 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.944 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.944 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 437 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463529+0000", 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2479999999999999e-06 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463544+0000", 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463572+0000", 2024-04-24T13:31:38.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8294e-05 2024-04-24T13:31:38.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463590+0000", 2024-04-24T13:31:38.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-24T13:31:38.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464092+0000", 2024-04-24T13:31:38.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000502189 2024-04-24T13:31:38.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464454+0000", 2024-04-24T13:31:38.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036231300000000001 2024-04-24T13:31:38.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:38.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464831+0000", 2024-04-24T13:31:38.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000377375 2024-04-24T13:31:38.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467473+0000", 2024-04-24T13:31:38.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026414659999999999 2024-04-24T13:31:38.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468185+0000", 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071215199999999997 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468271+0000", 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5593999999999994e-05 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468333+0000", 2024-04-24T13:31:38.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1957000000000003e-05 2024-04-24T13:31:38.950 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.950 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.950 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.950 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:531 6.4 e32/26 6:227f63b5:gc::gc.14:head v 32'13, mlcod=32'11)", 2024-04-24T13:31:38.950 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:38.950 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.333673048999998, 2024-04-24T13:31:38.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003260279, 2024-04-24T13:31:38.950 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.950 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.950 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.950 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524758+0000", 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524760+0000", 2024-04-24T13:31:38.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4720000000000001e-06 2024-04-24T13:31:38.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524771+0000", 2024-04-24T13:31:38.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1270000000000001e-05 2024-04-24T13:31:38.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524792+0000", 2024-04-24T13:31:38.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1566e-05 2024-04-24T13:31:38.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524805+0000", 2024-04-24T13:31:38.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2876e-05 2024-04-24T13:31:38.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524906+0000", 2024-04-24T13:31:38.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101084 2024-04-24T13:31:38.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.524943+0000", 2024-04-24T13:31:38.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6538000000000002e-05 2024-04-24T13:31:38.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.527964+0000", 2024-04-24T13:31:38.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030210229999999999 2024-04-24T13:31:38.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.528018+0000", 2024-04-24T13:31:38.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4450000000000002e-05 2024-04-24T13:31:38.954 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.955 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.955 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.955 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:745 6.d 6:b1126f68:::obj_delete_at_hint.0000000056:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.955 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:38.955 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.095849514999998, 2024-04-24T13:31:38.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032103409999999998, 2024-04-24T13:31:38.955 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.955 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 745 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762582+0000", 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762584+0000", 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7039999999999999e-06 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762597+0000", 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2539e-05 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762629+0000", 2024-04-24T13:31:38.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2116000000000002e-05 2024-04-24T13:31:38.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762644+0000", 2024-04-24T13:31:38.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5034999999999999e-05 2024-04-24T13:31:38.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.762801+0000", 2024-04-24T13:31:38.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015653999999999999 2024-04-24T13:31:38.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763192+0000", 2024-04-24T13:31:38.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000391529 2024-04-24T13:31:38.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:38.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.763747+0000", 2024-04-24T13:31:38.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055497399999999996 2024-04-24T13:31:38.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.764931+0000", 2024-04-24T13:31:38.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001184128 2024-04-24T13:31:38.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765643+0000", 2024-04-24T13:31:38.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071180500000000003 2024-04-24T13:31:38.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765726+0000", 2024-04-24T13:31:38.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3058000000000003e-05 2024-04-24T13:31:38.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.765792+0000", 2024-04-24T13:31:38.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5913000000000004e-05 2024-04-24T13:31:38.961 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.961 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.961 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.961 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.961 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:38.962 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.989254394, 2024-04-24T13:31:38.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033442569999999998, 2024-04-24T13:31:38.962 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.962 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.962 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.962 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.962 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.962 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.962 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 793 2024-04-24T13:31:38.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.962 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:38.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:31:38.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869179+0000", 2024-04-24T13:31:38.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.323e-06 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869190+0000", 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869222+0000", 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1733999999999998e-05 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869237+0000", 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5044e-05 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869396+0000", 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158913 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869763+0000", 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367112 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.870319+0000", 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055558799999999998 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.871509+0000", 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001190607 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872365+0000", 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085535299999999999 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872449+0000", 2024-04-24T13:31:38.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3834999999999999e-05 2024-04-24T13:31:38.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872521+0000", 2024-04-24T13:31:38.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2428999999999994e-05 2024-04-24T13:31:38.967 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.967 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.967 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.803248022000005, 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003340754, 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 874 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:38.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:31:38.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055185+0000", 2024-04-24T13:31:38.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055197+0000", 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1606e-05 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055229+0000", 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1603000000000002e-05 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055244+0000", 2024-04-24T13:31:38.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4928e-05 2024-04-24T13:31:38.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055397+0000", 2024-04-24T13:31:38.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015366499999999999 2024-04-24T13:31:38.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055763+0000", 2024-04-24T13:31:38.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036565600000000001 2024-04-24T13:31:38.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:38.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.056317+0000", 2024-04-24T13:31:38.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055436600000000004 2024-04-24T13:31:38.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.057678+0000", 2024-04-24T13:31:38.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001361283 2024-04-24T13:31:38.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058258+0000", 2024-04-24T13:31:38.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057942400000000004 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058407+0000", 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000149188 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058524+0000", 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116805 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.974 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.974 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:38.974 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.798529293000001, 2024-04-24T13:31:38.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032622950000000001, 2024-04-24T13:31:38.974 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.974 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.974 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.974 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.974 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.974 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.974 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 876 2024-04-24T13:31:38.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059904+0000", 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.767e-06 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059912+0000", 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819999999999994e-06 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059934+0000", 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2141e-05 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059949+0000", 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4285e-05 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060072+0000", 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012349400000000001 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060302+0000", 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022971999999999999 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060787+0000", 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048565400000000002 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062208+0000", 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014201870000000001 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062946+0000", 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073827699999999997 2024-04-24T13:31:38.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063036+0000", 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9758000000000004e-05 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063164+0000", 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012852999999999999 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.980 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:924 6.d 6:b6c174be:::obj_delete_at_hint.0000000115:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.980 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:38.980 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.687597646, 2024-04-24T13:31:38.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030953729999999998, 2024-04-24T13:31:38.980 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.980 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.980 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.980 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.980 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.980 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.980 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 924 2024-04-24T13:31:38.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.980 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:38.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170834+0000", 2024-04-24T13:31:38.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170836+0000", 2024-04-24T13:31:38.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1900000000000002e-06 2024-04-24T13:31:38.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170847+0000", 2024-04-24T13:31:38.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1109e-05 2024-04-24T13:31:38.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170879+0000", 2024-04-24T13:31:38.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2153000000000002e-05 2024-04-24T13:31:38.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.170898+0000", 2024-04-24T13:31:38.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8785000000000001e-05 2024-04-24T13:31:38.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171030+0000", 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013210300000000001 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171294+0000", 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026387600000000002 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.171790+0000", 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049596899999999997 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.172966+0000", 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011761 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173663+0000", 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069701500000000005 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173818+0000", 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155427 2024-04-24T13:31:38.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.173929+0000", 2024-04-24T13:31:38.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110646 2024-04-24T13:31:38.986 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.986 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.986 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.986 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:38.986 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 65.621586390000004, 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032803860000000002, 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 952 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:38.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236847+0000", 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236858+0000", 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0582e-05 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236900+0000", 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2463000000000003e-05 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236923+0000", 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2938e-05 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:38.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237071+0000", 2024-04-24T13:31:38.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014795100000000001 2024-04-24T13:31:38.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:38.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237365+0000", 2024-04-24T13:31:38.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000293963 2024-04-24T13:31:38.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:38.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237755+0000", 2024-04-24T13:31:38.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039032599999999998 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239124+0000", 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136918 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239925+0000", 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080016699999999996 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:38.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240011+0000", 2024-04-24T13:31:38.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6780999999999995e-05 2024-04-24T13:31:38.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:38.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:38.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:38.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240125+0000", 2024-04-24T13:31:38.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113862 2024-04-24T13:31:38.992 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.992 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.992 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.992 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:38.992 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:38.992 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:38.994 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:38.995 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:38.993+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:39.095 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:39.091+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:39.120 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:39.120 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:39.120 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:39.120 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:39.135 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:39.196 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:39.193+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:39.297 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:39.291+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:39.303 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:39.304 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:39.304 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:39.304 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:39.304 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:39.318 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:39.397 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:39.393+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:39.489 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:39.489 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:39.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:39.489 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:39.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.490 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:39.490 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:31:39.490 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.244340656000006, 2024-04-24T13:31:39.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:31:39.490 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.490 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.490 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.490 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:39.490 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:39.490 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:39.490 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:31:39.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:31:39.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:31:39.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:31:39.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:31:39.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:31:39.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:31:39.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:31:39.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:31:39.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:31:39.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94410010338304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.209482941999994, 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077892999999999999, 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:39.497 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:31:39.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2770000000000001e-06 2024-04-24T13:31:39.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279179+0000", 2024-04-24T13:31:39.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3529999999999999e-05 2024-04-24T13:31:39.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279222+0000", 2024-04-24T13:31:39.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2743000000000001e-05 2024-04-24T13:31:39.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279272+0000", 2024-04-24T13:31:39.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0649000000000002e-05 2024-04-24T13:31:39.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279772+0000", 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000500013 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280011+0000", 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023840499999999999 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280408+0000", 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039756999999999998 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282501+0000", 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020929159999999998 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286583+0000", 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040820530000000004 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286748+0000", 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016431200000000001 2024-04-24T13:31:39.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286951+0000", 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020383200000000001 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.196236948999996, 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024753290000000001, 2024-04-24T13:31:39.503 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292410+0000", 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292419+0000", 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8680000000000005e-06 2024-04-24T13:31:39.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292445+0000", 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6207000000000002e-05 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292458+0000", 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292597+0000", 2024-04-24T13:31:39.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013947100000000001 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292841+0000", 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024435599999999999 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.293085+0000", 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000243212 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:39.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294263+0000", 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001178171 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294758+0000", 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049492199999999996 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294824+0000", 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6346000000000005e-05 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294883+0000", 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9222999999999999e-05 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94410010333696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.193551060999994, 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023887449999999998, 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.509 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:39.510 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:39.510 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:39.510 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-24T13:31:39.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.510 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:31:39.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295096+0000", 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1660000000000001e-06 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295105+0000", 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6139999999999992e-06 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295131+0000", 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6633000000000001e-05 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295146+0000", 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4168999999999999e-05 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295250+0000", 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104071 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295424+0000", 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017425599999999999 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295726+0000", 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030180000000000002 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.296532+0000", 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080662400000000003 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:39.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297330+0000", 2024-04-24T13:31:39.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00079793300000000002 2024-04-24T13:31:39.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297392+0000", 2024-04-24T13:31:39.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2112000000000004e-05 2024-04-24T13:31:39.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297483+0000", 2024-04-24T13:31:39.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0366999999999997e-05 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 67.194022789000002, 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020133299999999998, 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294623+0000", 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9999999999999996e-07 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294634+0000", 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1292e-05 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294666+0000", 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1596e-05 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294688+0000", 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2561e-05 2024-04-24T13:31:39.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294842+0000", 2024-04-24T13:31:39.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153494 2024-04-24T13:31:39.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294893+0000", 2024-04-24T13:31:39.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0983999999999998e-05 2024-04-24T13:31:39.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296547+0000", 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016536890000000001 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296636+0000", 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8913999999999996e-05 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:215 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'2, mlcod=0'0)", 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 67.162856734000002, 2024-04-24T13:31:39.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018794250000000001, 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325790+0000", 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325809+0000", 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8590999999999999e-05 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325846+0000", 2024-04-24T13:31:39.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6875999999999997e-05 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325868+0000", 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1585000000000001e-05 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325983+0000", 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115631 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.326022+0000", 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8618999999999997e-05 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327579+0000", 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015573049999999999 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327668+0000", 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8588e-05 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.523 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:385 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'5, mlcod=32'2)", 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 67.052952400999999, 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020295980000000001, 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:31:39.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435694+0000", 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435708+0000", 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3525e-05 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435733+0000", 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5431000000000001e-05 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435752+0000", 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8465e-05 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435897+0000", 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014525000000000001 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435963+0000", 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6297000000000006e-05 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437645+0000", 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001681395 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437722+0000", 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7424999999999998e-05 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:437 6.a e32/26 6:55b0279d:reshard::reshard.0000000009:head v 32'4, mlcod=32'1)", 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 67.023644559999994, 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002915075, 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.528 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465002+0000", 2024-04-24T13:31:39.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4470000000000001e-06 2024-04-24T13:31:39.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465013+0000", 2024-04-24T13:31:39.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1532000000000001e-05 2024-04-24T13:31:39.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465035+0000", 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1138e-05 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465048+0000", 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3311e-05 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465219+0000", 2024-04-24T13:31:39.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017134600000000001 2024-04-24T13:31:39.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465254+0000", 2024-04-24T13:31:39.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5009999999999999e-05 2024-04-24T13:31:39.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467829+0000", 2024-04-24T13:31:39.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025744370000000002 2024-04-24T13:31:39.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467915+0000", 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6854000000000006e-05 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:466 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 67.00871832, 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037830749999999999, 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.533 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.534 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:31:39.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:31:39.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479928+0000", 2024-04-24T13:31:39.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7150000000000001e-06 2024-04-24T13:31:39.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479941+0000", 2024-04-24T13:31:39.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2999e-05 2024-04-24T13:31:39.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479969+0000", 2024-04-24T13:31:39.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7923999999999999e-05 2024-04-24T13:31:39.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479986+0000", 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6388e-05 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480113+0000", 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127594 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480167+0000", 2024-04-24T13:31:39.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3699999999999997e-05 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483640+0000", 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003472742 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483710+0000", 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0012999999999995e-05 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.538 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:468 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'6, mlcod=32'3)", 2024-04-24T13:31:39.538 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:31:39.538 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 67.006404336000003, 2024-04-24T13:31:39.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039247960000000004, 2024-04-24T13:31:39.538 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.538 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.538 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.538 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:31:39.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:31:39.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482242+0000", 2024-04-24T13:31:39.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.57e-06 2024-04-24T13:31:39.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482255+0000", 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2418999999999999e-05 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482281+0000", 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6043000000000001e-05 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482294+0000", 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2873e-05 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482395+0000", 2024-04-24T13:31:39.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101724 2024-04-24T13:31:39.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482446+0000", 2024-04-24T13:31:39.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0288999999999999e-05 2024-04-24T13:31:39.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486063+0000", 2024-04-24T13:31:39.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036179290000000002 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486165+0000", 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101949 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:473 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'8, mlcod=32'6)", 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 67.003308390000001, 2024-04-24T13:31:39.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034165060000000001, 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485338+0000", 2024-04-24T13:31:39.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.573e-06 2024-04-24T13:31:39.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485350+0000", 2024-04-24T13:31:39.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:31:39.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485377+0000", 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6897e-05 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485397+0000", 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9287999999999999e-05 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485521+0000", 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012448 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485572+0000", 2024-04-24T13:31:39.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0704000000000001e-05 2024-04-24T13:31:39.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488640+0000", 2024-04-24T13:31:39.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030685589999999998 2024-04-24T13:31:39.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488753+0000", 2024-04-24T13:31:39.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112682 2024-04-24T13:31:39.546 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:474 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'9, mlcod=32'6)", 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 67.000938633000004, 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045500480000000001, 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487708+0000", 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4389999999999999e-06 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487718+0000", 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0386e-05 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487743+0000", 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5106999999999999e-05 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487762+0000", 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8348000000000001e-05 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487893+0000", 2024-04-24T13:31:39.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130968 2024-04-24T13:31:39.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487926+0000", 2024-04-24T13:31:39.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3827e-05 2024-04-24T13:31:39.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492194+0000", 2024-04-24T13:31:39.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042671499999999999 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492256+0000", 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2823000000000005e-05 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:476 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 67.000146760999996, 2024-04-24T13:31:39.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059105989999999999, 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488500+0000", 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4169999999999999e-06 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488510+0000", 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0462000000000001e-05 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488536+0000", 2024-04-24T13:31:39.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6007e-05 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488553+0000", 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7037999999999998e-05 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488752+0000", 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019892900000000001 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488805+0000", 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2800999999999998e-05 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494315+0000", 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055099650000000003 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494409+0000", 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3980000000000005e-05 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.555 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'7)", 2024-04-24T13:31:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:31:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.997170926999999, 2024-04-24T13:31:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055780020000000003, 2024-04-24T13:31:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491476+0000", 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8479999999999999e-06 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491503+0000", 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7189e-05 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491534+0000", 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1222e-05 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491553+0000", 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9069e-05 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491769+0000", 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000215479 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491830+0000", 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1169999999999999e-05 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.496974+0000", 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051441860000000002 2024-04-24T13:31:39.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497052+0000", 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7838999999999998e-05 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:484 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'11, mlcod=32'8)", 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.991241565999999, 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022050070000000001, 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.560 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497405+0000", 2024-04-24T13:31:39.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5889999999999999e-06 2024-04-24T13:31:39.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497418+0000", 2024-04-24T13:31:39.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2700999999999999e-05 2024-04-24T13:31:39.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497449+0000", 2024-04-24T13:31:39.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0911000000000003e-05 2024-04-24T13:31:39.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497473+0000", 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4326000000000001e-05 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497563+0000", 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9652000000000002e-05 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497589+0000", 2024-04-24T13:31:39.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6669000000000002e-05 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499542+0000", 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019529180000000001 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499608+0000", 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6241000000000005e-05 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.565 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:511 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'3, mlcod=32'1)", 2024-04-24T13:31:39.565 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:31:39.565 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.976191639999996, 2024-04-24T13:31:39.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020247519999999999, 2024-04-24T13:31:39.565 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.565 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.565 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.565 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:31:39.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512455+0000", 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.463e-06 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512464+0000", 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.397e-06 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512488+0000", 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3502e-05 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512499+0000", 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0908e-05 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512620+0000", 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012119 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512672+0000", 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2366e-05 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514389+0000", 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017172890000000001 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514478+0000", 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8636999999999999e-05 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:544 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'12, mlcod=32'10)", 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.951033715999998, 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020839690000000002, 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.569 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537613+0000", 2024-04-24T13:31:39.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7710000000000001e-06 2024-04-24T13:31:39.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537627+0000", 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3580999999999999e-05 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537658+0000", 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1470999999999997e-05 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537680+0000", 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1447e-05 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537779+0000", 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9049000000000007e-05 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537822+0000", 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3815e-05 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539590+0000", 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017677459999999999 2024-04-24T13:31:39.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539695+0000", 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105089 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:552 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'13, mlcod=32'11)", 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.943892543000004, 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031853350000000001, 2024-04-24T13:31:39.576 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544754+0000", 2024-04-24T13:31:39.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309999999999999e-06 2024-04-24T13:31:39.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544769+0000", 2024-04-24T13:31:39.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4259e-05 2024-04-24T13:31:39.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544803+0000", 2024-04-24T13:31:39.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4650000000000002e-05 2024-04-24T13:31:39.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544822+0000", 2024-04-24T13:31:39.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8700999999999999e-05 2024-04-24T13:31:39.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544956+0000", 2024-04-24T13:31:39.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134482 2024-04-24T13:31:39.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544991+0000", 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4953000000000002e-05 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547847+0000", 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028556749999999998 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547938+0000", 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0784000000000004e-05 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.580 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:705 6.1f e32/26 6:f93251ce:::obj_delete_at_hint.0000000042:head v 32'7, mlcod=32'5)", 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.811174836000006, 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018230220000000001, 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:31:39.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:31:39.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677472+0000", 2024-04-24T13:31:39.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-24T13:31:39.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677483+0000", 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1025e-05 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677510+0000", 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6894e-05 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677522+0000", 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2367e-05 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677616+0000", 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4239000000000004e-05 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677656+0000", 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9681999999999997e-05 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679172+0000", 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015157529999999999 2024-04-24T13:31:39.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679293+0000", 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012133099999999999 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:709 6.1e e32/26 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 32'1, mlcod=0'0)", 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 66.800757164999993, 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020442059999999998, 2024-04-24T13:31:39.585 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.89e-07 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687895+0000", 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9959999999999996e-06 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687919+0000", 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3455000000000002e-05 2024-04-24T13:31:39.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687931+0000", 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2442e-05 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688076+0000", 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014435399999999999 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688127+0000", 2024-04-24T13:31:39.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1910999999999998e-05 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689827+0000", 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00169918 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689932+0000", 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105379 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:39.589 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:39.590 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:39.591 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:39.592 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:39.589+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:39.692 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:39.689+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:39.716 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:39.716 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:39.716 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:39.716 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:39.730 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:39.793 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:39.787+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:39.846 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:39.846 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:39.846 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:39.846 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:39.846 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:39.860 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:39.893 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:39.889+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:39.995 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:39.991+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:40.032 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:40.032 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:40.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:40.032 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:40.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.033 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.033 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:40.033 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.173235904999999, 2024-04-24T13:31:40.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:31:40.033 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.033 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.033 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.033 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.033 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.033 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.033 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:31:40.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.034 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:40.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:40.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:40.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:31:40.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:31:40.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:31:40.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:31:40.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:31:40.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:31:40.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:31:40.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:31:40.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:31:40.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:31:40.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:31:40.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:31:40.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:31:40.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:31:40.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:31:40.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:31:40.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.173213130999997, 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.039 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.040 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.040 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:31:40.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.040 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:40.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:40.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:31:40.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:31:40.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:31:40.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:31:40.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:31:40.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:31:40.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:31:40.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:31:40.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:31:40.045 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.045 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.045 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.045 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.045 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:40.045 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.075605698000004, 2024-04-24T13:31:40.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:31:40.045 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.045 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:40.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:40.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:31:40.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:31:40.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:31:40.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:31:40.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:31:40.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:31:40.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:31:40.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:31:40.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:31:40.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:31:40.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:31:40.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:31:40.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:31:40.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:31:40.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 91.075518060999997, 2024-04-24T13:31:40.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:31:40.052 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.052 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.052 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.052 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.052 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.052 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.052 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:31:40.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.052 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:31:40.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:31:40.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:31:40.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:31:40.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:31:40.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.057 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:40.058 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.969864173999994, 2024-04-24T13:31:40.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:31:40.058 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.058 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.058 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.058 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.058 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.058 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.058 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:31:40.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.058 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:31:40.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:31:40.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:31:40.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:31:40.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.060 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:31:40.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:31:40.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:31:40.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:31:40.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:31:40.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:31:40.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:31:40.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.063 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.064 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:40.064 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.969659656000005, 2024-04-24T13:31:40.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:31:40.064 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.064 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.064 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.064 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.064 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.064 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.064 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:31:40.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.064 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:40.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:40.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:31:40.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:31:40.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:31:40.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:31:40.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:31:40.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:31:40.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:31:40.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:31:40.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:31:40.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:31:40.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:31:40.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:31:40.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:31:40.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:31:40.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:31:40.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:31:40.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:31:40.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:31:40.069 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.069 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.069 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.070 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.070 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:40.070 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.969299832999994, 2024-04-24T13:31:40.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:31:40.070 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.070 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.070 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.070 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.070 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.070 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.070 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:31:40.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:31:40.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:31:40.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:31:40.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:31:40.075 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.075 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.075 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.076 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.076 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:40.076 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.969131430000004, 2024-04-24T13:31:40.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:31:40.076 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.076 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.076 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.076 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.076 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.076 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.076 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:31:40.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:31:40.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:31:40.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:31:40.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:31:40.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:31:40.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:31:40.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:31:40.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:31:40.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:31:40.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:31:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:31:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:31:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:31:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:31:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:31:40.081 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.082 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.082 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.082 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.082 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.082 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.082 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:40.082 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.968923039000003, 2024-04-24T13:31:40.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:31:40.082 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.082 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.082 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.082 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.082 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.083 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.083 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:31:40.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.083 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:40.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.083 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.083 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.083 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.083 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:40.083 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.084 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.085 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:31:40.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:31:40.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:31:40.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:31:40.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.086 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.086 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:31:40.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:31:40.086 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:31:40.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.968825186000004, 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.088 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.089 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:31:40.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.089 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:40.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:40.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:31:40.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:31:40.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:31:40.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:31:40.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.092 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:31:40.092 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:31:40.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.092 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.092 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.092 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:31:40.092 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:31:40.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.092 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.092 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.092 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:31:40.092 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:31:40.092 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:31:40.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:31:40.094 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.094 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.094 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.094 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.094 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:40.094 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.968724037000001, 2024-04-24T13:31:40.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:31:40.094 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.094 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.094 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.094 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:40.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:31:40.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:31:40.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:31:40.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:31:40.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:31:40.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:31:40.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:31:40.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:31:40.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:31:40.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:31:40.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:31:40.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:31:40.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:31:40.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:31:40.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:31:40.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:31:40.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:31:40.100 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.100 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.100 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.100 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.100 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.968467325000006, 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:40.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:40.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:31:40.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:31:40.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:31:40.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:31:40.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:31:40.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:31:40.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:31:40.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:31:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:31:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:31:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:31:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:31:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:31:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:31:40.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:31:40.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:31:40.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:31:40.106 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.106 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.106 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.968357663000006, 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:40.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:40.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:31:40.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:31:40.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:31:40.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:31:40.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:31:40.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:31:40.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:31:40.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:31:40.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.113 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.113 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:40.113 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.968285633999997, 2024-04-24T13:31:40.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:31:40.113 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.113 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.113 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.113 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.113 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.113 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.113 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:31:40.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.113 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:40.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:40.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:31:40.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:31:40.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:31:40.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:31:40.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:31:40.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:31:40.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:31:40.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:31:40.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:31:40.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:31:40.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:31:40.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:31:40.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:31:40.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:31:40.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:31:40.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:31:40.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:31:40.119 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.119 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.119 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.119 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.119 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:40.119 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.968114598, 2024-04-24T13:31:40.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:31:40.119 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.119 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.120 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.120 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.120 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.120 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.120 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:31:40.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.120 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:40.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:40.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:31:40.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:31:40.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:31:40.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:31:40.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:31:40.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:31:40.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:31:40.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:31:40.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:31:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:31:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:31:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:31:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:31:40.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:31:40.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:31:40.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:31:40.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:31:40.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:31:40.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.125 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:40.126 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.968075104999997, 2024-04-24T13:31:40.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:31:40.126 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.126 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.126 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.126 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.126 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.126 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.126 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:31:40.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.126 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:31:40.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:31:40.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:31:40.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:31:40.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:31:40.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:31:40.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:31:40.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:31:40.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.131 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.714755848999999, 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:40.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:40.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:40.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:31:40.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:31:40.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:31:40.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:31:40.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:31:40.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:31:40.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:31:40.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:31:40.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:31:40.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:31:40.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:31:40.137 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.137 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.137 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.138 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.138 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:40.138 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.714729801000004, 2024-04-24T13:31:40.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:31:40.138 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.138 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.138 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.138 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.138 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.138 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.138 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:31:40.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.139 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:40.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:40.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:31:40.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:31:40.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:31:40.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:31:40.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:31:40.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.143 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.144 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.144 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.144 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:40.144 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.714704444999995, 2024-04-24T13:31:40.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:31:40.144 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.144 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.144 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.144 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.144 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.144 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:31:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:31:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:31:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:31:40.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:31:40.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:31:40.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:31:40.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:31:40.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:31:40.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:31:40.149 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.150 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.150 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.150 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:40.150 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:40.150 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 90.714613376000003, 2024-04-24T13:31:40.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:31:40.150 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:40.150 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:40.150 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.150 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:40.150 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:40.151 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:40.151 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:31:40.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.151 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:40.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:40.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:40.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:40.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:40.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:31:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:31:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:31:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:31:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:40.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:31:40.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:31:40.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:40.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:31:40.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:31:40.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:40.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:31:40.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:31:40.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:31:40.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:31:40.156 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.156 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.156 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.156 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:40.156 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:40.156 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:40.157 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:40.155+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:40.158 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:40.258 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:40.257+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:40.284 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:40.284 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:40.284 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:40.284 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:40.298 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:40.386 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:40.385+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:40.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:31:40.460 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:40.460 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:40.460 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:40.460 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:40.460 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:40.460 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:40.457+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:40.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:40.561 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:40.555+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:40.638 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:40.638 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:40.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:40.639 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:40.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.639 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:31:40.639 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:40.639 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.714346918999993, 2024-04-24T13:31:40.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:31:40.639 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.639 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.639 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.639 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:31:40.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:31:40.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:31:40.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:31:40.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:31:40.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:31:40.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:31:40.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:31:40.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:31:40.643 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.643 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.643 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.643 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.571555149000005, 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.647 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.569252081000002, 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.567557563999998, 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.652 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:40.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:31:40.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:31:40.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:31:40.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:31:40.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:31:40.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:31:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.566099953000005, 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:40.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:31:40.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:31:40.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:31:40.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:31:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:31:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:31:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:31:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:31:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.564170864000005, 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:31:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.561746326999994, 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:31:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:31:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:31:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:31:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.560543577999994, 2024-04-24T13:31:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:31:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:31:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:31:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:31:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:31:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:31:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:31:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:31:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.557337412999999, 2024-04-24T13:31:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:31:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:31:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:31:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.318281829, 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:31:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:31:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:31:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:31:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:31:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:31:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:31:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:31:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:31:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:31:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:31:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:31:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.315861178000006, 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:31:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:31:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:31:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:31:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:31:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:31:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:31:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:31:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:31:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:31:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.31508796, 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.307348906000001, 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 90.959386799000001, 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:31:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:31:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:31:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:31:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:31:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:31:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:31:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:31:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:31:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:31:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 90.958638050999994, 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:31:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:31:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 90.957706926, 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:31:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 90.957215134999998, 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:31:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:31:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:31:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.371133710999999, 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:31:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:31:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:31:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:31:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:31:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:31:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:31:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:31:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.342286512000001, 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:31:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:31:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:31:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:31:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:31:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:31:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:31:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:31:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:31:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.304095267999998, 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:31:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:31:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:31:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:31:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:31:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:31:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:31:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:31:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:31:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:40.733 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:40.734 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:40.735 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:40.735+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:40.747 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:31:40.835 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:40.831+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:40.864 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:40.864 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:40.864 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:40.864 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:40.878 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:40.922 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:40.922 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:40.936 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:40.933+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:40.939 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:40.940 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:40.955 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:40.956 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:40.973 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:40.973 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:40.994 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:40.994 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:40.995 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:40.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:41.008 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:41.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:41.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:41.037 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:41.037 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:41.038 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:41.031+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:41.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:41.057 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:41.132 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:41.132 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:41.137 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:41.133+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:41.145 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:41.239 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:41.235+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:41.316 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:41.316 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:41.329 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:41.340 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:41.335+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:41.415 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:31:41.441 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:41.435+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:41.443 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:41.443 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:41.456 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:41.542 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:41.541+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:41.625 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:41.625 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:41.638 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:31:41.643 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:41.639+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:41.744 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:41.741+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:41.794 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:41.794 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:41.807 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:31:41.854 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:41.853+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:41.945 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:41.941+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:41.973 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:41.973 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:41.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:31:42.046 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:42.043+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:42.147 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:42.147+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:42.188 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:42.188 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:42.205 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:31:42.248 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:42.245+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:42.338 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:42.338 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:42.349 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:42.345+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:42.352 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:31:42.449 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:42.445+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:42.476 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:42.490 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:31:42.551 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:42.547+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:42.615 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:42.616 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:42.630 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:42.674 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:42.671+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:42.752 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:42.749+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:42.796 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:42.796 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:42.811 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:42.853 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:42.849+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:42.934 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:42.935 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:42.949 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:42.994 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:42.991+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:43.056 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:43.051+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:43.066 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:43.066 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:43.074 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:31:43.080 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:43.166 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:43.163+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:43.250 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:43.250 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:43.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:43.257 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:43.258 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:43.255+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:43.264 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:43.278 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:43.278 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:43.293 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:43.293 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:43.312 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:43.312 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:43.330 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:43.331 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:43.358 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:43.356+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:43.358 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:43.359 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:43.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:43.377 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:43.397 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:43.397 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:43.431 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:43.431 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:43.431 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:43.432 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:43.432 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:43.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:31:43.446 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:43.462 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:43.460+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:43.562 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:43.559+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:43.573 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:43.573 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:43.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:43.574 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:43.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.574 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:43.574 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:31:43.574 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 74.326652901000003, 2024-04-24T13:31:43.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:31:43.574 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.574 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.574 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.574 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:43.574 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:43.574 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:31:43.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:31:43.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:31:43.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:31:43.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:31:43.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:31:43.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:31:43.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:31:43.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:31:43.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:31:43.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:31:43.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:31:43.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:31:43.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:31:43.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:31:43.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:31:43.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:31:43.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:31:43.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:31:43.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:31:43.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:31:43.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:31:43.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:31:43.581 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.581 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.581 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.581 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:47 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94410010338304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:43.581 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:43.581 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 74.291795187000005, 2024-04-24T13:31:43.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077892999999999999, 2024-04-24T13:31:43.582 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.582 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.582 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.582 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:43.582 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:43.582 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:43.582 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 47 2024-04-24T13:31:43.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.582 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:43.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:31:43.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:31:43.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2770000000000001e-06 2024-04-24T13:31:43.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279179+0000", 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3529999999999999e-05 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279222+0000", 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2743000000000001e-05 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279272+0000", 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0649000000000002e-05 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279772+0000", 2024-04-24T13:31:43.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000500013 2024-04-24T13:31:43.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280011+0000", 2024-04-24T13:31:43.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023840499999999999 2024-04-24T13:31:43.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:31:43.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280408+0000", 2024-04-24T13:31:43.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039756999999999998 2024-04-24T13:31:43.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:43.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282501+0000", 2024-04-24T13:31:43.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020929159999999998 2024-04-24T13:31:43.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:43.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286583+0000", 2024-04-24T13:31:43.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040820530000000004 2024-04-24T13:31:43.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286748+0000", 2024-04-24T13:31:43.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016431200000000001 2024-04-24T13:31:43.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286951+0000", 2024-04-24T13:31:43.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020383200000000001 2024-04-24T13:31:43.587 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.587 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.587 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.587 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:54 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 74.278549193999993, 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024753290000000001, 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 54 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292408+0000", 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292410+0000", 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292419+0000", 2024-04-24T13:31:43.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8680000000000005e-06 2024-04-24T13:31:43.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292445+0000", 2024-04-24T13:31:43.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6207000000000002e-05 2024-04-24T13:31:43.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292458+0000", 2024-04-24T13:31:43.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292597+0000", 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013947100000000001 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.292841+0000", 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024435599999999999 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:43.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.293085+0000", 2024-04-24T13:31:43.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000243212 2024-04-24T13:31:43.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:43.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294263+0000", 2024-04-24T13:31:43.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001178171 2024-04-24T13:31:43.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:43.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294758+0000", 2024-04-24T13:31:43.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00049492199999999996 2024-04-24T13:31:43.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294824+0000", 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6346000000000005e-05 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.294883+0000", 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9222999999999999e-05 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.593 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:55 7.d 7:b4812045:::notify.4:head [watch watch cookie 94410010333696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:43.594 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:31:43.594 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 74.275863306000005, 2024-04-24T13:31:43.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023887449999999998, 2024-04-24T13:31:43.594 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.594 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.594 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:43.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:31:43.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:43.594 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 55 2024-04-24T13:31:43.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.594 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295094+0000", 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295096+0000", 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1660000000000001e-06 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295105+0000", 2024-04-24T13:31:43.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6139999999999992e-06 2024-04-24T13:31:43.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295131+0000", 2024-04-24T13:31:43.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6633000000000001e-05 2024-04-24T13:31:43.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295146+0000", 2024-04-24T13:31:43.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4168999999999999e-05 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295250+0000", 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000104071 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295424+0000", 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017425599999999999 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:43.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.295726+0000", 2024-04-24T13:31:43.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030180000000000002 2024-04-24T13:31:43.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:43.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.296532+0000", 2024-04-24T13:31:43.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080662400000000003 2024-04-24T13:31:43.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:43.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297330+0000", 2024-04-24T13:31:43.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00079793300000000002 2024-04-24T13:31:43.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297392+0000", 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2112000000000004e-05 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.297483+0000", 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0366999999999997e-05 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.599 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:209 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'1, mlcod=0'0)", 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.276335033999999, 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020133299999999998, 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294622+0000", 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294623+0000", 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9999999999999996e-07 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294634+0000", 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1292e-05 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294666+0000", 2024-04-24T13:31:43.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1596e-05 2024-04-24T13:31:43.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294688+0000", 2024-04-24T13:31:43.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2561e-05 2024-04-24T13:31:43.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294842+0000", 2024-04-24T13:31:43.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153494 2024-04-24T13:31:43.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.294893+0000", 2024-04-24T13:31:43.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0983999999999998e-05 2024-04-24T13:31:43.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296547+0000", 2024-04-24T13:31:43.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016536890000000001 2024-04-24T13:31:43.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.296636+0000", 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8913999999999996e-05 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:215 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'2, mlcod=0'0)", 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.245168978999999, 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018794250000000001, 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.604 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325788+0000", 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325790+0000", 2024-04-24T13:31:43.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:31:43.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325809+0000", 2024-04-24T13:31:43.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8590999999999999e-05 2024-04-24T13:31:43.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325846+0000", 2024-04-24T13:31:43.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6875999999999997e-05 2024-04-24T13:31:43.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325868+0000", 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1585000000000001e-05 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.325983+0000", 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115631 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.326022+0000", 2024-04-24T13:31:43.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8618999999999997e-05 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327579+0000", 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015573049999999999 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.327668+0000", 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8588e-05 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:385 6.3 e32/26 6:c60da066:gc::gc.4:head v 32'5, mlcod=32'2)", 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.135264645999996, 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020295980000000001, 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435693+0000", 2024-04-24T13:31:43.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435694+0000", 2024-04-24T13:31:43.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:31:43.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435708+0000", 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3525e-05 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435733+0000", 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5431000000000001e-05 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435752+0000", 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8465e-05 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435897+0000", 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014525000000000001 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.435963+0000", 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6297000000000006e-05 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437645+0000", 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001681395 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.437722+0000", 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7424999999999998e-05 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:437 6.a e32/26 6:55b0279d:reshard::reshard.0000000009:head v 32'4, mlcod=32'1)", 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.105956805000005, 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002915075, 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.613 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465000+0000", 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465002+0000", 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4470000000000001e-06 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465013+0000", 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1532000000000001e-05 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465035+0000", 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1138e-05 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465048+0000", 2024-04-24T13:31:43.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3311e-05 2024-04-24T13:31:43.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465219+0000", 2024-04-24T13:31:43.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017134600000000001 2024-04-24T13:31:43.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.465254+0000", 2024-04-24T13:31:43.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5009999999999999e-05 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467829+0000", 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025744370000000002 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467915+0000", 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6854000000000006e-05 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.618 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:466 6.5 e32/26 6:a4a56432:::obj_delete_at_hint.0000000012:head v 32'5, mlcod=32'3)", 2024-04-24T13:31:43.618 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:31:43.618 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.091030564999997, 2024-04-24T13:31:43.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037830749999999999, 2024-04-24T13:31:43.618 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.618 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.618 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.618 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:31:43.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479927+0000", 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479928+0000", 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7150000000000001e-06 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479941+0000", 2024-04-24T13:31:43.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2999e-05 2024-04-24T13:31:43.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479969+0000", 2024-04-24T13:31:43.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7923999999999999e-05 2024-04-24T13:31:43.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.479986+0000", 2024-04-24T13:31:43.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6388e-05 2024-04-24T13:31:43.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480113+0000", 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127594 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.480167+0000", 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3699999999999997e-05 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483640+0000", 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003472742 2024-04-24T13:31:43.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.483710+0000", 2024-04-24T13:31:43.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0012999999999995e-05 2024-04-24T13:31:43.622 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.622 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.622 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.622 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:468 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'6, mlcod=32'3)", 2024-04-24T13:31:43.622 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:31:43.622 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.088716581, 2024-04-24T13:31:43.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039247960000000004, 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482241+0000", 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482242+0000", 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.57e-06 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482255+0000", 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2418999999999999e-05 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482281+0000", 2024-04-24T13:31:43.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6043000000000001e-05 2024-04-24T13:31:43.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482294+0000", 2024-04-24T13:31:43.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2873e-05 2024-04-24T13:31:43.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482395+0000", 2024-04-24T13:31:43.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101724 2024-04-24T13:31:43.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.482446+0000", 2024-04-24T13:31:43.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0288999999999999e-05 2024-04-24T13:31:43.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486063+0000", 2024-04-24T13:31:43.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036179290000000002 2024-04-24T13:31:43.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.486165+0000", 2024-04-24T13:31:43.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101949 2024-04-24T13:31:43.626 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:473 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'8, mlcod=32'6)", 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.085620634999998, 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034165060000000001, 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485337+0000", 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485338+0000", 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.573e-06 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485350+0000", 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2323e-05 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485377+0000", 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6897e-05 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485397+0000", 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9287999999999999e-05 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485521+0000", 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012448 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.485572+0000", 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0704000000000001e-05 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488640+0000", 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030685589999999998 2024-04-24T13:31:43.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488753+0000", 2024-04-24T13:31:43.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112682 2024-04-24T13:31:43.631 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.631 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.631 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.631 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:474 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'9, mlcod=32'6)", 2024-04-24T13:31:43.631 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:31:43.631 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.083250878000001, 2024-04-24T13:31:43.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045500480000000001, 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487706+0000", 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487708+0000", 2024-04-24T13:31:43.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4389999999999999e-06 2024-04-24T13:31:43.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487718+0000", 2024-04-24T13:31:43.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0386e-05 2024-04-24T13:31:43.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487743+0000", 2024-04-24T13:31:43.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5106999999999999e-05 2024-04-24T13:31:43.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487762+0000", 2024-04-24T13:31:43.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8348000000000001e-05 2024-04-24T13:31:43.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487893+0000", 2024-04-24T13:31:43.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000130968 2024-04-24T13:31:43.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.487926+0000", 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3827e-05 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492194+0000", 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042671499999999999 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.492256+0000", 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2823000000000005e-05 2024-04-24T13:31:43.635 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:476 6.5 e32/26 6:a7f90313:reshard::reshard.0000000012:head v 32'7, mlcod=32'5)", 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.082459005999993, 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059105989999999999, 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488498+0000", 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488500+0000", 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4169999999999999e-06 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488510+0000", 2024-04-24T13:31:43.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0462000000000001e-05 2024-04-24T13:31:43.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488536+0000", 2024-04-24T13:31:43.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6007e-05 2024-04-24T13:31:43.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488553+0000", 2024-04-24T13:31:43.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7037999999999998e-05 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488752+0000", 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019892900000000001 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.488805+0000", 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2800999999999998e-05 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494315+0000", 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055099650000000003 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.494409+0000", 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3980000000000005e-05 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:478 6.3 e32/26 6:c57bc89b:::obj_delete_at_hint.0000000013:head v 32'10, mlcod=32'7)", 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:31:43.640 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.079483171999996, 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055780020000000003, 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491474+0000", 2024-04-24T13:31:43.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491476+0000", 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8479999999999999e-06 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491503+0000", 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7189e-05 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491534+0000", 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1222e-05 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491553+0000", 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9069e-05 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491769+0000", 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000215479 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.491830+0000", 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1169999999999999e-05 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.496974+0000", 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051441860000000002 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497052+0000", 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7838999999999998e-05 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.644 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:484 6.3 e32/26 6:c31f41d7:gc::gc.10:head v 32'11, mlcod=32'8)", 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.073553810999996, 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022050070000000001, 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:31:43.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497403+0000", 2024-04-24T13:31:43.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497405+0000", 2024-04-24T13:31:43.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5889999999999999e-06 2024-04-24T13:31:43.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497418+0000", 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2700999999999999e-05 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497449+0000", 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0911000000000003e-05 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497473+0000", 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4326000000000001e-05 2024-04-24T13:31:43.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497563+0000", 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9652000000000002e-05 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.497589+0000", 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6669000000000002e-05 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499542+0000", 2024-04-24T13:31:43.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0019529180000000001 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.499608+0000", 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6241000000000005e-05 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:511 6.15 e32/26 6:ab569f81:gc::gc.12:head v 32'3, mlcod=32'1)", 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.058503884999993, 2024-04-24T13:31:43.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020247519999999999, 2024-04-24T13:31:43.650 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.650 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.650 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.650 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:31:43.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512453+0000", 2024-04-24T13:31:43.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512455+0000", 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.463e-06 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512464+0000", 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.397e-06 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512488+0000", 2024-04-24T13:31:43.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3502e-05 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512499+0000", 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0908e-05 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512620+0000", 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012119 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.512672+0000", 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2366e-05 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514389+0000", 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017172890000000001 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.514478+0000", 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8636999999999999e-05 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.653 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:544 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'12, mlcod=32'10)", 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.033345960999995, 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020839690000000002, 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:31:43.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537611+0000", 2024-04-24T13:31:43.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537613+0000", 2024-04-24T13:31:43.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7710000000000001e-06 2024-04-24T13:31:43.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537627+0000", 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3580999999999999e-05 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537658+0000", 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1470999999999997e-05 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537680+0000", 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1447e-05 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537779+0000", 2024-04-24T13:31:43.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9049000000000007e-05 2024-04-24T13:31:43.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.537822+0000", 2024-04-24T13:31:43.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3815e-05 2024-04-24T13:31:43.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539590+0000", 2024-04-24T13:31:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017677459999999999 2024-04-24T13:31:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.539695+0000", 2024-04-24T13:31:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105089 2024-04-24T13:31:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:552 6.3 e32/26 6:c623b173:gc::gc.16:head v 32'13, mlcod=32'11)", 2024-04-24T13:31:43.658 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 71.026204788000001, 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031853350000000001, 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544752+0000", 2024-04-24T13:31:43.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544754+0000", 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309999999999999e-06 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544769+0000", 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4259e-05 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544803+0000", 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4650000000000002e-05 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544822+0000", 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8700999999999999e-05 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544956+0000", 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134482 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.544991+0000", 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4953000000000002e-05 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547847+0000", 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028556749999999998 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.547938+0000", 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0784000000000004e-05 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.664 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:705 6.1f e32/26 6:f93251ce:::obj_delete_at_hint.0000000042:head v 32'7, mlcod=32'5)", 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.893487081000004, 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018230220000000001, 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677470+0000", 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677472+0000", 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.731e-06 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677483+0000", 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1025e-05 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677510+0000", 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6894e-05 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677522+0000", 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2367e-05 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677616+0000", 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4239000000000004e-05 2024-04-24T13:31:43.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.677656+0000", 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9681999999999997e-05 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679172+0000", 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015157529999999999 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.679293+0000", 2024-04-24T13:31:43.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012133099999999999 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:709 6.1e e32/26 6:7af5a05b:::obj_delete_at_hint.0000000044:head v 32'1, mlcod=0'0)", 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 70.883069410000004, 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020442059999999998, 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:43.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687888+0000", 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.89e-07 2024-04-24T13:31:43.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687895+0000", 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9959999999999996e-06 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687919+0000", 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3455000000000002e-05 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.687931+0000", 2024-04-24T13:31:43.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2442e-05 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688076+0000", 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014435399999999999 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.688127+0000", 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1910999999999998e-05 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:43.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689827+0000", 2024-04-24T13:31:43.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00169918 2024-04-24T13:31:43.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:43.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:43.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:43.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.689932+0000", 2024-04-24T13:31:43.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105379 2024-04-24T13:31:43.673 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.673 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.673 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.673 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:43.673 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:43.673 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:43.675 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:43.675 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:43.675+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:43.775 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:43.772+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:43.846 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:43.846 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:43.847 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:31:43.847 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:43.860 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:43.876 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:43.872+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:43.977 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:43.971+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:43.982 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:31:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:31:43.982 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:31:43.982 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:43.996 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:44.078 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:44.076+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:44.156 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:44.156 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:44.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:44.156 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:44.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.156 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.156 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:44.156 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.298735407999999, 2024-04-24T13:31:44.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:31:44.156 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:44.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:44.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:31:44.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:31:44.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:31:44.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:31:44.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:31:44.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:31:44.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:31:44.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:31:44.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:31:44.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:31:44.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:31:44.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:31:44.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:31:44.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:31:44.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:31:44.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:31:44.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:31:44.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:31:44.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:31:44.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:31:44.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:31:44.162 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.162 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.162 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.298712633999997, 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.163 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:44.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:44.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:31:44.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:31:44.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:31:44.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:31:44.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:31:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:31:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:31:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:31:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:31:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:31:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:31:44.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:31:44.168 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.201105201000004, 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.169 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.170 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:31:44.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.170 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:44.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:44.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:31:44.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:31:44.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:31:44.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:31:44.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:31:44.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:31:44.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:31:44.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:31:44.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:31:44.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:31:44.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:31:44.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:31:44.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:31:44.175 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.175 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.175 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.175 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.175 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:44.175 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.201017563999997, 2024-04-24T13:31:44.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:31:44.175 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.175 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.175 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.175 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:44.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:31:44.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:31:44.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:31:44.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:31:44.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:31:44.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.095363676999995, 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.181 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.182 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:31:44.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.182 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:44.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:44.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:31:44.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:31:44.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:31:44.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:31:44.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:31:44.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:31:44.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:31:44.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:31:44.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:31:44.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:31:44.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.095159159000005, 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.187 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:44.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:31:44.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:31:44.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:31:44.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:31:44.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:31:44.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:31:44.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:31:44.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:31:44.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:31:44.193 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.193 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.193 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.193 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.193 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:44.193 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.094799335999994, 2024-04-24T13:31:44.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:31:44.193 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.193 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.193 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.193 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:44.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:31:44.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:31:44.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:31:44.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:31:44.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:31:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:31:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:31:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:31:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:31:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:31:44.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:31:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:31:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:31:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:31:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.094630933000005, 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.199 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:44.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:31:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:31:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:31:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:31:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:31:44.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:31:44.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:31:44.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:31:44.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:31:44.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:31:44.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:31:44.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.094422542000004, 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.205 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.206 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.206 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.206 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:31:44.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.206 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:44.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:31:44.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:31:44.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:31:44.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:31:44.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:31:44.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:31:44.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:31:44.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:31:44.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.211 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.211 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.211 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:44.211 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.094324689000004, 2024-04-24T13:31:44.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:31:44.211 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.211 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.211 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.211 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:44.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:31:44.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:31:44.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:31:44.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:31:44.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:31:44.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:31:44.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:31:44.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:31:44.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:31:44.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:31:44.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:31:44.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:31:44.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:31:44.217 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.217 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.217 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.217 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.217 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:44.217 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.094223540000002, 2024-04-24T13:31:44.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:31:44.217 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.217 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.217 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:44.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:31:44.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:31:44.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:31:44.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:31:44.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:31:44.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:31:44.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:31:44.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:31:44.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:31:44.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:31:44.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.093966828000006, 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.223 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.224 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.224 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:31:44.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.224 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:44.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:44.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:31:44.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:31:44.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:31:44.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:31:44.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:31:44.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:31:44.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:31:44.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.093857166000006, 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.229 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:31:44.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.234 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.093785136999998, 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:31:44.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:31:44.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:31:44.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:31:44.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:31:44.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:31:44.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:31:44.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:31:44.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.241 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.241 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:44.241 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.093614101, 2024-04-24T13:31:44.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:31:44.241 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.241 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.241 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.241 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:31:44.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.242 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:44.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:44.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:31:44.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:31:44.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:31:44.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:31:44.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:31:44.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:31:44.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:31:44.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:31:44.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:31:44.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:31:44.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:31:44.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:31:44.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:31:44.246 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.246 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.246 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 95.093574607999997, 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:31:44.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:31:44.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:31:44.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:31:44.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:31:44.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:31:44.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:31:44.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:31:44.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 94.840255352, 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:44.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:44.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:44.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:31:44.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:31:44.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:31:44.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:31:44.258 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.258 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.258 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.258 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.259 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:44.259 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 94.840229304000005, 2024-04-24T13:31:44.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:31:44.259 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.259 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.259 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.259 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.259 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.259 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.259 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:31:44.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.259 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:31:44.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:31:44.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.264 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 94.840203947999996, 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:44.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:44.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:44.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:31:44.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:31:44.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:31:44.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:31:44.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:31:44.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:31:44.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:44.270 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:44.271 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 94.840112879000003, 2024-04-24T13:31:44.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:31:44.271 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:44.271 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:44.271 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.271 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:44.271 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:44.271 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:44.274 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:31:44.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.275 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:44.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:44.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:44.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:44.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:44.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:31:44.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:31:44.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:44.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:31:44.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:31:44.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:44.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:31:44.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:31:44.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:31:44.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:44.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:44.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:44.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:31:44.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:31:44.280 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.280 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.280 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.280 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:44.280 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:44.280 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:44.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:44.282 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:44.276+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:44.382 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:44.380+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:44.404 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:44.404 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:44.405 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:44.405 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:44.412 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:31:44.420 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:44.483 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:44.483+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:44.583 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:44.580+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:44.602 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:44.602 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:44.602 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:44.617 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:44.686 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:44.683+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:44.767 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:44.768 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:44.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:44.768 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:44.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.768 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:31:44.768 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:44.768 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.843384706999998, 2024-04-24T13:31:44.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:31:44.768 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.768 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.768 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:31:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:31:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:31:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:31:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:31:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:31:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:31:44.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.700592936999996, 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:44.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:31:44.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:31:44.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:31:44.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.698289869000007, 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.777 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:44.781 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.696595352000003, 2024-04-24T13:31:44.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:31:44.782 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.782 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.782 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.782 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:44.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:31:44.785 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.786 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.786 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.786 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:31:44.786 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:44.786 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.695137740999996, 2024-04-24T13:31:44.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:31:44.786 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.786 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.786 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.786 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:31:44.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:31:44.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:31:44.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:31:44.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:31:44.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:31:44.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.790 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.790 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:31:44.790 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:44.790 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.693208651999996, 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:31:44.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.794 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.690784115, 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:44.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.689581365999999, 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.799 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:31:44.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:31:44.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:31:44.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:31:44.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:31:44.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:31:44.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.803 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:31:44.804 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:44.804 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.686375201000004, 2024-04-24T13:31:44.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:31:44.804 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.804 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.804 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.804 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:44.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:31:44.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.447319617000005, 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.808 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:31:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:31:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:31:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:31:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:31:44.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:31:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:31:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:31:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:31:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:31:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.812 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.444898965999997, 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:31:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:31:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:31:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:31:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:31:44.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.444125748000005, 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:31:44.817 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:31:44.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:31:44.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.436386694000007, 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:31:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:31:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:31:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:31:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:31:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:31:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:31:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:31:44.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:31:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:31:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:31:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.088424587000006, 2024-04-24T13:31:44.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:31:44.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:31:44.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:31:44.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:31:44.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:31:44.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:31:44.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:31:44.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.830 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.087675838999999, 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:44.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:31:44.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:31:44.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:31:44.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:31:44.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:31:44.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:31:44.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:31:44.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:31:44.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.835 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.835 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.086744714000005, 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:31:44.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:31:44.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.086252923000004, 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.840 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:31:44.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:44.844 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.500171499000004, 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:44.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:31:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:31:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:31:44.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.471324300000006, 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:44.851 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:31:44.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:31:44.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:31:44.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.433133056000003, 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.857 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:31:44.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:31:44.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:31:44.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:44.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:31:44.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:31:44.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:44.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:44.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:44.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:31:44.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:31:44.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:44.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:44.862 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:44.864 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:44.864 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:44.860+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:44.965 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:44.959+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:45.066 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:45.066 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:45.066 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:45.066 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:45.066 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:45.060+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:45.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:45.167 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:45.163+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:45.244 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:45.244 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:45.244 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:45.244 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:45.244 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:45.258 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:45.302 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:45.300+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:45.367 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:45.367 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:45.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 80.149138953999994, 2024-04-24T13:31:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:31:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:45.368 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:31:45.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:31:45.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:31:45.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:31:45.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:31:45.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:31:45.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:31:45.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:31:45.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:31:45.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:31:45.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:45.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.373 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:45.373 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:45.373 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 80.093429873999995, 2024-04-24T13:31:45.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:31:45.373 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.373 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:45.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:45.373 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:31:45.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.374 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:45.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:45.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:31:45.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:31:45.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:31:45.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:31:45.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:31:45.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:31:45.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:31:45.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.378 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 80.089362734000005, 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.379 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:31:45.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:31:45.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:31:45.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:31:45.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:31:45.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:31:45.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:31:45.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:31:45.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:31:45.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:31:45.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:31:45.384 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.384 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.384 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 76.087008842000003, 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:31:45.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:31:45.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:31:45.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 75.985983039999994, 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.389 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.390 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.390 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:31:45.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.390 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:45.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:45.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:31:45.394 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 73.078234049000002, 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.395 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.396 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:31:45.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.396 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:45.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:45.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:31:45.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:31:45.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:31:45.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:31:45.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:31:45.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:31:45.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:31:45.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:31:45.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:31:45.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:31:45.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:31:45.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:31:45.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:31:45.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.401 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.401 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:45.401 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 73.054438077, 2024-04-24T13:31:45.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:31:45.401 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.402 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.402 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.402 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:31:45.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.402 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:45.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 73.027742957000001, 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.407 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:45.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:31:45.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:31:45.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:31:45.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:31:45.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:31:45.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:31:45.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:31:45.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:31:45.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:31:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:31:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:31:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:31:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:31:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:31:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:31:45.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:31:45.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:31:45.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.413 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.413 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:45.413 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 73.010001036000006, 2024-04-24T13:31:45.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:31:45.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:31:45.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:31:45.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:31:45.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:31:45.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.419 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.976830828000004, 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:31:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:31:45.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:31:45.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:31:45.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:31:45.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:31:45.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.425 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.928798620999999, 2024-04-24T13:31:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:31:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:31:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:31:45.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:31:45.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.431 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:45.432 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.902550966000007, 2024-04-24T13:31:45.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:31:45.432 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.432 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.432 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.432 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.432 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.432 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.432 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:31:45.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.432 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:31:45.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:31:45.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:31:45.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:31:45.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:31:45.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:45.437 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.843168563000006, 2024-04-24T13:31:45.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:31:45.438 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.438 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.438 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.438 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.438 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.438 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.438 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:31:45.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.438 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:31:45.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:31:45.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:31:45.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:31:45.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:31:45.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:31:45.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:31:45.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:31:45.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:31:45.443 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.443 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.443 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.444 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.444 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:45.444 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.794701455999999, 2024-04-24T13:31:45.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:31:45.444 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.444 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.444 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.444 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.444 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.444 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.444 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:31:45.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.444 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:31:45.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.449 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.409010882999993, 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:31:45.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:31:45.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:31:45.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:31:45.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:31:45.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:45.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:31:45.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:31:45.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:31:45.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:31:45.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:31:45.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:31:45.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.455 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.214922987999998, 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:31:45.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:31:45.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:31:45.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:31:45.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:31:45.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.461 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:45.462 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.210909715, 2024-04-24T13:31:45.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:31:45.462 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.462 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.462 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.462 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.462 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.462 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.462 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:31:45.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.462 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:31:45.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:31:45.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:31:45.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:31:45.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:31:45.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:31:45.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:31:45.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:31:45.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:31:45.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:31:45.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.467 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:45.468 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.178856576000001, 2024-04-24T13:31:45.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:31:45.468 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.468 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.468 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.468 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.468 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.468 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.468 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:31:45.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.468 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:31:45.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:31:45.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:31:45.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:31:45.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:31:45.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:31:45.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.473 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.474 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:45.474 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.174312575000002, 2024-04-24T13:31:45.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:31:45.474 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.474 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.474 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.474 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.474 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.474 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.474 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:31:45.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.474 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:45.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:45.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:45.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:31:45.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:31:45.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:31:45.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:31:45.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:31:45.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:31:45.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.480 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:45.480 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:45.480 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.141161568000001, 2024-04-24T13:31:45.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:31:45.480 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:45.480 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:45.480 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:45.480 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:45.480 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:45.480 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:45.480 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:31:45.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.480 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:31:45.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:45.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:31:45.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:31:45.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:45.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:31:45.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:31:45.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:45.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:31:45.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:31:45.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:31:45.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:45.485 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:45.486 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:45.486 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:31:45.487 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:45.487+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:45.488 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:45.588 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:45.584+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:45.688 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:45.684+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:45.693 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:45.693 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:45.693 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:45.693 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:45.694 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:45.694 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:45.712 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:45.712 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:45.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:45.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:45.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:45.755 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:45.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:45.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:45.776 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:45.789 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:45.783+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:45.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:45.796 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:45.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:45.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:45.836 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:45.836 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:45.854 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:45.854 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:45.871 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:45.891 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:45.891+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:45.992 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:45.991+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:46.061 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:46.062 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:46.075 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:31:46.092 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:46.087+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:46.181 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:46.181 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:46.193 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:46.187+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:46.194 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:31:46.294 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:46.291+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:46.304 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:46.304 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:46.317 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:31:46.395 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:46.391+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:46.438 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:31:46.439 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:46.439 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:46.456 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:31:46.498 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:46.496+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:46.588 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:46.589 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:46.597 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:46.591+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:46.603 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:31:46.698 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:46.696+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:46.768 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:46.768 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:46.782 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:31:46.799 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:46.796+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:46.900 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:46.895+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:46.904 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:46.904 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:46.918 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:47.006 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:47.003+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:47.085 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:47.085 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:47.099 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:47.102 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:47.096+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:47.202 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:47.200+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:47.268 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:47.269 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:47.283 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:47.303 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:47.300+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:47.403 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:47.405 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:47.406 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:47.403+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:47.418 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:47.438 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:31:47.510 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:47.508+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:47.585 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:47.586 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:47.600 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:47.607 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:47.604+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:47.708 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:47.704+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:47.717 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:47.717 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:47.731 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:47.809 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:47.803+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:47.849 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:47.849 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:47.858 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:31:47.863 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:47.910 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:47.907+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:48.011 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:48.007+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:48.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:48.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:48.033 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:48.033 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:48.047 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:48.062 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:48.062 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:48.092 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:48.092 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:48.122 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:48.123 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:48.134 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:48.131+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:48.153 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:48.153 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:48.185 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:48.185 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:48.212 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:48.207+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:48.216 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:48.216 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:48.217 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:48.217 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:48.231 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:48.248 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:48.248 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:48.318 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:48.315+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:48.402 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:48.402 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:48.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:48.402 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:48.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.402 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.402 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:48.402 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.542344213999996, 2024-04-24T13:31:48.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:31:48.402 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.402 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:31:48.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:31:48.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:31:48.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:31:48.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:31:48.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:31:48.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:31:48.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:31:48.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:31:48.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.408 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.542321439999995, 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:31:48.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.444714007000002, 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.414 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:48.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:48.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:31:48.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:31:48.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:31:48.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:31:48.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:31:48.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:31:48.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:31:48.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:31:48.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.444626369999995, 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:31:48.420 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.421 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.421 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.421 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.421 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.421 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.421 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:31:48.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.421 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:48.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:31:48.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:31:48.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:31:48.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:31:48.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:31:48.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:31:48.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:31:48.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:31:48.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.426 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.426 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.426 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:48.426 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.338972483000006, 2024-04-24T13:31:48.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:31:48.427 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.427 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.427 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.427 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:31:48.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.427 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:48.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:48.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:31:48.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:31:48.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:31:48.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:31:48.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:31:48.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:31:48.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:31:48.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:31:48.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:31:48.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:31:48.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:31:48.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:31:48.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:31:48.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.432 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.338767965000002, 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:48.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:48.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:31:48.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:31:48.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:31:48.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:31:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:31:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:31:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:31:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:31:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:31:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.438 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.439 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:48.439 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.338408142000006, 2024-04-24T13:31:48.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:31:48.439 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.439 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.439 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.439 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.439 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.439 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.439 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:31:48.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.439 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:31:48.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:31:48.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:31:48.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:31:48.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:31:48.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:31:48.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.444 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.338239739000002, 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:48.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:48.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:31:48.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:31:48.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:31:48.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:31:48.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:31:48.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:31:48.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:31:48.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:31:48.450 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.450 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.450 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.450 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.450 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:48.450 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.338031348000001, 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:48.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:31:48.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:31:48.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:31:48.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:31:48.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:31:48.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:31:48.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:31:48.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.337933495000001, 2024-04-24T13:31:48.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:48.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:31:48.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:31:48.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:31:48.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:31:48.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:31:48.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:31:48.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:31:48.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.463 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.463 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:48.463 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.337832345999999, 2024-04-24T13:31:48.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:31:48.463 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.463 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.463 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.463 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.463 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.463 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.463 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:31:48.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.463 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:48.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:48.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:31:48.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:31:48.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:31:48.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:31:48.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:31:48.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:31:48.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.468 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.337575634000004, 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:48.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:48.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:31:48.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:31:48.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:31:48.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:31:48.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:31:48.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:31:48.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:31:48.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:31:48.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:31:48.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:31:48.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:31:48.474 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.474 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.474 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.474 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.474 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.337465972000004, 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:48.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:31:48.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:31:48.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:31:48.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:31:48.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:31:48.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:31:48.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:31:48.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:31:48.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.337393942999995, 2024-04-24T13:31:48.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:31:48.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:31:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:31:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.337222906999997, 2024-04-24T13:31:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:31:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.486 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:31:48.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:31:48.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.337183413999995, 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.492 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:31:48.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:31:48.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:31:48.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:31:48.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:31:48.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:31:48.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:31:48.497 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.497 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.083864157999997, 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.498 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:31:48.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:31:48.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.083838110000002, 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.504 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:31:48.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:31:48.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:31:48.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:31:48.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:31:48.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:31:48.509 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.509 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.509 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.509 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.509 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.083812753999993, 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:31:48.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:31:48.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:31:48.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:31:48.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:31:48.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:31:48.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 99.083721685, 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:31:48.515 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:31:48.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:31:48.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:48.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:48.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:48.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:31:48.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:31:48.521 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.521 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.521 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.521 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:48.521 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:48.521 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:48.523 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:48.523+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:48.523 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:48.623 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:48.620+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:48.691 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:48.691 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:48.691 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:48.708 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:48.754 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:48.752+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:48.825 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:48.823+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:48.921 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:48.922 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:48.922 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:48.922 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:48.922 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:48.925 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:48.919+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:48.940 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:49.026 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:49.024+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:49.109 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:49.109 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:49.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:49.110 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:49.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.110 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:31:49.110 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:49.110 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.1844299, 2024-04-24T13:31:49.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:31:49.110 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.110 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.110 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.110 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:31:49.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:31:49.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:31:49.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:31:49.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:31:49.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:31:49.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:31:49.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:31:49.114 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:49.115 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.04163813, 2024-04-24T13:31:49.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:31:49.115 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.115 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.115 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:49.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:49.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:31:49.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:31:49.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:31:49.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:31:49.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:31:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:31:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:31:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:31:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:31:49.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.03933506200001, 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:31:49.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:31:49.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.037640545, 2024-04-24T13:31:49.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:49.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:31:49.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:31:49.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:31:49.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:31:49.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:31:49.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:31:49.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:31:49.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:31:49.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:31:49.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.128 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.129 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.129 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:31:49.129 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:49.129 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.036182934, 2024-04-24T13:31:49.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:31:49.129 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.129 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.129 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:49.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:49.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:31:49.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:49.133 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.03425384499999, 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:49.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:31:49.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:31:49.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:31:49.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:31:49.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:31:49.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:31:49.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:31:49.137 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.138 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.138 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:31:49.138 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:49.138 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.031829308, 2024-04-24T13:31:49.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:31:49.138 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.138 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.138 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.138 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:49.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:49.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:31:49.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:31:49.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:31:49.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:31:49.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:31:49.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:31:49.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:31:49.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:31:49.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:31:49.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:31:49.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:31:49.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:31:49.142 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.030626559, 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:49.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:49.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:31:49.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:31:49.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:31:49.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:31:49.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:31:49.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:31:49.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:31:49.147 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.147 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.147 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.147 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:31:49.147 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.027420394, 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:31:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:31:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:31:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:31:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:31:49.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:31:49.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:31:49.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:31:49.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:31:49.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:31:49.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:31:49.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:31:49.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.155 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 99.788364810000004, 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:31:49.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:31:49.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:31:49.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:31:49.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:31:49.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 99.785944158999996, 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.160 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:31:49.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:49.164 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 99.785170941000004, 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:31:49.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:31:49.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.169 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:31:49.169 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:49.169 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 99.777431887000006, 2024-04-24T13:31:49.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:31:49.169 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.169 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.169 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:49.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:49.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:31:49.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:31:49.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:31:49.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:31:49.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:31:49.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:31:49.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:31:49.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.174 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:31:49.174 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:49.174 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 99.429469780000005, 2024-04-24T13:31:49.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:31:49.174 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.174 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.174 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.174 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:31:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:31:49.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:31:49.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:31:49.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:31:49.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:31:49.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:31:49.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:31:49.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:31:49.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:31:49.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:31:49.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:31:49.178 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.178 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.178 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 99.428721031999999, 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:49.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:31:49.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:31:49.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:31:49.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:31:49.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:31:49.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:31:49.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:31:49.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:31:49.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:31:49.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:31:49.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:31:49.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:31:49.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:31:49.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:31:49.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:31:49.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:31:49.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.183 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.184 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:31:49.184 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:49.184 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 99.427789907000005, 2024-04-24T13:31:49.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:31:49.184 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.184 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.184 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:31:49.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:31:49.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:31:49.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:31:49.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:31:49.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:31:49.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:31:49.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:31:49.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:31:49.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:31:49.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:49.188 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 99.427298116000003, 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:49.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:31:49.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:31:49.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:31:49.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:31:49.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:31:49.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:31:49.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:31:49.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:31:49.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:31:49.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:31:49.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:31:49.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:31:49.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.193 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:49.194 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 76.841216692000003, 2024-04-24T13:31:49.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:31:49.194 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.194 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.194 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.194 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.194 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.194 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:31:49.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.194 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:31:49.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:31:49.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:31:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:31:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:31:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:31:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 76.812369493000006, 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.200 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:31:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:31:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:31:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:31:49.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:31:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:31:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:31:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:31:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:31:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:31:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:31:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:49.206 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 76.774178249000002, 2024-04-24T13:31:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:31:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:31:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:31:49.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:31:49.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:31:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:31:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:31:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.212 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:49.214 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:49.214 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:49.208+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:49.314 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:49.312+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:49.415 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:49.412+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:49.431 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:49.450 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:49.466 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:31:49.515 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:49.515+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:49.616 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:49.615+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:49.662 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:49.662 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:49.662 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:49.662 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:49.662 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:49.681 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:49.718 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:49.715+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:49.819 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:49.815+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:49.853 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:49.853 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:49.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:49.853 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:49.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.853 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:49.853 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:49.853 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 84.634210100999994, 2024-04-24T13:31:49.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:31:49.853 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.853 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:49.854 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.854 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:49.854 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:49.854 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:31:49.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.854 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:49.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:31:49.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:31:49.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:31:49.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:31:49.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:31:49.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:31:49.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:31:49.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.858 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.858 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:49.858 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:49.858 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 84.578501020999994, 2024-04-24T13:31:49.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:31:49.858 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:31:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:49.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:31:49.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:31:49.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:31:49.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:31:49.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 84.574433881000004, 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.864 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:49.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:31:49.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:31:49.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:31:49.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:31:49.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:31:49.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:31:49.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:31:49.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:31:49.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:31:49.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:31:49.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:31:49.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.870 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:31:49.870 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:49.870 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 80.572079989000002, 2024-04-24T13:31:49.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:31:49.870 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.871 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.871 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:49.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:49.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:31:49.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:31:49.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:31:49.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:31:49.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:31:49.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:31:49.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:31:49.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:31:49.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:31:49.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:31:49.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:31:49.874 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.874 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 80.471054186999993, 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:31:49.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:31:49.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:31:49.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:31:49.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:31:49.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:31:49.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:31:49.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:31:49.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.563305196000002, 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.881 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:49.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:49.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.886 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.539509224, 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:31:49.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:31:49.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:31:49.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:31:49.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:31:49.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:31:49.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.512814104, 2024-04-24T13:31:49.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:49.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:31:49.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:31:49.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:31:49.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:31:49.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:31:49.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:31:49.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:31:49.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:31:49.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:31:49.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:31:49.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:31:49.898 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.898 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.898 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.898 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.898 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:49.898 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.495072183000005, 2024-04-24T13:31:49.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:31:49.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:31:49.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:31:49.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:31:49.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:31:49.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:31:49.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:31:49.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:31:49.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:31:49.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:31:49.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:31:49.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:31:49.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:31:49.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:31:49.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:31:49.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:31:49.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:31:49.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:31:49.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:31:49.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:31:49.904 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.904 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.904 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.461901975000004, 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.905 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:49.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:49.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:31:49.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:31:49.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:31:49.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:31:49.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:31:49.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:31:49.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:31:49.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:31:49.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:31:49.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:31:49.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:31:49.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:31:49.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:31:49.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:31:49.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:31:49.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:31:49.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:31:49.910 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.910 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.413869767999998, 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:31:49.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:31:49.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:31:49.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:31:49.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:31:49.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:31:49.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:31:49.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:31:49.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:31:49.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:31:49.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:31:49.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:31:49.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.387622113000006, 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.917 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.922 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.328239710000005, 2024-04-24T13:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:31:49.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:31:49.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:49.928 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 77.279772602999998, 2024-04-24T13:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 76.894082030000007, 2024-04-24T13:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:31:49.934 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:31:49.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:49.940 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 76.699994134999997, 2024-04-24T13:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:31:49.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:31:49.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.946 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 76.695980861999999, 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:31:49.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:31:49.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:49.952 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 76.663927723, 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:49.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:31:49.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:31:49.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:49.958 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 76.659383722000001, 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:49.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:31:49.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 76.626232715, 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:31:49.964 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:31:49.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:31:49.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:49.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:49.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:49.970 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:49.972 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:49.972 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:49.967+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:50.066 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-24T13:31:50.067 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-24T13:31:50.110 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:50.108+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:50.140 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:50.140 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:50.140 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:50.140 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:50.159 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:50.173 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:50.167+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:50.269 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:31:50.273 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:50.267+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:50.373 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:50.368+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:50.375 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:50.395 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:50.444 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:31:50.474 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:50.471+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:50.492 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:50.492 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:50.523 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:50.523 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:50.554 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:50.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:50.575 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:50.572+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:50.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:50.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:50.618 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:50.618 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:50.620 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:50.620 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:50.640 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:31:50.651 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:50.652 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:50.684 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:50.684 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:50.684 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:50.680+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:50.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:50.717 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:50.778 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:50.775+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:50.822 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:50.822 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:50.841 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:31:50.886 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:50.884+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:50.979 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:50.976+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:51.011 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:51.011 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:51.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:31:51.114 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:51.112+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:51.180 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:51.179+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:51.240 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:51.241 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:51.258 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:31:51.298 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:51.296+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:51.382 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:51.383+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:51.391 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:51.391 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:51.405 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:31:51.453 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.0 to 1 (10000) 2024-04-24T13:31:51.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-24T13:31:51.527 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:51.524+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:51.570 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:51.570 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:51.585 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:31:51.585 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:51.583+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:51.685 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:51.683+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:51.751 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:51.751 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:51.766 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:51.811 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:51.811+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:51.887 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:51.884+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:51.935 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:51.936 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:51.951 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:51.998 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:51.999+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:52.074 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:52.074 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:52.088 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:52.131 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:52.131+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:52.190 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:52.187+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:52.252 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:52.252 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:52.266 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:52.290 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:52.288+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:52.391 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:52.388+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:52.433 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:52.434 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:52.448 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:52.466 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.1 to 1 (10000) 2024-04-24T13:31:52.481 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:31:52.492 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-24T13:31:52.494 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:52.495+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:52.572 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:52.573 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:52.588 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:52.592 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:52.588+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:52.693 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:52.690+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:52.741 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:31:52.754 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:52.754 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:52.768 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:52.794 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:52.792+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:52.895 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:52.894+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:52.928 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:52.928 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:52.938 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:52.938 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:52.943 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:52.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:52.968 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:52.998 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:52.998 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:53.028 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:53.028 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:53.030 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:53.030+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:53.058 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:53.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:53.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:53.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:53.096 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:53.094+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:53.111 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:53.111 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:53.125 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:53.126 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:53.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:53.156 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:53.156 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:53.218 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:53.216+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:53.291 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:31:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:31:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:31:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:31:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.43330996100001, 2024-04-24T13:31:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:31:53.292 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.292 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.292 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.292 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.292 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.292 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:31:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:31:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:31:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:31:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:31:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:31:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:31:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:31:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:31:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:31:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:31:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:31:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:31:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:31:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:31:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:31:53.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:31:53.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:31:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:31:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.433287187, 2024-04-24T13:31:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:31:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:31:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:31:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:31:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:31:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:31:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:31:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:31:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:31:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:31:53.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:31:53.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:31:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:31:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:31:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:31:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:31:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:31:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:31:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:31:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.335679754, 2024-04-24T13:31:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:31:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:31:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:31:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:31:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:31:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:31:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:31:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:31:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:31:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:31:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:31:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:31:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:31:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:31:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:31:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:31:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:31:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:31:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.335592117, 2024-04-24T13:31:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:31:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:31:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:31:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:31:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:31:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:31:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:31:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:31:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:31:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:31:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:31:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:31:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.22993823, 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:31:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:31:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:31:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:31:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:31:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:31:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:31:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:31:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:31:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:31:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:31:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:31:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:31:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:31:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:31:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:31:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:31:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:31:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.229733712, 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:31:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:31:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:31:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:31:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:31:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:31:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:31:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:31:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:31:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:31:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.229373889, 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:31:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:31:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:31:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:31:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:31:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:31:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:31:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:31:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:31:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:31:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:31:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:31:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.229205486, 2024-04-24T13:31:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:31:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:31:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:31:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:31:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:31:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:31:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:31:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:31:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:31:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:31:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:31:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:31:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:31:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:31:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:31:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:31:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:31:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:31:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.228997095, 2024-04-24T13:31:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:31:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:31:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:31:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:31:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:31:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:31:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:31:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:31:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:31:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:31:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:31:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:31:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:31:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:31:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:31:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.228899242, 2024-04-24T13:31:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:31:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:31:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:31:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:31:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:31:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:31:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:31:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:31:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:31:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:31:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:31:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:31:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:31:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:31:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:31:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:31:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:31:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.22879809299999, 2024-04-24T13:31:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:31:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:31:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:31:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:31:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:31:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:31:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:31:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:31:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:31:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:31:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:31:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:31:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:31:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:31:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:31:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.228541381, 2024-04-24T13:31:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:31:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:31:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:31:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:31:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:31:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:31:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:31:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:31:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:31:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:31:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:31:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:31:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:31:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:31:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:31:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.228431719, 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:31:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:31:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:31:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:31:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:31:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:31:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:31:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:31:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:31:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:31:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:31:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:31:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:31:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.22835969, 2024-04-24T13:31:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:31:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:31:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:31:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:31:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:31:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:31:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:31:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:31:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:31:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:31:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:31:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.22818865399999, 2024-04-24T13:31:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:31:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:31:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:31:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:31:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:31:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:31:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:31:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:31:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:31:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:31:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:31:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:31:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:31:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 104.228149161, 2024-04-24T13:31:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:31:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:31:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:31:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:31:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:31:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:31:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:31:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:31:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:31:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:31:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:31:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:31:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:31:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:31:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 103.97482990500001, 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:31:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:31:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:31:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:31:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:31:53.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:31:53.406 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.406 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.406 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.406 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.407 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:53.407 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 103.974803857, 2024-04-24T13:31:53.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:31:53.407 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.407 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.407 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.407 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.407 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.408 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.408 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:31:53.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.408 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:53.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:31:53.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:31:53.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:31:53.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:31:53.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:31:53.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:31:53.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:31:53.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:31:53.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:31:53.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.414 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.414 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:53.414 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 103.974778501, 2024-04-24T13:31:53.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:31:53.414 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.414 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.414 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.414 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.414 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.414 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.415 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:31:53.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.415 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:53.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:53.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:31:53.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:31:53.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:31:53.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:31:53.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:31:53.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:31:53.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:31:53.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:31:53.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:31:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:31:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:31:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 103.974687432, 2024-04-24T13:31:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:31:53.421 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:31:53.422 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:31:53.422 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.422 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:31:53.422 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:31:53.422 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:31:53.422 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:31:53.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.422 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:31:53.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:31:53.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:31:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:31:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:31:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:31:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:31:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:31:53.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:31:53.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:31:53.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:31:53.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:31:53.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:31:53.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:31:53.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:31:53.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:53.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:31:53.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:31:53.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:31:53.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:31:53.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:31:53.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:31:53.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:31:53.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:31:53.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:31:53.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:31:53.427 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.427 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.427 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.427 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:31:53.427 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:31:53.428 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:31:53.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:53.430 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:53.424+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:53.477 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.2 to 1 (10000) 2024-04-24T13:31:53.478 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:31:53.511 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-24T13:31:53.554 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:53.552+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:53.604 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:53.605 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:53.605 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:53.625 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:53.631 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:53.630+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:53.732 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:53.730+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:53.802 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:53.802 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:53.802 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:53.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:53.832 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:53.830+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:53.933 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:53.928+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:53.994 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:53.994 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.069225745, 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:53.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:53.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:53.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:31:53.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:31:53.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:53.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:53.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:53.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:31:53.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:31:53.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:53.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:53.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:53.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:31:53.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:31:53.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:31:53.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:31:53.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:53.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:53.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:53.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:31:53.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:31:53.999 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:53.999 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:53.999 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:53.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:53.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:53.999 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:31:53.999 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:53.999 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.92643397499999, 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:54.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:31:54.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:31:54.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:31:54.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:31:54.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.92413090700001, 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.004 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:31:54.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:54.008 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.92243639, 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:54.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:31:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:31:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:31:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:31:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:31:54.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.920978779, 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:31:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:31:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:31:54.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.91904968999999, 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:31:54.018 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:31:54.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.916625153, 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:54.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:31:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:31:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:31:54.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.915422404, 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:31:54.027 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:31:54.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:31:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:31:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:31:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:31:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.031 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.912216239, 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:54.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.673160655, 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.036 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:31:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:31:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:31:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:31:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:31:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:31:54.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:31:54.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.670740004, 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:31:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:31:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:31:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:31:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:31:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:31:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:31:54.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:31:54.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.669966786, 2024-04-24T13:31:54.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:31:54.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.66222773200001, 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:54.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:31:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:31:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:31:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:31:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:31:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:31:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:31:54.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.314265625, 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:31:54.054 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:31:54.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:31:54.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:31:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:31:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:31:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:31:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:31:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.313516877, 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:54.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.312585752, 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.063 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:31:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:31:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:31:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:31:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:31:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:31:54.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.312093961, 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:31:54.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.726012537000003, 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.072 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:54.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:31:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:31:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:31:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:31:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:31:54.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.697165338000005, 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:54.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:54.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:31:54.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:31:54.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:31:54.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:31:54.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:31:54.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:31:54.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:31:54.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:31:54.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:31:54.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:31:54.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:31:54.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:31:54.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.084 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.085 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.085 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:54.085 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.658974094000001, 2024-04-24T13:31:54.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:31:54.086 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.086 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.086 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.086 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.086 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.086 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:31:54.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.086 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:31:54.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:31:54.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:31:54.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:31:54.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:31:54.091 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.091 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.091 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.091 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.091 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.091 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:54.093 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:54.093 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:54.090+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:54.194 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:54.194+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:54.295 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:54.292+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:54.302 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:54.302 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:54.302 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:54.302 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:54.320 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:54.410 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:54.408+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:54.479 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.3 to 1 (10000) 2024-04-24T13:31:54.497 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:54.494+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:54.508 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-24T13:31:54.535 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:54.535 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:54.535 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:54.535 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:54.535 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:54.555 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:54.598 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:54.596+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:54.698 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:54.692+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:54.773 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:54.773 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:54.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:54.774 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:54.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.774 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:54.774 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:54.774 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 89.554802666, 2024-04-24T13:31:54.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:31:54.774 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.774 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.774 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:54.774 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.774 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:54.774 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:54.774 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.778 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 89.499093586000001, 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:31:54.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:31:54.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 89.495026445999997, 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:31:54.784 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:31:54.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:31:54.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:31:54.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 85.492672553999995, 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:31:54.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:31:54.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:31:54.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 85.391646752, 2024-04-24T13:31:54.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:31:54.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:31:54.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:31:54.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:31:54.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 82.483897760999994, 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.800 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:31:54.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:31:54.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:31:54.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:31:54.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:31:54.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 82.460101789000007, 2024-04-24T13:31:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:31:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:31:54.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:31:54.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:31:54.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:54.811 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 82.433406668999993, 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:31:54.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 82.415664747999998, 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.817 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.822 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 82.382494539999996, 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:31:54.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:31:54.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.828 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 82.334462333000005, 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:54.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:54.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:31:54.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:31:54.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:31:54.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 82.308214677999999, 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:31:54.834 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:31:54.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:31:54.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:31:54.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:31:54.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 82.248832274999998, 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.840 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.841 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:31:54.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.841 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:54.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:31:54.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:31:54.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:31:54.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:31:54.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:31:54.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:31:54.846 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.846 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.846 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.846 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.846 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:54.846 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 82.200365168000005, 2024-04-24T13:31:54.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:31:54.846 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:31:54.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:31:54.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:31:54.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:31:54.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.814674595, 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.852 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.853 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.853 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.853 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:31:54.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.853 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:54.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:31:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:31:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:31:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:31:54.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:31:54.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:31:54.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:31:54.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.620586700000004, 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.858 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:54.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:31:54.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:31:54.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:31:54.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:31:54.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:31:54.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.616573427000006, 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.864 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.865 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.865 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.865 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:31:54.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.865 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:54.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:54.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:31:54.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:31:54.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:31:54.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:31:54.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:31:54.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:31:54.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.584520287999993, 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.870 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:31:54.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:31:54.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:31:54.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.579976286999994, 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:31:54.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 81.546825279999993, 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:54.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:54.882 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:54.882 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:54.882 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:54.882 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:54.882 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:31:54.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.882 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:54.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:54.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:54.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:31:54.886 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.887 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:54.887 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:54.887 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:54.888 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:54.889 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:54.884+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:54.989 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:54.984+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:55.090 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:55.086+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:55.102 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:55.102 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:55.102 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:55.102 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:55.122 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:55.177 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:31:55.190 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:55.190+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:55.291 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:55.290+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:55.341 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:55.341 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:55.341 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:55.341 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:55.342 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:55.361 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:55.392 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:55.390+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:55.418 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:55.418 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:55.448 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:55.449 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:55.483 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:55.483 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:55.492 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.4 to 1 (10000) 2024-04-24T13:31:55.492 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:55.488+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:55.509 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:31:55.513 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:55.513 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:55.523 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:55.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:55.535 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:31:55.539 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-24T13:31:55.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:55.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:55.591 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:55.591 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:55.593 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:55.590+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:55.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:55.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:55.662 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:55.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:55.694 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:55.694+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:55.708 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:55.708 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:55.726 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:31:55.815 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:55.812+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:55.896 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:55.894+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:55.938 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:55.956 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:31:55.998 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:55.996+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:56.097 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:56.094+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:56.107 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:56.107 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:56.120 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:31:56.198 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:56.196+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:56.252 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:56.253 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:56.267 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:31:56.300 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:56.296+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:56.390 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:56.391 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:56.401 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:56.396+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:56.405 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:31:56.495 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.5 to 1 (10000) 2024-04-24T13:31:56.502 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:56.502+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:56.506 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:31:56.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-24T13:31:56.531 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:56.531 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:56.546 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:31:56.626 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:56.624+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:56.704 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:56.702+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:56.712 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:56.726 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:31:56.805 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:56.800+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:56.890 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:56.890 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:56.904 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:31:56.905 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:56.902+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:57.007 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:57.006+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:57.023 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:57.023 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:57.037 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:31:57.107 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:57.104+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:57.201 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:57.201 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:57.209 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:57.206+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:57.215 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:31:57.310 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:57.304+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:57.381 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:57.381 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:57.395 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:31:57.411 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:57.408+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:57.508 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.6 to 1 (10000) 2024-04-24T13:31:57.512 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:57.508+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:57.521 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:57.521 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:57.535 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:31:57.539 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-24T13:31:57.539 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:31:57.627 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:57.624+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:57.658 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:57.658 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:57.672 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:31:57.689 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:31:57.739 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:57.736+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:57.801 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:57.801 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:57.816 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:31:57.816 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:57.814+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:57.890 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:31:57.890 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:31:57.916 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:57.912+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:57.920 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:31:57.921 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:31:57.951 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:31:57.951 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:31:57.980 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:31:57.981 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:31:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:31:57.988 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:31:58.002 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:31:58.012 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:31:58.012 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:31:58.017 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:58.012+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:58.045 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:31:58.045 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:31:58.076 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:31:58.076 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:31:58.107 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:31:58.107 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:31:58.118 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:58.114+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:58.121 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:31:58.131 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:31:58.149 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-04-24T13:31:57.509861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":803,"num_read_kb":546,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":591842,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":529,"ondisk_log_size":529,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":195904,"kb_used_data":6756,"kb_used_omap":10,"kb_used_meta":189045,"kb_avail":660406976,"statfs":{"total":676457349120,"available":676256743424,"internally_reserved":0,"allocated":6918144,"data_stored":4165407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11161,"internal_metadata":193582183},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.032445"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":67,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466231+0000","last_change":"2024-04-24T13:31:00.989667+0000","last_active":"2024-04-24T13:31:52.466231+0000","last_peered":"2024-04-24T13:31:52.466231+0000","last_clean":"2024-04-24T13:31:52.466231+0000","last_became_active":"2024-04-24T13:31:00.989365+0000","last_became_peered":"2024-04-24T13:31:00.989365+0000","last_unstale":"2024-04-24T13:31:52.466231+0000","last_undegraded":"2024-04-24T13:31:52.466231+0000","last_fullsized":"2024-04-24T13:31:52.466231+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:00:51.108396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454154+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:31:51.454154+0000","last_peered":"2024-04-24T13:31:51.454154+0000","last_clean":"2024-04-24T13:31:51.454154+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:31:51.454154+0000","last_undegraded":"2024-04-24T13:31:51.454154+0000","last_fullsized":"2024-04-24T13:31:51.454154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.397035+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:31:52.397035+0000","last_peered":"2024-04-24T13:31:52.397035+0000","last_clean":"2024-04-24T13:31:52.397035+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:31:52.397035+0000","last_undegraded":"2024-04-24T13:31:52.397035+0000","last_fullsized":"2024-04-24T13:31:52.397035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395359+0000","last_change":"2024-04-24T13:30:50.941589+0000","last_active":"2024-04-24T13:31:52.395359+0000","last_peered":"2024-04-24T13:31:52.395359+0000","last_clean":"2024-04-24T13:31:52.395359+0000","last_became_active":"2024-04-24T13:30:50.941305+0000","last_became_peered":"2024-04-24T13:30:50.941305+0000","last_unstale":"2024-04-24T13:31:52.395359+0000","last_undegraded":"2024-04-24T13:31:52.395359+0000","last_fullsized":"2024-04-24T13:31:52.395359+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:23.793119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212409+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:31:52.212409+0000","last_peered":"2024-04-24T13:31:52.212409+0000","last_clean":"2024-04-24T13:31:52.212409+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:31:52.212409+0000","last_undegraded":"2024-04-24T13:31:52.212409+0000","last_fullsized":"2024-04-24T13:31:52.212409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303376+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:31:51.303376+0000","last_peered":"2024-04-24T13:31:51.303376+0000","last_clean":"2024-04-24T13:31:51.303376+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:31:51.303376+0000","last_undegraded":"2024-04-24T13:31:51.303376+0000","last_fullsized":"2024-04-24T13:31:51.303376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456353+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:31:51.456353+0000","last_peered":"2024-04-24T13:31:51.456353+0000","last_clean":"2024-04-24T13:31:51.456353+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:31:51.456353+0000","last_undegraded":"2024-04-24T13:31:51.456353+0000","last_fullsized":"2024-04-24T13:31:51.456353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210367+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:31:52.210367+0000","last_peered":"2024-04-24T13:31:52.210367+0000","last_clean":"2024-04-24T13:31:52.210367+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:31:52.210367+0000","last_undegraded":"2024-04-24T13:31:52.210367+0000","last_fullsized":"2024-04-24T13:31:52.210367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":63,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466028+0000","last_change":"2024-04-24T13:30:50.941360+0000","last_active":"2024-04-24T13:31:52.466028+0000","last_peered":"2024-04-24T13:31:52.466028+0000","last_clean":"2024-04-24T13:31:52.466028+0000","last_became_active":"2024-04-24T13:30:50.940816+0000","last_became_peered":"2024-04-24T13:30:50.940816+0000","last_unstale":"2024-04-24T13:31:52.466028+0000","last_undegraded":"2024-04-24T13:31:52.466028+0000","last_fullsized":"2024-04-24T13:31:52.466028+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:04.247947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465355+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:31:52.465355+0000","last_peered":"2024-04-24T13:31:52.465355+0000","last_clean":"2024-04-24T13:31:52.465355+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:31:52.465355+0000","last_undegraded":"2024-04-24T13:31:52.465355+0000","last_fullsized":"2024-04-24T13:31:52.465355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454695+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:31:51.454695+0000","last_peered":"2024-04-24T13:31:51.454695+0000","last_clean":"2024-04-24T13:31:51.454695+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:31:51.454695+0000","last_undegraded":"2024-04-24T13:31:51.454695+0000","last_fullsized":"2024-04-24T13:31:51.454695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303837+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:31:51.303837+0000","last_peered":"2024-04-24T13:31:51.303837+0000","last_clean":"2024-04-24T13:31:51.303837+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:31:51.303837+0000","last_undegraded":"2024-04-24T13:31:51.303837+0000","last_fullsized":"2024-04-24T13:31:51.303837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210935+0000","last_change":"2024-04-24T13:30:50.911441+0000","last_active":"2024-04-24T13:31:52.210935+0000","last_peered":"2024-04-24T13:31:52.210935+0000","last_clean":"2024-04-24T13:31:52.210935+0000","last_became_active":"2024-04-24T13:30:50.911096+0000","last_became_peered":"2024-04-24T13:30:50.911096+0000","last_unstale":"2024-04-24T13:31:52.210935+0000","last_undegraded":"2024-04-24T13:31:52.210935+0000","last_fullsized":"2024-04-24T13:31:52.210935+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:12.878818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455968+0000","last_change":"2024-04-24T13:30:23.228080+0000","last_active":"2024-04-24T13:31:51.455968+0000","last_peered":"2024-04-24T13:31:51.455968+0000","last_clean":"2024-04-24T13:31:51.455968+0000","last_became_active":"2024-04-24T13:30:23.227215+0000","last_became_peered":"2024-04-24T13:30:23.227215+0000","last_unstale":"2024-04-24T13:31:51.455968+0000","last_undegraded":"2024-04-24T13:31:51.455968+0000","last_fullsized":"2024-04-24T13:31:51.455968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458216+0000","last_change":"2024-04-24T13:30:21.232985+0000","last_active":"2024-04-24T13:31:51.458216+0000","last_peered":"2024-04-24T13:31:51.458216+0000","last_clean":"2024-04-24T13:31:51.458216+0000","last_became_active":"2024-04-24T13:30:21.229584+0000","last_became_peered":"2024-04-24T13:30:21.229584+0000","last_unstale":"2024-04-24T13:31:51.458216+0000","last_undegraded":"2024-04-24T13:31:51.458216+0000","last_fullsized":"2024-04-24T13:31:51.458216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.467097+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:31:52.467097+0000","last_peered":"2024-04-24T13:31:52.467097+0000","last_clean":"2024-04-24T13:31:52.467097+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:31:52.467097+0000","last_undegraded":"2024-04-24T13:31:52.467097+0000","last_fullsized":"2024-04-24T13:31:52.467097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303392+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:31:51.303392+0000","last_peered":"2024-04-24T13:31:51.303392+0000","last_clean":"2024-04-24T13:31:51.303392+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:31:51.303392+0000","last_undegraded":"2024-04-24T13:31:51.303392+0000","last_fullsized":"2024-04-24T13:31:51.303392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456312+0000","last_change":"2024-04-24T13:30:50.945136+0000","last_active":"2024-04-24T13:31:51.456312+0000","last_peered":"2024-04-24T13:31:51.456312+0000","last_clean":"2024-04-24T13:31:51.456312+0000","last_became_active":"2024-04-24T13:30:50.944163+0000","last_became_peered":"2024-04-24T13:30:50.944163+0000","last_unstale":"2024-04-24T13:31:51.456312+0000","last_undegraded":"2024-04-24T13:31:51.456312+0000","last_fullsized":"2024-04-24T13:31:51.456312+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:29.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395187+0000","last_change":"2024-04-24T13:30:50.937742+0000","last_active":"2024-04-24T13:31:52.395187+0000","last_peered":"2024-04-24T13:31:52.395187+0000","last_clean":"2024-04-24T13:31:52.395187+0000","last_became_active":"2024-04-24T13:30:50.937395+0000","last_became_peered":"2024-04-24T13:30:50.937395+0000","last_unstale":"2024-04-24T13:31:52.395187+0000","last_undegraded":"2024-04-24T13:31:52.395187+0000","last_fullsized":"2024-04-24T13:31:52.395187+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:43.335130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465391+0000","last_change":"2024-04-24T13:30:21.244607+0000","last_active":"2024-04-24T13:31:52.465391+0000","last_peered":"2024-04-24T13:31:52.465391+0000","last_clean":"2024-04-24T13:31:52.465391+0000","last_became_active":"2024-04-24T13:30:21.243828+0000","last_became_peered":"2024-04-24T13:30:21.243828+0000","last_unstale":"2024-04-24T13:31:52.465391+0000","last_undegraded":"2024-04-24T13:31:52.465391+0000","last_fullsized":"2024-04-24T13:31:52.465391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454902+0000","last_change":"2024-04-24T13:30:23.220120+0000","last_active":"2024-04-24T13:31:51.454902+0000","last_peered":"2024-04-24T13:31:51.454902+0000","last_clean":"2024-04-24T13:31:51.454902+0000","last_became_active":"2024-04-24T13:30:23.219312+0000","last_became_peered":"2024-04-24T13:30:23.219312+0000","last_unstale":"2024-04-24T13:31:51.454902+0000","last_undegraded":"2024-04-24T13:31:51.454902+0000","last_fullsized":"2024-04-24T13:31:51.454902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465992+0000","last_change":"2024-04-24T13:30:21.243317+0000","last_active":"2024-04-24T13:31:52.465992+0000","last_peered":"2024-04-24T13:31:52.465992+0000","last_clean":"2024-04-24T13:31:52.465992+0000","last_became_active":"2024-04-24T13:30:21.239686+0000","last_became_peered":"2024-04-24T13:30:21.239686+0000","last_unstale":"2024-04-24T13:31:52.465992+0000","last_undegraded":"2024-04-24T13:31:52.465992+0000","last_fullsized":"2024-04-24T13:31:52.465992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465884+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:31:52.465884+0000","last_peered":"2024-04-24T13:31:52.465884+0000","last_clean":"2024-04-24T13:31:52.465884+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:31:52.465884+0000","last_undegraded":"2024-04-24T13:31:52.465884+0000","last_fullsized":"2024-04-24T13:31:52.465884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":99,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305417+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:31:51.305417+0000","last_peered":"2024-04-24T13:31:51.305417+0000","last_clean":"2024-04-24T13:31:51.305417+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:31:51.305417+0000","last_undegraded":"2024-04-24T13:31:51.305417+0000","last_fullsized":"2024-04-24T13:31:51.305417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465458+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:31:52.465458+0000","last_peered":"2024-04-24T13:31:52.465458+0000","last_clean":"2024-04-24T13:31:52.465458+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:31:52.465458+0000","last_undegraded":"2024-04-24T13:31:52.465458+0000","last_fullsized":"2024-04-24T13:31:52.465458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456376+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:31:51.456376+0000","last_peered":"2024-04-24T13:31:51.456376+0000","last_clean":"2024-04-24T13:31:51.456376+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:31:51.456376+0000","last_undegraded":"2024-04-24T13:31:51.456376+0000","last_fullsized":"2024-04-24T13:31:51.456376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303782+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:31:51.303782+0000","last_peered":"2024-04-24T13:31:51.303782+0000","last_clean":"2024-04-24T13:31:51.303782+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:31:51.303782+0000","last_undegraded":"2024-04-24T13:31:51.303782+0000","last_fullsized":"2024-04-24T13:31:51.303782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211506+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:31:52.211506+0000","last_peered":"2024-04-24T13:31:52.211506+0000","last_clean":"2024-04-24T13:31:52.211506+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:31:52.211506+0000","last_undegraded":"2024-04-24T13:31:52.211506+0000","last_fullsized":"2024-04-24T13:31:52.211506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":79,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304039+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:31:51.304039+0000","last_peered":"2024-04-24T13:31:51.304039+0000","last_clean":"2024-04-24T13:31:51.304039+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:31:51.304039+0000","last_undegraded":"2024-04-24T13:31:51.304039+0000","last_fullsized":"2024-04-24T13:31:51.304039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457602+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:31:51.457602+0000","last_peered":"2024-04-24T13:31:51.457602+0000","last_clean":"2024-04-24T13:31:51.457602+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:31:51.457602+0000","last_undegraded":"2024-04-24T13:31:51.457602+0000","last_fullsized":"2024-04-24T13:31:51.457602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":59,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305081+0000","last_change":"2024-04-24T13:30:50.929479+0000","last_active":"2024-04-24T13:31:51.305081+0000","last_peered":"2024-04-24T13:31:51.305081+0000","last_clean":"2024-04-24T13:31:51.305081+0000","last_became_active":"2024-04-24T13:30:50.928545+0000","last_became_peered":"2024-04-24T13:30:50.928545+0000","last_unstale":"2024-04-24T13:31:51.305081+0000","last_undegraded":"2024-04-24T13:31:51.305081+0000","last_fullsized":"2024-04-24T13:31:51.305081+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:26:58.476605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455004+0000","last_change":"2024-04-24T13:30:25.234573+0000","last_active":"2024-04-24T13:31:51.455004+0000","last_peered":"2024-04-24T13:31:51.455004+0000","last_clean":"2024-04-24T13:31:51.455004+0000","last_became_active":"2024-04-24T13:30:25.233807+0000","last_became_peered":"2024-04-24T13:30:25.233807+0000","last_unstale":"2024-04-24T13:31:51.455004+0000","last_undegraded":"2024-04-24T13:31:51.455004+0000","last_fullsized":"2024-04-24T13:31:51.455004+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":119,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212224+0000","last_change":"2024-04-24T13:30:50.953480+0000","last_active":"2024-04-24T13:31:52.212224+0000","last_peered":"2024-04-24T13:31:52.212224+0000","last_clean":"2024-04-24T13:31:52.212224+0000","last_became_active":"2024-04-24T13:30:50.917577+0000","last_became_peered":"2024-04-24T13:30:50.917577+0000","last_unstale":"2024-04-24T13:31:52.212224+0000","last_undegraded":"2024-04-24T13:31:52.212224+0000","last_fullsized":"2024-04-24T13:31:52.212224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:41.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456196+0000","last_change":"2024-04-24T13:30:50.941262+0000","last_active":"2024-04-24T13:31:51.456196+0000","last_peered":"2024-04-24T13:31:51.456196+0000","last_clean":"2024-04-24T13:31:51.456196+0000","last_became_active":"2024-04-24T13:30:50.940446+0000","last_became_peered":"2024-04-24T13:30:50.940446+0000","last_unstale":"2024-04-24T13:31:51.456196+0000","last_undegraded":"2024-04-24T13:31:51.456196+0000","last_fullsized":"2024-04-24T13:31:51.456196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:49.927686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454316+0000","last_change":"2024-04-24T13:30:31.266582+0000","last_active":"2024-04-24T13:31:51.454316+0000","last_peered":"2024-04-24T13:31:51.454316+0000","last_clean":"2024-04-24T13:31:51.454316+0000","last_became_active":"2024-04-24T13:30:31.265452+0000","last_became_peered":"2024-04-24T13:30:31.265452+0000","last_unstale":"2024-04-24T13:31:51.454316+0000","last_undegraded":"2024-04-24T13:31:51.454316+0000","last_fullsized":"2024-04-24T13:31:51.454316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455666+0000","last_change":"2024-04-24T13:30:50.944278+0000","last_active":"2024-04-24T13:31:51.455666+0000","last_peered":"2024-04-24T13:31:51.455666+0000","last_clean":"2024-04-24T13:31:51.455666+0000","last_became_active":"2024-04-24T13:30:50.942787+0000","last_became_peered":"2024-04-24T13:30:50.942787+0000","last_unstale":"2024-04-24T13:31:51.455666+0000","last_undegraded":"2024-04-24T13:31:51.455666+0000","last_fullsized":"2024-04-24T13:31:51.455666+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:06.774961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":105,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211583+0000","last_change":"2024-04-24T13:30:50.915215+0000","last_active":"2024-04-24T13:31:52.211583+0000","last_peered":"2024-04-24T13:31:52.211583+0000","last_clean":"2024-04-24T13:31:52.211583+0000","last_became_active":"2024-04-24T13:30:50.913930+0000","last_became_peered":"2024-04-24T13:30:50.913930+0000","last_unstale":"2024-04-24T13:31:52.211583+0000","last_undegraded":"2024-04-24T13:31:52.211583+0000","last_fullsized":"2024-04-24T13:31:52.211583+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:53.839067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458239+0000","last_change":"2024-04-24T13:30:50.926673+0000","last_active":"2024-04-24T13:31:51.458239+0000","last_peered":"2024-04-24T13:31:51.458239+0000","last_clean":"2024-04-24T13:31:51.458239+0000","last_became_active":"2024-04-24T13:30:50.926286+0000","last_became_peered":"2024-04-24T13:30:50.926286+0000","last_unstale":"2024-04-24T13:31:51.458239+0000","last_undegraded":"2024-04-24T13:31:51.458239+0000","last_fullsized":"2024-04-24T13:31:51.458239+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:21:21.951639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":96,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305813+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:31:51.305813+0000","last_peered":"2024-04-24T13:31:51.305813+0000","last_clean":"2024-04-24T13:31:51.305813+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:31:51.305813+0000","last_undegraded":"2024-04-24T13:31:51.305813+0000","last_fullsized":"2024-04-24T13:31:51.305813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":83,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305650+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:31:51.305650+0000","last_peered":"2024-04-24T13:31:51.305650+0000","last_clean":"2024-04-24T13:31:51.305650+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:31:51.305650+0000","last_undegraded":"2024-04-24T13:31:51.305650+0000","last_fullsized":"2024-04-24T13:31:51.305650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210362+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:31:52.210362+0000","last_peered":"2024-04-24T13:31:52.210362+0000","last_clean":"2024-04-24T13:31:52.210362+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:31:52.210362+0000","last_undegraded":"2024-04-24T13:31:52.210362+0000","last_fullsized":"2024-04-24T13:31:52.210362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210613+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:31:52.210613+0000","last_peered":"2024-04-24T13:31:52.210613+0000","last_clean":"2024-04-24T13:31:52.210613+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:31:52.210613+0000","last_undegraded":"2024-04-24T13:31:52.210613+0000","last_fullsized":"2024-04-24T13:31:52.210613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":59,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304570+0000","last_change":"2024-04-24T13:30:50.946908+0000","last_active":"2024-04-24T13:31:51.304570+0000","last_peered":"2024-04-24T13:31:51.304570+0000","last_clean":"2024-04-24T13:31:51.304570+0000","last_became_active":"2024-04-24T13:30:50.932201+0000","last_became_peered":"2024-04-24T13:30:50.932201+0000","last_unstale":"2024-04-24T13:31:51.304570+0000","last_undegraded":"2024-04-24T13:31:51.304570+0000","last_fullsized":"2024-04-24T13:31:51.304570+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:41.874257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458774+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:31:51.458774+0000","last_peered":"2024-04-24T13:31:51.458774+0000","last_clean":"2024-04-24T13:31:51.458774+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:31:51.458774+0000","last_undegraded":"2024-04-24T13:31:51.458774+0000","last_fullsized":"2024-04-24T13:31:51.458774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465209+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:31:52.465209+0000","last_peered":"2024-04-24T13:31:52.465209+0000","last_clean":"2024-04-24T13:31:52.465209+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:31:52.465209+0000","last_undegraded":"2024-04-24T13:31:52.465209+0000","last_fullsized":"2024-04-24T13:31:52.465209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"42'3","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.394976+0000","last_change":"2024-04-24T13:30:50.933595+0000","last_active":"2024-04-24T13:31:52.394976+0000","last_peered":"2024-04-24T13:31:52.394976+0000","last_clean":"2024-04-24T13:31:52.394976+0000","last_became_active":"2024-04-24T13:30:50.926963+0000","last_became_peered":"2024-04-24T13:30:50.926963+0000","last_unstale":"2024-04-24T13:31:52.394976+0000","last_undegraded":"2024-04-24T13:31:52.394976+0000","last_fullsized":"2024-04-24T13:31:52.394976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":79,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304685+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:31:51.304685+0000","last_peered":"2024-04-24T13:31:51.304685+0000","last_clean":"2024-04-24T13:31:51.304685+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:31:51.304685+0000","last_undegraded":"2024-04-24T13:31:51.304685+0000","last_fullsized":"2024-04-24T13:31:51.304685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458257+0000","last_change":"2024-04-24T13:30:50.921336+0000","last_active":"2024-04-24T13:31:51.458257+0000","last_peered":"2024-04-24T13:31:51.458257+0000","last_clean":"2024-04-24T13:31:51.458257+0000","last_became_active":"2024-04-24T13:30:50.920829+0000","last_became_peered":"2024-04-24T13:30:50.920829+0000","last_unstale":"2024-04-24T13:31:51.458257+0000","last_undegraded":"2024-04-24T13:31:51.458257+0000","last_fullsized":"2024-04-24T13:31:51.458257+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:37.250085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464894+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:31:52.464894+0000","last_peered":"2024-04-24T13:31:52.464894+0000","last_clean":"2024-04-24T13:31:52.464894+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:31:52.464894+0000","last_undegraded":"2024-04-24T13:31:52.464894+0000","last_fullsized":"2024-04-24T13:31:52.464894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455830+0000","last_change":"2024-04-24T13:30:25.229897+0000","last_active":"2024-04-24T13:31:51.455830+0000","last_peered":"2024-04-24T13:31:51.455830+0000","last_clean":"2024-04-24T13:31:51.455830+0000","last_became_active":"2024-04-24T13:30:25.228575+0000","last_became_peered":"2024-04-24T13:30:25.228575+0000","last_unstale":"2024-04-24T13:31:51.455830+0000","last_undegraded":"2024-04-24T13:31:51.455830+0000","last_fullsized":"2024-04-24T13:31:51.455830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465809+0000","last_change":"2024-04-24T13:30:51.001114+0000","last_active":"2024-04-24T13:31:52.465809+0000","last_peered":"2024-04-24T13:31:52.465809+0000","last_clean":"2024-04-24T13:31:52.465809+0000","last_became_active":"2024-04-24T13:30:50.954422+0000","last_became_peered":"2024-04-24T13:30:50.954422+0000","last_unstale":"2024-04-24T13:31:52.465809+0000","last_undegraded":"2024-04-24T13:31:52.465809+0000","last_fullsized":"2024-04-24T13:31:52.465809+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:44.516492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":104,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457978+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:31:51.457978+0000","last_peered":"2024-04-24T13:31:51.457978+0000","last_clean":"2024-04-24T13:31:51.457978+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:31:51.457978+0000","last_undegraded":"2024-04-24T13:31:51.457978+0000","last_fullsized":"2024-04-24T13:31:51.457978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454412+0000","last_change":"2024-04-24T13:30:50.921166+0000","last_active":"2024-04-24T13:31:51.454412+0000","last_peered":"2024-04-24T13:31:51.454412+0000","last_clean":"2024-04-24T13:31:51.454412+0000","last_became_active":"2024-04-24T13:30:50.920255+0000","last_became_peered":"2024-04-24T13:30:50.920255+0000","last_unstale":"2024-04-24T13:31:51.454412+0000","last_undegraded":"2024-04-24T13:31:51.454412+0000","last_fullsized":"2024-04-24T13:31:51.454412+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:21.522361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466629+0000","last_change":"2024-04-24T13:31:01.035289+0000","last_active":"2024-04-24T13:31:52.466629+0000","last_peered":"2024-04-24T13:31:52.466629+0000","last_clean":"2024-04-24T13:31:52.466629+0000","last_became_active":"2024-04-24T13:31:01.034325+0000","last_became_peered":"2024-04-24T13:31:01.034325+0000","last_unstale":"2024-04-24T13:31:52.466629+0000","last_undegraded":"2024-04-24T13:31:52.466629+0000","last_fullsized":"2024-04-24T13:31:52.466629+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:08.322191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":62,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464827+0000","last_change":"2024-04-24T13:30:50.948387+0000","last_active":"2024-04-24T13:31:52.464827+0000","last_peered":"2024-04-24T13:31:52.464827+0000","last_clean":"2024-04-24T13:31:52.464827+0000","last_became_active":"2024-04-24T13:30:50.947644+0000","last_became_peered":"2024-04-24T13:30:50.947644+0000","last_unstale":"2024-04-24T13:31:52.464827+0000","last_undegraded":"2024-04-24T13:31:52.464827+0000","last_fullsized":"2024-04-24T13:31:52.464827+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:03.622375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":120,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454319+0000","last_change":"2024-04-24T13:30:27.261028+0000","last_active":"2024-04-24T13:31:51.454319+0000","last_peered":"2024-04-24T13:31:51.454319+0000","last_clean":"2024-04-24T13:31:51.454319+0000","last_became_active":"2024-04-24T13:30:27.260231+0000","last_became_peered":"2024-04-24T13:30:27.260231+0000","last_unstale":"2024-04-24T13:31:51.454319+0000","last_undegraded":"2024-04-24T13:31:51.454319+0000","last_fullsized":"2024-04-24T13:31:51.454319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395173+0000","last_change":"2024-04-24T13:30:29.256804+0000","last_active":"2024-04-24T13:31:52.395173+0000","last_peered":"2024-04-24T13:31:52.395173+0000","last_clean":"2024-04-24T13:31:52.395173+0000","last_became_active":"2024-04-24T13:30:29.255975+0000","last_became_peered":"2024-04-24T13:30:29.255975+0000","last_unstale":"2024-04-24T13:31:52.395173+0000","last_undegraded":"2024-04-24T13:31:52.395173+0000","last_fullsized":"2024-04-24T13:31:52.395173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:51.521585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455403+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:31:51.455403+0000","last_peered":"2024-04-24T13:31:51.455403+0000","last_clean":"2024-04-24T13:31:51.455403+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:31:51.455403+0000","last_undegraded":"2024-04-24T13:31:51.455403+0000","last_fullsized":"2024-04-24T13:31:51.455403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303376+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:31:51.303376+0000","last_peered":"2024-04-24T13:31:51.303376+0000","last_clean":"2024-04-24T13:31:51.303376+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:31:51.303376+0000","last_undegraded":"2024-04-24T13:31:51.303376+0000","last_fullsized":"2024-04-24T13:31:51.303376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":59,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306600+0000","last_change":"2024-04-24T13:30:50.930041+0000","last_active":"2024-04-24T13:31:51.306600+0000","last_peered":"2024-04-24T13:31:51.306600+0000","last_clean":"2024-04-24T13:31:51.306600+0000","last_became_active":"2024-04-24T13:30:50.929179+0000","last_became_peered":"2024-04-24T13:30:50.929179+0000","last_unstale":"2024-04-24T13:31:51.306600+0000","last_undegraded":"2024-04-24T13:31:51.306600+0000","last_fullsized":"2024-04-24T13:31:51.306600+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:46.987972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":93,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464090+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:31:52.464090+0000","last_peered":"2024-04-24T13:31:52.464090+0000","last_clean":"2024-04-24T13:31:52.464090+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:31:52.464090+0000","last_undegraded":"2024-04-24T13:31:52.464090+0000","last_fullsized":"2024-04-24T13:31:52.464090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":120,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456984+0000","last_change":"2024-04-24T13:30:50.948850+0000","last_active":"2024-04-24T13:31:51.456984+0000","last_peered":"2024-04-24T13:31:51.456984+0000","last_clean":"2024-04-24T13:31:51.456984+0000","last_became_active":"2024-04-24T13:30:50.921374+0000","last_became_peered":"2024-04-24T13:30:50.921374+0000","last_unstale":"2024-04-24T13:31:51.456984+0000","last_undegraded":"2024-04-24T13:31:51.456984+0000","last_fullsized":"2024-04-24T13:31:51.456984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:22:03.728196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457359+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:31:51.457359+0000","last_peered":"2024-04-24T13:31:51.457359+0000","last_clean":"2024-04-24T13:31:51.457359+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:31:51.457359+0000","last_undegraded":"2024-04-24T13:31:51.457359+0000","last_fullsized":"2024-04-24T13:31:51.457359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":81,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465647+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:31:52.465647+0000","last_peered":"2024-04-24T13:31:52.465647+0000","last_clean":"2024-04-24T13:31:52.465647+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:31:52.465647+0000","last_undegraded":"2024-04-24T13:31:52.465647+0000","last_fullsized":"2024-04-24T13:31:52.465647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465426+0000","last_change":"2024-04-24T13:30:23.239143+0000","last_active":"2024-04-24T13:31:52.465426+0000","last_peered":"2024-04-24T13:31:52.465426+0000","last_clean":"2024-04-24T13:31:52.465426+0000","last_became_active":"2024-04-24T13:30:23.238351+0000","last_became_peered":"2024-04-24T13:30:23.238351+0000","last_unstale":"2024-04-24T13:31:52.465426+0000","last_undegraded":"2024-04-24T13:31:52.465426+0000","last_fullsized":"2024-04-24T13:31:52.465426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455480+0000","last_change":"2024-04-24T13:30:50.962698+0000","last_active":"2024-04-24T13:31:51.455480+0000","last_peered":"2024-04-24T13:31:51.455480+0000","last_clean":"2024-04-24T13:31:51.455480+0000","last_became_active":"2024-04-24T13:30:50.962126+0000","last_became_peered":"2024-04-24T13:30:50.962126+0000","last_unstale":"2024-04-24T13:31:51.455480+0000","last_undegraded":"2024-04-24T13:31:51.455480+0000","last_fullsized":"2024-04-24T13:31:51.455480+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.808699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":93,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466154+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:31:52.466154+0000","last_peered":"2024-04-24T13:31:52.466154+0000","last_clean":"2024-04-24T13:31:52.466154+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:31:52.466154+0000","last_undegraded":"2024-04-24T13:31:52.466154+0000","last_fullsized":"2024-04-24T13:31:52.466154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":122,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464005+0000","last_change":"2024-04-24T13:30:50.970163+0000","last_active":"2024-04-24T13:31:52.464005+0000","last_peered":"2024-04-24T13:31:52.464005+0000","last_clean":"2024-04-24T13:31:52.464005+0000","last_became_active":"2024-04-24T13:30:50.920182+0000","last_became_peered":"2024-04-24T13:30:50.920182+0000","last_unstale":"2024-04-24T13:31:52.464005+0000","last_undegraded":"2024-04-24T13:31:52.464005+0000","last_fullsized":"2024-04-24T13:31:52.464005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:29.765956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":103,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210839+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:31:52.210839+0000","last_peered":"2024-04-24T13:31:52.210839+0000","last_clean":"2024-04-24T13:31:52.210839+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:31:52.210839+0000","last_undegraded":"2024-04-24T13:31:52.210839+0000","last_fullsized":"2024-04-24T13:31:52.210839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210705+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:31:52.210705+0000","last_peered":"2024-04-24T13:31:52.210705+0000","last_clean":"2024-04-24T13:31:52.210705+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:31:52.210705+0000","last_undegraded":"2024-04-24T13:31:52.210705+0000","last_fullsized":"2024-04-24T13:31:52.210705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211981+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:31:52.211981+0000","last_peered":"2024-04-24T13:31:52.211981+0000","last_clean":"2024-04-24T13:31:52.211981+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:31:52.211981+0000","last_undegraded":"2024-04-24T13:31:52.211981+0000","last_fullsized":"2024-04-24T13:31:52.211981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457225+0000","last_change":"2024-04-24T13:30:21.228287+0000","last_active":"2024-04-24T13:31:51.457225+0000","last_peered":"2024-04-24T13:31:51.457225+0000","last_clean":"2024-04-24T13:31:51.457225+0000","last_became_active":"2024-04-24T13:30:21.227358+0000","last_became_peered":"2024-04-24T13:30:21.227358+0000","last_unstale":"2024-04-24T13:31:51.457225+0000","last_undegraded":"2024-04-24T13:31:51.457225+0000","last_fullsized":"2024-04-24T13:31:51.457225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:09.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":93,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464734+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:31:52.464734+0000","last_peered":"2024-04-24T13:31:52.464734+0000","last_clean":"2024-04-24T13:31:52.464734+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:31:52.464734+0000","last_undegraded":"2024-04-24T13:31:52.464734+0000","last_fullsized":"2024-04-24T13:31:52.464734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":128,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210957+0000","last_change":"2024-04-24T13:30:51.000083+0000","last_active":"2024-04-24T13:31:52.210957+0000","last_peered":"2024-04-24T13:31:52.210957+0000","last_clean":"2024-04-24T13:31:52.210957+0000","last_became_active":"2024-04-24T13:30:50.934568+0000","last_became_peered":"2024-04-24T13:30:50.934568+0000","last_unstale":"2024-04-24T13:31:52.210957+0000","last_undegraded":"2024-04-24T13:31:52.210957+0000","last_fullsized":"2024-04-24T13:31:52.210957+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:10.436000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":90,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.463921+0000","last_change":"2024-04-24T13:30:50.908390+0000","last_active":"2024-04-24T13:31:52.463921+0000","last_peered":"2024-04-24T13:31:52.463921+0000","last_clean":"2024-04-24T13:31:52.463921+0000","last_became_active":"2024-04-24T13:30:50.908013+0000","last_became_peered":"2024-04-24T13:30:50.908013+0000","last_unstale":"2024-04-24T13:31:52.463921+0000","last_undegraded":"2024-04-24T13:31:52.463921+0000","last_fullsized":"2024-04-24T13:31:52.463921+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395823+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:31:52.395823+0000","last_peered":"2024-04-24T13:31:52.395823+0000","last_clean":"2024-04-24T13:31:52.395823+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:31:52.395823+0000","last_undegraded":"2024-04-24T13:31:52.395823+0000","last_fullsized":"2024-04-24T13:31:52.395823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305839+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:31:51.305839+0000","last_peered":"2024-04-24T13:31:51.305839+0000","last_clean":"2024-04-24T13:31:51.305839+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:31:51.305839+0000","last_undegraded":"2024-04-24T13:31:51.305839+0000","last_fullsized":"2024-04-24T13:31:51.305839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456014+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:31:51.456014+0000","last_peered":"2024-04-24T13:31:51.456014+0000","last_clean":"2024-04-24T13:31:51.456014+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:31:51.456014+0000","last_undegraded":"2024-04-24T13:31:51.456014+0000","last_fullsized":"2024-04-24T13:31:51.456014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466462+0000","last_change":"2024-04-24T13:30:50.926692+0000","last_active":"2024-04-24T13:31:52.466462+0000","last_peered":"2024-04-24T13:31:52.466462+0000","last_clean":"2024-04-24T13:31:52.466462+0000","last_became_active":"2024-04-24T13:30:50.926146+0000","last_became_peered":"2024-04-24T13:30:50.926146+0000","last_unstale":"2024-04-24T13:31:52.466462+0000","last_undegraded":"2024-04-24T13:31:52.466462+0000","last_fullsized":"2024-04-24T13:31:52.466462+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:18.637521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":106,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306098+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:31:51.306098+0000","last_peered":"2024-04-24T13:31:51.306098+0000","last_clean":"2024-04-24T13:31:51.306098+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:31:51.306098+0000","last_undegraded":"2024-04-24T13:31:51.306098+0000","last_fullsized":"2024-04-24T13:31:51.306098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":84,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212333+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:31:52.212333+0000","last_peered":"2024-04-24T13:31:52.212333+0000","last_clean":"2024-04-24T13:31:52.212333+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:31:52.212333+0000","last_undegraded":"2024-04-24T13:31:52.212333+0000","last_fullsized":"2024-04-24T13:31:52.212333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457444+0000","last_change":"2024-04-24T13:30:31.269459+0000","last_active":"2024-04-24T13:31:51.457444+0000","last_peered":"2024-04-24T13:31:51.457444+0000","last_clean":"2024-04-24T13:31:51.457444+0000","last_became_active":"2024-04-24T13:30:31.268604+0000","last_became_peered":"2024-04-24T13:30:31.268604+0000","last_unstale":"2024-04-24T13:31:51.457444+0000","last_undegraded":"2024-04-24T13:31:51.457444+0000","last_fullsized":"2024-04-24T13:31:51.457444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:57.047113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305866+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:31:51.305866+0000","last_peered":"2024-04-24T13:31:51.305866+0000","last_clean":"2024-04-24T13:31:51.305866+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:31:51.305866+0000","last_undegraded":"2024-04-24T13:31:51.305866+0000","last_fullsized":"2024-04-24T13:31:51.305866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465554+0000","last_change":"2024-04-24T13:31:00.986244+0000","last_active":"2024-04-24T13:31:52.465554+0000","last_peered":"2024-04-24T13:31:52.465554+0000","last_clean":"2024-04-24T13:31:52.465554+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:31:52.465554+0000","last_undegraded":"2024-04-24T13:31:52.465554+0000","last_fullsized":"2024-04-24T13:31:52.465554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:23.355231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395490+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:31:52.395490+0000","last_peered":"2024-04-24T13:31:52.395490+0000","last_clean":"2024-04-24T13:31:52.395490+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:31:52.395490+0000","last_undegraded":"2024-04-24T13:31:52.395490+0000","last_fullsized":"2024-04-24T13:31:52.395490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":114,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466958+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:31:52.466958+0000","last_peered":"2024-04-24T13:31:52.466958+0000","last_clean":"2024-04-24T13:31:52.466958+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:31:52.466958+0000","last_undegraded":"2024-04-24T13:31:52.466958+0000","last_fullsized":"2024-04-24T13:31:52.466958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.467746+0000","last_change":"2024-04-24T13:30:29.259692+0000","last_active":"2024-04-24T13:31:52.467746+0000","last_peered":"2024-04-24T13:31:52.467746+0000","last_clean":"2024-04-24T13:31:52.467746+0000","last_became_active":"2024-04-24T13:30:29.258945+0000","last_became_peered":"2024-04-24T13:30:29.258945+0000","last_unstale":"2024-04-24T13:31:52.467746+0000","last_undegraded":"2024-04-24T13:31:52.467746+0000","last_fullsized":"2024-04-24T13:31:52.467746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:35.346937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395267+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:31:52.395267+0000","last_peered":"2024-04-24T13:31:52.395267+0000","last_clean":"2024-04-24T13:31:52.395267+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:31:52.395267+0000","last_undegraded":"2024-04-24T13:31:52.395267+0000","last_fullsized":"2024-04-24T13:31:52.395267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306487+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:31:51.306487+0000","last_peered":"2024-04-24T13:31:51.306487+0000","last_clean":"2024-04-24T13:31:51.306487+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:31:51.306487+0000","last_undegraded":"2024-04-24T13:31:51.306487+0000","last_fullsized":"2024-04-24T13:31:51.306487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":99,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304344+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:31:51.304344+0000","last_peered":"2024-04-24T13:31:51.304344+0000","last_clean":"2024-04-24T13:31:51.304344+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:31:51.304344+0000","last_undegraded":"2024-04-24T13:31:51.304344+0000","last_fullsized":"2024-04-24T13:31:51.304344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455941+0000","last_change":"2024-04-24T13:30:25.223759+0000","last_active":"2024-04-24T13:31:51.455941+0000","last_peered":"2024-04-24T13:31:51.455941+0000","last_clean":"2024-04-24T13:31:51.455941+0000","last_became_active":"2024-04-24T13:30:25.222877+0000","last_became_peered":"2024-04-24T13:30:25.222877+0000","last_unstale":"2024-04-24T13:31:51.455941+0000","last_undegraded":"2024-04-24T13:31:51.455941+0000","last_fullsized":"2024-04-24T13:31:51.455941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":104,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458754+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:31:51.458754+0000","last_peered":"2024-04-24T13:31:51.458754+0000","last_clean":"2024-04-24T13:31:51.458754+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:31:51.458754+0000","last_undegraded":"2024-04-24T13:31:51.458754+0000","last_fullsized":"2024-04-24T13:31:51.458754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465722+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:31:52.465722+0000","last_peered":"2024-04-24T13:31:52.465722+0000","last_clean":"2024-04-24T13:31:52.465722+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:31:52.465722+0000","last_undegraded":"2024-04-24T13:31:52.465722+0000","last_fullsized":"2024-04-24T13:31:52.465722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":79,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303378+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:31:51.303378+0000","last_peered":"2024-04-24T13:31:51.303378+0000","last_clean":"2024-04-24T13:31:51.303378+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:31:51.303378+0000","last_undegraded":"2024-04-24T13:31:51.303378+0000","last_fullsized":"2024-04-24T13:31:51.303378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395718+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:31:52.395718+0000","last_peered":"2024-04-24T13:31:52.395718+0000","last_clean":"2024-04-24T13:31:52.395718+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:31:52.395718+0000","last_undegraded":"2024-04-24T13:31:52.395718+0000","last_fullsized":"2024-04-24T13:31:52.395718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457971+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:31:51.457971+0000","last_peered":"2024-04-24T13:31:51.457971+0000","last_clean":"2024-04-24T13:31:51.457971+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:31:51.457971+0000","last_undegraded":"2024-04-24T13:31:51.457971+0000","last_fullsized":"2024-04-24T13:31:51.457971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":91,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306313+0000","last_change":"2024-04-24T13:30:25.224875+0000","last_active":"2024-04-24T13:31:51.306313+0000","last_peered":"2024-04-24T13:31:51.306313+0000","last_clean":"2024-04-24T13:31:51.306313+0000","last_became_active":"2024-04-24T13:30:25.224128+0000","last_became_peered":"2024-04-24T13:30:25.224128+0000","last_unstale":"2024-04-24T13:31:51.306313+0000","last_undegraded":"2024-04-24T13:31:51.306313+0000","last_fullsized":"2024-04-24T13:31:51.306313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":117,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454872+0000","last_change":"2024-04-24T13:30:27.261440+0000","last_active":"2024-04-24T13:31:51.454872+0000","last_peered":"2024-04-24T13:31:51.454872+0000","last_clean":"2024-04-24T13:31:51.454872+0000","last_became_active":"2024-04-24T13:30:27.260655+0000","last_became_peered":"2024-04-24T13:30:27.260655+0000","last_unstale":"2024-04-24T13:31:51.454872+0000","last_undegraded":"2024-04-24T13:31:51.454872+0000","last_fullsized":"2024-04-24T13:31:51.454872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":85,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464954+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:31:52.464954+0000","last_peered":"2024-04-24T13:31:52.464954+0000","last_clean":"2024-04-24T13:31:52.464954+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:31:52.464954+0000","last_undegraded":"2024-04-24T13:31:52.464954+0000","last_fullsized":"2024-04-24T13:31:52.464954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395082+0000","last_change":"2024-04-24T13:30:31.264695+0000","last_active":"2024-04-24T13:31:52.395082+0000","last_peered":"2024-04-24T13:31:52.395082+0000","last_clean":"2024-04-24T13:31:52.395082+0000","last_became_active":"2024-04-24T13:30:31.263950+0000","last_became_peered":"2024-04-24T13:30:31.263950+0000","last_unstale":"2024-04-24T13:31:52.395082+0000","last_undegraded":"2024-04-24T13:31:52.395082+0000","last_fullsized":"2024-04-24T13:31:52.395082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:18.381332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465907+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:31:52.465907+0000","last_peered":"2024-04-24T13:31:52.465907+0000","last_clean":"2024-04-24T13:31:52.465907+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:31:52.465907+0000","last_undegraded":"2024-04-24T13:31:52.465907+0000","last_fullsized":"2024-04-24T13:31:52.465907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":225,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211154+0000","last_change":"2024-04-24T13:30:53.928527+0000","last_active":"2024-04-24T13:31:52.211154+0000","last_peered":"2024-04-24T13:31:52.211154+0000","last_clean":"2024-04-24T13:31:52.211154+0000","last_became_active":"2024-04-24T13:30:53.928167+0000","last_became_peered":"2024-04-24T13:30:53.928167+0000","last_unstale":"2024-04-24T13:31:52.211154+0000","last_undegraded":"2024-04-24T13:31:52.211154+0000","last_fullsized":"2024-04-24T13:31:52.211154+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:43.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455369+0000","last_change":"2024-04-24T13:30:15.154142+0000","last_active":"2024-04-24T13:31:51.455369+0000","last_peered":"2024-04-24T13:31:51.455369+0000","last_clean":"2024-04-24T13:31:51.455369+0000","last_became_active":"2024-04-24T13:30:15.153433+0000","last_became_peered":"2024-04-24T13:30:15.153433+0000","last_unstale":"2024-04-24T13:31:51.455369+0000","last_undegraded":"2024-04-24T13:31:51.455369+0000","last_fullsized":"2024-04-24T13:31:51.455369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457744+0000","last_change":"2024-04-24T13:30:21.229655+0000","last_active":"2024-04-24T13:31:51.457744+0000","last_peered":"2024-04-24T13:31:51.457744+0000","last_clean":"2024-04-24T13:31:51.457744+0000","last_became_active":"2024-04-24T13:30:21.229312+0000","last_became_peered":"2024-04-24T13:30:21.229312+0000","last_unstale":"2024-04-24T13:31:51.457744+0000","last_undegraded":"2024-04-24T13:31:51.457744+0000","last_fullsized":"2024-04-24T13:31:51.457744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":63,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465292+0000","last_change":"2024-04-24T13:30:50.926055+0000","last_active":"2024-04-24T13:31:52.465292+0000","last_peered":"2024-04-24T13:31:52.465292+0000","last_clean":"2024-04-24T13:31:52.465292+0000","last_became_active":"2024-04-24T13:30:50.925664+0000","last_became_peered":"2024-04-24T13:30:50.925664+0000","last_unstale":"2024-04-24T13:31:52.465292+0000","last_undegraded":"2024-04-24T13:31:52.465292+0000","last_fullsized":"2024-04-24T13:31:52.465292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:02.798146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":116,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456098+0000","last_change":"2024-04-24T13:30:27.258347+0000","last_active":"2024-04-24T13:31:51.456098+0000","last_peered":"2024-04-24T13:31:51.456098+0000","last_clean":"2024-04-24T13:31:51.456098+0000","last_became_active":"2024-04-24T13:30:27.257694+0000","last_became_peered":"2024-04-24T13:30:27.257694+0000","last_unstale":"2024-04-24T13:31:51.456098+0000","last_undegraded":"2024-04-24T13:31:51.456098+0000","last_fullsized":"2024-04-24T13:31:51.456098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":89,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212319+0000","last_change":"2024-04-24T13:30:50.917737+0000","last_active":"2024-04-24T13:31:52.212319+0000","last_peered":"2024-04-24T13:31:52.212319+0000","last_clean":"2024-04-24T13:31:52.212319+0000","last_became_active":"2024-04-24T13:30:50.916920+0000","last_became_peered":"2024-04-24T13:30:50.916920+0000","last_unstale":"2024-04-24T13:31:52.212319+0000","last_undegraded":"2024-04-24T13:31:52.212319+0000","last_fullsized":"2024-04-24T13:31:52.212319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:12.813827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":81,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464612+0000","last_change":"2024-04-24T13:30:31.272077+0000","last_active":"2024-04-24T13:31:52.464612+0000","last_peered":"2024-04-24T13:31:52.464612+0000","last_clean":"2024-04-24T13:31:52.464612+0000","last_became_active":"2024-04-24T13:30:31.271268+0000","last_became_peered":"2024-04-24T13:30:31.271268+0000","last_unstale":"2024-04-24T13:31:52.464612+0000","last_undegraded":"2024-04-24T13:31:52.464612+0000","last_fullsized":"2024-04-24T13:31:52.464612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:33.796332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212507+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:31:52.212507+0000","last_peered":"2024-04-24T13:31:52.212507+0000","last_clean":"2024-04-24T13:31:52.212507+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:31:52.212507+0000","last_undegraded":"2024-04-24T13:31:52.212507+0000","last_fullsized":"2024-04-24T13:31:52.212507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.394822+0000","last_change":"2024-04-24T13:30:50.937903+0000","last_active":"2024-04-24T13:31:52.394822+0000","last_peered":"2024-04-24T13:31:52.394822+0000","last_clean":"2024-04-24T13:31:52.394822+0000","last_became_active":"2024-04-24T13:30:50.937359+0000","last_became_peered":"2024-04-24T13:30:50.937359+0000","last_unstale":"2024-04-24T13:31:52.394822+0000","last_undegraded":"2024-04-24T13:31:52.394822+0000","last_fullsized":"2024-04-24T13:31:52.394822+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:27.651521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211019+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:31:52.211019+0000","last_peered":"2024-04-24T13:31:52.211019+0000","last_clean":"2024-04-24T13:31:52.211019+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:31:52.211019+0000","last_undegraded":"2024-04-24T13:31:52.211019+0000","last_fullsized":"2024-04-24T13:31:52.211019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456332+0000","last_change":"2024-04-24T13:30:25.232972+0000","last_active":"2024-04-24T13:31:51.456332+0000","last_peered":"2024-04-24T13:31:51.456332+0000","last_clean":"2024-04-24T13:31:51.456332+0000","last_became_active":"2024-04-24T13:30:25.232265+0000","last_became_peered":"2024-04-24T13:30:25.232265+0000","last_unstale":"2024-04-24T13:31:51.456332+0000","last_undegraded":"2024-04-24T13:31:51.456332+0000","last_fullsized":"2024-04-24T13:31:51.456332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:47.489762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":147,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395397+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:31:52.395397+0000","last_peered":"2024-04-24T13:31:52.395397+0000","last_clean":"2024-04-24T13:31:52.395397+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:31:52.395397+0000","last_undegraded":"2024-04-24T13:31:52.395397+0000","last_fullsized":"2024-04-24T13:31:52.395397+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":63,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466589+0000","last_change":"2024-04-24T13:30:50.925382+0000","last_active":"2024-04-24T13:31:52.466589+0000","last_peered":"2024-04-24T13:31:52.466589+0000","last_clean":"2024-04-24T13:31:52.466589+0000","last_became_active":"2024-04-24T13:30:50.924919+0000","last_became_peered":"2024-04-24T13:30:50.924919+0000","last_unstale":"2024-04-24T13:31:52.466589+0000","last_undegraded":"2024-04-24T13:31:52.466589+0000","last_fullsized":"2024-04-24T13:31:52.466589+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395996+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:31:52.395996+0000","last_peered":"2024-04-24T13:31:52.395996+0000","last_clean":"2024-04-24T13:31:52.395996+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:31:52.395996+0000","last_undegraded":"2024-04-24T13:31:52.395996+0000","last_fullsized":"2024-04-24T13:31:52.395996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.396963+0000","last_change":"2024-04-24T13:30:23.217937+0000","last_active":"2024-04-24T13:31:52.396963+0000","last_peered":"2024-04-24T13:31:52.396963+0000","last_clean":"2024-04-24T13:31:52.396963+0000","last_became_active":"2024-04-24T13:30:23.217577+0000","last_became_peered":"2024-04-24T13:30:23.217577+0000","last_unstale":"2024-04-24T13:31:52.396963+0000","last_undegraded":"2024-04-24T13:31:52.396963+0000","last_fullsized":"2024-04-24T13:31:52.396963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464324+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:31:52.464324+0000","last_peered":"2024-04-24T13:31:52.464324+0000","last_clean":"2024-04-24T13:31:52.464324+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:31:52.464324+0000","last_undegraded":"2024-04-24T13:31:52.464324+0000","last_fullsized":"2024-04-24T13:31:52.464324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.394794+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:31:52.394794+0000","last_peered":"2024-04-24T13:31:52.394794+0000","last_clean":"2024-04-24T13:31:52.394794+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:31:52.394794+0000","last_undegraded":"2024-04-24T13:31:52.394794+0000","last_fullsized":"2024-04-24T13:31:52.394794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.467837+0000","last_change":"2024-04-24T13:30:25.229114+0000","last_active":"2024-04-24T13:31:52.467837+0000","last_peered":"2024-04-24T13:31:52.467837+0000","last_clean":"2024-04-24T13:31:52.467837+0000","last_became_active":"2024-04-24T13:30:25.228634+0000","last_became_peered":"2024-04-24T13:30:25.228634+0000","last_unstale":"2024-04-24T13:31:52.467837+0000","last_undegraded":"2024-04-24T13:31:52.467837+0000","last_fullsized":"2024-04-24T13:31:52.467837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:13.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"42'16","reported_seq":133,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465791+0000","last_change":"2024-04-24T13:30:50.991700+0000","last_active":"2024-04-24T13:31:52.465791+0000","last_peered":"2024-04-24T13:31:52.465791+0000","last_clean":"2024-04-24T13:31:52.465791+0000","last_became_active":"2024-04-24T13:30:50.940740+0000","last_became_peered":"2024-04-24T13:30:50.940740+0000","last_unstale":"2024-04-24T13:31:52.465791+0000","last_undegraded":"2024-04-24T13:31:52.465791+0000","last_fullsized":"2024-04-24T13:31:52.465791+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:39.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":84,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211749+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:31:52.211749+0000","last_peered":"2024-04-24T13:31:52.211749+0000","last_clean":"2024-04-24T13:31:52.211749+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:31:52.211749+0000","last_undegraded":"2024-04-24T13:31:52.211749+0000","last_fullsized":"2024-04-24T13:31:52.211749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456678+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:31:51.456678+0000","last_peered":"2024-04-24T13:31:51.456678+0000","last_clean":"2024-04-24T13:31:51.456678+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:31:51.456678+0000","last_undegraded":"2024-04-24T13:31:51.456678+0000","last_fullsized":"2024-04-24T13:31:51.456678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395658+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:31:52.395658+0000","last_peered":"2024-04-24T13:31:52.395658+0000","last_clean":"2024-04-24T13:31:52.395658+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:31:52.395658+0000","last_undegraded":"2024-04-24T13:31:52.395658+0000","last_fullsized":"2024-04-24T13:31:52.395658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455510+0000","last_change":"2024-04-24T13:30:15.151799+0000","last_active":"2024-04-24T13:31:51.455510+0000","last_peered":"2024-04-24T13:31:51.455510+0000","last_clean":"2024-04-24T13:31:51.455510+0000","last_became_active":"2024-04-24T13:30:15.150672+0000","last_became_peered":"2024-04-24T13:30:15.150672+0000","last_unstale":"2024-04-24T13:31:51.455510+0000","last_undegraded":"2024-04-24T13:31:51.455510+0000","last_fullsized":"2024-04-24T13:31:51.455510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":104,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305237+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:31:51.305237+0000","last_peered":"2024-04-24T13:31:51.305237+0000","last_clean":"2024-04-24T13:31:51.305237+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:31:51.305237+0000","last_undegraded":"2024-04-24T13:31:51.305237+0000","last_fullsized":"2024-04-24T13:31:51.305237+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.760398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":92,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211988+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:31:52.211988+0000","last_peered":"2024-04-24T13:31:52.211988+0000","last_clean":"2024-04-24T13:31:52.211988+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:31:52.211988+0000","last_undegraded":"2024-04-24T13:31:52.211988+0000","last_fullsized":"2024-04-24T13:31:52.211988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456491+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:31:51.456491+0000","last_peered":"2024-04-24T13:31:51.456491+0000","last_clean":"2024-04-24T13:31:51.456491+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:31:51.456491+0000","last_undegraded":"2024-04-24T13:31:51.456491+0000","last_fullsized":"2024-04-24T13:31:51.456491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":85,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466013+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:31:52.466013+0000","last_peered":"2024-04-24T13:31:52.466013+0000","last_clean":"2024-04-24T13:31:52.466013+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:31:52.466013+0000","last_undegraded":"2024-04-24T13:31:52.466013+0000","last_fullsized":"2024-04-24T13:31:52.466013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.453891+0000","last_change":"2024-04-24T13:30:31.267157+0000","last_active":"2024-04-24T13:31:51.453891+0000","last_peered":"2024-04-24T13:31:51.453891+0000","last_clean":"2024-04-24T13:31:51.453891+0000","last_became_active":"2024-04-24T13:30:31.266348+0000","last_became_peered":"2024-04-24T13:30:31.266348+0000","last_unstale":"2024-04-24T13:31:51.453891+0000","last_undegraded":"2024-04-24T13:31:51.453891+0000","last_fullsized":"2024-04-24T13:31:51.453891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:31.837696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.396262+0000","last_change":"2024-04-24T13:30:23.218086+0000","last_active":"2024-04-24T13:31:52.396262+0000","last_peered":"2024-04-24T13:31:52.396262+0000","last_clean":"2024-04-24T13:31:52.396262+0000","last_became_active":"2024-04-24T13:30:23.217750+0000","last_became_peered":"2024-04-24T13:30:23.217750+0000","last_unstale":"2024-04-24T13:31:52.396262+0000","last_undegraded":"2024-04-24T13:31:52.396262+0000","last_fullsized":"2024-04-24T13:31:52.396262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455841+0000","last_change":"2024-04-24T13:30:21.214846+0000","last_active":"2024-04-24T13:31:51.455841+0000","last_peered":"2024-04-24T13:31:51.455841+0000","last_clean":"2024-04-24T13:31:51.455841+0000","last_became_active":"2024-04-24T13:30:21.214127+0000","last_became_peered":"2024-04-24T13:30:21.214127+0000","last_unstale":"2024-04-24T13:31:51.455841+0000","last_undegraded":"2024-04-24T13:31:51.455841+0000","last_fullsized":"2024-04-24T13:31:51.455841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:02.477283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395908+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:31:52.395908+0000","last_peered":"2024-04-24T13:31:52.395908+0000","last_clean":"2024-04-24T13:31:52.395908+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:31:52.395908+0000","last_undegraded":"2024-04-24T13:31:52.395908+0000","last_fullsized":"2024-04-24T13:31:52.395908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":92,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211588+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:31:52.211588+0000","last_peered":"2024-04-24T13:31:52.211588+0000","last_clean":"2024-04-24T13:31:52.211588+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:31:52.211588+0000","last_undegraded":"2024-04-24T13:31:52.211588+0000","last_fullsized":"2024-04-24T13:31:52.211588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":120,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210769+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:31:52.210769+0000","last_peered":"2024-04-24T13:31:52.210769+0000","last_clean":"2024-04-24T13:31:52.210769+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:31:52.210769+0000","last_undegraded":"2024-04-24T13:31:52.210769+0000","last_fullsized":"2024-04-24T13:31:52.210769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":83,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304969+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:31:51.304969+0000","last_peered":"2024-04-24T13:31:51.304969+0000","last_clean":"2024-04-24T13:31:51.304969+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:31:51.304969+0000","last_undegraded":"2024-04-24T13:31:51.304969+0000","last_fullsized":"2024-04-24T13:31:51.304969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212093+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:31:52.212093+0000","last_peered":"2024-04-24T13:31:52.212093+0000","last_clean":"2024-04-24T13:31:52.212093+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:31:52.212093+0000","last_undegraded":"2024-04-24T13:31:52.212093+0000","last_fullsized":"2024-04-24T13:31:52.212093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211902+0000","last_change":"2024-04-24T13:30:23.220277+0000","last_active":"2024-04-24T13:31:52.211902+0000","last_peered":"2024-04-24T13:31:52.211902+0000","last_clean":"2024-04-24T13:31:52.211902+0000","last_became_active":"2024-04-24T13:30:23.219932+0000","last_became_peered":"2024-04-24T13:30:23.219932+0000","last_unstale":"2024-04-24T13:31:52.211902+0000","last_undegraded":"2024-04-24T13:31:52.211902+0000","last_fullsized":"2024-04-24T13:31:52.211902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395747+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:31:52.395747+0000","last_peered":"2024-04-24T13:31:52.395747+0000","last_clean":"2024-04-24T13:31:52.395747+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:31:52.395747+0000","last_undegraded":"2024-04-24T13:31:52.395747+0000","last_fullsized":"2024-04-24T13:31:52.395747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212087+0000","last_change":"2024-04-24T13:30:50.937016+0000","last_active":"2024-04-24T13:31:52.212087+0000","last_peered":"2024-04-24T13:31:52.212087+0000","last_clean":"2024-04-24T13:31:52.212087+0000","last_became_active":"2024-04-24T13:30:50.934998+0000","last_became_peered":"2024-04-24T13:30:50.934998+0000","last_unstale":"2024-04-24T13:31:52.212087+0000","last_undegraded":"2024-04-24T13:31:52.212087+0000","last_fullsized":"2024-04-24T13:31:52.212087+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:42:03.696601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":93,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465211+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:31:52.465211+0000","last_peered":"2024-04-24T13:31:52.465211+0000","last_clean":"2024-04-24T13:31:52.465211+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:31:52.465211+0000","last_undegraded":"2024-04-24T13:31:52.465211+0000","last_fullsized":"2024-04-24T13:31:52.465211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":110,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.394951+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:31:52.394951+0000","last_peered":"2024-04-24T13:31:52.394951+0000","last_clean":"2024-04-24T13:31:52.394951+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:31:52.394951+0000","last_undegraded":"2024-04-24T13:31:52.394951+0000","last_fullsized":"2024-04-24T13:31:52.394951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":104,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454185+0000","last_change":"2024-04-24T13:30:29.257969+0000","last_active":"2024-04-24T13:31:51.454185+0000","last_peered":"2024-04-24T13:31:51.454185+0000","last_clean":"2024-04-24T13:31:51.454185+0000","last_became_active":"2024-04-24T13:30:29.257131+0000","last_became_peered":"2024-04-24T13:30:29.257131+0000","last_unstale":"2024-04-24T13:31:51.454185+0000","last_undegraded":"2024-04-24T13:31:51.454185+0000","last_fullsized":"2024-04-24T13:31:51.454185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458505+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:31:51.458505+0000","last_peered":"2024-04-24T13:31:51.458505+0000","last_clean":"2024-04-24T13:31:51.458505+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:31:51.458505+0000","last_undegraded":"2024-04-24T13:31:51.458505+0000","last_fullsized":"2024-04-24T13:31:51.458505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.463812+0000","last_change":"2024-04-24T13:31:01.035271+0000","last_active":"2024-04-24T13:31:52.463812+0000","last_peered":"2024-04-24T13:31:52.463812+0000","last_clean":"2024-04-24T13:31:52.463812+0000","last_became_active":"2024-04-24T13:31:01.034314+0000","last_became_peered":"2024-04-24T13:31:01.034314+0000","last_unstale":"2024-04-24T13:31:52.463812+0000","last_undegraded":"2024-04-24T13:31:52.463812+0000","last_fullsized":"2024-04-24T13:31:52.463812+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:45.074671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457409+0000","last_change":"2024-04-24T13:30:50.913675+0000","last_active":"2024-04-24T13:31:51.457409+0000","last_peered":"2024-04-24T13:31:51.457409+0000","last_clean":"2024-04-24T13:31:51.457409+0000","last_became_active":"2024-04-24T13:30:50.912153+0000","last_became_peered":"2024-04-24T13:30:50.912153+0000","last_unstale":"2024-04-24T13:31:51.457409+0000","last_undegraded":"2024-04-24T13:31:51.457409+0000","last_fullsized":"2024-04-24T13:31:51.457409+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.808699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.394541+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:31:52.394541+0000","last_peered":"2024-04-24T13:31:52.394541+0000","last_clean":"2024-04-24T13:31:52.394541+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:31:52.394541+0000","last_undegraded":"2024-04-24T13:31:52.394541+0000","last_fullsized":"2024-04-24T13:31:52.394541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":91,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304697+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:31:51.304697+0000","last_peered":"2024-04-24T13:31:51.304697+0000","last_clean":"2024-04-24T13:31:51.304697+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:31:51.304697+0000","last_undegraded":"2024-04-24T13:31:51.304697+0000","last_fullsized":"2024-04-24T13:31:51.304697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":102,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305070+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:31:51.305070+0000","last_peered":"2024-04-24T13:31:51.305070+0000","last_clean":"2024-04-24T13:31:51.305070+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:31:51.305070+0000","last_undegraded":"2024-04-24T13:31:51.305070+0000","last_fullsized":"2024-04-24T13:31:51.305070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":104,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.459791+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:31:51.459791+0000","last_peered":"2024-04-24T13:31:51.459791+0000","last_clean":"2024-04-24T13:31:51.459791+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:31:51.459791+0000","last_undegraded":"2024-04-24T13:31:51.459791+0000","last_fullsized":"2024-04-24T13:31:51.459791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210502+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:31:52.210502+0000","last_peered":"2024-04-24T13:31:52.210502+0000","last_clean":"2024-04-24T13:31:52.210502+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:31:52.210502+0000","last_undegraded":"2024-04-24T13:31:52.210502+0000","last_fullsized":"2024-04-24T13:31:52.210502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303606+0000","last_change":"2024-04-24T13:30:23.219012+0000","last_active":"2024-04-24T13:31:51.303606+0000","last_peered":"2024-04-24T13:31:51.303606+0000","last_clean":"2024-04-24T13:31:51.303606+0000","last_became_active":"2024-04-24T13:30:23.218312+0000","last_became_peered":"2024-04-24T13:30:23.218312+0000","last_unstale":"2024-04-24T13:31:51.303606+0000","last_undegraded":"2024-04-24T13:31:51.303606+0000","last_fullsized":"2024-04-24T13:31:51.303606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212640+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:31:52.212640+0000","last_peered":"2024-04-24T13:31:52.212640+0000","last_clean":"2024-04-24T13:31:52.212640+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:31:52.212640+0000","last_undegraded":"2024-04-24T13:31:52.212640+0000","last_fullsized":"2024-04-24T13:31:52.212640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466332+0000","last_change":"2024-04-24T13:30:50.937218+0000","last_active":"2024-04-24T13:31:52.466332+0000","last_peered":"2024-04-24T13:31:52.466332+0000","last_clean":"2024-04-24T13:31:52.466332+0000","last_became_active":"2024-04-24T13:30:50.936420+0000","last_became_peered":"2024-04-24T13:30:50.936420+0000","last_unstale":"2024-04-24T13:31:52.466332+0000","last_undegraded":"2024-04-24T13:31:52.466332+0000","last_fullsized":"2024-04-24T13:31:52.466332+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:08.910360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458472+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:31:51.458472+0000","last_peered":"2024-04-24T13:31:51.458472+0000","last_clean":"2024-04-24T13:31:51.458472+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:31:51.458472+0000","last_undegraded":"2024-04-24T13:31:51.458472+0000","last_fullsized":"2024-04-24T13:31:51.458472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":134,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465135+0000","last_change":"2024-04-24T13:30:50.977698+0000","last_active":"2024-04-24T13:31:52.465135+0000","last_peered":"2024-04-24T13:31:52.465135+0000","last_clean":"2024-04-24T13:31:52.465135+0000","last_became_active":"2024-04-24T13:30:50.936955+0000","last_became_peered":"2024-04-24T13:30:50.936955+0000","last_unstale":"2024-04-24T13:31:52.465135+0000","last_undegraded":"2024-04-24T13:31:52.465135+0000","last_fullsized":"2024-04-24T13:31:52.465135+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:47.349331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457468+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:31:51.457468+0000","last_peered":"2024-04-24T13:31:51.457468+0000","last_clean":"2024-04-24T13:31:51.457468+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:31:51.457468+0000","last_undegraded":"2024-04-24T13:31:51.457468+0000","last_fullsized":"2024-04-24T13:31:51.457468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454746+0000","last_change":"2024-04-24T13:30:50.944864+0000","last_active":"2024-04-24T13:31:51.454746+0000","last_peered":"2024-04-24T13:31:51.454746+0000","last_clean":"2024-04-24T13:31:51.454746+0000","last_became_active":"2024-04-24T13:30:50.934827+0000","last_became_peered":"2024-04-24T13:30:50.934827+0000","last_unstale":"2024-04-24T13:31:51.454746+0000","last_undegraded":"2024-04-24T13:31:51.454746+0000","last_fullsized":"2024-04-24T13:31:51.454746+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:36:11.086183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212184+0000","last_change":"2024-04-24T13:30:31.264343+0000","last_active":"2024-04-24T13:31:52.212184+0000","last_peered":"2024-04-24T13:31:52.212184+0000","last_clean":"2024-04-24T13:31:52.212184+0000","last_became_active":"2024-04-24T13:30:31.263640+0000","last_became_peered":"2024-04-24T13:30:31.263640+0000","last_unstale":"2024-04-24T13:31:52.212184+0000","last_undegraded":"2024-04-24T13:31:52.212184+0000","last_fullsized":"2024-04-24T13:31:52.212184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:51:45.241537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304845+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:31:51.304845+0000","last_peered":"2024-04-24T13:31:51.304845+0000","last_clean":"2024-04-24T13:31:51.304845+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:31:51.304845+0000","last_undegraded":"2024-04-24T13:31:51.304845+0000","last_fullsized":"2024-04-24T13:31:51.304845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465031+0000","last_change":"2024-04-24T13:31:00.986151+0000","last_active":"2024-04-24T13:31:52.465031+0000","last_peered":"2024-04-24T13:31:52.465031+0000","last_clean":"2024-04-24T13:31:52.465031+0000","last_became_active":"2024-04-24T13:31:00.985421+0000","last_became_peered":"2024-04-24T13:31:00.985421+0000","last_unstale":"2024-04-24T13:31:52.465031+0000","last_undegraded":"2024-04-24T13:31:52.465031+0000","last_fullsized":"2024-04-24T13:31:52.465031+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:42.662404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.396337+0000","last_change":"2024-04-24T13:30:25.228158+0000","last_active":"2024-04-24T13:31:52.396337+0000","last_peered":"2024-04-24T13:31:52.396337+0000","last_clean":"2024-04-24T13:31:52.396337+0000","last_became_active":"2024-04-24T13:30:25.226828+0000","last_became_peered":"2024-04-24T13:30:25.226828+0000","last_unstale":"2024-04-24T13:31:52.396337+0000","last_undegraded":"2024-04-24T13:31:52.396337+0000","last_fullsized":"2024-04-24T13:31:52.396337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:11.608677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":108,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455633+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:31:51.455633+0000","last_peered":"2024-04-24T13:31:51.455633+0000","last_clean":"2024-04-24T13:31:51.455633+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:31:51.455633+0000","last_undegraded":"2024-04-24T13:31:51.455633+0000","last_fullsized":"2024-04-24T13:31:51.455633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458722+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:31:51.458722+0000","last_peered":"2024-04-24T13:31:51.458722+0000","last_clean":"2024-04-24T13:31:51.458722+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:31:51.458722+0000","last_undegraded":"2024-04-24T13:31:51.458722+0000","last_fullsized":"2024-04-24T13:31:51.458722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456130+0000","last_change":"2024-04-24T13:30:50.930475+0000","last_active":"2024-04-24T13:31:51.456130+0000","last_peered":"2024-04-24T13:31:51.456130+0000","last_clean":"2024-04-24T13:31:51.456130+0000","last_became_active":"2024-04-24T13:30:50.929905+0000","last_became_peered":"2024-04-24T13:30:50.929905+0000","last_unstale":"2024-04-24T13:31:51.456130+0000","last_undegraded":"2024-04-24T13:31:51.456130+0000","last_fullsized":"2024-04-24T13:31:51.456130+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:41.257023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.394514+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:31:52.394514+0000","last_peered":"2024-04-24T13:31:52.394514+0000","last_clean":"2024-04-24T13:31:52.394514+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:31:52.394514+0000","last_undegraded":"2024-04-24T13:31:52.394514+0000","last_fullsized":"2024-04-24T13:31:52.394514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":60,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.459566+0000","last_change":"2024-04-24T13:30:50.931263+0000","last_active":"2024-04-24T13:31:51.459566+0000","last_peered":"2024-04-24T13:31:51.459566+0000","last_clean":"2024-04-24T13:31:51.459566+0000","last_became_active":"2024-04-24T13:30:50.929683+0000","last_became_peered":"2024-04-24T13:30:50.929683+0000","last_unstale":"2024-04-24T13:31:51.459566+0000","last_undegraded":"2024-04-24T13:31:51.459566+0000","last_fullsized":"2024-04-24T13:31:51.459566+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:28:57.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456489+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:31:51.456489+0000","last_peered":"2024-04-24T13:31:51.456489+0000","last_clean":"2024-04-24T13:31:51.456489+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:31:51.456489+0000","last_undegraded":"2024-04-24T13:31:51.456489+0000","last_fullsized":"2024-04-24T13:31:51.456489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"50'5","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210964+0000","last_change":"2024-04-24T13:30:27.260167+0000","last_active":"2024-04-24T13:31:52.210964+0000","last_peered":"2024-04-24T13:31:52.210964+0000","last_clean":"2024-04-24T13:31:52.210964+0000","last_became_active":"2024-04-24T13:30:27.259644+0000","last_became_peered":"2024-04-24T13:30:27.259644+0000","last_unstale":"2024-04-24T13:31:52.210964+0000","last_undegraded":"2024-04-24T13:31:52.210964+0000","last_fullsized":"2024-04-24T13:31:52.210964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:21.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":62,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464684+0000","last_change":"2024-04-24T13:30:50.924952+0000","last_active":"2024-04-24T13:31:52.464684+0000","last_peered":"2024-04-24T13:31:52.464684+0000","last_clean":"2024-04-24T13:31:52.464684+0000","last_became_active":"2024-04-24T13:30:50.923933+0000","last_became_peered":"2024-04-24T13:30:50.923933+0000","last_unstale":"2024-04-24T13:31:52.464684+0000","last_undegraded":"2024-04-24T13:31:52.464684+0000","last_fullsized":"2024-04-24T13:31:52.464684+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:17.479670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211944+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:31:52.211944+0000","last_peered":"2024-04-24T13:31:52.211944+0000","last_clean":"2024-04-24T13:31:52.211944+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:31:52.211944+0000","last_undegraded":"2024-04-24T13:31:52.211944+0000","last_fullsized":"2024-04-24T13:31:52.211944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457036+0000","last_change":"2024-04-24T13:30:50.925917+0000","last_active":"2024-04-24T13:31:51.457036+0000","last_peered":"2024-04-24T13:31:51.457036+0000","last_clean":"2024-04-24T13:31:51.457036+0000","last_became_active":"2024-04-24T13:30:50.925580+0000","last_became_peered":"2024-04-24T13:30:50.925580+0000","last_unstale":"2024-04-24T13:31:51.457036+0000","last_undegraded":"2024-04-24T13:31:51.457036+0000","last_fullsized":"2024-04-24T13:31:51.457036+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456228+0000","last_change":"2024-04-24T13:30:50.938795+0000","last_active":"2024-04-24T13:31:51.456228+0000","last_peered":"2024-04-24T13:31:51.456228+0000","last_clean":"2024-04-24T13:31:51.456228+0000","last_became_active":"2024-04-24T13:30:50.937965+0000","last_became_peered":"2024-04-24T13:30:50.937965+0000","last_unstale":"2024-04-24T13:31:51.456228+0000","last_undegraded":"2024-04-24T13:31:51.456228+0000","last_fullsized":"2024-04-24T13:31:51.456228+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:31.350610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":59,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304169+0000","last_change":"2024-04-24T13:30:50.934577+0000","last_active":"2024-04-24T13:31:51.304169+0000","last_peered":"2024-04-24T13:31:51.304169+0000","last_clean":"2024-04-24T13:31:51.304169+0000","last_became_active":"2024-04-24T13:30:50.931559+0000","last_became_peered":"2024-04-24T13:30:50.931559+0000","last_unstale":"2024-04-24T13:31:51.304169+0000","last_undegraded":"2024-04-24T13:31:51.304169+0000","last_fullsized":"2024-04-24T13:31:51.304169+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:35.372215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":108,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456258+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:31:51.456258+0000","last_peered":"2024-04-24T13:31:51.456258+0000","last_clean":"2024-04-24T13:31:51.456258+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:31:51.456258+0000","last_undegraded":"2024-04-24T13:31:51.456258+0000","last_fullsized":"2024-04-24T13:31:51.456258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":85,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465088+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:31:52.465088+0000","last_peered":"2024-04-24T13:31:52.465088+0000","last_clean":"2024-04-24T13:31:52.465088+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:31:52.465088+0000","last_undegraded":"2024-04-24T13:31:52.465088+0000","last_fullsized":"2024-04-24T13:31:52.465088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455139+0000","last_change":"2024-04-24T13:30:50.941935+0000","last_active":"2024-04-24T13:31:51.455139+0000","last_peered":"2024-04-24T13:31:51.455139+0000","last_clean":"2024-04-24T13:31:51.455139+0000","last_became_active":"2024-04-24T13:30:50.940885+0000","last_became_peered":"2024-04-24T13:30:50.940885+0000","last_unstale":"2024-04-24T13:31:51.455139+0000","last_undegraded":"2024-04-24T13:31:51.455139+0000","last_fullsized":"2024-04-24T13:31:51.455139+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:22.937959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457708+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:31:51.457708+0000","last_peered":"2024-04-24T13:31:51.457708+0000","last_clean":"2024-04-24T13:31:51.457708+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:31:51.457708+0000","last_undegraded":"2024-04-24T13:31:51.457708+0000","last_fullsized":"2024-04-24T13:31:51.457708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212527+0000","last_change":"2024-04-24T13:30:21.229237+0000","last_active":"2024-04-24T13:31:52.212527+0000","last_peered":"2024-04-24T13:31:52.212527+0000","last_clean":"2024-04-24T13:31:52.212527+0000","last_became_active":"2024-04-24T13:30:21.228971+0000","last_became_peered":"2024-04-24T13:30:21.228971+0000","last_unstale":"2024-04-24T13:31:52.212527+0000","last_undegraded":"2024-04-24T13:31:52.212527+0000","last_fullsized":"2024-04-24T13:31:52.212527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":93,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464937+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:31:52.464937+0000","last_peered":"2024-04-24T13:31:52.464937+0000","last_clean":"2024-04-24T13:31:52.464937+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:31:52.464937+0000","last_undegraded":"2024-04-24T13:31:52.464937+0000","last_fullsized":"2024-04-24T13:31:52.464937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":107,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464576+0000","last_change":"2024-04-24T13:30:50.981989+0000","last_active":"2024-04-24T13:31:52.464576+0000","last_peered":"2024-04-24T13:31:52.464576+0000","last_clean":"2024-04-24T13:31:52.464576+0000","last_became_active":"2024-04-24T13:30:50.939707+0000","last_became_peered":"2024-04-24T13:30:50.939707+0000","last_unstale":"2024-04-24T13:31:52.464576+0000","last_undegraded":"2024-04-24T13:31:52.464576+0000","last_fullsized":"2024-04-24T13:31:52.464576+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:38.379316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":89,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211339+0000","last_change":"2024-04-24T13:30:50.935071+0000","last_active":"2024-04-24T13:31:52.211339+0000","last_peered":"2024-04-24T13:31:52.211339+0000","last_clean":"2024-04-24T13:31:52.211339+0000","last_became_active":"2024-04-24T13:30:50.934309+0000","last_became_peered":"2024-04-24T13:30:50.934309+0000","last_unstale":"2024-04-24T13:31:52.211339+0000","last_undegraded":"2024-04-24T13:31:52.211339+0000","last_fullsized":"2024-04-24T13:31:52.211339+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:51.520511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466174+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:31:52.466174+0000","last_peered":"2024-04-24T13:31:52.466174+0000","last_clean":"2024-04-24T13:31:52.466174+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:31:52.466174+0000","last_undegraded":"2024-04-24T13:31:52.466174+0000","last_fullsized":"2024-04-24T13:31:52.466174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458087+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:31:51.458087+0000","last_peered":"2024-04-24T13:31:51.458087+0000","last_clean":"2024-04-24T13:31:51.458087+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:31:51.458087+0000","last_undegraded":"2024-04-24T13:31:51.458087+0000","last_fullsized":"2024-04-24T13:31:51.458087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212321+0000","last_change":"2024-04-24T13:30:50.921993+0000","last_active":"2024-04-24T13:31:52.212321+0000","last_peered":"2024-04-24T13:31:52.212321+0000","last_clean":"2024-04-24T13:31:52.212321+0000","last_became_active":"2024-04-24T13:30:50.921257+0000","last_became_peered":"2024-04-24T13:30:50.921257+0000","last_unstale":"2024-04-24T13:31:52.212321+0000","last_undegraded":"2024-04-24T13:31:52.212321+0000","last_fullsized":"2024-04-24T13:31:52.212321+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:58.034297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":112,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395075+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:31:52.395075+0000","last_peered":"2024-04-24T13:31:52.395075+0000","last_clean":"2024-04-24T13:31:52.395075+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:31:52.395075+0000","last_undegraded":"2024-04-24T13:31:52.395075+0000","last_fullsized":"2024-04-24T13:31:52.395075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455803+0000","last_change":"2024-04-24T13:30:29.277963+0000","last_active":"2024-04-24T13:31:51.455803+0000","last_peered":"2024-04-24T13:31:51.455803+0000","last_clean":"2024-04-24T13:31:51.455803+0000","last_became_active":"2024-04-24T13:30:29.277170+0000","last_became_peered":"2024-04-24T13:30:29.277170+0000","last_unstale":"2024-04-24T13:31:51.455803+0000","last_undegraded":"2024-04-24T13:31:51.455803+0000","last_fullsized":"2024-04-24T13:31:51.455803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455900+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:31:51.455900+0000","last_peered":"2024-04-24T13:31:51.455900+0000","last_clean":"2024-04-24T13:31:51.455900+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:31:51.455900+0000","last_undegraded":"2024-04-24T13:31:51.455900+0000","last_fullsized":"2024-04-24T13:31:51.455900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212420+0000","last_change":"2024-04-24T13:30:50.917948+0000","last_active":"2024-04-24T13:31:52.212420+0000","last_peered":"2024-04-24T13:31:52.212420+0000","last_clean":"2024-04-24T13:31:52.212420+0000","last_became_active":"2024-04-24T13:30:50.917339+0000","last_became_peered":"2024-04-24T13:30:50.917339+0000","last_unstale":"2024-04-24T13:31:52.212420+0000","last_undegraded":"2024-04-24T13:31:52.212420+0000","last_fullsized":"2024-04-24T13:31:52.212420+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:36:03.041606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395607+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:31:52.395607+0000","last_peered":"2024-04-24T13:31:52.395607+0000","last_clean":"2024-04-24T13:31:52.395607+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:31:52.395607+0000","last_undegraded":"2024-04-24T13:31:52.395607+0000","last_fullsized":"2024-04-24T13:31:52.395607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":93,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466082+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:31:52.466082+0000","last_peered":"2024-04-24T13:31:52.466082+0000","last_clean":"2024-04-24T13:31:52.466082+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:31:52.466082+0000","last_undegraded":"2024-04-24T13:31:52.466082+0000","last_fullsized":"2024-04-24T13:31:52.466082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":120,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456080+0000","last_change":"2024-04-24T13:30:50.991717+0000","last_active":"2024-04-24T13:31:51.456080+0000","last_peered":"2024-04-24T13:31:51.456080+0000","last_clean":"2024-04-24T13:31:51.456080+0000","last_became_active":"2024-04-24T13:30:50.938486+0000","last_became_peered":"2024-04-24T13:30:50.938486+0000","last_unstale":"2024-04-24T13:31:51.456080+0000","last_undegraded":"2024-04-24T13:31:51.456080+0000","last_fullsized":"2024-04-24T13:31:51.456080+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:49.495847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395159+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:31:52.395159+0000","last_peered":"2024-04-24T13:31:52.395159+0000","last_clean":"2024-04-24T13:31:52.395159+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:31:52.395159+0000","last_undegraded":"2024-04-24T13:31:52.395159+0000","last_fullsized":"2024-04-24T13:31:52.395159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464886+0000","last_change":"2024-04-24T13:30:50.937377+0000","last_active":"2024-04-24T13:31:52.464886+0000","last_peered":"2024-04-24T13:31:52.464886+0000","last_clean":"2024-04-24T13:31:52.464886+0000","last_became_active":"2024-04-24T13:30:50.936540+0000","last_became_peered":"2024-04-24T13:30:50.936540+0000","last_unstale":"2024-04-24T13:31:52.464886+0000","last_undegraded":"2024-04-24T13:31:52.464886+0000","last_fullsized":"2024-04-24T13:31:52.464886+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:44.053660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455603+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:31:51.455603+0000","last_peered":"2024-04-24T13:31:51.455603+0000","last_clean":"2024-04-24T13:31:51.455603+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:31:51.455603+0000","last_undegraded":"2024-04-24T13:31:51.455603+0000","last_fullsized":"2024-04-24T13:31:51.455603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":99,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305528+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:31:51.305528+0000","last_peered":"2024-04-24T13:31:51.305528+0000","last_clean":"2024-04-24T13:31:51.305528+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:31:51.305528+0000","last_undegraded":"2024-04-24T13:31:51.305528+0000","last_fullsized":"2024-04-24T13:31:51.305528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":91,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306134+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:31:51.306134+0000","last_peered":"2024-04-24T13:31:51.306134+0000","last_clean":"2024-04-24T13:31:51.306134+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:31:51.306134+0000","last_undegraded":"2024-04-24T13:31:51.306134+0000","last_fullsized":"2024-04-24T13:31:51.306134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":108,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458645+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:31:51.458645+0000","last_peered":"2024-04-24T13:31:51.458645+0000","last_clean":"2024-04-24T13:31:51.458645+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:31:51.458645+0000","last_undegraded":"2024-04-24T13:31:51.458645+0000","last_fullsized":"2024-04-24T13:31:51.458645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.396630+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:31:52.396630+0000","last_peered":"2024-04-24T13:31:52.396630+0000","last_clean":"2024-04-24T13:31:52.396630+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:31:52.396630+0000","last_undegraded":"2024-04-24T13:31:52.396630+0000","last_fullsized":"2024-04-24T13:31:52.396630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454422+0000","last_change":"2024-04-24T13:30:50.929993+0000","last_active":"2024-04-24T13:31:51.454422+0000","last_peered":"2024-04-24T13:31:51.454422+0000","last_clean":"2024-04-24T13:31:51.454422+0000","last_became_active":"2024-04-24T13:30:50.929169+0000","last_became_peered":"2024-04-24T13:30:50.929169+0000","last_unstale":"2024-04-24T13:31:51.454422+0000","last_undegraded":"2024-04-24T13:31:51.454422+0000","last_fullsized":"2024-04-24T13:31:51.454422+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:57.047113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465530+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:31:52.465530+0000","last_peered":"2024-04-24T13:31:52.465530+0000","last_clean":"2024-04-24T13:31:52.465530+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:31:52.465530+0000","last_undegraded":"2024-04-24T13:31:52.465530+0000","last_fullsized":"2024-04-24T13:31:52.465530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211423+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:31:52.211423+0000","last_peered":"2024-04-24T13:31:52.211423+0000","last_clean":"2024-04-24T13:31:52.211423+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:31:52.211423+0000","last_undegraded":"2024-04-24T13:31:52.211423+0000","last_fullsized":"2024-04-24T13:31:52.211423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395443+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:31:52.395443+0000","last_peered":"2024-04-24T13:31:52.395443+0000","last_clean":"2024-04-24T13:31:52.395443+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:31:52.395443+0000","last_undegraded":"2024-04-24T13:31:52.395443+0000","last_fullsized":"2024-04-24T13:31:52.395443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":102,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306175+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:31:51.306175+0000","last_peered":"2024-04-24T13:31:51.306175+0000","last_clean":"2024-04-24T13:31:51.306175+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:31:51.306175+0000","last_undegraded":"2024-04-24T13:31:51.306175+0000","last_fullsized":"2024-04-24T13:31:51.306175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465038+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:31:52.465038+0000","last_peered":"2024-04-24T13:31:52.465038+0000","last_clean":"2024-04-24T13:31:52.465038+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:31:52.465038+0000","last_undegraded":"2024-04-24T13:31:52.465038+0000","last_fullsized":"2024-04-24T13:31:52.465038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.453881+0000","last_change":"2024-04-24T13:30:50.935081+0000","last_active":"2024-04-24T13:31:51.453881+0000","last_peered":"2024-04-24T13:31:51.453881+0000","last_clean":"2024-04-24T13:31:51.453881+0000","last_became_active":"2024-04-24T13:30:50.934177+0000","last_became_peered":"2024-04-24T13:30:50.934177+0000","last_unstale":"2024-04-24T13:31:51.453881+0000","last_undegraded":"2024-04-24T13:31:51.453881+0000","last_fullsized":"2024-04-24T13:31:51.453881+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304801+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:31:51.304801+0000","last_peered":"2024-04-24T13:31:51.304801+0000","last_clean":"2024-04-24T13:31:51.304801+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:31:51.304801+0000","last_undegraded":"2024-04-24T13:31:51.304801+0000","last_fullsized":"2024-04-24T13:31:51.304801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456862+0000","last_change":"2024-04-24T13:30:21.226147+0000","last_active":"2024-04-24T13:31:51.456862+0000","last_peered":"2024-04-24T13:31:51.456862+0000","last_clean":"2024-04-24T13:31:51.456862+0000","last_became_active":"2024-04-24T13:30:21.225369+0000","last_became_peered":"2024-04-24T13:30:21.225369+0000","last_unstale":"2024-04-24T13:31:51.456862+0000","last_undegraded":"2024-04-24T13:31:51.456862+0000","last_fullsized":"2024-04-24T13:31:51.456862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:24.585089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":59,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304397+0000","last_change":"2024-04-24T13:30:50.927331+0000","last_active":"2024-04-24T13:31:51.304397+0000","last_peered":"2024-04-24T13:31:51.304397+0000","last_clean":"2024-04-24T13:31:51.304397+0000","last_became_active":"2024-04-24T13:30:50.926529+0000","last_became_peered":"2024-04-24T13:30:50.926529+0000","last_unstale":"2024-04-24T13:31:51.304397+0000","last_undegraded":"2024-04-24T13:31:51.304397+0000","last_fullsized":"2024-04-24T13:31:51.304397+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:23.529403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":114,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454678+0000","last_change":"2024-04-24T13:30:27.260827+0000","last_active":"2024-04-24T13:31:51.454678+0000","last_peered":"2024-04-24T13:31:51.454678+0000","last_clean":"2024-04-24T13:31:51.454678+0000","last_became_active":"2024-04-24T13:30:27.260164+0000","last_became_peered":"2024-04-24T13:30:27.260164+0000","last_unstale":"2024-04-24T13:31:51.454678+0000","last_undegraded":"2024-04-24T13:31:51.454678+0000","last_fullsized":"2024-04-24T13:31:51.454678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":84,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211394+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:31:52.211394+0000","last_peered":"2024-04-24T13:31:52.211394+0000","last_clean":"2024-04-24T13:31:52.211394+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:31:52.211394+0000","last_undegraded":"2024-04-24T13:31:52.211394+0000","last_fullsized":"2024-04-24T13:31:52.211394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212185+0000","last_change":"2024-04-24T13:30:50.922108+0000","last_active":"2024-04-24T13:31:52.212185+0000","last_peered":"2024-04-24T13:31:52.212185+0000","last_clean":"2024-04-24T13:31:52.212185+0000","last_became_active":"2024-04-24T13:30:50.921514+0000","last_became_peered":"2024-04-24T13:30:50.921514+0000","last_unstale":"2024-04-24T13:31:52.212185+0000","last_undegraded":"2024-04-24T13:31:52.212185+0000","last_fullsized":"2024-04-24T13:31:52.212185+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:05.867839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305289+0000","last_change":"2024-04-24T13:30:23.225100+0000","last_active":"2024-04-24T13:31:51.305289+0000","last_peered":"2024-04-24T13:31:51.305289+0000","last_clean":"2024-04-24T13:31:51.305289+0000","last_became_active":"2024-04-24T13:30:23.224324+0000","last_became_peered":"2024-04-24T13:30:23.224324+0000","last_unstale":"2024-04-24T13:31:51.305289+0000","last_undegraded":"2024-04-24T13:31:51.305289+0000","last_fullsized":"2024-04-24T13:31:51.305289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455743+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:31:51.455743+0000","last_peered":"2024-04-24T13:31:51.455743+0000","last_clean":"2024-04-24T13:31:51.455743+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:31:51.455743+0000","last_undegraded":"2024-04-24T13:31:51.455743+0000","last_fullsized":"2024-04-24T13:31:51.455743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455249+0000","last_change":"2024-04-24T13:30:25.238830+0000","last_active":"2024-04-24T13:31:51.455249+0000","last_peered":"2024-04-24T13:31:51.455249+0000","last_clean":"2024-04-24T13:31:51.455249+0000","last_became_active":"2024-04-24T13:30:25.237595+0000","last_became_peered":"2024-04-24T13:30:25.237595+0000","last_unstale":"2024-04-24T13:31:51.455249+0000","last_undegraded":"2024-04-24T13:31:51.455249+0000","last_fullsized":"2024-04-24T13:31:51.455249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":104,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211248+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:31:52.211248+0000","last_peered":"2024-04-24T13:31:52.211248+0000","last_clean":"2024-04-24T13:31:52.211248+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:31:52.211248+0000","last_undegraded":"2024-04-24T13:31:52.211248+0000","last_fullsized":"2024-04-24T13:31:52.211248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":90,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464731+0000","last_change":"2024-04-24T13:30:50.938940+0000","last_active":"2024-04-24T13:31:52.464731+0000","last_peered":"2024-04-24T13:31:52.464731+0000","last_clean":"2024-04-24T13:31:52.464731+0000","last_became_active":"2024-04-24T13:30:50.936355+0000","last_became_peered":"2024-04-24T13:30:50.936355+0000","last_unstale":"2024-04-24T13:31:52.464731+0000","last_undegraded":"2024-04-24T13:31:52.464731+0000","last_fullsized":"2024-04-24T13:31:52.464731+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456242+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:31:51.456242+0000","last_peered":"2024-04-24T13:31:51.456242+0000","last_clean":"2024-04-24T13:31:51.456242+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:31:51.456242+0000","last_undegraded":"2024-04-24T13:31:51.456242+0000","last_fullsized":"2024-04-24T13:31:51.456242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":46,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454142+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:31:51.454142+0000","last_peered":"2024-04-24T13:31:51.454142+0000","last_clean":"2024-04-24T13:31:51.454142+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:31:51.454142+0000","last_undegraded":"2024-04-24T13:31:51.454142+0000","last_fullsized":"2024-04-24T13:31:51.454142+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456816+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:31:51.456816+0000","last_peered":"2024-04-24T13:31:51.456816+0000","last_clean":"2024-04-24T13:31:51.456816+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:31:51.456816+0000","last_undegraded":"2024-04-24T13:31:51.456816+0000","last_fullsized":"2024-04-24T13:31:51.456816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":91,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304045+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:31:51.304045+0000","last_peered":"2024-04-24T13:31:51.304045+0000","last_clean":"2024-04-24T13:31:51.304045+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:31:51.304045+0000","last_undegraded":"2024-04-24T13:31:51.304045+0000","last_fullsized":"2024-04-24T13:31:51.304045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":110,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457184+0000","last_change":"2024-04-24T13:30:50.967042+0000","last_active":"2024-04-24T13:31:51.457184+0000","last_peered":"2024-04-24T13:31:51.457184+0000","last_clean":"2024-04-24T13:31:51.457184+0000","last_became_active":"2024-04-24T13:30:50.925842+0000","last_became_peered":"2024-04-24T13:30:50.925842+0000","last_unstale":"2024-04-24T13:31:51.457184+0000","last_undegraded":"2024-04-24T13:31:51.457184+0000","last_fullsized":"2024-04-24T13:31:51.457184+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:59:29.558483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":83,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304497+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:31:51.304497+0000","last_peered":"2024-04-24T13:31:51.304497+0000","last_clean":"2024-04-24T13:31:51.304497+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:31:51.304497+0000","last_undegraded":"2024-04-24T13:31:51.304497+0000","last_fullsized":"2024-04-24T13:31:51.304497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395288+0000","last_change":"2024-04-24T13:30:50.939033+0000","last_active":"2024-04-24T13:31:52.395288+0000","last_peered":"2024-04-24T13:31:52.395288+0000","last_clean":"2024-04-24T13:31:52.395288+0000","last_became_active":"2024-04-24T13:30:50.938747+0000","last_became_peered":"2024-04-24T13:30:50.938747+0000","last_unstale":"2024-04-24T13:31:52.395288+0000","last_undegraded":"2024-04-24T13:31:52.395288+0000","last_fullsized":"2024-04-24T13:31:52.395288+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:48.546868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304385+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:31:51.304385+0000","last_peered":"2024-04-24T13:31:51.304385+0000","last_clean":"2024-04-24T13:31:51.304385+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:31:51.304385+0000","last_undegraded":"2024-04-24T13:31:51.304385+0000","last_fullsized":"2024-04-24T13:31:51.304385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466713+0000","last_change":"2024-04-24T13:31:00.985586+0000","last_active":"2024-04-24T13:31:52.466713+0000","last_peered":"2024-04-24T13:31:52.466713+0000","last_clean":"2024-04-24T13:31:52.466713+0000","last_became_active":"2024-04-24T13:31:00.984858+0000","last_became_peered":"2024-04-24T13:31:00.984858+0000","last_unstale":"2024-04-24T13:31:52.466713+0000","last_undegraded":"2024-04-24T13:31:52.466713+0000","last_fullsized":"2024-04-24T13:31:52.466713+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:19.065008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395045+0000","last_change":"2024-04-24T13:30:25.228645+0000","last_active":"2024-04-24T13:31:52.395045+0000","last_peered":"2024-04-24T13:31:52.395045+0000","last_clean":"2024-04-24T13:31:52.395045+0000","last_became_active":"2024-04-24T13:30:25.227801+0000","last_became_peered":"2024-04-24T13:30:25.227801+0000","last_unstale":"2024-04-24T13:31:52.395045+0000","last_undegraded":"2024-04-24T13:31:52.395045+0000","last_fullsized":"2024-04-24T13:31:52.395045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:16.778257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":103,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304640+0000","last_change":"2024-04-24T13:30:27.264731+0000","last_active":"2024-04-24T13:31:51.304640+0000","last_peered":"2024-04-24T13:31:51.304640+0000","last_clean":"2024-04-24T13:31:51.304640+0000","last_became_active":"2024-04-24T13:30:27.263888+0000","last_became_peered":"2024-04-24T13:30:27.263888+0000","last_unstale":"2024-04-24T13:31:51.304640+0000","last_undegraded":"2024-04-24T13:31:51.304640+0000","last_fullsized":"2024-04-24T13:31:51.304640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":84,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211253+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:31:52.211253+0000","last_peered":"2024-04-24T13:31:52.211253+0000","last_clean":"2024-04-24T13:31:52.211253+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:31:52.211253+0000","last_undegraded":"2024-04-24T13:31:52.211253+0000","last_fullsized":"2024-04-24T13:31:52.211253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":79,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303740+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:31:51.303740+0000","last_peered":"2024-04-24T13:31:51.303740+0000","last_clean":"2024-04-24T13:31:51.303740+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:31:51.303740+0000","last_undegraded":"2024-04-24T13:31:51.303740+0000","last_fullsized":"2024-04-24T13:31:51.303740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395778+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:31:52.395778+0000","last_peered":"2024-04-24T13:31:52.395778+0000","last_clean":"2024-04-24T13:31:52.395778+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:31:52.395778+0000","last_undegraded":"2024-04-24T13:31:52.395778+0000","last_fullsized":"2024-04-24T13:31:52.395778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465638+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:31:52.465638+0000","last_peered":"2024-04-24T13:31:52.465638+0000","last_clean":"2024-04-24T13:31:52.465638+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:31:52.465638+0000","last_undegraded":"2024-04-24T13:31:52.465638+0000","last_fullsized":"2024-04-24T13:31:52.465638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.396772+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:31:52.396772+0000","last_peered":"2024-04-24T13:31:52.396772+0000","last_clean":"2024-04-24T13:31:52.396772+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:31:52.396772+0000","last_undegraded":"2024-04-24T13:31:52.396772+0000","last_fullsized":"2024-04-24T13:31:52.396772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464189+0000","last_change":"2024-04-24T13:30:21.223752+0000","last_active":"2024-04-24T13:31:52.464189+0000","last_peered":"2024-04-24T13:31:52.464189+0000","last_clean":"2024-04-24T13:31:52.464189+0000","last_became_active":"2024-04-24T13:30:21.223457+0000","last_became_peered":"2024-04-24T13:30:21.223457+0000","last_unstale":"2024-04-24T13:31:52.464189+0000","last_undegraded":"2024-04-24T13:31:52.464189+0000","last_fullsized":"2024-04-24T13:31:52.464189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:49.280399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455420+0000","last_change":"2024-04-24T13:30:50.943597+0000","last_active":"2024-04-24T13:31:51.455420+0000","last_peered":"2024-04-24T13:31:51.455420+0000","last_clean":"2024-04-24T13:31:51.455420+0000","last_became_active":"2024-04-24T13:30:50.941937+0000","last_became_peered":"2024-04-24T13:30:50.941937+0000","last_unstale":"2024-04-24T13:31:51.455420+0000","last_undegraded":"2024-04-24T13:31:51.455420+0000","last_fullsized":"2024-04-24T13:31:51.455420+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:55.853630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455160+0000","last_change":"2024-04-24T13:30:21.224037+0000","last_active":"2024-04-24T13:31:51.455160+0000","last_peered":"2024-04-24T13:31:51.455160+0000","last_clean":"2024-04-24T13:31:51.455160+0000","last_became_active":"2024-04-24T13:30:21.222146+0000","last_became_peered":"2024-04-24T13:30:21.222146+0000","last_unstale":"2024-04-24T13:31:51.455160+0000","last_undegraded":"2024-04-24T13:31:51.455160+0000","last_fullsized":"2024-04-24T13:31:51.455160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395828+0000","last_change":"2024-04-24T13:30:50.918913+0000","last_active":"2024-04-24T13:31:52.395828+0000","last_peered":"2024-04-24T13:31:52.395828+0000","last_clean":"2024-04-24T13:31:52.395828+0000","last_became_active":"2024-04-24T13:30:50.918221+0000","last_became_peered":"2024-04-24T13:30:50.918221+0000","last_unstale":"2024-04-24T13:31:52.395828+0000","last_undegraded":"2024-04-24T13:31:52.395828+0000","last_fullsized":"2024-04-24T13:31:52.395828+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:43.128644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211513+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:31:52.211513+0000","last_peered":"2024-04-24T13:31:52.211513+0000","last_clean":"2024-04-24T13:31:52.211513+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:31:52.211513+0000","last_undegraded":"2024-04-24T13:31:52.211513+0000","last_fullsized":"2024-04-24T13:31:52.211513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456864+0000","last_change":"2024-04-24T13:30:50.926509+0000","last_active":"2024-04-24T13:31:51.456864+0000","last_peered":"2024-04-24T13:31:51.456864+0000","last_clean":"2024-04-24T13:31:51.456864+0000","last_became_active":"2024-04-24T13:30:50.925894+0000","last_became_peered":"2024-04-24T13:30:50.925894+0000","last_unstale":"2024-04-24T13:31:51.456864+0000","last_undegraded":"2024-04-24T13:31:51.456864+0000","last_fullsized":"2024-04-24T13:31:51.456864+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458583+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:31:51.458583+0000","last_peered":"2024-04-24T13:31:51.458583+0000","last_clean":"2024-04-24T13:31:51.458583+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:31:51.458583+0000","last_undegraded":"2024-04-24T13:31:51.458583+0000","last_fullsized":"2024-04-24T13:31:51.458583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305354+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:31:51.305354+0000","last_peered":"2024-04-24T13:31:51.305354+0000","last_clean":"2024-04-24T13:31:51.305354+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:31:51.305354+0000","last_undegraded":"2024-04-24T13:31:51.305354+0000","last_fullsized":"2024-04-24T13:31:51.305354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395681+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:31:52.395681+0000","last_peered":"2024-04-24T13:31:52.395681+0000","last_clean":"2024-04-24T13:31:52.395681+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:31:52.395681+0000","last_undegraded":"2024-04-24T13:31:52.395681+0000","last_fullsized":"2024-04-24T13:31:52.395681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455301+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:31:51.455301+0000","last_peered":"2024-04-24T13:31:51.455301+0000","last_clean":"2024-04-24T13:31:51.455301+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:31:51.455301+0000","last_undegraded":"2024-04-24T13:31:51.455301+0000","last_fullsized":"2024-04-24T13:31:51.455301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465537+0000","last_change":"2024-04-24T13:30:50.956474+0000","last_active":"2024-04-24T13:31:52.465537+0000","last_peered":"2024-04-24T13:31:52.465537+0000","last_clean":"2024-04-24T13:31:52.465537+0000","last_became_active":"2024-04-24T13:30:50.955801+0000","last_became_peered":"2024-04-24T13:30:50.955801+0000","last_unstale":"2024-04-24T13:31:52.465537+0000","last_undegraded":"2024-04-24T13:31:52.465537+0000","last_fullsized":"2024-04-24T13:31:52.465537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:41.114080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464753+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:31:52.464753+0000","last_peered":"2024-04-24T13:31:52.464753+0000","last_clean":"2024-04-24T13:31:52.464753+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:31:52.464753+0000","last_undegraded":"2024-04-24T13:31:52.464753+0000","last_fullsized":"2024-04-24T13:31:52.464753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458385+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:31:51.458385+0000","last_peered":"2024-04-24T13:31:51.458385+0000","last_clean":"2024-04-24T13:31:51.458385+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:31:51.458385+0000","last_undegraded":"2024-04-24T13:31:51.458385+0000","last_fullsized":"2024-04-24T13:31:51.458385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210491+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:31:52.210491+0000","last_peered":"2024-04-24T13:31:52.210491+0000","last_clean":"2024-04-24T13:31:52.210491+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:31:52.210491+0000","last_undegraded":"2024-04-24T13:31:52.210491+0000","last_fullsized":"2024-04-24T13:31:52.210491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455191+0000","last_change":"2024-04-24T13:30:21.229523+0000","last_active":"2024-04-24T13:31:51.455191+0000","last_peered":"2024-04-24T13:31:51.455191+0000","last_clean":"2024-04-24T13:31:51.455191+0000","last_became_active":"2024-04-24T13:30:21.228400+0000","last_became_peered":"2024-04-24T13:30:21.228400+0000","last_unstale":"2024-04-24T13:31:51.455191+0000","last_undegraded":"2024-04-24T13:31:51.455191+0000","last_fullsized":"2024-04-24T13:31:51.455191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306388+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:31:51.306388+0000","last_peered":"2024-04-24T13:31:51.306388+0000","last_clean":"2024-04-24T13:31:51.306388+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:31:51.306388+0000","last_undegraded":"2024-04-24T13:31:51.306388+0000","last_fullsized":"2024-04-24T13:31:51.306388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457222+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:31:51.457222+0000","last_peered":"2024-04-24T13:31:51.457222+0000","last_clean":"2024-04-24T13:31:51.457222+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:31:51.457222+0000","last_undegraded":"2024-04-24T13:31:51.457222+0000","last_fullsized":"2024-04-24T13:31:51.457222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466666+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:31:52.466666+0000","last_peered":"2024-04-24T13:31:52.466666+0000","last_clean":"2024-04-24T13:31:52.466666+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:31:52.466666+0000","last_undegraded":"2024-04-24T13:31:52.466666+0000","last_fullsized":"2024-04-24T13:31:52.466666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455020+0000","last_change":"2024-04-24T13:30:50.923914+0000","last_active":"2024-04-24T13:31:51.455020+0000","last_peered":"2024-04-24T13:31:51.455020+0000","last_clean":"2024-04-24T13:31:51.455020+0000","last_became_active":"2024-04-24T13:30:50.923103+0000","last_became_peered":"2024-04-24T13:30:50.923103+0000","last_unstale":"2024-04-24T13:31:51.455020+0000","last_undegraded":"2024-04-24T13:31:51.455020+0000","last_fullsized":"2024-04-24T13:31:51.455020+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:26:58.476605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305925+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:31:51.305925+0000","last_peered":"2024-04-24T13:31:51.305925+0000","last_clean":"2024-04-24T13:31:51.305925+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:31:51.305925+0000","last_undegraded":"2024-04-24T13:31:51.305925+0000","last_fullsized":"2024-04-24T13:31:51.305925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":105,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211664+0000","last_change":"2024-04-24T13:30:50.920564+0000","last_active":"2024-04-24T13:31:52.211664+0000","last_peered":"2024-04-24T13:31:52.211664+0000","last_clean":"2024-04-24T13:31:52.211664+0000","last_became_active":"2024-04-24T13:30:50.920252+0000","last_became_peered":"2024-04-24T13:30:50.920252+0000","last_unstale":"2024-04-24T13:31:52.211664+0000","last_undegraded":"2024-04-24T13:31:52.211664+0000","last_fullsized":"2024-04-24T13:31:52.211664+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:29.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456139+0000","last_change":"2024-04-24T13:30:50.925075+0000","last_active":"2024-04-24T13:31:51.456139+0000","last_peered":"2024-04-24T13:31:51.456139+0000","last_clean":"2024-04-24T13:31:51.456139+0000","last_became_active":"2024-04-24T13:30:50.921219+0000","last_became_peered":"2024-04-24T13:30:50.921219+0000","last_unstale":"2024-04-24T13:31:51.456139+0000","last_undegraded":"2024-04-24T13:31:51.456139+0000","last_fullsized":"2024-04-24T13:31:51.456139+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:06.421799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465530+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:31:52.465530+0000","last_peered":"2024-04-24T13:31:52.465530+0000","last_clean":"2024-04-24T13:31:52.465530+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:31:52.465530+0000","last_undegraded":"2024-04-24T13:31:52.465530+0000","last_fullsized":"2024-04-24T13:31:52.465530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211258+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:31:52.211258+0000","last_peered":"2024-04-24T13:31:52.211258+0000","last_clean":"2024-04-24T13:31:52.211258+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:31:52.211258+0000","last_undegraded":"2024-04-24T13:31:52.211258+0000","last_fullsized":"2024-04-24T13:31:52.211258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":63,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466742+0000","last_change":"2024-04-24T13:30:50.936271+0000","last_active":"2024-04-24T13:31:52.466742+0000","last_peered":"2024-04-24T13:31:52.466742+0000","last_clean":"2024-04-24T13:31:52.466742+0000","last_became_active":"2024-04-24T13:30:50.935833+0000","last_became_peered":"2024-04-24T13:30:50.935833+0000","last_unstale":"2024-04-24T13:31:52.466742+0000","last_undegraded":"2024-04-24T13:31:52.466742+0000","last_fullsized":"2024-04-24T13:31:52.466742+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:04.149889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455420+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:31:51.455420+0000","last_peered":"2024-04-24T13:31:51.455420+0000","last_clean":"2024-04-24T13:31:51.455420+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:31:51.455420+0000","last_undegraded":"2024-04-24T13:31:51.455420+0000","last_fullsized":"2024-04-24T13:31:51.455420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.468076+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:31:52.468076+0000","last_peered":"2024-04-24T13:31:52.468076+0000","last_clean":"2024-04-24T13:31:52.468076+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:31:52.468076+0000","last_undegraded":"2024-04-24T13:31:52.468076+0000","last_fullsized":"2024-04-24T13:31:52.468076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458360+0000","last_change":"2024-04-24T13:30:50.913925+0000","last_active":"2024-04-24T13:31:51.458360+0000","last_peered":"2024-04-24T13:31:51.458360+0000","last_clean":"2024-04-24T13:31:51.458360+0000","last_became_active":"2024-04-24T13:30:50.913630+0000","last_became_peered":"2024-04-24T13:30:50.913630+0000","last_unstale":"2024-04-24T13:31:51.458360+0000","last_undegraded":"2024-04-24T13:31:51.458360+0000","last_fullsized":"2024-04-24T13:31:51.458360+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:45.481646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456500+0000","last_change":"2024-04-24T13:30:50.946577+0000","last_active":"2024-04-24T13:31:51.456500+0000","last_peered":"2024-04-24T13:31:51.456500+0000","last_clean":"2024-04-24T13:31:51.456500+0000","last_became_active":"2024-04-24T13:30:50.945909+0000","last_became_peered":"2024-04-24T13:30:50.945909+0000","last_unstale":"2024-04-24T13:31:51.456500+0000","last_undegraded":"2024-04-24T13:31:51.456500+0000","last_fullsized":"2024-04-24T13:31:51.456500+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:54.012692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454537+0000","last_change":"2024-04-24T13:30:21.218669+0000","last_active":"2024-04-24T13:31:51.454537+0000","last_peered":"2024-04-24T13:31:51.454537+0000","last_clean":"2024-04-24T13:31:51.454537+0000","last_became_active":"2024-04-24T13:30:21.217904+0000","last_became_peered":"2024-04-24T13:30:21.217904+0000","last_unstale":"2024-04-24T13:31:51.454537+0000","last_undegraded":"2024-04-24T13:31:51.454537+0000","last_fullsized":"2024-04-24T13:31:51.454537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210584+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:31:52.210584+0000","last_peered":"2024-04-24T13:31:52.210584+0000","last_clean":"2024-04-24T13:31:52.210584+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:31:52.210584+0000","last_undegraded":"2024-04-24T13:31:52.210584+0000","last_fullsized":"2024-04-24T13:31:52.210584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395485+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:31:52.395485+0000","last_peered":"2024-04-24T13:31:52.395485+0000","last_clean":"2024-04-24T13:31:52.395485+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:31:52.395485+0000","last_undegraded":"2024-04-24T13:31:52.395485+0000","last_fullsized":"2024-04-24T13:31:52.395485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456067+0000","last_change":"2024-04-24T13:30:23.217309+0000","last_active":"2024-04-24T13:31:51.456067+0000","last_peered":"2024-04-24T13:31:51.456067+0000","last_clean":"2024-04-24T13:31:51.456067+0000","last_became_active":"2024-04-24T13:30:23.216484+0000","last_became_peered":"2024-04-24T13:30:23.216484+0000","last_unstale":"2024-04-24T13:31:51.456067+0000","last_undegraded":"2024-04-24T13:31:51.456067+0000","last_fullsized":"2024-04-24T13:31:51.456067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":683,"num_read_kb":442,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1474,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":8878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":389,"ondisk_log_size":389,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":55834574872,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28372,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343468,"statfs":{"total":96636764160,"available":96607711232,"internally_reserved":0,"allocated":1384448,"data_stored":1007163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":434682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":794624,"data_stored":424269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":433195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":424773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":426340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1396736,"data_stored":1014985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:31:58.163 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:31:58.178 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:58.178 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:58.178 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:58.199 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:31:58.220 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:31:58.218+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:31:58.321 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:58.318+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:58.418 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:58.418 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:58.418 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:58.424 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:58.422+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:58.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:31:58.525 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:58.522+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:58.540 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:31:58.608 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:58.608 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.68310531, 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:31:58.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:31:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:31:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:31:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:31:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:31:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:31:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:31:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:31:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:31:58.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:31:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:31:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:31:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:31:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:58.613 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.54031354, 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:31:58.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.538010472, 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:31:58.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:31:58.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:31:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:31:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:31:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:31:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:31:58.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:31:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:31:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:31:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.53631595500001, 2024-04-24T13:31:58.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:31:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:31:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:31:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.534858344, 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.627 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:31:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:31:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:31:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:31:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:31:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:31:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.631 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.532929255, 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.635 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.530504718, 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:31:58.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.529301969, 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:31:58.640 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:31:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:31:58.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:31:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:31:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:31:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:31:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.52609580399999, 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.645 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:31:58.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:31:58.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:58.649 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.28704021999999, 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:31:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:31:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:31:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:31:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:31:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:31:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:31:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:31:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:31:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:31:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.653 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.284619569, 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:31:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:31:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:31:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:31:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:31:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:31:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:31:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:31:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:31:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:31:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.658 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.28384635099999, 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:31:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:31:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:31:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:31:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.276107297, 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.663 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:31:58.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 108.92814519, 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:31:58.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:31:58.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:31:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:31:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:31:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:31:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:31:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 108.927396442, 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.672 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:31:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:31:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:31:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:31:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:31:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:31:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.676 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 108.92646531699999, 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:31:58.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:31:58.680 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 108.92597352600001, 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:31:58.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:31:58.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.339892101999993, 2024-04-24T13:31:58.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:31:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:31:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:31:58.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:31:58.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:31:58.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:31:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:31:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:31:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:31:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:31:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:31:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.311044902999996, 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.692 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:31:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:31:58.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:31:58.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:31:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:31:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.272853659000006, 2024-04-24T13:31:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:31:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:58.698 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:31:58.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:58.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:58.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.703 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:58.704 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:58.704 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:58.705 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:31:58.706 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:58.704+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:58.717 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:31:58.725 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:31:58.745 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":121,"stamp":"2024-04-24T13:31:57.509861+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":595683,"num_objects":195,"num_object_clones":0,"num_object_copies":390,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":195,"num_whiteouts":0,"num_read":803,"num_read_kb":546,"num_write":588,"num_write_kb":2458,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":56,"num_bytes_recovered":591842,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":529,"ondisk_log_size":529,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":195904,"kb_used_data":6756,"kb_used_omap":10,"kb_used_meta":189045,"kb_avail":660406976,"statfs":{"total":676457349120,"available":676256743424,"internally_reserved":0,"allocated":6918144,"data_stored":4165407,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11161,"internal_metadata":193582183},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.032445"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":67,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466231+0000","last_change":"2024-04-24T13:31:00.989667+0000","last_active":"2024-04-24T13:31:52.466231+0000","last_peered":"2024-04-24T13:31:52.466231+0000","last_clean":"2024-04-24T13:31:52.466231+0000","last_became_active":"2024-04-24T13:31:00.989365+0000","last_became_peered":"2024-04-24T13:31:00.989365+0000","last_unstale":"2024-04-24T13:31:52.466231+0000","last_undegraded":"2024-04-24T13:31:52.466231+0000","last_fullsized":"2024-04-24T13:31:52.466231+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:00:51.108396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.38","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454154+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:31:51.454154+0000","last_peered":"2024-04-24T13:31:51.454154+0000","last_clean":"2024-04-24T13:31:51.454154+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:31:51.454154+0000","last_undegraded":"2024-04-24T13:31:51.454154+0000","last_fullsized":"2024-04-24T13:31:51.454154+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.397035+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:31:52.397035+0000","last_peered":"2024-04-24T13:31:52.397035+0000","last_clean":"2024-04-24T13:31:52.397035+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:31:52.397035+0000","last_undegraded":"2024-04-24T13:31:52.397035+0000","last_fullsized":"2024-04-24T13:31:52.397035+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395359+0000","last_change":"2024-04-24T13:30:50.941589+0000","last_active":"2024-04-24T13:31:52.395359+0000","last_peered":"2024-04-24T13:31:52.395359+0000","last_clean":"2024-04-24T13:31:52.395359+0000","last_became_active":"2024-04-24T13:30:50.941305+0000","last_became_peered":"2024-04-24T13:30:50.941305+0000","last_unstale":"2024-04-24T13:31:52.395359+0000","last_undegraded":"2024-04-24T13:31:52.395359+0000","last_fullsized":"2024-04-24T13:31:52.395359+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:23.793119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212409+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:31:52.212409+0000","last_peered":"2024-04-24T13:31:52.212409+0000","last_clean":"2024-04-24T13:31:52.212409+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:31:52.212409+0000","last_undegraded":"2024-04-24T13:31:52.212409+0000","last_fullsized":"2024-04-24T13:31:52.212409+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303376+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:31:51.303376+0000","last_peered":"2024-04-24T13:31:51.303376+0000","last_clean":"2024-04-24T13:31:51.303376+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:31:51.303376+0000","last_undegraded":"2024-04-24T13:31:51.303376+0000","last_fullsized":"2024-04-24T13:31:51.303376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456353+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:31:51.456353+0000","last_peered":"2024-04-24T13:31:51.456353+0000","last_clean":"2024-04-24T13:31:51.456353+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:31:51.456353+0000","last_undegraded":"2024-04-24T13:31:51.456353+0000","last_fullsized":"2024-04-24T13:31:51.456353+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210367+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:31:52.210367+0000","last_peered":"2024-04-24T13:31:52.210367+0000","last_clean":"2024-04-24T13:31:52.210367+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:31:52.210367+0000","last_undegraded":"2024-04-24T13:31:52.210367+0000","last_fullsized":"2024-04-24T13:31:52.210367+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":63,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466028+0000","last_change":"2024-04-24T13:30:50.941360+0000","last_active":"2024-04-24T13:31:52.466028+0000","last_peered":"2024-04-24T13:31:52.466028+0000","last_clean":"2024-04-24T13:31:52.466028+0000","last_became_active":"2024-04-24T13:30:50.940816+0000","last_became_peered":"2024-04-24T13:30:50.940816+0000","last_unstale":"2024-04-24T13:31:52.466028+0000","last_undegraded":"2024-04-24T13:31:52.466028+0000","last_fullsized":"2024-04-24T13:31:52.466028+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:04.247947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465355+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:31:52.465355+0000","last_peered":"2024-04-24T13:31:52.465355+0000","last_clean":"2024-04-24T13:31:52.465355+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:31:52.465355+0000","last_undegraded":"2024-04-24T13:31:52.465355+0000","last_fullsized":"2024-04-24T13:31:52.465355+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454695+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:31:51.454695+0000","last_peered":"2024-04-24T13:31:51.454695+0000","last_clean":"2024-04-24T13:31:51.454695+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:31:51.454695+0000","last_undegraded":"2024-04-24T13:31:51.454695+0000","last_fullsized":"2024-04-24T13:31:51.454695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303837+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:31:51.303837+0000","last_peered":"2024-04-24T13:31:51.303837+0000","last_clean":"2024-04-24T13:31:51.303837+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:31:51.303837+0000","last_undegraded":"2024-04-24T13:31:51.303837+0000","last_fullsized":"2024-04-24T13:31:51.303837+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210935+0000","last_change":"2024-04-24T13:30:50.911441+0000","last_active":"2024-04-24T13:31:52.210935+0000","last_peered":"2024-04-24T13:31:52.210935+0000","last_clean":"2024-04-24T13:31:52.210935+0000","last_became_active":"2024-04-24T13:30:50.911096+0000","last_became_peered":"2024-04-24T13:30:50.911096+0000","last_unstale":"2024-04-24T13:31:52.210935+0000","last_undegraded":"2024-04-24T13:31:52.210935+0000","last_fullsized":"2024-04-24T13:31:52.210935+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:12.878818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455968+0000","last_change":"2024-04-24T13:30:23.228080+0000","last_active":"2024-04-24T13:31:51.455968+0000","last_peered":"2024-04-24T13:31:51.455968+0000","last_clean":"2024-04-24T13:31:51.455968+0000","last_became_active":"2024-04-24T13:30:23.227215+0000","last_became_peered":"2024-04-24T13:30:23.227215+0000","last_unstale":"2024-04-24T13:31:51.455968+0000","last_undegraded":"2024-04-24T13:31:51.455968+0000","last_fullsized":"2024-04-24T13:31:51.455968+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458216+0000","last_change":"2024-04-24T13:30:21.232985+0000","last_active":"2024-04-24T13:31:51.458216+0000","last_peered":"2024-04-24T13:31:51.458216+0000","last_clean":"2024-04-24T13:31:51.458216+0000","last_became_active":"2024-04-24T13:30:21.229584+0000","last_became_peered":"2024-04-24T13:30:21.229584+0000","last_unstale":"2024-04-24T13:31:51.458216+0000","last_undegraded":"2024-04-24T13:31:51.458216+0000","last_fullsized":"2024-04-24T13:31:51.458216+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.467097+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:31:52.467097+0000","last_peered":"2024-04-24T13:31:52.467097+0000","last_clean":"2024-04-24T13:31:52.467097+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:31:52.467097+0000","last_undegraded":"2024-04-24T13:31:52.467097+0000","last_fullsized":"2024-04-24T13:31:52.467097+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303392+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:31:51.303392+0000","last_peered":"2024-04-24T13:31:51.303392+0000","last_clean":"2024-04-24T13:31:51.303392+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:31:51.303392+0000","last_undegraded":"2024-04-24T13:31:51.303392+0000","last_fullsized":"2024-04-24T13:31:51.303392+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456312+0000","last_change":"2024-04-24T13:30:50.945136+0000","last_active":"2024-04-24T13:31:51.456312+0000","last_peered":"2024-04-24T13:31:51.456312+0000","last_clean":"2024-04-24T13:31:51.456312+0000","last_became_active":"2024-04-24T13:30:50.944163+0000","last_became_peered":"2024-04-24T13:30:50.944163+0000","last_unstale":"2024-04-24T13:31:51.456312+0000","last_undegraded":"2024-04-24T13:31:51.456312+0000","last_fullsized":"2024-04-24T13:31:51.456312+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:29.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":62,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395187+0000","last_change":"2024-04-24T13:30:50.937742+0000","last_active":"2024-04-24T13:31:52.395187+0000","last_peered":"2024-04-24T13:31:52.395187+0000","last_clean":"2024-04-24T13:31:52.395187+0000","last_became_active":"2024-04-24T13:30:50.937395+0000","last_became_peered":"2024-04-24T13:30:50.937395+0000","last_unstale":"2024-04-24T13:31:52.395187+0000","last_undegraded":"2024-04-24T13:31:52.395187+0000","last_fullsized":"2024-04-24T13:31:52.395187+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:43.335130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465391+0000","last_change":"2024-04-24T13:30:21.244607+0000","last_active":"2024-04-24T13:31:52.465391+0000","last_peered":"2024-04-24T13:31:52.465391+0000","last_clean":"2024-04-24T13:31:52.465391+0000","last_became_active":"2024-04-24T13:30:21.243828+0000","last_became_peered":"2024-04-24T13:30:21.243828+0000","last_unstale":"2024-04-24T13:31:52.465391+0000","last_undegraded":"2024-04-24T13:31:52.465391+0000","last_fullsized":"2024-04-24T13:31:52.465391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454902+0000","last_change":"2024-04-24T13:30:23.220120+0000","last_active":"2024-04-24T13:31:51.454902+0000","last_peered":"2024-04-24T13:31:51.454902+0000","last_clean":"2024-04-24T13:31:51.454902+0000","last_became_active":"2024-04-24T13:30:23.219312+0000","last_became_peered":"2024-04-24T13:30:23.219312+0000","last_unstale":"2024-04-24T13:31:51.454902+0000","last_undegraded":"2024-04-24T13:31:51.454902+0000","last_fullsized":"2024-04-24T13:31:51.454902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465992+0000","last_change":"2024-04-24T13:30:21.243317+0000","last_active":"2024-04-24T13:31:52.465992+0000","last_peered":"2024-04-24T13:31:52.465992+0000","last_clean":"2024-04-24T13:31:52.465992+0000","last_became_active":"2024-04-24T13:30:21.239686+0000","last_became_peered":"2024-04-24T13:30:21.239686+0000","last_unstale":"2024-04-24T13:31:52.465992+0000","last_undegraded":"2024-04-24T13:31:52.465992+0000","last_fullsized":"2024-04-24T13:31:52.465992+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465884+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:31:52.465884+0000","last_peered":"2024-04-24T13:31:52.465884+0000","last_clean":"2024-04-24T13:31:52.465884+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:31:52.465884+0000","last_undegraded":"2024-04-24T13:31:52.465884+0000","last_fullsized":"2024-04-24T13:31:52.465884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":99,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305417+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:31:51.305417+0000","last_peered":"2024-04-24T13:31:51.305417+0000","last_clean":"2024-04-24T13:31:51.305417+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:31:51.305417+0000","last_undegraded":"2024-04-24T13:31:51.305417+0000","last_fullsized":"2024-04-24T13:31:51.305417+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465458+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:31:52.465458+0000","last_peered":"2024-04-24T13:31:52.465458+0000","last_clean":"2024-04-24T13:31:52.465458+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:31:52.465458+0000","last_undegraded":"2024-04-24T13:31:52.465458+0000","last_fullsized":"2024-04-24T13:31:52.465458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456376+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:31:51.456376+0000","last_peered":"2024-04-24T13:31:51.456376+0000","last_clean":"2024-04-24T13:31:51.456376+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:31:51.456376+0000","last_undegraded":"2024-04-24T13:31:51.456376+0000","last_fullsized":"2024-04-24T13:31:51.456376+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303782+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:31:51.303782+0000","last_peered":"2024-04-24T13:31:51.303782+0000","last_clean":"2024-04-24T13:31:51.303782+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:31:51.303782+0000","last_undegraded":"2024-04-24T13:31:51.303782+0000","last_fullsized":"2024-04-24T13:31:51.303782+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211506+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:31:52.211506+0000","last_peered":"2024-04-24T13:31:52.211506+0000","last_clean":"2024-04-24T13:31:52.211506+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:31:52.211506+0000","last_undegraded":"2024-04-24T13:31:52.211506+0000","last_fullsized":"2024-04-24T13:31:52.211506+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":79,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304039+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:31:51.304039+0000","last_peered":"2024-04-24T13:31:51.304039+0000","last_clean":"2024-04-24T13:31:51.304039+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:31:51.304039+0000","last_undegraded":"2024-04-24T13:31:51.304039+0000","last_fullsized":"2024-04-24T13:31:51.304039+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457602+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:31:51.457602+0000","last_peered":"2024-04-24T13:31:51.457602+0000","last_clean":"2024-04-24T13:31:51.457602+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:31:51.457602+0000","last_undegraded":"2024-04-24T13:31:51.457602+0000","last_fullsized":"2024-04-24T13:31:51.457602+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":59,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305081+0000","last_change":"2024-04-24T13:30:50.929479+0000","last_active":"2024-04-24T13:31:51.305081+0000","last_peered":"2024-04-24T13:31:51.305081+0000","last_clean":"2024-04-24T13:31:51.305081+0000","last_became_active":"2024-04-24T13:30:50.928545+0000","last_became_peered":"2024-04-24T13:30:50.928545+0000","last_unstale":"2024-04-24T13:31:51.305081+0000","last_undegraded":"2024-04-24T13:31:51.305081+0000","last_fullsized":"2024-04-24T13:31:51.305081+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:26:58.476605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455004+0000","last_change":"2024-04-24T13:30:25.234573+0000","last_active":"2024-04-24T13:31:51.455004+0000","last_peered":"2024-04-24T13:31:51.455004+0000","last_clean":"2024-04-24T13:31:51.455004+0000","last_became_active":"2024-04-24T13:30:25.233807+0000","last_became_peered":"2024-04-24T13:30:25.233807+0000","last_unstale":"2024-04-24T13:31:51.455004+0000","last_undegraded":"2024-04-24T13:31:51.455004+0000","last_fullsized":"2024-04-24T13:31:51.455004+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"32'9","reported_seq":119,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212224+0000","last_change":"2024-04-24T13:30:50.953480+0000","last_active":"2024-04-24T13:31:52.212224+0000","last_peered":"2024-04-24T13:31:52.212224+0000","last_clean":"2024-04-24T13:31:52.212224+0000","last_became_active":"2024-04-24T13:30:50.917577+0000","last_became_peered":"2024-04-24T13:30:50.917577+0000","last_unstale":"2024-04-24T13:31:52.212224+0000","last_undegraded":"2024-04-24T13:31:52.212224+0000","last_fullsized":"2024-04-24T13:31:52.212224+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:41.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456196+0000","last_change":"2024-04-24T13:30:50.941262+0000","last_active":"2024-04-24T13:31:51.456196+0000","last_peered":"2024-04-24T13:31:51.456196+0000","last_clean":"2024-04-24T13:31:51.456196+0000","last_became_active":"2024-04-24T13:30:50.940446+0000","last_became_peered":"2024-04-24T13:30:50.940446+0000","last_unstale":"2024-04-24T13:31:51.456196+0000","last_undegraded":"2024-04-24T13:31:51.456196+0000","last_fullsized":"2024-04-24T13:31:51.456196+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:49.927686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454316+0000","last_change":"2024-04-24T13:30:31.266582+0000","last_active":"2024-04-24T13:31:51.454316+0000","last_peered":"2024-04-24T13:31:51.454316+0000","last_clean":"2024-04-24T13:31:51.454316+0000","last_became_active":"2024-04-24T13:30:31.265452+0000","last_became_peered":"2024-04-24T13:30:31.265452+0000","last_unstale":"2024-04-24T13:31:51.454316+0000","last_undegraded":"2024-04-24T13:31:51.454316+0000","last_fullsized":"2024-04-24T13:31:51.454316+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455666+0000","last_change":"2024-04-24T13:30:50.944278+0000","last_active":"2024-04-24T13:31:51.455666+0000","last_peered":"2024-04-24T13:31:51.455666+0000","last_clean":"2024-04-24T13:31:51.455666+0000","last_became_active":"2024-04-24T13:30:50.942787+0000","last_became_peered":"2024-04-24T13:30:50.942787+0000","last_unstale":"2024-04-24T13:31:51.455666+0000","last_undegraded":"2024-04-24T13:31:51.455666+0000","last_fullsized":"2024-04-24T13:31:51.455666+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:06.774961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":105,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211583+0000","last_change":"2024-04-24T13:30:50.915215+0000","last_active":"2024-04-24T13:31:52.211583+0000","last_peered":"2024-04-24T13:31:52.211583+0000","last_clean":"2024-04-24T13:31:52.211583+0000","last_became_active":"2024-04-24T13:30:50.913930+0000","last_became_peered":"2024-04-24T13:30:50.913930+0000","last_unstale":"2024-04-24T13:31:52.211583+0000","last_undegraded":"2024-04-24T13:31:52.211583+0000","last_fullsized":"2024-04-24T13:31:52.211583+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:53.839067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":98,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458239+0000","last_change":"2024-04-24T13:30:50.926673+0000","last_active":"2024-04-24T13:31:51.458239+0000","last_peered":"2024-04-24T13:31:51.458239+0000","last_clean":"2024-04-24T13:31:51.458239+0000","last_became_active":"2024-04-24T13:30:50.926286+0000","last_became_peered":"2024-04-24T13:30:50.926286+0000","last_unstale":"2024-04-24T13:31:51.458239+0000","last_undegraded":"2024-04-24T13:31:51.458239+0000","last_fullsized":"2024-04-24T13:31:51.458239+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:21:21.951639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":96,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305813+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:31:51.305813+0000","last_peered":"2024-04-24T13:31:51.305813+0000","last_clean":"2024-04-24T13:31:51.305813+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:31:51.305813+0000","last_undegraded":"2024-04-24T13:31:51.305813+0000","last_fullsized":"2024-04-24T13:31:51.305813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":83,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305650+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:31:51.305650+0000","last_peered":"2024-04-24T13:31:51.305650+0000","last_clean":"2024-04-24T13:31:51.305650+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:31:51.305650+0000","last_undegraded":"2024-04-24T13:31:51.305650+0000","last_fullsized":"2024-04-24T13:31:51.305650+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210362+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:31:52.210362+0000","last_peered":"2024-04-24T13:31:52.210362+0000","last_clean":"2024-04-24T13:31:52.210362+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:31:52.210362+0000","last_undegraded":"2024-04-24T13:31:52.210362+0000","last_fullsized":"2024-04-24T13:31:52.210362+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210613+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:31:52.210613+0000","last_peered":"2024-04-24T13:31:52.210613+0000","last_clean":"2024-04-24T13:31:52.210613+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:31:52.210613+0000","last_undegraded":"2024-04-24T13:31:52.210613+0000","last_fullsized":"2024-04-24T13:31:52.210613+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":59,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304570+0000","last_change":"2024-04-24T13:30:50.946908+0000","last_active":"2024-04-24T13:31:51.304570+0000","last_peered":"2024-04-24T13:31:51.304570+0000","last_clean":"2024-04-24T13:31:51.304570+0000","last_became_active":"2024-04-24T13:30:50.932201+0000","last_became_peered":"2024-04-24T13:30:50.932201+0000","last_unstale":"2024-04-24T13:31:51.304570+0000","last_undegraded":"2024-04-24T13:31:51.304570+0000","last_fullsized":"2024-04-24T13:31:51.304570+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:41.874257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458774+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:31:51.458774+0000","last_peered":"2024-04-24T13:31:51.458774+0000","last_clean":"2024-04-24T13:31:51.458774+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:31:51.458774+0000","last_undegraded":"2024-04-24T13:31:51.458774+0000","last_fullsized":"2024-04-24T13:31:51.458774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465209+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:31:52.465209+0000","last_peered":"2024-04-24T13:31:52.465209+0000","last_clean":"2024-04-24T13:31:52.465209+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:31:52.465209+0000","last_undegraded":"2024-04-24T13:31:52.465209+0000","last_fullsized":"2024-04-24T13:31:52.465209+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"42'3","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.394976+0000","last_change":"2024-04-24T13:30:50.933595+0000","last_active":"2024-04-24T13:31:52.394976+0000","last_peered":"2024-04-24T13:31:52.394976+0000","last_clean":"2024-04-24T13:31:52.394976+0000","last_became_active":"2024-04-24T13:30:50.926963+0000","last_became_peered":"2024-04-24T13:30:50.926963+0000","last_unstale":"2024-04-24T13:31:52.394976+0000","last_undegraded":"2024-04-24T13:31:52.394976+0000","last_fullsized":"2024-04-24T13:31:52.394976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":79,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304685+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:31:51.304685+0000","last_peered":"2024-04-24T13:31:51.304685+0000","last_clean":"2024-04-24T13:31:51.304685+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:31:51.304685+0000","last_undegraded":"2024-04-24T13:31:51.304685+0000","last_fullsized":"2024-04-24T13:31:51.304685+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458257+0000","last_change":"2024-04-24T13:30:50.921336+0000","last_active":"2024-04-24T13:31:51.458257+0000","last_peered":"2024-04-24T13:31:51.458257+0000","last_clean":"2024-04-24T13:31:51.458257+0000","last_became_active":"2024-04-24T13:30:50.920829+0000","last_became_peered":"2024-04-24T13:30:50.920829+0000","last_unstale":"2024-04-24T13:31:51.458257+0000","last_undegraded":"2024-04-24T13:31:51.458257+0000","last_fullsized":"2024-04-24T13:31:51.458257+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:37.250085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464894+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:31:52.464894+0000","last_peered":"2024-04-24T13:31:52.464894+0000","last_clean":"2024-04-24T13:31:52.464894+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:31:52.464894+0000","last_undegraded":"2024-04-24T13:31:52.464894+0000","last_fullsized":"2024-04-24T13:31:52.464894+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455830+0000","last_change":"2024-04-24T13:30:25.229897+0000","last_active":"2024-04-24T13:31:51.455830+0000","last_peered":"2024-04-24T13:31:51.455830+0000","last_clean":"2024-04-24T13:31:51.455830+0000","last_became_active":"2024-04-24T13:30:25.228575+0000","last_became_peered":"2024-04-24T13:30:25.228575+0000","last_unstale":"2024-04-24T13:31:51.455830+0000","last_undegraded":"2024-04-24T13:31:51.455830+0000","last_fullsized":"2024-04-24T13:31:51.455830+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"32'9","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465809+0000","last_change":"2024-04-24T13:30:51.001114+0000","last_active":"2024-04-24T13:31:52.465809+0000","last_peered":"2024-04-24T13:31:52.465809+0000","last_clean":"2024-04-24T13:31:52.465809+0000","last_became_active":"2024-04-24T13:30:50.954422+0000","last_became_peered":"2024-04-24T13:30:50.954422+0000","last_unstale":"2024-04-24T13:31:52.465809+0000","last_undegraded":"2024-04-24T13:31:52.465809+0000","last_fullsized":"2024-04-24T13:31:52.465809+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:44.516492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"29'2","reported_seq":104,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457978+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:31:51.457978+0000","last_peered":"2024-04-24T13:31:51.457978+0000","last_clean":"2024-04-24T13:31:51.457978+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:31:51.457978+0000","last_undegraded":"2024-04-24T13:31:51.457978+0000","last_fullsized":"2024-04-24T13:31:51.457978+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454412+0000","last_change":"2024-04-24T13:30:50.921166+0000","last_active":"2024-04-24T13:31:51.454412+0000","last_peered":"2024-04-24T13:31:51.454412+0000","last_clean":"2024-04-24T13:31:51.454412+0000","last_became_active":"2024-04-24T13:30:50.920255+0000","last_became_peered":"2024-04-24T13:30:50.920255+0000","last_unstale":"2024-04-24T13:31:51.454412+0000","last_undegraded":"2024-04-24T13:31:51.454412+0000","last_fullsized":"2024-04-24T13:31:51.454412+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:21.522361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466629+0000","last_change":"2024-04-24T13:31:01.035289+0000","last_active":"2024-04-24T13:31:52.466629+0000","last_peered":"2024-04-24T13:31:52.466629+0000","last_clean":"2024-04-24T13:31:52.466629+0000","last_became_active":"2024-04-24T13:31:01.034325+0000","last_became_peered":"2024-04-24T13:31:01.034325+0000","last_unstale":"2024-04-24T13:31:52.466629+0000","last_undegraded":"2024-04-24T13:31:52.466629+0000","last_fullsized":"2024-04-24T13:31:52.466629+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:08.322191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":62,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464827+0000","last_change":"2024-04-24T13:30:50.948387+0000","last_active":"2024-04-24T13:31:52.464827+0000","last_peered":"2024-04-24T13:31:52.464827+0000","last_clean":"2024-04-24T13:31:52.464827+0000","last_became_active":"2024-04-24T13:30:50.947644+0000","last_became_peered":"2024-04-24T13:30:50.947644+0000","last_unstale":"2024-04-24T13:31:52.464827+0000","last_undegraded":"2024-04-24T13:31:52.464827+0000","last_fullsized":"2024-04-24T13:31:52.464827+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:03.622375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"32'19","reported_seq":120,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454319+0000","last_change":"2024-04-24T13:30:27.261028+0000","last_active":"2024-04-24T13:31:51.454319+0000","last_peered":"2024-04-24T13:31:51.454319+0000","last_clean":"2024-04-24T13:31:51.454319+0000","last_became_active":"2024-04-24T13:30:27.260231+0000","last_became_peered":"2024-04-24T13:30:27.260231+0000","last_unstale":"2024-04-24T13:31:51.454319+0000","last_undegraded":"2024-04-24T13:31:51.454319+0000","last_fullsized":"2024-04-24T13:31:51.454319+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":32,"num_read_kb":21,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395173+0000","last_change":"2024-04-24T13:30:29.256804+0000","last_active":"2024-04-24T13:31:52.395173+0000","last_peered":"2024-04-24T13:31:52.395173+0000","last_clean":"2024-04-24T13:31:52.395173+0000","last_became_active":"2024-04-24T13:30:29.255975+0000","last_became_peered":"2024-04-24T13:30:29.255975+0000","last_unstale":"2024-04-24T13:31:52.395173+0000","last_undegraded":"2024-04-24T13:31:52.395173+0000","last_fullsized":"2024-04-24T13:31:52.395173+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:51.521585+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455403+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:31:51.455403+0000","last_peered":"2024-04-24T13:31:51.455403+0000","last_clean":"2024-04-24T13:31:51.455403+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:31:51.455403+0000","last_undegraded":"2024-04-24T13:31:51.455403+0000","last_fullsized":"2024-04-24T13:31:51.455403+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303376+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:31:51.303376+0000","last_peered":"2024-04-24T13:31:51.303376+0000","last_clean":"2024-04-24T13:31:51.303376+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:31:51.303376+0000","last_undegraded":"2024-04-24T13:31:51.303376+0000","last_fullsized":"2024-04-24T13:31:51.303376+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":59,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306600+0000","last_change":"2024-04-24T13:30:50.930041+0000","last_active":"2024-04-24T13:31:51.306600+0000","last_peered":"2024-04-24T13:31:51.306600+0000","last_clean":"2024-04-24T13:31:51.306600+0000","last_became_active":"2024-04-24T13:30:50.929179+0000","last_became_peered":"2024-04-24T13:30:50.929179+0000","last_unstale":"2024-04-24T13:31:51.306600+0000","last_undegraded":"2024-04-24T13:31:51.306600+0000","last_fullsized":"2024-04-24T13:31:51.306600+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:46.987972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":93,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464090+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:31:52.464090+0000","last_peered":"2024-04-24T13:31:52.464090+0000","last_clean":"2024-04-24T13:31:52.464090+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:31:52.464090+0000","last_undegraded":"2024-04-24T13:31:52.464090+0000","last_fullsized":"2024-04-24T13:31:52.464090+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"32'9","reported_seq":120,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456984+0000","last_change":"2024-04-24T13:30:50.948850+0000","last_active":"2024-04-24T13:31:51.456984+0000","last_peered":"2024-04-24T13:31:51.456984+0000","last_clean":"2024-04-24T13:31:51.456984+0000","last_became_active":"2024-04-24T13:30:50.921374+0000","last_became_peered":"2024-04-24T13:30:50.921374+0000","last_unstale":"2024-04-24T13:31:51.456984+0000","last_undegraded":"2024-04-24T13:31:51.456984+0000","last_fullsized":"2024-04-24T13:31:51.456984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:22:03.728196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457359+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:31:51.457359+0000","last_peered":"2024-04-24T13:31:51.457359+0000","last_clean":"2024-04-24T13:31:51.457359+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:31:51.457359+0000","last_undegraded":"2024-04-24T13:31:51.457359+0000","last_fullsized":"2024-04-24T13:31:51.457359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":81,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465647+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:31:52.465647+0000","last_peered":"2024-04-24T13:31:52.465647+0000","last_clean":"2024-04-24T13:31:52.465647+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:31:52.465647+0000","last_undegraded":"2024-04-24T13:31:52.465647+0000","last_fullsized":"2024-04-24T13:31:52.465647+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465426+0000","last_change":"2024-04-24T13:30:23.239143+0000","last_active":"2024-04-24T13:31:52.465426+0000","last_peered":"2024-04-24T13:31:52.465426+0000","last_clean":"2024-04-24T13:31:52.465426+0000","last_became_active":"2024-04-24T13:30:23.238351+0000","last_became_peered":"2024-04-24T13:30:23.238351+0000","last_unstale":"2024-04-24T13:31:52.465426+0000","last_undegraded":"2024-04-24T13:31:52.465426+0000","last_fullsized":"2024-04-24T13:31:52.465426+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455480+0000","last_change":"2024-04-24T13:30:50.962698+0000","last_active":"2024-04-24T13:31:51.455480+0000","last_peered":"2024-04-24T13:31:51.455480+0000","last_clean":"2024-04-24T13:31:51.455480+0000","last_became_active":"2024-04-24T13:30:50.962126+0000","last_became_peered":"2024-04-24T13:30:50.962126+0000","last_unstale":"2024-04-24T13:31:51.455480+0000","last_undegraded":"2024-04-24T13:31:51.455480+0000","last_fullsized":"2024-04-24T13:31:51.455480+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.808699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":93,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466154+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:31:52.466154+0000","last_peered":"2024-04-24T13:31:52.466154+0000","last_clean":"2024-04-24T13:31:52.466154+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:31:52.466154+0000","last_undegraded":"2024-04-24T13:31:52.466154+0000","last_fullsized":"2024-04-24T13:31:52.466154+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"32'15","reported_seq":122,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464005+0000","last_change":"2024-04-24T13:30:50.970163+0000","last_active":"2024-04-24T13:31:52.464005+0000","last_peered":"2024-04-24T13:31:52.464005+0000","last_clean":"2024-04-24T13:31:52.464005+0000","last_became_active":"2024-04-24T13:30:50.920182+0000","last_became_peered":"2024-04-24T13:30:50.920182+0000","last_unstale":"2024-04-24T13:31:52.464005+0000","last_undegraded":"2024-04-24T13:31:52.464005+0000","last_fullsized":"2024-04-24T13:31:52.464005+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:29.765956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"29'2","reported_seq":103,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210839+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:31:52.210839+0000","last_peered":"2024-04-24T13:31:52.210839+0000","last_clean":"2024-04-24T13:31:52.210839+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:31:52.210839+0000","last_undegraded":"2024-04-24T13:31:52.210839+0000","last_fullsized":"2024-04-24T13:31:52.210839+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"0'0","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210705+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:31:52.210705+0000","last_peered":"2024-04-24T13:31:52.210705+0000","last_clean":"2024-04-24T13:31:52.210705+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:31:52.210705+0000","last_undegraded":"2024-04-24T13:31:52.210705+0000","last_fullsized":"2024-04-24T13:31:52.210705+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211981+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:31:52.211981+0000","last_peered":"2024-04-24T13:31:52.211981+0000","last_clean":"2024-04-24T13:31:52.211981+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:31:52.211981+0000","last_undegraded":"2024-04-24T13:31:52.211981+0000","last_fullsized":"2024-04-24T13:31:52.211981+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457225+0000","last_change":"2024-04-24T13:30:21.228287+0000","last_active":"2024-04-24T13:31:51.457225+0000","last_peered":"2024-04-24T13:31:51.457225+0000","last_clean":"2024-04-24T13:31:51.457225+0000","last_became_active":"2024-04-24T13:30:21.227358+0000","last_became_peered":"2024-04-24T13:30:21.227358+0000","last_unstale":"2024-04-24T13:31:51.457225+0000","last_undegraded":"2024-04-24T13:31:51.457225+0000","last_fullsized":"2024-04-24T13:31:51.457225+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:09.788399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":93,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464734+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:31:52.464734+0000","last_peered":"2024-04-24T13:31:52.464734+0000","last_clean":"2024-04-24T13:31:52.464734+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:31:52.464734+0000","last_undegraded":"2024-04-24T13:31:52.464734+0000","last_fullsized":"2024-04-24T13:31:52.464734+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"32'12","reported_seq":128,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210957+0000","last_change":"2024-04-24T13:30:51.000083+0000","last_active":"2024-04-24T13:31:52.210957+0000","last_peered":"2024-04-24T13:31:52.210957+0000","last_clean":"2024-04-24T13:31:52.210957+0000","last_became_active":"2024-04-24T13:30:50.934568+0000","last_became_peered":"2024-04-24T13:30:50.934568+0000","last_unstale":"2024-04-24T13:31:52.210957+0000","last_undegraded":"2024-04-24T13:31:52.210957+0000","last_fullsized":"2024-04-24T13:31:52.210957+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:10.436000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":90,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.463921+0000","last_change":"2024-04-24T13:30:50.908390+0000","last_active":"2024-04-24T13:31:52.463921+0000","last_peered":"2024-04-24T13:31:52.463921+0000","last_clean":"2024-04-24T13:31:52.463921+0000","last_became_active":"2024-04-24T13:30:50.908013+0000","last_became_peered":"2024-04-24T13:30:50.908013+0000","last_unstale":"2024-04-24T13:31:52.463921+0000","last_undegraded":"2024-04-24T13:31:52.463921+0000","last_fullsized":"2024-04-24T13:31:52.463921+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395823+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:31:52.395823+0000","last_peered":"2024-04-24T13:31:52.395823+0000","last_clean":"2024-04-24T13:31:52.395823+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:31:52.395823+0000","last_undegraded":"2024-04-24T13:31:52.395823+0000","last_fullsized":"2024-04-24T13:31:52.395823+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305839+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:31:51.305839+0000","last_peered":"2024-04-24T13:31:51.305839+0000","last_clean":"2024-04-24T13:31:51.305839+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:31:51.305839+0000","last_undegraded":"2024-04-24T13:31:51.305839+0000","last_fullsized":"2024-04-24T13:31:51.305839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456014+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:31:51.456014+0000","last_peered":"2024-04-24T13:31:51.456014+0000","last_clean":"2024-04-24T13:31:51.456014+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:31:51.456014+0000","last_undegraded":"2024-04-24T13:31:51.456014+0000","last_fullsized":"2024-04-24T13:31:51.456014+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":98,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466462+0000","last_change":"2024-04-24T13:30:50.926692+0000","last_active":"2024-04-24T13:31:52.466462+0000","last_peered":"2024-04-24T13:31:52.466462+0000","last_clean":"2024-04-24T13:31:52.466462+0000","last_became_active":"2024-04-24T13:30:50.926146+0000","last_became_peered":"2024-04-24T13:30:50.926146+0000","last_unstale":"2024-04-24T13:31:52.466462+0000","last_undegraded":"2024-04-24T13:31:52.466462+0000","last_fullsized":"2024-04-24T13:31:52.466462+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:18.637521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"32'11","reported_seq":106,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306098+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:31:51.306098+0000","last_peered":"2024-04-24T13:31:51.306098+0000","last_clean":"2024-04-24T13:31:51.306098+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:31:51.306098+0000","last_undegraded":"2024-04-24T13:31:51.306098+0000","last_fullsized":"2024-04-24T13:31:51.306098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":84,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212333+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:31:52.212333+0000","last_peered":"2024-04-24T13:31:52.212333+0000","last_clean":"2024-04-24T13:31:52.212333+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:31:52.212333+0000","last_undegraded":"2024-04-24T13:31:52.212333+0000","last_fullsized":"2024-04-24T13:31:52.212333+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457444+0000","last_change":"2024-04-24T13:30:31.269459+0000","last_active":"2024-04-24T13:31:51.457444+0000","last_peered":"2024-04-24T13:31:51.457444+0000","last_clean":"2024-04-24T13:31:51.457444+0000","last_became_active":"2024-04-24T13:30:31.268604+0000","last_became_peered":"2024-04-24T13:30:31.268604+0000","last_unstale":"2024-04-24T13:31:51.457444+0000","last_undegraded":"2024-04-24T13:31:51.457444+0000","last_fullsized":"2024-04-24T13:31:51.457444+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:57.047113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305866+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:31:51.305866+0000","last_peered":"2024-04-24T13:31:51.305866+0000","last_clean":"2024-04-24T13:31:51.305866+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:31:51.305866+0000","last_undegraded":"2024-04-24T13:31:51.305866+0000","last_fullsized":"2024-04-24T13:31:51.305866+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465554+0000","last_change":"2024-04-24T13:31:00.986244+0000","last_active":"2024-04-24T13:31:52.465554+0000","last_peered":"2024-04-24T13:31:52.465554+0000","last_clean":"2024-04-24T13:31:52.465554+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:31:52.465554+0000","last_undegraded":"2024-04-24T13:31:52.465554+0000","last_fullsized":"2024-04-24T13:31:52.465554+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:23.355231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395490+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:31:52.395490+0000","last_peered":"2024-04-24T13:31:52.395490+0000","last_clean":"2024-04-24T13:31:52.395490+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:31:52.395490+0000","last_undegraded":"2024-04-24T13:31:52.395490+0000","last_fullsized":"2024-04-24T13:31:52.395490+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"32'15","reported_seq":114,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466958+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:31:52.466958+0000","last_peered":"2024-04-24T13:31:52.466958+0000","last_clean":"2024-04-24T13:31:52.466958+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:31:52.466958+0000","last_undegraded":"2024-04-24T13:31:52.466958+0000","last_fullsized":"2024-04-24T13:31:52.466958+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"29'2","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.467746+0000","last_change":"2024-04-24T13:30:29.259692+0000","last_active":"2024-04-24T13:31:52.467746+0000","last_peered":"2024-04-24T13:31:52.467746+0000","last_clean":"2024-04-24T13:31:52.467746+0000","last_became_active":"2024-04-24T13:30:29.258945+0000","last_became_peered":"2024-04-24T13:30:29.258945+0000","last_unstale":"2024-04-24T13:31:52.467746+0000","last_undegraded":"2024-04-24T13:31:52.467746+0000","last_fullsized":"2024-04-24T13:31:52.467746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:35.346937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395267+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:31:52.395267+0000","last_peered":"2024-04-24T13:31:52.395267+0000","last_clean":"2024-04-24T13:31:52.395267+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:31:52.395267+0000","last_undegraded":"2024-04-24T13:31:52.395267+0000","last_fullsized":"2024-04-24T13:31:52.395267+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306487+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:31:51.306487+0000","last_peered":"2024-04-24T13:31:51.306487+0000","last_clean":"2024-04-24T13:31:51.306487+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:31:51.306487+0000","last_undegraded":"2024-04-24T13:31:51.306487+0000","last_fullsized":"2024-04-24T13:31:51.306487+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":99,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304344+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:31:51.304344+0000","last_peered":"2024-04-24T13:31:51.304344+0000","last_clean":"2024-04-24T13:31:51.304344+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:31:51.304344+0000","last_undegraded":"2024-04-24T13:31:51.304344+0000","last_fullsized":"2024-04-24T13:31:51.304344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455941+0000","last_change":"2024-04-24T13:30:25.223759+0000","last_active":"2024-04-24T13:31:51.455941+0000","last_peered":"2024-04-24T13:31:51.455941+0000","last_clean":"2024-04-24T13:31:51.455941+0000","last_became_active":"2024-04-24T13:30:25.222877+0000","last_became_peered":"2024-04-24T13:30:25.222877+0000","last_unstale":"2024-04-24T13:31:51.455941+0000","last_undegraded":"2024-04-24T13:31:51.455941+0000","last_fullsized":"2024-04-24T13:31:51.455941+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"32'10","reported_seq":104,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458754+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:31:51.458754+0000","last_peered":"2024-04-24T13:31:51.458754+0000","last_clean":"2024-04-24T13:31:51.458754+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:31:51.458754+0000","last_undegraded":"2024-04-24T13:31:51.458754+0000","last_fullsized":"2024-04-24T13:31:51.458754+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"29'2","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465722+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:31:52.465722+0000","last_peered":"2024-04-24T13:31:52.465722+0000","last_clean":"2024-04-24T13:31:52.465722+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:31:52.465722+0000","last_undegraded":"2024-04-24T13:31:52.465722+0000","last_fullsized":"2024-04-24T13:31:52.465722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":79,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303378+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:31:51.303378+0000","last_peered":"2024-04-24T13:31:51.303378+0000","last_clean":"2024-04-24T13:31:51.303378+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:31:51.303378+0000","last_undegraded":"2024-04-24T13:31:51.303378+0000","last_fullsized":"2024-04-24T13:31:51.303378+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395718+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:31:52.395718+0000","last_peered":"2024-04-24T13:31:52.395718+0000","last_clean":"2024-04-24T13:31:52.395718+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:31:52.395718+0000","last_undegraded":"2024-04-24T13:31:52.395718+0000","last_fullsized":"2024-04-24T13:31:52.395718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457971+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:31:51.457971+0000","last_peered":"2024-04-24T13:31:51.457971+0000","last_clean":"2024-04-24T13:31:51.457971+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:31:51.457971+0000","last_undegraded":"2024-04-24T13:31:51.457971+0000","last_fullsized":"2024-04-24T13:31:51.457971+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":91,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306313+0000","last_change":"2024-04-24T13:30:25.224875+0000","last_active":"2024-04-24T13:31:51.306313+0000","last_peered":"2024-04-24T13:31:51.306313+0000","last_clean":"2024-04-24T13:31:51.306313+0000","last_became_active":"2024-04-24T13:30:25.224128+0000","last_became_peered":"2024-04-24T13:30:25.224128+0000","last_unstale":"2024-04-24T13:31:51.306313+0000","last_undegraded":"2024-04-24T13:31:51.306313+0000","last_fullsized":"2024-04-24T13:31:51.306313+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"32'17","reported_seq":117,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454872+0000","last_change":"2024-04-24T13:30:27.261440+0000","last_active":"2024-04-24T13:31:51.454872+0000","last_peered":"2024-04-24T13:31:51.454872+0000","last_clean":"2024-04-24T13:31:51.454872+0000","last_became_active":"2024-04-24T13:30:27.260655+0000","last_became_peered":"2024-04-24T13:30:27.260655+0000","last_unstale":"2024-04-24T13:31:51.454872+0000","last_undegraded":"2024-04-24T13:31:51.454872+0000","last_fullsized":"2024-04-24T13:31:51.454872+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":29,"num_read_kb":19,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":85,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464954+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:31:52.464954+0000","last_peered":"2024-04-24T13:31:52.464954+0000","last_clean":"2024-04-24T13:31:52.464954+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:31:52.464954+0000","last_undegraded":"2024-04-24T13:31:52.464954+0000","last_fullsized":"2024-04-24T13:31:52.464954+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395082+0000","last_change":"2024-04-24T13:30:31.264695+0000","last_active":"2024-04-24T13:31:52.395082+0000","last_peered":"2024-04-24T13:31:52.395082+0000","last_clean":"2024-04-24T13:31:52.395082+0000","last_became_active":"2024-04-24T13:30:31.263950+0000","last_became_peered":"2024-04-24T13:30:31.263950+0000","last_unstale":"2024-04-24T13:31:52.395082+0000","last_undegraded":"2024-04-24T13:31:52.395082+0000","last_fullsized":"2024-04-24T13:31:52.395082+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:18.381332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465907+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:31:52.465907+0000","last_peered":"2024-04-24T13:31:52.465907+0000","last_clean":"2024-04-24T13:31:52.465907+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:31:52.465907+0000","last_undegraded":"2024-04-24T13:31:52.465907+0000","last_fullsized":"2024-04-24T13:31:52.465907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":225,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211154+0000","last_change":"2024-04-24T13:30:53.928527+0000","last_active":"2024-04-24T13:31:52.211154+0000","last_peered":"2024-04-24T13:31:52.211154+0000","last_clean":"2024-04-24T13:31:52.211154+0000","last_became_active":"2024-04-24T13:30:53.928167+0000","last_became_peered":"2024-04-24T13:30:53.928167+0000","last_unstale":"2024-04-24T13:31:52.211154+0000","last_undegraded":"2024-04-24T13:31:52.211154+0000","last_fullsized":"2024-04-24T13:31:52.211154+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:43.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455369+0000","last_change":"2024-04-24T13:30:15.154142+0000","last_active":"2024-04-24T13:31:51.455369+0000","last_peered":"2024-04-24T13:31:51.455369+0000","last_clean":"2024-04-24T13:31:51.455369+0000","last_became_active":"2024-04-24T13:30:15.153433+0000","last_became_peered":"2024-04-24T13:30:15.153433+0000","last_unstale":"2024-04-24T13:31:51.455369+0000","last_undegraded":"2024-04-24T13:31:51.455369+0000","last_fullsized":"2024-04-24T13:31:51.455369+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457744+0000","last_change":"2024-04-24T13:30:21.229655+0000","last_active":"2024-04-24T13:31:51.457744+0000","last_peered":"2024-04-24T13:31:51.457744+0000","last_clean":"2024-04-24T13:31:51.457744+0000","last_became_active":"2024-04-24T13:30:21.229312+0000","last_became_peered":"2024-04-24T13:30:21.229312+0000","last_unstale":"2024-04-24T13:31:51.457744+0000","last_undegraded":"2024-04-24T13:31:51.457744+0000","last_fullsized":"2024-04-24T13:31:51.457744+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":63,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465292+0000","last_change":"2024-04-24T13:30:50.926055+0000","last_active":"2024-04-24T13:31:52.465292+0000","last_peered":"2024-04-24T13:31:52.465292+0000","last_clean":"2024-04-24T13:31:52.465292+0000","last_became_active":"2024-04-24T13:30:50.925664+0000","last_became_peered":"2024-04-24T13:30:50.925664+0000","last_unstale":"2024-04-24T13:31:52.465292+0000","last_undegraded":"2024-04-24T13:31:52.465292+0000","last_fullsized":"2024-04-24T13:31:52.465292+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:02.798146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"32'13","reported_seq":116,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456098+0000","last_change":"2024-04-24T13:30:27.258347+0000","last_active":"2024-04-24T13:31:51.456098+0000","last_peered":"2024-04-24T13:31:51.456098+0000","last_clean":"2024-04-24T13:31:51.456098+0000","last_became_active":"2024-04-24T13:30:27.257694+0000","last_became_peered":"2024-04-24T13:30:27.257694+0000","last_unstale":"2024-04-24T13:31:51.456098+0000","last_undegraded":"2024-04-24T13:31:51.456098+0000","last_fullsized":"2024-04-24T13:31:51.456098+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":30,"num_read_kb":19,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":89,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212319+0000","last_change":"2024-04-24T13:30:50.917737+0000","last_active":"2024-04-24T13:31:52.212319+0000","last_peered":"2024-04-24T13:31:52.212319+0000","last_clean":"2024-04-24T13:31:52.212319+0000","last_became_active":"2024-04-24T13:30:50.916920+0000","last_became_peered":"2024-04-24T13:30:50.916920+0000","last_unstale":"2024-04-24T13:31:52.212319+0000","last_undegraded":"2024-04-24T13:31:52.212319+0000","last_fullsized":"2024-04-24T13:31:52.212319+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:12.813827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":81,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464612+0000","last_change":"2024-04-24T13:30:31.272077+0000","last_active":"2024-04-24T13:31:52.464612+0000","last_peered":"2024-04-24T13:31:52.464612+0000","last_clean":"2024-04-24T13:31:52.464612+0000","last_became_active":"2024-04-24T13:30:31.271268+0000","last_became_peered":"2024-04-24T13:30:31.271268+0000","last_unstale":"2024-04-24T13:31:52.464612+0000","last_undegraded":"2024-04-24T13:31:52.464612+0000","last_fullsized":"2024-04-24T13:31:52.464612+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:33.796332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212507+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:31:52.212507+0000","last_peered":"2024-04-24T13:31:52.212507+0000","last_clean":"2024-04-24T13:31:52.212507+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:31:52.212507+0000","last_undegraded":"2024-04-24T13:31:52.212507+0000","last_fullsized":"2024-04-24T13:31:52.212507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.394822+0000","last_change":"2024-04-24T13:30:50.937903+0000","last_active":"2024-04-24T13:31:52.394822+0000","last_peered":"2024-04-24T13:31:52.394822+0000","last_clean":"2024-04-24T13:31:52.394822+0000","last_became_active":"2024-04-24T13:30:50.937359+0000","last_became_peered":"2024-04-24T13:30:50.937359+0000","last_unstale":"2024-04-24T13:31:52.394822+0000","last_undegraded":"2024-04-24T13:31:52.394822+0000","last_fullsized":"2024-04-24T13:31:52.394822+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:27.651521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211019+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:31:52.211019+0000","last_peered":"2024-04-24T13:31:52.211019+0000","last_clean":"2024-04-24T13:31:52.211019+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:31:52.211019+0000","last_undegraded":"2024-04-24T13:31:52.211019+0000","last_fullsized":"2024-04-24T13:31:52.211019+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456332+0000","last_change":"2024-04-24T13:30:25.232972+0000","last_active":"2024-04-24T13:31:51.456332+0000","last_peered":"2024-04-24T13:31:51.456332+0000","last_clean":"2024-04-24T13:31:51.456332+0000","last_became_active":"2024-04-24T13:30:25.232265+0000","last_became_peered":"2024-04-24T13:30:25.232265+0000","last_unstale":"2024-04-24T13:31:51.456332+0000","last_undegraded":"2024-04-24T13:31:51.456332+0000","last_fullsized":"2024-04-24T13:31:51.456332+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:47.489762+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"32'23","reported_seq":147,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395397+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:31:52.395397+0000","last_peered":"2024-04-24T13:31:52.395397+0000","last_clean":"2024-04-24T13:31:52.395397+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:31:52.395397+0000","last_undegraded":"2024-04-24T13:31:52.395397+0000","last_fullsized":"2024-04-24T13:31:52.395397+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":42,"num_read_kb":27,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":63,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466589+0000","last_change":"2024-04-24T13:30:50.925382+0000","last_active":"2024-04-24T13:31:52.466589+0000","last_peered":"2024-04-24T13:31:52.466589+0000","last_clean":"2024-04-24T13:31:52.466589+0000","last_became_active":"2024-04-24T13:30:50.924919+0000","last_became_peered":"2024-04-24T13:30:50.924919+0000","last_unstale":"2024-04-24T13:31:52.466589+0000","last_undegraded":"2024-04-24T13:31:52.466589+0000","last_fullsized":"2024-04-24T13:31:52.466589+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395996+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:31:52.395996+0000","last_peered":"2024-04-24T13:31:52.395996+0000","last_clean":"2024-04-24T13:31:52.395996+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:31:52.395996+0000","last_undegraded":"2024-04-24T13:31:52.395996+0000","last_fullsized":"2024-04-24T13:31:52.395996+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.396963+0000","last_change":"2024-04-24T13:30:23.217937+0000","last_active":"2024-04-24T13:31:52.396963+0000","last_peered":"2024-04-24T13:31:52.396963+0000","last_clean":"2024-04-24T13:31:52.396963+0000","last_became_active":"2024-04-24T13:30:23.217577+0000","last_became_peered":"2024-04-24T13:30:23.217577+0000","last_unstale":"2024-04-24T13:31:52.396963+0000","last_undegraded":"2024-04-24T13:31:52.396963+0000","last_fullsized":"2024-04-24T13:31:52.396963+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":107,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464324+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:31:52.464324+0000","last_peered":"2024-04-24T13:31:52.464324+0000","last_clean":"2024-04-24T13:31:52.464324+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:31:52.464324+0000","last_undegraded":"2024-04-24T13:31:52.464324+0000","last_fullsized":"2024-04-24T13:31:52.464324+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.394794+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:31:52.394794+0000","last_peered":"2024-04-24T13:31:52.394794+0000","last_clean":"2024-04-24T13:31:52.394794+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:31:52.394794+0000","last_undegraded":"2024-04-24T13:31:52.394794+0000","last_fullsized":"2024-04-24T13:31:52.394794+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":94,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.467837+0000","last_change":"2024-04-24T13:30:25.229114+0000","last_active":"2024-04-24T13:31:52.467837+0000","last_peered":"2024-04-24T13:31:52.467837+0000","last_clean":"2024-04-24T13:31:52.467837+0000","last_became_active":"2024-04-24T13:30:25.228634+0000","last_became_peered":"2024-04-24T13:30:25.228634+0000","last_unstale":"2024-04-24T13:31:52.467837+0000","last_undegraded":"2024-04-24T13:31:52.467837+0000","last_fullsized":"2024-04-24T13:31:52.467837+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:13.810005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"42'16","reported_seq":133,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465791+0000","last_change":"2024-04-24T13:30:50.991700+0000","last_active":"2024-04-24T13:31:52.465791+0000","last_peered":"2024-04-24T13:31:52.465791+0000","last_clean":"2024-04-24T13:31:52.465791+0000","last_became_active":"2024-04-24T13:30:50.940740+0000","last_became_peered":"2024-04-24T13:30:50.940740+0000","last_unstale":"2024-04-24T13:31:52.465791+0000","last_undegraded":"2024-04-24T13:31:52.465791+0000","last_fullsized":"2024-04-24T13:31:52.465791+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:39.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":84,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211749+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:31:52.211749+0000","last_peered":"2024-04-24T13:31:52.211749+0000","last_clean":"2024-04-24T13:31:52.211749+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:31:52.211749+0000","last_undegraded":"2024-04-24T13:31:52.211749+0000","last_fullsized":"2024-04-24T13:31:52.211749+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456678+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:31:51.456678+0000","last_peered":"2024-04-24T13:31:51.456678+0000","last_clean":"2024-04-24T13:31:51.456678+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:31:51.456678+0000","last_undegraded":"2024-04-24T13:31:51.456678+0000","last_fullsized":"2024-04-24T13:31:51.456678+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395658+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:31:52.395658+0000","last_peered":"2024-04-24T13:31:52.395658+0000","last_clean":"2024-04-24T13:31:52.395658+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:31:52.395658+0000","last_undegraded":"2024-04-24T13:31:52.395658+0000","last_fullsized":"2024-04-24T13:31:52.395658+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455510+0000","last_change":"2024-04-24T13:30:15.151799+0000","last_active":"2024-04-24T13:31:51.455510+0000","last_peered":"2024-04-24T13:31:51.455510+0000","last_clean":"2024-04-24T13:31:51.455510+0000","last_became_active":"2024-04-24T13:30:15.150672+0000","last_became_peered":"2024-04-24T13:30:15.150672+0000","last_unstale":"2024-04-24T13:31:51.455510+0000","last_undegraded":"2024-04-24T13:31:51.455510+0000","last_fullsized":"2024-04-24T13:31:51.455510+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"0'0","reported_seq":104,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305237+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:31:51.305237+0000","last_peered":"2024-04-24T13:31:51.305237+0000","last_clean":"2024-04-24T13:31:51.305237+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:31:51.305237+0000","last_undegraded":"2024-04-24T13:31:51.305237+0000","last_fullsized":"2024-04-24T13:31:51.305237+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.760398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":92,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211988+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:31:52.211988+0000","last_peered":"2024-04-24T13:31:52.211988+0000","last_clean":"2024-04-24T13:31:52.211988+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:31:52.211988+0000","last_undegraded":"2024-04-24T13:31:52.211988+0000","last_fullsized":"2024-04-24T13:31:52.211988+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456491+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:31:51.456491+0000","last_peered":"2024-04-24T13:31:51.456491+0000","last_clean":"2024-04-24T13:31:51.456491+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:31:51.456491+0000","last_undegraded":"2024-04-24T13:31:51.456491+0000","last_fullsized":"2024-04-24T13:31:51.456491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":85,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466013+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:31:52.466013+0000","last_peered":"2024-04-24T13:31:52.466013+0000","last_clean":"2024-04-24T13:31:52.466013+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:31:52.466013+0000","last_undegraded":"2024-04-24T13:31:52.466013+0000","last_fullsized":"2024-04-24T13:31:52.466013+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.453891+0000","last_change":"2024-04-24T13:30:31.267157+0000","last_active":"2024-04-24T13:31:51.453891+0000","last_peered":"2024-04-24T13:31:51.453891+0000","last_clean":"2024-04-24T13:31:51.453891+0000","last_became_active":"2024-04-24T13:30:31.266348+0000","last_became_peered":"2024-04-24T13:30:31.266348+0000","last_unstale":"2024-04-24T13:31:51.453891+0000","last_undegraded":"2024-04-24T13:31:51.453891+0000","last_fullsized":"2024-04-24T13:31:51.453891+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:31.837696+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.396262+0000","last_change":"2024-04-24T13:30:23.218086+0000","last_active":"2024-04-24T13:31:52.396262+0000","last_peered":"2024-04-24T13:31:52.396262+0000","last_clean":"2024-04-24T13:31:52.396262+0000","last_became_active":"2024-04-24T13:30:23.217750+0000","last_became_peered":"2024-04-24T13:30:23.217750+0000","last_unstale":"2024-04-24T13:31:52.396262+0000","last_undegraded":"2024-04-24T13:31:52.396262+0000","last_fullsized":"2024-04-24T13:31:52.396262+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455841+0000","last_change":"2024-04-24T13:30:21.214846+0000","last_active":"2024-04-24T13:31:51.455841+0000","last_peered":"2024-04-24T13:31:51.455841+0000","last_clean":"2024-04-24T13:31:51.455841+0000","last_became_active":"2024-04-24T13:30:21.214127+0000","last_became_peered":"2024-04-24T13:30:21.214127+0000","last_unstale":"2024-04-24T13:31:51.455841+0000","last_undegraded":"2024-04-24T13:31:51.455841+0000","last_fullsized":"2024-04-24T13:31:51.455841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:02.477283+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395908+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:31:52.395908+0000","last_peered":"2024-04-24T13:31:52.395908+0000","last_clean":"2024-04-24T13:31:52.395908+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:31:52.395908+0000","last_undegraded":"2024-04-24T13:31:52.395908+0000","last_fullsized":"2024-04-24T13:31:52.395908+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":92,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211588+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:31:52.211588+0000","last_peered":"2024-04-24T13:31:52.211588+0000","last_clean":"2024-04-24T13:31:52.211588+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:31:52.211588+0000","last_undegraded":"2024-04-24T13:31:52.211588+0000","last_fullsized":"2024-04-24T13:31:52.211588+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"32'18","reported_seq":120,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210769+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:31:52.210769+0000","last_peered":"2024-04-24T13:31:52.210769+0000","last_clean":"2024-04-24T13:31:52.210769+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:31:52.210769+0000","last_undegraded":"2024-04-24T13:31:52.210769+0000","last_fullsized":"2024-04-24T13:31:52.210769+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":83,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304969+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:31:51.304969+0000","last_peered":"2024-04-24T13:31:51.304969+0000","last_clean":"2024-04-24T13:31:51.304969+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:31:51.304969+0000","last_undegraded":"2024-04-24T13:31:51.304969+0000","last_fullsized":"2024-04-24T13:31:51.304969+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212093+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:31:52.212093+0000","last_peered":"2024-04-24T13:31:52.212093+0000","last_clean":"2024-04-24T13:31:52.212093+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:31:52.212093+0000","last_undegraded":"2024-04-24T13:31:52.212093+0000","last_fullsized":"2024-04-24T13:31:52.212093+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211902+0000","last_change":"2024-04-24T13:30:23.220277+0000","last_active":"2024-04-24T13:31:52.211902+0000","last_peered":"2024-04-24T13:31:52.211902+0000","last_clean":"2024-04-24T13:31:52.211902+0000","last_became_active":"2024-04-24T13:30:23.219932+0000","last_became_peered":"2024-04-24T13:30:23.219932+0000","last_unstale":"2024-04-24T13:31:52.211902+0000","last_undegraded":"2024-04-24T13:31:52.211902+0000","last_fullsized":"2024-04-24T13:31:52.211902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395747+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:31:52.395747+0000","last_peered":"2024-04-24T13:31:52.395747+0000","last_clean":"2024-04-24T13:31:52.395747+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:31:52.395747+0000","last_undegraded":"2024-04-24T13:31:52.395747+0000","last_fullsized":"2024-04-24T13:31:52.395747+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212087+0000","last_change":"2024-04-24T13:30:50.937016+0000","last_active":"2024-04-24T13:31:52.212087+0000","last_peered":"2024-04-24T13:31:52.212087+0000","last_clean":"2024-04-24T13:31:52.212087+0000","last_became_active":"2024-04-24T13:30:50.934998+0000","last_became_peered":"2024-04-24T13:30:50.934998+0000","last_unstale":"2024-04-24T13:31:52.212087+0000","last_undegraded":"2024-04-24T13:31:52.212087+0000","last_fullsized":"2024-04-24T13:31:52.212087+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:42:03.696601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":93,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465211+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:31:52.465211+0000","last_peered":"2024-04-24T13:31:52.465211+0000","last_clean":"2024-04-24T13:31:52.465211+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:31:52.465211+0000","last_undegraded":"2024-04-24T13:31:52.465211+0000","last_fullsized":"2024-04-24T13:31:52.465211+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":110,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.394951+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:31:52.394951+0000","last_peered":"2024-04-24T13:31:52.394951+0000","last_clean":"2024-04-24T13:31:52.394951+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:31:52.394951+0000","last_undegraded":"2024-04-24T13:31:52.394951+0000","last_fullsized":"2024-04-24T13:31:52.394951+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"29'2","reported_seq":104,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454185+0000","last_change":"2024-04-24T13:30:29.257969+0000","last_active":"2024-04-24T13:31:51.454185+0000","last_peered":"2024-04-24T13:31:51.454185+0000","last_clean":"2024-04-24T13:31:51.454185+0000","last_became_active":"2024-04-24T13:30:29.257131+0000","last_became_peered":"2024-04-24T13:30:29.257131+0000","last_unstale":"2024-04-24T13:31:51.454185+0000","last_undegraded":"2024-04-24T13:31:51.454185+0000","last_fullsized":"2024-04-24T13:31:51.454185+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458505+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:31:51.458505+0000","last_peered":"2024-04-24T13:31:51.458505+0000","last_clean":"2024-04-24T13:31:51.458505+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:31:51.458505+0000","last_undegraded":"2024-04-24T13:31:51.458505+0000","last_fullsized":"2024-04-24T13:31:51.458505+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.463812+0000","last_change":"2024-04-24T13:31:01.035271+0000","last_active":"2024-04-24T13:31:52.463812+0000","last_peered":"2024-04-24T13:31:52.463812+0000","last_clean":"2024-04-24T13:31:52.463812+0000","last_became_active":"2024-04-24T13:31:01.034314+0000","last_became_peered":"2024-04-24T13:31:01.034314+0000","last_unstale":"2024-04-24T13:31:52.463812+0000","last_undegraded":"2024-04-24T13:31:52.463812+0000","last_fullsized":"2024-04-24T13:31:52.463812+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:45.074671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457409+0000","last_change":"2024-04-24T13:30:50.913675+0000","last_active":"2024-04-24T13:31:51.457409+0000","last_peered":"2024-04-24T13:31:51.457409+0000","last_clean":"2024-04-24T13:31:51.457409+0000","last_became_active":"2024-04-24T13:30:50.912153+0000","last_became_peered":"2024-04-24T13:30:50.912153+0000","last_unstale":"2024-04-24T13:31:51.457409+0000","last_undegraded":"2024-04-24T13:31:51.457409+0000","last_fullsized":"2024-04-24T13:31:51.457409+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.808699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":107,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.394541+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:31:52.394541+0000","last_peered":"2024-04-24T13:31:52.394541+0000","last_clean":"2024-04-24T13:31:52.394541+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:31:52.394541+0000","last_undegraded":"2024-04-24T13:31:52.394541+0000","last_fullsized":"2024-04-24T13:31:52.394541+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":91,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304697+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:31:51.304697+0000","last_peered":"2024-04-24T13:31:51.304697+0000","last_clean":"2024-04-24T13:31:51.304697+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:31:51.304697+0000","last_undegraded":"2024-04-24T13:31:51.304697+0000","last_fullsized":"2024-04-24T13:31:51.304697+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":102,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305070+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:31:51.305070+0000","last_peered":"2024-04-24T13:31:51.305070+0000","last_clean":"2024-04-24T13:31:51.305070+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:31:51.305070+0000","last_undegraded":"2024-04-24T13:31:51.305070+0000","last_fullsized":"2024-04-24T13:31:51.305070+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"29'2","reported_seq":104,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.459791+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:31:51.459791+0000","last_peered":"2024-04-24T13:31:51.459791+0000","last_clean":"2024-04-24T13:31:51.459791+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:31:51.459791+0000","last_undegraded":"2024-04-24T13:31:51.459791+0000","last_fullsized":"2024-04-24T13:31:51.459791+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"0'0","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210502+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:31:52.210502+0000","last_peered":"2024-04-24T13:31:52.210502+0000","last_clean":"2024-04-24T13:31:52.210502+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:31:52.210502+0000","last_undegraded":"2024-04-24T13:31:52.210502+0000","last_fullsized":"2024-04-24T13:31:52.210502+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303606+0000","last_change":"2024-04-24T13:30:23.219012+0000","last_active":"2024-04-24T13:31:51.303606+0000","last_peered":"2024-04-24T13:31:51.303606+0000","last_clean":"2024-04-24T13:31:51.303606+0000","last_became_active":"2024-04-24T13:30:23.218312+0000","last_became_peered":"2024-04-24T13:30:23.218312+0000","last_unstale":"2024-04-24T13:31:51.303606+0000","last_undegraded":"2024-04-24T13:31:51.303606+0000","last_fullsized":"2024-04-24T13:31:51.303606+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:28.821923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212640+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:31:52.212640+0000","last_peered":"2024-04-24T13:31:52.212640+0000","last_clean":"2024-04-24T13:31:52.212640+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:31:52.212640+0000","last_undegraded":"2024-04-24T13:31:52.212640+0000","last_fullsized":"2024-04-24T13:31:52.212640+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":112,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466332+0000","last_change":"2024-04-24T13:30:50.937218+0000","last_active":"2024-04-24T13:31:52.466332+0000","last_peered":"2024-04-24T13:31:52.466332+0000","last_clean":"2024-04-24T13:31:52.466332+0000","last_became_active":"2024-04-24T13:30:50.936420+0000","last_became_peered":"2024-04-24T13:30:50.936420+0000","last_unstale":"2024-04-24T13:31:52.466332+0000","last_undegraded":"2024-04-24T13:31:52.466332+0000","last_fullsized":"2024-04-24T13:31:52.466332+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:08.910360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458472+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:31:51.458472+0000","last_peered":"2024-04-24T13:31:51.458472+0000","last_clean":"2024-04-24T13:31:51.458472+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:31:51.458472+0000","last_undegraded":"2024-04-24T13:31:51.458472+0000","last_fullsized":"2024-04-24T13:31:51.458472+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"32'19","reported_seq":134,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465135+0000","last_change":"2024-04-24T13:30:50.977698+0000","last_active":"2024-04-24T13:31:52.465135+0000","last_peered":"2024-04-24T13:31:52.465135+0000","last_clean":"2024-04-24T13:31:52.465135+0000","last_became_active":"2024-04-24T13:30:50.936955+0000","last_became_peered":"2024-04-24T13:30:50.936955+0000","last_unstale":"2024-04-24T13:31:52.465135+0000","last_undegraded":"2024-04-24T13:31:52.465135+0000","last_fullsized":"2024-04-24T13:31:52.465135+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:47.349331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457468+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:31:51.457468+0000","last_peered":"2024-04-24T13:31:51.457468+0000","last_clean":"2024-04-24T13:31:51.457468+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:31:51.457468+0000","last_undegraded":"2024-04-24T13:31:51.457468+0000","last_fullsized":"2024-04-24T13:31:51.457468+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454746+0000","last_change":"2024-04-24T13:30:50.944864+0000","last_active":"2024-04-24T13:31:51.454746+0000","last_peered":"2024-04-24T13:31:51.454746+0000","last_clean":"2024-04-24T13:31:51.454746+0000","last_became_active":"2024-04-24T13:30:50.934827+0000","last_became_peered":"2024-04-24T13:30:50.934827+0000","last_unstale":"2024-04-24T13:31:51.454746+0000","last_undegraded":"2024-04-24T13:31:51.454746+0000","last_fullsized":"2024-04-24T13:31:51.454746+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:36:11.086183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212184+0000","last_change":"2024-04-24T13:30:31.264343+0000","last_active":"2024-04-24T13:31:52.212184+0000","last_peered":"2024-04-24T13:31:52.212184+0000","last_clean":"2024-04-24T13:31:52.212184+0000","last_became_active":"2024-04-24T13:30:31.263640+0000","last_became_peered":"2024-04-24T13:30:31.263640+0000","last_unstale":"2024-04-24T13:31:52.212184+0000","last_undegraded":"2024-04-24T13:31:52.212184+0000","last_fullsized":"2024-04-24T13:31:52.212184+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:51:45.241537+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304845+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:31:51.304845+0000","last_peered":"2024-04-24T13:31:51.304845+0000","last_clean":"2024-04-24T13:31:51.304845+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:31:51.304845+0000","last_undegraded":"2024-04-24T13:31:51.304845+0000","last_fullsized":"2024-04-24T13:31:51.304845+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465031+0000","last_change":"2024-04-24T13:31:00.986151+0000","last_active":"2024-04-24T13:31:52.465031+0000","last_peered":"2024-04-24T13:31:52.465031+0000","last_clean":"2024-04-24T13:31:52.465031+0000","last_became_active":"2024-04-24T13:31:00.985421+0000","last_became_peered":"2024-04-24T13:31:00.985421+0000","last_unstale":"2024-04-24T13:31:52.465031+0000","last_undegraded":"2024-04-24T13:31:52.465031+0000","last_fullsized":"2024-04-24T13:31:52.465031+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:42.662404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.396337+0000","last_change":"2024-04-24T13:30:25.228158+0000","last_active":"2024-04-24T13:31:52.396337+0000","last_peered":"2024-04-24T13:31:52.396337+0000","last_clean":"2024-04-24T13:31:52.396337+0000","last_became_active":"2024-04-24T13:30:25.226828+0000","last_became_peered":"2024-04-24T13:30:25.226828+0000","last_unstale":"2024-04-24T13:31:52.396337+0000","last_undegraded":"2024-04-24T13:31:52.396337+0000","last_fullsized":"2024-04-24T13:31:52.396337+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:11.608677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"32'11","reported_seq":108,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455633+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:31:51.455633+0000","last_peered":"2024-04-24T13:31:51.455633+0000","last_clean":"2024-04-24T13:31:51.455633+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:31:51.455633+0000","last_undegraded":"2024-04-24T13:31:51.455633+0000","last_fullsized":"2024-04-24T13:31:51.455633+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458722+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:31:51.458722+0000","last_peered":"2024-04-24T13:31:51.458722+0000","last_clean":"2024-04-24T13:31:51.458722+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:31:51.458722+0000","last_undegraded":"2024-04-24T13:31:51.458722+0000","last_fullsized":"2024-04-24T13:31:51.458722+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456130+0000","last_change":"2024-04-24T13:30:50.930475+0000","last_active":"2024-04-24T13:31:51.456130+0000","last_peered":"2024-04-24T13:31:51.456130+0000","last_clean":"2024-04-24T13:31:51.456130+0000","last_became_active":"2024-04-24T13:30:50.929905+0000","last_became_peered":"2024-04-24T13:30:50.929905+0000","last_unstale":"2024-04-24T13:31:51.456130+0000","last_undegraded":"2024-04-24T13:31:51.456130+0000","last_fullsized":"2024-04-24T13:31:51.456130+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:41.257023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.394514+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:31:52.394514+0000","last_peered":"2024-04-24T13:31:52.394514+0000","last_clean":"2024-04-24T13:31:52.394514+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:31:52.394514+0000","last_undegraded":"2024-04-24T13:31:52.394514+0000","last_fullsized":"2024-04-24T13:31:52.394514+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":60,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.459566+0000","last_change":"2024-04-24T13:30:50.931263+0000","last_active":"2024-04-24T13:31:51.459566+0000","last_peered":"2024-04-24T13:31:51.459566+0000","last_clean":"2024-04-24T13:31:51.459566+0000","last_became_active":"2024-04-24T13:30:50.929683+0000","last_became_peered":"2024-04-24T13:30:50.929683+0000","last_unstale":"2024-04-24T13:31:51.459566+0000","last_undegraded":"2024-04-24T13:31:51.459566+0000","last_fullsized":"2024-04-24T13:31:51.459566+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:28:57.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456489+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:31:51.456489+0000","last_peered":"2024-04-24T13:31:51.456489+0000","last_clean":"2024-04-24T13:31:51.456489+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:31:51.456489+0000","last_undegraded":"2024-04-24T13:31:51.456489+0000","last_fullsized":"2024-04-24T13:31:51.456489+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"50'5","reported_seq":95,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210964+0000","last_change":"2024-04-24T13:30:27.260167+0000","last_active":"2024-04-24T13:31:52.210964+0000","last_peered":"2024-04-24T13:31:52.210964+0000","last_clean":"2024-04-24T13:31:52.210964+0000","last_became_active":"2024-04-24T13:30:27.259644+0000","last_became_peered":"2024-04-24T13:30:27.259644+0000","last_unstale":"2024-04-24T13:31:52.210964+0000","last_undegraded":"2024-04-24T13:31:52.210964+0000","last_fullsized":"2024-04-24T13:31:52.210964+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:21.088997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":62,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464684+0000","last_change":"2024-04-24T13:30:50.924952+0000","last_active":"2024-04-24T13:31:52.464684+0000","last_peered":"2024-04-24T13:31:52.464684+0000","last_clean":"2024-04-24T13:31:52.464684+0000","last_became_active":"2024-04-24T13:30:50.923933+0000","last_became_peered":"2024-04-24T13:30:50.923933+0000","last_unstale":"2024-04-24T13:31:52.464684+0000","last_undegraded":"2024-04-24T13:31:52.464684+0000","last_fullsized":"2024-04-24T13:31:52.464684+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:17.479670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"0'0","reported_seq":80,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211944+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:31:52.211944+0000","last_peered":"2024-04-24T13:31:52.211944+0000","last_clean":"2024-04-24T13:31:52.211944+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:31:52.211944+0000","last_undegraded":"2024-04-24T13:31:52.211944+0000","last_fullsized":"2024-04-24T13:31:52.211944+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457036+0000","last_change":"2024-04-24T13:30:50.925917+0000","last_active":"2024-04-24T13:31:51.457036+0000","last_peered":"2024-04-24T13:31:51.457036+0000","last_clean":"2024-04-24T13:31:51.457036+0000","last_became_active":"2024-04-24T13:30:50.925580+0000","last_became_peered":"2024-04-24T13:30:50.925580+0000","last_unstale":"2024-04-24T13:31:51.457036+0000","last_undegraded":"2024-04-24T13:31:51.457036+0000","last_fullsized":"2024-04-24T13:31:51.457036+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456228+0000","last_change":"2024-04-24T13:30:50.938795+0000","last_active":"2024-04-24T13:31:51.456228+0000","last_peered":"2024-04-24T13:31:51.456228+0000","last_clean":"2024-04-24T13:31:51.456228+0000","last_became_active":"2024-04-24T13:30:50.937965+0000","last_became_peered":"2024-04-24T13:30:50.937965+0000","last_unstale":"2024-04-24T13:31:51.456228+0000","last_undegraded":"2024-04-24T13:31:51.456228+0000","last_fullsized":"2024-04-24T13:31:51.456228+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:31.350610+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":59,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304169+0000","last_change":"2024-04-24T13:30:50.934577+0000","last_active":"2024-04-24T13:31:51.304169+0000","last_peered":"2024-04-24T13:31:51.304169+0000","last_clean":"2024-04-24T13:31:51.304169+0000","last_became_active":"2024-04-24T13:30:50.931559+0000","last_became_peered":"2024-04-24T13:30:50.931559+0000","last_unstale":"2024-04-24T13:31:51.304169+0000","last_undegraded":"2024-04-24T13:31:51.304169+0000","last_fullsized":"2024-04-24T13:31:51.304169+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:35.372215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"32'11","reported_seq":108,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456258+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:31:51.456258+0000","last_peered":"2024-04-24T13:31:51.456258+0000","last_clean":"2024-04-24T13:31:51.456258+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:31:51.456258+0000","last_undegraded":"2024-04-24T13:31:51.456258+0000","last_fullsized":"2024-04-24T13:31:51.456258+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":85,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465088+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:31:52.465088+0000","last_peered":"2024-04-24T13:31:52.465088+0000","last_clean":"2024-04-24T13:31:52.465088+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:31:52.465088+0000","last_undegraded":"2024-04-24T13:31:52.465088+0000","last_fullsized":"2024-04-24T13:31:52.465088+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455139+0000","last_change":"2024-04-24T13:30:50.941935+0000","last_active":"2024-04-24T13:31:51.455139+0000","last_peered":"2024-04-24T13:31:51.455139+0000","last_clean":"2024-04-24T13:31:51.455139+0000","last_became_active":"2024-04-24T13:30:50.940885+0000","last_became_peered":"2024-04-24T13:30:50.940885+0000","last_unstale":"2024-04-24T13:31:51.455139+0000","last_undegraded":"2024-04-24T13:31:51.455139+0000","last_fullsized":"2024-04-24T13:31:51.455139+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:22.937959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457708+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:31:51.457708+0000","last_peered":"2024-04-24T13:31:51.457708+0000","last_clean":"2024-04-24T13:31:51.457708+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:31:51.457708+0000","last_undegraded":"2024-04-24T13:31:51.457708+0000","last_fullsized":"2024-04-24T13:31:51.457708+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212527+0000","last_change":"2024-04-24T13:30:21.229237+0000","last_active":"2024-04-24T13:31:52.212527+0000","last_peered":"2024-04-24T13:31:52.212527+0000","last_clean":"2024-04-24T13:31:52.212527+0000","last_became_active":"2024-04-24T13:30:21.228971+0000","last_became_peered":"2024-04-24T13:30:21.228971+0000","last_unstale":"2024-04-24T13:31:52.212527+0000","last_undegraded":"2024-04-24T13:31:52.212527+0000","last_fullsized":"2024-04-24T13:31:52.212527+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":93,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464937+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:31:52.464937+0000","last_peered":"2024-04-24T13:31:52.464937+0000","last_clean":"2024-04-24T13:31:52.464937+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:31:52.464937+0000","last_undegraded":"2024-04-24T13:31:52.464937+0000","last_fullsized":"2024-04-24T13:31:52.464937+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"32'9","reported_seq":107,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464576+0000","last_change":"2024-04-24T13:30:50.981989+0000","last_active":"2024-04-24T13:31:52.464576+0000","last_peered":"2024-04-24T13:31:52.464576+0000","last_clean":"2024-04-24T13:31:52.464576+0000","last_became_active":"2024-04-24T13:30:50.939707+0000","last_became_peered":"2024-04-24T13:30:50.939707+0000","last_unstale":"2024-04-24T13:31:52.464576+0000","last_undegraded":"2024-04-24T13:31:52.464576+0000","last_fullsized":"2024-04-24T13:31:52.464576+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:38.379316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":89,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211339+0000","last_change":"2024-04-24T13:30:50.935071+0000","last_active":"2024-04-24T13:31:52.211339+0000","last_peered":"2024-04-24T13:31:52.211339+0000","last_clean":"2024-04-24T13:31:52.211339+0000","last_became_active":"2024-04-24T13:30:50.934309+0000","last_became_peered":"2024-04-24T13:30:50.934309+0000","last_unstale":"2024-04-24T13:31:52.211339+0000","last_undegraded":"2024-04-24T13:31:52.211339+0000","last_fullsized":"2024-04-24T13:31:52.211339+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:51.520511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466174+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:31:52.466174+0000","last_peered":"2024-04-24T13:31:52.466174+0000","last_clean":"2024-04-24T13:31:52.466174+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:31:52.466174+0000","last_undegraded":"2024-04-24T13:31:52.466174+0000","last_fullsized":"2024-04-24T13:31:52.466174+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458087+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:31:51.458087+0000","last_peered":"2024-04-24T13:31:51.458087+0000","last_clean":"2024-04-24T13:31:51.458087+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:31:51.458087+0000","last_undegraded":"2024-04-24T13:31:51.458087+0000","last_fullsized":"2024-04-24T13:31:51.458087+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212321+0000","last_change":"2024-04-24T13:30:50.921993+0000","last_active":"2024-04-24T13:31:52.212321+0000","last_peered":"2024-04-24T13:31:52.212321+0000","last_clean":"2024-04-24T13:31:52.212321+0000","last_became_active":"2024-04-24T13:30:50.921257+0000","last_became_peered":"2024-04-24T13:30:50.921257+0000","last_unstale":"2024-04-24T13:31:52.212321+0000","last_undegraded":"2024-04-24T13:31:52.212321+0000","last_fullsized":"2024-04-24T13:31:52.212321+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:58.034297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"32'12","reported_seq":112,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395075+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:31:52.395075+0000","last_peered":"2024-04-24T13:31:52.395075+0000","last_clean":"2024-04-24T13:31:52.395075+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:31:52.395075+0000","last_undegraded":"2024-04-24T13:31:52.395075+0000","last_fullsized":"2024-04-24T13:31:52.395075+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455803+0000","last_change":"2024-04-24T13:30:29.277963+0000","last_active":"2024-04-24T13:31:51.455803+0000","last_peered":"2024-04-24T13:31:51.455803+0000","last_clean":"2024-04-24T13:31:51.455803+0000","last_became_active":"2024-04-24T13:30:29.277170+0000","last_became_peered":"2024-04-24T13:30:29.277170+0000","last_unstale":"2024-04-24T13:31:51.455803+0000","last_undegraded":"2024-04-24T13:31:51.455803+0000","last_fullsized":"2024-04-24T13:31:51.455803+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455900+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:31:51.455900+0000","last_peered":"2024-04-24T13:31:51.455900+0000","last_clean":"2024-04-24T13:31:51.455900+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:31:51.455900+0000","last_undegraded":"2024-04-24T13:31:51.455900+0000","last_fullsized":"2024-04-24T13:31:51.455900+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212420+0000","last_change":"2024-04-24T13:30:50.917948+0000","last_active":"2024-04-24T13:31:52.212420+0000","last_peered":"2024-04-24T13:31:52.212420+0000","last_clean":"2024-04-24T13:31:52.212420+0000","last_became_active":"2024-04-24T13:30:50.917339+0000","last_became_peered":"2024-04-24T13:30:50.917339+0000","last_unstale":"2024-04-24T13:31:52.212420+0000","last_undegraded":"2024-04-24T13:31:52.212420+0000","last_fullsized":"2024-04-24T13:31:52.212420+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:36:03.041606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395607+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:31:52.395607+0000","last_peered":"2024-04-24T13:31:52.395607+0000","last_clean":"2024-04-24T13:31:52.395607+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:31:52.395607+0000","last_undegraded":"2024-04-24T13:31:52.395607+0000","last_fullsized":"2024-04-24T13:31:52.395607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":93,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466082+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:31:52.466082+0000","last_peered":"2024-04-24T13:31:52.466082+0000","last_clean":"2024-04-24T13:31:52.466082+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:31:52.466082+0000","last_undegraded":"2024-04-24T13:31:52.466082+0000","last_fullsized":"2024-04-24T13:31:52.466082+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"32'15","reported_seq":120,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456080+0000","last_change":"2024-04-24T13:30:50.991717+0000","last_active":"2024-04-24T13:31:51.456080+0000","last_peered":"2024-04-24T13:31:51.456080+0000","last_clean":"2024-04-24T13:31:51.456080+0000","last_became_active":"2024-04-24T13:30:50.938486+0000","last_became_peered":"2024-04-24T13:30:50.938486+0000","last_unstale":"2024-04-24T13:31:51.456080+0000","last_undegraded":"2024-04-24T13:31:51.456080+0000","last_fullsized":"2024-04-24T13:31:51.456080+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:49.495847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395159+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:31:52.395159+0000","last_peered":"2024-04-24T13:31:52.395159+0000","last_clean":"2024-04-24T13:31:52.395159+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:31:52.395159+0000","last_undegraded":"2024-04-24T13:31:52.395159+0000","last_fullsized":"2024-04-24T13:31:52.395159+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":86,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464886+0000","last_change":"2024-04-24T13:30:50.937377+0000","last_active":"2024-04-24T13:31:52.464886+0000","last_peered":"2024-04-24T13:31:52.464886+0000","last_clean":"2024-04-24T13:31:52.464886+0000","last_became_active":"2024-04-24T13:30:50.936540+0000","last_became_peered":"2024-04-24T13:30:50.936540+0000","last_unstale":"2024-04-24T13:31:52.464886+0000","last_undegraded":"2024-04-24T13:31:52.464886+0000","last_fullsized":"2024-04-24T13:31:52.464886+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:44.053660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455603+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:31:51.455603+0000","last_peered":"2024-04-24T13:31:51.455603+0000","last_clean":"2024-04-24T13:31:51.455603+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:31:51.455603+0000","last_undegraded":"2024-04-24T13:31:51.455603+0000","last_fullsized":"2024-04-24T13:31:51.455603+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"0'0","reported_seq":99,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305528+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:31:51.305528+0000","last_peered":"2024-04-24T13:31:51.305528+0000","last_clean":"2024-04-24T13:31:51.305528+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:31:51.305528+0000","last_undegraded":"2024-04-24T13:31:51.305528+0000","last_fullsized":"2024-04-24T13:31:51.305528+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":91,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306134+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:31:51.306134+0000","last_peered":"2024-04-24T13:31:51.306134+0000","last_clean":"2024-04-24T13:31:51.306134+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:31:51.306134+0000","last_undegraded":"2024-04-24T13:31:51.306134+0000","last_fullsized":"2024-04-24T13:31:51.306134+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"32'11","reported_seq":108,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458645+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:31:51.458645+0000","last_peered":"2024-04-24T13:31:51.458645+0000","last_clean":"2024-04-24T13:31:51.458645+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:31:51.458645+0000","last_undegraded":"2024-04-24T13:31:51.458645+0000","last_fullsized":"2024-04-24T13:31:51.458645+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":85,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.396630+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:31:52.396630+0000","last_peered":"2024-04-24T13:31:52.396630+0000","last_clean":"2024-04-24T13:31:52.396630+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:31:52.396630+0000","last_undegraded":"2024-04-24T13:31:52.396630+0000","last_fullsized":"2024-04-24T13:31:52.396630+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":86,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454422+0000","last_change":"2024-04-24T13:30:50.929993+0000","last_active":"2024-04-24T13:31:51.454422+0000","last_peered":"2024-04-24T13:31:51.454422+0000","last_clean":"2024-04-24T13:31:51.454422+0000","last_became_active":"2024-04-24T13:30:50.929169+0000","last_became_peered":"2024-04-24T13:30:50.929169+0000","last_unstale":"2024-04-24T13:31:51.454422+0000","last_undegraded":"2024-04-24T13:31:51.454422+0000","last_fullsized":"2024-04-24T13:31:51.454422+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:57.047113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465530+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:31:52.465530+0000","last_peered":"2024-04-24T13:31:52.465530+0000","last_clean":"2024-04-24T13:31:52.465530+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:31:52.465530+0000","last_undegraded":"2024-04-24T13:31:52.465530+0000","last_fullsized":"2024-04-24T13:31:52.465530+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211423+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:31:52.211423+0000","last_peered":"2024-04-24T13:31:52.211423+0000","last_clean":"2024-04-24T13:31:52.211423+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:31:52.211423+0000","last_undegraded":"2024-04-24T13:31:52.211423+0000","last_fullsized":"2024-04-24T13:31:52.211423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395443+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:31:52.395443+0000","last_peered":"2024-04-24T13:31:52.395443+0000","last_clean":"2024-04-24T13:31:52.395443+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:31:52.395443+0000","last_undegraded":"2024-04-24T13:31:52.395443+0000","last_fullsized":"2024-04-24T13:31:52.395443+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":102,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306175+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:31:51.306175+0000","last_peered":"2024-04-24T13:31:51.306175+0000","last_clean":"2024-04-24T13:31:51.306175+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:31:51.306175+0000","last_undegraded":"2024-04-24T13:31:51.306175+0000","last_fullsized":"2024-04-24T13:31:51.306175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"29'2","reported_seq":104,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465038+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:31:52.465038+0000","last_peered":"2024-04-24T13:31:52.465038+0000","last_clean":"2024-04-24T13:31:52.465038+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:31:52.465038+0000","last_undegraded":"2024-04-24T13:31:52.465038+0000","last_fullsized":"2024-04-24T13:31:52.465038+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.453881+0000","last_change":"2024-04-24T13:30:50.935081+0000","last_active":"2024-04-24T13:31:51.453881+0000","last_peered":"2024-04-24T13:31:51.453881+0000","last_clean":"2024-04-24T13:31:51.453881+0000","last_became_active":"2024-04-24T13:30:50.934177+0000","last_became_peered":"2024-04-24T13:30:50.934177+0000","last_unstale":"2024-04-24T13:31:51.453881+0000","last_undegraded":"2024-04-24T13:31:51.453881+0000","last_fullsized":"2024-04-24T13:31:51.453881+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304801+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:31:51.304801+0000","last_peered":"2024-04-24T13:31:51.304801+0000","last_clean":"2024-04-24T13:31:51.304801+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:31:51.304801+0000","last_undegraded":"2024-04-24T13:31:51.304801+0000","last_fullsized":"2024-04-24T13:31:51.304801+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456862+0000","last_change":"2024-04-24T13:30:21.226147+0000","last_active":"2024-04-24T13:31:51.456862+0000","last_peered":"2024-04-24T13:31:51.456862+0000","last_clean":"2024-04-24T13:31:51.456862+0000","last_became_active":"2024-04-24T13:30:21.225369+0000","last_became_peered":"2024-04-24T13:30:21.225369+0000","last_unstale":"2024-04-24T13:31:51.456862+0000","last_undegraded":"2024-04-24T13:31:51.456862+0000","last_fullsized":"2024-04-24T13:31:51.456862+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:24.585089+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":59,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304397+0000","last_change":"2024-04-24T13:30:50.927331+0000","last_active":"2024-04-24T13:31:51.304397+0000","last_peered":"2024-04-24T13:31:51.304397+0000","last_clean":"2024-04-24T13:31:51.304397+0000","last_became_active":"2024-04-24T13:30:50.926529+0000","last_became_peered":"2024-04-24T13:30:50.926529+0000","last_unstale":"2024-04-24T13:31:51.304397+0000","last_undegraded":"2024-04-24T13:31:51.304397+0000","last_fullsized":"2024-04-24T13:31:51.304397+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:23.529403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"32'15","reported_seq":114,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454678+0000","last_change":"2024-04-24T13:30:27.260827+0000","last_active":"2024-04-24T13:31:51.454678+0000","last_peered":"2024-04-24T13:31:51.454678+0000","last_clean":"2024-04-24T13:31:51.454678+0000","last_became_active":"2024-04-24T13:30:27.260164+0000","last_became_peered":"2024-04-24T13:30:27.260164+0000","last_unstale":"2024-04-24T13:31:51.454678+0000","last_undegraded":"2024-04-24T13:31:51.454678+0000","last_fullsized":"2024-04-24T13:31:51.454678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":26,"num_read_kb":17,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":84,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211394+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:31:52.211394+0000","last_peered":"2024-04-24T13:31:52.211394+0000","last_clean":"2024-04-24T13:31:52.211394+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:31:52.211394+0000","last_undegraded":"2024-04-24T13:31:52.211394+0000","last_fullsized":"2024-04-24T13:31:52.211394+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.212185+0000","last_change":"2024-04-24T13:30:50.922108+0000","last_active":"2024-04-24T13:31:52.212185+0000","last_peered":"2024-04-24T13:31:52.212185+0000","last_clean":"2024-04-24T13:31:52.212185+0000","last_became_active":"2024-04-24T13:30:50.921514+0000","last_became_peered":"2024-04-24T13:30:50.921514+0000","last_unstale":"2024-04-24T13:31:52.212185+0000","last_undegraded":"2024-04-24T13:31:52.212185+0000","last_fullsized":"2024-04-24T13:31:52.212185+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:05.867839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305289+0000","last_change":"2024-04-24T13:30:23.225100+0000","last_active":"2024-04-24T13:31:51.305289+0000","last_peered":"2024-04-24T13:31:51.305289+0000","last_clean":"2024-04-24T13:31:51.305289+0000","last_became_active":"2024-04-24T13:30:23.224324+0000","last_became_peered":"2024-04-24T13:30:23.224324+0000","last_unstale":"2024-04-24T13:31:51.305289+0000","last_undegraded":"2024-04-24T13:31:51.305289+0000","last_fullsized":"2024-04-24T13:31:51.305289+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455743+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:31:51.455743+0000","last_peered":"2024-04-24T13:31:51.455743+0000","last_clean":"2024-04-24T13:31:51.455743+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:31:51.455743+0000","last_undegraded":"2024-04-24T13:31:51.455743+0000","last_fullsized":"2024-04-24T13:31:51.455743+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":93,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455249+0000","last_change":"2024-04-24T13:30:25.238830+0000","last_active":"2024-04-24T13:31:51.455249+0000","last_peered":"2024-04-24T13:31:51.455249+0000","last_clean":"2024-04-24T13:31:51.455249+0000","last_became_active":"2024-04-24T13:30:25.237595+0000","last_became_peered":"2024-04-24T13:30:25.237595+0000","last_unstale":"2024-04-24T13:31:51.455249+0000","last_undegraded":"2024-04-24T13:31:51.455249+0000","last_fullsized":"2024-04-24T13:31:51.455249+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"32'9","reported_seq":104,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211248+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:31:52.211248+0000","last_peered":"2024-04-24T13:31:52.211248+0000","last_clean":"2024-04-24T13:31:52.211248+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:31:52.211248+0000","last_undegraded":"2024-04-24T13:31:52.211248+0000","last_fullsized":"2024-04-24T13:31:52.211248+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":90,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464731+0000","last_change":"2024-04-24T13:30:50.938940+0000","last_active":"2024-04-24T13:31:52.464731+0000","last_peered":"2024-04-24T13:31:52.464731+0000","last_clean":"2024-04-24T13:31:52.464731+0000","last_became_active":"2024-04-24T13:30:50.936355+0000","last_became_peered":"2024-04-24T13:30:50.936355+0000","last_unstale":"2024-04-24T13:31:52.464731+0000","last_undegraded":"2024-04-24T13:31:52.464731+0000","last_fullsized":"2024-04-24T13:31:52.464731+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":81,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456242+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:31:51.456242+0000","last_peered":"2024-04-24T13:31:51.456242+0000","last_clean":"2024-04-24T13:31:51.456242+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:31:51.456242+0000","last_undegraded":"2024-04-24T13:31:51.456242+0000","last_fullsized":"2024-04-24T13:31:51.456242+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"0'0","reported_seq":46,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454142+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:31:51.454142+0000","last_peered":"2024-04-24T13:31:51.454142+0000","last_clean":"2024-04-24T13:31:51.454142+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:31:51.454142+0000","last_undegraded":"2024-04-24T13:31:51.454142+0000","last_fullsized":"2024-04-24T13:31:51.454142+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456816+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:31:51.456816+0000","last_peered":"2024-04-24T13:31:51.456816+0000","last_clean":"2024-04-24T13:31:51.456816+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:31:51.456816+0000","last_undegraded":"2024-04-24T13:31:51.456816+0000","last_fullsized":"2024-04-24T13:31:51.456816+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":91,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304045+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:31:51.304045+0000","last_peered":"2024-04-24T13:31:51.304045+0000","last_clean":"2024-04-24T13:31:51.304045+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:31:51.304045+0000","last_undegraded":"2024-04-24T13:31:51.304045+0000","last_fullsized":"2024-04-24T13:31:51.304045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"32'5","reported_seq":110,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457184+0000","last_change":"2024-04-24T13:30:50.967042+0000","last_active":"2024-04-24T13:31:51.457184+0000","last_peered":"2024-04-24T13:31:51.457184+0000","last_clean":"2024-04-24T13:31:51.457184+0000","last_became_active":"2024-04-24T13:30:50.925842+0000","last_became_peered":"2024-04-24T13:30:50.925842+0000","last_unstale":"2024-04-24T13:31:51.457184+0000","last_undegraded":"2024-04-24T13:31:51.457184+0000","last_fullsized":"2024-04-24T13:31:51.457184+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:59:29.558483+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":83,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304497+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:31:51.304497+0000","last_peered":"2024-04-24T13:31:51.304497+0000","last_clean":"2024-04-24T13:31:51.304497+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:31:51.304497+0000","last_undegraded":"2024-04-24T13:31:51.304497+0000","last_fullsized":"2024-04-24T13:31:51.304497+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395288+0000","last_change":"2024-04-24T13:30:50.939033+0000","last_active":"2024-04-24T13:31:52.395288+0000","last_peered":"2024-04-24T13:31:52.395288+0000","last_clean":"2024-04-24T13:31:52.395288+0000","last_became_active":"2024-04-24T13:30:50.938747+0000","last_became_peered":"2024-04-24T13:30:50.938747+0000","last_unstale":"2024-04-24T13:31:52.395288+0000","last_undegraded":"2024-04-24T13:31:52.395288+0000","last_fullsized":"2024-04-24T13:31:52.395288+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:48.546868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304385+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:31:51.304385+0000","last_peered":"2024-04-24T13:31:51.304385+0000","last_clean":"2024-04-24T13:31:51.304385+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:31:51.304385+0000","last_undegraded":"2024-04-24T13:31:51.304385+0000","last_fullsized":"2024-04-24T13:31:51.304385+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":48,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466713+0000","last_change":"2024-04-24T13:31:00.985586+0000","last_active":"2024-04-24T13:31:52.466713+0000","last_peered":"2024-04-24T13:31:52.466713+0000","last_clean":"2024-04-24T13:31:52.466713+0000","last_became_active":"2024-04-24T13:31:00.984858+0000","last_became_peered":"2024-04-24T13:31:00.984858+0000","last_unstale":"2024-04-24T13:31:52.466713+0000","last_undegraded":"2024-04-24T13:31:52.466713+0000","last_fullsized":"2024-04-24T13:31:52.466713+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:19.065008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":94,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395045+0000","last_change":"2024-04-24T13:30:25.228645+0000","last_active":"2024-04-24T13:31:52.395045+0000","last_peered":"2024-04-24T13:31:52.395045+0000","last_clean":"2024-04-24T13:31:52.395045+0000","last_became_active":"2024-04-24T13:30:25.227801+0000","last_became_peered":"2024-04-24T13:30:25.227801+0000","last_unstale":"2024-04-24T13:31:52.395045+0000","last_undegraded":"2024-04-24T13:31:52.395045+0000","last_fullsized":"2024-04-24T13:31:52.395045+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:16.778257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"32'9","reported_seq":103,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.304640+0000","last_change":"2024-04-24T13:30:27.264731+0000","last_active":"2024-04-24T13:31:51.304640+0000","last_peered":"2024-04-24T13:31:51.304640+0000","last_clean":"2024-04-24T13:31:51.304640+0000","last_became_active":"2024-04-24T13:30:27.263888+0000","last_became_peered":"2024-04-24T13:30:27.263888+0000","last_unstale":"2024-04-24T13:31:51.304640+0000","last_undegraded":"2024-04-24T13:31:51.304640+0000","last_fullsized":"2024-04-24T13:31:51.304640+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:36:25.093773+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":84,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211253+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:31:52.211253+0000","last_peered":"2024-04-24T13:31:52.211253+0000","last_clean":"2024-04-24T13:31:52.211253+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:31:52.211253+0000","last_undegraded":"2024-04-24T13:31:52.211253+0000","last_fullsized":"2024-04-24T13:31:52.211253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":79,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.303740+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:31:51.303740+0000","last_peered":"2024-04-24T13:31:51.303740+0000","last_clean":"2024-04-24T13:31:51.303740+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:31:51.303740+0000","last_undegraded":"2024-04-24T13:31:51.303740+0000","last_fullsized":"2024-04-24T13:31:51.303740+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395778+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:31:52.395778+0000","last_peered":"2024-04-24T13:31:52.395778+0000","last_clean":"2024-04-24T13:31:52.395778+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:31:52.395778+0000","last_undegraded":"2024-04-24T13:31:52.395778+0000","last_fullsized":"2024-04-24T13:31:52.395778+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465638+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:31:52.465638+0000","last_peered":"2024-04-24T13:31:52.465638+0000","last_clean":"2024-04-24T13:31:52.465638+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:31:52.465638+0000","last_undegraded":"2024-04-24T13:31:52.465638+0000","last_fullsized":"2024-04-24T13:31:52.465638+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.396772+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:31:52.396772+0000","last_peered":"2024-04-24T13:31:52.396772+0000","last_clean":"2024-04-24T13:31:52.396772+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:31:52.396772+0000","last_undegraded":"2024-04-24T13:31:52.396772+0000","last_fullsized":"2024-04-24T13:31:52.396772+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464189+0000","last_change":"2024-04-24T13:30:21.223752+0000","last_active":"2024-04-24T13:31:52.464189+0000","last_peered":"2024-04-24T13:31:52.464189+0000","last_clean":"2024-04-24T13:31:52.464189+0000","last_became_active":"2024-04-24T13:30:21.223457+0000","last_became_peered":"2024-04-24T13:30:21.223457+0000","last_unstale":"2024-04-24T13:31:52.464189+0000","last_undegraded":"2024-04-24T13:31:52.464189+0000","last_fullsized":"2024-04-24T13:31:52.464189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:49.280399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455420+0000","last_change":"2024-04-24T13:30:50.943597+0000","last_active":"2024-04-24T13:31:51.455420+0000","last_peered":"2024-04-24T13:31:51.455420+0000","last_clean":"2024-04-24T13:31:51.455420+0000","last_became_active":"2024-04-24T13:30:50.941937+0000","last_became_peered":"2024-04-24T13:30:50.941937+0000","last_unstale":"2024-04-24T13:31:51.455420+0000","last_undegraded":"2024-04-24T13:31:51.455420+0000","last_fullsized":"2024-04-24T13:31:51.455420+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:55.853630+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455160+0000","last_change":"2024-04-24T13:30:21.224037+0000","last_active":"2024-04-24T13:31:51.455160+0000","last_peered":"2024-04-24T13:31:51.455160+0000","last_clean":"2024-04-24T13:31:51.455160+0000","last_became_active":"2024-04-24T13:30:21.222146+0000","last_became_peered":"2024-04-24T13:30:21.222146+0000","last_unstale":"2024-04-24T13:31:51.455160+0000","last_undegraded":"2024-04-24T13:31:51.455160+0000","last_fullsized":"2024-04-24T13:31:51.455160+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395828+0000","last_change":"2024-04-24T13:30:50.918913+0000","last_active":"2024-04-24T13:31:52.395828+0000","last_peered":"2024-04-24T13:31:52.395828+0000","last_clean":"2024-04-24T13:31:52.395828+0000","last_became_active":"2024-04-24T13:30:50.918221+0000","last_became_peered":"2024-04-24T13:30:50.918221+0000","last_unstale":"2024-04-24T13:31:52.395828+0000","last_undegraded":"2024-04-24T13:31:52.395828+0000","last_fullsized":"2024-04-24T13:31:52.395828+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:43.128644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":100,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211513+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:31:52.211513+0000","last_peered":"2024-04-24T13:31:52.211513+0000","last_clean":"2024-04-24T13:31:52.211513+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:31:52.211513+0000","last_undegraded":"2024-04-24T13:31:52.211513+0000","last_fullsized":"2024-04-24T13:31:52.211513+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"0'0","reported_seq":102,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456864+0000","last_change":"2024-04-24T13:30:50.926509+0000","last_active":"2024-04-24T13:31:51.456864+0000","last_peered":"2024-04-24T13:31:51.456864+0000","last_clean":"2024-04-24T13:31:51.456864+0000","last_became_active":"2024-04-24T13:30:50.925894+0000","last_became_peered":"2024-04-24T13:30:50.925894+0000","last_unstale":"2024-04-24T13:31:51.456864+0000","last_undegraded":"2024-04-24T13:31:51.456864+0000","last_fullsized":"2024-04-24T13:31:51.456864+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458583+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:31:51.458583+0000","last_peered":"2024-04-24T13:31:51.458583+0000","last_clean":"2024-04-24T13:31:51.458583+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:31:51.458583+0000","last_undegraded":"2024-04-24T13:31:51.458583+0000","last_fullsized":"2024-04-24T13:31:51.458583+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305354+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:31:51.305354+0000","last_peered":"2024-04-24T13:31:51.305354+0000","last_clean":"2024-04-24T13:31:51.305354+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:31:51.305354+0000","last_undegraded":"2024-04-24T13:31:51.305354+0000","last_fullsized":"2024-04-24T13:31:51.305354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395681+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:31:52.395681+0000","last_peered":"2024-04-24T13:31:52.395681+0000","last_clean":"2024-04-24T13:31:52.395681+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:31:52.395681+0000","last_undegraded":"2024-04-24T13:31:52.395681+0000","last_fullsized":"2024-04-24T13:31:52.395681+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455301+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:31:51.455301+0000","last_peered":"2024-04-24T13:31:51.455301+0000","last_clean":"2024-04-24T13:31:51.455301+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:31:51.455301+0000","last_undegraded":"2024-04-24T13:31:51.455301+0000","last_fullsized":"2024-04-24T13:31:51.455301+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":106,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465537+0000","last_change":"2024-04-24T13:30:50.956474+0000","last_active":"2024-04-24T13:31:52.465537+0000","last_peered":"2024-04-24T13:31:52.465537+0000","last_clean":"2024-04-24T13:31:52.465537+0000","last_became_active":"2024-04-24T13:30:50.955801+0000","last_became_peered":"2024-04-24T13:30:50.955801+0000","last_unstale":"2024-04-24T13:31:52.465537+0000","last_undegraded":"2024-04-24T13:31:52.465537+0000","last_fullsized":"2024-04-24T13:31:52.465537+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:41.114080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.464753+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:31:52.464753+0000","last_peered":"2024-04-24T13:31:52.464753+0000","last_clean":"2024-04-24T13:31:52.464753+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:31:52.464753+0000","last_undegraded":"2024-04-24T13:31:52.464753+0000","last_fullsized":"2024-04-24T13:31:52.464753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458385+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:31:51.458385+0000","last_peered":"2024-04-24T13:31:51.458385+0000","last_clean":"2024-04-24T13:31:51.458385+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:31:51.458385+0000","last_undegraded":"2024-04-24T13:31:51.458385+0000","last_fullsized":"2024-04-24T13:31:51.458385+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210491+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:31:52.210491+0000","last_peered":"2024-04-24T13:31:52.210491+0000","last_clean":"2024-04-24T13:31:52.210491+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:31:52.210491+0000","last_undegraded":"2024-04-24T13:31:52.210491+0000","last_fullsized":"2024-04-24T13:31:52.210491+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455191+0000","last_change":"2024-04-24T13:30:21.229523+0000","last_active":"2024-04-24T13:31:51.455191+0000","last_peered":"2024-04-24T13:31:51.455191+0000","last_clean":"2024-04-24T13:31:51.455191+0000","last_became_active":"2024-04-24T13:30:21.228400+0000","last_became_peered":"2024-04-24T13:30:21.228400+0000","last_unstale":"2024-04-24T13:31:51.455191+0000","last_undegraded":"2024-04-24T13:31:51.455191+0000","last_fullsized":"2024-04-24T13:31:51.455191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.306388+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:31:51.306388+0000","last_peered":"2024-04-24T13:31:51.306388+0000","last_clean":"2024-04-24T13:31:51.306388+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:31:51.306388+0000","last_undegraded":"2024-04-24T13:31:51.306388+0000","last_fullsized":"2024-04-24T13:31:51.306388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.457222+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:31:51.457222+0000","last_peered":"2024-04-24T13:31:51.457222+0000","last_clean":"2024-04-24T13:31:51.457222+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:31:51.457222+0000","last_undegraded":"2024-04-24T13:31:51.457222+0000","last_fullsized":"2024-04-24T13:31:51.457222+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":97,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466666+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:31:52.466666+0000","last_peered":"2024-04-24T13:31:52.466666+0000","last_clean":"2024-04-24T13:31:52.466666+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:31:52.466666+0000","last_undegraded":"2024-04-24T13:31:52.466666+0000","last_fullsized":"2024-04-24T13:31:52.466666+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455020+0000","last_change":"2024-04-24T13:30:50.923914+0000","last_active":"2024-04-24T13:31:51.455020+0000","last_peered":"2024-04-24T13:31:51.455020+0000","last_clean":"2024-04-24T13:31:51.455020+0000","last_became_active":"2024-04-24T13:30:50.923103+0000","last_became_peered":"2024-04-24T13:30:50.923103+0000","last_unstale":"2024-04-24T13:31:51.455020+0000","last_undegraded":"2024-04-24T13:31:51.455020+0000","last_fullsized":"2024-04-24T13:31:51.455020+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:26:58.476605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"0'0","reported_seq":95,"reported_epoch":66,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.305925+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:31:51.305925+0000","last_peered":"2024-04-24T13:31:51.305925+0000","last_clean":"2024-04-24T13:31:51.305925+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:31:51.305925+0000","last_undegraded":"2024-04-24T13:31:51.305925+0000","last_fullsized":"2024-04-24T13:31:51.305925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":105,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211664+0000","last_change":"2024-04-24T13:30:50.920564+0000","last_active":"2024-04-24T13:31:52.211664+0000","last_peered":"2024-04-24T13:31:52.211664+0000","last_clean":"2024-04-24T13:31:52.211664+0000","last_became_active":"2024-04-24T13:30:50.920252+0000","last_became_peered":"2024-04-24T13:30:50.920252+0000","last_unstale":"2024-04-24T13:31:52.211664+0000","last_undegraded":"2024-04-24T13:31:52.211664+0000","last_fullsized":"2024-04-24T13:31:52.211664+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:29.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456139+0000","last_change":"2024-04-24T13:30:50.925075+0000","last_active":"2024-04-24T13:31:51.456139+0000","last_peered":"2024-04-24T13:31:51.456139+0000","last_clean":"2024-04-24T13:31:51.456139+0000","last_became_active":"2024-04-24T13:30:50.921219+0000","last_became_peered":"2024-04-24T13:30:50.921219+0000","last_unstale":"2024-04-24T13:31:51.456139+0000","last_undegraded":"2024-04-24T13:31:51.456139+0000","last_fullsized":"2024-04-24T13:31:51.456139+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:06.421799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.465530+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:31:52.465530+0000","last_peered":"2024-04-24T13:31:52.465530+0000","last_clean":"2024-04-24T13:31:52.465530+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:31:52.465530+0000","last_undegraded":"2024-04-24T13:31:52.465530+0000","last_fullsized":"2024-04-24T13:31:52.465530+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.211258+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:31:52.211258+0000","last_peered":"2024-04-24T13:31:52.211258+0000","last_clean":"2024-04-24T13:31:52.211258+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:31:52.211258+0000","last_undegraded":"2024-04-24T13:31:52.211258+0000","last_fullsized":"2024-04-24T13:31:52.211258+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":63,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.466742+0000","last_change":"2024-04-24T13:30:50.936271+0000","last_active":"2024-04-24T13:31:52.466742+0000","last_peered":"2024-04-24T13:31:52.466742+0000","last_clean":"2024-04-24T13:31:52.466742+0000","last_became_active":"2024-04-24T13:30:50.935833+0000","last_became_peered":"2024-04-24T13:30:50.935833+0000","last_unstale":"2024-04-24T13:31:52.466742+0000","last_undegraded":"2024-04-24T13:31:52.466742+0000","last_fullsized":"2024-04-24T13:31:52.466742+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:04.149889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.455420+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:31:51.455420+0000","last_peered":"2024-04-24T13:31:51.455420+0000","last_clean":"2024-04-24T13:31:51.455420+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:31:51.455420+0000","last_undegraded":"2024-04-24T13:31:51.455420+0000","last_fullsized":"2024-04-24T13:31:51.455420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":101,"reported_epoch":68,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.468076+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:31:52.468076+0000","last_peered":"2024-04-24T13:31:52.468076+0000","last_clean":"2024-04-24T13:31:52.468076+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:31:52.468076+0000","last_undegraded":"2024-04-24T13:31:52.468076+0000","last_fullsized":"2024-04-24T13:31:52.468076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":61,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.458360+0000","last_change":"2024-04-24T13:30:50.913925+0000","last_active":"2024-04-24T13:31:51.458360+0000","last_peered":"2024-04-24T13:31:51.458360+0000","last_clean":"2024-04-24T13:31:51.458360+0000","last_became_active":"2024-04-24T13:30:50.913630+0000","last_became_peered":"2024-04-24T13:30:50.913630+0000","last_unstale":"2024-04-24T13:31:51.458360+0000","last_undegraded":"2024-04-24T13:31:51.458360+0000","last_fullsized":"2024-04-24T13:31:51.458360+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:45.481646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":106,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456500+0000","last_change":"2024-04-24T13:30:50.946577+0000","last_active":"2024-04-24T13:31:51.456500+0000","last_peered":"2024-04-24T13:31:51.456500+0000","last_clean":"2024-04-24T13:31:51.456500+0000","last_became_active":"2024-04-24T13:30:50.945909+0000","last_became_peered":"2024-04-24T13:30:50.945909+0000","last_unstale":"2024-04-24T13:31:51.456500+0000","last_undegraded":"2024-04-24T13:31:51.456500+0000","last_fullsized":"2024-04-24T13:31:51.456500+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:54.012692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.454537+0000","last_change":"2024-04-24T13:30:21.218669+0000","last_active":"2024-04-24T13:31:51.454537+0000","last_peered":"2024-04-24T13:31:51.454537+0000","last_clean":"2024-04-24T13:31:51.454537+0000","last_became_active":"2024-04-24T13:30:21.217904+0000","last_became_peered":"2024-04-24T13:30:21.217904+0000","last_unstale":"2024-04-24T13:31:51.454537+0000","last_undegraded":"2024-04-24T13:31:51.454537+0000","last_fullsized":"2024-04-24T13:31:51.454537+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"0'0","reported_seq":96,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.210584+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:31:52.210584+0000","last_peered":"2024-04-24T13:31:52.210584+0000","last_clean":"2024-04-24T13:31:52.210584+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:31:52.210584+0000","last_undegraded":"2024-04-24T13:31:52.210584+0000","last_fullsized":"2024-04-24T13:31:52.210584+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":101,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:52.395485+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:31:52.395485+0000","last_peered":"2024-04-24T13:31:52.395485+0000","last_clean":"2024-04-24T13:31:52.395485+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:31:52.395485+0000","last_undegraded":"2024-04-24T13:31:52.395485+0000","last_fullsized":"2024-04-24T13:31:52.395485+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"0'0","reported_seq":97,"reported_epoch":67,"state":"active+clean","last_fresh":"2024-04-24T13:31:51.456067+0000","last_change":"2024-04-24T13:30:23.217309+0000","last_active":"2024-04-24T13:31:51.456067+0000","last_peered":"2024-04-24T13:31:51.456067+0000","last_clean":"2024-04-24T13:31:51.456067+0000","last_became_active":"2024-04-24T13:30:23.216484+0000","last_became_peered":"2024-04-24T13:30:23.216484+0000","last_unstale":"2024-04-24T13:31:51.456067+0000","last_undegraded":"2024-04-24T13:31:51.456067+0000","last_fullsized":"2024-04-24T13:31:51.456067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":17,"ondisk_log_size":17,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":3702,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":683,"num_read_kb":442,"num_write":419,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":53,"num_bytes_recovered":1474,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":331776,"data_stored":8878,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":389,"ondisk_log_size":389,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":4,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":55834574872,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574872,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28372,"kb_used_data":1352,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343468,"statfs":{"total":96636764160,"available":96607711232,"internally_reserved":0,"allocated":1384448,"data_stored":1007163,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574873,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27868,"kb_used_data":844,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343972,"statfs":{"total":96636764160,"available":96608227328,"internally_reserved":0,"allocated":864256,"data_stored":434682,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574873,"num_pgs":81,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27796,"kb_used_data":776,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344044,"statfs":{"total":96636764160,"available":96608301056,"internally_reserved":0,"allocated":794624,"data_stored":424269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574872,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27840,"kb_used_data":820,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344000,"statfs":{"total":96636764160,"available":96608256000,"internally_reserved":0,"allocated":839680,"data_stored":433195,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574873,"num_pgs":67,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27812,"kb_used_data":792,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344028,"statfs":{"total":96636764160,"available":96608284672,"internally_reserved":0,"allocated":811008,"data_stored":424773,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":27654598},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574874,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27832,"kb_used_data":808,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344008,"statfs":{"total":96636764160,"available":96608264192,"internally_reserved":0,"allocated":827392,"data_stored":426340,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574873,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":28384,"kb_used_data":1364,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94343456,"statfs":{"total":96636764160,"available":96607698944,"internally_reserved":0,"allocated":1396736,"data_stored":1014985,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1128,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":990,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:31:58.755 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-24T13:31:58.755 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-24T13:31:58.755 INFO:tasks.thrashosds.thrasher:Reweighting osd 5 to 0.12316787108542089 2024-04-24T13:31:58.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 0.12316787108542089 2024-04-24T13:31:58.807 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:58.806+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:58.885 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:58.886 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:58.886 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:58.906 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:31:58.910 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:58.904+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:59.009 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:31:59.006+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:31:59.078 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:59.079 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:59.079 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:59.097 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:31:59.143 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:31:59.140+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:31:59.211 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:31:59.208+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:31:59.271 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:59.271 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:31:59.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:31:59.271 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:31:59.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 94.052678243000003, 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:31:59.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:31:59.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:31:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:31:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:31:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:31:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:31:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:31:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:59.276 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 93.996969163000003, 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:59.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:31:59.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:31:59.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:31:59.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:31:59.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:31:59.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:31:59.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:31:59.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:31:59.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:31:59.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 93.992902022999999, 2024-04-24T13:31:59.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:31:59.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:31:59.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 89.990548130999997, 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.288 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:59.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:31:59.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:31:59.292 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 89.889522329000002, 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:59.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:31:59.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:31:59.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:31:59.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:31:59.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:31:59.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:31:59.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:31:59.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:31:59.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:31:59.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.299 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.299 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:59.299 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.981773337999996, 2024-04-24T13:31:59.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:31:59.299 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.299 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.299 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.300 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:31:59.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.300 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:59.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:31:59.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:31:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:31:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:31:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:31:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.957977365999994, 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.305 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.306 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.306 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.306 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.306 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:31:59.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.306 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:59.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:31:59.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:31:59.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:31:59.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:31:59.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:31:59.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.931282245999995, 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.311 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:31:59.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:31:59.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:31:59.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:31:59.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:31:59.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:31:59.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:31:59.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:31:59.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:31:59.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:31:59.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:31:59.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:31:59.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:31:59.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:31:59.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:31:59.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:31:59.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.913540325, 2024-04-24T13:31:59.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:31:59.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:31:59.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.880370116999998, 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.323 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:31:59.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:31:59.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:31:59.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:31:59.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:31:59.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:31:59.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:31:59.328 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.832337910000007, 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.329 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.330 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:31:59.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.330 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:59.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:31:59.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:31:59.334 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.806090255000001, 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.335 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:31:59.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.341 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.341 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:59.341 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.746707852, 2024-04-24T13:31:59.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:31:59.341 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.341 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.341 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.341 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.341 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.341 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.341 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:31:59.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.341 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:59.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:31:59.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:31:59.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:31:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:31:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:31:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:31:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.698240745000007, 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.347 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:31:59.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:31:59.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:59.352 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.312550172000002, 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:59.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:31:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:31:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:31:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:31:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:31:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:31:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:31:59.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:31:59.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.118462277000006, 2024-04-24T13:31:59.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:31:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:31:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:31:59.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:31:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:31:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:31:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:31:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.364 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.114449003999994, 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:31:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:31:59.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:31:59.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:31:59.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:31:59.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:31:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:31:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:31:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:59.370 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.082395864999995, 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:59.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:31:59.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.077851863999996, 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.376 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.377 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.377 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.377 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.377 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.377 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:31:59.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.377 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:59.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:31:59.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:31:59.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:31:59.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:31:59.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:31:59.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.044700856999995, 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:31:59.382 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:31:59.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:31:59.387 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.388 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:31:59.388 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:31:59.388 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:59.389 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:31:59.390 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:59.386+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:59.492 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:31:59.488+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:31:59.528 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.5 to 0.123168 (1f87) 2024-04-24T13:31:59.537 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:31:59.591 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:59.588+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:59.631 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:59.632 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:59.632 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:31:59.632 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:59.653 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:31:59.696 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:31:59.692+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:31:59.793 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:31:59.790+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:31:59.863 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:31:59.863 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:31:59.863 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:31:59.863 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:31:59.863 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:31:59.881 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:31:59.894 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:59.894+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:31:59.997 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:31:59.994+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:00.055 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:00.055 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:00.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:00.055 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:00.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.055 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:00.055 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:32:00.055 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 94.769758585999995, 2024-04-24T13:32:00.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026500819999999998, 2024-04-24T13:32:00.056 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.056 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.056 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.056 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.056 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:00.056 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:00.056 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 42 2024-04-24T13:32:00.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.056 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:32:00.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:32:00.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283130+0000", 2024-04-24T13:32:00.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3599999999999999e-06 2024-04-24T13:32:00.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283143+0000", 2024-04-24T13:32:00.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2989999999999999e-05 2024-04-24T13:32:00.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283175+0000", 2024-04-24T13:32:00.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1262e-05 2024-04-24T13:32:00.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283190+0000", 2024-04-24T13:32:00.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5333999999999999e-05 2024-04-24T13:32:00.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283279+0000", 2024-04-24T13:32:00.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8616000000000007e-05 2024-04-24T13:32:00.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283443+0000", 2024-04-24T13:32:00.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016473200000000001 2024-04-24T13:32:00.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:00.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283600+0000", 2024-04-24T13:32:00.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015686500000000001 2024-04-24T13:32:00.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.284799+0000", 2024-04-24T13:32:00.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011988229999999999 2024-04-24T13:32:00.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285616+0000", 2024-04-24T13:32:00.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081652500000000002 2024-04-24T13:32:00.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285709+0000", 2024-04-24T13:32:00.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3109999999999995e-05 2024-04-24T13:32:00.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285778+0000", 2024-04-24T13:32:00.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9465e-05 2024-04-24T13:32:00.062 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.062 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.062 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.062 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:00.062 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:32:00.062 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 90.764884318, 2024-04-24T13:32:00.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025615049999999999, 2024-04-24T13:32:00.062 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.063 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.063 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.063 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.063 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.063 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.063 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 52 2024-04-24T13:32:00.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.063 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:32:00.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:32:00.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288005+0000", 2024-04-24T13:32:00.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:32:00.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288017+0000", 2024-04-24T13:32:00.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1995e-05 2024-04-24T13:32:00.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288050+0000", 2024-04-24T13:32:00.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2555999999999998e-05 2024-04-24T13:32:00.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288063+0000", 2024-04-24T13:32:00.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3774999999999999e-05 2024-04-24T13:32:00.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288165+0000", 2024-04-24T13:32:00.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101394 2024-04-24T13:32:00.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288357+0000", 2024-04-24T13:32:00.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019187800000000001 2024-04-24T13:32:00.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:00.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288525+0000", 2024-04-24T13:32:00.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016830600000000001 2024-04-24T13:32:00.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.289691+0000", 2024-04-24T13:32:00.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011659629999999999 2024-04-24T13:32:00.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290333+0000", 2024-04-24T13:32:00.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064243099999999995 2024-04-24T13:32:00.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290439+0000", 2024-04-24T13:32:00.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105689 2024-04-24T13:32:00.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290564+0000", 2024-04-24T13:32:00.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012480600000000001 2024-04-24T13:32:00.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.068 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.069 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.069 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.069 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:00.069 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.653441704000002, 2024-04-24T13:32:00.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:32:00.069 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.069 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.069 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.070 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.070 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.070 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.070 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:32:00.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.070 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:00.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:00.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:32:00.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:32:00.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:32:00.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:32:00.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:32:00.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:32:00.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:32:00.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:32:00.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:32:00.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:32:00.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:32:00.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:32:00.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:00.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:32:00.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:32:00.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:32:00.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:32:00.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:32:00.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:32:00.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:32:00.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:32:00.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:32:00.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:32:00.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.076 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.076 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.077 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:32:00.077 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.641364324999998, 2024-04-24T13:32:00.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029424360000000001, 2024-04-24T13:32:00.077 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.077 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.077 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.077 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.077 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.077 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.077 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 279 2024-04-24T13:32:00.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.077 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:32:00.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:32:00.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411523+0000", 2024-04-24T13:32:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0899999999999999e-06 2024-04-24T13:32:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411539+0000", 2024-04-24T13:32:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:32:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411556+0000", 2024-04-24T13:32:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6588000000000001e-05 2024-04-24T13:32:00.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411564+0000", 2024-04-24T13:32:00.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6929999999999996e-06 2024-04-24T13:32:00.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411638+0000", 2024-04-24T13:32:00.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3244999999999994e-05 2024-04-24T13:32:00.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411745+0000", 2024-04-24T13:32:00.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107876 2024-04-24T13:32:00.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:00.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411936+0000", 2024-04-24T13:32:00.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000190819 2024-04-24T13:32:00.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.412644+0000", 2024-04-24T13:32:00.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070752499999999997 2024-04-24T13:32:00.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414368+0000", 2024-04-24T13:32:00.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017246850000000001 2024-04-24T13:32:00.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414419+0000", 2024-04-24T13:32:00.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0513999999999998e-05 2024-04-24T13:32:00.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414465+0000", 2024-04-24T13:32:00.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5862000000000002e-05 2024-04-24T13:32:00.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.083 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.083 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.083 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:00.083 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.637657946000004, 2024-04-24T13:32:00.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:32:00.083 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.083 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.084 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.084 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.084 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.084 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.084 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:32:00.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.084 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:00.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:00.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:32:00.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:32:00.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:32:00.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:32:00.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:32:00.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:32:00.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:32:00.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:32:00.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:32:00.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:32:00.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:32:00.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:32:00.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:00.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:32:00.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:32:00.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:32:00.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:32:00.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:32:00.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:32:00.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:32:00.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:32:00.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:32:00.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:32:00.090 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.090 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.090 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.090 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:691 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.090 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:32:00.090 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.394506109000005, 2024-04-24T13:32:00.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027367860000000002, 2024-04-24T13:32:00.091 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.091 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.091 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.091 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.091 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.091 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.091 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 691 2024-04-24T13:32:00.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.091 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:32:00.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:32:00.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658383+0000", 2024-04-24T13:32:00.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7719999999999999e-06 2024-04-24T13:32:00.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658393+0000", 2024-04-24T13:32:00.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1840000000000005e-06 2024-04-24T13:32:00.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658414+0000", 2024-04-24T13:32:00.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0967000000000001e-05 2024-04-24T13:32:00.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658424+0000", 2024-04-24T13:32:00.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0961000000000001e-05 2024-04-24T13:32:00.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658556+0000", 2024-04-24T13:32:00.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013183199999999999 2024-04-24T13:32:00.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658781+0000", 2024-04-24T13:32:00.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022427499999999999 2024-04-24T13:32:00.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:00.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.659230+0000", 2024-04-24T13:32:00.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044896299999999998 2024-04-24T13:32:00.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660178+0000", 2024-04-24T13:32:00.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094838799999999999 2024-04-24T13:32:00.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660868+0000", 2024-04-24T13:32:00.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000689575 2024-04-24T13:32:00.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661012+0000", 2024-04-24T13:32:00.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000144735 2024-04-24T13:32:00.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661117+0000", 2024-04-24T13:32:00.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105134 2024-04-24T13:32:00.097 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.097 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.097 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.097 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:32:00.097 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:00.097 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.194385154000003, 2024-04-24T13:32:00.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:32:00.097 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.098 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.098 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.098 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:00.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:00.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:32:00.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:32:00.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:32:00.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:32:00.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:32:00.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:32:00.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:32:00.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:32:00.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:32:00.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:32:00.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:32:00.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:32:00.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:32:00.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:32:00.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:32:00.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:32:00.103 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.103 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.103 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.103 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.103 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:00.103 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.131041636000006, 2024-04-24T13:32:00.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:32:00.104 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.104 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.104 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.104 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.104 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.104 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.104 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:32:00.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.104 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:00.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:00.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:32:00.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:32:00.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:32:00.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:32:00.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:32:00.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:32:00.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:32:00.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:32:00.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:32:00.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:32:00.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:32:00.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:32:00.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.126365941000003, 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:32:00.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:32:00.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:32:00.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.074442091999998, 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028643660000000001, 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 841 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:32:00.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:32:00.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978447+0000", 2024-04-24T13:32:00.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978459+0000", 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.224e-05 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978489+0000", 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9583000000000001e-05 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978504+0000", 2024-04-24T13:32:00.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978612+0000", 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107327 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978831+0000", 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021982300000000001 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:00.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.979160+0000", 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032855299999999998 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.980242+0000", 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010821649999999999 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981019+0000", 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00077641199999999998 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981185+0000", 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016605499999999999 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981309+0000", 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012434300000000001 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:00.122 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.070321210000003, 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:00.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:32:00.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:32:00.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:32:00.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:32:00.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:00.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:32:00.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:32:00.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:32:00.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.060575174999997, 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.128 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:32:00.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.056028362999996, 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002954763, 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.134 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 849 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996861+0000", 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2069999999999998e-06 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996871+0000", 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0753e-05 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996903+0000", 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996922+0000", 2024-04-24T13:32:00.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8595999999999999e-05 2024-04-24T13:32:00.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997042+0000", 2024-04-24T13:32:00.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119646 2024-04-24T13:32:00.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997271+0000", 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228963 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997736+0000", 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000465181 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999022+0000", 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012864829999999999 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999529+0000", 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050722400000000002 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999697+0000", 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016795499999999999 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999813+0000", 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115746 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.139 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.011743109999998, 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027316710000000002, 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.140 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 868 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041146+0000", 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041156+0000", 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0772e-05 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041184+0000", 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7616000000000001e-05 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041199+0000", 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4582e-05 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041309+0000", 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011029799999999999 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041532+0000", 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022316 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041846+0000", 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031406700000000001 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043088+0000", 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001241409 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043667+0000", 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057961000000000004 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043767+0000", 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100166 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043875+0000", 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107871 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.145 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.922565841999997, 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003049946, 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 907 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130323+0000", 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5859999999999999e-06 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130336+0000", 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.218e-05 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130367+0000", 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1665000000000003e-05 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130382+0000", 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5113000000000001e-05 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130510+0000", 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012778999999999999 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130749+0000", 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238669 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.131082+0000", 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033360300000000002 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.132266+0000", 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001183627 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133172+0000", 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090542200000000002 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133259+0000", 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:32:00.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133371+0000", 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011194 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.918746992999999, 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002722543, 2024-04-24T13:32:00.151 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.152 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.152 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.152 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.152 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.152 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.152 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 909 2024-04-24T13:32:00.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.152 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134141+0000", 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134150+0000", 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9430000000000006e-06 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134172+0000", 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1296000000000001e-05 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134187+0000", 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5659e-05 2024-04-24T13:32:00.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134275+0000", 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7787000000000005e-05 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134403+0000", 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127677 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134686+0000", 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028353500000000002 2024-04-24T13:32:00.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.135742+0000", 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010557800000000001 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136663+0000", 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092043500000000005 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136753+0000", 2024-04-24T13:32:00.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0871000000000005e-05 2024-04-24T13:32:00.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136862+0000", 2024-04-24T13:32:00.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010883 2024-04-24T13:32:00.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.157 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.157 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.157 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.825052111000005, 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029521759999999999, 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 949 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:32:00.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227837+0000", 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2189999999999998e-06 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227848+0000", 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-05 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227876+0000", 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8972999999999999e-05 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227892+0000", 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5965999999999999e-05 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228028+0000", 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135322 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228256+0000", 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228237 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228706+0000", 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045042599999999997 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.229990+0000", 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012836799999999999 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230579+0000", 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058925199999999996 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230673+0000", 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3484000000000001e-05 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230787+0000", 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113917 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.820945021, 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.163 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.168 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.810745237000006, 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030452859999999999, 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 955 2024-04-24T13:32:00.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.170 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:00.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:00.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242144+0000", 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2500000000000001e-06 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242155+0000", 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1779e-05 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242186+0000", 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0879e-05 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242202+0000", 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5566e-05 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242338+0000", 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013631299999999999 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242700+0000", 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036144900000000002 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.243261+0000", 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056143600000000001 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.244736+0000", 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001475248 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245034+0000", 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029792099999999998 2024-04-24T13:32:00.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245119+0000", 2024-04-24T13:32:00.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4876999999999994e-05 2024-04-24T13:32:00.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245187+0000", 2024-04-24T13:32:00.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7568000000000001e-05 2024-04-24T13:32:00.174 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.174 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.174 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.175 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:00.175 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:32:00.175 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 86.806819802000007, 2024-04-24T13:32:00.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026970509999999998, 2024-04-24T13:32:00.175 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:00.175 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:00.175 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:00.175 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:00.175 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:00.175 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:00.175 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 957 2024-04-24T13:32:00.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:00.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246069+0000", 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4600000000000002e-06 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246081+0000", 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1780000000000001e-05 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246105+0000", 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3805999999999999e-05 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246120+0000", 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5415999999999999e-05 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246221+0000", 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010027 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246367+0000", 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014653299999999999 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246645+0000", 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000277681 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.247868+0000", 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001223373 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248563+0000", 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694781 2024-04-24T13:32:00.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248648+0000", 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5187999999999998e-05 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248764+0000", 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115763 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:00.180 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:00.181 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:32:00.183 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:00.183 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:00.176+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:00.283 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:00.280+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:00.384 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:00.380+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:00.400 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:00.400 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:00.400 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:00.400 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:00.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:00.423 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:00.423 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:00.455 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:00.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:00.485 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:00.480+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:00.486 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:00.486 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:00.516 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:00.517 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:00.597 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:00.586+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:00.601 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:00.602 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:00.637 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:00.637 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:00.638 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:00.638 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:00.662 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:00.680 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:00.680 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:00.687 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:00.686+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:00.713 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:00.713 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:00.789 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:00.786+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:00.811 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:00.811 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:00.825 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:00.889 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:00.884+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:00.955 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:00.956 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:00.971 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:01.018 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:01.018+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:01.089 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:01.089 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:01.090 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:01.090+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:01.103 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:01.190 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:01.188+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:01.272 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:01.272 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:01.285 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:01.291 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:01.288+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:01.392 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:01.390+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:01.408 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:01.409 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:01.423 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:01.493 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:01.488+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:01.591 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:32:01.593 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:01.590+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:01.593 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:01.593 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:01.607 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:01.695 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:01.694+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:01.767 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:01.767 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:01.781 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:01.796 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:01.792+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:01.899 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:01.896+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:01.945 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:01.946 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:01.960 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:02.006 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:02.006+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:02.082 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:02.083 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:02.096 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:02.101 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:02.096+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:02.202 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:02.202+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:02.260 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:02.260 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:02.274 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:02.318 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:02.318+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:02.404 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:02.402+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:02.443 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:02.443 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:02.457 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:32:02.505 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:02.500+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:02.584 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:32:02.606 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:02.606+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:02.624 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:02.624 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:02.641 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:32:02.707 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:02.704+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:02.738 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:32:02.801 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:02.801 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:02.807 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:02.806+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:02.815 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:32:02.909 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:02.906+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:02.936 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:02.937 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:02.968 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:02.968 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:02.988 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:02.988 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:02.988 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:02.999 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:02.999 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:03.006 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:32:03.009 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:03.006+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:03.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:03.063 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:03.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:03.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:03.097 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:03.109 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:03.104+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:03.130 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:03.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:03.163 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:03.163 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:03.174 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:03.174 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:03.175 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:03.175 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:03.175 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:03.195 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:32:03.210 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:03.210+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:03.311 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:03.308+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:03.408 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:03.408 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.483363321, 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:32:03.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:32:03.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:32:03.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:32:03.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:32:03.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:32:03.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:32:03.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:32:03.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:32:03.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:32:03.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:32:03.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:32:03.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.413 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:32:03.414 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:32:03.414 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.340571551, 2024-04-24T13:32:03.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:32:03.414 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.414 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.414 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.414 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:32:03.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:32:03.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:32:03.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:32:03.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:32:03.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:32:03.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:32:03.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:32:03.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:32:03.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:32:03.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:32:03.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:32:03.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:32:03.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:32:03.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:32:03.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:32:03.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.33826848299999, 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:32:03.418 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:32:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:32:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:32:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:32:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:32:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:32:03.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:32:03.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:32:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:32:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.336573966, 2024-04-24T13:32:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:32:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:32:03.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:32:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:32:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:32:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:32:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:32:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:32:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:32:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:32:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:32:03.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:32:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:32:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:32:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:32:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:32:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:32:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:32:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:32:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:32:03.427 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:32:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.335116355, 2024-04-24T13:32:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:32:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:32:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:32:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:32:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:32:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:32:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:32:03.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.333187266, 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.432 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:32:03.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:32:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:32:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:32:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:32:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:32:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:32:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:32:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:32:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:32:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:32:03.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:32:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:32:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:32:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:32:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:32:03.436 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:32:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:32:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.330762729, 2024-04-24T13:32:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:32:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:32:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:32:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:32:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:32:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:32:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:32:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:32:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:32:03.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:32:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:32:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.32955998, 2024-04-24T13:32:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:32:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:32:03.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:32:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:32:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:32:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:32:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:32:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:32:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:32:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:32:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.446 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.326353815, 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:32:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:32:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:32:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:32:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:32:03.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:32:03.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:32:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:32:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:32:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:32:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.08729823100001, 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.451 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:32:03.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:32:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:32:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:32:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:32:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:32:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:32:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:32:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:32:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:32:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:32:03.455 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:32:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:32:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.08487758, 2024-04-24T13:32:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:32:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:32:03.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:32:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:32:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:32:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:32:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:32:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:32:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:32:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:32:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:32:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:32:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.460 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.08410436200001, 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:32:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:32:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:32:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:32:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:32:03.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:32:03.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:32:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:32:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:32:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:32:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:32:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:32:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:32:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:32:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:32:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.07636530800001, 2024-04-24T13:32:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:32:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.465 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:32:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:32:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:32:03.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:32:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:32:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:32:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:32:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:32:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.469 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:32:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:32:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 113.72840320100001, 2024-04-24T13:32:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:32:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:32:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:32:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:32:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:32:03.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:32:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:32:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:32:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:32:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 113.727654453, 2024-04-24T13:32:03.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:32:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:32:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:32:03.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:32:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:32:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:32:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:32:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:32:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:32:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:32:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:32:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:32:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:32:03.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:32:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:32:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:32:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:32:03.479 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 113.72672332800001, 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:32:03.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:32:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:32:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:32:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:32:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:32:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:32:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:32:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:32:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:32:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:32:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:32:03.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:32:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:32:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:32:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 113.726231537, 2024-04-24T13:32:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:32:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.484 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:32:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:32:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:32:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:32:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:32:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:32:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:32:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:32:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:32:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:32:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:32:03.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.140150113000004, 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.489 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:32:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:32:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:32:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:32:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:32:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:32:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:32:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:32:03.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:32:03.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:32:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:32:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:32:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:32:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:32:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:03.495 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.111302914000007, 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:32:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:32:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:32:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:32:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:32:03.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:32:03.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:32:03.501 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.073111670000003, 2024-04-24T13:32:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:32:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:32:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:03.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:32:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:32:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:32:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:32:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:32:03.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:32:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:32:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:32:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:32:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:32:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:32:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:32:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:32:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:32:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:03.507 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:03.507 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:03.509 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:32:03.509 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:03.504+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:03.610 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:03.606+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:03.710 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:03.708+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:03.723 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:03.723 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:03.724 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:03.724 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:03.741 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:32:03.826 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:03.824+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:03.913 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:03.908+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:03.947 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:03.948 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:03.948 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:03.948 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:03.948 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:03.965 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:32:04.050 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:04.048+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:04.115 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:04.114+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:04.177 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:04.177 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:04.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:04.177 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:04.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.177 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:04.177 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:04.177 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 98.958287377000005, 2024-04-24T13:32:04.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:32:04.177 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.178 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.178 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:32:04.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:04.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:04.178 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:32:04.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.178 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:04.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:32:04.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:32:04.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:32:04.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:32:04.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:32:04.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:32:04.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:32:04.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:32:04.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:32:04.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:32:04.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:32:04.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:32:04.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:32:04.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:32:04.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:32:04.182 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.182 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.182 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 98.902578297000005, 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:32:04.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:32:04.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:32:04.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:32:04.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:32:04.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:32:04.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:32:04.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:32:04.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:32:04.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:32:04.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:32:04.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:32:04.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:32:04.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:32:04.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:32:04.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:32:04.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:32:04.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:32:04.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:32:04.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:32:04.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:32:04.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:32:04.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:32:04.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:32:04.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.189 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.189 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:04.189 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:04.189 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 98.898511157000002, 2024-04-24T13:32:04.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:32:04.190 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.190 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.190 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.190 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:04.190 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:04.190 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:32:04.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.190 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:04.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:32:04.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:32:04.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:32:04.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:32:04.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:32:04.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:32:04.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:32:04.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:32:04.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:32:04.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:32:04.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:32:04.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:32:04.195 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 94.896157264999999, 2024-04-24T13:32:04.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:32:04.196 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.196 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.196 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.196 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:32:04.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:32:04.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:32:04.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:32:04.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:32:04.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:32:04.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:32:04.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:32:04.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:32:04.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:32:04.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:32:04.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:32:04.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:32:04.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.200 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.200 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:04.200 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:32:04.200 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 94.795131463000004, 2024-04-24T13:32:04.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:32:04.201 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.201 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.201 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.201 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:32:04.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.201 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:32:04.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:32:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:32:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:32:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:32:04.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:32:04.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:32:04.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.206 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.206 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.207 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:04.207 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.887382471999999, 2024-04-24T13:32:04.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:32:04.207 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.207 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.207 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.207 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.207 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.207 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:32:04.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.207 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:32:04.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:32:04.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:32:04.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:32:04.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:32:04.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:32:04.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:32:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:32:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:32:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:32:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:32:04.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:32:04.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:32:04.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:32:04.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:32:04.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:32:04.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:32:04.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.863586499999997, 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.214 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:32:04.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.214 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:04.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:04.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:32:04.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:32:04.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:32:04.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:32:04.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:32:04.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:32:04.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:32:04.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:32:04.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:32:04.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:32:04.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:32:04.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:32:04.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:32:04.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:32:04.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:32:04.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:32:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:32:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.836891379999997, 2024-04-24T13:32:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:32:04.219 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:04.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:32:04.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:32:04.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:32:04.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:32:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:32:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:32:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:32:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:32:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:32:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.819149459000002, 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.225 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:32:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:32:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:32:04.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:32:04.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:32:04.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:32:04.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:32:04.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:32:04.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:32:04.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:32:04.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.785979251000001, 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.231 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.232 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.232 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.232 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.232 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.232 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:32:04.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.232 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:32:04.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:32:04.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:32:04.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:32:04.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:32:04.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:32:04.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:32:04.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:32:04.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:32:04.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:32:04.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:32:04.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:32:04.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:32:04.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.737947043999995, 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:32:04.237 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.238 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.238 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.238 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.238 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.238 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.238 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:32:04.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.238 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:32:04.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:32:04.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:32:04.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:32:04.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:32:04.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:32:04.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:32:04.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:32:04.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:32:04.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:32:04.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:32:04.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.243 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:04.244 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.711699389000003, 2024-04-24T13:32:04.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:32:04.244 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.244 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.244 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.244 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:32:04.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.244 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:04.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:04.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:32:04.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:32:04.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:32:04.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:32:04.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:32:04.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:32:04.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:32:04.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:32:04.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:32:04.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:32:04.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:32:04.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:32:04.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.250 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.250 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:04.250 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.652316986000002, 2024-04-24T13:32:04.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:32:04.250 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.250 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.250 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.250 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.250 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.250 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.250 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:32:04.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.251 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:04.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:04.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:32:04.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:32:04.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:32:04.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:32:04.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:32:04.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:32:04.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:32:04.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:32:04.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:32:04.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:32:04.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:32:04.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:32:04.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.255 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.603849878999995, 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:32:04.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.257 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:32:04.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:32:04.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:32:04.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:32:04.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:32:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:32:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:32:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:32:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:32:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.261 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.262 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.262 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:32:04.262 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.218159306000004, 2024-04-24T13:32:04.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:32:04.262 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.262 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.262 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.262 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.262 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.262 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:32:04.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:04.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:32:04.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:32:04.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:32:04.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:32:04.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:32:04.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:04.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:32:04.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:32:04.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:32:04.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:32:04.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:32:04.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:32:04.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:32:04.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:32:04.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:32:04.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.024071410999994, 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.269 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.269 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:32:04.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.269 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:32:04.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:32:04.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:32:04.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:32:04.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:32:04.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:32:04.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:32:04.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:32:04.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.274 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.274 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.274 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:32:04.274 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.020058137999996, 2024-04-24T13:32:04.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:32:04.274 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.274 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.274 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.274 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:32:04.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:32:04.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:32:04.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:32:04.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:32:04.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:32:04.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:32:04.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:32:04.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:32:04.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:32:04.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 90.988004998999997, 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.280 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:32:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:04.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:32:04.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:04.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:32:04.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:32:04.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:32:04.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:32:04.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:32:04.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:32:04.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:32:04.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:32:04.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:32:04.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:32:04.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.286 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.286 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.286 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:32:04.286 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 90.983460997999998, 2024-04-24T13:32:04.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:32:04.286 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.286 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.286 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:32:04.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 90.950309990999997, 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.292 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:32:04.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:32:04.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:32:04.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:32:04.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:32:04.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:32:04.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:32:04.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:32:04.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:32:04.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:32:04.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:32:04.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.297 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.298 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.298 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:04.299 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:32:04.299 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:04.296+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:04.400 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:04.398+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:04.501 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:04.498+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:04.508 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:04.509 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:04.509 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:04.526 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:32:04.602 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:04.598+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:04.609 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:04.694 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:04.703 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:04.700+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:04.713 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:32:04.804 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:04.802+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:04.905 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:04.900+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:04.927 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:04.927 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:04.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:04.927 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:04.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.927 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:04.927 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:32:04.927 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 99.642083698999997, 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026500819999999998, 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 42 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:32:04.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:32:04.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283130+0000", 2024-04-24T13:32:04.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3599999999999999e-06 2024-04-24T13:32:04.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283143+0000", 2024-04-24T13:32:04.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2989999999999999e-05 2024-04-24T13:32:04.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283175+0000", 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1262e-05 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283190+0000", 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5333999999999999e-05 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283279+0000", 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8616000000000007e-05 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283443+0000", 2024-04-24T13:32:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016473200000000001 2024-04-24T13:32:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283600+0000", 2024-04-24T13:32:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015686500000000001 2024-04-24T13:32:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.284799+0000", 2024-04-24T13:32:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011988229999999999 2024-04-24T13:32:04.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285616+0000", 2024-04-24T13:32:04.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081652500000000002 2024-04-24T13:32:04.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285709+0000", 2024-04-24T13:32:04.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3109999999999995e-05 2024-04-24T13:32:04.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285778+0000", 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9465e-05 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.637209431000002, 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025615049999999999, 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.934 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 52 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288005+0000", 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288017+0000", 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1995e-05 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288050+0000", 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2555999999999998e-05 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288063+0000", 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3774999999999999e-05 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288165+0000", 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101394 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288357+0000", 2024-04-24T13:32:04.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019187800000000001 2024-04-24T13:32:04.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:04.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288525+0000", 2024-04-24T13:32:04.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016830600000000001 2024-04-24T13:32:04.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.289691+0000", 2024-04-24T13:32:04.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011659629999999999 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290333+0000", 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064243099999999995 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290439+0000", 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105689 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290564+0000", 2024-04-24T13:32:04.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012480600000000001 2024-04-24T13:32:04.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.940 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.940 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.940 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:04.940 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 92.525766817000004, 2024-04-24T13:32:04.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:32:04.940 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.940 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.940 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:04.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:32:04.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:32:04.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:32:04.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:32:04.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:32:04.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:32:04.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:32:04.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:32:04.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:32:04.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:32:04.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:32:04.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:32:04.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:32:04.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.946 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.946 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.946 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:32:04.946 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 92.513689438, 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029424360000000001, 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 279 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:32:04.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411523+0000", 2024-04-24T13:32:04.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0899999999999999e-06 2024-04-24T13:32:04.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411539+0000", 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411556+0000", 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6588000000000001e-05 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411564+0000", 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6929999999999996e-06 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411638+0000", 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3244999999999994e-05 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411745+0000", 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107876 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411936+0000", 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000190819 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.412644+0000", 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070752499999999997 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414368+0000", 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017246850000000001 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414419+0000", 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0513999999999998e-05 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414465+0000", 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5862000000000002e-05 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 92.509983059000007, 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.952 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:32:04.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:32:04.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:32:04.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:32:04.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:32:04.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:32:04.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:32:04.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:691 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 92.266831221999993, 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027367860000000002, 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.958 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 691 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658383+0000", 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7719999999999999e-06 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658393+0000", 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1840000000000005e-06 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658414+0000", 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0967000000000001e-05 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658424+0000", 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0961000000000001e-05 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658556+0000", 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013183199999999999 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658781+0000", 2024-04-24T13:32:04.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022427499999999999 2024-04-24T13:32:04.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:04.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.659230+0000", 2024-04-24T13:32:04.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044896299999999998 2024-04-24T13:32:04.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660178+0000", 2024-04-24T13:32:04.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094838799999999999 2024-04-24T13:32:04.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660868+0000", 2024-04-24T13:32:04.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000689575 2024-04-24T13:32:04.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661012+0000", 2024-04-24T13:32:04.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000144735 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661117+0000", 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105134 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 92.066710267000005, 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:32:04.964 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:32:04.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:32:04.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 92.003366748999994, 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.969 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:32:04.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:32:04.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:32:04.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:32:04.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:32:04.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:32:04.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:32:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:32:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:32:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:32:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:32:04.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:32:04.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:32:04.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:32:04.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:32:04.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:32:04.974 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.998691054000005, 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.975 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:32:04.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:32:04.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:32:04.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:32:04.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:32:04.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.980 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.946767205, 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028643660000000001, 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.981 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 841 2024-04-24T13:32:04.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.982 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:32:04.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:32:04.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978447+0000", 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978459+0000", 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.224e-05 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978489+0000", 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9583000000000001e-05 2024-04-24T13:32:04.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978504+0000", 2024-04-24T13:32:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:32:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978612+0000", 2024-04-24T13:32:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107327 2024-04-24T13:32:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978831+0000", 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021982300000000001 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.979160+0000", 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032855299999999998 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.980242+0000", 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010821649999999999 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981019+0000", 2024-04-24T13:32:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00077641199999999998 2024-04-24T13:32:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981185+0000", 2024-04-24T13:32:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016605499999999999 2024-04-24T13:32:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981309+0000", 2024-04-24T13:32:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012434300000000001 2024-04-24T13:32:04.986 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.942646323000005, 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:32:04.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:32:04.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.932900287999999, 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.993 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:32:04.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:04.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:04.998 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.928353475999998, 2024-04-24T13:32:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002954763, 2024-04-24T13:32:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 849 2024-04-24T13:32:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:04.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996861+0000", 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2069999999999998e-06 2024-04-24T13:32:05.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996871+0000", 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0753e-05 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996903+0000", 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996922+0000", 2024-04-24T13:32:05.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8595999999999999e-05 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997042+0000", 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119646 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997271+0000", 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228963 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:05.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997736+0000", 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000465181 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999022+0000", 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012864829999999999 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999529+0000", 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050722400000000002 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999697+0000", 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016795499999999999 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999813+0000", 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115746 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:05.004 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.884068223, 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027316710000000002, 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 868 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:05.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:32:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:32:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041146+0000", 2024-04-24T13:32:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:32:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041156+0000", 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0772e-05 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041184+0000", 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7616000000000001e-05 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041199+0000", 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4582e-05 2024-04-24T13:32:05.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041309+0000", 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011029799999999999 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041532+0000", 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022316 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041846+0000", 2024-04-24T13:32:05.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031406700000000001 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043088+0000", 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001241409 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043667+0000", 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057961000000000004 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043767+0000", 2024-04-24T13:32:05.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100166 2024-04-24T13:32:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043875+0000", 2024-04-24T13:32:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107871 2024-04-24T13:32:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:05.010 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.794890955, 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003049946, 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 907 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:05.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130323+0000", 2024-04-24T13:32:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5859999999999999e-06 2024-04-24T13:32:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130336+0000", 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.218e-05 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130367+0000", 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1665000000000003e-05 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130382+0000", 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5113000000000001e-05 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130510+0000", 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012778999999999999 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130749+0000", 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238669 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.131082+0000", 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033360300000000002 2024-04-24T13:32:05.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.132266+0000", 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001183627 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133172+0000", 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090542200000000002 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133259+0000", 2024-04-24T13:32:05.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:32:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133371+0000", 2024-04-24T13:32:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011194 2024-04-24T13:32:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:32:05.016 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.791072106000001, 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002722543, 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 909 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:32:05.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134141+0000", 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:05.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134150+0000", 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9430000000000006e-06 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134172+0000", 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1296000000000001e-05 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134187+0000", 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5659e-05 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134275+0000", 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7787000000000005e-05 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134403+0000", 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127677 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134686+0000", 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028353500000000002 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.135742+0000", 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010557800000000001 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136663+0000", 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092043500000000005 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136753+0000", 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0871000000000005e-05 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136862+0000", 2024-04-24T13:32:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010883 2024-04-24T13:32:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:32:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.697377223999993, 2024-04-24T13:32:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029521759999999999, 2024-04-24T13:32:05.022 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 949 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227837+0000", 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2189999999999998e-06 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227848+0000", 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-05 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227876+0000", 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8972999999999999e-05 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227892+0000", 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5965999999999999e-05 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228028+0000", 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135322 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:05.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228256+0000", 2024-04-24T13:32:05.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228237 2024-04-24T13:32:05.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:05.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228706+0000", 2024-04-24T13:32:05.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045042599999999997 2024-04-24T13:32:05.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:05.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.229990+0000", 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012836799999999999 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230579+0000", 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058925199999999996 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230673+0000", 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3484000000000001e-05 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230787+0000", 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113917 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.693270134000002, 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:05.028 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:05.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:05.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:05.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:32:05.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:32:05.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:05.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:32:05.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:32:05.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:32:05.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:32:05.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:32:05.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.034 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:05.034 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.034 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:05.034 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:05.034 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.683070349999994, 2024-04-24T13:32:05.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030452859999999999, 2024-04-24T13:32:05.034 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:05.034 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:05.034 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:05.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:05.035 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:05.035 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:05.035 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 955 2024-04-24T13:32:05.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.035 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:05.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:05.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:05.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:05.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:05.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:05.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242144+0000", 2024-04-24T13:32:05.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2500000000000001e-06 2024-04-24T13:32:05.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:05.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242155+0000", 2024-04-24T13:32:05.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1779e-05 2024-04-24T13:32:05.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242186+0000", 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0879e-05 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242202+0000", 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5566e-05 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242338+0000", 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013631299999999999 2024-04-24T13:32:05.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242700+0000", 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036144900000000002 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.243261+0000", 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056143600000000001 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.244736+0000", 2024-04-24T13:32:05.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001475248 2024-04-24T13:32:05.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:05.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245034+0000", 2024-04-24T13:32:05.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029792099999999998 2024-04-24T13:32:05.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:05.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245119+0000", 2024-04-24T13:32:05.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4876999999999994e-05 2024-04-24T13:32:05.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245187+0000", 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7568000000000001e-05 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 91.679144914999995, 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026970509999999998, 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:05.040 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:05.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:05.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:05.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:05.041 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 957 2024-04-24T13:32:05.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.041 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:05.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:05.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:32:05.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246069+0000", 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4600000000000002e-06 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246081+0000", 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1780000000000001e-05 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246105+0000", 2024-04-24T13:32:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3805999999999999e-05 2024-04-24T13:32:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246120+0000", 2024-04-24T13:32:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5415999999999999e-05 2024-04-24T13:32:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246221+0000", 2024-04-24T13:32:05.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010027 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246367+0000", 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014653299999999999 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246645+0000", 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000277681 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:05.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.247868+0000", 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001223373 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248563+0000", 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694781 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248648+0000", 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5187999999999998e-05 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:05.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248764+0000", 2024-04-24T13:32:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115763 2024-04-24T13:32:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:05.046 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:05.046 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:05.048 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:05.048 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:05.046+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:05.148 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:05.146+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:05.178 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:32:05.189 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:32:05.254 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:05.252+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:05.263 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:05.263 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:05.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:05.370 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:05.368+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:05.393 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:05.394 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:05.424 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:05.424 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:05.451 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:05.450+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:05.454 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:05.454 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:05.484 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:05.484 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:05.496 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:05.496 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:05.513 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:05.517 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:05.518 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:05.551 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:05.551 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:05.552 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:05.548+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:05.584 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:05.584 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:05.617 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:05.617 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:05.682 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:05.680+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:05.687 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:05.688 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:05.704 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:05.752 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:05.748+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:05.837 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:05.837 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:05.851 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:05.853 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:05.848+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:05.954 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:05.954+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:05.968 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:05.982 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:06.055 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:06.052+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:06.150 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:06.150 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:06.157 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:06.152+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:06.164 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:06.258 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:06.254+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:06.287 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:06.287 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:06.301 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:06.387 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:06.386+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:06.457 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:06.458 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:06.459 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:06.458+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:06.471 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:06.560 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:06.558+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:06.639 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:06.639 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:06.653 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:06.695 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:06.694+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:06.761 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:06.758+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:06.814 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:06.815 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:06.829 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:06.871 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:06.870+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:06.963 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:06.960+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:06.993 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:06.993 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:07.007 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:07.063 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:07.060+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:07.132 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:07.132 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:07.146 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:07.190 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:07.190+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:07.213 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:32:07.266 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:07.262+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:07.266 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:07.266 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:07.281 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:32:07.366 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:07.364+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:07.445 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:07.445 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:07.459 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:32:07.467 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:07.464+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:07.568 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:07.564+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:07.576 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:07.576 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:07.591 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:32:07.639 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:32:07.669 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:07.666+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:07.760 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:07.760 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:07.770 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:07.770+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:07.779 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:32:07.837 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:07.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:07.868 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:07.868 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:07.870 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:07.870+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:07.897 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:07.898 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:07.928 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:07.928 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:07.949 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:07.949 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:07.949 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:07.949 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:07.949 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:07.961 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:07.961 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:07.967 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:32:07.994 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:07.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:07.995 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:07.992+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:08.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:08.030 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:08.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:08.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:08.071 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:08.068+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:08.139 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:08.139 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:08.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:08.139 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:08.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.139 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:32:08.139 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:32:08.139 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 119.21372959200001, 2024-04-24T13:32:08.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:32:08.139 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.140 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.140 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.140 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:32:08.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:32:08.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:32:08.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:32:08.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:32:08.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:32:08.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:32:08.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:32:08.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:32:08.143 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 119.070937822, 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:32:08.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:32:08.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 119.068634754, 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:32:08.148 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:32:08.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:32:08.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:32:08.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:32:08.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:32:08.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:32:08.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:32:08.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:32:08.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:32:08.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:32:08.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:32:08.153 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.153 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.153 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.153 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:32:08.153 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:32:08.153 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 119.066940237, 2024-04-24T13:32:08.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:32:08.153 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.153 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.153 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.153 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:32:08.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:32:08.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:32:08.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:32:08.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:32:08.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:32:08.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.157 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.158 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.158 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:32:08.158 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:32:08.158 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 119.065482626, 2024-04-24T13:32:08.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:32:08.159 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.159 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.159 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.159 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:32:08.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:32:08.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:32:08.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:32:08.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:32:08.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:32:08.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:32:08.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:32:08.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:32:08.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:32:08.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:32:08.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:32:08.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:32:08.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:32:08.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:32:08.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:32:08.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:32:08.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:32:08.163 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.163 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.164 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:32:08.164 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:32:08.164 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 119.063553537, 2024-04-24T13:32:08.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:32:08.164 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.164 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.164 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.165 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:32:08.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:32:08.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:32:08.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:32:08.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:32:08.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:32:08.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:32:08.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:32:08.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:32:08.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:32:08.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:32:08.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:32:08.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:32:08.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:32:08.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:32:08.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:32:08.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:32:08.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:32:08.169 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.170 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.170 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.170 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:32:08.170 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:32:08.170 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 119.06112899999999, 2024-04-24T13:32:08.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:32:08.170 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.171 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.171 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.171 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:32:08.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:32:08.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:32:08.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:32:08.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:32:08.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:32:08.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:32:08.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:32:08.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:32:08.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:32:08.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:32:08.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 119.05992625099999, 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:32:08.175 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:32:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:32:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:32:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:32:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:32:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:32:08.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:32:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:32:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:32:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:32:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 119.056720086, 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.180 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:32:08.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:32:08.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:32:08.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:32:08.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:32:08.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 118.817664502, 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:32:08.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:32:08.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:32:08.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:32:08.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:32:08.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:32:08.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:32:08.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:32:08.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:32:08.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 118.81524385100001, 2024-04-24T13:32:08.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:32:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:32:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:32:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:32:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:32:08.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:32:08.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:32:08.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:32:08.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:32:08.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:32:08.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:32:08.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:32:08.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:32:08.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:32:08.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 118.814470633, 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:32:08.194 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.195 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.195 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.195 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:32:08.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:32:08.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:32:08.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:32:08.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:32:08.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:32:08.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:32:08.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:32:08.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:32:08.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:32:08.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:32:08.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:32:08.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:32:08.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:32:08.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:32:08.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:32:08.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:32:08.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:32:08.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.200 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.200 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:32:08.200 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:32:08.200 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 118.806731579, 2024-04-24T13:32:08.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:32:08.200 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.200 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.200 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:32:08.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:32:08.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:32:08.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:32:08.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:32:08.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:32:08.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:32:08.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:32:08.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:32:08.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:32:08.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:32:08.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:32:08.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:32:08.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:32:08.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:32:08.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:32:08.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:32:08.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:32:08.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.205 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.205 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:32:08.205 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:32:08.205 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 118.458769472, 2024-04-24T13:32:08.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:32:08.206 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.206 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.206 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:32:08.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:32:08.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:32:08.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:32:08.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:32:08.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:32:08.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:32:08.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:32:08.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 118.45802072399999, 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:32:08.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:32:08.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:32:08.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:32:08.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:32:08.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:32:08.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.215 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 118.457089599, 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:32:08.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:32:08.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:32:08.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:32:08.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:32:08.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:32:08.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:32:08.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:32:08.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:32:08.220 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.220 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.220 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.220 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:32:08.220 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:32:08.220 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 118.456597808, 2024-04-24T13:32:08.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:32:08.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:32:08.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:32:08.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:32:08.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:32:08.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:32:08.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:32:08.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:32:08.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:32:08.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:32:08.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:32:08.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.870516383999998, 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.225 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.226 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:32:08.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.226 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:32:08.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:32:08.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:32:08.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:32:08.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:32:08.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:32:08.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:32:08.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:32:08.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:32:08.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:08.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:32:08.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:32:08.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:32:08.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:32:08.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:32:08.232 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.233 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.233 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.234 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:32:08.234 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.841669185000001, 2024-04-24T13:32:08.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:32:08.234 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.234 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.234 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.234 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:32:08.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.234 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:32:08.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:32:08.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:32:08.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:32:08.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:32:08.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:32:08.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:32:08.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:32:08.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:32:08.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:32:08.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:32:08.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:32:08.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:32:08.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:32:08.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:08.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:32:08.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:32:08.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:32:08.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:32:08.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:32:08.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:32:08.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:32:08.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:32:08.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:32:08.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:32:08.241 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.241 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.241 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.241 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.241 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:32:08.241 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.803477940999997, 2024-04-24T13:32:08.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:32:08.242 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.242 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.242 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.242 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.242 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.242 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.242 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:32:08.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.242 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:32:08.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:32:08.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:32:08.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:32:08.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:32:08.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:32:08.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:32:08.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:32:08.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:32:08.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:32:08.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:32:08.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:32:08.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:32:08.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:32:08.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:08.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:32:08.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:32:08.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:32:08.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:32:08.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.248 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.248 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.248 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:08.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:32:08.250 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:08.246+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:08.322 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:32:08.350 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:08.350+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:08.420 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:08.420 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:08.420 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:08.437 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:32:08.482 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:08.480+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:08.552 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:08.550+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:08.606 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:08.606 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:08.606 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:08.606 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:08.606 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:08.624 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:32:08.666 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:08.664+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:08.753 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:08.750+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:08.837 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:08.837 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:08.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:08.837 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:08.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.837 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:08.837 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:08.837 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 103.61826548099999, 2024-04-24T13:32:08.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:32:08.837 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:32:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:32:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:32:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:32:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 103.56255640099999, 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.842 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.843 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:08.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:08.843 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:32:08.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.843 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:32:08.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:32:08.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:32:08.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:32:08.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:32:08.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:32:08.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:32:08.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:32:08.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:32:08.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:32:08.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:32:08.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:32:08.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:32:08.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:32:08.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:32:08.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:32:08.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.850 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.850 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.850 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:08.850 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:08.850 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 103.55848926100001, 2024-04-24T13:32:08.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:32:08.850 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:32:08.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:32:08.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:32:08.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:32:08.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:32:08.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:32:08.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:32:08.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:32:08.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:32:08.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:32:08.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 99.556135369000003, 2024-04-24T13:32:08.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:32:08.857 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.857 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.857 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:32:08.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:32:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:32:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:32:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:32:08.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:32:08.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:32:08.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:32:08.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:32:08.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 99.455109566999994, 2024-04-24T13:32:08.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:32:08.862 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.862 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.862 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.862 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.862 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.862 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.862 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:32:08.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.862 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:32:08.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:32:08.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:32:08.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:32:08.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:32:08.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:32:08.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:32:08.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:32:08.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:32:08.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.867 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.868 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.868 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:08.868 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.547360576000003, 2024-04-24T13:32:08.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:32:08.868 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.868 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.868 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.868 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.868 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.868 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:32:08.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:32:08.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:32:08.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:32:08.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:32:08.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:32:08.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:32:08.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:32:08.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.523564604000001, 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:32:08.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:32:08.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:32:08.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:32:08.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:32:08.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.879 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:08.880 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.496869484000001, 2024-04-24T13:32:08.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:32:08.880 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.880 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.880 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.880 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:32:08.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.880 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:32:08.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:32:08.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:32:08.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:32:08.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:32:08.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:32:08.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:32:08.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:32:08.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:32:08.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:32:08.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:32:08.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:32:08.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:32:08.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:32:08.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:32:08.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.885 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.886 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.886 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:32:08.886 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.479127563000006, 2024-04-24T13:32:08.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:32:08.886 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.886 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.886 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.886 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.886 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.886 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.886 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:32:08.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.886 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:32:08.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:32:08.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:32:08.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:32:08.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:32:08.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:32:08.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:32:08.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.892 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.892 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:32:08.892 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.445957355000004, 2024-04-24T13:32:08.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:32:08.892 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.892 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.892 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.892 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:32:08.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:32:08.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:32:08.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:32:08.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:32:08.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:32:08.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:32:08.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:32:08.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:32:08.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:32:08.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.897 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:32:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.397925147999999, 2024-04-24T13:32:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:32:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.898 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:32:08.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.899 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:32:08.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:32:08.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:32:08.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:32:08.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:32:08.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:32:08.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:32:08.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:32:08.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:32:08.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:32:08.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:32:08.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:32:08.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:32:08.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.903 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.371677493000007, 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.904 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:32:08.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:32:08.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.910 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.910 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:08.910 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.312295090000006, 2024-04-24T13:32:08.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:32:08.910 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.910 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.910 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.910 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:32:08.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.910 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:32:08.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:32:08.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:32:08.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:32:08.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:32:08.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:32:08.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:32:08.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:32:08.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:32:08.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:32:08.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:32:08.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:32:08.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.263827982999999, 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.916 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:32:08.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:32:08.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:32:08.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.878137409999994, 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:32:08.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:32:08.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:32:08.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:08.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:32:08.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:32:08.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:32:08.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:32:08.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.927 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.684049514999998, 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:32:08.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:32:08.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:32:08.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:32:08.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:32:08.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:32:08.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:32:08.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:32:08.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:32:08.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:32:08.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:32:08.933 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.933 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.933 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.933 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:32:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.680036242, 2024-04-24T13:32:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:32:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:32:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.934 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:32:08.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:32:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:32:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:32:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:32:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:32:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:32:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:32:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:32:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:32:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:32:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:32:08.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:32:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:32:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:32:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:32:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.939 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.647983103000001, 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:32:08.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:32:08.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:32:08.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:32:08.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:32:08.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:32:08.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:32:08.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:32:08.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.946 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.946 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:32:08.946 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.643439102000002, 2024-04-24T13:32:08.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:32:08.946 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.946 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.946 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.946 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.946 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.946 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.946 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:32:08.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.947 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:32:08.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:32:08.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:32:08.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:08.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:32:08.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:32:08.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:32:08.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:32:08.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.952 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:08.952 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:32:08.952 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 95.610288095000001, 2024-04-24T13:32:08.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:32:08.952 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:08.952 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:08.952 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:08.952 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:08.952 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:08.952 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:08.952 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:08.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:32:08.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:32:08.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:08.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:32:08.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:32:08.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:08.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:32:08.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:32:08.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:08.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:32:08.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:32:08.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:08.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:32:08.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:32:08.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:08.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:32:08.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:32:08.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:08.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:32:08.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:32:08.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:08.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:32:08.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:08.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:32:08.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:32:08.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.958 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:08.958 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:08.958 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:08.960 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:32:08.960 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:08.958+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:09.061 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:09.058+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:09.129 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:09.129 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:09.129 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:09.129 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:09.148 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:32:09.162 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:09.158+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:09.262 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:09.260+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:09.317 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:09.317 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:09.317 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:09.317 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:09.317 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:09.336 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:32:09.364 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:09.362+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:09.464 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:09.460+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:09.547 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:09.547 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.262471636, 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026500819999999998, 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:09.548 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 42 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283130+0000", 2024-04-24T13:32:09.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3599999999999999e-06 2024-04-24T13:32:09.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283143+0000", 2024-04-24T13:32:09.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2989999999999999e-05 2024-04-24T13:32:09.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283175+0000", 2024-04-24T13:32:09.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1262e-05 2024-04-24T13:32:09.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283190+0000", 2024-04-24T13:32:09.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5333999999999999e-05 2024-04-24T13:32:09.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283279+0000", 2024-04-24T13:32:09.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8616000000000007e-05 2024-04-24T13:32:09.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283443+0000", 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016473200000000001 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283600+0000", 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015686500000000001 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.284799+0000", 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011988229999999999 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285616+0000", 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081652500000000002 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285709+0000", 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3109999999999995e-05 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285778+0000", 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9465e-05 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.553 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.554 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:09.554 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:32:09.554 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.25759736800001, 2024-04-24T13:32:09.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025615049999999999, 2024-04-24T13:32:09.554 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.554 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.554 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.554 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.554 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.554 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.555 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 52 2024-04-24T13:32:09.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.555 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:32:09.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:32:09.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288005+0000", 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288017+0000", 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1995e-05 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288050+0000", 2024-04-24T13:32:09.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2555999999999998e-05 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288063+0000", 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3774999999999999e-05 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288165+0000", 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101394 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288357+0000", 2024-04-24T13:32:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019187800000000001 2024-04-24T13:32:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288525+0000", 2024-04-24T13:32:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016830600000000001 2024-04-24T13:32:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.289691+0000", 2024-04-24T13:32:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011659629999999999 2024-04-24T13:32:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290333+0000", 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064243099999999995 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290439+0000", 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105689 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290564+0000", 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012480600000000001 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.559 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.560 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.560 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.560 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:09.560 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.146154753999994, 2024-04-24T13:32:09.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:32:09.560 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.560 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.560 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.560 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.560 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.560 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:32:09.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:32:09.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:32:09.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:09.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:32:09.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:32:09.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:32:09.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:32:09.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.565 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.134077375000004, 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029424360000000001, 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.566 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 279 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411523+0000", 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0899999999999999e-06 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411539+0000", 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411556+0000", 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6588000000000001e-05 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411564+0000", 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6929999999999996e-06 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411638+0000", 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3244999999999994e-05 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411745+0000", 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107876 2024-04-24T13:32:09.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411936+0000", 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000190819 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.412644+0000", 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070752499999999997 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414368+0000", 2024-04-24T13:32:09.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017246850000000001 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414419+0000", 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0513999999999998e-05 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414465+0000", 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5862000000000002e-05 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.572 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.572 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:09.572 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.130370995999996, 2024-04-24T13:32:09.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:32:09.572 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.572 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.572 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.572 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.572 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.572 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.572 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:32:09.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:32:09.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:32:09.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:32:09.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:32:09.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:32:09.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:32:09.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:09.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:32:09.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:32:09.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:32:09.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:32:09.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:32:09.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.578 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:691 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.578 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:32:09.578 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.887219158999997, 2024-04-24T13:32:09.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027367860000000002, 2024-04-24T13:32:09.578 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.578 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.578 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.578 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.578 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.578 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.578 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 691 2024-04-24T13:32:09.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.579 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:32:09.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:32:09.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658383+0000", 2024-04-24T13:32:09.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7719999999999999e-06 2024-04-24T13:32:09.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658393+0000", 2024-04-24T13:32:09.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1840000000000005e-06 2024-04-24T13:32:09.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658414+0000", 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0967000000000001e-05 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658424+0000", 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0961000000000001e-05 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658556+0000", 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013183199999999999 2024-04-24T13:32:09.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658781+0000", 2024-04-24T13:32:09.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022427499999999999 2024-04-24T13:32:09.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:09.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.659230+0000", 2024-04-24T13:32:09.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044896299999999998 2024-04-24T13:32:09.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660178+0000", 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094838799999999999 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660868+0000", 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000689575 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661012+0000", 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000144735 2024-04-24T13:32:09.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661117+0000", 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105134 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.687098203999994, 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.584 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.585 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.585 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:09.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:09.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:32:09.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:32:09.587 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:32:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:32:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:32:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:32:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.588 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.623754685999998, 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.589 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:09.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:09.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.590 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.590 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.590 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.590 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:32:09.590 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.591 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.592 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.593 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:32:09.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:32:09.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.594 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.594 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:32:09.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:32:09.594 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.594 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.594 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.594 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.619078990999995, 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:09.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:09.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:32:09.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:32:09.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:32:09.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:32:09.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:32:09.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:32:09.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:32:09.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.567155142000004, 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028643660000000001, 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 841 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:32:09.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:32:09.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978447+0000", 2024-04-24T13:32:09.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-24T13:32:09.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978459+0000", 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.224e-05 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978489+0000", 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9583000000000001e-05 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978504+0000", 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:32:09.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978612+0000", 2024-04-24T13:32:09.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107327 2024-04-24T13:32:09.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978831+0000", 2024-04-24T13:32:09.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021982300000000001 2024-04-24T13:32:09.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:09.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.979160+0000", 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032855299999999998 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.980242+0000", 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010821649999999999 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981019+0000", 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00077641199999999998 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981185+0000", 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016605499999999999 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981309+0000", 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012434300000000001 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:09.606 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.563034259999995, 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:09.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:32:09.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.553288225000003, 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.612 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:32:09.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:32:09.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:32:09.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:09.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:32:09.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:32:09.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.548741413000002, 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002954763, 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.618 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.619 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.619 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 849 2024-04-24T13:32:09.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.619 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:09.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996861+0000", 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2069999999999998e-06 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996871+0000", 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0753e-05 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996903+0000", 2024-04-24T13:32:09.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:32:09.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996922+0000", 2024-04-24T13:32:09.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8595999999999999e-05 2024-04-24T13:32:09.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997042+0000", 2024-04-24T13:32:09.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119646 2024-04-24T13:32:09.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997271+0000", 2024-04-24T13:32:09.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228963 2024-04-24T13:32:09.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:09.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997736+0000", 2024-04-24T13:32:09.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000465181 2024-04-24T13:32:09.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999022+0000", 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012864829999999999 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999529+0000", 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050722400000000002 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999697+0000", 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016795499999999999 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999813+0000", 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115746 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.504456160000004, 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027316710000000002, 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.624 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 868 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041146+0000", 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041156+0000", 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0772e-05 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041184+0000", 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7616000000000001e-05 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041199+0000", 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4582e-05 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041309+0000", 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011029799999999999 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041532+0000", 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022316 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041846+0000", 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031406700000000001 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043088+0000", 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001241409 2024-04-24T13:32:09.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043667+0000", 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057961000000000004 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043767+0000", 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100166 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043875+0000", 2024-04-24T13:32:09.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107871 2024-04-24T13:32:09.630 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.630 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.630 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.630 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.630 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:09.630 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.415278892000003, 2024-04-24T13:32:09.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003049946, 2024-04-24T13:32:09.630 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.630 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.630 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.630 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.631 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.631 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.631 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 907 2024-04-24T13:32:09.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.631 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:09.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:09.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130323+0000", 2024-04-24T13:32:09.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5859999999999999e-06 2024-04-24T13:32:09.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130336+0000", 2024-04-24T13:32:09.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.218e-05 2024-04-24T13:32:09.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130367+0000", 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1665000000000003e-05 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130382+0000", 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5113000000000001e-05 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130510+0000", 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012778999999999999 2024-04-24T13:32:09.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130749+0000", 2024-04-24T13:32:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238669 2024-04-24T13:32:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.131082+0000", 2024-04-24T13:32:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033360300000000002 2024-04-24T13:32:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.132266+0000", 2024-04-24T13:32:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001183627 2024-04-24T13:32:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133172+0000", 2024-04-24T13:32:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090542200000000002 2024-04-24T13:32:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133259+0000", 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133371+0000", 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011194 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.636 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.411460043000005, 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002722543, 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 909 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:32:09.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:32:09.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134141+0000", 2024-04-24T13:32:09.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:32:09.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134150+0000", 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9430000000000006e-06 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134172+0000", 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1296000000000001e-05 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134187+0000", 2024-04-24T13:32:09.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5659e-05 2024-04-24T13:32:09.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134275+0000", 2024-04-24T13:32:09.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7787000000000005e-05 2024-04-24T13:32:09.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134403+0000", 2024-04-24T13:32:09.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127677 2024-04-24T13:32:09.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134686+0000", 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028353500000000002 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.135742+0000", 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010557800000000001 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136663+0000", 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092043500000000005 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136753+0000", 2024-04-24T13:32:09.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0871000000000005e-05 2024-04-24T13:32:09.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136862+0000", 2024-04-24T13:32:09.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010883 2024-04-24T13:32:09.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.642 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.643 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.643 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:32:09.643 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.317765160999997, 2024-04-24T13:32:09.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029521759999999999, 2024-04-24T13:32:09.643 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.643 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.643 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.643 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 949 2024-04-24T13:32:09.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227837+0000", 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2189999999999998e-06 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227848+0000", 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-05 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227876+0000", 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8972999999999999e-05 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227892+0000", 2024-04-24T13:32:09.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5965999999999999e-05 2024-04-24T13:32:09.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228028+0000", 2024-04-24T13:32:09.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135322 2024-04-24T13:32:09.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228256+0000", 2024-04-24T13:32:09.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228237 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228706+0000", 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045042599999999997 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.229990+0000", 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012836799999999999 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230579+0000", 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058925199999999996 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230673+0000", 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3484000000000001e-05 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230787+0000", 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113917 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.649 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.649 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:09.649 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.313658071000006, 2024-04-24T13:32:09.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:32:09.649 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.649 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.649 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.649 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.649 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.649 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.649 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:32:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:32:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:32:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:32:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:32:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:32:09.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:32:09.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.303458286999998, 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030452859999999999, 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 955 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.655 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:09.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:09.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242144+0000", 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2500000000000001e-06 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242155+0000", 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1779e-05 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242186+0000", 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0879e-05 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242202+0000", 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5566e-05 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242338+0000", 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013631299999999999 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242700+0000", 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036144900000000002 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.243261+0000", 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056143600000000001 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.244736+0000", 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001475248 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245034+0000", 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029792099999999998 2024-04-24T13:32:09.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245119+0000", 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4876999999999994e-05 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245187+0000", 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7568000000000001e-05 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 96.299532851999999, 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026970509999999998, 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 957 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:09.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246069+0000", 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4600000000000002e-06 2024-04-24T13:32:09.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246081+0000", 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1780000000000001e-05 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246105+0000", 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3805999999999999e-05 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246120+0000", 2024-04-24T13:32:09.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5415999999999999e-05 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246221+0000", 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010027 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246367+0000", 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014653299999999999 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:09.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246645+0000", 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000277681 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.247868+0000", 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001223373 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248563+0000", 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694781 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:09.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248648+0000", 2024-04-24T13:32:09.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5187999999999998e-05 2024-04-24T13:32:09.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:09.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:09.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:09.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248764+0000", 2024-04-24T13:32:09.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115763 2024-04-24T13:32:09.666 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.666 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.666 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.666 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:09.666 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:09.666 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:09.671 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:09.671 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:09.670+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:09.771 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:09.768+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:09.874 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:09.870+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:09.882 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:09.882 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:09.882 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:09.882 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:09.899 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:09.973 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:09.970+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:10.074 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:10.068+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:10.082 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:32:10.112 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:10.113 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:10.132 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:10.175 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:10.172+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:10.276 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:10.272+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:10.280 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:10.280 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:10.311 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:10.312 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:10.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:10.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:10.348 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:10.348 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:10.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:10.349 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:10.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.349 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:32:10.349 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:10.349 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 103.09959580899999, 2024-04-24T13:32:10.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057346300000000001, 2024-04-24T13:32:10.349 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.349 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.349 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:32:10.349 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.349 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.350 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44 2024-04-24T13:32:10.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.350 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:10.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:10.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247277+0000", 2024-04-24T13:32:10.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3459999999999998e-06 2024-04-24T13:32:10.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247344+0000", 2024-04-24T13:32:10.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6768999999999997e-05 2024-04-24T13:32:10.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247379+0000", 2024-04-24T13:32:10.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4573999999999998e-05 2024-04-24T13:32:10.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247402+0000", 2024-04-24T13:32:10.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3303e-05 2024-04-24T13:32:10.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247599+0000", 2024-04-24T13:32:10.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019720499999999999 2024-04-24T13:32:10.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:32:10.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247622+0000", 2024-04-24T13:32:10.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2512999999999999e-05 2024-04-24T13:32:10.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.252825+0000", 2024-04-24T13:32:10.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052035270000000003 2024-04-24T13:32:10.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.253009+0000", 2024-04-24T13:32:10.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018339300000000001 2024-04-24T13:32:10.354 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.354 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.354 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 98.070953295999999, 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:32:10.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:32:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:32:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:32:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:32:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:32:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:32:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:32:10.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:32:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:32:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:32:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:32:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:10.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:32:10.361 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 98.019913654999996, 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031751589999999999, 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 216 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:32:10.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326959+0000", 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6170000000000001e-06 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326972+0000", 2024-04-24T13:32:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:32:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327005+0000", 2024-04-24T13:32:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2845000000000001e-05 2024-04-24T13:32:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327023+0000", 2024-04-24T13:32:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8179999999999999e-05 2024-04-24T13:32:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327132+0000", 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010878300000000001 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327351+0000", 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021952000000000001 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327770+0000", 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041895600000000001 2024-04-24T13:32:10.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329354+0000", 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00158388 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329982+0000", 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062821700000000003 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330066+0000", 2024-04-24T13:32:10.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4153999999999994e-05 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330131+0000", 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4920999999999997e-05 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.979942582999996, 2024-04-24T13:32:10.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031663630000000002, 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 227 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366930+0000", 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3800000000000001e-06 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366941+0000", 2024-04-24T13:32:10.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1466e-05 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366973+0000", 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1588999999999999e-05 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366987+0000", 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4663e-05 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367166+0000", 2024-04-24T13:32:10.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017905699999999999 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367388+0000", 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022201299999999999 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367820+0000", 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000431357 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369320+0000", 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015007359999999999 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369944+0000", 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062337299999999998 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370026+0000", 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2437999999999999e-05 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370094+0000", 2024-04-24T13:32:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7291000000000003e-05 2024-04-24T13:32:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:32:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.972631137999997, 2024-04-24T13:32:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030833050000000002, 2024-04-24T13:32:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 229 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374241+0000", 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5660000000000001e-06 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374253+0000", 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2094e-05 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374284+0000", 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0824999999999997e-05 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374299+0000", 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.483e-05 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374410+0000", 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110956 2024-04-24T13:32:10.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374631+0000", 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221117 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.375006+0000", 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000375041 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.376480+0000", 2024-04-24T13:32:10.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00147434 2024-04-24T13:32:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377172+0000", 2024-04-24T13:32:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00069190799999999998 2024-04-24T13:32:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377255+0000", 2024-04-24T13:32:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2536999999999999e-05 2024-04-24T13:32:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377322+0000", 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7090999999999999e-05 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.965999128999997, 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040131660000000003, 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.379 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 231 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380873+0000", 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2400000000000002e-06 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380884+0000", 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0645999999999999e-05 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380919+0000", 2024-04-24T13:32:10.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5026e-05 2024-04-24T13:32:10.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380934+0000", 2024-04-24T13:32:10.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.522e-05 2024-04-24T13:32:10.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381077+0000", 2024-04-24T13:32:10.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014362500000000001 2024-04-24T13:32:10.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381453+0000", 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037581799999999999 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.382170+0000", 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071714999999999995 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.383955+0000", 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017847710000000001 2024-04-24T13:32:10.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384619+0000", 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066381600000000002 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384770+0000", 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015067800000000001 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384884+0000", 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114176 2024-04-24T13:32:10.384 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:324 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.927967265000007, 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029016649999999999, 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.385 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 324 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418904+0000", 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-06 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418911+0000", 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.759e-06 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418928+0000", 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7105e-05 2024-04-24T13:32:10.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418935+0000", 2024-04-24T13:32:10.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7309999999999993e-06 2024-04-24T13:32:10.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419024+0000", 2024-04-24T13:32:10.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8524999999999997e-05 2024-04-24T13:32:10.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419121+0000", 2024-04-24T13:32:10.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6978000000000006e-05 2024-04-24T13:32:10.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:10.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419329+0000", 2024-04-24T13:32:10.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020806399999999999 2024-04-24T13:32:10.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419835+0000", 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050625300000000002 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421631+0000", 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001795615 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421694+0000", 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3398999999999994e-05 2024-04-24T13:32:10.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421804+0000", 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109894 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:562 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.794035895999997, 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048608870000000004, 2024-04-24T13:32:10.391 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 562 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:10.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552837+0000", 2024-04-24T13:32:10.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8499999999999998e-06 2024-04-24T13:32:10.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552852+0000", 2024-04-24T13:32:10.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4866e-05 2024-04-24T13:32:10.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552890+0000", 2024-04-24T13:32:10.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8166e-05 2024-04-24T13:32:10.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552905+0000", 2024-04-24T13:32:10.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5255e-05 2024-04-24T13:32:10.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553053+0000", 2024-04-24T13:32:10.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014824599999999999 2024-04-24T13:32:10.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553425+0000", 2024-04-24T13:32:10.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000371512 2024-04-24T13:32:10.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:10.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553969+0000", 2024-04-24T13:32:10.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054421500000000002 2024-04-24T13:32:10.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.554987+0000", 2024-04-24T13:32:10.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001017855 2024-04-24T13:32:10.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557606+0000", 2024-04-24T13:32:10.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026195839999999999 2024-04-24T13:32:10.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557655+0000", 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8575000000000002e-05 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557695+0000", 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9762999999999999e-05 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.397 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:607 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:32:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.754166652999999, 2024-04-24T13:32:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003243737, 2024-04-24T13:32:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 607 2024-04-24T13:32:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:32:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:32:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592705+0000", 2024-04-24T13:32:10.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592714+0000", 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7630000000000006e-06 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592733+0000", 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9656e-05 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592745+0000", 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592881+0000", 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013627999999999999 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593221+0000", 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033945600000000002 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:10.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593765+0000", 2024-04-24T13:32:10.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054456600000000002 2024-04-24T13:32:10.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.594969+0000", 2024-04-24T13:32:10.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012034649999999999 2024-04-24T13:32:10.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595779+0000", 2024-04-24T13:32:10.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000810161 2024-04-24T13:32:10.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595893+0000", 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114481 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595947+0000", 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3352e-05 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.403 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.603058786999995, 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027976260000000001, 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 736 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743813+0000", 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0899999999999999e-06 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743824+0000", 2024-04-24T13:32:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.111e-05 2024-04-24T13:32:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743853+0000", 2024-04-24T13:32:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909000000000001e-05 2024-04-24T13:32:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743867+0000", 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4036000000000001e-05 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743980+0000", 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011266 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744205+0000", 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000225016 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:10.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744515+0000", 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030974000000000003 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.745485+0000", 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097096300000000003 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746512+0000", 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001026873 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746563+0000", 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1017000000000003e-05 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746609+0000", 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5212e-05 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.409 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.513831408000001, 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028606399999999998, 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 778 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833041+0000", 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3539999999999998e-06 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833052+0000", 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833084+0000", 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833111+0000", 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6869e-05 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833245+0000", 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000133576 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833460+0000", 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021584600000000001 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833761+0000", 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000300477 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.834890+0000", 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011292050000000001 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835731+0000", 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000841423 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835829+0000", 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7337000000000007e-05 2024-04-24T13:32:10.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835899+0000", 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0151e-05 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.403351061999999, 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002884246, 2024-04-24T13:32:10.415 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 826 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:32:10.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943521+0000", 2024-04-24T13:32:10.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4530000000000001e-06 2024-04-24T13:32:10.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943532+0000", 2024-04-24T13:32:10.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:32:10.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943563+0000", 2024-04-24T13:32:10.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0982000000000003e-05 2024-04-24T13:32:10.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943582+0000", 2024-04-24T13:32:10.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8406e-05 2024-04-24T13:32:10.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943781+0000", 2024-04-24T13:32:10.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000199624 2024-04-24T13:32:10.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944019+0000", 2024-04-24T13:32:10.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000237972 2024-04-24T13:32:10.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:10.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944345+0000", 2024-04-24T13:32:10.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032530699999999999 2024-04-24T13:32:10.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.945581+0000", 2024-04-24T13:32:10.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012363809999999999 2024-04-24T13:32:10.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946252+0000", 2024-04-24T13:32:10.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067128499999999998 2024-04-24T13:32:10.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946339+0000", 2024-04-24T13:32:10.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6193999999999995e-05 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946403+0000", 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4364999999999998e-05 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.375927601000001, 2024-04-24T13:32:10.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034937589999999999, 2024-04-24T13:32:10.422 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.422 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.422 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.422 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.422 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.422 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.422 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 838 2024-04-24T13:32:10.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.422 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:10.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970944+0000", 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3360000000000002e-06 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970959+0000", 2024-04-24T13:32:10.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.469e-05 2024-04-24T13:32:10.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970989+0000", 2024-04-24T13:32:10.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0159e-05 2024-04-24T13:32:10.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971004+0000", 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971147+0000", 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014242500000000001 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971514+0000", 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036720900000000001 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:10.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.972113+0000", 2024-04-24T13:32:10.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00059902100000000004 2024-04-24T13:32:10.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.973403+0000", 2024-04-24T13:32:10.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012904189999999999 2024-04-24T13:32:10.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974152+0000", 2024-04-24T13:32:10.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074879600000000003 2024-04-24T13:32:10.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974316+0000", 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164308 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974436+0000", 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119453 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.371619680999999, 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030693220000000002, 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 840 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975252+0000", 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975261+0000", 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5089999999999999e-06 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975284+0000", 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2719999999999999e-05 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975297+0000", 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2666e-05 2024-04-24T13:32:10.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975425+0000", 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012792899999999999 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975661+0000", 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023588299999999999 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.976159+0000", 2024-04-24T13:32:10.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000498264 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.977419+0000", 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012604859999999999 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978048+0000", 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062885000000000003 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978211+0000", 2024-04-24T13:32:10.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016268899999999999 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978319+0000", 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108596 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.313381379000006, 2024-04-24T13:32:10.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033625529999999999, 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 865 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:32:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033491+0000", 2024-04-24T13:32:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:32:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033502+0000", 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1693e-05 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033532+0000", 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0165999999999999e-05 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033549+0000", 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6113e-05 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033691+0000", 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142445 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034025+0000", 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000334407 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034537+0000", 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051115299999999998 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.035646+0000", 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011090169999999999 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036588+0000", 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094208599999999997 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036741+0000", 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153055 2024-04-24T13:32:10.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036851+0000", 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110245 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.308881271000004, 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029772050000000001, 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.439 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 867 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037991+0000", 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1040000000000001e-06 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038001+0000", 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0910000000000001e-05 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038032+0000", 2024-04-24T13:32:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0648999999999997e-05 2024-04-24T13:32:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038050+0000", 2024-04-24T13:32:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8151999999999998e-05 2024-04-24T13:32:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038165+0000", 2024-04-24T13:32:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115058 2024-04-24T13:32:10.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038379+0000", 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021330000000000001 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038813+0000", 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00043452299999999997 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.039972+0000", 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001158793 2024-04-24T13:32:10.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040723+0000", 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075142000000000004 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040864+0000", 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140624 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040966+0000", 2024-04-24T13:32:10.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101672 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:888 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.259811533999994, 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031285739999999999, 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.445 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.446 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 888 2024-04-24T13:32:10.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.446 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:32:10.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:32:10.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087060+0000", 2024-04-24T13:32:10.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.516e-06 2024-04-24T13:32:10.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087067+0000", 2024-04-24T13:32:10.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2400000000000001e-06 2024-04-24T13:32:10.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087086+0000", 2024-04-24T13:32:10.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9446e-05 2024-04-24T13:32:10.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087096+0000", 2024-04-24T13:32:10.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:32:10.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087221+0000", 2024-04-24T13:32:10.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012472300000000001 2024-04-24T13:32:10.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087467+0000", 2024-04-24T13:32:10.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024638200000000001 2024-04-24T13:32:10.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:10.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087959+0000", 2024-04-24T13:32:10.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049190900000000001 2024-04-24T13:32:10.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.089236+0000", 2024-04-24T13:32:10.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001277037 2024-04-24T13:32:10.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090046+0000", 2024-04-24T13:32:10.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00080988200000000005 2024-04-24T13:32:10.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090124+0000", 2024-04-24T13:32:10.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7670999999999995e-05 2024-04-24T13:32:10.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090187+0000", 2024-04-24T13:32:10.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2798000000000004e-05 2024-04-24T13:32:10.452 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.452 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.452 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.452 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.452 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:32:10.452 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.243090160999998, 2024-04-24T13:32:10.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028897739999999999, 2024-04-24T13:32:10.453 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.453 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.453 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.453 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.453 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.453 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.453 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 895 2024-04-24T13:32:10.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.453 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103782+0000", 2024-04-24T13:32:10.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2029999999999999e-06 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103794+0000", 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1746000000000001e-05 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103824+0000", 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0942999999999998e-05 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103846+0000", 2024-04-24T13:32:10.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1086000000000001e-05 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104008+0000", 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016265499999999999 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104236+0000", 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022747300000000001 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:10.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104551+0000", 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031555400000000001 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.105734+0000", 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011832290000000001 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106519+0000", 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078438599999999998 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106603+0000", 2024-04-24T13:32:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4455000000000004e-05 2024-04-24T13:32:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106669+0000", 2024-04-24T13:32:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6044000000000007e-05 2024-04-24T13:32:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.458 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.239362352000001, 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027864140000000001, 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 897 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107509+0000", 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2500000000000001e-06 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107516+0000", 2024-04-24T13:32:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0929999999999997e-06 2024-04-24T13:32:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107535+0000", 2024-04-24T13:32:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9176000000000001e-05 2024-04-24T13:32:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107546+0000", 2024-04-24T13:32:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0596e-05 2024-04-24T13:32:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107647+0000", 2024-04-24T13:32:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010131700000000001 2024-04-24T13:32:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107791+0000", 2024-04-24T13:32:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014395900000000001 2024-04-24T13:32:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.108057+0000", 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026571500000000003 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.109123+0000", 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010666969999999999 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110108+0000", 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00098528700000000006 2024-04-24T13:32:10.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110199+0000", 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0080000000000005e-05 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110294+0000", 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5243999999999998e-05 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.464 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 97.232959983000001, 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028668890000000001, 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 900 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:10.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:32:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:32:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113911+0000", 2024-04-24T13:32:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5540000000000001e-06 2024-04-24T13:32:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113919+0000", 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4730000000000003e-06 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113937+0000", 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8462e-05 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113947+0000", 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5869999999999999e-06 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114061+0000", 2024-04-24T13:32:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011431599999999999 2024-04-24T13:32:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114188+0000", 2024-04-24T13:32:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012727300000000001 2024-04-24T13:32:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:10.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114460+0000", 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027200500000000002 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.115591+0000", 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011307719999999999 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116635+0000", 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044278 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:10.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116713+0000", 2024-04-24T13:32:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7484000000000006e-05 2024-04-24T13:32:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116777+0000", 2024-04-24T13:32:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3684999999999998e-05 2024-04-24T13:32:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:10.470 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:10.470 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:10.471 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:32:10.472 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:10.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:10.473 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:10.473 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:10.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:10.474 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:10.474 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:10.475 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:10.475 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:10.475 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:10.470+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:10.505 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:10.505 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:10.573 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:10.570+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:10.606 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:10.606 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:10.620 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:10.707 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:10.706+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:10.775 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:10.772+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:10.785 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:10.786 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:10.800 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:10.876 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:10.872+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:10.969 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:10.969 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:10.976 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:10.972+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:10.983 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:11.077 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:11.074+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:11.105 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:11.105 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:11.120 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:11.207 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:11.206+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:11.279 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:11.278+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:11.288 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:11.288 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:11.302 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:11.351 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:32:11.390 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:11.390+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:11.473 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:11.473 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:11.481 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:11.478+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:11.487 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:11.582 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:11.576+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:11.655 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:11.656 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:11.670 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:11.683 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:11.680+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:11.784 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:11.780+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:11.794 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:11.794 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:11.808 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:11.885 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:11.882+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:11.930 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:11.930 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:11.944 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:11.990 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:11.990+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:12.087 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:12.084+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:12.116 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:12.117 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:12.130 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:32:12.188 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:12.184+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:12.249 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:12.249 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:12.263 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:32:12.288 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:12.284+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:12.387 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:12.388 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:12.389 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:12.386+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:12.402 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:32:12.490 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:12.486+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:12.516 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:12.516 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:12.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:32:12.530 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:32:12.591 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:12.590+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:12.688 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:12.688 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:12.691 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:12.688+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:12.702 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:32:12.721 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:12.721 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:12.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:12.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:12.756 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:12.756 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:12.774 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:12.774 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:12.792 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:12.788+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:12.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:12.795 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:12.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:12.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:12.837 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:12.838 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:12.838 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:12.839 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:12.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:12.839 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:12.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.839 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:67 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'41, mlcod=15'39)", 2024-04-24T13:32:12.839 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:32:12.839 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.91366964700001, 2024-04-24T13:32:12.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040578929999999999, 2024-04-24T13:32:12.839 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.839 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:32:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923817+0000", 2024-04-24T13:32:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923819+0000", 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.654e-06 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923830+0000", 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0740000000000001e-05 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923858+0000", 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8742999999999999e-05 2024-04-24T13:32:12.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923872+0000", 2024-04-24T13:32:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3243e-05 2024-04-24T13:32:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.923999+0000", 2024-04-24T13:32:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012721600000000001 2024-04-24T13:32:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.924032+0000", 2024-04-24T13:32:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3556000000000002e-05 2024-04-24T13:32:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927748+0000", 2024-04-24T13:32:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003715402 2024-04-24T13:32:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:08.927875+0000", 2024-04-24T13:32:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012733899999999999 2024-04-24T13:32:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.843 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:109 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'71, mlcod=15'65)", 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.770877877, 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050181729999999999, 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066609+0000", 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066610+0000", 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2900000000000002e-07 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066699+0000", 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8671999999999994e-05 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066711+0000", 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2862e-05 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066722+0000", 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0745e-05 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066787+0000", 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5055999999999995e-05 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.066804+0000", 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7036000000000001e-05 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071592+0000", 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047872239999999996 2024-04-24T13:32:12.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071627+0000", 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5748999999999999e-05 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:110 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'72, mlcod=15'66)", 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.768574809, 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051763149999999999, 2024-04-24T13:32:12.848 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068912+0000", 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068913+0000", 2024-04-24T13:32:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7199999999999998e-07 2024-04-24T13:32:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068921+0000", 2024-04-24T13:32:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6990000000000003e-06 2024-04-24T13:32:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068932+0000", 2024-04-24T13:32:12.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0893999999999999e-05 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.068939+0000", 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9070000000000007e-06 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070722+0000", 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017825619999999999 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070737+0000", 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5007999999999999e-05 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074028+0000", 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032908159999999998 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074088+0000", 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0656999999999999e-05 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:111 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'73, mlcod=15'68)", 2024-04-24T13:32:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:32:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.766880292, 2024-04-24T13:32:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035247360000000001, 2024-04-24T13:32:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:32:12.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070607+0000", 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2200000000000003e-07 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070615+0000", 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4070000000000004e-06 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070625+0000", 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0506000000000001e-05 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.070632+0000", 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0419999999999997e-06 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071040+0000", 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040741600000000002 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.071072+0000", 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2613000000000001e-05 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074095+0000", 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003022458 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074131+0000", 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6572000000000002e-05 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:112 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'74, mlcod=15'68)", 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.765422681, 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049782130000000004, 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:32:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072064+0000", 2024-04-24T13:32:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072065+0000", 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072136+0000", 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0927999999999996e-05 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072149+0000", 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3482000000000001e-05 2024-04-24T13:32:12.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072156+0000", 2024-04-24T13:32:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.049e-06 2024-04-24T13:32:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072207+0000", 2024-04-24T13:32:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1136e-05 2024-04-24T13:32:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.072222+0000", 2024-04-24T13:32:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5327000000000001e-05 2024-04-24T13:32:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077008+0000", 2024-04-24T13:32:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047859319999999997 2024-04-24T13:32:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077043+0000", 2024-04-24T13:32:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4581e-05 2024-04-24T13:32:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:113 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'75, mlcod=15'69)", 2024-04-24T13:32:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:32:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.763493592, 2024-04-24T13:32:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058663999999999999, 2024-04-24T13:32:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.862 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:32:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073993+0000", 2024-04-24T13:32:12.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.073994+0000", 2024-04-24T13:32:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4799999999999997e-07 2024-04-24T13:32:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074003+0000", 2024-04-24T13:32:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5960000000000004e-06 2024-04-24T13:32:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074016+0000", 2024-04-24T13:32:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3251999999999999e-05 2024-04-24T13:32:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074025+0000", 2024-04-24T13:32:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8419999999999994e-06 2024-04-24T13:32:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074161+0000", 2024-04-24T13:32:12.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000136248 2024-04-24T13:32:12.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.074179+0000", 2024-04-24T13:32:12.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7679000000000001e-05 2024-04-24T13:32:12.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079823+0000", 2024-04-24T13:32:12.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056445890000000002 2024-04-24T13:32:12.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079860+0000", 2024-04-24T13:32:12.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6446000000000003e-05 2024-04-24T13:32:12.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.867 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.867 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.867 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:114 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'76, mlcod=15'72)", 2024-04-24T13:32:12.867 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:32:12.868 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.76106905499999, 2024-04-24T13:32:12.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00347584, 2024-04-24T13:32:12.868 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.868 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.868 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.868 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:32:12.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076418+0000", 2024-04-24T13:32:12.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076420+0000", 2024-04-24T13:32:12.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.637e-06 2024-04-24T13:32:12.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076430+0000", 2024-04-24T13:32:12.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.082e-05 2024-04-24T13:32:12.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076459+0000", 2024-04-24T13:32:12.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8410000000000001e-05 2024-04-24T13:32:12.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076489+0000", 2024-04-24T13:32:12.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9856999999999999e-05 2024-04-24T13:32:12.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076609+0000", 2024-04-24T13:32:12.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012084200000000001 2024-04-24T13:32:12.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.076643+0000", 2024-04-24T13:32:12.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3076e-05 2024-04-24T13:32:12.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079863+0000", 2024-04-24T13:32:12.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032207550000000001 2024-04-24T13:32:12.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.079894+0000", 2024-04-24T13:32:12.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0443e-05 2024-04-24T13:32:12.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.872 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.873 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.873 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:115 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'77, mlcod=15'72)", 2024-04-24T13:32:12.873 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:32:12.873 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.75986630600001, 2024-04-24T13:32:12.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048644409999999997, 2024-04-24T13:32:12.873 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.873 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.873 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:32:12.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077621+0000", 2024-04-24T13:32:12.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077622+0000", 2024-04-24T13:32:12.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8700000000000004e-07 2024-04-24T13:32:12.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077684+0000", 2024-04-24T13:32:12.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2836999999999995e-05 2024-04-24T13:32:12.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077698+0000", 2024-04-24T13:32:12.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3390999999999999e-05 2024-04-24T13:32:12.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077704+0000", 2024-04-24T13:32:12.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2029999999999997e-06 2024-04-24T13:32:12.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077759+0000", 2024-04-24T13:32:12.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4676999999999998e-05 2024-04-24T13:32:12.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.077773+0000", 2024-04-24T13:32:12.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4406000000000001e-05 2024-04-24T13:32:12.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082440+0000", 2024-04-24T13:32:12.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046666429999999998 2024-04-24T13:32:12.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.082485+0000", 2024-04-24T13:32:12.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5396999999999999e-05 2024-04-24T13:32:12.878 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.878 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.878 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.878 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:117 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'79, mlcod=15'73)", 2024-04-24T13:32:12.878 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:32:12.878 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.756660141, 2024-04-24T13:32:12.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043478500000000003, 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080827+0000", 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080828+0000", 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.446e-06 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080851+0000", 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2776999999999999e-05 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080872+0000", 2024-04-24T13:32:12.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1403000000000002e-05 2024-04-24T13:32:12.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080888+0000", 2024-04-24T13:32:12.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5345999999999998e-05 2024-04-24T13:32:12.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.080986+0000", 2024-04-24T13:32:12.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8496e-05 2024-04-24T13:32:12.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.081021+0000", 2024-04-24T13:32:12.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4589999999999999e-05 2024-04-24T13:32:12.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085130+0000", 2024-04-24T13:32:12.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088330000000001 2024-04-24T13:32:12.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.085175+0000", 2024-04-24T13:32:12.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4959000000000001e-05 2024-04-24T13:32:12.883 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.883 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.883 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.883 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:137 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'95, mlcod=15'91)", 2024-04-24T13:32:12.883 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:32:12.883 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.517604557, 2024-04-24T13:32:12.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037368409999999999, 2024-04-24T13:32:12.883 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.883 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.883 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.883 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319882+0000", 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319888+0000", 2024-04-24T13:32:12.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.587e-06 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319937+0000", 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8683000000000001e-05 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319963+0000", 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6737000000000002e-05 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.319974+0000", 2024-04-24T13:32:12.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0876000000000001e-05 2024-04-24T13:32:12.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320078+0000", 2024-04-24T13:32:12.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103433 2024-04-24T13:32:12.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.320116+0000", 2024-04-24T13:32:12.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8299e-05 2024-04-24T13:32:12.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323540+0000", 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034239539999999999 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323619+0000", 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9271999999999996e-05 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.887 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:140 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'98, mlcod=15'92)", 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.515183906, 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038858880000000001, 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322303+0000", 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322305+0000", 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9570000000000001e-06 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322360+0000", 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5126e-05 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322390+0000", 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9714e-05 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322405+0000", 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5342999999999999e-05 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322781+0000", 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000376184 2024-04-24T13:32:12.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.322796+0000", 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4148000000000001e-05 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326108+0000", 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033128760000000002 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.326189+0000", 2024-04-24T13:32:12.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0539999999999998e-05 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:141 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'99, mlcod=15'92)", 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.514410688, 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00568266, 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323076+0000", 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323078+0000", 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7430000000000001e-06 2024-04-24T13:32:12.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323090+0000", 2024-04-24T13:32:12.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:32:12.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323113+0000", 2024-04-24T13:32:12.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3699000000000001e-05 2024-04-24T13:32:12.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323126+0000", 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2894000000000001e-05 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323344+0000", 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000218049 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.323357+0000", 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2167000000000001e-05 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328669+0000", 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053124080000000002 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.328759+0000", 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9982999999999995e-05 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:143 1.0 e15/14 1:30306672:devicehealth::main.db.0000000000000000:head v 15'101, mlcod=15'98)", 2024-04-24T13:32:12.896 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.506671634, 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034376459999999999, 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330815+0000", 2024-04-24T13:32:12.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330817+0000", 2024-04-24T13:32:12.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.31e-06 2024-04-24T13:32:12.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330954+0000", 2024-04-24T13:32:12.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013744500000000001 2024-04-24T13:32:12.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330973+0000", 2024-04-24T13:32:12.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8844000000000001e-05 2024-04-24T13:32:12.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.330983+0000", 2024-04-24T13:32:12.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.013e-05 2024-04-24T13:32:12.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331289+0000", 2024-04-24T13:32:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030548700000000001 2024-04-24T13:32:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.331321+0000", 2024-04-24T13:32:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2193000000000002e-05 2024-04-24T13:32:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334177+0000", 2024-04-24T13:32:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028564710000000002 2024-04-24T13:32:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.334253+0000", 2024-04-24T13:32:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5766000000000006e-05 2024-04-24T13:32:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.901 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:154 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'108, mlcod=15'105)", 2024-04-24T13:32:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:32:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.158709527, 2024-04-24T13:32:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034616, 2024-04-24T13:32:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:32:12.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678777+0000", 2024-04-24T13:32:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678778+0000", 2024-04-24T13:32:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.032e-06 2024-04-24T13:32:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678786+0000", 2024-04-24T13:32:12.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0809999999999996e-06 2024-04-24T13:32:12.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678801+0000", 2024-04-24T13:32:12.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5361000000000001e-05 2024-04-24T13:32:12.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678808+0000", 2024-04-24T13:32:12.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1219999999999997e-06 2024-04-24T13:32:12.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678873+0000", 2024-04-24T13:32:12.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5439999999999997e-05 2024-04-24T13:32:12.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.678900+0000", 2024-04-24T13:32:12.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6231e-05 2024-04-24T13:32:12.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682179+0000", 2024-04-24T13:32:12.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003278857 2024-04-24T13:32:12.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.682239+0000", 2024-04-24T13:32:12.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0476000000000002e-05 2024-04-24T13:32:12.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.907 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.907 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.907 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:155 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'109, mlcod=15'105)", 2024-04-24T13:32:12.907 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:32:12.907 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.15796077900001, 2024-04-24T13:32:12.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048802580000000002, 2024-04-24T13:32:12.907 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.908 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.908 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.908 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:32:12.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679526+0000", 2024-04-24T13:32:12.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679527+0000", 2024-04-24T13:32:12.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8899999999999998e-07 2024-04-24T13:32:12.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679574+0000", 2024-04-24T13:32:12.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6856e-05 2024-04-24T13:32:12.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679589+0000", 2024-04-24T13:32:12.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5074e-05 2024-04-24T13:32:12.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679596+0000", 2024-04-24T13:32:12.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9249999999999998e-06 2024-04-24T13:32:12.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679711+0000", 2024-04-24T13:32:12.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115034 2024-04-24T13:32:12.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.679726+0000", 2024-04-24T13:32:12.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5277e-05 2024-04-24T13:32:12.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684360+0000", 2024-04-24T13:32:12.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046338500000000001 2024-04-24T13:32:12.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684406+0000", 2024-04-24T13:32:12.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6252999999999999e-05 2024-04-24T13:32:12.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:156 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'110, mlcod=15'105)", 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.157029654, 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039749210000000002, 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:32:12.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680457+0000", 2024-04-24T13:32:12.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680458+0000", 2024-04-24T13:32:12.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.95e-07 2024-04-24T13:32:12.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680465+0000", 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9110000000000004e-06 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680480+0000", 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4728e-05 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680487+0000", 2024-04-24T13:32:12.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9319999999999999e-06 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680549+0000", 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1638999999999997e-05 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680577+0000", 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8946999999999999e-05 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684410+0000", 2024-04-24T13:32:12.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038324330000000001 2024-04-24T13:32:12.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684432+0000", 2024-04-24T13:32:12.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2336000000000001e-05 2024-04-24T13:32:12.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.917 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.917 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4219.0:157 1.0 e15/14 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head v 15'111, mlcod=15'105)", 2024-04-24T13:32:12.917 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:32:12.918 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.156537863, 2024-04-24T13:32:12.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003501526, 2024-04-24T13:32:12.918 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.918 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.918 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.918 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:32:12.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680949+0000", 2024-04-24T13:32:12.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680950+0000", 2024-04-24T13:32:12.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9000000000000005e-07 2024-04-24T13:32:12.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680957+0000", 2024-04-24T13:32:12.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6880000000000002e-06 2024-04-24T13:32:12.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680971+0000", 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4651000000000001e-05 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.680978+0000", 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8820000000000003e-06 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681022+0000", 2024-04-24T13:32:12.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3572000000000002e-05 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.681036+0000", 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4129e-05 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684433+0000", 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033972709999999999 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:09.684451+0000", 2024-04-24T13:32:12.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7343e-05 2024-04-24T13:32:12.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.922 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.922 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:206 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:12.922 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:32:12.922 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.570456439, 2024-04-24T13:32:12.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086002140000000001, 2024-04-24T13:32:12.922 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.922 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 206 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267031+0000", 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267034+0000", 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.473e-06 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267051+0000", 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7365999999999999e-05 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267088+0000", 2024-04-24T13:32:12.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6842999999999999e-05 2024-04-24T13:32:12.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267106+0000", 2024-04-24T13:32:12.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7842e-05 2024-04-24T13:32:12.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267244+0000", 2024-04-24T13:32:12.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013759300000000001 2024-04-24T13:32:12.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.267255+0000", 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0988999999999999e-05 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271616+0000", 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043608659999999997 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.271983+0000", 2024-04-24T13:32:12.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000367191 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.272919+0000", 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00093584699999999996 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.274619+0000", 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017002530000000001 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:12.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275489+0000", 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087019899999999999 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275571+0000", 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083999999999995e-05 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275631+0000", 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9667999999999999e-05 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:210 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.54160924, 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046081860000000002, 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 210 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.929 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:32:12.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295878+0000", 2024-04-24T13:32:12.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295880+0000", 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295893+0000", 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2832e-05 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295925+0000", 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1739000000000002e-05 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.295941+0000", 2024-04-24T13:32:12.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.596e-05 2024-04-24T13:32:12.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296066+0000", 2024-04-24T13:32:12.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012465299999999999 2024-04-24T13:32:12.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296283+0000", 2024-04-24T13:32:12.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021733000000000001 2024-04-24T13:32:12.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:12.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.296687+0000", 2024-04-24T13:32:12.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040429300000000001 2024-04-24T13:32:12.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:12.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.298130+0000", 2024-04-24T13:32:12.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014426109999999999 2024-04-24T13:32:12.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:12.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300338+0000", 2024-04-24T13:32:12.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022077070000000002 2024-04-24T13:32:12.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300421+0000", 2024-04-24T13:32:12.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3143e-05 2024-04-24T13:32:12.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.300486+0000", 2024-04-24T13:32:12.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:32:12.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.935 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.937 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:218 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.503417996, 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037681580000000002, 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 218 2024-04-24T13:32:12.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334069+0000", 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:12.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334071+0000", 2024-04-24T13:32:12.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-06 2024-04-24T13:32:12.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:12.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334083+0000", 2024-04-24T13:32:12.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1559000000000001e-05 2024-04-24T13:32:12.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:12.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334114+0000", 2024-04-24T13:32:12.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1102999999999997e-05 2024-04-24T13:32:12.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:12.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334132+0000", 2024-04-24T13:32:12.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7846000000000002e-05 2024-04-24T13:32:12.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:12.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334277+0000", 2024-04-24T13:32:12.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145062 2024-04-24T13:32:12.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:12.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.334630+0000", 2024-04-24T13:32:12.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035283500000000002 2024-04-24T13:32:12.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:12.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.335343+0000", 2024-04-24T13:32:12.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071282099999999998 2024-04-24T13:32:12.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:12.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.336950+0000", 2024-04-24T13:32:12.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016074889999999999 2024-04-24T13:32:12.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:12.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337694+0000", 2024-04-24T13:32:12.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074421999999999997 2024-04-24T13:32:12.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:12.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337775+0000", 2024-04-24T13:32:12.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0310999999999997e-05 2024-04-24T13:32:12.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:12.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:12.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:12.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.337837+0000", 2024-04-24T13:32:12.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2397999999999994e-05 2024-04-24T13:32:12.944 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.944 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.944 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.944 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:12.944 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:12.945 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:12.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:32:12.948 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:12.949 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:12.949 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:12.944+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:13.047 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:13.044+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:13.106 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:13.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:13.107 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:13.107 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:13.120 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:32:13.145 INFO:tasks.workunit.client.0.smithi071.stderr:Updating files: 98% (12077/12271) Updating files: 99% (12149/12271) Updating files: 100% (12271/12271) Updating files: 100% (12271/12271), done. 2024-04-24T13:32:13.148 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:13.144+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:13.250 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:13.246+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:13.254 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:13.254 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:13.254 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:13.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:32:13.354 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:13.352+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:13.373 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:32:13.428 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:13.428 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:13.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:13.428 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:13.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 108.20972186100001, 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:32:13.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:32:13.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 108.15401278100001, 2024-04-24T13:32:13.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:32:13.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:32:13.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:32:13.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 108.149945641, 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.439 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:32:13.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:32:13.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:32:13.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:32:13.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:32:13.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:32:13.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.147591749, 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:32:13.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.046565947, 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.449 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:32:13.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:32:13.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.454 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.138816956, 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:32:13.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:13.460 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.115020984, 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:13.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:32:13.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:32:13.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:32:13.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:32:13.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:32:13.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:32:13.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:32:13.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:32:13.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:32:13.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:32:13.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:32:13.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:32:13.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.466 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.088325864, 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:32:13.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:32:13.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.070583943, 2024-04-24T13:32:13.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:32:13.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:32:13.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:32:13.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:32:13.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:32:13.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:32:13.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:32:13.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:32:13.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:32:13.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:32:13.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:32:13.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:32:13.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:32:13.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:32:13.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:32:13.478 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.478 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.478 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.478 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.479 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:32:13.479 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.037413735, 2024-04-24T13:32:13.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:32:13.479 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.479 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.479 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.479 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.479 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.479 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.480 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:32:13.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.480 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:32:13.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:32:13.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:32:13.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:32:13.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:32:13.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:32:13.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:32:13.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:32:13.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:32:13.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:32:13.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:32:13.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:32:13.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:32:13.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:32:13.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:32:13.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:32:13.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:32:13.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:32:13.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:32:13.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:32:13.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:32:13.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:32:13.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:32:13.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:32:13.485 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.485 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.485 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.486 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.486 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:32:13.486 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.989381528, 2024-04-24T13:32:13.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:32:13.486 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.486 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.486 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.486 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.486 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.486 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.487 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:32:13.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.487 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:32:13.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:32:13.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:32:13.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:32:13.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:32:13.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:32:13.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:32:13.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:32:13.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:32:13.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:32:13.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:32:13.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:32:13.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:32:13.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:32:13.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:32:13.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:32:13.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:32:13.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:32:13.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:32:13.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:32:13.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:32:13.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:32:13.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:32:13.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:32:13.492 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.492 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.492 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.492 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.492 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:13.493 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.963133873, 2024-04-24T13:32:13.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:32:13.493 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.493 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.493 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.493 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.493 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.493 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.493 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:32:13.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.493 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:13.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:13.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:32:13.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:32:13.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:32:13.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:32:13.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:32:13.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:32:13.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:32:13.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:32:13.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:32:13.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:32:13.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:32:13.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:32:13.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:32:13.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.498 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.499 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.499 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:13.499 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.90375147, 2024-04-24T13:32:13.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:32:13.499 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.499 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.499 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:32:13.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:32:13.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:32:13.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:32:13.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:32:13.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:32:13.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:32:13.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:32:13.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:32:13.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:32:13.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:32:13.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:32:13.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:32:13.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:32:13.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:32:13.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:32:13.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:32:13.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:32:13.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:32:13.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:32:13.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:32:13.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:32:13.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.505 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.505 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.506 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:32:13.506 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.855284363, 2024-04-24T13:32:13.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:32:13.506 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.506 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.506 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.506 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.506 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.506 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.506 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:32:13.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.506 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:32:13.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:32:13.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.511 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.46959379, 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:32:13.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.27550589499999, 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:32:13.517 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:32:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:32:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:32:13.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:32:13.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:32:13.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:32:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:32:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:32:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:32:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:32:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.271492622, 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.523 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:32:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:32:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:32:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:32:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:32:13.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:32:13.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.239439483, 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.529 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:32:13.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:32:13.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:32:13.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.234895482, 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:32:13.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:32:13.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.201744475, 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:32:13.540 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:32:13.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:32:13.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:32:13.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.546 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.546 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.546 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:13.546 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:13.546 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:13.547 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:32:13.548 INFO:tasks.workunit.client.0.smithi071.stderr:Note: switching to '882080b304cb1602e69c11bc5fe8479e7d2bc64d'. 2024-04-24T13:32:13.548 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-04-24T13:32:13.548 INFO:tasks.workunit.client.0.smithi071.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-04-24T13:32:13.548 INFO:tasks.workunit.client.0.smithi071.stderr:changes and commit them, and you can discard any commits you make in this 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr:state without impacting any branches by switching back to a branch. 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr:If you want to create a new branch to retain commits you create, you may 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr:do so (now or later) by using -c with the switch command. Example: 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr: git switch -c 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr:Or undo this operation with: 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr: git switch - 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr: 2024-04-24T13:32:13.549 INFO:tasks.workunit.client.0.smithi071.stderr:HEAD is now at 882080b304c Merge branches 'pr-55592', 'pr-56394', 'pr-56860', 'pr-56868' and 'pr-57004' into wip-cbodley-testing 2024-04-24T13:32:13.550 DEBUG:teuthology.orchestra.run.smithi071:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-04-24T13:32:13.550 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:13.544+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:13.601 INFO:tasks.workunit.client.0.smithi071.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-04-24T13:32:13.602 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-24T13:32:13.602 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-04-24T13:32:13.648 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:13.644+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:13.707 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:13.707 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:13.708 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:13.708 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:13.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:32:13.762 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:13.760+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:13.849 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:13.846+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:13.874 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:13.874 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:13.874 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:13.886 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:32:13.950 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:13.944+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:14.000 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:14.000 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:14.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:14.000 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:14.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.000 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:42 5.6 5:66436ebe:::default.zonegroup.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:14.000 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:32:14.000 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 108.715790363, 2024-04-24T13:32:14.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026500819999999998, 2024-04-24T13:32:14.000 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.000 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 42 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283128+0000", 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283130+0000", 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3599999999999999e-06 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283143+0000", 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2989999999999999e-05 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283175+0000", 2024-04-24T13:32:14.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1262e-05 2024-04-24T13:32:14.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283190+0000", 2024-04-24T13:32:14.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5333999999999999e-05 2024-04-24T13:32:14.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283279+0000", 2024-04-24T13:32:14.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8616000000000007e-05 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283443+0000", 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016473200000000001 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.283600+0000", 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015686500000000001 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.284799+0000", 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011988229999999999 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285616+0000", 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081652500000000002 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285709+0000", 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3109999999999995e-05 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.285778+0000", 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9465e-05 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:52 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.710916095, 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025615049999999999, 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.006 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 52 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288002+0000", 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288005+0000", 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288017+0000", 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1995e-05 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288050+0000", 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2555999999999998e-05 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288063+0000", 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3774999999999999e-05 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288165+0000", 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101394 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288357+0000", 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019187800000000001 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.288525+0000", 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016830600000000001 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.289691+0000", 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011659629999999999 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290333+0000", 2024-04-24T13:32:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064243099999999995 2024-04-24T13:32:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290439+0000", 2024-04-24T13:32:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105689 2024-04-24T13:32:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.290564+0000", 2024-04-24T13:32:14.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012480600000000001 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.599473481, 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.012 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:32:14.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:32:14.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:32:14.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:32:14.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:32:14.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:32:14.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:32:14.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:14.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:32:14.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:32:14.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:32:14.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:32:14.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.018 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.018 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:279 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.018 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:32:14.018 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.587396102, 2024-04-24T13:32:14.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029424360000000001, 2024-04-24T13:32:14.018 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.018 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.019 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 279 2024-04-24T13:32:14.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.019 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:32:14.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411522+0000", 2024-04-24T13:32:14.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411523+0000", 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0899999999999999e-06 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411539+0000", 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411556+0000", 2024-04-24T13:32:14.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6588000000000001e-05 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411564+0000", 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6929999999999996e-06 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411638+0000", 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3244999999999994e-05 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411745+0000", 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107876 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.411936+0000", 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000190819 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.412644+0000", 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070752499999999997 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414368+0000", 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017246850000000001 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414419+0000", 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0513999999999998e-05 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.414465+0000", 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5862000000000002e-05 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.58368972300001, 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.024 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:32:14.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:32:14.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:32:14.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:32:14.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:32:14.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:32:14.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:32:14.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:32:14.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:32:14.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:32:14.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:32:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:32:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:32:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:32:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:32:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:32:14.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:691 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:32:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.34053788600001, 2024-04-24T13:32:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027367860000000002, 2024-04-24T13:32:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.030 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 691 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658381+0000", 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658383+0000", 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7719999999999999e-06 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658393+0000", 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1840000000000005e-06 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658414+0000", 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0967000000000001e-05 2024-04-24T13:32:14.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658424+0000", 2024-04-24T13:32:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0961000000000001e-05 2024-04-24T13:32:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658556+0000", 2024-04-24T13:32:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013183199999999999 2024-04-24T13:32:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.658781+0000", 2024-04-24T13:32:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022427499999999999 2024-04-24T13:32:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.659230+0000", 2024-04-24T13:32:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00044896299999999998 2024-04-24T13:32:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660178+0000", 2024-04-24T13:32:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094838799999999999 2024-04-24T13:32:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.660868+0000", 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000689575 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661012+0000", 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000144735 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.661117+0000", 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105134 2024-04-24T13:32:14.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.140416931, 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:32:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:32:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:32:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.07707341299999, 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:32:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:32:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:32:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:32:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:32:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:32:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:32:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:32:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:32:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:32:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:32:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:32:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:32:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:32:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:32:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:32:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.072397718, 2024-04-24T13:32:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:32:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:32:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:32:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:32:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:32:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:32:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:32:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:32:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:32:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:32:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:841 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.020473869, 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028643660000000001, 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 841 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:32:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978445+0000", 2024-04-24T13:32:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978447+0000", 2024-04-24T13:32:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-24T13:32:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978459+0000", 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.224e-05 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978489+0000", 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9583000000000001e-05 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978504+0000", 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5539000000000001e-05 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978612+0000", 2024-04-24T13:32:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107327 2024-04-24T13:32:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978831+0000", 2024-04-24T13:32:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021982300000000001 2024-04-24T13:32:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.979160+0000", 2024-04-24T13:32:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032855299999999998 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.980242+0000", 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010821649999999999 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981019+0000", 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00077641199999999998 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981185+0000", 2024-04-24T13:32:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016605499999999999 2024-04-24T13:32:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.981309+0000", 2024-04-24T13:32:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012434300000000001 2024-04-24T13:32:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.016352987, 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:32:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.006606952, 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:32:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:32:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:32:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:32:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:32:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.00206014, 2024-04-24T13:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002954763, 2024-04-24T13:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 849 2024-04-24T13:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996861+0000", 2024-04-24T13:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2069999999999998e-06 2024-04-24T13:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996871+0000", 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0753e-05 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996903+0000", 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996922+0000", 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8595999999999999e-05 2024-04-24T13:32:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997042+0000", 2024-04-24T13:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119646 2024-04-24T13:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997271+0000", 2024-04-24T13:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228963 2024-04-24T13:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997736+0000", 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000465181 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999022+0000", 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012864829999999999 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999529+0000", 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050722400000000002 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999697+0000", 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016795499999999999 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999813+0000", 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115746 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:868 6.f 6:f6792a7a:::obj_delete_at_hint.0000000097:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.957774887, 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027316710000000002, 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 868 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041144+0000", 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041146+0000", 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041156+0000", 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0772e-05 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041184+0000", 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7616000000000001e-05 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041199+0000", 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4582e-05 2024-04-24T13:32:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041309+0000", 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011029799999999999 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041532+0000", 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022316 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.041846+0000", 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031406700000000001 2024-04-24T13:32:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043088+0000", 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001241409 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043667+0000", 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057961000000000004 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043767+0000", 2024-04-24T13:32:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100166 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.043875+0000", 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107871 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.868597619, 2024-04-24T13:32:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003049946, 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 907 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130323+0000", 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5859999999999999e-06 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130336+0000", 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.218e-05 2024-04-24T13:32:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130367+0000", 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1665000000000003e-05 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130382+0000", 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5113000000000001e-05 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130510+0000", 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012778999999999999 2024-04-24T13:32:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130749+0000", 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238669 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.131082+0000", 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033360300000000002 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.132266+0000", 2024-04-24T13:32:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001183627 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133172+0000", 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090542200000000002 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133259+0000", 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133371+0000", 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011194 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:909 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.86477877, 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002722543, 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 909 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134140+0000", 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134141+0000", 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134150+0000", 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9430000000000006e-06 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134172+0000", 2024-04-24T13:32:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1296000000000001e-05 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134187+0000", 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5659e-05 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134275+0000", 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7787000000000005e-05 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134403+0000", 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127677 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.134686+0000", 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00028353500000000002 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.135742+0000", 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010557800000000001 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136663+0000", 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092043500000000005 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136753+0000", 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0871000000000005e-05 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.136862+0000", 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010883 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:949 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.77108388800001, 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029521759999999999, 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 949 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227835+0000", 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227837+0000", 2024-04-24T13:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2189999999999998e-06 2024-04-24T13:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227848+0000", 2024-04-24T13:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0699999999999999e-05 2024-04-24T13:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227876+0000", 2024-04-24T13:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8972999999999999e-05 2024-04-24T13:32:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227892+0000", 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5965999999999999e-05 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228028+0000", 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135322 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228256+0000", 2024-04-24T13:32:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228237 2024-04-24T13:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.228706+0000", 2024-04-24T13:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045042599999999997 2024-04-24T13:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.229990+0000", 2024-04-24T13:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012836799999999999 2024-04-24T13:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230579+0000", 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058925199999999996 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230673+0000", 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3484000000000001e-05 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.230787+0000", 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113917 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.766976798, 2024-04-24T13:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:32:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.75677701399999, 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030452859999999999, 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 955 2024-04-24T13:32:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242144+0000", 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2500000000000001e-06 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242155+0000", 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1779e-05 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242186+0000", 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0879e-05 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242202+0000", 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5566e-05 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242338+0000", 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013631299999999999 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242700+0000", 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036144900000000002 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.243261+0000", 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056143600000000001 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.244736+0000", 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001475248 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245034+0000", 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029792099999999998 2024-04-24T13:32:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245119+0000", 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4876999999999994e-05 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245187+0000", 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7568000000000001e-05 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:957 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 100.75285157899999, 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026970509999999998, 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 957 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246067+0000", 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246069+0000", 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4600000000000002e-06 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246081+0000", 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1780000000000001e-05 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246105+0000", 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3805999999999999e-05 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246120+0000", 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5415999999999999e-05 2024-04-24T13:32:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246221+0000", 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010027 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246367+0000", 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014653299999999999 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.246645+0000", 2024-04-24T13:32:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000277681 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.247868+0000", 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001223373 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248563+0000", 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000694781 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248648+0000", 2024-04-24T13:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5187999999999998e-05 2024-04-24T13:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.248764+0000", 2024-04-24T13:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115763 2024-04-24T13:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.117 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:14.119 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:14.119 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:14.116+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:14.220 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:14.216+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:14.298 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:14.299 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:14.299 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:14.299 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:14.312 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:14.321 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:14.318+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:14.337 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-04-24T13:32:14.353 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:32:14.406 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-04-24T13:32:14.421 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:14.416+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:14.446 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-04-24T13:32:14.448 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-24T13:32:14.448 INFO:tasks.workunit.client.0.smithi071.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-04-24T13:32:14.457 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:14.457 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:14.457 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:14.457 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:14.457 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:14.470 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:14.485 INFO:tasks.workunit.client.0.smithi071.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-04-24T13:32:14.488 DEBUG:teuthology.orchestra.run.smithi071:> set -ex 2024-04-24T13:32:14.489 DEBUG:teuthology.orchestra.run.smithi071:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-04-24T13:32:14.530 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:14.528+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:14.534 INFO:tasks.workunit:Running workunits matching rgw/s3_bucket_quota.pl on client.0... 2024-04-24T13:32:14.535 INFO:tasks.workunit:Running workunit rgw/s3_bucket_quota.pl... 2024-04-24T13:32:14.536 DEBUG:teuthology.orchestra.run.smithi071:workunit test rgw/s3_bucket_quota.pl> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=882080b304cb1602e69c11bc5fe8479e7d2bc64d TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/rgw/s3_bucket_quota.pl 2024-04-24T13:32:14.596 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:14.596 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:14.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:14.596 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:14.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 107.348286923, 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057346300000000001, 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:14.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:14.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247277+0000", 2024-04-24T13:32:14.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3459999999999998e-06 2024-04-24T13:32:14.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247344+0000", 2024-04-24T13:32:14.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6768999999999997e-05 2024-04-24T13:32:14.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247379+0000", 2024-04-24T13:32:14.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4573999999999998e-05 2024-04-24T13:32:14.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247402+0000", 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3303e-05 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247599+0000", 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019720499999999999 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247622+0000", 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2512999999999999e-05 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.252825+0000", 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052035270000000003 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.253009+0000", 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018339300000000001 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.601 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.602 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:14.602 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 102.31964441, 2024-04-24T13:32:14.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:32:14.602 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.602 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.602 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.602 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.602 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.602 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.602 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:32:14.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.602 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:32:14.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:32:14.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:32:14.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:32:14.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:32:14.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:32:14.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:32:14.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:32:14.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:32:14.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:216 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 102.26860476900001, 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031751589999999999, 2024-04-24T13:32:14.608 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 216 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326956+0000", 2024-04-24T13:32:14.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326959+0000", 2024-04-24T13:32:14.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6170000000000001e-06 2024-04-24T13:32:14.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.326972+0000", 2024-04-24T13:32:14.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:32:14.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327005+0000", 2024-04-24T13:32:14.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2845000000000001e-05 2024-04-24T13:32:14.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327023+0000", 2024-04-24T13:32:14.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8179999999999999e-05 2024-04-24T13:32:14.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327132+0000", 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010878300000000001 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327351+0000", 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021952000000000001 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.327770+0000", 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041895600000000001 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329354+0000", 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00158388 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.329982+0000", 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062821700000000003 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330066+0000", 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4153999999999994e-05 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.330131+0000", 2024-04-24T13:32:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4920999999999997e-05 2024-04-24T13:32:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:227 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:32:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 102.22863369700001, 2024-04-24T13:32:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031663630000000002, 2024-04-24T13:32:14.614 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 227 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366927+0000", 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366930+0000", 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3800000000000001e-06 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366941+0000", 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1466e-05 2024-04-24T13:32:14.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366973+0000", 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1588999999999999e-05 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.366987+0000", 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4663e-05 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367166+0000", 2024-04-24T13:32:14.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017905699999999999 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367388+0000", 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022201299999999999 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.367820+0000", 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000431357 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369320+0000", 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015007359999999999 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.369944+0000", 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062337299999999998 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370026+0000", 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2437999999999999e-05 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.370094+0000", 2024-04-24T13:32:14.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7291000000000003e-05 2024-04-24T13:32:14.620 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.620 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.620 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.620 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:229 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.620 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:32:14.620 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 102.22132225199999, 2024-04-24T13:32:14.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030833050000000002, 2024-04-24T13:32:14.620 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.620 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 229 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374239+0000", 2024-04-24T13:32:14.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374241+0000", 2024-04-24T13:32:14.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5660000000000001e-06 2024-04-24T13:32:14.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374253+0000", 2024-04-24T13:32:14.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2094e-05 2024-04-24T13:32:14.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374284+0000", 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0824999999999997e-05 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374299+0000", 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.483e-05 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374410+0000", 2024-04-24T13:32:14.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110956 2024-04-24T13:32:14.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.374631+0000", 2024-04-24T13:32:14.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221117 2024-04-24T13:32:14.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:14.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.375006+0000", 2024-04-24T13:32:14.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000375041 2024-04-24T13:32:14.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.376480+0000", 2024-04-24T13:32:14.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00147434 2024-04-24T13:32:14.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377172+0000", 2024-04-24T13:32:14.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00069190799999999998 2024-04-24T13:32:14.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377255+0000", 2024-04-24T13:32:14.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2536999999999999e-05 2024-04-24T13:32:14.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.377322+0000", 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7090999999999999e-05 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 102.21469024300001, 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040131660000000003, 2024-04-24T13:32:14.626 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.627 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.627 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.627 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.627 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.627 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.627 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 231 2024-04-24T13:32:14.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.627 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:14.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380873+0000", 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2400000000000002e-06 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380884+0000", 2024-04-24T13:32:14.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0645999999999999e-05 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380919+0000", 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5026e-05 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380934+0000", 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.522e-05 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381077+0000", 2024-04-24T13:32:14.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014362500000000001 2024-04-24T13:32:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381453+0000", 2024-04-24T13:32:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037581799999999999 2024-04-24T13:32:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.382170+0000", 2024-04-24T13:32:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071714999999999995 2024-04-24T13:32:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.383955+0000", 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017847710000000001 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384619+0000", 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066381600000000002 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384770+0000", 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015067800000000001 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384884+0000", 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114176 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:324 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 102.176658379, 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029016649999999999, 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 324 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418902+0000", 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418904+0000", 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-06 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418911+0000", 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.759e-06 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418928+0000", 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7105e-05 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.418935+0000", 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7309999999999993e-06 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419024+0000", 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8524999999999997e-05 2024-04-24T13:32:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419121+0000", 2024-04-24T13:32:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6978000000000006e-05 2024-04-24T13:32:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419329+0000", 2024-04-24T13:32:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020806399999999999 2024-04-24T13:32:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419835+0000", 2024-04-24T13:32:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050625300000000002 2024-04-24T13:32:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421631+0000", 2024-04-24T13:32:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001795615 2024-04-24T13:32:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421694+0000", 2024-04-24T13:32:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3398999999999994e-05 2024-04-24T13:32:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.421804+0000", 2024-04-24T13:32:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109894 2024-04-24T13:32:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:562 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 102.04272700999999, 2024-04-24T13:32:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048608870000000004, 2024-04-24T13:32:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 562 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552837+0000", 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8499999999999998e-06 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552852+0000", 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4866e-05 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552890+0000", 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8166e-05 2024-04-24T13:32:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552905+0000", 2024-04-24T13:32:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5255e-05 2024-04-24T13:32:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553053+0000", 2024-04-24T13:32:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014824599999999999 2024-04-24T13:32:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553425+0000", 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000371512 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553969+0000", 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054421500000000002 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.554987+0000", 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001017855 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557606+0000", 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026195839999999999 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557655+0000", 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8575000000000002e-05 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557695+0000", 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9762999999999999e-05 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:607 6.c 6:36abfd60:::obj_delete_at_hint.0000000029:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 102.00285776699999, 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003243737, 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 607 2024-04-24T13:32:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592703+0000", 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592705+0000", 2024-04-24T13:32:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:32:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592714+0000", 2024-04-24T13:32:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7630000000000006e-06 2024-04-24T13:32:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592733+0000", 2024-04-24T13:32:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9656e-05 2024-04-24T13:32:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592745+0000", 2024-04-24T13:32:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1717e-05 2024-04-24T13:32:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.592881+0000", 2024-04-24T13:32:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013627999999999999 2024-04-24T13:32:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593221+0000", 2024-04-24T13:32:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033945600000000002 2024-04-24T13:32:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.593765+0000", 2024-04-24T13:32:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054456600000000002 2024-04-24T13:32:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.594969+0000", 2024-04-24T13:32:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012034649999999999 2024-04-24T13:32:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595779+0000", 2024-04-24T13:32:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000810161 2024-04-24T13:32:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595893+0000", 2024-04-24T13:32:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114481 2024-04-24T13:32:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.595947+0000", 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3352e-05 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:736 6.6 6:6192870f:::obj_delete_at_hint.0000000053:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.85174990100001, 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027976260000000001, 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 736 2024-04-24T13:32:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:32:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743811+0000", 2024-04-24T13:32:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743813+0000", 2024-04-24T13:32:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0899999999999999e-06 2024-04-24T13:32:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743824+0000", 2024-04-24T13:32:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.111e-05 2024-04-24T13:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743853+0000", 2024-04-24T13:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8909000000000001e-05 2024-04-24T13:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743867+0000", 2024-04-24T13:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4036000000000001e-05 2024-04-24T13:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.743980+0000", 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011266 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744205+0000", 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000225016 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.744515+0000", 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030974000000000003 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.745485+0000", 2024-04-24T13:32:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097096300000000003 2024-04-24T13:32:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746512+0000", 2024-04-24T13:32:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001026873 2024-04-24T13:32:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746563+0000", 2024-04-24T13:32:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1017000000000003e-05 2024-04-24T13:32:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.746609+0000", 2024-04-24T13:32:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5212e-05 2024-04-24T13:32:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:778 6.1b 6:dc490aaa:::obj_delete_at_hint.0000000067:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:32:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.762522522, 2024-04-24T13:32:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028606399999999998, 2024-04-24T13:32:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 778 2024-04-24T13:32:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:32:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833038+0000", 2024-04-24T13:32:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833041+0000", 2024-04-24T13:32:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3539999999999998e-06 2024-04-24T13:32:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833052+0000", 2024-04-24T13:32:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:32:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833084+0000", 2024-04-24T13:32:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:32:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833111+0000", 2024-04-24T13:32:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6869e-05 2024-04-24T13:32:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833245+0000", 2024-04-24T13:32:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000133576 2024-04-24T13:32:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833460+0000", 2024-04-24T13:32:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021584600000000001 2024-04-24T13:32:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.833761+0000", 2024-04-24T13:32:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000300477 2024-04-24T13:32:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.834890+0000", 2024-04-24T13:32:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011292050000000001 2024-04-24T13:32:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835731+0000", 2024-04-24T13:32:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000841423 2024-04-24T13:32:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835829+0000", 2024-04-24T13:32:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7337000000000007e-05 2024-04-24T13:32:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.835899+0000", 2024-04-24T13:32:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0151e-05 2024-04-24T13:32:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:826 6.6 6:64735f45:::obj_delete_at_hint.0000000083:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:32:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.65204217599999, 2024-04-24T13:32:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002884246, 2024-04-24T13:32:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 826 2024-04-24T13:32:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:32:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943519+0000", 2024-04-24T13:32:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943521+0000", 2024-04-24T13:32:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4530000000000001e-06 2024-04-24T13:32:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943532+0000", 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943563+0000", 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0982000000000003e-05 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943582+0000", 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8406e-05 2024-04-24T13:32:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.943781+0000", 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000199624 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944019+0000", 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000237972 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.944345+0000", 2024-04-24T13:32:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032530699999999999 2024-04-24T13:32:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.945581+0000", 2024-04-24T13:32:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012363809999999999 2024-04-24T13:32:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946252+0000", 2024-04-24T13:32:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067128499999999998 2024-04-24T13:32:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946339+0000", 2024-04-24T13:32:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6193999999999995e-05 2024-04-24T13:32:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.946403+0000", 2024-04-24T13:32:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4364999999999998e-05 2024-04-24T13:32:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.624618715, 2024-04-24T13:32:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034937589999999999, 2024-04-24T13:32:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 838 2024-04-24T13:32:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970944+0000", 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3360000000000002e-06 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970959+0000", 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.469e-05 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970989+0000", 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0159e-05 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971004+0000", 2024-04-24T13:32:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:32:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971147+0000", 2024-04-24T13:32:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014242500000000001 2024-04-24T13:32:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971514+0000", 2024-04-24T13:32:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036720900000000001 2024-04-24T13:32:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.972113+0000", 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00059902100000000004 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.973403+0000", 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012904189999999999 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974152+0000", 2024-04-24T13:32:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074879600000000003 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974316+0000", 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164308 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974436+0000", 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119453 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:840 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:32:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.62031079499999, 2024-04-24T13:32:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030693220000000002, 2024-04-24T13:32:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 840 2024-04-24T13:32:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975250+0000", 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975252+0000", 2024-04-24T13:32:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.73e-06 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975261+0000", 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5089999999999999e-06 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975284+0000", 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2719999999999999e-05 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975297+0000", 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2666e-05 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975425+0000", 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012792899999999999 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.975661+0000", 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023588299999999999 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.976159+0000", 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000498264 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.977419+0000", 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012604859999999999 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978048+0000", 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062885000000000003 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978211+0000", 2024-04-24T13:32:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016268899999999999 2024-04-24T13:32:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.978319+0000", 2024-04-24T13:32:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108596 2024-04-24T13:32:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:865 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:32:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.562072493, 2024-04-24T13:32:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033625529999999999, 2024-04-24T13:32:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 865 2024-04-24T13:32:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033488+0000", 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033491+0000", 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033502+0000", 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1693e-05 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033532+0000", 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0165999999999999e-05 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033549+0000", 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6113e-05 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.033691+0000", 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142445 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034025+0000", 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000334407 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.034537+0000", 2024-04-24T13:32:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051115299999999998 2024-04-24T13:32:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.035646+0000", 2024-04-24T13:32:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011090169999999999 2024-04-24T13:32:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036588+0000", 2024-04-24T13:32:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094208599999999997 2024-04-24T13:32:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036741+0000", 2024-04-24T13:32:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153055 2024-04-24T13:32:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.036851+0000", 2024-04-24T13:32:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110245 2024-04-24T13:32:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:867 6.c 6:31288c1b:::obj_delete_at_hint.0000000096:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.557572385, 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029772050000000001, 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 867 2024-04-24T13:32:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:32:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037988+0000", 2024-04-24T13:32:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.037991+0000", 2024-04-24T13:32:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1040000000000001e-06 2024-04-24T13:32:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038001+0000", 2024-04-24T13:32:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0910000000000001e-05 2024-04-24T13:32:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038032+0000", 2024-04-24T13:32:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0648999999999997e-05 2024-04-24T13:32:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038050+0000", 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8151999999999998e-05 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038165+0000", 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115058 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038379+0000", 2024-04-24T13:32:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021330000000000001 2024-04-24T13:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.038813+0000", 2024-04-24T13:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00043452299999999997 2024-04-24T13:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.039972+0000", 2024-04-24T13:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001158793 2024-04-24T13:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040723+0000", 2024-04-24T13:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00075142000000000004 2024-04-24T13:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040864+0000", 2024-04-24T13:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140624 2024-04-24T13:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.040966+0000", 2024-04-24T13:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101672 2024-04-24T13:32:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:888 6.11 6:8a7625ba:::obj_delete_at_hint.0000000103:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:32:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.508502648, 2024-04-24T13:32:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031285739999999999, 2024-04-24T13:32:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 888 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087058+0000", 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087060+0000", 2024-04-24T13:32:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.516e-06 2024-04-24T13:32:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087067+0000", 2024-04-24T13:32:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2400000000000001e-06 2024-04-24T13:32:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087086+0000", 2024-04-24T13:32:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9446e-05 2024-04-24T13:32:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087096+0000", 2024-04-24T13:32:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:32:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087221+0000", 2024-04-24T13:32:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012472300000000001 2024-04-24T13:32:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087467+0000", 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024638200000000001 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.087959+0000", 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049190900000000001 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.089236+0000", 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001277037 2024-04-24T13:32:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090046+0000", 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00080988200000000005 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090124+0000", 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7670999999999995e-05 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.090187+0000", 2024-04-24T13:32:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2798000000000004e-05 2024-04-24T13:32:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:895 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:32:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.49178127499999, 2024-04-24T13:32:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028897739999999999, 2024-04-24T13:32:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 895 2024-04-24T13:32:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:32:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103780+0000", 2024-04-24T13:32:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103782+0000", 2024-04-24T13:32:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2029999999999999e-06 2024-04-24T13:32:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103794+0000", 2024-04-24T13:32:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1746000000000001e-05 2024-04-24T13:32:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103824+0000", 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0942999999999998e-05 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.103846+0000", 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1086000000000001e-05 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104008+0000", 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016265499999999999 2024-04-24T13:32:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104236+0000", 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022747300000000001 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.104551+0000", 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00031555400000000001 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.105734+0000", 2024-04-24T13:32:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011832290000000001 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106519+0000", 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00078438599999999998 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106603+0000", 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4455000000000004e-05 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.106669+0000", 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6044000000000007e-05 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:897 6.13 6:cc909b6b:::obj_delete_at_hint.0000000106:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.488053466, 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027864140000000001, 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 897 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107507+0000", 2024-04-24T13:32:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107509+0000", 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2500000000000001e-06 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107516+0000", 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0929999999999997e-06 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107535+0000", 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9176000000000001e-05 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107546+0000", 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0596e-05 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107647+0000", 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010131700000000001 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.107791+0000", 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014395900000000001 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.108057+0000", 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026571500000000003 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.109123+0000", 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010666969999999999 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110108+0000", 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00098528700000000006 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110199+0000", 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0080000000000005e-05 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.110294+0000", 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5243999999999998e-05 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:900 6.b 6:d4f18cce:::obj_delete_at_hint.0000000107:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 101.481651097, 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028668890000000001, 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 900 2024-04-24T13:32:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:32:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113910+0000", 2024-04-24T13:32:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113911+0000", 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5540000000000001e-06 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113919+0000", 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4730000000000003e-06 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113937+0000", 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8462e-05 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.113947+0000", 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5869999999999999e-06 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114061+0000", 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011431599999999999 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114188+0000", 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012727300000000001 2024-04-24T13:32:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.114460+0000", 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027200500000000002 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.115591+0000", 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011307719999999999 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116635+0000", 2024-04-24T13:32:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044278 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116713+0000", 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7484000000000006e-05 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.116777+0000", 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3684999999999998e-05 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:14.719 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:14.720 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:14.721 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:14.718+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:14.821 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:14.818+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:14.851 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:14.851 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:14.851 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:14.851 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:14.865 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:14.909 INFO:tasks.workunit.client.0.smithi071.stderr:1+0 records in 2024-04-24T13:32:14.910 INFO:tasks.workunit.client.0.smithi071.stderr:1+0 records out 2024-04-24T13:32:14.910 INFO:tasks.workunit.client.0.smithi071.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0111446 s, 941 MB/s 2024-04-24T13:32:14.949 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:32:14.951 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:14.950+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:15.023 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:15.020+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:15.035 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:15.035 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:15.035 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:15.035 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:15.035 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:15.050 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:15.090 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:15.090 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:15.107 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:15.108 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:15.114 INFO:tasks.workunit.client.0.smithi071.stdout:Bucket Created: buck_2024_03_24_13_32_15 2024-04-24T13:32:15.123 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:15.120+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:15.125 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:15.126 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:15.141 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:15.141 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:15.159 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:15.159 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:15.180 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:15.181 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:15.199 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:15.199 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:15.221 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:15.221 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:15.224 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:15.222+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:15.228 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:15.228 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:15.240 INFO:tasks.workunit.client.0.smithi071.stdout:quota set for the bucket: buck_2024_03_24_13_32_15 2024-04-24T13:32:15.243 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:15.325 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:15.320+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:15.412 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:15.412 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:15.427 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:15.428 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:15.424+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:15.456 INFO:tasks.workunit.client.0.smithi071.stdout:quota enabled for the bucket: buck_2024_03_24_13_32_15 2024-04-24T13:32:15.456 INFO:tasks.workunit.client.0.smithi071.stdout:adding file to bucket: 10Mb. 2024-04-24T13:32:15.457 INFO:tasks.workunit.client.0.smithi071.stdout:upload file successful 2024-04-24T13:32:15.457 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:15.457 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - Test max objects passed 2024-04-24T13:32:15.457 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:15.528 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:15.526+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:15.554 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:15.554 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:15.570 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:15.658 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:15.658+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:15.685 INFO:tasks.workunit.client.0.smithi071.stdout:user qa_user deleted 2024-04-24T13:32:15.685 INFO:tasks.workunit.client.0.smithi071.stdout:bucket delete succeeded 2024-04-24T13:32:15.709 INFO:tasks.workunit.client.0.smithi071.stderr:1+0 records in 2024-04-24T13:32:15.709 INFO:tasks.workunit.client.0.smithi071.stderr:1+0 records out 2024-04-24T13:32:15.709 INFO:tasks.workunit.client.0.smithi071.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0208081 s, 504 MB/s 2024-04-24T13:32:15.730 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:15.724+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:15.737 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:15.737 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:15.751 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:15.838 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:15.838+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:15.865 INFO:tasks.workunit.client.0.smithi071.stdout:Bucket Created: buck_2024_03_24_13_32_15 2024-04-24T13:32:15.923 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:15.923 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:15.931 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:15.928+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:15.939 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:16.033 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:16.030+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:16.112 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:16.113 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:16.115 INFO:tasks.workunit.client.0.smithi071.stdout:bucket quota max_objs set for the given user: buck_2024_03_24_13_32_15 2024-04-24T13:32:16.126 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:16.133 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:16.128+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:16.234 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:16.228+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:16.286 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:16.286 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:16.300 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:16.346 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:16.346+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:16.352 INFO:tasks.workunit.client.0.smithi071.stdout:quota enabled for the bucket: buck_2024_03_24_13_32_15 2024-04-24T13:32:16.353 INFO:tasks.workunit.client.0.smithi071.stdout:adding file to bucket: 10Mb. 2024-04-24T13:32:16.353 INFO:tasks.workunit.client.0.smithi071.stdout:upload file successful 2024-04-24T13:32:16.353 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:16.353 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - Test max objects for the given user passed 2024-04-24T13:32:16.353 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:16.381 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:32:16.423 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:16.423 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:16.435 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:16.432+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:16.438 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:32:16.536 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:16.532+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:16.584 INFO:tasks.workunit.client.0.smithi071.stdout:user qa_user deleted 2024-04-24T13:32:16.584 INFO:tasks.workunit.client.0.smithi071.stdout:bucket delete succeeded 2024-04-24T13:32:16.612 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:16.612 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:16.626 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:32:16.646 INFO:tasks.workunit.client.0.smithi071.stderr:1+0 records in 2024-04-24T13:32:16.646 INFO:tasks.workunit.client.0.smithi071.stderr:1+0 records out 2024-04-24T13:32:16.646 INFO:tasks.workunit.client.0.smithi071.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0598422 s, 175 MB/s 2024-04-24T13:32:16.671 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:16.670+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:16.737 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:16.732+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:16.749 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:16.750 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:16.765 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:32:16.806 INFO:tasks.workunit.client.0.smithi071.stdout:Bucket Created: buck_2024_03_24_13_32_16 2024-04-24T13:32:16.838 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:16.838+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:16.879 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:16.879 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:16.893 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:32:16.939 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:16.938+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:16.959 INFO:tasks.workunit.client.0.smithi071.stdout:quota set for the bucket: buck_2024_03_24_13_32_16 2024-04-24T13:32:17.040 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:17.038+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:17.048 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:17.049 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:17.064 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:32:17.150 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:17.148+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:17.201 INFO:tasks.workunit.client.0.smithi071.stdout:quota enabled for the bucket: buck_2024_03_24_13_32_16 2024-04-24T13:32:17.201 INFO:tasks.workunit.client.0.smithi071.stdout:adding file to bucket: 10Mb. 2024-04-24T13:32:17.202 INFO:tasks.workunit.client.0.smithi071.stdout:upload file successful 2024-04-24T13:32:17.211 INFO:tasks.workunit.client.0.smithi071.stderr:1+0 records in 2024-04-24T13:32:17.211 INFO:tasks.workunit.client.0.smithi071.stderr:1+0 records out 2024-04-24T13:32:17.211 INFO:tasks.workunit.client.0.smithi071.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00837288 s, 1.3 GB/s 2024-04-24T13:32:17.220 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:17.220 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:17.234 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:32:17.241 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:32:17.243 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:17.242+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:17.265 INFO:tasks.workunit.client.0.smithi071.stdout:readding file to bucket: 10MBfile1 2024-04-24T13:32:17.265 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:17.265 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - set max objects and test beyond max objects passed 2024-04-24T13:32:17.265 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:17.343 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:17.340+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:17.374 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:32:17.402 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:17.402 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:17.422 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:32:17.427 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:17.427 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:17.444 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:17.442+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:17.444 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:17.445 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:17.461 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:17.461 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:17.479 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:17.480 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:17.502 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:17.502 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:17.524 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:17.524 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:17.545 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:17.542+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:17.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:17.547 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:17.551 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:17.551 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:17.552 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:17.565 INFO:tasks.workunit.client.0.smithi071.stdout:user qa_user deleted 2024-04-24T13:32:17.566 INFO:tasks.workunit.client.0.smithi071.stdout:bucket delete succeeded 2024-04-24T13:32:17.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:32:17.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:17.571 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:17.593 INFO:tasks.workunit.client.0.smithi071.stderr:1+0 records in 2024-04-24T13:32:17.594 INFO:tasks.workunit.client.0.smithi071.stderr:1+0 records out 2024-04-24T13:32:17.594 INFO:tasks.workunit.client.0.smithi071.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0250671 s, 418 MB/s 2024-04-24T13:32:17.647 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:17.646+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:17.685 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:17.685 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 112.46807971299999, 2024-04-24T13:32:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:32:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:32:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:17.686 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:32:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:32:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:32:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:32:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:32:17.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:32:17.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:32:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:32:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:32:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:32:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:32:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:38 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 112.41237063299999, 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003139953, 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 38 2024-04-24T13:32:17.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272413+0000", 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272415+0000", 2024-04-24T13:32:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.793e-06 2024-04-24T13:32:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272424+0000", 2024-04-24T13:32:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2399999999999996e-06 2024-04-24T13:32:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272448+0000", 2024-04-24T13:32:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:32:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272461+0000", 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2828e-05 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272607+0000", 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014613899999999999 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.272970+0000", 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036307000000000001 2024-04-24T13:32:17.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.273359+0000", 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038877999999999997 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275014+0000", 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001655044 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275368+0000", 2024-04-24T13:32:17.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353877 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275458+0000", 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9733000000000003e-05 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.275553+0000", 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5655999999999994e-05 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 112.40830349300001, 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.697 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.702 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:48 7.0 e29/28 7:05bf5b68:::notify.1:head v 29'1, mlcod=0'0)", 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 108.405949601, 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295261, 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278834+0000", 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278837+0000", 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.96e-06 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278858+0000", 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1056e-05 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278907+0000", 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8358e-05 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.278931+0000", 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.44e-05 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279057+0000", 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012572199999999999 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.279101+0000", 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4422999999999998e-05 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281702+0000", 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026010870000000002 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.281787+0000", 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4604000000000005e-05 2024-04-24T13:32:17.706 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:193 6.4 6:22d26bf9:::data_loggenerations_metadata:head [create,call version.set in=10b,writefull 0~28] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 108.30492379899999, 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030062560000000001, 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.707 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 193 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379860+0000", 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379863+0000", 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3099999999999999e-06 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379874+0000", 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1476e-05 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379906+0000", 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1819000000000001e-05 2024-04-24T13:32:17.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.379922+0000", 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5979999999999999e-05 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380037+0000", 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114636 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380241+0000", 2024-04-24T13:32:17.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020442600000000001 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.380491+0000", 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025015399999999999 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382273+0000", 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017822179999999999 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382656+0000", 2024-04-24T13:32:17.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038245400000000001 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382746+0000", 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0409999999999997e-05 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:29.382867+0000", 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012037299999999999 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.397174808, 2024-04-24T13:32:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:32:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:32:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.713 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:32:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:32:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:32:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:32:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:32:17.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:32:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:32:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:32:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:32:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:32:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:32:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.373378836, 2024-04-24T13:32:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:32:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.719 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:32:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:32:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:32:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:32:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:32:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:32:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:32:17.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:32:17.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:32:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.346683716, 2024-04-24T13:32:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:32:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.725 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:32:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:32:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:32:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:32:17.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:32:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:32:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:32:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:32:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:32:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:32:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:32:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:32:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:32:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:32:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:32:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:32:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:32:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:32:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:224 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:32:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.32894179500001, 2024-04-24T13:32:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032308200000000001, 2024-04-24T13:32:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 224 2024-04-24T13:32:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.732 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:32:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355842+0000", 2024-04-24T13:32:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355845+0000", 2024-04-24T13:32:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.39e-06 2024-04-24T13:32:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355857+0000", 2024-04-24T13:32:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1942e-05 2024-04-24T13:32:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355888+0000", 2024-04-24T13:32:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1112999999999998e-05 2024-04-24T13:32:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.355910+0000", 2024-04-24T13:32:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1889e-05 2024-04-24T13:32:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356049+0000", 2024-04-24T13:32:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013979899999999999 2024-04-24T13:32:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356277+0000", 2024-04-24T13:32:17.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000227159 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.356699+0000", 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042228699999999998 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358049+0000", 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001350134 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.358927+0000", 2024-04-24T13:32:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00087768899999999996 2024-04-24T13:32:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359010+0000", 2024-04-24T13:32:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2882999999999999e-05 2024-04-24T13:32:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.359073+0000", 2024-04-24T13:32:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3534999999999994e-05 2024-04-24T13:32:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.737 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:233 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:32:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.295771587, 2024-04-24T13:32:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030698219999999998, 2024-04-24T13:32:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.738 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 233 2024-04-24T13:32:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:32:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389012+0000", 2024-04-24T13:32:17.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389015+0000", 2024-04-24T13:32:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3300000000000001e-06 2024-04-24T13:32:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389027+0000", 2024-04-24T13:32:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1809e-05 2024-04-24T13:32:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389058+0000", 2024-04-24T13:32:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1814999999999999e-05 2024-04-24T13:32:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389073+0000", 2024-04-24T13:32:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4797000000000001e-05 2024-04-24T13:32:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389187+0000", 2024-04-24T13:32:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113263 2024-04-24T13:32:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389405+0000", 2024-04-24T13:32:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021810300000000001 2024-04-24T13:32:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.389823+0000", 2024-04-24T13:32:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00041814700000000001 2024-04-24T13:32:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391214+0000", 2024-04-24T13:32:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013909759999999999 2024-04-24T13:32:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.391916+0000", 2024-04-24T13:32:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070236099999999998 2024-04-24T13:32:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392016+0000", 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9759999999999994e-05 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.392082+0000", 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6460999999999999e-05 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.744 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:391 6.4 6:25ca39bb:::obj_delete_at_hint.0000000005:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.24773938, 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00295342, 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 391 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:32:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437045+0000", 2024-04-24T13:32:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437046+0000", 2024-04-24T13:32:17.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437052+0000", 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8819999999999998e-06 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437063+0000", 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1113e-05 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437071+0000", 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0320000000000003e-06 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437118+0000", 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7048000000000001e-05 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437166+0000", 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7988999999999997e-05 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437286+0000", 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120006 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.437832+0000", 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054604600000000001 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439884+0000", 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020526390000000002 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439952+0000", 2024-04-24T13:32:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7047999999999999e-05 2024-04-24T13:32:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.439998+0000", 2024-04-24T13:32:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6587e-05 2024-04-24T13:32:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.750 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.22149172500001, 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:32:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:32:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:32:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:32:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:32:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:32:17.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:32:17.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.16210932200001, 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:32:17.756 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:32:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:32:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:32:17.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:32:17.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:32:17.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.762 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.762 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:582 6.1d 6:bbf2d10c:::obj_delete_at_hint.0000000025:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.762 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:32:17.762 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.113642215, 2024-04-24T13:32:17.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028323749999999998, 2024-04-24T13:32:17.762 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.762 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 582 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571142+0000", 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571143+0000", 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1629999999999999e-06 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571150+0000", 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4479999999999997e-06 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571167+0000", 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6718000000000002e-05 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571176+0000", 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3299999999999999e-06 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571277+0000", 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101325 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571416+0000", 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013946100000000001 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.571643+0000", 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000226973 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.572634+0000", 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00099098000000000003 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573868+0000", 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233266 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573932+0000", 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3979999999999994e-05 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.573974+0000", 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2731000000000001e-05 2024-04-24T13:32:17.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:832 6.1 6:80d23011:::obj_delete_at_hint.0000000085:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.72795164199999, 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030480429999999998, 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 832 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956832+0000", 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956835+0000", 2024-04-24T13:32:17.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:17.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956846+0000", 2024-04-24T13:32:17.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1233000000000001e-05 2024-04-24T13:32:17.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956879+0000", 2024-04-24T13:32:17.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2815999999999999e-05 2024-04-24T13:32:17.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.956904+0000", 2024-04-24T13:32:17.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5539000000000001e-05 2024-04-24T13:32:17.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957033+0000", 2024-04-24T13:32:17.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128176 2024-04-24T13:32:17.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957240+0000", 2024-04-24T13:32:17.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020723000000000001 2024-04-24T13:32:17.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:17.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.957560+0000", 2024-04-24T13:32:17.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032045000000000001 2024-04-24T13:32:17.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.958685+0000", 2024-04-24T13:32:17.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001125154 2024-04-24T13:32:17.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959730+0000", 2024-04-24T13:32:17.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001044187 2024-04-24T13:32:17.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959817+0000", 2024-04-24T13:32:17.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7566999999999997e-05 2024-04-24T13:32:17.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.959880+0000", 2024-04-24T13:32:17.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3363999999999998e-05 2024-04-24T13:32:17.777 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.777 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.777 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.777 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:916 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.777 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:32:17.777 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.533863747, 2024-04-24T13:32:17.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029331460000000002, 2024-04-24T13:32:17.777 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.777 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.778 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.778 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.778 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.778 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.778 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 916 2024-04-24T13:32:17.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.778 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:32:17.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150920+0000", 2024-04-24T13:32:17.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150923+0000", 2024-04-24T13:32:17.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2960000000000001e-06 2024-04-24T13:32:17.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150934+0000", 2024-04-24T13:32:17.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.166e-05 2024-04-24T13:32:17.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150966+0000", 2024-04-24T13:32:17.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1399000000000002e-05 2024-04-24T13:32:17.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.150981+0000", 2024-04-24T13:32:17.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5763000000000001e-05 2024-04-24T13:32:17.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151137+0000", 2024-04-24T13:32:17.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155165 2024-04-24T13:32:17.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151368+0000", 2024-04-24T13:32:17.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023127900000000001 2024-04-24T13:32:17.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.151734+0000", 2024-04-24T13:32:17.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036580299999999999 2024-04-24T13:32:17.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.152838+0000", 2024-04-24T13:32:17.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001103962 2024-04-24T13:32:17.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153569+0000", 2024-04-24T13:32:17.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000731531 2024-04-24T13:32:17.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153737+0000", 2024-04-24T13:32:17.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016748500000000001 2024-04-24T13:32:17.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.153853+0000", 2024-04-24T13:32:17.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116803 2024-04-24T13:32:17.787 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.787 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.787 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.788 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:918 6.4 6:258fd845:::obj_delete_at_hint.0000000113:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.788 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:32:17.788 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.529850474, 2024-04-24T13:32:17.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030135040000000002, 2024-04-24T13:32:17.788 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.788 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.789 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.789 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.789 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.789 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 918 2024-04-24T13:32:17.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.789 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:32:17.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154934+0000", 2024-04-24T13:32:17.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154935+0000", 2024-04-24T13:32:17.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.623e-06 2024-04-24T13:32:17.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154944+0000", 2024-04-24T13:32:17.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6600000000000001e-06 2024-04-24T13:32:17.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154964+0000", 2024-04-24T13:32:17.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0599e-05 2024-04-24T13:32:17.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.154978+0000", 2024-04-24T13:32:17.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3043e-05 2024-04-24T13:32:17.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155095+0000", 2024-04-24T13:32:17.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117137 2024-04-24T13:32:17.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155327+0000", 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023242200000000001 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.155826+0000", 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049932500000000001 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157005+0000", 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011782310000000001 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157682+0000", 2024-04-24T13:32:17.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00067687200000000002 2024-04-24T13:32:17.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157838+0000", 2024-04-24T13:32:17.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015685499999999999 2024-04-24T13:32:17.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.157947+0000", 2024-04-24T13:32:17.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108737 2024-04-24T13:32:17.796 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.497797335, 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.797 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.798 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:32:17.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.798 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:17.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:32:17.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:32:17.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:32:17.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:32:17.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:32:17.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:933 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.493253334, 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030417489999999998, 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.803 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 933 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191531+0000", 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191532+0000", 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.733e-06 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191541+0000", 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5229999999999995e-06 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191562+0000", 2024-04-24T13:32:17.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0849e-05 2024-04-24T13:32:17.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191572+0000", 2024-04-24T13:32:17.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0263e-05 2024-04-24T13:32:17.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191744+0000", 2024-04-24T13:32:17.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017177499999999999 2024-04-24T13:32:17.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.191968+0000", 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000223666 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.192431+0000", 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046376300000000001 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.193661+0000", 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012297950000000001 2024-04-24T13:32:17.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194304+0000", 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00064312799999999997 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194459+0000", 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154575 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.194572+0000", 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011367899999999999 2024-04-24T13:32:17.808 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:948 6.1d 6:bca2c1f2:::obj_delete_at_hint.0000000123:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 104.460102327, 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029262300000000002, 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:17.809 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:17.810 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 948 2024-04-24T13:32:17.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.810 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:17.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:17.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:32:17.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:17.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224682+0000", 2024-04-24T13:32:17.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224684+0000", 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.747e-06 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224692+0000", 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9500000000000007e-06 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224715+0000", 2024-04-24T13:32:17.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2356000000000001e-05 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224733+0000", 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8320000000000001e-05 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224835+0000", 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102233 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:17.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.224970+0000", 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134499 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.225242+0000", 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027180800000000001 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.226447+0000", 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001205687 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:17.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227421+0000", 2024-04-24T13:32:17.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097401599999999997 2024-04-24T13:32:17.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:17.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227548+0000", 2024-04-24T13:32:17.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012656599999999999 2024-04-24T13:32:17.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:17.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:17.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:17.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.227608+0000", 2024-04-24T13:32:17.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0047999999999998e-05 2024-04-24T13:32:17.814 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.815 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.815 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.815 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:17.815 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:17.815 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:17.816 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:32:17.817 INFO:tasks.workunit.client.0.smithi071.stdout:Bucket Created: buck_2024_03_24_13_32_17 2024-04-24T13:32:17.817 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:17.814+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:17.917 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:17.914+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:17.979 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:17.979 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:17.979 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:17.979 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:17.993 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:32:18.008 INFO:tasks.workunit.client.0.smithi071.stdout:bucket quota max_objs set for the given user: buck_2024_03_24_13_32_17 2024-04-24T13:32:18.017 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:18.014+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:18.110 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:18.111 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:18.111 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:18.111 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:18.111 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:18.118 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:18.118+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:18.125 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:32:18.218 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:18.216+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:18.255 INFO:tasks.workunit.client.0.smithi071.stdout:quota enabled for the bucket: buck_2024_03_24_13_32_17 2024-04-24T13:32:18.255 INFO:tasks.workunit.client.0.smithi071.stdout:adding file to bucket: 10Mb. 2024-04-24T13:32:18.255 INFO:tasks.workunit.client.0.smithi071.stdout:upload file successful 2024-04-24T13:32:18.287 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.886840096, 2024-04-24T13:32:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:32:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:32:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:32:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:32:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:32:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:32:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.871056338, 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:32:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:32:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:32:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:32:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:32:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:32:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:32:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:32:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:32:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:32:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.427783546, 2024-04-24T13:32:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:32:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:32:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:32:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:32:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:32:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:32:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:32:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:32:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:32:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:32:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.364440028, 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:32:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:32:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:32:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:32:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:32:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.359764333, 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:32:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:32:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:32:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:32:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:32:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:32:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:32:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.303719602, 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:32:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:32:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:32:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:32:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:32:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:32:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.29397356699999, 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:32:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:32:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:849 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.28942675499999, 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002954763, 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 849 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996858+0000", 2024-04-24T13:32:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996861+0000", 2024-04-24T13:32:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2069999999999998e-06 2024-04-24T13:32:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996871+0000", 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0753e-05 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996903+0000", 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2008999999999998e-05 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.996922+0000", 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8595999999999999e-05 2024-04-24T13:32:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997042+0000", 2024-04-24T13:32:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119646 2024-04-24T13:32:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997271+0000", 2024-04-24T13:32:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000228963 2024-04-24T13:32:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.997736+0000", 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000465181 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999022+0000", 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012864829999999999 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999529+0000", 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050722400000000002 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999697+0000", 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016795499999999999 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.999813+0000", 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115746 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:907 6.14 6:2ece19cb:::obj_delete_at_hint.0000000110:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.155964234, 2024-04-24T13:32:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003049946, 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 907 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130321+0000", 2024-04-24T13:32:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130323+0000", 2024-04-24T13:32:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5859999999999999e-06 2024-04-24T13:32:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130336+0000", 2024-04-24T13:32:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.218e-05 2024-04-24T13:32:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130367+0000", 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1665000000000003e-05 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130382+0000", 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5113000000000001e-05 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130510+0000", 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012778999999999999 2024-04-24T13:32:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.130749+0000", 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000238669 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.131082+0000", 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00033360300000000002 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.132266+0000", 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001183627 2024-04-24T13:32:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133172+0000", 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00090542200000000002 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133259+0000", 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.133371+0000", 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011194 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.054343413, 2024-04-24T13:32:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:32:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:32:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:32:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:32:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:32:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:32:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:955 6.f 6:f2c84a15:::obj_delete_at_hint.0000000126:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 105.044143629, 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030452859999999999, 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 955 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242141+0000", 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242144+0000", 2024-04-24T13:32:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2500000000000001e-06 2024-04-24T13:32:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242155+0000", 2024-04-24T13:32:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1779e-05 2024-04-24T13:32:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242186+0000", 2024-04-24T13:32:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0879e-05 2024-04-24T13:32:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242202+0000", 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5566e-05 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242338+0000", 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013631299999999999 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.242700+0000", 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036144900000000002 2024-04-24T13:32:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.243261+0000", 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056143600000000001 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.244736+0000", 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001475248 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245034+0000", 2024-04-24T13:32:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029792099999999998 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245119+0000", 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4876999999999994e-05 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.245187+0000", 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7568000000000001e-05 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5087.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94838597716400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.477320+0000", 2024-04-24T13:32:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.80896542999999999, 2024-04-24T13:32:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053295189999999996, 2024-04-24T13:32:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5087", 2024-04-24T13:32:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1617668435", 2024-04-24T13:32:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 100 2024-04-24T13:32:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477320+0000", 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477320+0000", 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477321+0000", 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4890000000000001e-06 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477325+0000", 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1919999999999998e-06 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477340+0000", 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4793e-05 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477356+0000", 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477402+0000", 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5868999999999997e-05 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477459+0000", 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7058999999999997e-05 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477540+0000", 2024-04-24T13:32:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0446999999999997e-05 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.480172+0000", 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026327479999999999 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.482561+0000", 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023886749999999998 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.482601+0000", 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0051e-05 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.482649+0000", 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8031000000000001e-05 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1569 4.32 4:4d570018:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.3.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.556835+0000", 2024-04-24T13:32:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.729450025, 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039046649999999999, 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1569 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556835+0000", 2024-04-24T13:32:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556835+0000", 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556837+0000", 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.902e-06 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556843+0000", 2024-04-24T13:32:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3990000000000001e-06 2024-04-24T13:32:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556871+0000", 2024-04-24T13:32:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8044000000000001e-05 2024-04-24T13:32:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556880+0000", 2024-04-24T13:32:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2190000000000004e-06 2024-04-24T13:32:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556936+0000", 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6060000000000002e-05 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.557016+0000", 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0029000000000002e-05 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.557118+0000", 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102768 2024-04-24T13:32:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.558207+0000", 2024-04-24T13:32:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010886279999999999 2024-04-24T13:32:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.560675+0000", 2024-04-24T13:32:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024681249999999998 2024-04-24T13:32:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.560706+0000", 2024-04-24T13:32:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1195999999999997e-05 2024-04-24T13:32:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.560740+0000", 2024-04-24T13:32:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3294999999999999e-05 2024-04-24T13:32:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.5111.0:56 7.14 e82/28 7:2b04a3e9:::notify.6:head v 82'42, mlcod=81'40)", 2024-04-24T13:32:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.691653+0000", 2024-04-24T13:32:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.59463236100000005, 2024-04-24T13:32:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044709930000000004, 2024-04-24T13:32:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691653+0000", 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691653+0000", 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691653+0000", 2024-04-24T13:32:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1799999999999999e-07 2024-04-24T13:32:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691655+0000", 2024-04-24T13:32:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4260000000000002e-06 2024-04-24T13:32:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691660+0000", 2024-04-24T13:32:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0030000000000002e-06 2024-04-24T13:32:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691664+0000", 2024-04-24T13:32:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6200000000000001e-06 2024-04-24T13:32:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691739+0000", 2024-04-24T13:32:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5288000000000002e-05 2024-04-24T13:32:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691759+0000", 2024-04-24T13:32:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0072e-05 2024-04-24T13:32:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696079+0000", 2024-04-24T13:32:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043192509999999996 2024-04-24T13:32:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696124+0000", 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5114999999999997e-05 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1589 4.32 4:4e593490:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733643+0000", 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.55264247399999999, 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042263659999999996, 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1589 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733643+0000", 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733643+0000", 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733645+0000", 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.193e-06 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733654+0000", 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0110000000000006e-06 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733674+0000", 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0208e-05 2024-04-24T13:32:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733684+0000", 2024-04-24T13:32:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6509999999999996e-06 2024-04-24T13:32:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733767+0000", 2024-04-24T13:32:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3413999999999998e-05 2024-04-24T13:32:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733894+0000", 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012658999999999999 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734043+0000", 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014896000000000001 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.735108+0000", 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010658530000000001 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737752+0000", 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026430749999999999 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737832+0000", 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0039999999999999e-05 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737869+0000", 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7370999999999998e-05 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1590 4.0 4:0175f652:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733724+0000", 2024-04-24T13:32:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.55256070099999999, 2024-04-24T13:32:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004720414, 2024-04-24T13:32:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.374 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1590 2024-04-24T13:32:18.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.374 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733724+0000", 2024-04-24T13:32:18.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733724+0000", 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733725+0000", 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.99e-07 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733730+0000", 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6569999999999996e-06 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733739+0000", 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2129999999999997e-06 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733745+0000", 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.46e-06 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733982+0000", 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023672299999999999 2024-04-24T13:32:18.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734092+0000", 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010942000000000001 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734222+0000", 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013054599999999999 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.735192+0000", 2024-04-24T13:32:18.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00096959800000000001 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738379+0000", 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003187133 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738407+0000", 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8218e-05 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738445+0000", 2024-04-24T13:32:18.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7747000000000003e-05 2024-04-24T13:32:18.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.379 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1591 4.34 4:2f8daf8d:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:18.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733763+0000", 2024-04-24T13:32:18.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.55252237199999998, 2024-04-24T13:32:18.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041142720000000004, 2024-04-24T13:32:18.379 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.379 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1591 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733763+0000", 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733763+0000", 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733763+0000", 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9800000000000004e-07 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733768+0000", 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9529999999999998e-06 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733775+0000", 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7569999999999998e-06 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733780+0000", 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3619999999999997e-06 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733836+0000", 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5291000000000003e-05 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733953+0000", 2024-04-24T13:32:18.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117404 2024-04-24T13:32:18.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:18.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734093+0000", 2024-04-24T13:32:18.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139896 2024-04-24T13:32:18.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.735096+0000", 2024-04-24T13:32:18.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010028859999999999 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737810+0000", 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002713956 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737842+0000", 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2288e-05 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737877+0000", 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4981000000000003e-05 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1584 4.4 e82/22 4:22d8a9f0:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.2:head v 82'1, mlcod=0'0)", 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.734672+0000", 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.55161259699999998, 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003155649, 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.385 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734672+0000", 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734672+0000", 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734673+0000", 2024-04-24T13:32:18.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-04-24T13:32:18.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734679+0000", 2024-04-24T13:32:18.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4199999999999998e-06 2024-04-24T13:32:18.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734689+0000", 2024-04-24T13:32:18.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0553e-05 2024-04-24T13:32:18.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734696+0000", 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7769999999999997e-06 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734767+0000", 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0747999999999994e-05 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734783+0000", 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6073e-05 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737789+0000", 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030059209999999999 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737828+0000", 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9286999999999998e-05 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.389 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5165.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94314959539792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.105440+0000", 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.18084535400000001, 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003116597, 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5165", 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/3607738460", 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 51 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105440+0000", 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105440+0000", 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105440+0000", 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8199999999999999e-07 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105444+0000", 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3100000000000001e-06 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105453+0000", 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7599999999999997e-06 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105459+0000", 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2700000000000004e-06 2024-04-24T13:32:18.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105501+0000", 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1978999999999999e-05 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105557+0000", 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6645999999999999e-05 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105638+0000", 2024-04-24T13:32:18.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0889000000000004e-05 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.106382+0000", 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074407800000000001 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.108438+0000", 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020552919999999998 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.108490+0000", 2024-04-24T13:32:18.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2784000000000001e-05 2024-04-24T13:32:18.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.108556+0000", 2024-04-24T13:32:18.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5907000000000004e-05 2024-04-24T13:32:18.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.395 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.395 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.5165.0:56 7.14 e82/28 7:2b04a3e9:::notify.6:head v 82'51, mlcod=82'49)", 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.110473+0000", 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.17581258699999999, 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047884579999999998, 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110473+0000", 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110473+0000", 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110473+0000", 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110478+0000", 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2920000000000003e-06 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:18.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110486+0000", 2024-04-24T13:32:18.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3509999999999996e-06 2024-04-24T13:32:18.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:18.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110492+0000", 2024-04-24T13:32:18.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0769999999999996e-06 2024-04-24T13:32:18.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:18.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110566+0000", 2024-04-24T13:32:18.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3937999999999996e-05 2024-04-24T13:32:18.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110584+0000", 2024-04-24T13:32:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8666000000000001e-05 2024-04-24T13:32:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115219+0000", 2024-04-24T13:32:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046345730000000003 2024-04-24T13:32:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:18.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115261+0000", 2024-04-24T13:32:18.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2190000000000001e-05 2024-04-24T13:32:18.400 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.400 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.400 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.400 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:18.400 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:18.400 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:18.402 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:18.402 INFO:tasks.workunit.client.0.smithi071.stderr:1+0 records in 2024-04-24T13:32:18.402 INFO:tasks.workunit.client.0.smithi071.stderr:1+0 records out 2024-04-24T13:32:18.402 INFO:tasks.workunit.client.0.smithi071.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0640884 s, 164 MB/s 2024-04-24T13:32:18.403 INFO:tasks.workunit.client.0.smithi071.stdout:readding file to bucket: 10MBfile1 2024-04-24T13:32:18.403 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:18.403 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - set max objects for a given user and test beyond max objects passed 2024-04-24T13:32:18.403 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:18.403 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:18.398+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:18.502 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:18.500+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:18.560 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:18.560 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:18.560 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:18.560 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:18.574 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:18.604 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:18.602+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:18.904 INFO:tasks.workunit.client.0.smithi071.stdout:user qa_user deleted 2024-04-24T13:32:18.904 INFO:tasks.workunit.client.0.smithi071.stdout:bucket delete succeeded 2024-04-24T13:32:18.904 INFO:tasks.workunit.client.0.smithi071.stdout:Bucket Created: buck_2024_03_24_13_32_18 2024-04-24T13:32:18.905 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:18.900+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:18.954 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:18.955 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_24_13_32_18 with max size as zero 2024-04-24T13:32:18.955 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:18.955 INFO:tasks.workunit.client.0.smithi071.stdout:bucket delete succeeded 2024-04-24T13:32:19.003 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:19.000+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:19.017 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:19.017 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:19.017 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:19.017 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:19.017 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:19.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:19.105 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:19.102+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:19.106 INFO:tasks.workunit.client.0.smithi071.stdout:Bucket Created: buck_2024_03_24_13_32_19 2024-04-24T13:32:19.194 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:32:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 111.945658204, 2024-04-24T13:32:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057346300000000001, 2024-04-24T13:32:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247277+0000", 2024-04-24T13:32:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3459999999999998e-06 2024-04-24T13:32:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247344+0000", 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6768999999999997e-05 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247379+0000", 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4573999999999998e-05 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247402+0000", 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3303e-05 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247599+0000", 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019720499999999999 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247622+0000", 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2512999999999999e-05 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.252825+0000", 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052035270000000003 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.253009+0000", 2024-04-24T13:32:19.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018339300000000001 2024-04-24T13:32:19.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.199 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.199 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.199 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:19.199 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:19.199 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 106.917015691, 2024-04-24T13:32:19.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:32:19.199 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:32:19.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:32:19.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:32:19.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:32:19.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:32:19.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:32:19.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:32:19.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:32:19.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:19.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:32:19.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:32:19.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:32:19.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:32:19.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:32:19.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.206 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.206 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:19.207 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:19.207 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 106.812061524, 2024-04-24T13:32:19.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040131660000000003, 2024-04-24T13:32:19.207 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.207 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.207 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.207 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.207 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:19.207 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 231 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380873+0000", 2024-04-24T13:32:19.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2400000000000002e-06 2024-04-24T13:32:19.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380884+0000", 2024-04-24T13:32:19.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0645999999999999e-05 2024-04-24T13:32:19.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380919+0000", 2024-04-24T13:32:19.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5026e-05 2024-04-24T13:32:19.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380934+0000", 2024-04-24T13:32:19.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.522e-05 2024-04-24T13:32:19.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381077+0000", 2024-04-24T13:32:19.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014362500000000001 2024-04-24T13:32:19.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381453+0000", 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037581799999999999 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.382170+0000", 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071714999999999995 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.383955+0000", 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017847710000000001 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384619+0000", 2024-04-24T13:32:19.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066381600000000002 2024-04-24T13:32:19.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384770+0000", 2024-04-24T13:32:19.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015067800000000001 2024-04-24T13:32:19.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384884+0000", 2024-04-24T13:32:19.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114176 2024-04-24T13:32:19.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.213 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.213 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:562 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:19.213 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:19.213 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 106.640098291, 2024-04-24T13:32:19.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048608870000000004, 2024-04-24T13:32:19.213 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.213 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 562 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:19.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552837+0000", 2024-04-24T13:32:19.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8499999999999998e-06 2024-04-24T13:32:19.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552852+0000", 2024-04-24T13:32:19.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4866e-05 2024-04-24T13:32:19.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552890+0000", 2024-04-24T13:32:19.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8166e-05 2024-04-24T13:32:19.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552905+0000", 2024-04-24T13:32:19.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5255e-05 2024-04-24T13:32:19.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553053+0000", 2024-04-24T13:32:19.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014824599999999999 2024-04-24T13:32:19.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553425+0000", 2024-04-24T13:32:19.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000371512 2024-04-24T13:32:19.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:19.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553969+0000", 2024-04-24T13:32:19.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054421500000000002 2024-04-24T13:32:19.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.554987+0000", 2024-04-24T13:32:19.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001017855 2024-04-24T13:32:19.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557606+0000", 2024-04-24T13:32:19.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026195839999999999 2024-04-24T13:32:19.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557655+0000", 2024-04-24T13:32:19.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8575000000000002e-05 2024-04-24T13:32:19.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557695+0000", 2024-04-24T13:32:19.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9762999999999999e-05 2024-04-24T13:32:19.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.219 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.219 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.219 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 106.221989996, 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034937589999999999, 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 838 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970944+0000", 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3360000000000002e-06 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970959+0000", 2024-04-24T13:32:19.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.469e-05 2024-04-24T13:32:19.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970989+0000", 2024-04-24T13:32:19.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0159e-05 2024-04-24T13:32:19.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971004+0000", 2024-04-24T13:32:19.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971147+0000", 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014242500000000001 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971514+0000", 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036720900000000001 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.972113+0000", 2024-04-24T13:32:19.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00059902100000000004 2024-04-24T13:32:19.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.973403+0000", 2024-04-24T13:32:19.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012904189999999999 2024-04-24T13:32:19.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974152+0000", 2024-04-24T13:32:19.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074879600000000003 2024-04-24T13:32:19.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974316+0000", 2024-04-24T13:32:19.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164308 2024-04-24T13:32:19.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974436+0000", 2024-04-24T13:32:19.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119453 2024-04-24T13:32:19.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.225 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.226 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1182 4.16 e81/22 4:6b47d35a:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.1.10:head v 81'1, mlcod=0'0)", 2024-04-24T13:32:19.226 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:15.105295+0000", 2024-04-24T13:32:19.226 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.0876375749999996, 2024-04-24T13:32:19.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036488269999999999, 2024-04-24T13:32:19.226 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.226 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.226 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.226 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105295+0000", 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105295+0000", 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105295+0000", 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.91e-07 2024-04-24T13:32:19.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105299+0000", 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3390000000000003e-06 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105309+0000", 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0025e-05 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105318+0000", 2024-04-24T13:32:19.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7779999999999996e-06 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105619+0000", 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030148700000000002 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105636+0000", 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6571000000000001e-05 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.108904+0000", 2024-04-24T13:32:19.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003267739 2024-04-24T13:32:19.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.108943+0000", 2024-04-24T13:32:19.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9597000000000001e-05 2024-04-24T13:32:19.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.230 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.230 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5111.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94137918829056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.691233+0000", 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.501698792, 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050209349999999998, 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5111", 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1624747613", 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 55 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691233+0000", 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691233+0000", 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691235+0000", 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2610000000000001e-06 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691239+0000", 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2139999999999998e-06 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691251+0000", 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1776999999999999e-05 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691257+0000", 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0179999999999998e-06 2024-04-24T13:32:19.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691310+0000", 2024-04-24T13:32:19.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3201000000000001e-05 2024-04-24T13:32:19.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691387+0000", 2024-04-24T13:32:19.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6762999999999997e-05 2024-04-24T13:32:19.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:19.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691537+0000", 2024-04-24T13:32:19.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149958 2024-04-24T13:32:19.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.693654+0000", 2024-04-24T13:32:19.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021170270000000001 2024-04-24T13:32:19.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696131+0000", 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024774179999999999 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696181+0000", 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0046000000000002e-05 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696254+0000", 2024-04-24T13:32:19.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3251999999999996e-05 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5111.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.691278+0000", 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.501653932, 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050104219999999996, 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.237 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5111", 2024-04-24T13:32:19.238 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1624747613", 2024-04-24T13:32:19.238 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 56 2024-04-24T13:32:19.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.238 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691278+0000", 2024-04-24T13:32:19.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691278+0000", 2024-04-24T13:32:19.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691279+0000", 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0200000000000003e-07 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691281+0000", 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691286+0000", 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2100000000000001e-06 2024-04-24T13:32:19.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691289+0000", 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5200000000000002e-06 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691336+0000", 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6771000000000003e-05 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691411+0000", 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4689000000000003e-05 2024-04-24T13:32:19.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:19.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691537+0000", 2024-04-24T13:32:19.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012561899999999999 2024-04-24T13:32:19.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.693529+0000", 2024-04-24T13:32:19.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001992649 2024-04-24T13:32:19.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696226+0000", 2024-04-24T13:32:19.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026964070000000001 2024-04-24T13:32:19.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696265+0000", 2024-04-24T13:32:19.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9477000000000002e-05 2024-04-24T13:32:19.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696289+0000", 2024-04-24T13:32:19.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3558e-05 2024-04-24T13:32:19.243 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.243 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.243 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.243 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1588 4.29 4:950e3da7:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.243 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733711+0000", 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.4592207150000001, 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004339847, 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1588 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733711+0000", 2024-04-24T13:32:19.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733711+0000", 2024-04-24T13:32:19.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733712+0000", 2024-04-24T13:32:19.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4099999999999999e-07 2024-04-24T13:32:19.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733716+0000", 2024-04-24T13:32:19.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6890000000000002e-06 2024-04-24T13:32:19.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733728+0000", 2024-04-24T13:32:19.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2660000000000001e-05 2024-04-24T13:32:19.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733734+0000", 2024-04-24T13:32:19.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8289999999999996e-06 2024-04-24T13:32:19.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733787+0000", 2024-04-24T13:32:19.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2408999999999999e-05 2024-04-24T13:32:19.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733896+0000", 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010933 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734032+0000", 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013609200000000001 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737906+0000", 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038740530000000001 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737971+0000", 2024-04-24T13:32:19.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4941e-05 2024-04-24T13:32:19.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738015+0000", 2024-04-24T13:32:19.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4475999999999999e-05 2024-04-24T13:32:19.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738051+0000", 2024-04-24T13:32:19.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5827000000000001e-05 2024-04-24T13:32:19.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.250 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.250 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1582 4.16 e82/22 4:69bcb5d9:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.0:head v 82'3, mlcod=81'1)", 2024-04-24T13:32:19.250 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.734337+0000", 2024-04-24T13:32:19.250 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.4585947990000001, 2024-04-24T13:32:19.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003588585, 2024-04-24T13:32:19.250 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734337+0000", 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734337+0000", 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734338+0000", 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1519999999999999e-06 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734345+0000", 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4030000000000004e-06 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734356+0000", 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0606e-05 2024-04-24T13:32:19.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734362+0000", 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9580000000000001e-06 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734440+0000", 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7364e-05 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734457+0000", 2024-04-24T13:32:19.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6906e-05 2024-04-24T13:32:19.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737886+0000", 2024-04-24T13:32:19.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034295889999999998 2024-04-24T13:32:19.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737926+0000", 2024-04-24T13:32:19.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9607000000000002e-05 2024-04-24T13:32:19.254 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.254 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.254 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1585 4.2f e82/22 4:f66a130c:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.3:head v 82'3, mlcod=81'1)", 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.734734+0000", 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.4581976509999999, 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034355280000000002, 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734734+0000", 2024-04-24T13:32:19.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734734+0000", 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734735+0000", 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9999999999999997e-07 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734741+0000", 2024-04-24T13:32:19.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4219999999999999e-06 2024-04-24T13:32:19.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734750+0000", 2024-04-24T13:32:19.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7440000000000002e-06 2024-04-24T13:32:19.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734757+0000", 2024-04-24T13:32:19.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.421e-06 2024-04-24T13:32:19.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734834+0000", 2024-04-24T13:32:19.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7739999999999998e-05 2024-04-24T13:32:19.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734852+0000", 2024-04-24T13:32:19.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7776000000000001e-05 2024-04-24T13:32:19.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738133+0000", 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032805220000000001 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738170+0000", 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7302999999999998e-05 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.259 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5165.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.110078+0000", 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0828540790000001, 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053186259999999999, 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5165", 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/3607738460", 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 56 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110078+0000", 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110078+0000", 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110079+0000", 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3900000000000005e-07 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110082+0000", 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4319999999999999e-06 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110090+0000", 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.763e-06 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110096+0000", 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8250000000000001e-06 2024-04-24T13:32:19.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110146+0000", 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0695000000000002e-05 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110227+0000", 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0554000000000002e-05 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110352+0000", 2024-04-24T13:32:19.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012533800000000001 2024-04-24T13:32:19.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.112615+0000", 2024-04-24T13:32:19.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022629880000000001 2024-04-24T13:32:19.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115344+0000", 2024-04-24T13:32:19.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027288899999999999 2024-04-24T13:32:19.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115373+0000", 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8711999999999999e-05 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115397+0000", 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.389e-05 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1706 4.29 4:950e3da7:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.265 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.606016+0000", 2024-04-24T13:32:19.266 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.58691590299999996, 2024-04-24T13:32:19.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004810361, 2024-04-24T13:32:19.266 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.266 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.266 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:19.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.266 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1706 2024-04-24T13:32:19.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.266 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606016+0000", 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606016+0000", 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606017+0000", 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3e-07 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606021+0000", 2024-04-24T13:32:19.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1049999999999997e-06 2024-04-24T13:32:19.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606031+0000", 2024-04-24T13:32:19.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6590000000000002e-06 2024-04-24T13:32:19.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606038+0000", 2024-04-24T13:32:19.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5009999999999998e-06 2024-04-24T13:32:19.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606205+0000", 2024-04-24T13:32:19.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000167188 2024-04-24T13:32:19.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606274+0000", 2024-04-24T13:32:19.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8330999999999993e-05 2024-04-24T13:32:19.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:19.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606368+0000", 2024-04-24T13:32:19.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4747999999999995e-05 2024-04-24T13:32:19.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.607958+0000", 2024-04-24T13:32:19.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001589196 2024-04-24T13:32:19.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610739+0000", 2024-04-24T13:32:19.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00278166 2024-04-24T13:32:19.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610800+0000", 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0653999999999999e-05 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610827+0000", 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6689000000000001e-05 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1719 4.15 4:a9c3e2b3:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.751119+0000", 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.44181314599999999, 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041158660000000001, 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1719 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751119+0000", 2024-04-24T13:32:19.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751119+0000", 2024-04-24T13:32:19.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751121+0000", 2024-04-24T13:32:19.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7600000000000001e-06 2024-04-24T13:32:19.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751129+0000", 2024-04-24T13:32:19.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0770000000000008e-06 2024-04-24T13:32:19.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751147+0000", 2024-04-24T13:32:19.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7858000000000001e-05 2024-04-24T13:32:19.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751156+0000", 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2550000000000003e-06 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751222+0000", 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6340000000000005e-05 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751355+0000", 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013299500000000001 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751494+0000", 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139164 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.752323+0000", 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00082899899999999997 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755169+0000", 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028453380000000002 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755202+0000", 2024-04-24T13:32:19.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3136000000000003e-05 2024-04-24T13:32:19.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755235+0000", 2024-04-24T13:32:19.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2944000000000002e-05 2024-04-24T13:32:19.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.277 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.277 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1720 4.11 4:8aa62082:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.751178+0000", 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.44175414899999998, 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040457669999999996, 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1720 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751178+0000", 2024-04-24T13:32:19.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751178+0000", 2024-04-24T13:32:19.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751179+0000", 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5400000000000001e-07 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751183+0000", 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0459999999999999e-06 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751189+0000", 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5989999999999998e-06 2024-04-24T13:32:19.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751193+0000", 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6440000000000002e-06 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751246+0000", 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3446000000000003e-05 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751325+0000", 2024-04-24T13:32:19.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8586999999999998e-05 2024-04-24T13:32:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751409+0000", 2024-04-24T13:32:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3993999999999996e-05 2024-04-24T13:32:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.752239+0000", 2024-04-24T13:32:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00083003700000000005 2024-04-24T13:32:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755164+0000", 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029250719999999999 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755199+0000", 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5240999999999997e-05 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755224+0000", 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4547000000000001e-05 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.285 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1723 4.15 4:a83fb8d7:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.751205+0000", 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.441726915, 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088490000000004, 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.286 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1723 2024-04-24T13:32:19.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.287 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751205+0000", 2024-04-24T13:32:19.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751205+0000", 2024-04-24T13:32:19.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751206+0000", 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3000000000000001e-07 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751209+0000", 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1549999999999999e-06 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751215+0000", 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1349999999999997e-06 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751220+0000", 2024-04-24T13:32:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.429e-06 2024-04-24T13:32:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751758+0000", 2024-04-24T13:32:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053738899999999999 2024-04-24T13:32:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751902+0000", 2024-04-24T13:32:19.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014389399999999999 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.752074+0000", 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017230300000000001 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.753003+0000", 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092858100000000005 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755268+0000", 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002265553 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755295+0000", 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6726000000000001e-05 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755314+0000", 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9253999999999999e-05 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1812 4.15 4:a9c3e2b3:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.942075+0000", 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.250857312, 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061256640000000003, 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1812 2024-04-24T13:32:19.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942075+0000", 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942075+0000", 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942076+0000", 2024-04-24T13:32:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.11e-06 2024-04-24T13:32:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942082+0000", 2024-04-24T13:32:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3450000000000002e-06 2024-04-24T13:32:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942095+0000", 2024-04-24T13:32:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2585000000000001e-05 2024-04-24T13:32:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942104+0000", 2024-04-24T13:32:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6619999999999994e-06 2024-04-24T13:32:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942172+0000", 2024-04-24T13:32:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8112000000000001e-05 2024-04-24T13:32:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942246+0000", 2024-04-24T13:32:19.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4636999999999997e-05 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942352+0000", 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105474 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943298+0000", 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094645899999999997 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.948150+0000", 2024-04-24T13:32:19.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048519460000000002 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.948179+0000", 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8549000000000001e-05 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.948200+0000", 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1784999999999999e-05 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1813 4.11 4:8aa62082:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.942122+0000", 2024-04-24T13:32:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.25080981099999999, 2024-04-24T13:32:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071059180000000001, 2024-04-24T13:32:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1813 2024-04-24T13:32:19.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942122+0000", 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942122+0000", 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942123+0000", 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4799999999999998e-07 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942126+0000", 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9809999999999999e-06 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942136+0000", 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8549999999999997e-06 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942142+0000", 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1990000000000003e-06 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942187+0000", 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5102999999999998e-05 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942251+0000", 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4324000000000003e-05 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942352+0000", 2024-04-24T13:32:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100412 2024-04-24T13:32:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943198+0000", 2024-04-24T13:32:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000846615 2024-04-24T13:32:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949171+0000", 2024-04-24T13:32:19.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059721519999999997 2024-04-24T13:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949206+0000", 2024-04-24T13:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5706e-05 2024-04-24T13:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949228+0000", 2024-04-24T13:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2022999999999999e-05 2024-04-24T13:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1816 4.15 4:a83fb8d7:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.942155+0000", 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.25077672200000001, 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070975669999999999, 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1816 2024-04-24T13:32:19.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942155+0000", 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942155+0000", 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942156+0000", 2024-04-24T13:32:19.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0500000000000004e-07 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942163+0000", 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9369999999999998e-06 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942170+0000", 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9789999999999996e-06 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942175+0000", 2024-04-24T13:32:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4380000000000003e-06 2024-04-24T13:32:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942863+0000", 2024-04-24T13:32:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00068733800000000001 2024-04-24T13:32:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942945+0000", 2024-04-24T13:32:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083000000000007e-05 2024-04-24T13:32:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943058+0000", 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113206 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.946270+0000", 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032119779999999999 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949191+0000", 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029214190000000002 2024-04-24T13:32:19.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949223+0000", 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1548999999999999e-05 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949253+0000", 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0134999999999999e-05 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.309 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1809 4.1a e82/22 4:5ade8a4f:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.0:head v 82'2, mlcod=0'0)", 2024-04-24T13:32:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.943465+0000", 2024-04-24T13:32:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.24946761000000001, 2024-04-24T13:32:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058673099999999997, 2024-04-24T13:32:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943465+0000", 2024-04-24T13:32:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943465+0000", 2024-04-24T13:32:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943465+0000", 2024-04-24T13:32:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:32:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943477+0000", 2024-04-24T13:32:19.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1591e-05 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943501+0000", 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4396000000000002e-05 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943511+0000", 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5219999999999996e-06 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:19.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943567+0000", 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5813999999999998e-05 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943589+0000", 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2188000000000002e-05 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949307+0000", 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057182079999999998 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:19.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949332+0000", 2024-04-24T13:32:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4813000000000001e-05 2024-04-24T13:32:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:19.314 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:19.314 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:19.316 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:19.316 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:19.316 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_24_13_32_19 with max objects as zero 2024-04-24T13:32:19.316 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:19.316 INFO:tasks.workunit.client.0.smithi071.stdout:bucket delete succeeded 2024-04-24T13:32:19.317 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:19.312+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:19.399 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:32:19.418 INFO:tasks.workunit.client.0.smithi071.stdout:Bucket Created: buck_2024_03_24_13_32_19 2024-04-24T13:32:19.420 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:19.416+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:19.451 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:19.451 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:19.451 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:19.451 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:19.465 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:19.517 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:19.514+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:19.570 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:19.570 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_24_13_32_19 max objects -1 2024-04-24T13:32:19.570 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:19.570 INFO:tasks.workunit.client.0.smithi071.stdout:bucket delete succeeded 2024-04-24T13:32:19.590 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:32:19.592 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:19.592 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:19.592 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:19.592 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:19.592 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:19.606 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:19.635 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:19.632+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:19.714 INFO:tasks.workunit.client.0.smithi071.stdout:Bucket Created: buck_2024_03_24_13_32_19 2024-04-24T13:32:19.718 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:19.716+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:19.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:19.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:19.754 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:19.754 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:19.771 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:19.771 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:19.787 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:32:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 112.556944746, 2024-04-24T13:32:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020457065, 2024-04-24T13:32:19.787 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225903+0000", 2024-04-24T13:32:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7100000000000001e-06 2024-04-24T13:32:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225922+0000", 2024-04-24T13:32:19.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8919999999999998e-05 2024-04-24T13:32:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225960+0000", 2024-04-24T13:32:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7240000000000003e-05 2024-04-24T13:32:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225987+0000", 2024-04-24T13:32:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6919000000000001e-05 2024-04-24T13:32:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226300+0000", 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000313701 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226317+0000", 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6463000000000001e-05 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231091+0000", 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047739169999999999 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231111+0000", 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0605999999999999e-05 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246073+0000", 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014961264 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246357+0000", 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028432499999999999 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.792 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 110.515805099, 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056987720000000004, 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:32:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:32:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267040+0000", 2024-04-24T13:32:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3e-07 2024-04-24T13:32:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267050+0000", 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8560000000000002e-06 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267205+0000", 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520200000000001 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267244+0000", 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8587000000000002e-05 2024-04-24T13:32:19.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267346+0000", 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010223200000000001 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267374+0000", 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8214000000000001e-05 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272631+0000", 2024-04-24T13:32:19.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052563089999999998 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272738+0000", 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107642 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:47 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'2, mlcod=0'0)", 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 110.501894343, 2024-04-24T13:32:19.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052089900000000001, 2024-04-24T13:32:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:32:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:32:19.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280951+0000", 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7199999999999997e-07 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280962+0000", 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1094000000000001e-05 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280981+0000", 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9066e-05 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280999+0000", 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8148e-05 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281144+0000", 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014454999999999999 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281190+0000", 2024-04-24T13:32:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5649000000000003e-05 2024-04-24T13:32:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286063+0000", 2024-04-24T13:32:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048732549999999999 2024-04-24T13:32:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286159+0000", 2024-04-24T13:32:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6355999999999997e-05 2024-04-24T13:32:19.801 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 107.48050646199999, 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010258288000000001, 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.802 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302342+0000", 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6059999999999999e-06 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302357+0000", 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5201999999999999e-05 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302393+0000", 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6386e-05 2024-04-24T13:32:19.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302411+0000", 2024-04-24T13:32:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7864999999999999e-05 2024-04-24T13:32:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302544+0000", 2024-04-24T13:32:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132526 2024-04-24T13:32:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:19.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302554+0000", 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0479000000000001e-05 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309290+0000", 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006735937 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309474+0000", 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000183981 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309873+0000", 2024-04-24T13:32:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000398618 2024-04-24T13:32:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.311131+0000", 2024-04-24T13:32:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012578929999999999 2024-04-24T13:32:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312443+0000", 2024-04-24T13:32:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001312648 2024-04-24T13:32:19.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312535+0000", 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1620999999999996e-05 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312596+0000", 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1525999999999993e-05 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4865.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:14.968824+0000", 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.8140203780000004, 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046556760000000001, 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "started", 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4865", 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/2885481152", 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968824+0000", 2024-04-24T13:32:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968824+0000", 2024-04-24T13:32:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968827+0000", 2024-04-24T13:32:19.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6429999999999999e-06 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968836+0000", 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0229999999999998e-06 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968857+0000", 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1396e-05 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968877+0000", 2024-04-24T13:32:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0103e-05 2024-04-24T13:32:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968977+0000", 2024-04-24T13:32:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9862e-05 2024-04-24T13:32:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968984+0000", 2024-04-24T13:32:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6279999999999999e-06 2024-04-24T13:32:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.973315+0000", 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043312649999999999 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.973388+0000", 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2611e-05 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.973480+0000", 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2145000000000006e-05 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.813 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1586 4.2c 4:37b5a98b:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:17.732999+0000", 2024-04-24T13:32:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.04984601, 2024-04-24T13:32:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042846200000000003, 2024-04-24T13:32:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.814 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1586 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.732999+0000", 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.732999+0000", 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733001+0000", 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2639999999999998e-06 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733029+0000", 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8042e-05 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733060+0000", 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0916e-05 2024-04-24T13:32:19.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733075+0000", 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5163e-05 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733269+0000", 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019399900000000001 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733502+0000", 2024-04-24T13:32:19.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023322100000000001 2024-04-24T13:32:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733902+0000", 2024-04-24T13:32:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000399971 2024-04-24T13:32:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.735670+0000", 2024-04-24T13:32:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017675270000000001 2024-04-24T13:32:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.737133+0000", 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001463223 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.737220+0000", 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6848000000000006e-05 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.737283+0000", 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3446000000000002e-05 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.819 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1615 3.1a 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.5771320719999999, 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020755388999999999, 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.820 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1615 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205715+0000", 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4399999999999999e-06 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211414+0000", 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005699356 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211448+0000", 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4221999999999999e-05 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211466+0000", 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7629999999999999e-05 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211585+0000", 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011937 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211840+0000", 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000254861 2024-04-24T13:32:19.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:19.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.212059+0000", 2024-04-24T13:32:19.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218789 2024-04-24T13:32:19.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:19.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.225826+0000", 2024-04-24T13:32:19.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013767061000000001 2024-04-24T13:32:19.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226295+0000", 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046917399999999999 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226388+0000", 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2190999999999999e-05 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226468+0000", 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0295000000000003e-05 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.825 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1704 4.2c 4:37b5a98b:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.605304+0000", 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.1775402879999999, 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004234888, 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1704 2024-04-24T13:32:19.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605304+0000", 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605304+0000", 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605307+0000", 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3539999999999998e-06 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605317+0000", 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0856000000000001e-05 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605348+0000", 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1019000000000002e-05 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605364+0000", 2024-04-24T13:32:19.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5313000000000001e-05 2024-04-24T13:32:19.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605523+0000", 2024-04-24T13:32:19.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000159111 2024-04-24T13:32:19.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605803+0000", 2024-04-24T13:32:19.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028006299999999999 2024-04-24T13:32:19.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.606142+0000", 2024-04-24T13:32:19.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033936900000000001 2024-04-24T13:32:19.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:19.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.608804+0000", 2024-04-24T13:32:19.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002661362 2024-04-24T13:32:19.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.609383+0000", 2024-04-24T13:32:19.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057949499999999997 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.609468+0000", 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5228000000000005e-05 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.609539+0000", 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0717999999999996e-05 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1716 4.1a 4:5ade8a4f:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750490+0000", 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.0323547209999999, 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084099940000000005, 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1716 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.832 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750490+0000", 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750490+0000", 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750491+0000", 2024-04-24T13:32:19.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5200000000000001e-06 2024-04-24T13:32:19.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750499+0000", 2024-04-24T13:32:19.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0700000000000007e-06 2024-04-24T13:32:19.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750522+0000", 2024-04-24T13:32:19.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2351999999999999e-05 2024-04-24T13:32:19.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.889e-05 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750694+0000", 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015310599999999999 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751002+0000", 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030817699999999997 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751435+0000", 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043325699999999999 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753491+0000", 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00205609 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758630+0000", 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005138531 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758778+0000", 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014789 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758900+0000", 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122111 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1722 4.18 4:1805f73b:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.837 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750693+0000", 2024-04-24T13:32:19.838 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.032151856, 2024-04-24T13:32:19.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088221259999999996, 2024-04-24T13:32:19.838 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.838 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.838 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.838 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.838 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.838 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.838 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1722 2024-04-24T13:32:19.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.838 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750693+0000", 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750693+0000", 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750694+0000", 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2300000000000001e-06 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750702+0000", 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0930000000000003e-06 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750721+0000", 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8980000000000001e-05 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750737+0000", 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5676e-05 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750896+0000", 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015962999999999999 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751255+0000", 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035844199999999999 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751697+0000", 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044219399999999997 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:19.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.754222+0000", 2024-04-24T13:32:19.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025252819999999998 2024-04-24T13:32:19.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759319+0000", 2024-04-24T13:32:19.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050967230000000001 2024-04-24T13:32:19.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759452+0000", 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013312099999999999 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759515+0000", 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2755000000000005e-05 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1725 4.13 4:cb20c8cc:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750779+0000", 2024-04-24T13:32:19.843 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.0320652180000001, 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086438699999999997, 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1725 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750779+0000", 2024-04-24T13:32:19.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750779+0000", 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750781+0000", 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2139999999999999e-06 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750788+0000", 2024-04-24T13:32:19.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0589999999999997e-06 2024-04-24T13:32:19.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750807+0000", 2024-04-24T13:32:19.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9177e-05 2024-04-24T13:32:19.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750901+0000", 2024-04-24T13:32:19.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3955000000000004e-05 2024-04-24T13:32:19.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751102+0000", 2024-04-24T13:32:19.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020087499999999999 2024-04-24T13:32:19.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751417+0000", 2024-04-24T13:32:19.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000315464 2024-04-24T13:32:19.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751796+0000", 2024-04-24T13:32:19.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037914099999999999 2024-04-24T13:32:19.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:19.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753965+0000", 2024-04-24T13:32:19.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021692040000000001 2024-04-24T13:32:19.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759226+0000", 2024-04-24T13:32:19.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052606789999999999 2024-04-24T13:32:19.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759350+0000", 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012385 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759423+0000", 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3251999999999996e-05 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:1721 4.38 e82/22 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head v 82'7, mlcod=82'5)", 2024-04-24T13:32:19.849 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.751818+0000", 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.0310262370000001, 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069060240000000002, 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751818+0000", 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751818+0000", 2024-04-24T13:32:19.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751820+0000", 2024-04-24T13:32:19.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8840000000000001e-06 2024-04-24T13:32:19.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751838+0000", 2024-04-24T13:32:19.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7612999999999999e-05 2024-04-24T13:32:19.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751863+0000", 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4865999999999999e-05 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751883+0000", 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0279e-05 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752339+0000", 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045636100000000002 2024-04-24T13:32:19.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752388+0000", 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8782000000000002e-05 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758630+0000", 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062420879999999998 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758724+0000", 2024-04-24T13:32:19.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4151e-05 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:1724 4.38 e82/22 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head v 82'8, mlcod=82'5)", 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.753466+0000", 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.029378449, 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061231640000000004, 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753466+0000", 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753466+0000", 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753468+0000", 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.57e-06 2024-04-24T13:32:19.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753483+0000", 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5455999999999999e-05 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753509+0000", 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5497e-05 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753525+0000", 2024-04-24T13:32:19.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6175999999999999e-05 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753665+0000", 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014010699999999999 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753717+0000", 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1845000000000003e-05 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759533+0000", 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058163609999999999 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759589+0000", 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6152e-05 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1809 4.1a 4:5ade8a4f:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941431+0000", 2024-04-24T13:32:19.858 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.84141340099999995, 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0076807159999999998, 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1809 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941431+0000", 2024-04-24T13:32:19.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941431+0000", 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941433+0000", 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1900000000000002e-06 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941443+0000", 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8700000000000004e-06 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941472+0000", 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9105e-05 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941487+0000", 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4970000000000001e-05 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941625+0000", 2024-04-24T13:32:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013815400000000001 2024-04-24T13:32:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941786+0000", 2024-04-24T13:32:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016102600000000001 2024-04-24T13:32:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942051+0000", 2024-04-24T13:32:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000264911 2024-04-24T13:32:19.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.943709+0000", 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016574409999999999 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948959+0000", 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052507129999999997 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949050+0000", 2024-04-24T13:32:19.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0760999999999994e-05 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949112+0000", 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1575000000000006e-05 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1811 4.35 4:ac3d4c50:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941523+0000", 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.841321557, 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059788640000000004, 2024-04-24T13:32:19.864 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1811 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941523+0000", 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941523+0000", 2024-04-24T13:32:19.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941524+0000", 2024-04-24T13:32:19.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:32:19.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941529+0000", 2024-04-24T13:32:19.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8369999999999996e-06 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941541+0000", 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2303000000000001e-05 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941577+0000", 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5685999999999997e-05 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941729+0000", 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015242000000000001 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941939+0000", 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000209805 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942217+0000", 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027807100000000001 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.945849+0000", 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036323509999999998 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947240+0000", 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001390397 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947382+0000", 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014174700000000001 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947502+0000", 2024-04-24T13:32:19.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120217 2024-04-24T13:32:19.870 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.870 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.870 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.870 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1815 4.18 4:1805f73b:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.870 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941634+0000", 2024-04-24T13:32:19.870 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.84121061900000005, 2024-04-24T13:32:19.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072440860000000003, 2024-04-24T13:32:19.870 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1815 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941634+0000", 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941634+0000", 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941636+0000", 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.624e-06 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941643+0000", 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6720000000000004e-06 2024-04-24T13:32:19.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941672+0000", 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9139999999999999e-05 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941688+0000", 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.594e-05 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941814+0000", 2024-04-24T13:32:19.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126017 2024-04-24T13:32:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942001+0000", 2024-04-24T13:32:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018702899999999999 2024-04-24T13:32:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942249+0000", 2024-04-24T13:32:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024771400000000001 2024-04-24T13:32:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947111+0000", 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048622520000000001 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948617+0000", 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015059400000000001 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948766+0000", 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148744 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948878+0000", 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112014 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1818 4.13 4:cb20c8cc:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941727+0000", 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.84111721699999997, 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071492509999999997, 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.876 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1818 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941727+0000", 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941727+0000", 2024-04-24T13:32:19.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941729+0000", 2024-04-24T13:32:19.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.513e-06 2024-04-24T13:32:19.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941735+0000", 2024-04-24T13:32:19.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4529999999999999e-06 2024-04-24T13:32:19.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941755+0000", 2024-04-24T13:32:19.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9836000000000001e-05 2024-04-24T13:32:19.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941835+0000", 2024-04-24T13:32:19.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9437999999999994e-05 2024-04-24T13:32:19.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941970+0000", 2024-04-24T13:32:19.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013506100000000001 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942162+0000", 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192342 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942464+0000", 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030173400000000001 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:19.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947169+0000", 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047049800000000001 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948661+0000", 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014922780000000001 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948776+0000", 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115165 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948877+0000", 2024-04-24T13:32:19.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100451 2024-04-24T13:32:19.882 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.882 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.882 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.882 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:1814 4.38 e82/22 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head v 82'9, mlcod=82'7)", 2024-04-24T13:32:19.882 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.942444+0000", 2024-04-24T13:32:19.882 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.84040006300000003, 2024-04-24T13:32:19.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048299049999999998, 2024-04-24T13:32:19.882 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.882 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.882 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942444+0000", 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942444+0000", 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942446+0000", 2024-04-24T13:32:19.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3829999999999999e-06 2024-04-24T13:32:19.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942483+0000", 2024-04-24T13:32:19.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7299000000000003e-05 2024-04-24T13:32:19.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942507+0000", 2024-04-24T13:32:19.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4110000000000001e-05 2024-04-24T13:32:19.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942552+0000", 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4702e-05 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942774+0000", 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022156199999999999 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942827+0000", 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3341999999999999e-05 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947190+0000", 2024-04-24T13:32:19.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043633150000000004 2024-04-24T13:32:19.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947274+0000", 2024-04-24T13:32:19.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4191999999999996e-05 2024-04-24T13:32:19.886 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.886 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.886 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1829 4.30 4:0ff29942:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.6.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:19.089328+0000", 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.69351665100000004, 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045862450000000001, 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1829 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089328+0000", 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089328+0000", 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089330+0000", 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2469999999999998e-06 2024-04-24T13:32:19.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089342+0000", 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1463e-05 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089376+0000", 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199000000000002e-05 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089402+0000", 2024-04-24T13:32:19.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6570000000000001e-05 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089566+0000", 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000163256 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089877+0000", 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031148800000000001 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:19.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.090270+0000", 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039329799999999999 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.092133+0000", 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018626210000000001 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.093713+0000", 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001579851 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.093792+0000", 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8807999999999995e-05 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.093914+0000", 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012244400000000001 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1922 4.30 4:0ff29942:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.6.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:19.273806+0000", 2024-04-24T13:32:19.892 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.50903837399999996, 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043024910000000003, 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1922 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273806+0000", 2024-04-24T13:32:19.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273806+0000", 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273808+0000", 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1100000000000001e-06 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:19.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273818+0000", 2024-04-24T13:32:19.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8640000000000008e-06 2024-04-24T13:32:19.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:19.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273849+0000", 2024-04-24T13:32:19.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0632000000000001e-05 2024-04-24T13:32:19.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:19.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273866+0000", 2024-04-24T13:32:19.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7703e-05 2024-04-24T13:32:19.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:19.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.275434+0000", 2024-04-24T13:32:19.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015677410000000001 2024-04-24T13:32:19.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:19.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.275663+0000", 2024-04-24T13:32:19.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022848899999999999 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.275963+0000", 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030008699999999999 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.277429+0000", 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014665360000000001 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.277879+0000", 2024-04-24T13:32:19.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044962399999999998 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.278010+0000", 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013137700000000001 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.278109+0000", 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8327999999999998e-05 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.900 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:19.901 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:19.901 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:19.902 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:19.902 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:19.903 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:19.903 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:19.903 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:19.904 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:19.902+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:19.904 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:19.904 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:19.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:19.905 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:19.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:19.905 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:19.906 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:19.906 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - quota set for the bucket: buck_2024_03_24_13_32_19 with max size -1 2024-04-24T13:32:19.906 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:19.906 INFO:tasks.workunit.client.0.smithi071.stdout:bucket delete succeeded 2024-04-24T13:32:20.003 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:20.002+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:20.077 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:20.077 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:20.091 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:20.135 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:20.134+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:20.204 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:20.200+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:20.251 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:20.251 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:20.266 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:20.305 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:20.300+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:20.373 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:32:20.389 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:20.390 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:20.404 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:20.442 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:20.440+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:20.509 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:20.506+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:20.527 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:20.527 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:20.541 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:20.609 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:20.604+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:20.710 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:20.706+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:20.713 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:20.714 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:20.727 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:20.810 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:20.808+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:20.887 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:20.887 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:20.901 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:20.946 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:20.946+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:21.012 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:21.008+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:21.020 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:21.020 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:21.034 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:32:21.113 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:21.108+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:21.172 INFO:tasks.workunit.client.0.smithi071.stderr:200+0 records in 2024-04-24T13:32:21.173 INFO:tasks.workunit.client.0.smithi071.stderr:200+0 records out 2024-04-24T13:32:21.173 INFO:tasks.workunit.client.0.smithi071.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 1.28698 s, 1.6 GB/s 2024-04-24T13:32:21.196 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:21.196 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:21.210 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:32:21.213 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:21.208+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:21.314 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:21.308+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:21.318 INFO:tasks.workunit.client.0.smithi071.stdout:Bucket Created: buck_2024_03_24_13_32_21 2024-04-24T13:32:21.342 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:21.343 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:21.357 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:32:21.415 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:21.412+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:21.447 INFO:tasks.workunit.client.0.smithi071.stdout:quota set for the bucket: buck_2024_03_24_13_32_21 2024-04-24T13:32:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:21.477 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:21.493 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:32:21.535 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:21.532+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:21.618 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:21.614+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:21.644 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:21.645 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:21.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:32:21.718 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:21.712+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:21.780 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:21.780 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:21.793 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:32:21.819 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:21.818+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:21.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:32:21.946 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:21.946 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:21.946 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:21.940+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:21.959 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:32:22.021 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:22.018+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:22.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:22.039 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:22.069 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:22.069 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:22.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:22.086 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:22.103 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:22.104 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:22.114 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:22.114 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:22.114 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:22.122 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:22.118+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:22.126 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:32:22.136 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:22.137 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:22.157 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:22.157 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:22.190 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:22.190 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:22.222 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:22.220+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:22.223 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:22.223 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:22.246 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.246 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 117.027925971, 2024-04-24T13:32:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:32:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:32:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:32:22.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:32:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:32:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:32:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:32:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:32:22.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:32:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:32:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:32:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:32:22.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:32:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:32:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:32:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:32:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:32:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:32:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:32:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:32:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:32:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.252 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:40 5.12 5:48b58d5a:::zonegroup_info.9a8bb09e-6b67-43c4-8d16-00ec507c7c71:head [create,call version.set in=10b,writefull 0~436] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 116.968149751, 2024-04-24T13:32:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003387312, 2024-04-24T13:32:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.253 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:32:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 40 2024-04-24T13:32:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276481+0000", 2024-04-24T13:32:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276482+0000", 2024-04-24T13:32:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.548e-06 2024-04-24T13:32:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276491+0000", 2024-04-24T13:32:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8030000000000003e-06 2024-04-24T13:32:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276511+0000", 2024-04-24T13:32:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9904000000000001e-05 2024-04-24T13:32:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276524+0000", 2024-04-24T13:32:22.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3438000000000001e-05 2024-04-24T13:32:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.276672+0000", 2024-04-24T13:32:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014756099999999999 2024-04-24T13:32:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277023+0000", 2024-04-24T13:32:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035090099999999998 2024-04-24T13:32:22.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.277451+0000", 2024-04-24T13:32:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042787599999999999 2024-04-24T13:32:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279066+0000", 2024-04-24T13:32:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001615025 2024-04-24T13:32:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279705+0000", 2024-04-24T13:32:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00063978799999999997 2024-04-24T13:32:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279803+0000", 2024-04-24T13:32:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7578999999999995e-05 2024-04-24T13:32:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.279868+0000", 2024-04-24T13:32:22.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4888999999999995e-05 2024-04-24T13:32:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:208 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.957021066, 2024-04-24T13:32:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004202534, 2024-04-24T13:32:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.260 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 208 2024-04-24T13:32:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287609+0000", 2024-04-24T13:32:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287612+0000", 2024-04-24T13:32:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8159999999999998e-06 2024-04-24T13:32:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287626+0000", 2024-04-24T13:32:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.344e-05 2024-04-24T13:32:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287658+0000", 2024-04-24T13:32:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2212000000000003e-05 2024-04-24T13:32:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287697+0000", 2024-04-24T13:32:22.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9462000000000003e-05 2024-04-24T13:32:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287857+0000", 2024-04-24T13:32:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015938500000000001 2024-04-24T13:32:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288101+0000", 2024-04-24T13:32:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024403599999999999 2024-04-24T13:32:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.288571+0000", 2024-04-24T13:32:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047070499999999997 2024-04-24T13:32:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.290007+0000", 2024-04-24T13:32:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014355380000000001 2024-04-24T13:32:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291630+0000", 2024-04-24T13:32:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001623535 2024-04-24T13:32:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291741+0000", 2024-04-24T13:32:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110847 2024-04-24T13:32:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.291812+0000", 2024-04-24T13:32:22.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0557999999999998e-05 2024-04-24T13:32:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:212 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.93322509399999, 2024-04-24T13:32:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035509539999999998, 2024-04-24T13:32:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.267 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 212 2024-04-24T13:32:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311405+0000", 2024-04-24T13:32:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311407+0000", 2024-04-24T13:32:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.84e-06 2024-04-24T13:32:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311419+0000", 2024-04-24T13:32:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1653e-05 2024-04-24T13:32:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311445+0000", 2024-04-24T13:32:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5851999999999999e-05 2024-04-24T13:32:22.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311469+0000", 2024-04-24T13:32:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4448999999999999e-05 2024-04-24T13:32:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311610+0000", 2024-04-24T13:32:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014100300000000001 2024-04-24T13:32:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.311863+0000", 2024-04-24T13:32:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025287200000000001 2024-04-24T13:32:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.312313+0000", 2024-04-24T13:32:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00045055799999999999 2024-04-24T13:32:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.313835+0000", 2024-04-24T13:32:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001521082 2024-04-24T13:32:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314806+0000", 2024-04-24T13:32:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00097173300000000002 2024-04-24T13:32:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314891+0000", 2024-04-24T13:32:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4859999999999997e-05 2024-04-24T13:32:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.314956+0000", 2024-04-24T13:32:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5052e-05 2024-04-24T13:32:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:219 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.90652997399999, 2024-04-24T13:32:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033038590000000001, 2024-04-24T13:32:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.275 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 219 2024-04-24T13:32:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338100+0000", 2024-04-24T13:32:22.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338103+0000", 2024-04-24T13:32:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:32:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338116+0000", 2024-04-24T13:32:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3203e-05 2024-04-24T13:32:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338149+0000", 2024-04-24T13:32:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2536000000000002e-05 2024-04-24T13:32:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338171+0000", 2024-04-24T13:32:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2429000000000002e-05 2024-04-24T13:32:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338325+0000", 2024-04-24T13:32:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153972 2024-04-24T13:32:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.338558+0000", 2024-04-24T13:32:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023268299999999999 2024-04-24T13:32:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.339021+0000", 2024-04-24T13:32:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00046377499999999998 2024-04-24T13:32:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.340405+0000", 2024-04-24T13:32:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001383783 2024-04-24T13:32:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341250+0000", 2024-04-24T13:32:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00084440000000000003 2024-04-24T13:32:22.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341340+0000", 2024-04-24T13:32:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.988e-05 2024-04-24T13:32:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.341404+0000", 2024-04-24T13:32:22.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4702000000000005e-05 2024-04-24T13:32:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:442 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:22.283 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.781337983, 2024-04-24T13:32:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035950840000000001, 2024-04-24T13:32:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.284 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 442 2024-04-24T13:32:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463292+0000", 2024-04-24T13:32:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463293+0000", 2024-04-24T13:32:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6400000000000001e-07 2024-04-24T13:32:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463297+0000", 2024-04-24T13:32:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.189e-06 2024-04-24T13:32:22.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463306+0000", 2024-04-24T13:32:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3070000000000003e-06 2024-04-24T13:32:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463310+0000", 2024-04-24T13:32:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3030000000000001e-06 2024-04-24T13:32:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463344+0000", 2024-04-24T13:32:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:32:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463394+0000", 2024-04-24T13:32:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0164000000000003e-05 2024-04-24T13:32:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.463510+0000", 2024-04-24T13:32:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115773 2024-04-24T13:32:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.464044+0000", 2024-04-24T13:32:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053476399999999996 2024-04-24T13:32:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466796+0000", 2024-04-24T13:32:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027521669999999998 2024-04-24T13:32:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466845+0000", 2024-04-24T13:32:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8086e-05 2024-04-24T13:32:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.466887+0000", 2024-04-24T13:32:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2904000000000001e-05 2024-04-24T13:32:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:531 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.72195558, 2024-04-24T13:32:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042179660000000001, 2024-04-24T13:32:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 531 2024-04-24T13:32:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522675+0000", 2024-04-24T13:32:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522676+0000", 2024-04-24T13:32:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.429e-06 2024-04-24T13:32:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522683+0000", 2024-04-24T13:32:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8419999999999999e-06 2024-04-24T13:32:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522702+0000", 2024-04-24T13:32:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8946000000000001e-05 2024-04-24T13:32:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522716+0000", 2024-04-24T13:32:22.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3611000000000001e-05 2024-04-24T13:32:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522800+0000", 2024-04-24T13:32:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4603000000000003e-05 2024-04-24T13:32:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.522899+0000", 2024-04-24T13:32:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9203000000000005e-05 2024-04-24T13:32:22.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:32:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523110+0000", 2024-04-24T13:32:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021056499999999999 2024-04-24T13:32:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.523822+0000", 2024-04-24T13:32:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071200099999999998 2024-04-24T13:32:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526782+0000", 2024-04-24T13:32:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029598210000000001 2024-04-24T13:32:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526846+0000", 2024-04-24T13:32:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4471e-05 2024-04-24T13:32:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.526893+0000", 2024-04-24T13:32:22.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6474000000000003e-05 2024-04-24T13:32:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:931 6.1 6:86cc8a85:::obj_delete_at_hint.0000000118:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.05764359299999, 2024-04-24T13:32:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033585669999999998, 2024-04-24T13:32:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.298 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 931 2024-04-24T13:32:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:22.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186987+0000", 2024-04-24T13:32:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.186989+0000", 2024-04-24T13:32:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187000+0000", 2024-04-24T13:32:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1309e-05 2024-04-24T13:32:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187032+0000", 2024-04-24T13:32:22.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1628999999999998e-05 2024-04-24T13:32:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187047+0000", 2024-04-24T13:32:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5054e-05 2024-04-24T13:32:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187204+0000", 2024-04-24T13:32:22.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157145 2024-04-24T13:32:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.187583+0000", 2024-04-24T13:32:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037895399999999998 2024-04-24T13:32:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.188158+0000", 2024-04-24T13:32:22.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00057452999999999996 2024-04-24T13:32:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.189462+0000", 2024-04-24T13:32:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013043729999999999 2024-04-24T13:32:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190076+0000", 2024-04-24T13:32:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061420400000000003 2024-04-24T13:32:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190228+0000", 2024-04-24T13:32:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152206 2024-04-24T13:32:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.190345+0000", 2024-04-24T13:32:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000116836 2024-04-24T13:32:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1584 4.4 4:22d8a9f0:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733626+0000", 2024-04-24T13:32:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.5110039909999999, 2024-04-24T13:32:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044360459999999999, 2024-04-24T13:32:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.306 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1584 2024-04-24T13:32:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733626+0000", 2024-04-24T13:32:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733626+0000", 2024-04-24T13:32:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733627+0000", 2024-04-24T13:32:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9999999999999998e-07 2024-04-24T13:32:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733630+0000", 2024-04-24T13:32:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2499999999999998e-06 2024-04-24T13:32:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733637+0000", 2024-04-24T13:32:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0090000000000001e-06 2024-04-24T13:32:22.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733647+0000", 2024-04-24T13:32:22.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0134e-05 2024-04-24T13:32:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733698+0000", 2024-04-24T13:32:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0587000000000002e-05 2024-04-24T13:32:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733828+0000", 2024-04-24T13:32:22.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013058000000000001 2024-04-24T13:32:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733961+0000", 2024-04-24T13:32:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000133089 2024-04-24T13:32:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734946+0000", 2024-04-24T13:32:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00098401000000000001 2024-04-24T13:32:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737978+0000", 2024-04-24T13:32:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030324340000000001 2024-04-24T13:32:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738024+0000", 2024-04-24T13:32:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6473e-05 2024-04-24T13:32:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738062+0000", 2024-04-24T13:32:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7979999999999999e-05 2024-04-24T13:32:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5165.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.314 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.097370+0000", 2024-04-24T13:32:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.1472603189999999, 2024-04-24T13:32:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052317040000000002, 2024-04-24T13:32:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5165", 2024-04-24T13:32:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/3607738460", 2024-04-24T13:32:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 48 2024-04-24T13:32:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097370+0000", 2024-04-24T13:32:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097370+0000", 2024-04-24T13:32:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097371+0000", 2024-04-24T13:32:22.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5000000000000003e-07 2024-04-24T13:32:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097374+0000", 2024-04-24T13:32:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1020000000000001e-06 2024-04-24T13:32:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097382+0000", 2024-04-24T13:32:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9440000000000005e-06 2024-04-24T13:32:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097387+0000", 2024-04-24T13:32:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5879999999999997e-06 2024-04-24T13:32:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097449+0000", 2024-04-24T13:32:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1939000000000004e-05 2024-04-24T13:32:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097533+0000", 2024-04-24T13:32:22.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4295000000000005e-05 2024-04-24T13:32:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097652+0000", 2024-04-24T13:32:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011874099999999999 2024-04-24T13:32:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.099879+0000", 2024-04-24T13:32:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002227035 2024-04-24T13:32:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.102504+0000", 2024-04-24T13:32:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026247499999999999 2024-04-24T13:32:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.102558+0000", 2024-04-24T13:32:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3557999999999998e-05 2024-04-24T13:32:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.102602+0000", 2024-04-24T13:32:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4202000000000001e-05 2024-04-24T13:32:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1616 3.2b e82/41 3:d46d78ac:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_2:head v 82'1, mlcod=0'0)", 2024-04-24T13:32:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.212299+0000", 2024-04-24T13:32:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.032331611, 2024-04-24T13:32:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042095359999999998, 2024-04-24T13:32:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.321 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212299+0000", 2024-04-24T13:32:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212299+0000", 2024-04-24T13:32:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212300+0000", 2024-04-24T13:32:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3880000000000001e-06 2024-04-24T13:32:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.213425+0000", 2024-04-24T13:32:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001124421 2024-04-24T13:32:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.213447+0000", 2024-04-24T13:32:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2208000000000002e-05 2024-04-24T13:32:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.213456+0000", 2024-04-24T13:32:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0149999999999992e-06 2024-04-24T13:32:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.213515+0000", 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9494999999999999e-05 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.213531+0000", 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5324000000000001e-05 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.216466+0000", 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029353830000000002 2024-04-24T13:32:22.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.216508+0000", 2024-04-24T13:32:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2302000000000003e-05 2024-04-24T13:32:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1615 3.1a e82/20 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head v 82'1, mlcod=0'0)", 2024-04-24T13:32:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:32:22.326 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.0316461339999998, 2024-04-24T13:32:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013622553000000001, 2024-04-24T13:32:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:32:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:32:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212985+0000", 2024-04-24T13:32:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1370000000000001e-06 2024-04-24T13:32:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219240+0000", 2024-04-24T13:32:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062543240000000003 2024-04-24T13:32:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219257+0000", 2024-04-24T13:32:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6940999999999999e-05 2024-04-24T13:32:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219267+0000", 2024-04-24T13:32:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0283e-05 2024-04-24T13:32:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219324+0000", 2024-04-24T13:32:22.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6950999999999997e-05 2024-04-24T13:32:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219343+0000", 2024-04-24T13:32:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8681999999999998e-05 2024-04-24T13:32:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226529+0000", 2024-04-24T13:32:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071867169999999996 2024-04-24T13:32:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226607+0000", 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7517999999999999e-05 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1618 3.36 e82/74 3:6e88aafa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4_10Mb.:head v 82'1, mlcod=0'0)", 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.237136+0000", 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.0074939650000001, 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010263291000000001, 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.331 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.237136+0000", 2024-04-24T13:32:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.237136+0000", 2024-04-24T13:32:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.237137+0000", 2024-04-24T13:32:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:32:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.242425+0000", 2024-04-24T13:32:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052873820000000002 2024-04-24T13:32:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.242446+0000", 2024-04-24T13:32:22.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1325e-05 2024-04-24T13:32:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.242458+0000", 2024-04-24T13:32:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1748e-05 2024-04-24T13:32:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.242538+0000", 2024-04-24T13:32:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0125999999999998e-05 2024-04-24T13:32:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.242558+0000", 2024-04-24T13:32:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0188999999999999e-05 2024-04-24T13:32:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.247357+0000", 2024-04-24T13:32:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047993020000000001 2024-04-24T13:32:22.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.247400+0000", 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2188999999999999e-05 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1701 4.3e 4:7e8f2907:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.605898+0000", 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6387328370000001, 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034594040000000001, 2024-04-24T13:32:22.336 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1701 2024-04-24T13:32:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605898+0000", 2024-04-24T13:32:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605898+0000", 2024-04-24T13:32:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605898+0000", 2024-04-24T13:32:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1900000000000001e-07 2024-04-24T13:32:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605903+0000", 2024-04-24T13:32:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.172e-06 2024-04-24T13:32:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605918+0000", 2024-04-24T13:32:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5709000000000002e-05 2024-04-24T13:32:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605926+0000", 2024-04-24T13:32:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7489999999999998e-06 2024-04-24T13:32:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605976+0000", 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0385e-05 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606046+0000", 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9890999999999999e-05 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606138+0000", 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1502000000000006e-05 2024-04-24T13:32:22.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.607797+0000", 2024-04-24T13:32:22.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016595430000000001 2024-04-24T13:32:22.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.609287+0000", 2024-04-24T13:32:22.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014893739999999999 2024-04-24T13:32:22.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.609317+0000", 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9943000000000001e-05 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.609357+0000", 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0216999999999998e-05 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1702 4.4 4:22d8a9f0:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.605947+0000", 2024-04-24T13:32:22.342 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6386832500000001, 2024-04-24T13:32:22.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047668060000000002, 2024-04-24T13:32:22.343 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.343 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.343 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.343 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.343 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.343 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.343 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1702 2024-04-24T13:32:22.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.343 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605947+0000", 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605947+0000", 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605948+0000", 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7800000000000002e-07 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605950+0000", 2024-04-24T13:32:22.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1600000000000001e-06 2024-04-24T13:32:22.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605956+0000", 2024-04-24T13:32:22.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.579e-06 2024-04-24T13:32:22.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605962+0000", 2024-04-24T13:32:22.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5670000000000002e-06 2024-04-24T13:32:22.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606002+0000", 2024-04-24T13:32:22.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9983e-05 2024-04-24T13:32:22.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606063+0000", 2024-04-24T13:32:22.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1371000000000006e-05 2024-04-24T13:32:22.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:22.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606144+0000", 2024-04-24T13:32:22.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0307000000000002e-05 2024-04-24T13:32:22.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.607804+0000", 2024-04-24T13:32:22.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001660796 2024-04-24T13:32:22.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610642+0000", 2024-04-24T13:32:22.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028376249999999999 2024-04-24T13:32:22.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610673+0000", 2024-04-24T13:32:22.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0939999999999999e-05 2024-04-24T13:32:22.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610714+0000", 2024-04-24T13:32:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1e-05 2024-04-24T13:32:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1730 8.15 8:a9005206:root::buck_2024_03_24_13_32_18:head [create,call version.set in=10b,writefull 0~192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.763558+0000", 2024-04-24T13:32:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.4810723179999998, 2024-04-24T13:32:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047981330000000004, 2024-04-24T13:32:22.350 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1730 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763558+0000", 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763558+0000", 2024-04-24T13:32:22.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763559+0000", 2024-04-24T13:32:22.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999993e-07 2024-04-24T13:32:22.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763563+0000", 2024-04-24T13:32:22.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2699999999999998e-06 2024-04-24T13:32:22.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763575+0000", 2024-04-24T13:32:22.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1399e-05 2024-04-24T13:32:22.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763580+0000", 2024-04-24T13:32:22.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5289999999999999e-06 2024-04-24T13:32:22.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763623+0000", 2024-04-24T13:32:22.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2605000000000003e-05 2024-04-24T13:32:22.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763705+0000", 2024-04-24T13:32:22.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2568e-05 2024-04-24T13:32:22.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:22.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763797+0000", 2024-04-24T13:32:22.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1699000000000004e-05 2024-04-24T13:32:22.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.764256+0000", 2024-04-24T13:32:22.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000458646 2024-04-24T13:32:22.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.768258+0000", 2024-04-24T13:32:22.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040020059999999998 2024-04-24T13:32:22.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.768311+0000", 2024-04-24T13:32:22.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3482000000000001e-05 2024-04-24T13:32:22.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.768356+0000", 2024-04-24T13:32:22.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4935000000000003e-05 2024-04-24T13:32:22.357 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.357 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.357 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.357 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1825 4.31 4:8f182dbc:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.6.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.357 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:19.089861+0000", 2024-04-24T13:32:22.358 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.1547694169999998, 2024-04-24T13:32:22.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041484360000000001, 2024-04-24T13:32:22.358 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.358 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.358 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.358 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.358 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.358 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.358 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1825 2024-04-24T13:32:22.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.358 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089861+0000", 2024-04-24T13:32:22.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089861+0000", 2024-04-24T13:32:22.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089863+0000", 2024-04-24T13:32:22.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3360000000000002e-06 2024-04-24T13:32:22.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089877+0000", 2024-04-24T13:32:22.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3519999999999999e-05 2024-04-24T13:32:22.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089897+0000", 2024-04-24T13:32:22.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0588999999999999e-05 2024-04-24T13:32:22.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089907+0000", 2024-04-24T13:32:22.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5319999999999995e-06 2024-04-24T13:32:22.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089977+0000", 2024-04-24T13:32:22.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0009e-05 2024-04-24T13:32:22.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.090134+0000", 2024-04-24T13:32:22.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015756400000000001 2024-04-24T13:32:22.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:22.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.090302+0000", 2024-04-24T13:32:22.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000167551 2024-04-24T13:32:22.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.091376+0000", 2024-04-24T13:32:22.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001073737 2024-04-24T13:32:22.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.093942+0000", 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002566161 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.093972+0000", 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0175000000000002e-05 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.094009+0000", 2024-04-24T13:32:22.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7261999999999997e-05 2024-04-24T13:32:22.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.364 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.364 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.364 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1828 4.27 4:e7e8a400:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.6.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.364 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:19.089929+0000", 2024-04-24T13:32:22.364 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.1547011679999999, 2024-04-24T13:32:22.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033130070000000002, 2024-04-24T13:32:22.364 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.364 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.364 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.365 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.365 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1828 2024-04-24T13:32:22.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.365 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089929+0000", 2024-04-24T13:32:22.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089929+0000", 2024-04-24T13:32:22.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089930+0000", 2024-04-24T13:32:22.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0800000000000005e-07 2024-04-24T13:32:22.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089934+0000", 2024-04-24T13:32:22.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9700000000000001e-06 2024-04-24T13:32:22.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089941+0000", 2024-04-24T13:32:22.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5480000000000004e-06 2024-04-24T13:32:22.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089946+0000", 2024-04-24T13:32:22.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1780000000000002e-06 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.090053+0000", 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010704099999999999 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.090169+0000", 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011519 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:22.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.090308+0000", 2024-04-24T13:32:22.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000138913 2024-04-24T13:32:22.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.090916+0000", 2024-04-24T13:32:22.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060857200000000004 2024-04-24T13:32:22.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.093186+0000", 2024-04-24T13:32:22.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022700820000000001 2024-04-24T13:32:22.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.093216+0000", 2024-04-24T13:32:22.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0148999999999999e-05 2024-04-24T13:32:22.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.093242+0000", 2024-04-24T13:32:22.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5856000000000001e-05 2024-04-24T13:32:22.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.370 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.370 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.371 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1830 4.39 4:9f83bdcd:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.6.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.371 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:19.089964+0000", 2024-04-24T13:32:22.371 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.1546664780000002, 2024-04-24T13:32:22.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039256600000000001, 2024-04-24T13:32:22.371 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.371 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.371 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.371 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.371 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.372 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.372 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1830 2024-04-24T13:32:22.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.372 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089964+0000", 2024-04-24T13:32:22.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089964+0000", 2024-04-24T13:32:22.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089964+0000", 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7800000000000002e-07 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089968+0000", 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2119999999999999e-06 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089973+0000", 2024-04-24T13:32:22.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9460000000000003e-06 2024-04-24T13:32:22.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.089978+0000", 2024-04-24T13:32:22.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6070000000000001e-06 2024-04-24T13:32:22.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.090034+0000", 2024-04-24T13:32:22.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5461000000000003e-05 2024-04-24T13:32:22.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.090134+0000", 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010090399999999999 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.090302+0000", 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000167555 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.091381+0000", 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00107868 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.093807+0000", 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024266270000000002 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.093854+0000", 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6986e-05 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.093890+0000", 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5203999999999997e-05 2024-04-24T13:32:22.376 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.377 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.377 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1923 4.39 4:9f83bdcd:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.6.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.377 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:19.274441+0000", 2024-04-24T13:32:22.377 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.9701897000000002, 2024-04-24T13:32:22.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042793869999999999, 2024-04-24T13:32:22.377 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.378 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.378 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.378 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.378 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.378 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.378 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1923 2024-04-24T13:32:22.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.378 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274441+0000", 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274441+0000", 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274441+0000", 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4700000000000001e-07 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274444+0000", 2024-04-24T13:32:22.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.88e-06 2024-04-24T13:32:22.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274451+0000", 2024-04-24T13:32:22.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0670000000000003e-06 2024-04-24T13:32:22.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274457+0000", 2024-04-24T13:32:22.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5380000000000002e-06 2024-04-24T13:32:22.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274511+0000", 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4138999999999998e-05 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274581+0000", 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0042999999999993e-05 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274672+0000", 2024-04-24T13:32:22.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0823999999999996e-05 2024-04-24T13:32:22.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.275470+0000", 2024-04-24T13:32:22.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00079784500000000004 2024-04-24T13:32:22.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.278668+0000", 2024-04-24T13:32:22.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031979209999999998 2024-04-24T13:32:22.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.278696+0000", 2024-04-24T13:32:22.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8835000000000001e-05 2024-04-24T13:32:22.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.278720+0000", 2024-04-24T13:32:22.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3547999999999999e-05 2024-04-24T13:32:22.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.384 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:22.385 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:32:22.386 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:22.382+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:22.396 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:32:22.487 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:22.486+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:22.559 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:22.559 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:22.559 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:22.573 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:32:22.587 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:22.586+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:22.688 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:22.684+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:22.689 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:22.689 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:22.689 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:22.689 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:22.689 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:22.702 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:32:22.790 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:22.788+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:22.856 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:22.856 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:22.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:22.856 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:22.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.856 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:22.856 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:22.856 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 110.454516668, 2024-04-24T13:32:22.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:32:22.857 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.857 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.857 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.857 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.857 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.857 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.857 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:32:22.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.857 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:22.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:22.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:32:22.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:32:22.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:32:22.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:32:22.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:32:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:32:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:32:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:32:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:32:22.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:32:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:32:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:32:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:32:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:32:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:32:22.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:32:22.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:32:22.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:32:22.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:32:22.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:32:22.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:32:22.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:32:22.863 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.863 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.863 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.864 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:22.864 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:22.864 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 110.43873291, 2024-04-24T13:32:22.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:32:22.864 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.864 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.864 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.864 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.864 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.864 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:32:22.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:32:22.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:32:22.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:32:22.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:32:22.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:32:22.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:32:22.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:22.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:32:22.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:32:22.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:32:22.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:32:22.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.869 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.870 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:32:22.870 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:22.870 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.995460118, 2024-04-24T13:32:22.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:32:22.870 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.870 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.870 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:32:22.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:32:22.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:32:22.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:32:22.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:32:22.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:32:22.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:32:22.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:32:22.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:32:22.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.874 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.9321166, 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.875 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:32:22.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:32:22.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.881 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:22.881 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:22.881 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.927440905, 2024-04-24T13:32:22.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:32:22.881 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.881 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.881 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:32:22.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:22.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:32:22.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:32:22.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:32:22.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:32:22.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:32:22.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:32:22.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:32:22.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:32:22.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:32:22.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:32:22.886 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.886 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.886 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.871396174, 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:32:22.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.888 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:22.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:22.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:32:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:32:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:32:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:32:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:32:22.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:32:22.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:32:22.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:32:22.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:32:22.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:32:22.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:32:22.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:32:22.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:22.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:32:22.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:32:22.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:32:22.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:32:22.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:32:22.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:32:22.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:32:22.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:32:22.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:32:22.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:32:22.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.893 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.894 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:22.894 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:22.894 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.86165013900001, 2024-04-24T13:32:22.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:32:22.894 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.894 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.894 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.895 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:32:22.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.895 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:22.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:22.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:32:22.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:32:22.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:32:22.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:32:22.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:32:22.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:32:22.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:32:22.900 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.900 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.900 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.900 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:22.900 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:22.901 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 109.62201998499999, 2024-04-24T13:32:22.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:32:22.901 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.901 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.901 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.901 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:32:22.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.901 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:32:22.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:32:22.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:32:22.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:32:22.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:32:22.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:32:22.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:32:22.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:32:22.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:32:22.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:32:22.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:32:22.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.906 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.907 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.907 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5087.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94838597716400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.907 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.477320+0000", 2024-04-24T13:32:22.907 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.3766420019999996, 2024-04-24T13:32:22.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053295189999999996, 2024-04-24T13:32:22.907 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.907 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.907 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5087", 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1617668435", 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 100 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477320+0000", 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477320+0000", 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477321+0000", 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4890000000000001e-06 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477325+0000", 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1919999999999998e-06 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477340+0000", 2024-04-24T13:32:22.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4793e-05 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477356+0000", 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477402+0000", 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5868999999999997e-05 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477459+0000", 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7058999999999997e-05 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477540+0000", 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0446999999999997e-05 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.480172+0000", 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026327479999999999 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.482561+0000", 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023886749999999998 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.482601+0000", 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0051e-05 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.482649+0000", 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8031000000000001e-05 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.912 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1569 4.32 4:4d570018:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.3.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.556835+0000", 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.2971265970000001, 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039046649999999999, 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.913 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1569 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556835+0000", 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556835+0000", 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556837+0000", 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.902e-06 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556843+0000", 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3990000000000001e-06 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556871+0000", 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8044000000000001e-05 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556880+0000", 2024-04-24T13:32:22.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2190000000000004e-06 2024-04-24T13:32:22.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556936+0000", 2024-04-24T13:32:22.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6060000000000002e-05 2024-04-24T13:32:22.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.557016+0000", 2024-04-24T13:32:22.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0029000000000002e-05 2024-04-24T13:32:22.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:22.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.557118+0000", 2024-04-24T13:32:22.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102768 2024-04-24T13:32:22.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.558207+0000", 2024-04-24T13:32:22.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010886279999999999 2024-04-24T13:32:22.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.560675+0000", 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024681249999999998 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.560706+0000", 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1195999999999997e-05 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.560740+0000", 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3294999999999999e-05 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.918 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.5111.0:56 7.14 e82/28 7:2b04a3e9:::notify.6:head v 82'42, mlcod=81'40)", 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.691653+0000", 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1623089330000003, 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044709930000000004, 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691653+0000", 2024-04-24T13:32:22.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691653+0000", 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691653+0000", 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1799999999999999e-07 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691655+0000", 2024-04-24T13:32:22.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4260000000000002e-06 2024-04-24T13:32:22.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691660+0000", 2024-04-24T13:32:22.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0030000000000002e-06 2024-04-24T13:32:22.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691664+0000", 2024-04-24T13:32:22.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6200000000000001e-06 2024-04-24T13:32:22.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691739+0000", 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5288000000000002e-05 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691759+0000", 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0072e-05 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696079+0000", 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043192509999999996 2024-04-24T13:32:22.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696124+0000", 2024-04-24T13:32:22.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5114999999999997e-05 2024-04-24T13:32:22.923 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.923 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.923 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.923 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1589 4.32 4:4e593490:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.923 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733643+0000", 2024-04-24T13:32:22.923 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1203190459999997, 2024-04-24T13:32:22.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042263659999999996, 2024-04-24T13:32:22.924 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.924 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.924 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.924 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.924 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.924 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.924 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1589 2024-04-24T13:32:22.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.924 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733643+0000", 2024-04-24T13:32:22.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733643+0000", 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733645+0000", 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.193e-06 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733654+0000", 2024-04-24T13:32:22.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0110000000000006e-06 2024-04-24T13:32:22.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733674+0000", 2024-04-24T13:32:22.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0208e-05 2024-04-24T13:32:22.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733684+0000", 2024-04-24T13:32:22.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6509999999999996e-06 2024-04-24T13:32:22.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733767+0000", 2024-04-24T13:32:22.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3413999999999998e-05 2024-04-24T13:32:22.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733894+0000", 2024-04-24T13:32:22.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012658999999999999 2024-04-24T13:32:22.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:22.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734043+0000", 2024-04-24T13:32:22.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014896000000000001 2024-04-24T13:32:22.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.735108+0000", 2024-04-24T13:32:22.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010658530000000001 2024-04-24T13:32:22.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737752+0000", 2024-04-24T13:32:22.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026430749999999999 2024-04-24T13:32:22.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737832+0000", 2024-04-24T13:32:22.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0039999999999999e-05 2024-04-24T13:32:22.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737869+0000", 2024-04-24T13:32:22.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7370999999999998e-05 2024-04-24T13:32:22.929 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.930 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.930 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.930 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1590 4.0 4:0175f652:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.930 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733724+0000", 2024-04-24T13:32:22.930 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1202372729999999, 2024-04-24T13:32:22.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004720414, 2024-04-24T13:32:22.930 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.930 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.930 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.930 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.930 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.931 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.931 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1590 2024-04-24T13:32:22.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.931 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733724+0000", 2024-04-24T13:32:22.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733724+0000", 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733725+0000", 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.99e-07 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733730+0000", 2024-04-24T13:32:22.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6569999999999996e-06 2024-04-24T13:32:22.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733739+0000", 2024-04-24T13:32:22.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2129999999999997e-06 2024-04-24T13:32:22.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733745+0000", 2024-04-24T13:32:22.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.46e-06 2024-04-24T13:32:22.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733982+0000", 2024-04-24T13:32:22.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023672299999999999 2024-04-24T13:32:22.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734092+0000", 2024-04-24T13:32:22.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010942000000000001 2024-04-24T13:32:22.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:22.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734222+0000", 2024-04-24T13:32:22.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013054599999999999 2024-04-24T13:32:22.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.735192+0000", 2024-04-24T13:32:22.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00096959800000000001 2024-04-24T13:32:22.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738379+0000", 2024-04-24T13:32:22.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003187133 2024-04-24T13:32:22.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738407+0000", 2024-04-24T13:32:22.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8218e-05 2024-04-24T13:32:22.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738445+0000", 2024-04-24T13:32:22.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7747000000000003e-05 2024-04-24T13:32:22.937 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.937 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.937 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.938 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1591 4.34 4:2f8daf8d:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.938 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733763+0000", 2024-04-24T13:32:22.938 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1201989440000002, 2024-04-24T13:32:22.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041142720000000004, 2024-04-24T13:32:22.938 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.938 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.938 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.938 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.938 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.938 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.938 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1591 2024-04-24T13:32:22.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733763+0000", 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733763+0000", 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733763+0000", 2024-04-24T13:32:22.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9800000000000004e-07 2024-04-24T13:32:22.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733768+0000", 2024-04-24T13:32:22.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9529999999999998e-06 2024-04-24T13:32:22.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733775+0000", 2024-04-24T13:32:22.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7569999999999998e-06 2024-04-24T13:32:22.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733780+0000", 2024-04-24T13:32:22.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3619999999999997e-06 2024-04-24T13:32:22.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733836+0000", 2024-04-24T13:32:22.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5291000000000003e-05 2024-04-24T13:32:22.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733953+0000", 2024-04-24T13:32:22.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117404 2024-04-24T13:32:22.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:22.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734093+0000", 2024-04-24T13:32:22.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139896 2024-04-24T13:32:22.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.735096+0000", 2024-04-24T13:32:22.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010028859999999999 2024-04-24T13:32:22.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737810+0000", 2024-04-24T13:32:22.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002713956 2024-04-24T13:32:22.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737842+0000", 2024-04-24T13:32:22.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2288e-05 2024-04-24T13:32:22.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737877+0000", 2024-04-24T13:32:22.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4981000000000003e-05 2024-04-24T13:32:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1584 4.4 e82/22 4:22d8a9f0:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.2:head v 82'1, mlcod=0'0)", 2024-04-24T13:32:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.734672+0000", 2024-04-24T13:32:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.119289169, 2024-04-24T13:32:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003155649, 2024-04-24T13:32:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.944 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734672+0000", 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734672+0000", 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734673+0000", 2024-04-24T13:32:22.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734679+0000", 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4199999999999998e-06 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734689+0000", 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0553e-05 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734696+0000", 2024-04-24T13:32:22.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7769999999999997e-06 2024-04-24T13:32:22.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734767+0000", 2024-04-24T13:32:22.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0747999999999994e-05 2024-04-24T13:32:22.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734783+0000", 2024-04-24T13:32:22.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6073e-05 2024-04-24T13:32:22.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737789+0000", 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030059209999999999 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737828+0000", 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9286999999999998e-05 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.948 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5165.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94314959539792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.105440+0000", 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.7485219260000004, 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003116597, 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5165", 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/3607738460", 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 51 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105440+0000", 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105440+0000", 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105440+0000", 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8199999999999999e-07 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105444+0000", 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3100000000000001e-06 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105453+0000", 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7599999999999997e-06 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105459+0000", 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2700000000000004e-06 2024-04-24T13:32:22.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105501+0000", 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1978999999999999e-05 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105557+0000", 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6645999999999999e-05 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105638+0000", 2024-04-24T13:32:22.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0889000000000004e-05 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.106382+0000", 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074407800000000001 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.108438+0000", 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020552919999999998 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.108490+0000", 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2784000000000001e-05 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.108556+0000", 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5907000000000004e-05 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.5165.0:56 7.14 e82/28 7:2b04a3e9:::notify.6:head v 82'51, mlcod=82'49)", 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.110473+0000", 2024-04-24T13:32:22.954 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.7434891590000001, 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047884579999999998, 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110473+0000", 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110473+0000", 2024-04-24T13:32:22.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110473+0000", 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110478+0000", 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2920000000000003e-06 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110486+0000", 2024-04-24T13:32:22.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3509999999999996e-06 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110492+0000", 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0769999999999996e-06 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110566+0000", 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3937999999999996e-05 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110584+0000", 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8666000000000001e-05 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115219+0000", 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046345730000000003 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115261+0000", 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2190000000000001e-05 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1707 4.32 4:4e593490:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.605950+0000", 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2480114809999998, 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037535720000000002, 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1707 2024-04-24T13:32:22.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605950+0000", 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605950+0000", 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605951+0000", 2024-04-24T13:32:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.850000000000001e-07 2024-04-24T13:32:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605956+0000", 2024-04-24T13:32:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9089999999999999e-06 2024-04-24T13:32:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605970+0000", 2024-04-24T13:32:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3604000000000001e-05 2024-04-24T13:32:22.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605978+0000", 2024-04-24T13:32:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8560000000000007e-06 2024-04-24T13:32:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606096+0000", 2024-04-24T13:32:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011834 2024-04-24T13:32:22.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606166+0000", 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0350000000000002e-05 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606265+0000", 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8778999999999997e-05 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.607729+0000", 2024-04-24T13:32:22.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014643169999999999 2024-04-24T13:32:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.609631+0000", 2024-04-24T13:32:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001901724 2024-04-24T13:32:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.609672+0000", 2024-04-24T13:32:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0859999999999998e-05 2024-04-24T13:32:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.609704+0000", 2024-04-24T13:32:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1847999999999997e-05 2024-04-24T13:32:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1708 4.0 4:0175f652:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:22.965 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.605998+0000", 2024-04-24T13:32:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2479640459999999, 2024-04-24T13:32:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047686100000000004, 2024-04-24T13:32:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1708 2024-04-24T13:32:22.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605998+0000", 2024-04-24T13:32:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605998+0000", 2024-04-24T13:32:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605998+0000", 2024-04-24T13:32:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4000000000000002e-07 2024-04-24T13:32:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606001+0000", 2024-04-24T13:32:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.061e-06 2024-04-24T13:32:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606009+0000", 2024-04-24T13:32:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8429999999999993e-06 2024-04-24T13:32:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606015+0000", 2024-04-24T13:32:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0569999999999998e-06 2024-04-24T13:32:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606618+0000", 2024-04-24T13:32:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060244400000000005 2024-04-24T13:32:22.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606689+0000", 2024-04-24T13:32:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1363000000000001e-05 2024-04-24T13:32:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606776+0000", 2024-04-24T13:32:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6891000000000005e-05 2024-04-24T13:32:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610483+0000", 2024-04-24T13:32:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037067699999999999 2024-04-24T13:32:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610710+0000", 2024-04-24T13:32:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022745600000000001 2024-04-24T13:32:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610745+0000", 2024-04-24T13:32:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4839000000000003e-05 2024-04-24T13:32:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610766+0000", 2024-04-24T13:32:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1345999999999999e-05 2024-04-24T13:32:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1702 4.4 e82/22 4:22d8a9f0:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.2:head v 82'2, mlcod=0'0)", 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.606781+0000", 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2471811050000001, 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037302279999999999, 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606781+0000", 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606781+0000", 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606781+0000", 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1200000000000001e-07 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606788+0000", 2024-04-24T13:32:22.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2430000000000002e-06 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606796+0000", 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7760000000000003e-06 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606803+0000", 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6800000000000004e-06 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:22.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606842+0000", 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8546e-05 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606860+0000", 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8672999999999999e-05 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610490+0000", 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036294370000000001 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:22.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:22.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610511+0000", 2024-04-24T13:32:22.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0961000000000001e-05 2024-04-24T13:32:22.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.977 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:22.977 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:22.977 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:22.979 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:22.979 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:22.978+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:23.079 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:23.076+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:23.138 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:23.138 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:23.139 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:23.139 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:23.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:23.195 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:23.192+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:23.282 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:23.278+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:23.311 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:23.311 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:23.324 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:23.383 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:23.382+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:23.393 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:32:23.445 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:23.445 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:23.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:23.446 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:23.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.446 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:32:23.446 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:23.446 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 116.19714465600001, 2024-04-24T13:32:23.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057346300000000001, 2024-04-24T13:32:23.446 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.446 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.446 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:32:23.447 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.447 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:23.447 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.447 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44 2024-04-24T13:32:23.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.447 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:23.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:23.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247277+0000", 2024-04-24T13:32:23.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3459999999999998e-06 2024-04-24T13:32:23.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247344+0000", 2024-04-24T13:32:23.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6768999999999997e-05 2024-04-24T13:32:23.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247379+0000", 2024-04-24T13:32:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4573999999999998e-05 2024-04-24T13:32:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247402+0000", 2024-04-24T13:32:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3303e-05 2024-04-24T13:32:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247599+0000", 2024-04-24T13:32:23.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019720499999999999 2024-04-24T13:32:23.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:32:23.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247622+0000", 2024-04-24T13:32:23.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2512999999999999e-05 2024-04-24T13:32:23.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.252825+0000", 2024-04-24T13:32:23.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052035270000000003 2024-04-24T13:32:23.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.253009+0000", 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018339300000000001 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 111.168502143, 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.452 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:32:23.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:32:23.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:32:23.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:32:23.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:32:23.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:32:23.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:32:23.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:32:23.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:23.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:32:23.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:32:23.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:32:23.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:32:23.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.458 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 111.063547976, 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040131660000000003, 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.459 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 231 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380873+0000", 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2400000000000002e-06 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380884+0000", 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0645999999999999e-05 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380919+0000", 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5026e-05 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380934+0000", 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.522e-05 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381077+0000", 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014362500000000001 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381453+0000", 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037581799999999999 2024-04-24T13:32:23.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.382170+0000", 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071714999999999995 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.383955+0000", 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017847710000000001 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384619+0000", 2024-04-24T13:32:23.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066381600000000002 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384770+0000", 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015067800000000001 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384884+0000", 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114176 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:562 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 110.891584743, 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048608870000000004, 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 562 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.465 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552837+0000", 2024-04-24T13:32:23.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8499999999999998e-06 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552852+0000", 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4866e-05 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552890+0000", 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8166e-05 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552905+0000", 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5255e-05 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553053+0000", 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014824599999999999 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553425+0000", 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000371512 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553969+0000", 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054421500000000002 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.554987+0000", 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001017855 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557606+0000", 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026195839999999999 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557655+0000", 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8575000000000002e-05 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557695+0000", 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9762999999999999e-05 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:23.470 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 110.473476448, 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034937589999999999, 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 838 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970944+0000", 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3360000000000002e-06 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970959+0000", 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.469e-05 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970989+0000", 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0159e-05 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971004+0000", 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971147+0000", 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014242500000000001 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971514+0000", 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036720900000000001 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.972113+0000", 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00059902100000000004 2024-04-24T13:32:23.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.973403+0000", 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012904189999999999 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974152+0000", 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074879600000000003 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974316+0000", 2024-04-24T13:32:23.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164308 2024-04-24T13:32:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974436+0000", 2024-04-24T13:32:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119453 2024-04-24T13:32:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1182 4.16 e81/22 4:6b47d35a:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.1.10:head v 81'1, mlcod=0'0)", 2024-04-24T13:32:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:15.105295+0000", 2024-04-24T13:32:23.476 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.3391240270000004, 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036488269999999999, 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105295+0000", 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105295+0000", 2024-04-24T13:32:23.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105295+0000", 2024-04-24T13:32:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.91e-07 2024-04-24T13:32:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105299+0000", 2024-04-24T13:32:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3390000000000003e-06 2024-04-24T13:32:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105309+0000", 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0025e-05 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105318+0000", 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7779999999999996e-06 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105619+0000", 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030148700000000002 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105636+0000", 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6571000000000001e-05 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.108904+0000", 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003267739 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.108943+0000", 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9597000000000001e-05 2024-04-24T13:32:23.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5111.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94137918829056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.691233+0000", 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.753185244, 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050209349999999998, 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5111", 2024-04-24T13:32:23.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1624747613", 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 55 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691233+0000", 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691233+0000", 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691235+0000", 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2610000000000001e-06 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691239+0000", 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2139999999999998e-06 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691251+0000", 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1776999999999999e-05 2024-04-24T13:32:23.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691257+0000", 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0179999999999998e-06 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691310+0000", 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3201000000000001e-05 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691387+0000", 2024-04-24T13:32:23.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6762999999999997e-05 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691537+0000", 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149958 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.693654+0000", 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021170270000000001 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696131+0000", 2024-04-24T13:32:23.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024774179999999999 2024-04-24T13:32:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696181+0000", 2024-04-24T13:32:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0046000000000002e-05 2024-04-24T13:32:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696254+0000", 2024-04-24T13:32:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3251999999999996e-05 2024-04-24T13:32:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5111.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.691278+0000", 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.7531403839999999, 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050104219999999996, 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5111", 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1624747613", 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 56 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.487 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691278+0000", 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691278+0000", 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691279+0000", 2024-04-24T13:32:23.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0200000000000003e-07 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691281+0000", 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691286+0000", 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2100000000000001e-06 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691289+0000", 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5200000000000002e-06 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691336+0000", 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6771000000000003e-05 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691411+0000", 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4689000000000003e-05 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691537+0000", 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012561899999999999 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.693529+0000", 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001992649 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696226+0000", 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026964070000000001 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696265+0000", 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9477000000000002e-05 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696289+0000", 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3558e-05 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.492 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1588 4.29 4:950e3da7:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733711+0000", 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.7107071669999998, 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004339847, 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1588 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733711+0000", 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733711+0000", 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733712+0000", 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4099999999999999e-07 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733716+0000", 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6890000000000002e-06 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733728+0000", 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2660000000000001e-05 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733734+0000", 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8289999999999996e-06 2024-04-24T13:32:23.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733787+0000", 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2408999999999999e-05 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733896+0000", 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010933 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734032+0000", 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013609200000000001 2024-04-24T13:32:23.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737906+0000", 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038740530000000001 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737971+0000", 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4941e-05 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738015+0000", 2024-04-24T13:32:23.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4475999999999999e-05 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738051+0000", 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5827000000000001e-05 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1582 4.16 e82/22 4:69bcb5d9:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.0:head v 82'3, mlcod=81'1)", 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.734337+0000", 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.7100812510000001, 2024-04-24T13:32:23.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003588585, 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734337+0000", 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734337+0000", 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734338+0000", 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1519999999999999e-06 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734345+0000", 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4030000000000004e-06 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734356+0000", 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0606e-05 2024-04-24T13:32:23.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734362+0000", 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9580000000000001e-06 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734440+0000", 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7364e-05 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734457+0000", 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6906e-05 2024-04-24T13:32:23.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737886+0000", 2024-04-24T13:32:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034295889999999998 2024-04-24T13:32:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737926+0000", 2024-04-24T13:32:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9607000000000002e-05 2024-04-24T13:32:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1585 4.2f e82/22 4:f66a130c:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.3:head v 82'3, mlcod=81'1)", 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.734734+0000", 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.7096841029999998, 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034355280000000002, 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734734+0000", 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734734+0000", 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734735+0000", 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9999999999999997e-07 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734741+0000", 2024-04-24T13:32:23.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4219999999999999e-06 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734750+0000", 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7440000000000002e-06 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734757+0000", 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.421e-06 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734834+0000", 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7739999999999998e-05 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734852+0000", 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7776000000000001e-05 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738133+0000", 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032805220000000001 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738170+0000", 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7302999999999998e-05 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5165.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.110078+0000", 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.3343405309999996, 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053186259999999999, 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.507 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5165", 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/3607738460", 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 56 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110078+0000", 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110078+0000", 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110079+0000", 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3900000000000005e-07 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110082+0000", 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4319999999999999e-06 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110090+0000", 2024-04-24T13:32:23.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.763e-06 2024-04-24T13:32:23.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110096+0000", 2024-04-24T13:32:23.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8250000000000001e-06 2024-04-24T13:32:23.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110146+0000", 2024-04-24T13:32:23.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0695000000000002e-05 2024-04-24T13:32:23.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110227+0000", 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0554000000000002e-05 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110352+0000", 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012533800000000001 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.112615+0000", 2024-04-24T13:32:23.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022629880000000001 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115344+0000", 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027288899999999999 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115373+0000", 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8711999999999999e-05 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115397+0000", 2024-04-24T13:32:23.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.389e-05 2024-04-24T13:32:23.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.513 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.513 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1706 4.29 4:950e3da7:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:23.513 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.606016+0000", 2024-04-24T13:32:23.513 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.8384023550000004, 2024-04-24T13:32:23.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004810361, 2024-04-24T13:32:23.513 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.513 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.513 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1706 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606016+0000", 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606016+0000", 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606017+0000", 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3e-07 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606021+0000", 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1049999999999997e-06 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606031+0000", 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6590000000000002e-06 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606038+0000", 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5009999999999998e-06 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606205+0000", 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000167188 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606274+0000", 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8330999999999993e-05 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606368+0000", 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4747999999999995e-05 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.607958+0000", 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001589196 2024-04-24T13:32:23.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610739+0000", 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00278166 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610800+0000", 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0653999999999999e-05 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610827+0000", 2024-04-24T13:32:23.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6689000000000001e-05 2024-04-24T13:32:23.519 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.519 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.519 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.519 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1719 4.15 4:a9c3e2b3:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:23.519 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.751119+0000", 2024-04-24T13:32:23.519 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.6932995980000003, 2024-04-24T13:32:23.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041158660000000001, 2024-04-24T13:32:23.519 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.519 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.519 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.519 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1719 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751119+0000", 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751119+0000", 2024-04-24T13:32:23.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751121+0000", 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7600000000000001e-06 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751129+0000", 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0770000000000008e-06 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751147+0000", 2024-04-24T13:32:23.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7858000000000001e-05 2024-04-24T13:32:23.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751156+0000", 2024-04-24T13:32:23.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2550000000000003e-06 2024-04-24T13:32:23.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751222+0000", 2024-04-24T13:32:23.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6340000000000005e-05 2024-04-24T13:32:23.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751355+0000", 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013299500000000001 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751494+0000", 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139164 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.752323+0000", 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00082899899999999997 2024-04-24T13:32:23.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755169+0000", 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028453380000000002 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755202+0000", 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3136000000000003e-05 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755235+0000", 2024-04-24T13:32:23.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2944000000000002e-05 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1720 4.11 4:8aa62082:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.751178+0000", 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.6932406010000003, 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040457669999999996, 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.525 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1720 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751178+0000", 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751178+0000", 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751179+0000", 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5400000000000001e-07 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751183+0000", 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0459999999999999e-06 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751189+0000", 2024-04-24T13:32:23.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5989999999999998e-06 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751193+0000", 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6440000000000002e-06 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751246+0000", 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3446000000000003e-05 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751325+0000", 2024-04-24T13:32:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8586999999999998e-05 2024-04-24T13:32:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751409+0000", 2024-04-24T13:32:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3993999999999996e-05 2024-04-24T13:32:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.752239+0000", 2024-04-24T13:32:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00083003700000000005 2024-04-24T13:32:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755164+0000", 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029250719999999999 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755199+0000", 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5240999999999997e-05 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755224+0000", 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4547000000000001e-05 2024-04-24T13:32:23.530 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1723 4.15 4:a83fb8d7:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.751205+0000", 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.6932133670000002, 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088490000000004, 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:23.531 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1723 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751205+0000", 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751205+0000", 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751206+0000", 2024-04-24T13:32:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3000000000000001e-07 2024-04-24T13:32:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751209+0000", 2024-04-24T13:32:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1549999999999999e-06 2024-04-24T13:32:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751215+0000", 2024-04-24T13:32:23.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1349999999999997e-06 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751220+0000", 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.429e-06 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751758+0000", 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053738899999999999 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751902+0000", 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014389399999999999 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.752074+0000", 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017230300000000001 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.753003+0000", 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092858100000000005 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755268+0000", 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002265553 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755295+0000", 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6726000000000001e-05 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755314+0000", 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9253999999999999e-05 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.536 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1812 4.15 4:a9c3e2b3:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.942075+0000", 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.5023437639999999, 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061256640000000003, 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1812 2024-04-24T13:32:23.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942075+0000", 2024-04-24T13:32:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942075+0000", 2024-04-24T13:32:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942076+0000", 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.11e-06 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942082+0000", 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3450000000000002e-06 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942095+0000", 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2585000000000001e-05 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942104+0000", 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6619999999999994e-06 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942172+0000", 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8112000000000001e-05 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942246+0000", 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4636999999999997e-05 2024-04-24T13:32:23.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942352+0000", 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105474 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943298+0000", 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094645899999999997 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.948150+0000", 2024-04-24T13:32:23.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048519460000000002 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.948179+0000", 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8549000000000001e-05 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.948200+0000", 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1784999999999999e-05 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1813 4.11 4:8aa62082:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.942122+0000", 2024-04-24T13:32:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.5022962629999999, 2024-04-24T13:32:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071059180000000001, 2024-04-24T13:32:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1813 2024-04-24T13:32:23.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942122+0000", 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942122+0000", 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942123+0000", 2024-04-24T13:32:23.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4799999999999998e-07 2024-04-24T13:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942126+0000", 2024-04-24T13:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9809999999999999e-06 2024-04-24T13:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942136+0000", 2024-04-24T13:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8549999999999997e-06 2024-04-24T13:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942142+0000", 2024-04-24T13:32:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1990000000000003e-06 2024-04-24T13:32:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942187+0000", 2024-04-24T13:32:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5102999999999998e-05 2024-04-24T13:32:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942251+0000", 2024-04-24T13:32:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4324000000000003e-05 2024-04-24T13:32:23.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942352+0000", 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100412 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943198+0000", 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000846615 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949171+0000", 2024-04-24T13:32:23.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059721519999999997 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949206+0000", 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5706e-05 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949228+0000", 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2022999999999999e-05 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1816 4.15 4:a83fb8d7:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.942155+0000", 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.5022631740000003, 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070975669999999999, 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1816 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.549 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942155+0000", 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942155+0000", 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942156+0000", 2024-04-24T13:32:23.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0500000000000004e-07 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942163+0000", 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9369999999999998e-06 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942170+0000", 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9789999999999996e-06 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942175+0000", 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4380000000000003e-06 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942863+0000", 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00068733800000000001 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942945+0000", 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083000000000007e-05 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:23.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943058+0000", 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113206 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.946270+0000", 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032119779999999999 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949191+0000", 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029214190000000002 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949223+0000", 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1548999999999999e-05 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949253+0000", 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0134999999999999e-05 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1809 4.1a e82/22 4:5ade8a4f:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.0:head v 82'2, mlcod=0'0)", 2024-04-24T13:32:23.554 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.943465+0000", 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.5009540619999999, 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058673099999999997, 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943465+0000", 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:23.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943465+0000", 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943465+0000", 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943477+0000", 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1591e-05 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:23.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943501+0000", 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4396000000000002e-05 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943511+0000", 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5219999999999996e-06 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943567+0000", 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5813999999999998e-05 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943589+0000", 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2188000000000002e-05 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949307+0000", 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057182079999999998 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949332+0000", 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4813000000000001e-05 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.558 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.559 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.559 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:23.559 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:23.559 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:23.560 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:23.561 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:23.558+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:23.661 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:23.656+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:23.692 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:23.692 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:23.692 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:23.692 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:23.706 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:23.762 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:23.760+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:23.829 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:23.829 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:23.830 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:23.843 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:23.863 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:23.860+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:23.963 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:23.963 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:23.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:23.963 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:23.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.964 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:32:23.964 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:23.964 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 116.73378022200001, 2024-04-24T13:32:23.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020457065, 2024-04-24T13:32:23.964 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:23.964 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:23.964 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-24T13:32:23.964 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:23.964 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:23.964 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.964 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:23.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225903+0000", 2024-04-24T13:32:23.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7100000000000001e-06 2024-04-24T13:32:23.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:23.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225922+0000", 2024-04-24T13:32:23.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8919999999999998e-05 2024-04-24T13:32:23.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:23.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225960+0000", 2024-04-24T13:32:23.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7240000000000003e-05 2024-04-24T13:32:23.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225987+0000", 2024-04-24T13:32:23.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6919000000000001e-05 2024-04-24T13:32:23.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:23.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226300+0000", 2024-04-24T13:32:23.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000313701 2024-04-24T13:32:23.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:23.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226317+0000", 2024-04-24T13:32:23.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6463000000000001e-05 2024-04-24T13:32:23.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:23.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231091+0000", 2024-04-24T13:32:23.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047739169999999999 2024-04-24T13:32:23.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:32:23.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231111+0000", 2024-04-24T13:32:23.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0605999999999999e-05 2024-04-24T13:32:23.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:23.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246073+0000", 2024-04-24T13:32:23.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014961264 2024-04-24T13:32:23.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:23.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246357+0000", 2024-04-24T13:32:23.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028432499999999999 2024-04-24T13:32:23.970 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:23.970 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:23.970 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:23.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.970 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-24T13:32:23.970 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:32:23.970 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 114.692640575, 2024-04-24T13:32:23.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056987720000000004, 2024-04-24T13:32:23.970 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:23.971 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:23.971 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.971 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:23.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:23.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:32:23.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:23.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:23.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:32:23.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:23.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:23.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267040+0000", 2024-04-24T13:32:23.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3e-07 2024-04-24T13:32:23.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:23.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267050+0000", 2024-04-24T13:32:23.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8560000000000002e-06 2024-04-24T13:32:23.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:23.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267205+0000", 2024-04-24T13:32:23.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520200000000001 2024-04-24T13:32:23.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267244+0000", 2024-04-24T13:32:23.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8587000000000002e-05 2024-04-24T13:32:23.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:23.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267346+0000", 2024-04-24T13:32:23.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010223200000000001 2024-04-24T13:32:23.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:23.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267374+0000", 2024-04-24T13:32:23.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8214000000000001e-05 2024-04-24T13:32:23.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:23.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272631+0000", 2024-04-24T13:32:23.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052563089999999998 2024-04-24T13:32:23.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272738+0000", 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107642 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:47 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'2, mlcod=0'0)", 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 114.678729819, 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052089900000000001, 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:23.975 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:23.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280951+0000", 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7199999999999997e-07 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280962+0000", 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1094000000000001e-05 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280981+0000", 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9066e-05 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280999+0000", 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8148e-05 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281144+0000", 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014454999999999999 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281190+0000", 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5649000000000003e-05 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:23.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286063+0000", 2024-04-24T13:32:23.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048732549999999999 2024-04-24T13:32:23.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:23.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286159+0000", 2024-04-24T13:32:23.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6355999999999997e-05 2024-04-24T13:32:23.979 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:23.979 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:23.979 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:23.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 111.657341938, 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010258288000000001, 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:23.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302342+0000", 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6059999999999999e-06 2024-04-24T13:32:23.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:23.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302357+0000", 2024-04-24T13:32:23.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5201999999999999e-05 2024-04-24T13:32:23.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:23.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302393+0000", 2024-04-24T13:32:23.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6386e-05 2024-04-24T13:32:23.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302411+0000", 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7864999999999999e-05 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302544+0000", 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132526 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302554+0000", 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0479000000000001e-05 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309290+0000", 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006735937 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309474+0000", 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000183981 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309873+0000", 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000398618 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.311131+0000", 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012578929999999999 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312443+0000", 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001312648 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312535+0000", 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1620999999999996e-05 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:23.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312596+0000", 2024-04-24T13:32:23.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1525999999999993e-05 2024-04-24T13:32:23.986 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:23.986 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:23.986 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:23.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.986 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4865.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-04-24T13:32:23.986 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:14.968824+0000", 2024-04-24T13:32:23.986 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.9908558539999994, 2024-04-24T13:32:23.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046556760000000001, 2024-04-24T13:32:23.986 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "started", 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4865", 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/2885481152", 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968824+0000", 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968824+0000", 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968827+0000", 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6429999999999999e-06 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968836+0000", 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0229999999999998e-06 2024-04-24T13:32:23.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968857+0000", 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1396e-05 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968877+0000", 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0103e-05 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968977+0000", 2024-04-24T13:32:23.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9862e-05 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968984+0000", 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6279999999999999e-06 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.973315+0000", 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043312649999999999 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:23.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.973388+0000", 2024-04-24T13:32:23.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2611e-05 2024-04-24T13:32:23.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:23.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.973480+0000", 2024-04-24T13:32:23.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2145000000000006e-05 2024-04-24T13:32:23.991 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:23.991 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:23.991 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:23.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.991 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1586 4.2c 4:37b5a98b:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:17.732999+0000", 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.2266814860000004, 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042846200000000003, 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1586 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:23.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.732999+0000", 2024-04-24T13:32:23.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:23.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:23.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.732999+0000", 2024-04-24T13:32:23.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:23.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:23.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733001+0000", 2024-04-24T13:32:23.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2639999999999998e-06 2024-04-24T13:32:23.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:23.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733029+0000", 2024-04-24T13:32:23.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8042e-05 2024-04-24T13:32:23.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:23.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733060+0000", 2024-04-24T13:32:23.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0916e-05 2024-04-24T13:32:23.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733075+0000", 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5163e-05 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733269+0000", 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019399900000000001 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733502+0000", 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023322100000000001 2024-04-24T13:32:23.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:23.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733902+0000", 2024-04-24T13:32:23.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000399971 2024-04-24T13:32:23.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:23.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.735670+0000", 2024-04-24T13:32:23.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017675270000000001 2024-04-24T13:32:23.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:23.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.737133+0000", 2024-04-24T13:32:23.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001463223 2024-04-24T13:32:23.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:23.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.737220+0000", 2024-04-24T13:32:23.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6848000000000006e-05 2024-04-24T13:32:23.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:23.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.737283+0000", 2024-04-24T13:32:23.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3446000000000002e-05 2024-04-24T13:32:23.998 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:23.998 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:23.998 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:23.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.998 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1615 3.1a 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:23.998 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:23.998 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.7539675480000003, 2024-04-24T13:32:23.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020755388999999999, 2024-04-24T13:32:23.999 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:23.999 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:23.999 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:23.999 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:23.999 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:23.999 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:23.999 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1615 2024-04-24T13:32:23.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:23.999 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:23.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:23.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:23.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:24.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:24.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205715+0000", 2024-04-24T13:32:24.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4399999999999999e-06 2024-04-24T13:32:24.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211414+0000", 2024-04-24T13:32:24.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005699356 2024-04-24T13:32:24.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211448+0000", 2024-04-24T13:32:24.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4221999999999999e-05 2024-04-24T13:32:24.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211466+0000", 2024-04-24T13:32:24.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7629999999999999e-05 2024-04-24T13:32:24.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211585+0000", 2024-04-24T13:32:24.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011937 2024-04-24T13:32:24.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211840+0000", 2024-04-24T13:32:24.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000254861 2024-04-24T13:32:24.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:24.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.212059+0000", 2024-04-24T13:32:24.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218789 2024-04-24T13:32:24.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:24.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.225826+0000", 2024-04-24T13:32:24.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013767061000000001 2024-04-24T13:32:24.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:24.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226295+0000", 2024-04-24T13:32:24.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046917399999999999 2024-04-24T13:32:24.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226388+0000", 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2190999999999999e-05 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226468+0000", 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0295000000000003e-05 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.006 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1704 4.2c 4:37b5a98b:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:24.006 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.605304+0000", 2024-04-24T13:32:24.006 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.3543757640000003, 2024-04-24T13:32:24.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004234888, 2024-04-24T13:32:24.006 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:24.006 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:24.006 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:24.006 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:24.006 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:24.006 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:24.006 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1704 2024-04-24T13:32:24.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.006 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605304+0000", 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605304+0000", 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605307+0000", 2024-04-24T13:32:24.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3539999999999998e-06 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605317+0000", 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0856000000000001e-05 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605348+0000", 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1019000000000002e-05 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605364+0000", 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5313000000000001e-05 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605523+0000", 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000159111 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605803+0000", 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028006299999999999 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:24.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.606142+0000", 2024-04-24T13:32:24.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033936900000000001 2024-04-24T13:32:24.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:24.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.608804+0000", 2024-04-24T13:32:24.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002661362 2024-04-24T13:32:24.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.609383+0000", 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057949499999999997 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.609468+0000", 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5228000000000005e-05 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.609539+0000", 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0717999999999996e-05 2024-04-24T13:32:24.011 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1716 4.1a 4:5ade8a4f:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750490+0000", 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.2091901969999999, 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084099940000000005, 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:24.012 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1716 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750490+0000", 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750490+0000", 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750491+0000", 2024-04-24T13:32:24.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5200000000000001e-06 2024-04-24T13:32:24.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750499+0000", 2024-04-24T13:32:24.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0700000000000007e-06 2024-04-24T13:32:24.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750522+0000", 2024-04-24T13:32:24.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2351999999999999e-05 2024-04-24T13:32:24.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:24.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.889e-05 2024-04-24T13:32:24.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750694+0000", 2024-04-24T13:32:24.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015310599999999999 2024-04-24T13:32:24.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751002+0000", 2024-04-24T13:32:24.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030817699999999997 2024-04-24T13:32:24.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:24.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751435+0000", 2024-04-24T13:32:24.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043325699999999999 2024-04-24T13:32:24.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:24.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753491+0000", 2024-04-24T13:32:24.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00205609 2024-04-24T13:32:24.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:24.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758630+0000", 2024-04-24T13:32:24.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005138531 2024-04-24T13:32:24.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758778+0000", 2024-04-24T13:32:24.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014789 2024-04-24T13:32:24.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758900+0000", 2024-04-24T13:32:24.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122111 2024-04-24T13:32:24.019 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.019 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.019 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.019 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1722 4.18 4:1805f73b:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:24.019 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750693+0000", 2024-04-24T13:32:24.019 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.2089873320000004, 2024-04-24T13:32:24.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088221259999999996, 2024-04-24T13:32:24.020 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:24.020 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:24.020 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:24.020 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:24.020 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:24.020 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:24.020 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1722 2024-04-24T13:32:24.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.020 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:24.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:24.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750693+0000", 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750693+0000", 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750694+0000", 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2300000000000001e-06 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750702+0000", 2024-04-24T13:32:24.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0930000000000003e-06 2024-04-24T13:32:24.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750721+0000", 2024-04-24T13:32:24.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8980000000000001e-05 2024-04-24T13:32:24.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750737+0000", 2024-04-24T13:32:24.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5676e-05 2024-04-24T13:32:24.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750896+0000", 2024-04-24T13:32:24.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015962999999999999 2024-04-24T13:32:24.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751255+0000", 2024-04-24T13:32:24.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035844199999999999 2024-04-24T13:32:24.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751697+0000", 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044219399999999997 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.754222+0000", 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025252819999999998 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759319+0000", 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050967230000000001 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759452+0000", 2024-04-24T13:32:24.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013312099999999999 2024-04-24T13:32:24.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759515+0000", 2024-04-24T13:32:24.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2755000000000005e-05 2024-04-24T13:32:24.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.025 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.025 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.026 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1725 4.13 4:cb20c8cc:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:24.026 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750779+0000", 2024-04-24T13:32:24.026 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.2089006940000004, 2024-04-24T13:32:24.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086438699999999997, 2024-04-24T13:32:24.026 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:24.026 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:24.026 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:24.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:24.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:24.026 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:24.026 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1725 2024-04-24T13:32:24.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.026 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:24.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:24.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750779+0000", 2024-04-24T13:32:24.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750779+0000", 2024-04-24T13:32:24.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750781+0000", 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2139999999999999e-06 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750788+0000", 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0589999999999997e-06 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750807+0000", 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9177e-05 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750901+0000", 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3955000000000004e-05 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751102+0000", 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020087499999999999 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751417+0000", 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000315464 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:24.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751796+0000", 2024-04-24T13:32:24.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037914099999999999 2024-04-24T13:32:24.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:24.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753965+0000", 2024-04-24T13:32:24.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021692040000000001 2024-04-24T13:32:24.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759226+0000", 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052606789999999999 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759350+0000", 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012385 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759423+0000", 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3251999999999996e-05 2024-04-24T13:32:24.031 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:1721 4.38 e82/22 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head v 82'7, mlcod=82'5)", 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.751818+0000", 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.2078617129999998, 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069060240000000002, 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:24.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751818+0000", 2024-04-24T13:32:24.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751818+0000", 2024-04-24T13:32:24.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751820+0000", 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8840000000000001e-06 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751838+0000", 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7612999999999999e-05 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751863+0000", 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4865999999999999e-05 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751883+0000", 2024-04-24T13:32:24.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0279e-05 2024-04-24T13:32:24.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752339+0000", 2024-04-24T13:32:24.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045636100000000002 2024-04-24T13:32:24.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752388+0000", 2024-04-24T13:32:24.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8782000000000002e-05 2024-04-24T13:32:24.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758630+0000", 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062420879999999998 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758724+0000", 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4151e-05 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.036 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:1724 4.38 e82/22 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head v 82'8, mlcod=82'5)", 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.753466+0000", 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.2062139250000001, 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061231640000000004, 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753466+0000", 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753466+0000", 2024-04-24T13:32:24.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753468+0000", 2024-04-24T13:32:24.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.57e-06 2024-04-24T13:32:24.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753483+0000", 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5455999999999999e-05 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753509+0000", 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5497e-05 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753525+0000", 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6175999999999999e-05 2024-04-24T13:32:24.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753665+0000", 2024-04-24T13:32:24.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014010699999999999 2024-04-24T13:32:24.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753717+0000", 2024-04-24T13:32:24.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1845000000000003e-05 2024-04-24T13:32:24.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759533+0000", 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058163609999999999 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759589+0000", 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6152e-05 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1809 4.1a 4:5ade8a4f:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941431+0000", 2024-04-24T13:32:24.041 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.0182488770000004, 2024-04-24T13:32:24.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0076807159999999998, 2024-04-24T13:32:24.042 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:24.042 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:24.042 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:24.042 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:24.042 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:24.042 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:24.042 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1809 2024-04-24T13:32:24.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.042 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:24.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:24.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941431+0000", 2024-04-24T13:32:24.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941431+0000", 2024-04-24T13:32:24.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941433+0000", 2024-04-24T13:32:24.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1900000000000002e-06 2024-04-24T13:32:24.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941443+0000", 2024-04-24T13:32:24.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8700000000000004e-06 2024-04-24T13:32:24.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941472+0000", 2024-04-24T13:32:24.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9105e-05 2024-04-24T13:32:24.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.044 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.044 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941487+0000", 2024-04-24T13:32:24.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4970000000000001e-05 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941625+0000", 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013815400000000001 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941786+0000", 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016102600000000001 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:24.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942051+0000", 2024-04-24T13:32:24.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000264911 2024-04-24T13:32:24.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:24.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.943709+0000", 2024-04-24T13:32:24.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016574409999999999 2024-04-24T13:32:24.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:24.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948959+0000", 2024-04-24T13:32:24.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052507129999999997 2024-04-24T13:32:24.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949050+0000", 2024-04-24T13:32:24.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0760999999999994e-05 2024-04-24T13:32:24.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949112+0000", 2024-04-24T13:32:24.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1575000000000006e-05 2024-04-24T13:32:24.047 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.047 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.047 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.048 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1811 4.35 4:ac3d4c50:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:24.048 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941523+0000", 2024-04-24T13:32:24.048 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.0181570329999996, 2024-04-24T13:32:24.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059788640000000004, 2024-04-24T13:32:24.048 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:24.048 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:24.048 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:24.048 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:24.048 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:24.048 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:24.048 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1811 2024-04-24T13:32:24.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.048 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941523+0000", 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941523+0000", 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941524+0000", 2024-04-24T13:32:24.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:32:24.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941529+0000", 2024-04-24T13:32:24.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8369999999999996e-06 2024-04-24T13:32:24.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941541+0000", 2024-04-24T13:32:24.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2303000000000001e-05 2024-04-24T13:32:24.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941577+0000", 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5685999999999997e-05 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941729+0000", 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015242000000000001 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941939+0000", 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000209805 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942217+0000", 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027807100000000001 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.945849+0000", 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036323509999999998 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947240+0000", 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001390397 2024-04-24T13:32:24.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947382+0000", 2024-04-24T13:32:24.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014174700000000001 2024-04-24T13:32:24.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947502+0000", 2024-04-24T13:32:24.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120217 2024-04-24T13:32:24.053 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.053 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.053 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.054 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1815 4.18 4:1805f73b:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:24.054 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941634+0000", 2024-04-24T13:32:24.054 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.0180460949999999, 2024-04-24T13:32:24.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072440860000000003, 2024-04-24T13:32:24.054 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:24.054 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:24.054 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:24.054 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:24.054 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:24.054 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:24.054 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1815 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941634+0000", 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941634+0000", 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941636+0000", 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.624e-06 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941643+0000", 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6720000000000004e-06 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941672+0000", 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9139999999999999e-05 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941688+0000", 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.594e-05 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941814+0000", 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126017 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942001+0000", 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018702899999999999 2024-04-24T13:32:24.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942249+0000", 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024771400000000001 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947111+0000", 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048622520000000001 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948617+0000", 2024-04-24T13:32:24.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015059400000000001 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948766+0000", 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148744 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948878+0000", 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112014 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1818 4.13 4:cb20c8cc:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941727+0000", 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.0179526929999998, 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071492509999999997, 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1818 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.060 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:24.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:24.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941727+0000", 2024-04-24T13:32:24.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941727+0000", 2024-04-24T13:32:24.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941729+0000", 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.513e-06 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941735+0000", 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4529999999999999e-06 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941755+0000", 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9836000000000001e-05 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941835+0000", 2024-04-24T13:32:24.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9437999999999994e-05 2024-04-24T13:32:24.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941970+0000", 2024-04-24T13:32:24.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013506100000000001 2024-04-24T13:32:24.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942162+0000", 2024-04-24T13:32:24.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192342 2024-04-24T13:32:24.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:24.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942464+0000", 2024-04-24T13:32:24.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030173400000000001 2024-04-24T13:32:24.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:24.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947169+0000", 2024-04-24T13:32:24.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047049800000000001 2024-04-24T13:32:24.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:24.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948661+0000", 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014922780000000001 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948776+0000", 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115165 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948877+0000", 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100451 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.065 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.066 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:1814 4.38 e82/22 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head v 82'9, mlcod=82'7)", 2024-04-24T13:32:24.066 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.942444+0000", 2024-04-24T13:32:24.066 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.0172355389999996, 2024-04-24T13:32:24.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048299049999999998, 2024-04-24T13:32:24.066 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:24.066 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:24.066 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:24.066 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:24.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:24.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942444+0000", 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942444+0000", 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942446+0000", 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3829999999999999e-06 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942483+0000", 2024-04-24T13:32:24.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7299000000000003e-05 2024-04-24T13:32:24.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942507+0000", 2024-04-24T13:32:24.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4110000000000001e-05 2024-04-24T13:32:24.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942552+0000", 2024-04-24T13:32:24.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4702e-05 2024-04-24T13:32:24.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942774+0000", 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022156199999999999 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942827+0000", 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3341999999999999e-05 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947190+0000", 2024-04-24T13:32:24.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043633150000000004 2024-04-24T13:32:24.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.070 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.070 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947274+0000", 2024-04-24T13:32:24.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4191999999999996e-05 2024-04-24T13:32:24.070 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.070 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.070 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.070 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1829 4.30 4:0ff29942:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.6.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:24.070 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:19.089328+0000", 2024-04-24T13:32:24.070 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.8703521270000003, 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045862450000000001, 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1829 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089328+0000", 2024-04-24T13:32:24.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089328+0000", 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089330+0000", 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2469999999999998e-06 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089342+0000", 2024-04-24T13:32:24.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1463e-05 2024-04-24T13:32:24.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089376+0000", 2024-04-24T13:32:24.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199000000000002e-05 2024-04-24T13:32:24.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089402+0000", 2024-04-24T13:32:24.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6570000000000001e-05 2024-04-24T13:32:24.073 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.073 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.073 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089566+0000", 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000163256 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089877+0000", 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031148800000000001 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.090270+0000", 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039329799999999999 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.074 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.092133+0000", 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018626210000000001 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.093713+0000", 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001579851 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.093792+0000", 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8807999999999995e-05 2024-04-24T13:32:24.075 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.093914+0000", 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012244400000000001 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1922 4.30 4:0ff29942:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.6.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:19.273806+0000", 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.6858738500000001, 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043024910000000003, 2024-04-24T13:32:24.076 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1922 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273806+0000", 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.077 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273806+0000", 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273808+0000", 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1100000000000001e-06 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273818+0000", 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8640000000000008e-06 2024-04-24T13:32:24.078 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273849+0000", 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0632000000000001e-05 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273866+0000", 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7703e-05 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.275434+0000", 2024-04-24T13:32:24.079 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015677410000000001 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.275663+0000", 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022848899999999999 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.275963+0000", 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030008699999999999 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.277429+0000", 2024-04-24T13:32:24.080 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014665360000000001 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.277879+0000", 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044962399999999998 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.278010+0000", 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013137700000000001 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:24.081 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.278109+0000", 2024-04-24T13:32:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8327999999999998e-05 2024-04-24T13:32:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:24.082 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:24.082 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:24.084 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:24.084 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:24.082+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:24.185 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:24.180+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:24.240 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:32:24.253 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:24.253 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:24.253 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:24.253 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:24.267 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:24.314 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:24.314+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:24.385 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:24.386 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:24.386 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:24.380+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:24.387 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:24.387 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:24.387 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:24.387 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:24.387 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:24.406 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:24.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:24.407 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:24.419 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:24.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:24.435 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:24.436 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:24.453 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:24.453 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:24.470 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:24.470 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:24.487 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:24.484+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:24.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:24.488 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:24.507 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:24.507 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:24.580 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:24.580 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:24.588 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:24.586+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:24.595 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:24.689 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:24.686+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:24.755 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:24.755 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:24.769 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:24.790 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:24.784+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:24.891 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:24.890+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:24.931 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:24.932 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:24.945 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:25.034 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:25.034+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:25.092 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:25.088+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:25.108 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:25.108 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:25.123 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:25.193 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:25.188+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:25.283 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:25.284 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:25.294 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:25.294+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:25.296 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:32:25.395 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:25.394+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:25.415 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:32:25.456 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:25.456 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:25.470 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:32:25.515 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:25.514+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:25.546 INFO:tasks.workunit.client.0.smithi071.stdout:quota enabled for the bucket: buck_2024_03_24_13_32_21 2024-04-24T13:32:25.546 INFO:tasks.workunit.client.0.smithi071.stdout:adding file to bucket: 2Gb. 2024-04-24T13:32:25.546 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:25.546 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - set max size and ensure that objects upload beyond max size is not entertained 2024-04-24T13:32:25.546 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:25.546 INFO:tasks.workunit.client.0.smithi071.stdout:delete objects successful 2024-04-24T13:32:25.598 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:25.592+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:25.631 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:25.632 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:25.646 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:32:25.699 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:25.698+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:25.763 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:25.779 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:32:25.800 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:25.798+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:25.900 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:25.900 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:25.901 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:25.898+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:25.916 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:32:26.001 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:25.996+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:26.027 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:26.027 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:26.044 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:32:26.102 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:26.102+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:26.204 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:26.202+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:26.205 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:26.205 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:26.222 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:32:26.227 INFO:tasks.workunit.client.0.smithi071.stderr:100+0 records in 2024-04-24T13:32:26.227 INFO:tasks.workunit.client.0.smithi071.stderr:100+0 records out 2024-04-24T13:32:26.227 INFO:tasks.workunit.client.0.smithi071.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 0.679527 s, 1.5 GB/s 2024-04-24T13:32:26.305 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:26.302+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:26.333 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:26.333 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:26.346 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:32:26.401 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:32:26.405 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:26.400+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:26.505 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:26.505 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:26.506 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:26.502+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:26.517 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:32:26.523 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:32:26.607 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:26.606+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:26.631 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:26.632 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:26.645 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:32:26.691 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:26.692 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:26.707 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:26.706+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:26.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:26.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:26.723 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:26.724 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:26.739 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:26.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:26.755 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:26.755 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:26.755 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:26.755 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:26.755 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:26.759 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:26.759 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:26.768 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:32:26.779 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:26.779 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:26.807 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:26.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:26.808 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:26.806+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:26.828 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:26.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:26.886 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:26.886 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:26.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:26.886 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:26.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:236 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.483977474, 2024-04-24T13:32:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003215206, 2024-04-24T13:32:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 236 2024-04-24T13:32:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.887 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:26.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399445+0000", 2024-04-24T13:32:26.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399448+0000", 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0570000000000001e-06 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399461+0000", 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.342e-05 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399495+0000", 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3042e-05 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399511+0000", 2024-04-24T13:32:26.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6656000000000001e-05 2024-04-24T13:32:26.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399635+0000", 2024-04-24T13:32:26.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123609 2024-04-24T13:32:26.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.399899+0000", 2024-04-24T13:32:26.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026446199999999998 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.400300+0000", 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040073399999999998 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402002+0000", 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00170195 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:26.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402511+0000", 2024-04-24T13:32:26.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00050917699999999998 2024-04-24T13:32:26.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402592+0000", 2024-04-24T13:32:26.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0710999999999993e-05 2024-04-24T13:32:26.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.402660+0000", 2024-04-24T13:32:26.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8387999999999996e-05 2024-04-24T13:32:26.892 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:299 6.14 6:2c0c0c23:reshard::reshard.0000000001:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.468193716, 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040932160000000002, 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:26.893 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:26.894 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 299 2024-04-24T13:32:26.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.894 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:26.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415229+0000", 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415230+0000", 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5039999999999999e-06 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415237+0000", 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.233e-06 2024-04-24T13:32:26.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415254+0000", 2024-04-24T13:32:26.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6466000000000001e-05 2024-04-24T13:32:26.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415263+0000", 2024-04-24T13:32:26.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9190000000000005e-06 2024-04-24T13:32:26.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415328+0000", 2024-04-24T13:32:26.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5287e-05 2024-04-24T13:32:26.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415416+0000", 2024-04-24T13:32:26.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7859e-05 2024-04-24T13:32:26.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:26.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.415546+0000", 2024-04-24T13:32:26.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129691 2024-04-24T13:32:26.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:26.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.416487+0000", 2024-04-24T13:32:26.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094159400000000002 2024-04-24T13:32:26.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:26.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419224+0000", 2024-04-24T13:32:26.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027366309999999998 2024-04-24T13:32:26.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419282+0000", 2024-04-24T13:32:26.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8298999999999999e-05 2024-04-24T13:32:26.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.419322+0000", 2024-04-24T13:32:26.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9733000000000001e-05 2024-04-24T13:32:26.899 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.899 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.900 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.900 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:790 6.12 e32/26 6:4a2e2f65:::obj_delete_at_hint.0000000071:head v 32'6, mlcod=32'4)", 2024-04-24T13:32:26.900 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:26.900 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.024920924, 2024-04-24T13:32:26.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003653964, 2024-04-24T13:32:26.900 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.901 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.901 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.901 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:26.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858502+0000", 2024-04-24T13:32:26.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858503+0000", 2024-04-24T13:32:26.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.75e-06 2024-04-24T13:32:26.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858515+0000", 2024-04-24T13:32:26.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1966e-05 2024-04-24T13:32:26.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858543+0000", 2024-04-24T13:32:26.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7705999999999999e-05 2024-04-24T13:32:26.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858556+0000", 2024-04-24T13:32:26.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3353000000000001e-05 2024-04-24T13:32:26.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858654+0000", 2024-04-24T13:32:26.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7486999999999997e-05 2024-04-24T13:32:26.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.858690+0000", 2024-04-24T13:32:26.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6179e-05 2024-04-24T13:32:26.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862078+0000", 2024-04-24T13:32:26.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033879359999999998 2024-04-24T13:32:26.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.862156+0000", 2024-04-24T13:32:26.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7587000000000001e-05 2024-04-24T13:32:26.907 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.907 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:817 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 113.961577406, 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033612289999999999, 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:26.908 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 817 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921845+0000", 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921848+0000", 2024-04-24T13:32:26.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.089e-06 2024-04-24T13:32:26.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921863+0000", 2024-04-24T13:32:26.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4593000000000001e-05 2024-04-24T13:32:26.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921895+0000", 2024-04-24T13:32:26.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2616000000000001e-05 2024-04-24T13:32:26.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.921913+0000", 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7275999999999999e-05 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922071+0000", 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015866200000000001 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.922449+0000", 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037779399999999998 2024-04-24T13:32:26.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.923032+0000", 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058337199999999997 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924545+0000", 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001512785 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.924934+0000", 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00038838799999999998 2024-04-24T13:32:26.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925081+0000", 2024-04-24T13:32:26.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000147622 2024-04-24T13:32:26.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.925206+0000", 2024-04-24T13:32:26.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012503199999999999 2024-04-24T13:32:26.913 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.913 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.913 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:819 6.14 6:2d8f1e3e:::obj_delete_at_hint.0000000080:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 113.956901711, 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030923579999999999, 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 819 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.914 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926521+0000", 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926523+0000", 2024-04-24T13:32:26.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1629999999999999e-06 2024-04-24T13:32:26.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926534+0000", 2024-04-24T13:32:26.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0749e-05 2024-04-24T13:32:26.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926566+0000", 2024-04-24T13:32:26.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2069000000000001e-05 2024-04-24T13:32:26.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926585+0000", 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9049999999999999e-05 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926705+0000", 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011981600000000001 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.926934+0000", 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022945600000000001 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:26.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.927410+0000", 2024-04-24T13:32:26.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00047591799999999998 2024-04-24T13:32:26.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:26.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.928689+0000", 2024-04-24T13:32:26.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012786869999999999 2024-04-24T13:32:26.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:26.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929353+0000", 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066437799999999997 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929500+0000", 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014718899999999999 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.929613+0000", 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112883 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.919 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:843 6.14 6:2d09e641:::obj_delete_at_hint.0000000088:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 113.90085698, 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030584869999999999, 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 843 2024-04-24T13:32:26.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982565+0000", 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982568+0000", 2024-04-24T13:32:26.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0540000000000002e-06 2024-04-24T13:32:26.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982578+0000", 2024-04-24T13:32:26.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0026e-05 2024-04-24T13:32:26.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982610+0000", 2024-04-24T13:32:26.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2858999999999998e-05 2024-04-24T13:32:26.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982630+0000", 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9432999999999998e-05 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982759+0000", 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000129565 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.982983+0000", 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000224043 2024-04-24T13:32:26.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.983468+0000", 2024-04-24T13:32:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048480499999999999 2024-04-24T13:32:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.984767+0000", 2024-04-24T13:32:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001298953 2024-04-24T13:32:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:26.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985348+0000", 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000580874 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985509+0000", 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045499999999999 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.985624+0000", 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011542 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.926 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:847 6.14 6:2dbd613a:::obj_delete_at_hint.0000000090:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:26.926 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:26.926 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 113.89111094499999, 2024-04-24T13:32:26.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003477066, 2024-04-24T13:32:26.926 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.926 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.926 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.926 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.926 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:26.926 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:26.926 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 847 2024-04-24T13:32:26.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992312+0000", 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992314+0000", 2024-04-24T13:32:26.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2730000000000001e-06 2024-04-24T13:32:26.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992329+0000", 2024-04-24T13:32:26.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5536000000000002e-05 2024-04-24T13:32:26.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992360+0000", 2024-04-24T13:32:26.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0846000000000002e-05 2024-04-24T13:32:26.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992377+0000", 2024-04-24T13:32:26.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6929999999999999e-05 2024-04-24T13:32:26.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992528+0000", 2024-04-24T13:32:26.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000150438 2024-04-24T13:32:26.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.992881+0000", 2024-04-24T13:32:26.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00035310199999999999 2024-04-24T13:32:26.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:26.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.993441+0000", 2024-04-24T13:32:26.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00056022299999999999 2024-04-24T13:32:26.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:26.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.994924+0000", 2024-04-24T13:32:26.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014834959999999999 2024-04-24T13:32:26.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995507+0000", 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00058232399999999995 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995654+0000", 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014729899999999999 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.995789+0000", 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000134599 2024-04-24T13:32:26.932 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.933 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.933 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.933 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:951 6.f 6:f04f5452:::obj_delete_at_hint.0000000124:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:26.934 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:26.934 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 113.651480791, 2024-04-24T13:32:26.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00325845, 2024-04-24T13:32:26.934 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.934 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.934 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:26.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:26.934 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 951 2024-04-24T13:32:26.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.934 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:26.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231942+0000", 2024-04-24T13:32:26.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231944+0000", 2024-04-24T13:32:26.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0229999999999999e-06 2024-04-24T13:32:26.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231957+0000", 2024-04-24T13:32:26.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.312e-05 2024-04-24T13:32:26.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.231984+0000", 2024-04-24T13:32:26.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7423000000000002e-05 2024-04-24T13:32:26.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232001+0000", 2024-04-24T13:32:26.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7099e-05 2024-04-24T13:32:26.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232117+0000", 2024-04-24T13:32:26.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115277 2024-04-24T13:32:26.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232298+0000", 2024-04-24T13:32:26.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000181087 2024-04-24T13:32:26.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:26.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.232798+0000", 2024-04-24T13:32:26.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00049998800000000004 2024-04-24T13:32:26.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:26.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234141+0000", 2024-04-24T13:32:26.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013433659999999999 2024-04-24T13:32:26.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:26.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.234910+0000", 2024-04-24T13:32:26.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00076921300000000004 2024-04-24T13:32:26.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235076+0000", 2024-04-24T13:32:26.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016592500000000001 2024-04-24T13:32:26.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:33.235200+0000", 2024-04-24T13:32:26.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000123929 2024-04-24T13:32:26.941 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.941 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.941 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.941 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5087.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94838597716400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:26.941 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.477320+0000", 2024-04-24T13:32:26.941 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.406102808, 2024-04-24T13:32:26.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053295189999999996, 2024-04-24T13:32:26.942 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.942 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.942 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.942 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.942 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5087", 2024-04-24T13:32:26.943 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1617668435", 2024-04-24T13:32:26.943 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 100 2024-04-24T13:32:26.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.943 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477320+0000", 2024-04-24T13:32:26.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477320+0000", 2024-04-24T13:32:26.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477321+0000", 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4890000000000001e-06 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477325+0000", 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1919999999999998e-06 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477340+0000", 2024-04-24T13:32:26.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4793e-05 2024-04-24T13:32:26.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477356+0000", 2024-04-24T13:32:26.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:32:26.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477402+0000", 2024-04-24T13:32:26.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5868999999999997e-05 2024-04-24T13:32:26.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477459+0000", 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7058999999999997e-05 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.477540+0000", 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0446999999999997e-05 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.480172+0000", 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026327479999999999 2024-04-24T13:32:26.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.482561+0000", 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023886749999999998 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.482601+0000", 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0051e-05 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.482649+0000", 2024-04-24T13:32:26.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8031000000000001e-05 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1569 4.32 4:4d570018:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.3.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.556835+0000", 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.3265874029999996, 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039046649999999999, 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.949 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1569 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556835+0000", 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556835+0000", 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556837+0000", 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.902e-06 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556843+0000", 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3990000000000001e-06 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556871+0000", 2024-04-24T13:32:26.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8044000000000001e-05 2024-04-24T13:32:26.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556880+0000", 2024-04-24T13:32:26.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2190000000000004e-06 2024-04-24T13:32:26.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.556936+0000", 2024-04-24T13:32:26.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6060000000000002e-05 2024-04-24T13:32:26.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.557016+0000", 2024-04-24T13:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0029000000000002e-05 2024-04-24T13:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.557118+0000", 2024-04-24T13:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102768 2024-04-24T13:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.558207+0000", 2024-04-24T13:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010886279999999999 2024-04-24T13:32:26.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:26.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.560675+0000", 2024-04-24T13:32:26.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024681249999999998 2024-04-24T13:32:26.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.560706+0000", 2024-04-24T13:32:26.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1195999999999997e-05 2024-04-24T13:32:26.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.560740+0000", 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3294999999999999e-05 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.5111.0:56 7.14 e82/28 7:2b04a3e9:::notify.6:head v 82'42, mlcod=81'40)", 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.691653+0000", 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1917697389999997, 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044709930000000004, 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.955 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.956 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691653+0000", 2024-04-24T13:32:26.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691653+0000", 2024-04-24T13:32:26.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691653+0000", 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1799999999999999e-07 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691655+0000", 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4260000000000002e-06 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691660+0000", 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0030000000000002e-06 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691664+0000", 2024-04-24T13:32:26.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6200000000000001e-06 2024-04-24T13:32:26.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691739+0000", 2024-04-24T13:32:26.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5288000000000002e-05 2024-04-24T13:32:26.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691759+0000", 2024-04-24T13:32:26.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0072e-05 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696079+0000", 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043192509999999996 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696124+0000", 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5114999999999997e-05 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1589 4.32 4:4e593490:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733643+0000", 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.149779852, 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042263659999999996, 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1589 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733643+0000", 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733643+0000", 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733645+0000", 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.193e-06 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733654+0000", 2024-04-24T13:32:26.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0110000000000006e-06 2024-04-24T13:32:26.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733674+0000", 2024-04-24T13:32:26.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0208e-05 2024-04-24T13:32:26.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733684+0000", 2024-04-24T13:32:26.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6509999999999996e-06 2024-04-24T13:32:26.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733767+0000", 2024-04-24T13:32:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3413999999999998e-05 2024-04-24T13:32:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733894+0000", 2024-04-24T13:32:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012658999999999999 2024-04-24T13:32:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:26.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734043+0000", 2024-04-24T13:32:26.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014896000000000001 2024-04-24T13:32:26.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:26.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.735108+0000", 2024-04-24T13:32:26.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010658530000000001 2024-04-24T13:32:26.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:26.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737752+0000", 2024-04-24T13:32:26.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026430749999999999 2024-04-24T13:32:26.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737832+0000", 2024-04-24T13:32:26.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0039999999999999e-05 2024-04-24T13:32:26.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737869+0000", 2024-04-24T13:32:26.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7370999999999998e-05 2024-04-24T13:32:26.965 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.965 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.966 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.966 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1590 4.0 4:0175f652:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:26.966 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733724+0000", 2024-04-24T13:32:26.966 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1496980790000002, 2024-04-24T13:32:26.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004720414, 2024-04-24T13:32:26.966 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.966 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.966 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.966 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.966 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:26.967 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:26.967 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1590 2024-04-24T13:32:26.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.967 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733724+0000", 2024-04-24T13:32:26.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733724+0000", 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733725+0000", 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.99e-07 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733730+0000", 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6569999999999996e-06 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733739+0000", 2024-04-24T13:32:26.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2129999999999997e-06 2024-04-24T13:32:26.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733745+0000", 2024-04-24T13:32:26.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.46e-06 2024-04-24T13:32:26.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733982+0000", 2024-04-24T13:32:26.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023672299999999999 2024-04-24T13:32:26.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734092+0000", 2024-04-24T13:32:26.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010942000000000001 2024-04-24T13:32:26.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:26.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734222+0000", 2024-04-24T13:32:26.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013054599999999999 2024-04-24T13:32:26.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:26.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.735192+0000", 2024-04-24T13:32:26.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00096959800000000001 2024-04-24T13:32:26.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:26.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738379+0000", 2024-04-24T13:32:26.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003187133 2024-04-24T13:32:26.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738407+0000", 2024-04-24T13:32:26.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8218e-05 2024-04-24T13:32:26.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738445+0000", 2024-04-24T13:32:26.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7747000000000003e-05 2024-04-24T13:32:26.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.973 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.973 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1591 4.34 4:2f8daf8d:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:26.973 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733763+0000", 2024-04-24T13:32:26.973 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1496597499999996, 2024-04-24T13:32:26.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041142720000000004, 2024-04-24T13:32:26.973 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.973 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.974 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:26.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:26.974 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1591 2024-04-24T13:32:26.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.974 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733763+0000", 2024-04-24T13:32:26.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733763+0000", 2024-04-24T13:32:26.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733763+0000", 2024-04-24T13:32:26.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9800000000000004e-07 2024-04-24T13:32:26.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733768+0000", 2024-04-24T13:32:26.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9529999999999998e-06 2024-04-24T13:32:26.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733775+0000", 2024-04-24T13:32:26.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7569999999999998e-06 2024-04-24T13:32:26.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733780+0000", 2024-04-24T13:32:26.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3619999999999997e-06 2024-04-24T13:32:26.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733836+0000", 2024-04-24T13:32:26.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5291000000000003e-05 2024-04-24T13:32:26.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733953+0000", 2024-04-24T13:32:26.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117404 2024-04-24T13:32:26.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:26.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734093+0000", 2024-04-24T13:32:26.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139896 2024-04-24T13:32:26.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:26.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.735096+0000", 2024-04-24T13:32:26.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010028859999999999 2024-04-24T13:32:26.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737810+0000", 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002713956 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737842+0000", 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2288e-05 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737877+0000", 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4981000000000003e-05 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.980 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1584 4.4 e82/22 4:22d8a9f0:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.2:head v 82'1, mlcod=0'0)", 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.734672+0000", 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1487499749999994, 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003155649, 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734672+0000", 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734672+0000", 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734673+0000", 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7000000000000003e-07 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734679+0000", 2024-04-24T13:32:26.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4199999999999998e-06 2024-04-24T13:32:26.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734689+0000", 2024-04-24T13:32:26.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0553e-05 2024-04-24T13:32:26.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734696+0000", 2024-04-24T13:32:26.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7769999999999997e-06 2024-04-24T13:32:26.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734767+0000", 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0747999999999994e-05 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734783+0000", 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6073e-05 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737789+0000", 2024-04-24T13:32:26.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030059209999999999 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737828+0000", 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9286999999999998e-05 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5165.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94314959539792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.105440+0000", 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.7779827319999999, 2024-04-24T13:32:26.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003116597, 2024-04-24T13:32:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5165", 2024-04-24T13:32:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/3607738460", 2024-04-24T13:32:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 51 2024-04-24T13:32:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105440+0000", 2024-04-24T13:32:26.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105440+0000", 2024-04-24T13:32:26.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105440+0000", 2024-04-24T13:32:26.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8199999999999999e-07 2024-04-24T13:32:26.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105444+0000", 2024-04-24T13:32:26.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3100000000000001e-06 2024-04-24T13:32:26.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105453+0000", 2024-04-24T13:32:26.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7599999999999997e-06 2024-04-24T13:32:26.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105459+0000", 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2700000000000004e-06 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105501+0000", 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1978999999999999e-05 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105557+0000", 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6645999999999999e-05 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.105638+0000", 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0889000000000004e-05 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.106382+0000", 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074407800000000001 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.108438+0000", 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020552919999999998 2024-04-24T13:32:26.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.108490+0000", 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2784000000000001e-05 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.108556+0000", 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5907000000000004e-05 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.5165.0:56 7.14 e82/28 7:2b04a3e9:::notify.6:head v 82'51, mlcod=82'49)", 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.110473+0000", 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.7729499650000005, 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047884579999999998, 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110473+0000", 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110473+0000", 2024-04-24T13:32:26.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110473+0000", 2024-04-24T13:32:26.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7099999999999997e-07 2024-04-24T13:32:26.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110478+0000", 2024-04-24T13:32:26.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2920000000000003e-06 2024-04-24T13:32:26.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110486+0000", 2024-04-24T13:32:26.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3509999999999996e-06 2024-04-24T13:32:26.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110492+0000", 2024-04-24T13:32:26.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0769999999999996e-06 2024-04-24T13:32:26.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:26.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110566+0000", 2024-04-24T13:32:26.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3937999999999996e-05 2024-04-24T13:32:26.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:26.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110584+0000", 2024-04-24T13:32:26.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8666000000000001e-05 2024-04-24T13:32:26.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:26.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115219+0000", 2024-04-24T13:32:26.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0046345730000000003 2024-04-24T13:32:26.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115261+0000", 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2190000000000001e-05 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1707 4.32 4:4e593490:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.605950+0000", 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2774722870000002, 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037535720000000002, 2024-04-24T13:32:26.996 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:26.997 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:26.997 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:26.997 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:26.997 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:26.997 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:26.997 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1707 2024-04-24T13:32:26.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.997 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:26.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:26.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605950+0000", 2024-04-24T13:32:26.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:26.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605950+0000", 2024-04-24T13:32:26.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:26.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:26.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605951+0000", 2024-04-24T13:32:26.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.850000000000001e-07 2024-04-24T13:32:26.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605956+0000", 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9089999999999999e-06 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605970+0000", 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3604000000000001e-05 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605978+0000", 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8560000000000007e-06 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:26.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606096+0000", 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011834 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606166+0000", 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0350000000000002e-05 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606265+0000", 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8778999999999997e-05 2024-04-24T13:32:27.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.607729+0000", 2024-04-24T13:32:27.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014643169999999999 2024-04-24T13:32:27.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.609631+0000", 2024-04-24T13:32:27.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001901724 2024-04-24T13:32:27.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.609672+0000", 2024-04-24T13:32:27.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0859999999999998e-05 2024-04-24T13:32:27.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.609704+0000", 2024-04-24T13:32:27.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1847999999999997e-05 2024-04-24T13:32:27.002 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.002 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1708 4.0 4:0175f652:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.605998+0000", 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2774248519999993, 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047686100000000004, 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.003 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1708 2024-04-24T13:32:27.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.004 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605998+0000", 2024-04-24T13:32:27.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605998+0000", 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605998+0000", 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4000000000000002e-07 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606001+0000", 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.061e-06 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606009+0000", 2024-04-24T13:32:27.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8429999999999993e-06 2024-04-24T13:32:27.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606015+0000", 2024-04-24T13:32:27.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0569999999999998e-06 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606618+0000", 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00060244400000000005 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606689+0000", 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1363000000000001e-05 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:27.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606776+0000", 2024-04-24T13:32:27.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6891000000000005e-05 2024-04-24T13:32:27.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610483+0000", 2024-04-24T13:32:27.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037067699999999999 2024-04-24T13:32:27.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610710+0000", 2024-04-24T13:32:27.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022745600000000001 2024-04-24T13:32:27.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610745+0000", 2024-04-24T13:32:27.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4839000000000003e-05 2024-04-24T13:32:27.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610766+0000", 2024-04-24T13:32:27.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1345999999999999e-05 2024-04-24T13:32:27.010 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.010 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.010 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.010 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1702 4.4 e82/22 4:22d8a9f0:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.2:head v 82'2, mlcod=0'0)", 2024-04-24T13:32:27.010 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.606781+0000", 2024-04-24T13:32:27.010 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2766419110000005, 2024-04-24T13:32:27.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0037302279999999999, 2024-04-24T13:32:27.010 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.011 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.011 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.011 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606781+0000", 2024-04-24T13:32:27.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606781+0000", 2024-04-24T13:32:27.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606781+0000", 2024-04-24T13:32:27.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1200000000000001e-07 2024-04-24T13:32:27.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606788+0000", 2024-04-24T13:32:27.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2430000000000002e-06 2024-04-24T13:32:27.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606796+0000", 2024-04-24T13:32:27.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7760000000000003e-06 2024-04-24T13:32:27.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606803+0000", 2024-04-24T13:32:27.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6800000000000004e-06 2024-04-24T13:32:27.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606842+0000", 2024-04-24T13:32:27.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8546e-05 2024-04-24T13:32:27.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606860+0000", 2024-04-24T13:32:27.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8672999999999999e-05 2024-04-24T13:32:27.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610490+0000", 2024-04-24T13:32:27.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036294370000000001 2024-04-24T13:32:27.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610511+0000", 2024-04-24T13:32:27.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0961000000000001e-05 2024-04-24T13:32:27.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.015 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.015 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.016 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:27.017 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:27.018 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:27.012+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:27.118 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:27.116+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:27.175 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:27.175 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:27.175 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:27.175 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:27.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:27.230 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:27.228+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:27.321 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:27.318+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:27.347 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:27.347 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:27.347 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:27.347 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:27.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:27.422 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:27.420+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:27.472 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:27.472 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:27.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:27.472 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:27.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.473 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:44 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:32:27.473 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:27.473 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 120.224197445, 2024-04-24T13:32:27.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057346300000000001, 2024-04-24T13:32:27.473 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.473 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.473 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:32:27.473 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.473 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.473 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.473 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 44 2024-04-24T13:32:27.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.474 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:27.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247274+0000", 2024-04-24T13:32:27.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247277+0000", 2024-04-24T13:32:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3459999999999998e-06 2024-04-24T13:32:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247344+0000", 2024-04-24T13:32:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6768999999999997e-05 2024-04-24T13:32:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247379+0000", 2024-04-24T13:32:27.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4573999999999998e-05 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247402+0000", 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3303e-05 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247599+0000", 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019720499999999999 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:32:27.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.247622+0000", 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2512999999999999e-05 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.252825+0000", 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052035270000000003 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:27.253009+0000", 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018339300000000001 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.477 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 115.19555493199999, 2024-04-24T13:32:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:32:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.478 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:32:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:32:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:32:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:32:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:32:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:32:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:32:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:32:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:32:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:32:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:32:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:32:27.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:27.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:32:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:32:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:32:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:32:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:32:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:32:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.484 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:231 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 115.090600765, 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040131660000000003, 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 231 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380871+0000", 2024-04-24T13:32:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380873+0000", 2024-04-24T13:32:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2400000000000002e-06 2024-04-24T13:32:27.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380884+0000", 2024-04-24T13:32:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0645999999999999e-05 2024-04-24T13:32:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380919+0000", 2024-04-24T13:32:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5026e-05 2024-04-24T13:32:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.380934+0000", 2024-04-24T13:32:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.522e-05 2024-04-24T13:32:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381077+0000", 2024-04-24T13:32:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014362500000000001 2024-04-24T13:32:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.381453+0000", 2024-04-24T13:32:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00037581799999999999 2024-04-24T13:32:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.382170+0000", 2024-04-24T13:32:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071714999999999995 2024-04-24T13:32:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.383955+0000", 2024-04-24T13:32:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017847710000000001 2024-04-24T13:32:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384619+0000", 2024-04-24T13:32:27.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00066381600000000002 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384770+0000", 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015067800000000001 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.384884+0000", 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114176 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:562 6.b 6:d201668e:::obj_delete_at_hint.0000000023:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.91863753200001, 2024-04-24T13:32:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048608870000000004, 2024-04-24T13:32:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 562 2024-04-24T13:32:27.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552834+0000", 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552837+0000", 2024-04-24T13:32:27.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8499999999999998e-06 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552852+0000", 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4866e-05 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552890+0000", 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8166e-05 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.552905+0000", 2024-04-24T13:32:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5255e-05 2024-04-24T13:32:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553053+0000", 2024-04-24T13:32:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014824599999999999 2024-04-24T13:32:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553425+0000", 2024-04-24T13:32:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000371512 2024-04-24T13:32:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.553969+0000", 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00054421500000000002 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.554987+0000", 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001017855 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557606+0000", 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026195839999999999 2024-04-24T13:32:27.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557655+0000", 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8575000000000002e-05 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.557695+0000", 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9762999999999999e-05 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:838 6.c 6:330b1641:::obj_delete_at_hint.0000000087:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 114.50052923699999, 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034937589999999999, 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 838 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970942+0000", 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970944+0000", 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3360000000000002e-06 2024-04-24T13:32:27.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970959+0000", 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.469e-05 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.970989+0000", 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0159e-05 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971004+0000", 2024-04-24T13:32:27.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971147+0000", 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014242500000000001 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.971514+0000", 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036720900000000001 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:27.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.972113+0000", 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00059902100000000004 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.973403+0000", 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012904189999999999 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974152+0000", 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074879600000000003 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974316+0000", 2024-04-24T13:32:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164308 2024-04-24T13:32:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.974436+0000", 2024-04-24T13:32:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119453 2024-04-24T13:32:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.502 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1182 4.16 e81/22 4:6b47d35a:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.1.10:head v 81'1, mlcod=0'0)", 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:15.105295+0000", 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.366176815999999, 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036488269999999999, 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105295+0000", 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105295+0000", 2024-04-24T13:32:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105295+0000", 2024-04-24T13:32:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.91e-07 2024-04-24T13:32:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105299+0000", 2024-04-24T13:32:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3390000000000003e-06 2024-04-24T13:32:27.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105309+0000", 2024-04-24T13:32:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0025e-05 2024-04-24T13:32:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105318+0000", 2024-04-24T13:32:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7779999999999996e-06 2024-04-24T13:32:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105619+0000", 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00030148700000000002 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.105636+0000", 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6571000000000001e-05 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.108904+0000", 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003267739 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:15.108943+0000", 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9597000000000001e-05 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5111.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94137918829056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.691233+0000", 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.7802380329999998, 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050209349999999998, 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5111", 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1624747613", 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 55 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691233+0000", 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691233+0000", 2024-04-24T13:32:27.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691235+0000", 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2610000000000001e-06 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691239+0000", 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2139999999999998e-06 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691251+0000", 2024-04-24T13:32:27.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1776999999999999e-05 2024-04-24T13:32:27.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691257+0000", 2024-04-24T13:32:27.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0179999999999998e-06 2024-04-24T13:32:27.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691310+0000", 2024-04-24T13:32:27.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3201000000000001e-05 2024-04-24T13:32:27.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691387+0000", 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6762999999999997e-05 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691537+0000", 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149958 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.693654+0000", 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021170270000000001 2024-04-24T13:32:27.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696131+0000", 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024774179999999999 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696181+0000", 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0046000000000002e-05 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696254+0000", 2024-04-24T13:32:27.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3251999999999996e-05 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5111.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.691278+0000", 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.7801931730000007, 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050104219999999996, 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.513 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5111", 2024-04-24T13:32:27.514 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1624747613", 2024-04-24T13:32:27.514 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 56 2024-04-24T13:32:27.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.514 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691278+0000", 2024-04-24T13:32:27.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691278+0000", 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691279+0000", 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0200000000000003e-07 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691281+0000", 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.12e-06 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691286+0000", 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2100000000000001e-06 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691289+0000", 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5200000000000002e-06 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691336+0000", 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6771000000000003e-05 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691411+0000", 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4689000000000003e-05 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.691537+0000", 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012561899999999999 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.693529+0000", 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001992649 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696226+0000", 2024-04-24T13:32:27.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026964070000000001 2024-04-24T13:32:27.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696265+0000", 2024-04-24T13:32:27.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9477000000000002e-05 2024-04-24T13:32:27.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.696289+0000", 2024-04-24T13:32:27.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3558e-05 2024-04-24T13:32:27.519 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.519 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.519 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.519 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1588 4.29 4:950e3da7:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:27.519 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733711+0000", 2024-04-24T13:32:27.519 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.7377599559999997, 2024-04-24T13:32:27.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004339847, 2024-04-24T13:32:27.519 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.519 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.519 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.519 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1588 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733711+0000", 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733711+0000", 2024-04-24T13:32:27.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733712+0000", 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4099999999999999e-07 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733716+0000", 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6890000000000002e-06 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733728+0000", 2024-04-24T13:32:27.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2660000000000001e-05 2024-04-24T13:32:27.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733734+0000", 2024-04-24T13:32:27.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8289999999999996e-06 2024-04-24T13:32:27.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733787+0000", 2024-04-24T13:32:27.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2408999999999999e-05 2024-04-24T13:32:27.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733896+0000", 2024-04-24T13:32:27.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010933 2024-04-24T13:32:27.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:27.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734032+0000", 2024-04-24T13:32:27.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013609200000000001 2024-04-24T13:32:27.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737906+0000", 2024-04-24T13:32:27.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038740530000000001 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737971+0000", 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4941e-05 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738015+0000", 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4475999999999999e-05 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738051+0000", 2024-04-24T13:32:27.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5827000000000001e-05 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1582 4.16 e82/22 4:69bcb5d9:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.0:head v 82'3, mlcod=81'1)", 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.734337+0000", 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.7371340400000008, 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003588585, 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734337+0000", 2024-04-24T13:32:27.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734337+0000", 2024-04-24T13:32:27.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734338+0000", 2024-04-24T13:32:27.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1519999999999999e-06 2024-04-24T13:32:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734345+0000", 2024-04-24T13:32:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4030000000000004e-06 2024-04-24T13:32:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734356+0000", 2024-04-24T13:32:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0606e-05 2024-04-24T13:32:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734362+0000", 2024-04-24T13:32:27.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9580000000000001e-06 2024-04-24T13:32:27.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734440+0000", 2024-04-24T13:32:27.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7364e-05 2024-04-24T13:32:27.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734457+0000", 2024-04-24T13:32:27.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6906e-05 2024-04-24T13:32:27.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737886+0000", 2024-04-24T13:32:27.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034295889999999998 2024-04-24T13:32:27.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737926+0000", 2024-04-24T13:32:27.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9607000000000002e-05 2024-04-24T13:32:27.529 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.529 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.529 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1585 4.2f e82/22 4:f66a130c:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.3:head v 82'3, mlcod=81'1)", 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.734734+0000", 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.7367368919999997, 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034355280000000002, 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734734+0000", 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734734+0000", 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734735+0000", 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9999999999999997e-07 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734741+0000", 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4219999999999999e-06 2024-04-24T13:32:27.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734750+0000", 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7440000000000002e-06 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734757+0000", 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.421e-06 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734834+0000", 2024-04-24T13:32:27.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7739999999999998e-05 2024-04-24T13:32:27.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734852+0000", 2024-04-24T13:32:27.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7776000000000001e-05 2024-04-24T13:32:27.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738133+0000", 2024-04-24T13:32:27.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032805220000000001 2024-04-24T13:32:27.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738170+0000", 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7302999999999998e-05 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5165.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.110078+0000", 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.3613933199999995, 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053186259999999999, 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.535 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5165", 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/3607738460", 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 56 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110078+0000", 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110078+0000", 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110079+0000", 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3900000000000005e-07 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110082+0000", 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4319999999999999e-06 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110090+0000", 2024-04-24T13:32:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.763e-06 2024-04-24T13:32:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110096+0000", 2024-04-24T13:32:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8250000000000001e-06 2024-04-24T13:32:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110146+0000", 2024-04-24T13:32:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0695000000000002e-05 2024-04-24T13:32:27.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110227+0000", 2024-04-24T13:32:27.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0554000000000002e-05 2024-04-24T13:32:27.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:27.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.110352+0000", 2024-04-24T13:32:27.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012533800000000001 2024-04-24T13:32:27.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.112615+0000", 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022629880000000001 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115344+0000", 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027288899999999999 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115373+0000", 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8711999999999999e-05 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.115397+0000", 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.389e-05 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1706 4.29 4:950e3da7:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.606016+0000", 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8654551440000002, 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004810361, 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.541 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1706 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606016+0000", 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606016+0000", 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606017+0000", 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3e-07 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606021+0000", 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1049999999999997e-06 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606031+0000", 2024-04-24T13:32:27.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6590000000000002e-06 2024-04-24T13:32:27.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606038+0000", 2024-04-24T13:32:27.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5009999999999998e-06 2024-04-24T13:32:27.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606205+0000", 2024-04-24T13:32:27.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000167188 2024-04-24T13:32:27.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606274+0000", 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8330999999999993e-05 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606368+0000", 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4747999999999995e-05 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.607958+0000", 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001589196 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610739+0000", 2024-04-24T13:32:27.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00278166 2024-04-24T13:32:27.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610800+0000", 2024-04-24T13:32:27.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0653999999999999e-05 2024-04-24T13:32:27.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610827+0000", 2024-04-24T13:32:27.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6689000000000001e-05 2024-04-24T13:32:27.547 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.547 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.547 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.547 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1719 4.15 4:a9c3e2b3:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.3:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:27.547 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.751119+0000", 2024-04-24T13:32:27.547 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.7203523870000001, 2024-04-24T13:32:27.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041158660000000001, 2024-04-24T13:32:27.547 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1719 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751119+0000", 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751119+0000", 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751121+0000", 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7600000000000001e-06 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751129+0000", 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0770000000000008e-06 2024-04-24T13:32:27.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751147+0000", 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7858000000000001e-05 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751156+0000", 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2550000000000003e-06 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751222+0000", 2024-04-24T13:32:27.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6340000000000005e-05 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751355+0000", 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013299500000000001 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751494+0000", 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139164 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.752323+0000", 2024-04-24T13:32:27.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00082899899999999997 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755169+0000", 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028453380000000002 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755202+0000", 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3136000000000003e-05 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755235+0000", 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2944000000000002e-05 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1720 4.11 4:8aa62082:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.751178+0000", 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.7202933900000001, 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040457669999999996, 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.553 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1720 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751178+0000", 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751178+0000", 2024-04-24T13:32:27.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751179+0000", 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5400000000000001e-07 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751183+0000", 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0459999999999999e-06 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751189+0000", 2024-04-24T13:32:27.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5989999999999998e-06 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751193+0000", 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6440000000000002e-06 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751246+0000", 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3446000000000003e-05 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751325+0000", 2024-04-24T13:32:27.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8586999999999998e-05 2024-04-24T13:32:27.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:27.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751409+0000", 2024-04-24T13:32:27.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3993999999999996e-05 2024-04-24T13:32:27.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.752239+0000", 2024-04-24T13:32:27.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00083003700000000005 2024-04-24T13:32:27.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755164+0000", 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029250719999999999 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755199+0000", 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5240999999999997e-05 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755224+0000", 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4547000000000001e-05 2024-04-24T13:32:27.558 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1723 4.15 4:a83fb8d7:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.7:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.751205+0000", 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.7202661559999992, 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041088490000000004, 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.559 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.560 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1723 2024-04-24T13:32:27.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.560 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751205+0000", 2024-04-24T13:32:27.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751205+0000", 2024-04-24T13:32:27.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751206+0000", 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3000000000000001e-07 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751209+0000", 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1549999999999999e-06 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751215+0000", 2024-04-24T13:32:27.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1349999999999997e-06 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751220+0000", 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.429e-06 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751758+0000", 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00053738899999999999 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.751902+0000", 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014389399999999999 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.752074+0000", 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017230300000000001 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.753003+0000", 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00092858100000000005 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755268+0000", 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002265553 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755295+0000", 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6726000000000001e-05 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.755314+0000", 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9253999999999999e-05 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.564 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1812 4.15 4:a9c3e2b3:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.942075+0000", 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.5293965529999998, 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061256640000000003, 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1812 2024-04-24T13:32:27.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.566 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942075+0000", 2024-04-24T13:32:27.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942075+0000", 2024-04-24T13:32:27.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942076+0000", 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.11e-06 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942082+0000", 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3450000000000002e-06 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942095+0000", 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2585000000000001e-05 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942104+0000", 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6619999999999994e-06 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942172+0000", 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8112000000000001e-05 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942246+0000", 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4636999999999997e-05 2024-04-24T13:32:27.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942352+0000", 2024-04-24T13:32:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105474 2024-04-24T13:32:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943298+0000", 2024-04-24T13:32:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094645899999999997 2024-04-24T13:32:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.948150+0000", 2024-04-24T13:32:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048519460000000002 2024-04-24T13:32:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.948179+0000", 2024-04-24T13:32:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8549000000000001e-05 2024-04-24T13:32:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.948200+0000", 2024-04-24T13:32:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1784999999999999e-05 2024-04-24T13:32:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.570 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1813 4.11 4:8aa62082:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.942122+0000", 2024-04-24T13:32:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.5293490520000006, 2024-04-24T13:32:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071059180000000001, 2024-04-24T13:32:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.571 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1813 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942122+0000", 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942122+0000", 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942123+0000", 2024-04-24T13:32:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4799999999999998e-07 2024-04-24T13:32:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942126+0000", 2024-04-24T13:32:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9809999999999999e-06 2024-04-24T13:32:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942136+0000", 2024-04-24T13:32:27.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8549999999999997e-06 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942142+0000", 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1990000000000003e-06 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942187+0000", 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5102999999999998e-05 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.574 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942251+0000", 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4324000000000003e-05 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942352+0000", 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100412 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943198+0000", 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000846615 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.575 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949171+0000", 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0059721519999999997 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949206+0000", 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5706e-05 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949228+0000", 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2022999999999999e-05 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.576 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1816 4.15 4:a83fb8d7:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.942155+0000", 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.5293159630000002, 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070975669999999999, 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1816 2024-04-24T13:32:27.577 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942155+0000", 2024-04-24T13:32:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942155+0000", 2024-04-24T13:32:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.578 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942156+0000", 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0500000000000004e-07 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942163+0000", 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9369999999999998e-06 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942170+0000", 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9789999999999996e-06 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.579 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942175+0000", 2024-04-24T13:32:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4380000000000003e-06 2024-04-24T13:32:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942863+0000", 2024-04-24T13:32:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00068733800000000001 2024-04-24T13:32:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.942945+0000", 2024-04-24T13:32:27.580 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2083000000000007e-05 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943058+0000", 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113206 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.946270+0000", 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032119779999999999 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:27.581 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949191+0000", 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029214190000000002 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949223+0000", 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1548999999999999e-05 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949253+0000", 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0134999999999999e-05 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.582 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1809 4.1a e82/22 4:5ade8a4f:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.0:head v 82'2, mlcod=0'0)", 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.943465+0000", 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.5280068510000007, 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058673099999999997, 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943465+0000", 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.583 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:27.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943465+0000", 2024-04-24T13:32:27.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:27.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:27.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943465+0000", 2024-04-24T13:32:27.584 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7800000000000001e-07 2024-04-24T13:32:27.584 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.584 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.584 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:27.584 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943477+0000", 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1591e-05 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943501+0000", 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4396000000000002e-05 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943511+0000", 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5219999999999996e-06 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:27.585 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943567+0000", 2024-04-24T13:32:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5813999999999998e-05 2024-04-24T13:32:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.943589+0000", 2024-04-24T13:32:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2188000000000002e-05 2024-04-24T13:32:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949307+0000", 2024-04-24T13:32:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057182079999999998 2024-04-24T13:32:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:27.586 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.949332+0000", 2024-04-24T13:32:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4813000000000001e-05 2024-04-24T13:32:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:27.587 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:27.587 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:27.589 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:27.589 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:27.584+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:27.690 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:27.686+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:27.720 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:27.720 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:27.720 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:27.721 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:27.735 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:27.823 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:27.822+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:27.891 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:27.890+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:27.901 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:27.901 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:27.901 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:27.901 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:27.901 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:27.915 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:27.992 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:27.988+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:28.085 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:28.085 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:28.085 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:32:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 120.85579164000001, 2024-04-24T13:32:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020457065, 2024-04-24T13:32:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-24T13:32:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.086 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.087 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225903+0000", 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7100000000000001e-06 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225922+0000", 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8919999999999998e-05 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225960+0000", 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7240000000000003e-05 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.088 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225987+0000", 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6919000000000001e-05 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226300+0000", 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000313701 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226317+0000", 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6463000000000001e-05 2024-04-24T13:32:28.089 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231091+0000", 2024-04-24T13:32:28.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047739169999999999 2024-04-24T13:32:28.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:32:28.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231111+0000", 2024-04-24T13:32:28.090 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0605999999999999e-05 2024-04-24T13:32:28.090 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.090 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.090 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.090 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246073+0000", 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014961264 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246357+0000", 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028432499999999999 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:46 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'1, mlcod=0'0)", 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:32:28.091 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 118.814651993, 2024-04-24T13:32:28.092 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056987720000000004, 2024-04-24T13:32:28.092 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.094 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.094 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.094 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.094 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:32:28.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.094 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267039+0000", 2024-04-24T13:32:28.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267040+0000", 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3e-07 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267050+0000", 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8560000000000002e-06 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267205+0000", 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520200000000001 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267244+0000", 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8587000000000002e-05 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267346+0000", 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010223200000000001 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.267374+0000", 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8214000000000001e-05 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272631+0000", 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052563089999999998 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.272738+0000", 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107642 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.097 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:47 7.1f e29/28 7:f95f44c2:::notify.0:head v 29'2, mlcod=0'0)", 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 118.800741237, 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052089900000000001, 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280950+0000", 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280951+0000", 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7199999999999997e-07 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280962+0000", 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1094000000000001e-05 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280981+0000", 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9066e-05 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.280999+0000", 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8148e-05 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281144+0000", 2024-04-24T13:32:28.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014454999999999999 2024-04-24T13:32:28.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.281190+0000", 2024-04-24T13:32:28.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5649000000000003e-05 2024-04-24T13:32:28.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286063+0000", 2024-04-24T13:32:28.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048732549999999999 2024-04-24T13:32:28.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.286159+0000", 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6355999999999997e-05 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:211 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 115.779353356, 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010258288000000001, 2024-04-24T13:32:28.102 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 211 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302338+0000", 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302342+0000", 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6059999999999999e-06 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302357+0000", 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5201999999999999e-05 2024-04-24T13:32:28.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302393+0000", 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6386e-05 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302411+0000", 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7864999999999999e-05 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302544+0000", 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132526 2024-04-24T13:32:28.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.302554+0000", 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0479000000000001e-05 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309290+0000", 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006735937 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309474+0000", 2024-04-24T13:32:28.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000183981 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.309873+0000", 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000398618 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.311131+0000", 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012578929999999999 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312443+0000", 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001312648 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312535+0000", 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1620999999999996e-05 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.312596+0000", 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1525999999999993e-05 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4865.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~46] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e81)", 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:14.968824+0000", 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.112867272000001, 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046556760000000001, 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "started", 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4865", 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/2885481152", 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.109 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968824+0000", 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968824+0000", 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968827+0000", 2024-04-24T13:32:28.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6429999999999999e-06 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968836+0000", 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0229999999999998e-06 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968857+0000", 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1396e-05 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968877+0000", 2024-04-24T13:32:28.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0103e-05 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968977+0000", 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9862e-05 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.968984+0000", 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6279999999999999e-06 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.973315+0000", 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043312649999999999 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.973388+0000", 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2611e-05 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:14.973480+0000", 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2145000000000006e-05 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1586 4.2c 4:37b5a98b:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:17.732999+0000", 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.348692904, 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042846200000000003, 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1586 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.114 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.732999+0000", 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.732999+0000", 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733001+0000", 2024-04-24T13:32:28.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2639999999999998e-06 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733029+0000", 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8042e-05 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733060+0000", 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0916e-05 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733075+0000", 2024-04-24T13:32:28.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5163e-05 2024-04-24T13:32:28.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733269+0000", 2024-04-24T13:32:28.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019399900000000001 2024-04-24T13:32:28.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733502+0000", 2024-04-24T13:32:28.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023322100000000001 2024-04-24T13:32:28.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.733902+0000", 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000399971 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.735670+0000", 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017675270000000001 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.737133+0000", 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001463223 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.737220+0000", 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6848000000000006e-05 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.737283+0000", 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3446000000000002e-05 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.119 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1615 3.1a 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.120 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:28.120 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.8759789659999999, 2024-04-24T13:32:28.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020755388999999999, 2024-04-24T13:32:28.120 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.120 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.120 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.120 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.120 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.120 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.120 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1615 2024-04-24T13:32:28.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.120 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205715+0000", 2024-04-24T13:32:28.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4399999999999999e-06 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211414+0000", 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005699356 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211448+0000", 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4221999999999999e-05 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211466+0000", 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7629999999999999e-05 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211585+0000", 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011937 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211840+0000", 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000254861 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.212059+0000", 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218789 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.225826+0000", 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013767061000000001 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226295+0000", 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046917399999999999 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226388+0000", 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2190999999999999e-05 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226468+0000", 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0295000000000003e-05 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.125 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1704 4.2c 4:37b5a98b:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.126 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.605304+0000", 2024-04-24T13:32:28.126 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.4763871819999999, 2024-04-24T13:32:28.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004234888, 2024-04-24T13:32:28.126 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.126 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.126 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.126 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.126 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.126 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.126 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1704 2024-04-24T13:32:28.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.126 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605304+0000", 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605304+0000", 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605307+0000", 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3539999999999998e-06 2024-04-24T13:32:28.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605317+0000", 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0856000000000001e-05 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605348+0000", 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1019000000000002e-05 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605364+0000", 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5313000000000001e-05 2024-04-24T13:32:28.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605523+0000", 2024-04-24T13:32:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000159111 2024-04-24T13:32:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.605803+0000", 2024-04-24T13:32:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028006299999999999 2024-04-24T13:32:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:28.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.606142+0000", 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033936900000000001 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.608804+0000", 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002661362 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.609383+0000", 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057949499999999997 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.609468+0000", 2024-04-24T13:32:28.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5228000000000005e-05 2024-04-24T13:32:28.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.609539+0000", 2024-04-24T13:32:28.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0717999999999996e-05 2024-04-24T13:32:28.131 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.131 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.131 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.131 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1716 4.1a 4:5ade8a4f:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.0:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750490+0000", 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3312016149999994, 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084099940000000005, 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1716 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750490+0000", 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750490+0000", 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750491+0000", 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5200000000000001e-06 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750499+0000", 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0700000000000007e-06 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750522+0000", 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2351999999999999e-05 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.889e-05 2024-04-24T13:32:28.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750694+0000", 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015310599999999999 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751002+0000", 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030817699999999997 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751435+0000", 2024-04-24T13:32:28.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043325699999999999 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753491+0000", 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00205609 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758630+0000", 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005138531 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758778+0000", 2024-04-24T13:32:28.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014789 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758900+0000", 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122111 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1722 4.18 4:1805f73b:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.6:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750693+0000", 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3309987499999991, 2024-04-24T13:32:28.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088221259999999996, 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1722 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750693+0000", 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750693+0000", 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750694+0000", 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2300000000000001e-06 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750702+0000", 2024-04-24T13:32:28.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0930000000000003e-06 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750721+0000", 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8980000000000001e-05 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750737+0000", 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5676e-05 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750896+0000", 2024-04-24T13:32:28.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015962999999999999 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751255+0000", 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035844199999999999 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751697+0000", 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044219399999999997 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.754222+0000", 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025252819999999998 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759319+0000", 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050967230000000001 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759452+0000", 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013312099999999999 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759515+0000", 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2755000000000005e-05 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1725 4.13 4:cb20c8cc:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.9:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750779+0000", 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.330912112, 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086438699999999997, 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.143 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1725 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750779+0000", 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750779+0000", 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750781+0000", 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2139999999999999e-06 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750788+0000", 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0589999999999997e-06 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750807+0000", 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9177e-05 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750901+0000", 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3955000000000004e-05 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751102+0000", 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020087499999999999 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751417+0000", 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000315464 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751796+0000", 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037914099999999999 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753965+0000", 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021692040000000001 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759226+0000", 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052606789999999999 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759350+0000", 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012385 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759423+0000", 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3251999999999996e-05 2024-04-24T13:32:28.148 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:1721 4.38 e82/22 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head v 82'7, mlcod=82'5)", 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.751818+0000", 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3298731309999994, 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069060240000000002, 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751818+0000", 2024-04-24T13:32:28.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751818+0000", 2024-04-24T13:32:28.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751820+0000", 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8840000000000001e-06 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751838+0000", 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7612999999999999e-05 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751863+0000", 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4865999999999999e-05 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751883+0000", 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0279e-05 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752339+0000", 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045636100000000002 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752388+0000", 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8782000000000002e-05 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758630+0000", 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062420879999999998 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.758724+0000", 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4151e-05 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:1724 4.38 e82/22 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head v 82'8, mlcod=82'5)", 2024-04-24T13:32:28.153 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.753466+0000", 2024-04-24T13:32:28.154 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3282253429999997, 2024-04-24T13:32:28.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061231640000000004, 2024-04-24T13:32:28.154 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.154 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.154 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.154 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753466+0000", 2024-04-24T13:32:28.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753466+0000", 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753468+0000", 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.57e-06 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753483+0000", 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5455999999999999e-05 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753509+0000", 2024-04-24T13:32:28.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5497e-05 2024-04-24T13:32:28.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753525+0000", 2024-04-24T13:32:28.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6175999999999999e-05 2024-04-24T13:32:28.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753665+0000", 2024-04-24T13:32:28.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014010699999999999 2024-04-24T13:32:28.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753717+0000", 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1845000000000003e-05 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759533+0000", 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058163609999999999 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759589+0000", 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6152e-05 2024-04-24T13:32:28.157 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1809 4.1a 4:5ade8a4f:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941431+0000", 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.1402602949999991, 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0076807159999999998, 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.158 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1809 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941431+0000", 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941431+0000", 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941433+0000", 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1900000000000002e-06 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941443+0000", 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8700000000000004e-06 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941472+0000", 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9105e-05 2024-04-24T13:32:28.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941487+0000", 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4970000000000001e-05 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941625+0000", 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013815400000000001 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941786+0000", 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016102600000000001 2024-04-24T13:32:28.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:28.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942051+0000", 2024-04-24T13:32:28.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000264911 2024-04-24T13:32:28.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.943709+0000", 2024-04-24T13:32:28.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016574409999999999 2024-04-24T13:32:28.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948959+0000", 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052507129999999997 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949050+0000", 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0760999999999994e-05 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949112+0000", 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1575000000000006e-05 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.163 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1811 4.35 4:ac3d4c50:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941523+0000", 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.1401684509999992, 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059788640000000004, 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1811 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.164 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941523+0000", 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941523+0000", 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941524+0000", 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:32:28.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941529+0000", 2024-04-24T13:32:28.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8369999999999996e-06 2024-04-24T13:32:28.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941541+0000", 2024-04-24T13:32:28.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2303000000000001e-05 2024-04-24T13:32:28.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941577+0000", 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5685999999999997e-05 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941729+0000", 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015242000000000001 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941939+0000", 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000209805 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:28.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942217+0000", 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027807100000000001 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.945849+0000", 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036323509999999998 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947240+0000", 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001390397 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947382+0000", 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014174700000000001 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947502+0000", 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120217 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1815 4.18 4:1805f73b:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.169 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941634+0000", 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.1400575130000004, 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0072440860000000003, 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1815 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941634+0000", 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941634+0000", 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941636+0000", 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.624e-06 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941643+0000", 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6720000000000004e-06 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941672+0000", 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9139999999999999e-05 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941688+0000", 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.594e-05 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941814+0000", 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126017 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942001+0000", 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018702899999999999 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942249+0000", 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024771400000000001 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947111+0000", 2024-04-24T13:32:28.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048622520000000001 2024-04-24T13:32:28.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948617+0000", 2024-04-24T13:32:28.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015059400000000001 2024-04-24T13:32:28.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948766+0000", 2024-04-24T13:32:28.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148744 2024-04-24T13:32:28.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948878+0000", 2024-04-24T13:32:28.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112014 2024-04-24T13:32:28.175 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.175 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.175 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.175 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1818 4.13 4:cb20c8cc:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.175 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941727+0000", 2024-04-24T13:32:28.175 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.1399641109999994, 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071492509999999997, 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1818 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941727+0000", 2024-04-24T13:32:28.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941727+0000", 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941729+0000", 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.513e-06 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941735+0000", 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4529999999999999e-06 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941755+0000", 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9836000000000001e-05 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941835+0000", 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9437999999999994e-05 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941970+0000", 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013506100000000001 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942162+0000", 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000192342 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942464+0000", 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030173400000000001 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947169+0000", 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047049800000000001 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948661+0000", 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014922780000000001 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948776+0000", 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115165 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.948877+0000", 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100451 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:1814 4.38 e82/22 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head v 82'9, mlcod=82'7)", 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.942444+0000", 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.1392469569999992, 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048299049999999998, 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.181 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.182 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942444+0000", 2024-04-24T13:32:28.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942444+0000", 2024-04-24T13:32:28.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942446+0000", 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3829999999999999e-06 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942483+0000", 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7299000000000003e-05 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942507+0000", 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4110000000000001e-05 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942552+0000", 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4702e-05 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942774+0000", 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022156199999999999 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942827+0000", 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3341999999999999e-05 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947190+0000", 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043633150000000004 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947274+0000", 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4191999999999996e-05 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.185 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1829 4.30 4:0ff29942:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.6.4:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:19.089328+0000", 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.9923635449999999, 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045862450000000001, 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1829 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089328+0000", 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089328+0000", 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089330+0000", 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2469999999999998e-06 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089342+0000", 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1463e-05 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089376+0000", 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4199000000000002e-05 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089402+0000", 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6570000000000001e-05 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089566+0000", 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000163256 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.089877+0000", 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031148800000000001 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.090270+0000", 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039329799999999999 2024-04-24T13:32:28.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.092133+0000", 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018626210000000001 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.093713+0000", 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001579851 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.093792+0000", 2024-04-24T13:32:28.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8807999999999995e-05 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.093914+0000", 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012244400000000001 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1922 4.30 4:0ff29942:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.6.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:19.273806+0000", 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.8078852679999997, 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043024910000000003, 2024-04-24T13:32:28.191 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1922 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273806+0000", 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273806+0000", 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273808+0000", 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1100000000000001e-06 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273818+0000", 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8640000000000008e-06 2024-04-24T13:32:28.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273849+0000", 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0632000000000001e-05 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.273866+0000", 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7703e-05 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.275434+0000", 2024-04-24T13:32:28.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0015677410000000001 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.275663+0000", 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022848899999999999 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.275963+0000", 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030008699999999999 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.277429+0000", 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014665360000000001 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.277879+0000", 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044962399999999998 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.278010+0000", 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013137700000000001 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:19.278109+0000", 2024-04-24T13:32:28.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8327999999999998e-05 2024-04-24T13:32:28.197 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.197 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.197 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.197 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.197 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.197 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:28.198 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:28.199 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:28.196+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:28.299 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:28.296+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:28.329 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:28.329 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:28.329 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:28.329 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:28.347 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:28.400 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:28.396+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:28.429 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:32:28.473 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:28.474 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:28.474 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:28.474 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:28.474 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:28.490 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:28.534 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:28.534+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:28.602 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:28.597+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:28.630 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:28.630 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:28.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:28.630 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:28.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.630 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4440.0:37 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=10b,writefull 0~46] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:32:28.630 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 123.357486381, 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003286134, 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4440", 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270372+0000", 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270374+0000", 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9130000000000001e-06 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270384+0000", 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0023e-05 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270410+0000", 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5483e-05 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270426+0000", 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6413e-05 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270524+0000", 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8314999999999996e-05 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270704+0000", 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017929 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.270950+0000", 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024601000000000001 2024-04-24T13:32:28.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.272837+0000", 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018874600000000001 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273498+0000", 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066062100000000002 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273589+0000", 2024-04-24T13:32:28.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.098e-05 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:25.273658+0000", 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9626e-05 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 119.34869651299999, 2024-04-24T13:32:28.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048388950000000002, 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:28.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:32:28.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3799999999999998e-06 2024-04-24T13:32:28.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279193+0000", 2024-04-24T13:32:28.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7674e-05 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279224+0000", 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0654000000000002e-05 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279244+0000", 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279426+0000", 2024-04-24T13:32:28.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018255300000000001 2024-04-24T13:32:28.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279717+0000", 2024-04-24T13:32:28.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029043800000000001 2024-04-24T13:32:28.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:28.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279993+0000", 2024-04-24T13:32:28.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276786 2024-04-24T13:32:28.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282898+0000", 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002904093 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283731+0000", 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00083382599999999997 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283886+0000", 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015512600000000001 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284001+0000", 2024-04-24T13:32:28.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114405 2024-04-24T13:32:28.642 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.642 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.642 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.642 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410010339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:28.642 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:28.642 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 119.34357191799999, 2024-04-24T13:32:28.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044116340000000002, 2024-04-24T13:32:28.642 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.642 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:28.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284289+0000", 2024-04-24T13:32:28.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.125e-06 2024-04-24T13:32:28.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284299+0000", 2024-04-24T13:32:28.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0485999999999999e-05 2024-04-24T13:32:28.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284330+0000", 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0528000000000003e-05 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284345+0000", 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4883e-05 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284484+0000", 2024-04-24T13:32:28.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139708 2024-04-24T13:32:28.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284655+0000", 2024-04-24T13:32:28.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170953 2024-04-24T13:32:28.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:28.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284981+0000", 2024-04-24T13:32:28.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000325648 2024-04-24T13:32:28.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.287326+0000", 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023452709999999999 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288427+0000", 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001100544 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288551+0000", 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012466500000000001 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288698+0000", 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146823 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 116.364359033, 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047820809999999997, 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.648 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:28.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263503+0000", 2024-04-24T13:32:28.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.039e-06 2024-04-24T13:32:28.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263520+0000", 2024-04-24T13:32:28.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7198e-05 2024-04-24T13:32:28.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263548+0000", 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8158e-05 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263565+0000", 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7008e-05 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263754+0000", 2024-04-24T13:32:28.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001894 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263973+0000", 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218593 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.264373+0000", 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040043400000000002 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.266377+0000", 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020033030000000001 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268121+0000", 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017441049999999999 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268212+0000", 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1490000000000007e-05 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268282+0000", 2024-04-24T13:32:28.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9352999999999998e-05 2024-04-24T13:32:28.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.654 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.654 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:28.654 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:28.654 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 116.284646881, 2024-04-24T13:32:28.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034252639999999999, 2024-04-24T13:32:28.654 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.654 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.654 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 220 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343214+0000", 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343227+0000", 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2941e-05 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343259+0000", 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1557000000000003e-05 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343274+0000", 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5401999999999999e-05 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343455+0000", 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018068700000000001 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343694+0000", 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238552 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.344088+0000", 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039456400000000003 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.345723+0000", 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016349139999999999 2024-04-24T13:32:28.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346480+0000", 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075738300000000004 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346569+0000", 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8281000000000004e-05 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346637+0000", 2024-04-24T13:32:28.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8165999999999998e-05 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:223 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 116.27395350499999, 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032680679999999998, 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 223 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353905+0000", 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353907+0000", 2024-04-24T13:32:28.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1560000000000002e-06 2024-04-24T13:32:28.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353918+0000", 2024-04-24T13:32:28.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0669000000000001e-05 2024-04-24T13:32:28.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353948+0000", 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0329999999999999e-05 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.353963+0000", 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4989e-05 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354076+0000", 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112704 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354300+0000", 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022397000000000001 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.354729+0000", 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042914100000000002 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356223+0000", 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001494219 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.356972+0000", 2024-04-24T13:32:28.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00074910099999999996 2024-04-24T13:32:28.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357059+0000", 2024-04-24T13:32:28.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6624000000000003e-05 2024-04-24T13:32:28.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.357173+0000", 2024-04-24T13:32:28.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114165 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 116.266906584, 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032957419999999999, 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360954+0000", 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.154e-06 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360965+0000", 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1321999999999999e-05 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360996+0000", 2024-04-24T13:32:28.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0902999999999999e-05 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361012+0000", 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361185+0000", 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172072 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361404+0000", 2024-04-24T13:32:28.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021965999999999999 2024-04-24T13:32:28.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:28.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361852+0000", 2024-04-24T13:32:28.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000448276 2024-04-24T13:32:28.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.363340+0000", 2024-04-24T13:32:28.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001487169 2024-04-24T13:32:28.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364094+0000", 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075443699999999995 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364184+0000", 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9957000000000006e-05 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364248+0000", 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3627000000000006e-05 2024-04-24T13:32:28.671 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 116.263341737, 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036426480000000001, 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.672 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.673 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-24T13:32:28.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.673 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:28.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:28.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364519+0000", 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364529+0000", 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088999999999999e-05 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364554+0000", 2024-04-24T13:32:28.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5537e-05 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364568+0000", 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3372e-05 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364726+0000", 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015809299999999999 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365059+0000", 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000333185 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365758+0000", 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069934299999999995 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.367413+0000", 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016552349999999999 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368012+0000", 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059858700000000003 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368097+0000", 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5253999999999994e-05 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368159+0000", 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2113000000000007e-05 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.678 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:28.678 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:28.678 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 116.23395510100001, 2024-04-24T13:32:28.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033998840000000002, 2024-04-24T13:32:28.678 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.678 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.678 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.678 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.678 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.678 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.678 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-24T13:32:28.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393906+0000", 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1569999999999998e-06 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393917+0000", 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1348999999999999e-05 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393942+0000", 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.527e-05 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393957+0000", 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4355999999999999e-05 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394127+0000", 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170555 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394352+0000", 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224539 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394788+0000", 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043600099999999999 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.396137+0000", 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001349404 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397158+0000", 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001020738 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397237+0000", 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9319000000000004e-05 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397303+0000", 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6196000000000001e-05 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:437 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:28.683 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 116.164331507, 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048056540000000003, 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 437 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:28.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463529+0000", 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2479999999999999e-06 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463544+0000", 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463572+0000", 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8294e-05 2024-04-24T13:32:28.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463590+0000", 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464092+0000", 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000502189 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464454+0000", 2024-04-24T13:32:28.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036231300000000001 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464831+0000", 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000377375 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467473+0000", 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026414659999999999 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468185+0000", 2024-04-24T13:32:28.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071215199999999997 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468271+0000", 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5593999999999994e-05 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468333+0000", 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1957000000000003e-05 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 115.75868175799999, 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033442569999999998, 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 793 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.691 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869179+0000", 2024-04-24T13:32:28.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.323e-06 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869190+0000", 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869222+0000", 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1733999999999998e-05 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869237+0000", 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5044e-05 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869396+0000", 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158913 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869763+0000", 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367112 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.870319+0000", 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055558799999999998 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.871509+0000", 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001190607 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872365+0000", 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085535299999999999 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872449+0000", 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3834999999999999e-05 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872521+0000", 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2428999999999994e-05 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.696 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 115.572675386, 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003340754, 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 874 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055185+0000", 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055197+0000", 2024-04-24T13:32:28.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1606e-05 2024-04-24T13:32:28.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055229+0000", 2024-04-24T13:32:28.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1603000000000002e-05 2024-04-24T13:32:28.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055244+0000", 2024-04-24T13:32:28.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4928e-05 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055397+0000", 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015366499999999999 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055763+0000", 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036565600000000001 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:28.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.056317+0000", 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055436600000000004 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.057678+0000", 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001361283 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058258+0000", 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057942400000000004 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058407+0000", 2024-04-24T13:32:28.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000149188 2024-04-24T13:32:28.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058524+0000", 2024-04-24T13:32:28.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116805 2024-04-24T13:32:28.702 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.702 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.702 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.702 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:876 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.unlock in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:28.703 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:32:28.703 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 115.567956657, 2024-04-24T13:32:28.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032622950000000001, 2024-04-24T13:32:28.703 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.703 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.703 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.703 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.703 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.703 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.703 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 876 2024-04-24T13:32:28.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.703 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059902+0000", 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059904+0000", 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.767e-06 2024-04-24T13:32:28.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059912+0000", 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4819999999999994e-06 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059934+0000", 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2141e-05 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.059949+0000", 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4285e-05 2024-04-24T13:32:28.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060072+0000", 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012349400000000001 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060302+0000", 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022971999999999999 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.060787+0000", 2024-04-24T13:32:28.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048565400000000002 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062208+0000", 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0014201870000000001 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.062946+0000", 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00073827699999999997 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063036+0000", 2024-04-24T13:32:28.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9758000000000004e-05 2024-04-24T13:32:28.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.063164+0000", 2024-04-24T13:32:28.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012852999999999999 2024-04-24T13:32:28.708 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.708 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.710 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.710 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:952 6.a 6:541d369a:::obj_delete_at_hint.0000000125:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:28.710 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:32:28.710 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 115.391013754, 2024-04-24T13:32:28.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032803860000000002, 2024-04-24T13:32:28.710 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.710 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.710 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.710 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.710 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.710 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 952 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236845+0000", 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236847+0000", 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1730000000000002e-06 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236858+0000", 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0582e-05 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236900+0000", 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2463000000000003e-05 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.236923+0000", 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2938e-05 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237071+0000", 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014795100000000001 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237365+0000", 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000293963 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:28.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.237755+0000", 2024-04-24T13:32:28.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039032599999999998 2024-04-24T13:32:28.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239124+0000", 2024-04-24T13:32:28.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00136918 2024-04-24T13:32:28.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.239925+0000", 2024-04-24T13:32:28.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00080016699999999996 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240011+0000", 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6780999999999995e-05 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.240125+0000", 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113862 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1566 4.38 4:1cdfa9df:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.3.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 11.071684113, 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040238560000000001, 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1566 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.716 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:28.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:28.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556176+0000", 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.057e-06 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556187+0000", 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0693000000000001e-05 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556219+0000", 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1718999999999999e-05 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556242+0000", 2024-04-24T13:32:28.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2687000000000001e-05 2024-04-24T13:32:28.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556384+0000", 2024-04-24T13:32:28.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014257899999999999 2024-04-24T13:32:28.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556624+0000", 2024-04-24T13:32:28.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024014199999999999 2024-04-24T13:32:28.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556921+0000", 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029673900000000002 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.559462+0000", 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025407530000000002 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560009+0000", 2024-04-24T13:32:28.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054690399999999997 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560096+0000", 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7597999999999997e-05 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560198+0000", 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010198499999999999 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.722 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1721 4.38 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.722 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:28.722 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.8773176530000004, 2024-04-24T13:32:28.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088323519999999999, 2024-04-24T13:32:28.722 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.722 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.722 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.722 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.722 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.722 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.722 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1721 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750544+0000", 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9569999999999998e-06 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750561+0000", 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7589e-05 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750600+0000", 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8145999999999997e-05 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750621+0000", 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1109999999999999e-05 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750797+0000", 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017672599999999999 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751113+0000", 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031514599999999998 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:28.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751586+0000", 2024-04-24T13:32:28.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047325699999999999 2024-04-24T13:32:28.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753982+0000", 2024-04-24T13:32:28.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023960880000000002 2024-04-24T13:32:28.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759108+0000", 2024-04-24T13:32:28.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051256590000000003 2024-04-24T13:32:28.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759247+0000", 2024-04-24T13:32:28.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013992400000000001 2024-04-24T13:32:28.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759373+0000", 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012574999999999999 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1724 4.38 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.8771914990000003, 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093322379999999996, 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.728 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1724 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:28.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750669+0000", 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7269999999999999e-06 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750678+0000", 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9700000000000005e-06 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750744+0000", 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5920999999999994e-05 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750766+0000", 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.226e-05 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752483+0000", 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001717393 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752795+0000", 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031186000000000001 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753283+0000", 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048743300000000001 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.756401+0000", 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031181220000000001 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759844+0000", 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003443715 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759934+0000", 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9728000000000006e-05 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759999+0000", 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5109000000000003e-05 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.733 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1814 4.38 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.6864043219999996, 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065250220000000001, 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.734 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1814 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941457+0000", 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941467+0000", 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0596e-05 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941503+0000", 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5398999999999998e-05 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941524+0000", 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1586e-05 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941687+0000", 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016257000000000001 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941919+0000", 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232315 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942204+0000", 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028527000000000001 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.945033+0000", 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028291029999999999 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947677+0000", 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026439649999999999 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947848+0000", 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017036699999999999 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947979+0000", 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131524 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.739 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1817 4.38 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.6862953750000003, 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079573279999999996, 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1817 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941565+0000", 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.657e-06 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941573+0000", 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4169999999999992e-06 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941596+0000", 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2535999999999999e-05 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941610+0000", 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3746e-05 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944182+0000", 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025729540000000001 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944388+0000", 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000205183 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944557+0000", 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016964200000000001 2024-04-24T13:32:28.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.946998+0000", 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024406670000000001 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949247+0000", 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022489490000000001 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949406+0000", 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000159436 2024-04-24T13:32:28.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949520+0000", 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114141 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2212 3.3a 3:5de7fd4f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.229630215, 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024848709, 2024-04-24T13:32:28.745 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:28.746 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:28.746 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:28.746 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:28.746 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:28.746 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:28.746 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2212 2024-04-24T13:32:28.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.746 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:28.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:28.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:28.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398232+0000", 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405320+0000", 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070884040000000004 2024-04-24T13:32:28.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:28.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405367+0000", 2024-04-24T13:32:28.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6940000000000001e-05 2024-04-24T13:32:28.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:28.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405393+0000", 2024-04-24T13:32:28.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5252000000000001e-05 2024-04-24T13:32:28.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:28.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405487+0000", 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4596e-05 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405609+0000", 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121892 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405710+0000", 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010121899999999999 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:28.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.415423+0000", 2024-04-24T13:32:28.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097131219999999994 2024-04-24T13:32:28.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:28.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.422967+0000", 2024-04-24T13:32:28.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00754319 2024-04-24T13:32:28.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:28.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.423023+0000", 2024-04-24T13:32:28.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5958000000000002e-05 2024-04-24T13:32:28.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:28.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:28.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:28.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.423077+0000", 2024-04-24T13:32:28.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4432999999999999e-05 2024-04-24T13:32:28.751 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.751 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.751 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.751 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:28.751 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:28.751 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:28.752 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:28.753 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:28.748+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:28.845 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:32:28.890 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:28.888+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:28.896 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:28.896 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:28.896 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:28.896 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:28.911 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:28.954 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:28.952+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:29.031 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:29.032 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:29.040 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:29.040 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:29.040 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:29.040 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:29.040 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:29.054 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:29.055 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:29.055 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:29.053+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:29.059 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:29.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:29.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:29.096 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:29.097 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:29.123 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:29.124 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:29.146 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:29.146 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:29.156 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:29.152+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:29.173 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:29.173 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:29.200 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:29.200 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:29.241 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:29.241 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:29.260 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:29.275 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:29.272+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:29.358 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:29.353+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:29.391 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:29.391 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:29.409 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:32:29.424 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:32:29.499 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:29.496+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:29.559 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:29.557+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:29.592 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:29.592 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:29.599 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-24T13:32:29.599 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-24T13:32:29.599 INFO:tasks.thrashosds.thrasher:thrash_pg_upmap 2024-04-24T13:32:29.600 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump -f json-pretty 2024-04-24T13:32:29.610 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:32:29.699 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:29.697+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:29.761 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:29.757+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:29.791 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:29.810 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:32:29.861 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:29.857+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:29.947 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:29.947 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:29.962 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:29.957+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:29.969 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:32:30.063 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:32:30.063 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:30.063 INFO:teuthology.orchestra.run.smithi071.stdout: "epoch": 86, 2024-04-24T13:32:30.063 INFO:teuthology.orchestra.run.smithi071.stdout: "fsid": "6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8", 2024-04-24T13:32:30.063 INFO:teuthology.orchestra.run.smithi071.stdout: "created": "2024-04-24T13:29:54.500837+0000", 2024-04-24T13:32:30.063 INFO:teuthology.orchestra.run.smithi071.stdout: "modified": "2024-04-24T13:32:29.414781+0000", 2024-04-24T13:32:30.063 INFO:teuthology.orchestra.run.smithi071.stdout: "last_up_change": "2024-04-24T13:30:06.614065+0000", 2024-04-24T13:32:30.063 INFO:teuthology.orchestra.run.smithi071.stdout: "last_in_change": "2024-04-24T13:30:49.878979+0000", 2024-04-24T13:32:30.063 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": "noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit", 2024-04-24T13:32:30.063 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_num": 5801984, 2024-04-24T13:32:30.064 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_set": [ 2024-04-24T13:32:30.064 INFO:teuthology.orchestra.run.smithi071.stdout: "noscrub", 2024-04-24T13:32:30.064 INFO:teuthology.orchestra.run.smithi071.stdout: "pglog_hardlimit", 2024-04-24T13:32:30.064 INFO:teuthology.orchestra.run.smithi071.stdout: "purged_snapdirs", 2024-04-24T13:32:30.064 INFO:teuthology.orchestra.run.smithi071.stdout: "recovery_deletes", 2024-04-24T13:32:30.064 INFO:teuthology.orchestra.run.smithi071.stdout: "sortbitwise" 2024-04-24T13:32:30.064 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-24T13:32:30.064 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_version": 4, 2024-04-24T13:32:30.064 INFO:teuthology.orchestra.run.smithi071.stdout: "full_ratio": 0.94999998807907104, 2024-04-24T13:32:30.064 INFO:teuthology.orchestra.run.smithi071.stdout: "backfillfull_ratio": 0.89999997615814209, 2024-04-24T13:32:30.064 INFO:teuthology.orchestra.run.smithi071.stdout: "nearfull_ratio": 0.85000002384185791, 2024-04-24T13:32:30.064 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_snapshot": "", 2024-04-24T13:32:30.064 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_max": 8, 2024-04-24T13:32:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: "max_osd": 8, 2024-04-24T13:32:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: "require_min_compat_client": "luminous", 2024-04-24T13:32:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: "min_compat_client": "luminous", 2024-04-24T13:32:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: "require_osd_release": "squid", 2024-04-24T13:32:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: "allow_crimson": false, 2024-04-24T13:32:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: "pools": [ 2024-04-24T13:32:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 1, 2024-04-24T13:32:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": ".mgr", 2024-04-24T13:32:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-04-24T13:30:07.251223+0000", 2024-04-24T13:32:30.065 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-04-24T13:32:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool", 2024-04-24T13:32:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-04-24T13:32:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-04-24T13:32:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-04-24T13:32:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-04-24T13:32:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-04-24T13:32:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-04-24T13:32:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-04-24T13:32:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-24T13:32:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-04-24T13:32:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-04-24T13:32:30.066 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 1, 2024-04-24T13:32:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 1, 2024-04-24T13:32:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 1, 2024-04-24T13:32:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 1, 2024-04-24T13:32:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 1, 2024-04-24T13:32:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-04-24T13:32:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-04-24T13:32:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-04-24T13:32:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-04-24T13:32:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-04-24T13:32:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-04-24T13:32:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-04-24T13:32:30.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "16", 2024-04-24T13:32:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-04-24T13:32:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-24T13:32:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-04-24T13:32:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-04-24T13:32:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-04-24T13:32:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 0, 2024-04-24T13:32:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 0, 2024-04-24T13:32:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-04-24T13:32:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-04-24T13:32:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-04-24T13:32:30.068 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-04-24T13:32:30.069 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-04-24T13:32:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-04-24T13:32:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-04-24T13:32:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-04-24T13:32:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-04-24T13:32:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-04-24T13:32:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-04-24T13:32:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-04-24T13:32:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-04-24T13:32:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-04-24T13:32:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-04-24T13:32:30.070 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: "options": { 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_max": 32, 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_min": 1 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: "mgr": {} 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: "score_type": "Fair distribution", 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 8, 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 8, 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: "optimal_score": 0.25, 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_acting": 2, 2024-04-24T13:32:30.071 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_stable": 2, 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity_weighted": 1, 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity": 1, 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity_weighted": 1 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 2, 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": "rbd", 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-04-24T13:30:13.385113+0000", 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool", 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-04-24T13:32:30.072 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 8, 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 8, 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 8, 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 8, 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 8, 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-04-24T13:32:30.073 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "19", 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 0, 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 0, 2024-04-24T13:32:30.074 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-24T13:32:30.075 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-04-24T13:32:30.076 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: "options": {}, 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: "rbd": {} 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: "score_type": "Fair distribution", 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 4, 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 4, 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: "optimal_score": 0.75, 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_acting": 3, 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_stable": 3, 2024-04-24T13:32:30.077 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity_weighted": 1, 2024-04-24T13:32:30.078 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity": 1, 2024-04-24T13:32:30.078 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity_weighted": 1 2024-04-24T13:32:30.078 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.078 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 3, 2024-04-24T13:32:30.078 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": "default.rgw.buckets.data", 2024-04-24T13:32:30.078 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-04-24T13:30:20.167043+0000", 2024-04-24T13:32:30.078 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-04-24T13:32:30.078 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool", 2024-04-24T13:32:30.078 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-04-24T13:32:30.078 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-04-24T13:32:30.078 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 64, 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 64, 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 64, 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 64, 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 64, 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-04-24T13:32:30.079 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "22", 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 0, 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 0, 2024-04-24T13:32:30.080 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-24T13:32:30.081 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-04-24T13:32:30.082 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-04-24T13:32:30.082 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-04-24T13:32:30.082 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-04-24T13:32:30.082 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-04-24T13:32:30.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.082 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-04-24T13:32:30.082 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-04-24T13:32:30.082 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-04-24T13:32:30.082 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-04-24T13:32:30.082 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-04-24T13:32:30.082 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-04-24T13:32:30.082 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-04-24T13:32:30.082 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: "options": {}, 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": {} 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: "score_type": "Fair distribution", 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 1.9900000095367432, 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 1.9900000095367432, 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: "optimal_score": 0.87999999523162842, 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_acting": 1.75, 2024-04-24T13:32:30.083 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_stable": 1.75, 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity_weighted": 1, 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity": 1, 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity_weighted": 1 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 4, 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": "default.rgw.buckets.index", 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-04-24T13:30:21.533214+0000", 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool", 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-04-24T13:32:30.084 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 64, 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 64, 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 64, 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 64, 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 64, 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-04-24T13:32:30.085 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-04-24T13:32:30.086 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-04-24T13:32:30.086 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-04-24T13:32:30.086 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-04-24T13:32:30.086 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-04-24T13:32:30.086 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-04-24T13:32:30.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.086 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "24", 2024-04-24T13:32:30.086 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-04-24T13:32:30.086 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-24T13:32:30.087 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-04-24T13:32:30.087 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-04-24T13:32:30.087 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-04-24T13:32:30.087 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 0, 2024-04-24T13:32:30.087 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 0, 2024-04-24T13:32:30.087 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-04-24T13:32:30.087 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-04-24T13:32:30.087 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-04-24T13:32:30.087 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-04-24T13:32:30.087 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-04-24T13:32:30.087 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-04-24T13:32:30.087 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-04-24T13:32:30.087 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-04-24T13:32:30.088 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-04-24T13:32:30.088 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-04-24T13:32:30.088 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-04-24T13:32:30.088 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-24T13:32:30.088 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-24T13:32:30.088 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-24T13:32:30.088 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-04-24T13:32:30.088 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-04-24T13:32:30.088 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-04-24T13:32:30.088 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-04-24T13:32:30.088 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-04-24T13:32:30.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.089 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-04-24T13:32:30.089 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-04-24T13:32:30.089 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-04-24T13:32:30.089 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-04-24T13:32:30.089 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-04-24T13:32:30.089 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-04-24T13:32:30.089 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-04-24T13:32:30.089 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-04-24T13:32:30.089 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-04-24T13:32:30.089 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-04-24T13:32:30.089 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-04-24T13:32:30.090 INFO:teuthology.orchestra.run.smithi071.stdout: "options": {}, 2024-04-24T13:32:30.090 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-04-24T13:32:30.090 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": {} 2024-04-24T13:32:30.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.090 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-04-24T13:32:30.090 INFO:teuthology.orchestra.run.smithi071.stdout: "score_type": "Fair distribution", 2024-04-24T13:32:30.090 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 1.9900000095367432, 2024-04-24T13:32:30.090 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 1.9900000095367432, 2024-04-24T13:32:30.090 INFO:teuthology.orchestra.run.smithi071.stdout: "optimal_score": 0.87999999523162842, 2024-04-24T13:32:30.090 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_acting": 1.75, 2024-04-24T13:32:30.090 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_stable": 1.75, 2024-04-24T13:32:30.090 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity_weighted": 1, 2024-04-24T13:32:30.091 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity": 1, 2024-04-24T13:32:30.091 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity_weighted": 1 2024-04-24T13:32:30.091 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.091 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 5, 2024-04-24T13:32:30.091 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": ".rgw.root", 2024-04-24T13:32:30.091 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-04-24T13:30:23.455631+0000", 2024-04-24T13:32:30.091 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-04-24T13:32:30.091 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool", 2024-04-24T13:32:30.091 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-04-24T13:32:30.092 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-04-24T13:32:30.092 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-04-24T13:32:30.092 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-04-24T13:32:30.092 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-04-24T13:32:30.092 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-04-24T13:32:30.092 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-04-24T13:32:30.092 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-24T13:32:30.092 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-04-24T13:32:30.092 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-04-24T13:32:30.092 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 32, 2024-04-24T13:32:30.092 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 32, 2024-04-24T13:32:30.092 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 32, 2024-04-24T13:32:30.093 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 32, 2024-04-24T13:32:30.093 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 32, 2024-04-24T13:32:30.093 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-04-24T13:32:30.093 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-04-24T13:32:30.093 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-04-24T13:32:30.093 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-04-24T13:32:30.093 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-04-24T13:32:30.093 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-04-24T13:32:30.093 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-04-24T13:32:30.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.093 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "26", 2024-04-24T13:32:30.094 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-04-24T13:32:30.094 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-24T13:32:30.094 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-04-24T13:32:30.094 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-04-24T13:32:30.094 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-04-24T13:32:30.094 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 0, 2024-04-24T13:32:30.094 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 0, 2024-04-24T13:32:30.094 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-04-24T13:32:30.094 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-04-24T13:32:30.094 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-04-24T13:32:30.095 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-04-24T13:32:30.095 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-04-24T13:32:30.095 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-04-24T13:32:30.095 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-04-24T13:32:30.095 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-04-24T13:32:30.095 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-04-24T13:32:30.095 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-04-24T13:32:30.095 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-04-24T13:32:30.095 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-24T13:32:30.095 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-24T13:32:30.095 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-24T13:32:30.095 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-04-24T13:32:30.096 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-04-24T13:32:30.096 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-04-24T13:32:30.096 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-04-24T13:32:30.096 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-04-24T13:32:30.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.096 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-04-24T13:32:30.096 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-04-24T13:32:30.096 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-04-24T13:32:30.096 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: "options": {}, 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": {} 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: "score_type": "Fair distribution", 2024-04-24T13:32:30.097 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 1.75, 2024-04-24T13:32:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 1.75, 2024-04-24T13:32:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: "optimal_score": 0.75, 2024-04-24T13:32:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_acting": 1.309999942779541, 2024-04-24T13:32:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_stable": 1.309999942779541, 2024-04-24T13:32:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity_weighted": 1, 2024-04-24T13:32:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity": 1, 2024-04-24T13:32:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity_weighted": 1 2024-04-24T13:32:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 6, 2024-04-24T13:32:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": "default.rgw.log", 2024-04-24T13:32:30.098 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-04-24T13:30:25.363907+0000", 2024-04-24T13:32:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-04-24T13:32:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool", 2024-04-24T13:32:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-04-24T13:32:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-04-24T13:32:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-04-24T13:32:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-04-24T13:32:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-04-24T13:32:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-04-24T13:32:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-04-24T13:32:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-24T13:32:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-04-24T13:32:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-04-24T13:32:30.099 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 32, 2024-04-24T13:32:30.100 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 32, 2024-04-24T13:32:30.100 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 32, 2024-04-24T13:32:30.100 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 32, 2024-04-24T13:32:30.100 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 32, 2024-04-24T13:32:30.100 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-04-24T13:32:30.100 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-04-24T13:32:30.100 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-04-24T13:32:30.100 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-04-24T13:32:30.100 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-04-24T13:32:30.100 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-04-24T13:32:30.100 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-04-24T13:32:30.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.100 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "28", 2024-04-24T13:32:30.101 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-04-24T13:32:30.101 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-24T13:32:30.101 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-04-24T13:32:30.101 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-04-24T13:32:30.101 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-04-24T13:32:30.101 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 0, 2024-04-24T13:32:30.101 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 0, 2024-04-24T13:32:30.101 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-04-24T13:32:30.101 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-04-24T13:32:30.101 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-04-24T13:32:30.101 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-04-24T13:32:30.101 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-04-24T13:32:30.101 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-04-24T13:32:30.102 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-04-24T13:32:30.102 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-04-24T13:32:30.102 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-04-24T13:32:30.102 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-04-24T13:32:30.102 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-04-24T13:32:30.102 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-24T13:32:30.102 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-24T13:32:30.102 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-24T13:32:30.102 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-04-24T13:32:30.102 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-04-24T13:32:30.102 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-04-24T13:32:30.102 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-04-24T13:32:30.102 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-04-24T13:32:30.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.103 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-04-24T13:32:30.103 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-04-24T13:32:30.103 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-04-24T13:32:30.103 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-04-24T13:32:30.103 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-04-24T13:32:30.103 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-04-24T13:32:30.103 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-04-24T13:32:30.103 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-04-24T13:32:30.103 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-04-24T13:32:30.103 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-04-24T13:32:30.103 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-04-24T13:32:30.104 INFO:teuthology.orchestra.run.smithi071.stdout: "options": {}, 2024-04-24T13:32:30.104 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-04-24T13:32:30.104 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": {} 2024-04-24T13:32:30.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.104 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-04-24T13:32:30.104 INFO:teuthology.orchestra.run.smithi071.stdout: "score_type": "Fair distribution", 2024-04-24T13:32:30.104 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 1.7400000095367432, 2024-04-24T13:32:30.104 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 1.7400000095367432, 2024-04-24T13:32:30.104 INFO:teuthology.orchestra.run.smithi071.stdout: "optimal_score": 0.87999999523162842, 2024-04-24T13:32:30.104 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_acting": 1.5299999713897705, 2024-04-24T13:32:30.104 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_stable": 1.5299999713897705, 2024-04-24T13:32:30.104 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity_weighted": 1, 2024-04-24T13:32:30.105 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity": 1, 2024-04-24T13:32:30.105 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity_weighted": 1 2024-04-24T13:32:30.105 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.105 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 7, 2024-04-24T13:32:30.105 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": "default.rgw.control", 2024-04-24T13:32:30.105 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-04-24T13:30:27.261843+0000", 2024-04-24T13:32:30.105 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-04-24T13:32:30.105 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool", 2024-04-24T13:32:30.105 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-04-24T13:32:30.105 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-04-24T13:32:30.105 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-04-24T13:32:30.106 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-04-24T13:32:30.106 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-04-24T13:32:30.106 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-04-24T13:32:30.106 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-04-24T13:32:30.106 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-24T13:32:30.106 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-04-24T13:32:30.106 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-04-24T13:32:30.106 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 32, 2024-04-24T13:32:30.106 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 32, 2024-04-24T13:32:30.106 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 32, 2024-04-24T13:32:30.106 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 32, 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 32, 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "30", 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-04-24T13:32:30.107 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 0, 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 0, 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-04-24T13:32:30.108 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-04-24T13:32:30.109 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: "options": {}, 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": {} 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: "score_type": "Fair distribution", 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 1.75, 2024-04-24T13:32:30.110 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 1.75, 2024-04-24T13:32:30.111 INFO:teuthology.orchestra.run.smithi071.stdout: "optimal_score": 0.75, 2024-04-24T13:32:30.111 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_acting": 1.309999942779541, 2024-04-24T13:32:30.111 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_stable": 1.309999942779541, 2024-04-24T13:32:30.111 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity_weighted": 1, 2024-04-24T13:32:30.111 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity": 1, 2024-04-24T13:32:30.111 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity_weighted": 1 2024-04-24T13:32:30.111 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.111 INFO:teuthology.orchestra.run.smithi071.stdout: "pool": 8, 2024-04-24T13:32:30.111 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_name": "default.rgw.meta", 2024-04-24T13:32:30.111 INFO:teuthology.orchestra.run.smithi071.stdout: "create_time": "2024-04-24T13:30:29.393640+0000", 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "flags": 1, 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "flags_names": "hashpspool", 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "type": 1, 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 2, 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "min_size": 1, 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_rule": 0, 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_count": 0, 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_target": 0, 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_barrier": 0, 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "peering_crush_bucket_mandatory_member": 2147483647, 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "object_hash": 2, 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_mode": "off", 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num": 32, 2024-04-24T13:32:30.112 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num": 32, 2024-04-24T13:32:30.113 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_placement_num_target": 32, 2024-04-24T13:32:30.113 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_target": 32, 2024-04-24T13:32:30.113 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_num_pending": 32, 2024-04-24T13:32:30.113 INFO:teuthology.orchestra.run.smithi071.stdout: "last_pg_merge_meta": { 2024-04-24T13:32:30.113 INFO:teuthology.orchestra.run.smithi071.stdout: "source_pgid": "0.0", 2024-04-24T13:32:30.113 INFO:teuthology.orchestra.run.smithi071.stdout: "ready_epoch": 0, 2024-04-24T13:32:30.113 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_started": 0, 2024-04-24T13:32:30.113 INFO:teuthology.orchestra.run.smithi071.stdout: "last_epoch_clean": 0, 2024-04-24T13:32:30.113 INFO:teuthology.orchestra.run.smithi071.stdout: "source_version": "0'0", 2024-04-24T13:32:30.113 INFO:teuthology.orchestra.run.smithi071.stdout: "target_version": "0'0" 2024-04-24T13:32:30.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.113 INFO:teuthology.orchestra.run.smithi071.stdout: "last_change": "32", 2024-04-24T13:32:30.113 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend": "0", 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_prenautilus": "0", 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "last_force_op_resend_preluminous": "0", 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "auid": 0, 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_mode": "selfmanaged", 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_seq": 0, 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "snap_epoch": 0, 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "pool_snaps": [], 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps": "[]", 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_bytes": 0, 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "quota_max_objects": 0, 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "tiers": [], 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "tier_of": -1, 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "read_tier": -1, 2024-04-24T13:32:30.114 INFO:teuthology.orchestra.run.smithi071.stdout: "write_tier": -1, 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_mode": "none", 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_bytes": 0, 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: "target_max_objects": 0, 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_ratio_micro": 400000, 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_dirty_high_ratio_micro": 600000, 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_target_full_ratio_micro": 800000, 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_flush_age": 0, 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: "cache_min_evict_age": 0, 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profile": "", 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_params": { 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "none" 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_period": 0, 2024-04-24T13:32:30.115 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_count": 0, 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: "use_gmt_hitset": true, 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: "min_read_recency_for_promote": 0, 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: "min_write_recency_for_promote": 0, 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_grade_decay_rate": 0, 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: "hit_set_search_last_n": 0, 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: "grade_table": [], 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: "stripe_width": 0, 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: "expected_num_objects": 0, 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: "fast_read": false, 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: "options": { 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_autoscale_bias": 4 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: "application_metadata": { 2024-04-24T13:32:30.116 INFO:teuthology.orchestra.run.smithi071.stdout: "rgw": {} 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: "read_balance": { 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: "score_type": "Fair distribution", 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: "score_acting": 1.7400000095367432, 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: "score_stable": 1.7400000095367432, 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: "optimal_score": 0.87999999523162842, 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_acting": 1.5299999713897705, 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: "raw_score_stable": 1.5299999713897705, 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity_weighted": 1, 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity": 1, 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: "average_primary_affinity_weighted": 1 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.117 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-24T13:32:30.118 INFO:teuthology.orchestra.run.smithi071.stdout: "osds": [ 2024-04-24T13:32:30.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.118 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 0, 2024-04-24T13:32:30.118 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "dcf17737-d21a-4731-8a14-4b008f82e1b8", 2024-04-24T13:32:30.118 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-04-24T13:32:30.118 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-04-24T13:32:30.118 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-04-24T13:32:30.118 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-04-24T13:32:30.118 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-04-24T13:32:30.118 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-04-24T13:32:30.118 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 13, 2024-04-24T13:32:30.118 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 74, 2024-04-24T13:32:30.118 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6800", 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1371554644 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6801", 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1371554644 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.119 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6802", 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1371554644 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6803", 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1371554644 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6809", 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1371554644 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6812", 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1371554644 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.121 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-04-24T13:32:30.122 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.122 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.122 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6804", 2024-04-24T13:32:30.122 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1371554644 2024-04-24T13:32:30.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.122 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.122 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6806", 2024-04-24T13:32:30.122 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 1371554644 2024-04-24T13:32:30.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.122 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.123 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6801/1371554644", 2024-04-24T13:32:30.123 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.71:6803/1371554644", 2024-04-24T13:32:30.123 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.71:6812/1371554644", 2024-04-24T13:32:30.123 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.71:6806/1371554644", 2024-04-24T13:32:30.123 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-04-24T13:32:30.123 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-04-24T13:32:30.123 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-04-24T13:32:30.123 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.123 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 1, 2024-04-24T13:32:30.123 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "559511d8-704f-48ae-a330-331a8a18486a", 2024-04-24T13:32:30.123 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-04-24T13:32:30.124 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-04-24T13:32:30.124 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-04-24T13:32:30.124 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-04-24T13:32:30.124 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-04-24T13:32:30.124 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-04-24T13:32:30.124 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 13, 2024-04-24T13:32:30.124 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 74, 2024-04-24T13:32:30.124 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-04-24T13:32:30.124 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-04-24T13:32:30.124 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-04-24T13:32:30.124 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.125 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6824", 2024-04-24T13:32:30.125 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2907970623 2024-04-24T13:32:30.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.125 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6825", 2024-04-24T13:32:30.125 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2907970623 2024-04-24T13:32:30.125 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6826", 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2907970623 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6827", 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2907970623 2024-04-24T13:32:30.126 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-04-24T13:32:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6830", 2024-04-24T13:32:30.127 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2907970623 2024-04-24T13:32:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6831", 2024-04-24T13:32:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2907970623 2024-04-24T13:32:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-04-24T13:32:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.128 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6828", 2024-04-24T13:32:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2907970623 2024-04-24T13:32:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6829", 2024-04-24T13:32:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2907970623 2024-04-24T13:32:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6825/2907970623", 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.71:6827/2907970623", 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.71:6831/2907970623", 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.71:6829/2907970623", 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 2, 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "496cf95c-01c4-4537-ba79-35c2ad152201", 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-04-24T13:32:30.130 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-04-24T13:32:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-04-24T13:32:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-04-24T13:32:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-04-24T13:32:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-04-24T13:32:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 13, 2024-04-24T13:32:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 75, 2024-04-24T13:32:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-04-24T13:32:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-04-24T13:32:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-04-24T13:32:30.131 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6805", 2024-04-24T13:32:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 747727017 2024-04-24T13:32:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6808", 2024-04-24T13:32:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 747727017 2024-04-24T13:32:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-04-24T13:32:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6811", 2024-04-24T13:32:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 747727017 2024-04-24T13:32:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6813", 2024-04-24T13:32:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 747727017 2024-04-24T13:32:30.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-04-24T13:32:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6822", 2024-04-24T13:32:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 747727017 2024-04-24T13:32:30.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6823", 2024-04-24T13:32:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 747727017 2024-04-24T13:32:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-04-24T13:32:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.135 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6816", 2024-04-24T13:32:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 747727017 2024-04-24T13:32:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6819", 2024-04-24T13:32:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 747727017 2024-04-24T13:32:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6808/747727017", 2024-04-24T13:32:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.71:6813/747727017", 2024-04-24T13:32:30.136 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.71:6823/747727017", 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.71:6819/747727017", 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 3, 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "5ce9d307-23e5-4bb9-8035-0827520a6d80", 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-04-24T13:32:30.137 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-04-24T13:32:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-04-24T13:32:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 13, 2024-04-24T13:32:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 74, 2024-04-24T13:32:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-04-24T13:32:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-04-24T13:32:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-04-24T13:32:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6807", 2024-04-24T13:32:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2258589678 2024-04-24T13:32:30.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6810", 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2258589678 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6814", 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2258589678 2024-04-24T13:32:30.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.140 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6815", 2024-04-24T13:32:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2258589678 2024-04-24T13:32:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-04-24T13:32:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6820", 2024-04-24T13:32:30.142 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2258589678 2024-04-24T13:32:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6821", 2024-04-24T13:32:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2258589678 2024-04-24T13:32:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-04-24T13:32:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.143 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6817", 2024-04-24T13:32:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2258589678 2024-04-24T13:32:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.71:6818", 2024-04-24T13:32:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2258589678 2024-04-24T13:32:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.71:6810/2258589678", 2024-04-24T13:32:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.71:6815/2258589678", 2024-04-24T13:32:30.144 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.71:6821/2258589678", 2024-04-24T13:32:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.71:6818/2258589678", 2024-04-24T13:32:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-04-24T13:32:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-04-24T13:32:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-04-24T13:32:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 4, 2024-04-24T13:32:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "6d6e5b3c-301d-4b2c-996f-17d13224f780", 2024-04-24T13:32:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-04-24T13:32:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-04-24T13:32:30.145 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-04-24T13:32:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-04-24T13:32:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-04-24T13:32:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-04-24T13:32:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 13, 2024-04-24T13:32:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 74, 2024-04-24T13:32:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-04-24T13:32:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-04-24T13:32:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-04-24T13:32:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6810", 2024-04-24T13:32:30.146 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2264053969 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6814", 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2264053969 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6817", 2024-04-24T13:32:30.147 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2264053969 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6821", 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2264053969 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6828", 2024-04-24T13:32:30.148 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2264053969 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6830", 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2264053969 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6824", 2024-04-24T13:32:30.149 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2264053969 2024-04-24T13:32:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6826", 2024-04-24T13:32:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2264053969 2024-04-24T13:32:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.138:6814/2264053969", 2024-04-24T13:32:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.138:6821/2264053969", 2024-04-24T13:32:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.138:6830/2264053969", 2024-04-24T13:32:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.138:6826/2264053969", 2024-04-24T13:32:30.150 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 5, 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "b3d18c54-5a9a-4215-8b40-3e796ac2fed4", 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0.1231536865234375, 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-04-24T13:32:30.151 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 13, 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 48, 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6812", 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 942955714 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6815", 2024-04-24T13:32:30.152 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 942955714 2024-04-24T13:32:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-04-24T13:32:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6819", 2024-04-24T13:32:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 942955714 2024-04-24T13:32:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.153 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6822", 2024-04-24T13:32:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 942955714 2024-04-24T13:32:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-04-24T13:32:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6829", 2024-04-24T13:32:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 942955714 2024-04-24T13:32:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.154 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6831", 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 942955714 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6825", 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 942955714 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.155 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6827", 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 942955714 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.138:6815/942955714", 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.138:6822/942955714", 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.138:6831/942955714", 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.138:6827/942955714", 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 6, 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "12d21ba0-8670-470b-8fd5-a02349ecb4d4", 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 1, 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 1, 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 13, 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 75, 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-04-24T13:32:30.157 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-04-24T13:32:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6808", 2024-04-24T13:32:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 889830629 2024-04-24T13:32:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6809", 2024-04-24T13:32:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 889830629 2024-04-24T13:32:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6811", 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 889830629 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6813", 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 889830629 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6820", 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 889830629 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6823", 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 889830629 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-04-24T13:32:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6816", 2024-04-24T13:32:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 889830629 2024-04-24T13:32:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6818", 2024-04-24T13:32:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 889830629 2024-04-24T13:32:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.161 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.138:6809/889830629", 2024-04-24T13:32:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.138:6813/889830629", 2024-04-24T13:32:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.138:6823/889830629", 2024-04-24T13:32:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.138:6818/889830629", 2024-04-24T13:32:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-04-24T13:32:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-04-24T13:32:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-04-24T13:32:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 7, 2024-04-24T13:32:30.162 INFO:teuthology.orchestra.run.smithi071.stdout: "uuid": "dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce", 2024-04-24T13:32:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "up": 1, 2024-04-24T13:32:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "in": 0, 2024-04-24T13:32:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "weight": 0, 2024-04-24T13:32:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_affinity": 1, 2024-04-24T13:32:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_begin": 0, 2024-04-24T13:32:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "last_clean_end": 0, 2024-04-24T13:32:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "up_from": 13, 2024-04-24T13:32:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "up_thru": 30, 2024-04-24T13:32:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "down_at": 0, 2024-04-24T13:32:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "lost_at": 0, 2024-04-24T13:32:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addrs": { 2024-04-24T13:32:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6800", 2024-04-24T13:32:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2015291049 2024-04-24T13:32:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6801", 2024-04-24T13:32:30.164 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2015291049 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addrs": { 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6802", 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2015291049 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6803", 2024-04-24T13:32:30.165 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2015291049 2024-04-24T13:32:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addrs": { 2024-04-24T13:32:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.166 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6806", 2024-04-24T13:32:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2015291049 2024-04-24T13:32:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6807", 2024-04-24T13:32:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2015291049 2024-04-24T13:32:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addrs": { 2024-04-24T13:32:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "addrvec": [ 2024-04-24T13:32:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v2", 2024-04-24T13:32:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6804", 2024-04-24T13:32:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2015291049 2024-04-24T13:32:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: "type": "v1", 2024-04-24T13:32:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: "addr": "172.21.15.138:6805", 2024-04-24T13:32:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: "nonce": 2015291049 2024-04-24T13:32:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "public_addr": "172.21.15.138:6801/2015291049", 2024-04-24T13:32:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "cluster_addr": "172.21.15.138:6803/2015291049", 2024-04-24T13:32:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_back_addr": "172.21.15.138:6807/2015291049", 2024-04-24T13:32:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "heartbeat_front_addr": "172.21.15.138:6805/2015291049", 2024-04-24T13:32:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "state": [ 2024-04-24T13:32:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "exists", 2024-04-24T13:32:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "up" 2024-04-24T13:32:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-24T13:32:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: "osd_xinfo": [ 2024-04-24T13:32:30.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 0, 2024-04-24T13:32:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-04-24T13:32:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-04-24T13:32:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-04-24T13:32:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540701547738038271, 2024-04-24T13:32:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-04-24T13:32:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-04-24T13:30:03.268101+0000", 2024-04-24T13:32:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-04-24T13:32:30.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 1, 2024-04-24T13:32:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-04-24T13:32:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-04-24T13:32:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-04-24T13:32:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540701547738038271, 2024-04-24T13:32:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-04-24T13:32:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-04-24T13:30:03.247572+0000", 2024-04-24T13:32:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-04-24T13:32:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 2, 2024-04-24T13:32:30.171 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-04-24T13:32:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-04-24T13:32:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-04-24T13:32:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540701547738038271, 2024-04-24T13:32:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-04-24T13:32:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-04-24T13:30:03.186485+0000", 2024-04-24T13:32:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-04-24T13:32:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.172 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 3, 2024-04-24T13:32:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-04-24T13:32:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-04-24T13:32:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-04-24T13:32:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540701547738038271, 2024-04-24T13:32:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-04-24T13:32:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-04-24T13:30:03.184532+0000", 2024-04-24T13:32:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-04-24T13:32:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 4, 2024-04-24T13:32:30.173 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-04-24T13:32:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-04-24T13:32:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-04-24T13:32:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540701547738038271, 2024-04-24T13:32:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-04-24T13:32:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-04-24T13:30:03.157242+0000", 2024-04-24T13:32:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-04-24T13:32:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 5, 2024-04-24T13:32:30.174 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-04-24T13:32:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-04-24T13:32:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-04-24T13:32:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540701547738038271, 2024-04-24T13:32:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-04-24T13:32:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-04-24T13:30:03.126293+0000", 2024-04-24T13:32:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-04-24T13:32:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 6, 2024-04-24T13:32:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-04-24T13:32:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-04-24T13:32:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-04-24T13:32:30.175 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540701547738038271, 2024-04-24T13:32:30.176 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 0, 2024-04-24T13:32:30.176 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-04-24T13:30:03.118991+0000", 2024-04-24T13:32:30.176 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-04-24T13:32:30.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.176 INFO:teuthology.orchestra.run.smithi071.stdout: "osd": 7, 2024-04-24T13:32:30.176 INFO:teuthology.orchestra.run.smithi071.stdout: "down_stamp": "0.000000", 2024-04-24T13:32:30.176 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_probability": 0, 2024-04-24T13:32:30.176 INFO:teuthology.orchestra.run.smithi071.stdout: "laggy_interval": 0, 2024-04-24T13:32:30.176 INFO:teuthology.orchestra.run.smithi071.stdout: "features": 4540701547738038271, 2024-04-24T13:32:30.176 INFO:teuthology.orchestra.run.smithi071.stdout: "old_weight": 65536, 2024-04-24T13:32:30.176 INFO:teuthology.orchestra.run.smithi071.stdout: "last_purged_snaps_scrub": "2024-04-24T13:30:03.213395+0000", 2024-04-24T13:32:30.176 INFO:teuthology.orchestra.run.smithi071.stdout: "dead_epoch": 0 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_upmap": [], 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_upmap_items": [ 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: "pgid": "3.3", 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: "mappings": [ 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: "from": 0, 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: "to": 1 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: "pgid": "3.a", 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: "mappings": [ 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: "from": 4, 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: "to": 2 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: "pgid": "3.f", 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: "mappings": [ 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: "from": 4, 2024-04-24T13:32:30.178 INFO:teuthology.orchestra.run.smithi071.stdout: "to": 2 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: "pgid": "3.14", 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: "mappings": [ 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: "from": 4, 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: "to": 2 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.179 INFO:teuthology.orchestra.run.smithi071.stdout: "pgid": "3.1f", 2024-04-24T13:32:30.180 INFO:teuthology.orchestra.run.smithi071.stdout: "mappings": [ 2024-04-24T13:32:30.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.180 INFO:teuthology.orchestra.run.smithi071.stdout: "from": 0, 2024-04-24T13:32:30.180 INFO:teuthology.orchestra.run.smithi071.stdout: "to": 2 2024-04-24T13:32:30.180 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.180 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.180 INFO:teuthology.orchestra.run.smithi071.stdout: "pgid": "3.3f", 2024-04-24T13:32:30.180 INFO:teuthology.orchestra.run.smithi071.stdout: "mappings": [ 2024-04-24T13:32:30.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.180 INFO:teuthology.orchestra.run.smithi071.stdout: "from": 0, 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: "to": 2 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: "pgid": "4.0", 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: "mappings": [ 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: "from": 3, 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: "to": 2 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.182 INFO:teuthology.orchestra.run.smithi071.stdout: "pgid": "4.a", 2024-04-24T13:32:30.182 INFO:teuthology.orchestra.run.smithi071.stdout: "mappings": [ 2024-04-24T13:32:30.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.182 INFO:teuthology.orchestra.run.smithi071.stdout: "from": 1, 2024-04-24T13:32:30.182 INFO:teuthology.orchestra.run.smithi071.stdout: "to": 2 2024-04-24T13:32:30.182 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.182 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.182 INFO:teuthology.orchestra.run.smithi071.stdout: "pgid": "4.19", 2024-04-24T13:32:30.182 INFO:teuthology.orchestra.run.smithi071.stdout: "mappings": [ 2024-04-24T13:32:30.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.183 INFO:teuthology.orchestra.run.smithi071.stdout: "from": 3, 2024-04-24T13:32:30.183 INFO:teuthology.orchestra.run.smithi071.stdout: "to": 5 2024-04-24T13:32:30.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.183 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.183 INFO:teuthology.orchestra.run.smithi071.stdout: "pgid": "6.1b", 2024-04-24T13:32:30.183 INFO:teuthology.orchestra.run.smithi071.stdout: "mappings": [ 2024-04-24T13:32:30.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:30.183 INFO:teuthology.orchestra.run.smithi071.stdout: "from": 3, 2024-04-24T13:32:30.183 INFO:teuthology.orchestra.run.smithi071.stdout: "to": 2 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_upmap_primaries": [], 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: "pg_temp": [], 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: "primary_temp": [], 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: "blocklist": {}, 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: "range_blocklist": {}, 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: "erasure_code_profiles": { 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: "default": { 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: "crush-failure-domain": "osd", 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: "k": "2", 2024-04-24T13:32:30.184 INFO:teuthology.orchestra.run.smithi071.stdout: "m": "1", 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: "plugin": "jerasure", 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: "technique": "reed_sol_van" 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: "removed_snaps_queue": [], 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: "new_removed_snaps": [], 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: "new_purged_snaps": [], 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: "crush_node_flags": {}, 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: "device_class_flags": {}, 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode": { 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode_enabled": false, 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_bucket_count": 0, 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: "degraded_stretch_mode": 0, 2024-04-24T13:32:30.185 INFO:teuthology.orchestra.run.smithi071.stdout: "recovering_stretch_mode": 0, 2024-04-24T13:32:30.186 INFO:teuthology.orchestra.run.smithi071.stdout: "stretch_mode_bucket": 0 2024-04-24T13:32:30.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:30.186 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:30.186 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:30.060+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:30.188 INFO:tasks.thrashosds.thrasher:j is {'epoch': 86, 'fsid': '6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8', 'created': '2024-04-24T13:29:54.500837+0000', 'modified': '2024-04-24T13:32:29.414781+0000', 'last_up_change': '2024-04-24T13:30:06.614065+0000', 'last_in_change': '2024-04-24T13:30:49.878979+0000', 'flags': 'noscrub,sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit', 'flags_num': 5801984, 'flags_set': ['noscrub', 'pglog_hardlimit', 'purged_snapdirs', 'recovery_deletes', 'sortbitwise'], 'crush_version': 4, 'full_ratio': 0.949999988079071, 'backfillfull_ratio': 0.8999999761581421, 'nearfull_ratio': 0.8500000238418579, 'cluster_snapshot': '', 'pool_max': 8, 'max_osd': 8, 'require_min_compat_client': 'luminous', 'min_compat_client': 'luminous', 'require_osd_release': 'squid', 'allow_crimson': False, 'pools': [{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-04-24T13:30:07.251223+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '16', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 8, 'score_stable': 8, 'optimal_score': 0.25, 'raw_score_acting': 2, 'raw_score_stable': 2, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'rbd', 'create_time': '2024-04-24T13:30:13.385113+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 8, 'pg_placement_num': 8, 'pg_placement_num_target': 8, 'pg_num_target': 8, 'pg_num_pending': 8, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '19', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rbd': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 4, 'score_stable': 4, 'optimal_score': 0.75, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'default.rgw.buckets.data', 'create_time': '2024-04-24T13:30:20.167043+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 4, 'pool_name': 'default.rgw.buckets.index', 'create_time': '2024-04-24T13:30:21.533214+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 64, 'pg_placement_num': 64, 'pg_placement_num_target': 64, 'pg_num_target': 64, 'pg_num_pending': 64, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '24', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.9900000095367432, 'score_stable': 1.9900000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.75, 'raw_score_stable': 1.75, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 5, 'pool_name': '.rgw.root', 'create_time': '2024-04-24T13:30:23.455631+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '26', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 0.75, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 6, 'pool_name': 'default.rgw.log', 'create_time': '2024-04-24T13:30:25.363907+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '28', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 7, 'pool_name': 'default.rgw.control', 'create_time': '2024-04-24T13:30:27.261843+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '30', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.75, 'score_stable': 1.75, 'optimal_score': 0.75, 'raw_score_acting': 1.309999942779541, 'raw_score_stable': 1.309999942779541, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 8, 'pool_name': 'default.rgw.meta', 'create_time': '2024-04-24T13:30:29.393640+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 2, 'min_size': 1, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '32', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4}, 'application_metadata': {'rgw': {}}, 'read_balance': {'score_type': 'Fair distribution', 'score_acting': 1.7400000095367432, 'score_stable': 1.7400000095367432, 'optimal_score': 0.8799999952316284, 'raw_score_acting': 1.5299999713897705, 'raw_score_stable': 1.5299999713897705, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}], 'osds': [{'osd': 0, 'uuid': 'dcf17737-d21a-4731-8a14-4b008f82e1b8', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6800', 'nonce': 1371554644}, {'type': 'v1', 'addr': '172.21.15.71:6801', 'nonce': 1371554644}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6802', 'nonce': 1371554644}, {'type': 'v1', 'addr': '172.21.15.71:6803', 'nonce': 1371554644}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6809', 'nonce': 1371554644}, {'type': 'v1', 'addr': '172.21.15.71:6812', 'nonce': 1371554644}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6804', 'nonce': 1371554644}, {'type': 'v1', 'addr': '172.21.15.71:6806', 'nonce': 1371554644}]}, 'public_addr': '172.21.15.71:6801/1371554644', 'cluster_addr': '172.21.15.71:6803/1371554644', 'heartbeat_back_addr': '172.21.15.71:6812/1371554644', 'heartbeat_front_addr': '172.21.15.71:6806/1371554644', 'state': ['exists', 'up']}, {'osd': 1, 'uuid': '559511d8-704f-48ae-a330-331a8a18486a', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6824', 'nonce': 2907970623}, {'type': 'v1', 'addr': '172.21.15.71:6825', 'nonce': 2907970623}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6826', 'nonce': 2907970623}, {'type': 'v1', 'addr': '172.21.15.71:6827', 'nonce': 2907970623}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6830', 'nonce': 2907970623}, {'type': 'v1', 'addr': '172.21.15.71:6831', 'nonce': 2907970623}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6828', 'nonce': 2907970623}, {'type': 'v1', 'addr': '172.21.15.71:6829', 'nonce': 2907970623}]}, 'public_addr': '172.21.15.71:6825/2907970623', 'cluster_addr': '172.21.15.71:6827/2907970623', 'heartbeat_back_addr': '172.21.15.71:6831/2907970623', 'heartbeat_front_addr': '172.21.15.71:6829/2907970623', 'state': ['exists', 'up']}, {'osd': 2, 'uuid': '496cf95c-01c4-4537-ba79-35c2ad152201', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 75, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6805', 'nonce': 747727017}, {'type': 'v1', 'addr': '172.21.15.71:6808', 'nonce': 747727017}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6811', 'nonce': 747727017}, {'type': 'v1', 'addr': '172.21.15.71:6813', 'nonce': 747727017}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6822', 'nonce': 747727017}, {'type': 'v1', 'addr': '172.21.15.71:6823', 'nonce': 747727017}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6816', 'nonce': 747727017}, {'type': 'v1', 'addr': '172.21.15.71:6819', 'nonce': 747727017}]}, 'public_addr': '172.21.15.71:6808/747727017', 'cluster_addr': '172.21.15.71:6813/747727017', 'heartbeat_back_addr': '172.21.15.71:6823/747727017', 'heartbeat_front_addr': '172.21.15.71:6819/747727017', 'state': ['exists', 'up']}, {'osd': 3, 'uuid': '5ce9d307-23e5-4bb9-8035-0827520a6d80', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6807', 'nonce': 2258589678}, {'type': 'v1', 'addr': '172.21.15.71:6810', 'nonce': 2258589678}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6814', 'nonce': 2258589678}, {'type': 'v1', 'addr': '172.21.15.71:6815', 'nonce': 2258589678}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6820', 'nonce': 2258589678}, {'type': 'v1', 'addr': '172.21.15.71:6821', 'nonce': 2258589678}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.71:6817', 'nonce': 2258589678}, {'type': 'v1', 'addr': '172.21.15.71:6818', 'nonce': 2258589678}]}, 'public_addr': '172.21.15.71:6810/2258589678', 'cluster_addr': '172.21.15.71:6815/2258589678', 'heartbeat_back_addr': '172.21.15.71:6821/2258589678', 'heartbeat_front_addr': '172.21.15.71:6818/2258589678', 'state': ['exists', 'up']}, {'osd': 4, 'uuid': '6d6e5b3c-301d-4b2c-996f-17d13224f780', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 74, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6810', 'nonce': 2264053969}, {'type': 'v1', 'addr': '172.21.15.138:6814', 'nonce': 2264053969}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6817', 'nonce': 2264053969}, {'type': 'v1', 'addr': '172.21.15.138:6821', 'nonce': 2264053969}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6828', 'nonce': 2264053969}, {'type': 'v1', 'addr': '172.21.15.138:6830', 'nonce': 2264053969}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6824', 'nonce': 2264053969}, {'type': 'v1', 'addr': '172.21.15.138:6826', 'nonce': 2264053969}]}, 'public_addr': '172.21.15.138:6814/2264053969', 'cluster_addr': '172.21.15.138:6821/2264053969', 'heartbeat_back_addr': '172.21.15.138:6830/2264053969', 'heartbeat_front_addr': '172.21.15.138:6826/2264053969', 'state': ['exists', 'up']}, {'osd': 5, 'uuid': 'b3d18c54-5a9a-4215-8b40-3e796ac2fed4', 'up': 1, 'in': 1, 'weight': 0.1231536865234375, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 48, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6812', 'nonce': 942955714}, {'type': 'v1', 'addr': '172.21.15.138:6815', 'nonce': 942955714}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6819', 'nonce': 942955714}, {'type': 'v1', 'addr': '172.21.15.138:6822', 'nonce': 942955714}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6829', 'nonce': 942955714}, {'type': 'v1', 'addr': '172.21.15.138:6831', 'nonce': 942955714}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6825', 'nonce': 942955714}, {'type': 'v1', 'addr': '172.21.15.138:6827', 'nonce': 942955714}]}, 'public_addr': '172.21.15.138:6815/942955714', 'cluster_addr': '172.21.15.138:6822/942955714', 'heartbeat_back_addr': '172.21.15.138:6831/942955714', 'heartbeat_front_addr': '172.21.15.138:6827/942955714', 'state': ['exists', 'up']}, {'osd': 6, 'uuid': '12d21ba0-8670-470b-8fd5-a02349ecb4d4', 'up': 1, 'in': 1, 'weight': 1, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 75, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6808', 'nonce': 889830629}, {'type': 'v1', 'addr': '172.21.15.138:6809', 'nonce': 889830629}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6811', 'nonce': 889830629}, {'type': 'v1', 'addr': '172.21.15.138:6813', 'nonce': 889830629}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6820', 'nonce': 889830629}, {'type': 'v1', 'addr': '172.21.15.138:6823', 'nonce': 889830629}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6816', 'nonce': 889830629}, {'type': 'v1', 'addr': '172.21.15.138:6818', 'nonce': 889830629}]}, 'public_addr': '172.21.15.138:6809/889830629', 'cluster_addr': '172.21.15.138:6813/889830629', 'heartbeat_back_addr': '172.21.15.138:6823/889830629', 'heartbeat_front_addr': '172.21.15.138:6818/889830629', 'state': ['exists', 'up']}, {'osd': 7, 'uuid': 'dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce', 'up': 1, 'in': 0, 'weight': 0, 'primary_affinity': 1, 'last_clean_begin': 0, 'last_clean_end': 0, 'up_from': 13, 'up_thru': 30, 'down_at': 0, 'lost_at': 0, 'public_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6800', 'nonce': 2015291049}, {'type': 'v1', 'addr': '172.21.15.138:6801', 'nonce': 2015291049}]}, 'cluster_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6802', 'nonce': 2015291049}, {'type': 'v1', 'addr': '172.21.15.138:6803', 'nonce': 2015291049}]}, 'heartbeat_back_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6806', 'nonce': 2015291049}, {'type': 'v1', 'addr': '172.21.15.138:6807', 'nonce': 2015291049}]}, 'heartbeat_front_addrs': {'addrvec': [{'type': 'v2', 'addr': '172.21.15.138:6804', 'nonce': 2015291049}, {'type': 'v1', 'addr': '172.21.15.138:6805', 'nonce': 2015291049}]}, 'public_addr': '172.21.15.138:6801/2015291049', 'cluster_addr': '172.21.15.138:6803/2015291049', 'heartbeat_back_addr': '172.21.15.138:6807/2015291049', 'heartbeat_front_addr': '172.21.15.138:6805/2015291049', 'state': ['exists', 'up']}], 'osd_xinfo': [{'osd': 0, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-24T13:30:03.268101+0000', 'dead_epoch': 0}, {'osd': 1, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-24T13:30:03.247572+0000', 'dead_epoch': 0}, {'osd': 2, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-24T13:30:03.186485+0000', 'dead_epoch': 0}, {'osd': 3, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-24T13:30:03.184532+0000', 'dead_epoch': 0}, {'osd': 4, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-24T13:30:03.157242+0000', 'dead_epoch': 0}, {'osd': 5, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-24T13:30:03.126293+0000', 'dead_epoch': 0}, {'osd': 6, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 0, 'last_purged_snaps_scrub': '2024-04-24T13:30:03.118991+0000', 'dead_epoch': 0}, {'osd': 7, 'down_stamp': '0.000000', 'laggy_probability': 0, 'laggy_interval': 0, 'features': 4540701547738038271, 'old_weight': 65536, 'last_purged_snaps_scrub': '2024-04-24T13:30:03.213395+0000', 'dead_epoch': 0}], 'pg_upmap': [], 'pg_upmap_items': [{'pgid': '3.3', 'mappings': [{'from': 0, 'to': 1}]}, {'pgid': '3.a', 'mappings': [{'from': 4, 'to': 2}]}, {'pgid': '3.f', 'mappings': [{'from': 4, 'to': 2}]}, {'pgid': '3.14', 'mappings': [{'from': 4, 'to': 2}]}, {'pgid': '3.1f', 'mappings': [{'from': 0, 'to': 2}]}, {'pgid': '3.3f', 'mappings': [{'from': 0, 'to': 2}]}, {'pgid': '4.0', 'mappings': [{'from': 3, 'to': 2}]}, {'pgid': '4.a', 'mappings': [{'from': 1, 'to': 2}]}, {'pgid': '4.19', 'mappings': [{'from': 3, 'to': 5}]}, {'pgid': '6.1b', 'mappings': [{'from': 3, 'to': 2}]}], 'pg_upmap_primaries': [], 'pg_temp': [], 'primary_temp': [], 'blocklist': {}, 'range_blocklist': {}, 'erasure_code_profiles': {'default': {'crush-failure-domain': 'osd', 'k': '2', 'm': '1', 'plugin': 'jerasure', 'technique': 'reed_sol_van'}}, 'removed_snaps_queue': [], 'new_removed_snaps': [], 'new_purged_snaps': [], 'crush_node_flags': {}, 'device_class_flags': {}, 'stretch_mode': {'stretch_mode_enabled': False, 'stretch_bucket_count': 0, 'degraded_stretch_mode': 0, 'recovering_stretch_mode': 0, 'stretch_mode_bucket': 0}} 2024-04-24T13:32:30.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:32:30.189 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:30.189 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:30.190 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:32:30.231 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:30.228+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:30.292 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:30.289+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:30.389 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:30.389 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:30.392 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:30.389+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:30.412 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:32:30.493 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:30.489+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:30.563 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:30.563 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:30.588 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:32:30.634 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:30.632+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:30.671 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:32:30.677 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:32:30.696 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":150,"stamp":"2024-04-24T13:32:29.425151+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":25780679,"num_objects":219,"num_object_clones":0,"num_object_copies":438,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":219,"num_whiteouts":0,"num_read":2431,"num_read_kb":2140,"num_write":1071,"num_write_kb":43499,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":102,"num_bytes_recovered":594335,"num_keys_recovered":2,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1729,"ondisk_log_size":1729,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":275804,"kb_used_data":57544,"kb_used_omap":10,"kb_used_meta":218165,"kb_avail":660327076,"statfs":{"total":676457349120,"available":676174925824,"internally_reserved":0,"allocated":58925056,"data_stored":55548912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11161,"internal_metadata":223401063},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":5,"apply_latency_ms":5,"commit_latency_ns":5000000,"apply_latency_ns":5000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.161804"},"pg_stats":[{"pgid":"3.3f","version":"0'0","reported_seq":101,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.803157+0000","last_change":"2024-04-24T13:31:00.989667+0000","last_active":"2024-04-24T13:32:26.803157+0000","last_peered":"2024-04-24T13:32:26.803157+0000","last_clean":"2024-04-24T13:32:26.803157+0000","last_became_active":"2024-04-24T13:31:00.989365+0000","last_became_peered":"2024-04-24T13:31:00.989365+0000","last_unstale":"2024-04-24T13:32:26.803157+0000","last_undegraded":"2024-04-24T13:32:26.803157+0000","last_fullsized":"2024-04-24T13:32:26.803157+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:00:51.108396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.38","version":"82'14","reported_seq":178,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.401989+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:32:26.401989+0000","last_peered":"2024-04-24T13:32:26.401989+0000","last_clean":"2024-04-24T13:32:26.401989+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:32:26.401989+0000","last_undegraded":"2024-04-24T13:32:26.401989+0000","last_fullsized":"2024-04-24T13:32:26.401989+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":138,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.504076+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:32:26.504076+0000","last_peered":"2024-04-24T13:32:26.504076+0000","last_clean":"2024-04-24T13:32:26.504076+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:32:26.504076+0000","last_undegraded":"2024-04-24T13:32:26.504076+0000","last_fullsized":"2024-04-24T13:32:26.504076+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"82'4","reported_seq":115,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502412+0000","last_change":"2024-04-24T13:30:50.941589+0000","last_active":"2024-04-24T13:32:26.502412+0000","last_peered":"2024-04-24T13:32:26.502412+0000","last_clean":"2024-04-24T13:32:26.502412+0000","last_became_active":"2024-04-24T13:30:50.941305+0000","last_became_peered":"2024-04-24T13:30:50.941305+0000","last_unstale":"2024-04-24T13:32:26.502412+0000","last_undegraded":"2024-04-24T13:32:26.502412+0000","last_fullsized":"2024-04-24T13:32:26.502412+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:23.793119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"81'2","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402463+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:32:26.402463+0000","last_peered":"2024-04-24T13:32:26.402463+0000","last_clean":"2024-04-24T13:32:26.402463+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:32:26.402463+0000","last_undegraded":"2024-04-24T13:32:26.402463+0000","last_fullsized":"2024-04-24T13:32:26.402463+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800665+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:32:26.800665+0000","last_peered":"2024-04-24T13:32:26.800665+0000","last_clean":"2024-04-24T13:32:26.800665+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:32:26.800665+0000","last_undegraded":"2024-04-24T13:32:26.800665+0000","last_fullsized":"2024-04-24T13:32:26.800665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":138,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402047+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:32:26.402047+0000","last_peered":"2024-04-24T13:32:26.402047+0000","last_clean":"2024-04-24T13:32:26.402047+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:32:26.402047+0000","last_undegraded":"2024-04-24T13:32:26.402047+0000","last_fullsized":"2024-04-24T13:32:26.402047+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"83'3","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399879+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:32:26.399879+0000","last_peered":"2024-04-24T13:32:26.399879+0000","last_clean":"2024-04-24T13:32:26.399879+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:32:26.399879+0000","last_undegraded":"2024-04-24T13:32:26.399879+0000","last_fullsized":"2024-04-24T13:32:26.399879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":97,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798041+0000","last_change":"2024-04-24T13:30:50.941360+0000","last_active":"2024-04-24T13:32:26.798041+0000","last_peered":"2024-04-24T13:32:26.798041+0000","last_clean":"2024-04-24T13:32:26.798041+0000","last_became_active":"2024-04-24T13:30:50.940816+0000","last_became_peered":"2024-04-24T13:30:50.940816+0000","last_unstale":"2024-04-24T13:32:26.798041+0000","last_undegraded":"2024-04-24T13:32:26.798041+0000","last_fullsized":"2024-04-24T13:32:26.798041+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:04.247947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"82'2","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801129+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:32:26.801129+0000","last_peered":"2024-04-24T13:32:26.801129+0000","last_clean":"2024-04-24T13:32:26.801129+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:32:26.801129+0000","last_undegraded":"2024-04-24T13:32:26.801129+0000","last_fullsized":"2024-04-24T13:32:26.801129+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"81'1","reported_seq":138,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.401990+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:32:26.401990+0000","last_peered":"2024-04-24T13:32:26.401990+0000","last_clean":"2024-04-24T13:32:26.401990+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:32:26.401990+0000","last_undegraded":"2024-04-24T13:32:26.401990+0000","last_fullsized":"2024-04-24T13:32:26.401990+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"82'4","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.804631+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:32:26.804631+0000","last_peered":"2024-04-24T13:32:26.804631+0000","last_clean":"2024-04-24T13:32:26.804631+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:32:26.804631+0000","last_undegraded":"2024-04-24T13:32:26.804631+0000","last_fullsized":"2024-04-24T13:32:26.804631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":97,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399059+0000","last_change":"2024-04-24T13:30:50.911441+0000","last_active":"2024-04-24T13:32:26.399059+0000","last_peered":"2024-04-24T13:32:26.399059+0000","last_clean":"2024-04-24T13:32:26.399059+0000","last_became_active":"2024-04-24T13:30:50.911096+0000","last_became_peered":"2024-04-24T13:30:50.911096+0000","last_unstale":"2024-04-24T13:32:26.399059+0000","last_undegraded":"2024-04-24T13:32:26.399059+0000","last_fullsized":"2024-04-24T13:32:26.399059+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:12.878818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"82'2","reported_seq":41,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503659+0000","last_change":"2024-04-24T13:32:00.564552+0000","last_active":"2024-04-24T13:32:26.503659+0000","last_peered":"2024-04-24T13:32:26.503659+0000","last_clean":"2024-04-24T13:32:26.503659+0000","last_became_active":"2024-04-24T13:32:00.564271+0000","last_became_peered":"2024-04-24T13:32:00.564271+0000","last_unstale":"2024-04-24T13:32:26.503659+0000","last_undegraded":"2024-04-24T13:32:26.503659+0000","last_fullsized":"2024-04-24T13:32:26.503659+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:31.661093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801210+0000","last_change":"2024-04-24T13:32:00.576894+0000","last_active":"2024-04-24T13:32:26.801210+0000","last_peered":"2024-04-24T13:32:26.801210+0000","last_clean":"2024-04-24T13:32:26.801210+0000","last_became_active":"2024-04-24T13:32:00.575339+0000","last_became_peered":"2024-04-24T13:32:00.575339+0000","last_unstale":"2024-04-24T13:32:26.801210+0000","last_undegraded":"2024-04-24T13:32:26.801210+0000","last_fullsized":"2024-04-24T13:32:26.801210+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:40.193989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"82'6","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800011+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:32:26.800011+0000","last_peered":"2024-04-24T13:32:26.800011+0000","last_clean":"2024-04-24T13:32:26.800011+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:32:26.800011+0000","last_undegraded":"2024-04-24T13:32:26.800011+0000","last_fullsized":"2024-04-24T13:32:26.800011+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"83'3","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799469+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:32:26.799469+0000","last_peered":"2024-04-24T13:32:26.799469+0000","last_clean":"2024-04-24T13:32:26.799469+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:32:26.799469+0000","last_undegraded":"2024-04-24T13:32:26.799469+0000","last_fullsized":"2024-04-24T13:32:26.799469+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402438+0000","last_change":"2024-04-24T13:32:00.572932+0000","last_active":"2024-04-24T13:32:26.402438+0000","last_peered":"2024-04-24T13:32:26.402438+0000","last_clean":"2024-04-24T13:32:26.402438+0000","last_became_active":"2024-04-24T13:32:00.571887+0000","last_became_peered":"2024-04-24T13:32:00.571887+0000","last_unstale":"2024-04-24T13:32:26.402438+0000","last_undegraded":"2024-04-24T13:32:26.402438+0000","last_fullsized":"2024-04-24T13:32:26.402438+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:41.648006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"82'4","reported_seq":114,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502271+0000","last_change":"2024-04-24T13:30:50.937742+0000","last_active":"2024-04-24T13:32:26.502271+0000","last_peered":"2024-04-24T13:32:26.502271+0000","last_clean":"2024-04-24T13:32:26.502271+0000","last_became_active":"2024-04-24T13:30:50.937395+0000","last_became_peered":"2024-04-24T13:30:50.937395+0000","last_unstale":"2024-04-24T13:32:26.502271+0000","last_undegraded":"2024-04-24T13:32:26.502271+0000","last_fullsized":"2024-04-24T13:32:26.502271+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:43.335130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"82'2","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802480+0000","last_change":"2024-04-24T13:32:00.584981+0000","last_active":"2024-04-24T13:32:26.802480+0000","last_peered":"2024-04-24T13:32:26.802480+0000","last_clean":"2024-04-24T13:32:26.802480+0000","last_became_active":"2024-04-24T13:32:00.584186+0000","last_became_peered":"2024-04-24T13:32:00.584186+0000","last_unstale":"2024-04-24T13:32:26.802480+0000","last_undegraded":"2024-04-24T13:32:26.802480+0000","last_fullsized":"2024-04-24T13:32:26.802480+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.808699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"83'5","reported_seq":52,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797841+0000","last_change":"2024-04-24T13:32:00.565847+0000","last_active":"2024-04-24T13:32:26.797841+0000","last_peered":"2024-04-24T13:32:26.797841+0000","last_clean":"2024-04-24T13:32:26.797841+0000","last_became_active":"2024-04-24T13:32:00.565548+0000","last_became_peered":"2024-04-24T13:32:00.565548+0000","last_unstale":"2024-04-24T13:32:26.797841+0000","last_undegraded":"2024-04-24T13:32:26.797841+0000","last_fullsized":"2024-04-24T13:32:26.797841+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:21.522361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802613+0000","last_change":"2024-04-24T13:32:00.599603+0000","last_active":"2024-04-24T13:32:26.802613+0000","last_peered":"2024-04-24T13:32:26.802613+0000","last_clean":"2024-04-24T13:32:26.802613+0000","last_became_active":"2024-04-24T13:32:00.598954+0000","last_became_peered":"2024-04-24T13:32:00.598954+0000","last_unstale":"2024-04-24T13:32:26.802613+0000","last_undegraded":"2024-04-24T13:32:26.802613+0000","last_fullsized":"2024-04-24T13:32:26.802613+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:35.235521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":131,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798110+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:32:26.798110+0000","last_peered":"2024-04-24T13:32:26.798110+0000","last_clean":"2024-04-24T13:32:26.798110+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:32:26.798110+0000","last_undegraded":"2024-04-24T13:32:26.798110+0000","last_fullsized":"2024-04-24T13:32:26.798110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802946+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:32:26.802946+0000","last_peered":"2024-04-24T13:32:26.802946+0000","last_clean":"2024-04-24T13:32:26.802946+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:32:26.802946+0000","last_undegraded":"2024-04-24T13:32:26.802946+0000","last_fullsized":"2024-04-24T13:32:26.802946+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"83'3","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798665+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:32:26.798665+0000","last_peered":"2024-04-24T13:32:26.798665+0000","last_clean":"2024-04-24T13:32:26.798665+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:32:26.798665+0000","last_undegraded":"2024-04-24T13:32:26.798665+0000","last_fullsized":"2024-04-24T13:32:26.798665+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"0'0","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799317+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:32:26.799317+0000","last_peered":"2024-04-24T13:32:26.799317+0000","last_clean":"2024-04-24T13:32:26.799317+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:32:26.799317+0000","last_undegraded":"2024-04-24T13:32:26.799317+0000","last_fullsized":"2024-04-24T13:32:26.799317+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"82'2","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.804653+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:32:26.804653+0000","last_peered":"2024-04-24T13:32:26.804653+0000","last_clean":"2024-04-24T13:32:26.804653+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:32:26.804653+0000","last_undegraded":"2024-04-24T13:32:26.804653+0000","last_fullsized":"2024-04-24T13:32:26.804653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399653+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:32:26.399653+0000","last_peered":"2024-04-24T13:32:26.399653+0000","last_clean":"2024-04-24T13:32:26.399653+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:32:26.399653+0000","last_undegraded":"2024-04-24T13:32:26.399653+0000","last_fullsized":"2024-04-24T13:32:26.399653+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798830+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:32:26.798830+0000","last_peered":"2024-04-24T13:32:26.798830+0000","last_clean":"2024-04-24T13:32:26.798830+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:32:26.798830+0000","last_undegraded":"2024-04-24T13:32:26.798830+0000","last_fullsized":"2024-04-24T13:32:26.798830+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"82'2","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799519+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:32:26.799519+0000","last_peered":"2024-04-24T13:32:26.799519+0000","last_clean":"2024-04-24T13:32:26.799519+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:32:26.799519+0000","last_undegraded":"2024-04-24T13:32:26.799519+0000","last_fullsized":"2024-04-24T13:32:26.799519+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"0'0","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802745+0000","last_change":"2024-04-24T13:30:50.929479+0000","last_active":"2024-04-24T13:32:26.802745+0000","last_peered":"2024-04-24T13:32:26.802745+0000","last_clean":"2024-04-24T13:32:26.802745+0000","last_became_active":"2024-04-24T13:30:50.928545+0000","last_became_peered":"2024-04-24T13:30:50.928545+0000","last_unstale":"2024-04-24T13:32:26.802745+0000","last_undegraded":"2024-04-24T13:32:26.802745+0000","last_fullsized":"2024-04-24T13:32:26.802745+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:26:58.476605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":100,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503212+0000","last_change":"2024-04-24T13:32:00.646571+0000","last_active":"2024-04-24T13:32:26.503212+0000","last_peered":"2024-04-24T13:32:26.503212+0000","last_clean":"2024-04-24T13:32:26.503212+0000","last_became_active":"2024-04-24T13:32:00.596446+0000","last_became_peered":"2024-04-24T13:32:00.596446+0000","last_unstale":"2024-04-24T13:32:26.503212+0000","last_undegraded":"2024-04-24T13:32:26.503212+0000","last_fullsized":"2024-04-24T13:32:26.503212+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:29:02.008315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":87,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"82'13","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.400269+0000","last_change":"2024-04-24T13:30:50.953480+0000","last_active":"2024-04-24T13:32:26.400269+0000","last_peered":"2024-04-24T13:32:26.400269+0000","last_clean":"2024-04-24T13:32:26.400269+0000","last_became_active":"2024-04-24T13:30:50.917577+0000","last_became_peered":"2024-04-24T13:30:50.917577+0000","last_unstale":"2024-04-24T13:32:26.400269+0000","last_undegraded":"2024-04-24T13:32:26.400269+0000","last_fullsized":"2024-04-24T13:32:26.400269+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:41.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799600+0000","last_change":"2024-04-24T13:32:00.550424+0000","last_active":"2024-04-24T13:32:26.799600+0000","last_peered":"2024-04-24T13:32:26.799600+0000","last_clean":"2024-04-24T13:32:26.799600+0000","last_became_active":"2024-04-24T13:32:00.550098+0000","last_became_peered":"2024-04-24T13:32:00.550098+0000","last_unstale":"2024-04-24T13:32:26.799600+0000","last_undegraded":"2024-04-24T13:32:26.799600+0000","last_fullsized":"2024-04-24T13:32:26.799600+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:51:43.235825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"83'33","reported_seq":76,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800850+0000","last_change":"2024-04-24T13:32:00.576594+0000","last_active":"2024-04-24T13:32:26.800850+0000","last_peered":"2024-04-24T13:32:26.800850+0000","last_clean":"2024-04-24T13:32:26.800850+0000","last_became_active":"2024-04-24T13:32:00.575785+0000","last_became_peered":"2024-04-24T13:32:00.575785+0000","last_unstale":"2024-04-24T13:32:26.800850+0000","last_undegraded":"2024-04-24T13:32:26.800850+0000","last_fullsized":"2024-04-24T13:32:26.800850+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:46:13.469865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":77,"num_read_kb":77,"num_write":66,"num_write_kb":25,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"82'4","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797735+0000","last_change":"2024-04-24T13:32:00.594661+0000","last_active":"2024-04-24T13:32:26.797735+0000","last_peered":"2024-04-24T13:32:26.797735+0000","last_clean":"2024-04-24T13:32:26.797735+0000","last_became_active":"2024-04-24T13:32:00.594387+0000","last_became_peered":"2024-04-24T13:32:00.594387+0000","last_unstale":"2024-04-24T13:32:26.797735+0000","last_undegraded":"2024-04-24T13:32:26.797735+0000","last_fullsized":"2024-04-24T13:32:26.797735+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:05.797402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399682+0000","last_change":"2024-04-24T13:30:50.915215+0000","last_active":"2024-04-24T13:32:26.399682+0000","last_peered":"2024-04-24T13:32:26.399682+0000","last_clean":"2024-04-24T13:32:26.399682+0000","last_became_active":"2024-04-24T13:30:50.913930+0000","last_became_peered":"2024-04-24T13:30:50.913930+0000","last_unstale":"2024-04-24T13:32:26.399682+0000","last_undegraded":"2024-04-24T13:32:26.399682+0000","last_fullsized":"2024-04-24T13:32:26.399682+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:53.839067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":133,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799365+0000","last_change":"2024-04-24T13:30:50.926673+0000","last_active":"2024-04-24T13:32:26.799365+0000","last_peered":"2024-04-24T13:32:26.799365+0000","last_clean":"2024-04-24T13:32:26.799365+0000","last_became_active":"2024-04-24T13:30:50.926286+0000","last_became_peered":"2024-04-24T13:30:50.926286+0000","last_unstale":"2024-04-24T13:32:26.799365+0000","last_undegraded":"2024-04-24T13:32:26.799365+0000","last_fullsized":"2024-04-24T13:32:26.799365+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:21:21.951639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":133,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.804905+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:32:26.804905+0000","last_peered":"2024-04-24T13:32:26.804905+0000","last_clean":"2024-04-24T13:32:26.804905+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:32:26.804905+0000","last_undegraded":"2024-04-24T13:32:26.804905+0000","last_fullsized":"2024-04-24T13:32:26.804905+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.804462+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:32:26.804462+0000","last_peered":"2024-04-24T13:32:26.804462+0000","last_clean":"2024-04-24T13:32:26.804462+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:32:26.804462+0000","last_undegraded":"2024-04-24T13:32:26.804462+0000","last_fullsized":"2024-04-24T13:32:26.804462+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399509+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:32:26.399509+0000","last_peered":"2024-04-24T13:32:26.399509+0000","last_clean":"2024-04-24T13:32:26.399509+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:32:26.399509+0000","last_undegraded":"2024-04-24T13:32:26.399509+0000","last_fullsized":"2024-04-24T13:32:26.399509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"83'9","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399541+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:32:26.399541+0000","last_peered":"2024-04-24T13:32:26.399541+0000","last_clean":"2024-04-24T13:32:26.399541+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:32:26.399541+0000","last_undegraded":"2024-04-24T13:32:26.399541+0000","last_fullsized":"2024-04-24T13:32:26.399541+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799784+0000","last_change":"2024-04-24T13:30:50.946908+0000","last_active":"2024-04-24T13:32:26.799784+0000","last_peered":"2024-04-24T13:32:26.799784+0000","last_clean":"2024-04-24T13:32:26.799784+0000","last_became_active":"2024-04-24T13:30:50.932201+0000","last_became_peered":"2024-04-24T13:30:50.932201+0000","last_unstale":"2024-04-24T13:32:26.799784+0000","last_undegraded":"2024-04-24T13:32:26.799784+0000","last_fullsized":"2024-04-24T13:32:26.799784+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:41.874257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801364+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:32:26.801364+0000","last_peered":"2024-04-24T13:32:26.801364+0000","last_clean":"2024-04-24T13:32:26.801364+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:32:26.801364+0000","last_undegraded":"2024-04-24T13:32:26.801364+0000","last_fullsized":"2024-04-24T13:32:26.801364+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":138,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798483+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:32:26.798483+0000","last_peered":"2024-04-24T13:32:26.798483+0000","last_clean":"2024-04-24T13:32:26.798483+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:32:26.798483+0000","last_undegraded":"2024-04-24T13:32:26.798483+0000","last_fullsized":"2024-04-24T13:32:26.798483+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"83'90","reported_seq":216,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502783+0000","last_change":"2024-04-24T13:30:50.933595+0000","last_active":"2024-04-24T13:32:26.502783+0000","last_peered":"2024-04-24T13:32:26.502783+0000","last_clean":"2024-04-24T13:32:26.502783+0000","last_became_active":"2024-04-24T13:30:50.926963+0000","last_became_peered":"2024-04-24T13:30:50.926963+0000","last_unstale":"2024-04-24T13:32:26.502783+0000","last_undegraded":"2024-04-24T13:32:26.502783+0000","last_fullsized":"2024-04-24T13:32:26.502783+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"82'4","reported_seq":122,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801827+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:32:26.801827+0000","last_peered":"2024-04-24T13:32:26.801827+0000","last_clean":"2024-04-24T13:32:26.801827+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:32:26.801827+0000","last_undegraded":"2024-04-24T13:32:26.801827+0000","last_fullsized":"2024-04-24T13:32:26.801827+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"83'1","reported_seq":139,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801082+0000","last_change":"2024-04-24T13:30:50.921336+0000","last_active":"2024-04-24T13:32:26.801082+0000","last_peered":"2024-04-24T13:32:26.801082+0000","last_clean":"2024-04-24T13:32:26.801082+0000","last_became_active":"2024-04-24T13:30:50.920829+0000","last_became_peered":"2024-04-24T13:30:50.920829+0000","last_unstale":"2024-04-24T13:32:26.801082+0000","last_undegraded":"2024-04-24T13:32:26.801082+0000","last_fullsized":"2024-04-24T13:32:26.801082+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:37.250085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"0'0","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799392+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:32:26.799392+0000","last_peered":"2024-04-24T13:32:26.799392+0000","last_clean":"2024-04-24T13:32:26.799392+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:32:26.799392+0000","last_undegraded":"2024-04-24T13:32:26.799392+0000","last_fullsized":"2024-04-24T13:32:26.799392+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801175+0000","last_change":"2024-04-24T13:32:00.575312+0000","last_active":"2024-04-24T13:32:26.801175+0000","last_peered":"2024-04-24T13:32:26.801175+0000","last_clean":"2024-04-24T13:32:26.801175+0000","last_became_active":"2024-04-24T13:32:00.575004+0000","last_became_peered":"2024-04-24T13:32:00.575004+0000","last_unstale":"2024-04-24T13:32:26.801175+0000","last_undegraded":"2024-04-24T13:32:26.801175+0000","last_fullsized":"2024-04-24T13:32:26.801175+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:23:40.859824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"82'13","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802083+0000","last_change":"2024-04-24T13:30:51.001114+0000","last_active":"2024-04-24T13:32:26.802083+0000","last_peered":"2024-04-24T13:32:26.802083+0000","last_clean":"2024-04-24T13:32:26.802083+0000","last_became_active":"2024-04-24T13:30:50.954422+0000","last_became_peered":"2024-04-24T13:30:50.954422+0000","last_unstale":"2024-04-24T13:32:26.802083+0000","last_undegraded":"2024-04-24T13:32:26.802083+0000","last_fullsized":"2024-04-24T13:32:26.802083+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:44.516492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"83'89","reported_seq":233,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799049+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:32:26.799049+0000","last_peered":"2024-04-24T13:32:26.799049+0000","last_clean":"2024-04-24T13:32:26.799049+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:32:26.799049+0000","last_undegraded":"2024-04-24T13:32:26.799049+0000","last_fullsized":"2024-04-24T13:32:26.799049+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"82'2","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798741+0000","last_change":"2024-04-24T13:32:00.583583+0000","last_active":"2024-04-24T13:32:26.798741+0000","last_peered":"2024-04-24T13:32:26.798741+0000","last_clean":"2024-04-24T13:32:26.798741+0000","last_became_active":"2024-04-24T13:32:00.577955+0000","last_became_peered":"2024-04-24T13:32:00.577955+0000","last_unstale":"2024-04-24T13:32:26.798741+0000","last_undegraded":"2024-04-24T13:32:26.798741+0000","last_fullsized":"2024-04-24T13:32:26.798741+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:31.661093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":82,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799459+0000","last_change":"2024-04-24T13:31:01.035289+0000","last_active":"2024-04-24T13:32:26.799459+0000","last_peered":"2024-04-24T13:32:26.799459+0000","last_clean":"2024-04-24T13:32:26.799459+0000","last_became_active":"2024-04-24T13:31:01.034325+0000","last_became_peered":"2024-04-24T13:31:01.034325+0000","last_unstale":"2024-04-24T13:32:26.799459+0000","last_undegraded":"2024-04-24T13:32:26.799459+0000","last_fullsized":"2024-04-24T13:32:26.799459+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:08.322191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800472+0000","last_change":"2024-04-24T13:30:50.948387+0000","last_active":"2024-04-24T13:32:26.800472+0000","last_peered":"2024-04-24T13:32:26.800472+0000","last_clean":"2024-04-24T13:32:26.800472+0000","last_became_active":"2024-04-24T13:30:50.947644+0000","last_became_peered":"2024-04-24T13:30:50.947644+0000","last_unstale":"2024-04-24T13:32:26.800472+0000","last_undegraded":"2024-04-24T13:32:26.800472+0000","last_fullsized":"2024-04-24T13:32:26.800472+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:03.622375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"82'23","reported_seq":104,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802111+0000","last_change":"2024-04-24T13:32:00.642541+0000","last_active":"2024-04-24T13:32:26.802111+0000","last_peered":"2024-04-24T13:32:26.802111+0000","last_clean":"2024-04-24T13:32:26.802111+0000","last_became_active":"2024-04-24T13:32:00.600504+0000","last_became_peered":"2024-04-24T13:32:00.600504+0000","last_unstale":"2024-04-24T13:32:26.802111+0000","last_undegraded":"2024-04-24T13:32:26.802111+0000","last_fullsized":"2024-04-24T13:32:26.802111+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:10.436000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":126,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503122+0000","last_change":"2024-04-24T13:32:00.572217+0000","last_active":"2024-04-24T13:32:26.503122+0000","last_peered":"2024-04-24T13:32:26.503122+0000","last_clean":"2024-04-24T13:32:26.503122+0000","last_became_active":"2024-04-24T13:32:00.571455+0000","last_became_peered":"2024-04-24T13:32:00.571455+0000","last_unstale":"2024-04-24T13:32:26.503122+0000","last_undegraded":"2024-04-24T13:32:26.503122+0000","last_fullsized":"2024-04-24T13:32:26.503122+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:03.862128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"83'6","reported_seq":126,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402084+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:32:26.402084+0000","last_peered":"2024-04-24T13:32:26.402084+0000","last_clean":"2024-04-24T13:32:26.402084+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:32:26.402084+0000","last_undegraded":"2024-04-24T13:32:26.402084+0000","last_fullsized":"2024-04-24T13:32:26.402084+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":406,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":17,"num_read_kb":14,"num_write":20,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800401+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:32:26.800401+0000","last_peered":"2024-04-24T13:32:26.800401+0000","last_clean":"2024-04-24T13:32:26.800401+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:32:26.800401+0000","last_undegraded":"2024-04-24T13:32:26.800401+0000","last_fullsized":"2024-04-24T13:32:26.800401+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.806279+0000","last_change":"2024-04-24T13:30:50.930041+0000","last_active":"2024-04-24T13:32:26.806279+0000","last_peered":"2024-04-24T13:32:26.806279+0000","last_clean":"2024-04-24T13:32:26.806279+0000","last_became_active":"2024-04-24T13:30:50.929179+0000","last_became_peered":"2024-04-24T13:30:50.929179+0000","last_unstale":"2024-04-24T13:32:26.806279+0000","last_undegraded":"2024-04-24T13:32:26.806279+0000","last_fullsized":"2024-04-24T13:32:26.806279+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:46.987972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.796934+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:32:26.796934+0000","last_peered":"2024-04-24T13:32:26.796934+0000","last_clean":"2024-04-24T13:32:26.796934+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:32:26.796934+0000","last_undegraded":"2024-04-24T13:32:26.796934+0000","last_fullsized":"2024-04-24T13:32:26.796934+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"82'14","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799707+0000","last_change":"2024-04-24T13:30:50.948850+0000","last_active":"2024-04-24T13:32:26.799707+0000","last_peered":"2024-04-24T13:32:26.799707+0000","last_clean":"2024-04-24T13:32:26.799707+0000","last_became_active":"2024-04-24T13:30:50.921374+0000","last_became_peered":"2024-04-24T13:30:50.921374+0000","last_unstale":"2024-04-24T13:32:26.799707+0000","last_undegraded":"2024-04-24T13:32:26.799707+0000","last_fullsized":"2024-04-24T13:32:26.799707+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:22:03.728196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797721+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:32:26.797721+0000","last_peered":"2024-04-24T13:32:26.797721+0000","last_clean":"2024-04-24T13:32:26.797721+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:32:26.797721+0000","last_undegraded":"2024-04-24T13:32:26.797721+0000","last_fullsized":"2024-04-24T13:32:26.797721+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":115,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801239+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:32:26.801239+0000","last_peered":"2024-04-24T13:32:26.801239+0000","last_clean":"2024-04-24T13:32:26.801239+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:32:26.801239+0000","last_undegraded":"2024-04-24T13:32:26.801239+0000","last_fullsized":"2024-04-24T13:32:26.801239+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"82'4","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802406+0000","last_change":"2024-04-24T13:32:01.548738+0000","last_active":"2024-04-24T13:32:26.802406+0000","last_peered":"2024-04-24T13:32:26.802406+0000","last_clean":"2024-04-24T13:32:26.802406+0000","last_became_active":"2024-04-24T13:32:01.548259+0000","last_became_peered":"2024-04-24T13:32:01.548259+0000","last_unstale":"2024-04-24T13:32:26.802406+0000","last_undegraded":"2024-04-24T13:32:26.802406+0000","last_fullsized":"2024-04-24T13:32:26.802406+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":33,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802326+0000","last_change":"2024-04-24T13:32:00.584693+0000","last_active":"2024-04-24T13:32:26.802326+0000","last_peered":"2024-04-24T13:32:26.802326+0000","last_clean":"2024-04-24T13:32:26.802326+0000","last_became_active":"2024-04-24T13:32:00.583818+0000","last_became_peered":"2024-04-24T13:32:00.583818+0000","last_unstale":"2024-04-24T13:32:26.802326+0000","last_undegraded":"2024-04-24T13:32:26.802326+0000","last_fullsized":"2024-04-24T13:32:26.802326+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:54.012692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797974+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:32:26.797974+0000","last_peered":"2024-04-24T13:32:26.797974+0000","last_clean":"2024-04-24T13:32:26.797974+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:32:26.797974+0000","last_undegraded":"2024-04-24T13:32:26.797974+0000","last_fullsized":"2024-04-24T13:32:26.797974+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"82'19","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.796889+0000","last_change":"2024-04-24T13:30:50.970163+0000","last_active":"2024-04-24T13:32:26.796889+0000","last_peered":"2024-04-24T13:32:26.796889+0000","last_clean":"2024-04-24T13:32:26.796889+0000","last_became_active":"2024-04-24T13:30:50.920182+0000","last_became_peered":"2024-04-24T13:30:50.920182+0000","last_unstale":"2024-04-24T13:32:26.796889+0000","last_undegraded":"2024-04-24T13:32:26.796889+0000","last_fullsized":"2024-04-24T13:32:26.796889+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:29.765956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"83'89","reported_seq":312,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.398857+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:32:26.398857+0000","last_peered":"2024-04-24T13:32:26.398857+0000","last_clean":"2024-04-24T13:32:26.398857+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:32:26.398857+0000","last_undegraded":"2024-04-24T13:32:26.398857+0000","last_fullsized":"2024-04-24T13:32:26.398857+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"82'3","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.400171+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:32:26.400171+0000","last_peered":"2024-04-24T13:32:26.400171+0000","last_clean":"2024-04-24T13:32:26.400171+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:32:26.400171+0000","last_undegraded":"2024-04-24T13:32:26.400171+0000","last_fullsized":"2024-04-24T13:32:26.400171+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"83'5","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.400190+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:32:26.400190+0000","last_peered":"2024-04-24T13:32:26.400190+0000","last_clean":"2024-04-24T13:32:26.400190+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:32:26.400190+0000","last_undegraded":"2024-04-24T13:32:26.400190+0000","last_fullsized":"2024-04-24T13:32:26.400190+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799861+0000","last_change":"2024-04-24T13:32:00.594022+0000","last_active":"2024-04-24T13:32:26.799861+0000","last_peered":"2024-04-24T13:32:26.799861+0000","last_clean":"2024-04-24T13:32:26.799861+0000","last_became_active":"2024-04-24T13:32:00.593750+0000","last_became_peered":"2024-04-24T13:32:00.593750+0000","last_unstale":"2024-04-24T13:32:26.799861+0000","last_undegraded":"2024-04-24T13:32:26.799861+0000","last_fullsized":"2024-04-24T13:32:26.799861+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:53:33.468353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797798+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:32:26.797798+0000","last_peered":"2024-04-24T13:32:26.797798+0000","last_clean":"2024-04-24T13:32:26.797798+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:32:26.797798+0000","last_undegraded":"2024-04-24T13:32:26.797798+0000","last_fullsized":"2024-04-24T13:32:26.797798+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"82'20","reported_seq":172,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399142+0000","last_change":"2024-04-24T13:30:51.000083+0000","last_active":"2024-04-24T13:32:26.399142+0000","last_peered":"2024-04-24T13:32:26.399142+0000","last_clean":"2024-04-24T13:32:26.399142+0000","last_became_active":"2024-04-24T13:30:50.934568+0000","last_became_peered":"2024-04-24T13:30:50.934568+0000","last_unstale":"2024-04-24T13:32:26.399142+0000","last_undegraded":"2024-04-24T13:32:26.399142+0000","last_fullsized":"2024-04-24T13:32:26.399142+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:10.436000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":124,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.796830+0000","last_change":"2024-04-24T13:30:50.908390+0000","last_active":"2024-04-24T13:32:26.796830+0000","last_peered":"2024-04-24T13:32:26.796830+0000","last_clean":"2024-04-24T13:32:26.796830+0000","last_became_active":"2024-04-24T13:30:50.908013+0000","last_became_peered":"2024-04-24T13:30:50.908013+0000","last_unstale":"2024-04-24T13:32:26.796830+0000","last_undegraded":"2024-04-24T13:32:26.796830+0000","last_fullsized":"2024-04-24T13:32:26.796830+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"83'8","reported_seq":145,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503607+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:32:26.503607+0000","last_peered":"2024-04-24T13:32:26.503607+0000","last_clean":"2024-04-24T13:32:26.503607+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:32:26.503607+0000","last_undegraded":"2024-04-24T13:32:26.503607+0000","last_fullsized":"2024-04-24T13:32:26.503607+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":584,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":58,"num_read_kb":58,"num_write":18,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"82'2","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.803508+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:32:26.803508+0000","last_peered":"2024-04-24T13:32:26.803508+0000","last_clean":"2024-04-24T13:32:26.803508+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:32:26.803508+0000","last_undegraded":"2024-04-24T13:32:26.803508+0000","last_fullsized":"2024-04-24T13:32:26.803508+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799052+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:32:26.799052+0000","last_peered":"2024-04-24T13:32:26.799052+0000","last_clean":"2024-04-24T13:32:26.799052+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:32:26.799052+0000","last_undegraded":"2024-04-24T13:32:26.799052+0000","last_fullsized":"2024-04-24T13:32:26.799052+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798634+0000","last_change":"2024-04-24T13:32:00.570272+0000","last_active":"2024-04-24T13:32:26.798634+0000","last_peered":"2024-04-24T13:32:26.798634+0000","last_clean":"2024-04-24T13:32:26.798634+0000","last_became_active":"2024-04-24T13:32:00.569572+0000","last_became_peered":"2024-04-24T13:32:00.569572+0000","last_unstale":"2024-04-24T13:32:26.798634+0000","last_undegraded":"2024-04-24T13:32:26.798634+0000","last_fullsized":"2024-04-24T13:32:26.798634+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:51.009578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"82'15","reported_seq":147,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.804625+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:32:26.804625+0000","last_peered":"2024-04-24T13:32:26.804625+0000","last_clean":"2024-04-24T13:32:26.804625+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:32:26.804625+0000","last_undegraded":"2024-04-24T13:32:26.804625+0000","last_fullsized":"2024-04-24T13:32:26.804625+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402551+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:32:26.402551+0000","last_peered":"2024-04-24T13:32:26.402551+0000","last_clean":"2024-04-24T13:32:26.402551+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:32:26.402551+0000","last_undegraded":"2024-04-24T13:32:26.402551+0000","last_fullsized":"2024-04-24T13:32:26.402551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":121,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801593+0000","last_change":"2024-04-24T13:32:00.577449+0000","last_active":"2024-04-24T13:32:26.801593+0000","last_peered":"2024-04-24T13:32:26.801593+0000","last_clean":"2024-04-24T13:32:26.801593+0000","last_became_active":"2024-04-24T13:32:00.576582+0000","last_became_peered":"2024-04-24T13:32:00.576582+0000","last_unstale":"2024-04-24T13:32:26.801593+0000","last_undegraded":"2024-04-24T13:32:26.801593+0000","last_fullsized":"2024-04-24T13:32:26.801593+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:42.720281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.804953+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:32:26.804953+0000","last_peered":"2024-04-24T13:32:26.804953+0000","last_clean":"2024-04-24T13:32:26.804953+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:32:26.804953+0000","last_undegraded":"2024-04-24T13:32:26.804953+0000","last_fullsized":"2024-04-24T13:32:26.804953+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802672+0000","last_change":"2024-04-24T13:31:00.986244+0000","last_active":"2024-04-24T13:32:26.802672+0000","last_peered":"2024-04-24T13:32:26.802672+0000","last_clean":"2024-04-24T13:32:26.802672+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:32:26.802672+0000","last_undegraded":"2024-04-24T13:32:26.802672+0000","last_fullsized":"2024-04-24T13:32:26.802672+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:23.355231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":129,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503176+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:32:26.503176+0000","last_peered":"2024-04-24T13:32:26.503176+0000","last_clean":"2024-04-24T13:32:26.503176+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:32:26.503176+0000","last_undegraded":"2024-04-24T13:32:26.503176+0000","last_fullsized":"2024-04-24T13:32:26.503176+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"82'20","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799831+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:32:26.799831+0000","last_peered":"2024-04-24T13:32:26.799831+0000","last_clean":"2024-04-24T13:32:26.799831+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:32:26.799831+0000","last_undegraded":"2024-04-24T13:32:26.799831+0000","last_fullsized":"2024-04-24T13:32:26.799831+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"83'90","reported_seq":250,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798940+0000","last_change":"2024-04-24T13:32:00.643512+0000","last_active":"2024-04-24T13:32:26.798940+0000","last_peered":"2024-04-24T13:32:26.798940+0000","last_clean":"2024-04-24T13:32:26.798940+0000","last_became_active":"2024-04-24T13:32:00.581919+0000","last_became_peered":"2024-04-24T13:32:00.581919+0000","last_unstale":"2024-04-24T13:32:26.798940+0000","last_undegraded":"2024-04-24T13:32:26.798940+0000","last_fullsized":"2024-04-24T13:32:26.798940+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:01.892496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502400+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:32:26.502400+0000","last_peered":"2024-04-24T13:32:26.502400+0000","last_clean":"2024-04-24T13:32:26.502400+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:32:26.502400+0000","last_undegraded":"2024-04-24T13:32:26.502400+0000","last_fullsized":"2024-04-24T13:32:26.502400+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.805920+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:32:26.805920+0000","last_peered":"2024-04-24T13:32:26.805920+0000","last_clean":"2024-04-24T13:32:26.805920+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:32:26.805920+0000","last_undegraded":"2024-04-24T13:32:26.805920+0000","last_fullsized":"2024-04-24T13:32:26.805920+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"0'0","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799187+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:32:26.799187+0000","last_peered":"2024-04-24T13:32:26.799187+0000","last_clean":"2024-04-24T13:32:26.799187+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:32:26.799187+0000","last_undegraded":"2024-04-24T13:32:26.799187+0000","last_fullsized":"2024-04-24T13:32:26.799187+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":161,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.805068+0000","last_change":"2024-04-24T13:32:00.620428+0000","last_active":"2024-04-24T13:32:26.805068+0000","last_peered":"2024-04-24T13:32:26.805068+0000","last_clean":"2024-04-24T13:32:26.805068+0000","last_became_active":"2024-04-24T13:32:00.580756+0000","last_became_peered":"2024-04-24T13:32:00.580756+0000","last_unstale":"2024-04-24T13:32:26.805068+0000","last_undegraded":"2024-04-24T13:32:26.805068+0000","last_fullsized":"2024-04-24T13:32:26.805068+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:02.973502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":116,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"82'11","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799149+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:32:26.799149+0000","last_peered":"2024-04-24T13:32:26.799149+0000","last_clean":"2024-04-24T13:32:26.799149+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:32:26.799149+0000","last_undegraded":"2024-04-24T13:32:26.799149+0000","last_fullsized":"2024-04-24T13:32:26.799149+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"83'89","reported_seq":266,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801632+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:32:26.801632+0000","last_peered":"2024-04-24T13:32:26.801632+0000","last_clean":"2024-04-24T13:32:26.801632+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:32:26.801632+0000","last_undegraded":"2024-04-24T13:32:26.801632+0000","last_fullsized":"2024-04-24T13:32:26.801632+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800419+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:32:26.800419+0000","last_peered":"2024-04-24T13:32:26.800419+0000","last_clean":"2024-04-24T13:32:26.800419+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:32:26.800419+0000","last_undegraded":"2024-04-24T13:32:26.800419+0000","last_fullsized":"2024-04-24T13:32:26.800419+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"83'3","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503839+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:32:26.503839+0000","last_peered":"2024-04-24T13:32:26.503839+0000","last_clean":"2024-04-24T13:32:26.503839+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:32:26.503839+0000","last_undegraded":"2024-04-24T13:32:26.503839+0000","last_fullsized":"2024-04-24T13:32:26.503839+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797388+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:32:26.797388+0000","last_peered":"2024-04-24T13:32:26.797388+0000","last_clean":"2024-04-24T13:32:26.797388+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:32:26.797388+0000","last_undegraded":"2024-04-24T13:32:26.797388+0000","last_fullsized":"2024-04-24T13:32:26.797388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":133,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.805315+0000","last_change":"2024-04-24T13:32:00.575444+0000","last_active":"2024-04-24T13:32:26.805315+0000","last_peered":"2024-04-24T13:32:26.805315+0000","last_clean":"2024-04-24T13:32:26.805315+0000","last_became_active":"2024-04-24T13:32:00.574616+0000","last_became_peered":"2024-04-24T13:32:00.574616+0000","last_unstale":"2024-04-24T13:32:26.805315+0000","last_undegraded":"2024-04-24T13:32:26.805315+0000","last_fullsized":"2024-04-24T13:32:26.805315+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:51.796840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"82'21","reported_seq":99,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503311+0000","last_change":"2024-04-24T13:32:00.659945+0000","last_active":"2024-04-24T13:32:26.503311+0000","last_peered":"2024-04-24T13:32:26.503311+0000","last_clean":"2024-04-24T13:32:26.503311+0000","last_became_active":"2024-04-24T13:32:00.596498+0000","last_became_peered":"2024-04-24T13:32:00.596498+0000","last_unstale":"2024-04-24T13:32:26.503311+0000","last_undegraded":"2024-04-24T13:32:26.503311+0000","last_fullsized":"2024-04-24T13:32:26.503311+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:22:03.728196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":119,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800453+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:32:26.800453+0000","last_peered":"2024-04-24T13:32:26.800453+0000","last_clean":"2024-04-24T13:32:26.800453+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:32:26.800453+0000","last_undegraded":"2024-04-24T13:32:26.800453+0000","last_fullsized":"2024-04-24T13:32:26.800453+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"82'2","reported_seq":126,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502994+0000","last_change":"2024-04-24T13:32:00.562685+0000","last_active":"2024-04-24T13:32:26.502994+0000","last_peered":"2024-04-24T13:32:26.502994+0000","last_clean":"2024-04-24T13:32:26.502994+0000","last_became_active":"2024-04-24T13:32:00.562306+0000","last_became_peered":"2024-04-24T13:32:00.562306+0000","last_unstale":"2024-04-24T13:32:26.502994+0000","last_undegraded":"2024-04-24T13:32:26.502994+0000","last_fullsized":"2024-04-24T13:32:26.502994+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:36:11.086183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"82'2","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802465+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:32:26.802465+0000","last_peered":"2024-04-24T13:32:26.802465+0000","last_clean":"2024-04-24T13:32:26.802465+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:32:26.802465+0000","last_undegraded":"2024-04-24T13:32:26.802465+0000","last_fullsized":"2024-04-24T13:32:26.802465+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":261,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.398675+0000","last_change":"2024-04-24T13:30:53.928527+0000","last_active":"2024-04-24T13:32:26.398675+0000","last_peered":"2024-04-24T13:32:26.398675+0000","last_clean":"2024-04-24T13:32:26.398675+0000","last_became_active":"2024-04-24T13:30:53.928167+0000","last_became_peered":"2024-04-24T13:30:53.928167+0000","last_unstale":"2024-04-24T13:32:26.398675+0000","last_undegraded":"2024-04-24T13:32:26.398675+0000","last_fullsized":"2024-04-24T13:32:26.398675+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:43.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797934+0000","last_change":"2024-04-24T13:32:00.578098+0000","last_active":"2024-04-24T13:32:26.797934+0000","last_peered":"2024-04-24T13:32:26.797934+0000","last_clean":"2024-04-24T13:32:26.797934+0000","last_became_active":"2024-04-24T13:32:00.577790+0000","last_became_peered":"2024-04-24T13:32:00.577790+0000","last_unstale":"2024-04-24T13:32:26.797934+0000","last_undegraded":"2024-04-24T13:32:26.797934+0000","last_fullsized":"2024-04-24T13:32:26.797934+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:25.305366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799895+0000","last_change":"2024-04-24T13:32:00.603123+0000","last_active":"2024-04-24T13:32:26.799895+0000","last_peered":"2024-04-24T13:32:26.799895+0000","last_clean":"2024-04-24T13:32:26.799895+0000","last_became_active":"2024-04-24T13:32:00.602796+0000","last_became_peered":"2024-04-24T13:32:00.602796+0000","last_unstale":"2024-04-24T13:32:26.799895+0000","last_undegraded":"2024-04-24T13:32:26.799895+0000","last_fullsized":"2024-04-24T13:32:26.799895+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:00.666218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":102,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798538+0000","last_change":"2024-04-24T13:32:00.570311+0000","last_active":"2024-04-24T13:32:26.798538+0000","last_peered":"2024-04-24T13:32:26.798538+0000","last_clean":"2024-04-24T13:32:26.798538+0000","last_became_active":"2024-04-24T13:32:00.570038+0000","last_became_peered":"2024-04-24T13:32:00.570038+0000","last_unstale":"2024-04-24T13:32:26.798538+0000","last_undegraded":"2024-04-24T13:32:26.798538+0000","last_fullsized":"2024-04-24T13:32:26.798538+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:18.009342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"82'27","reported_seq":102,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801451+0000","last_change":"2024-04-24T13:32:00.618901+0000","last_active":"2024-04-24T13:32:26.801451+0000","last_peered":"2024-04-24T13:32:26.801451+0000","last_clean":"2024-04-24T13:32:26.801451+0000","last_became_active":"2024-04-24T13:32:00.577557+0000","last_became_peered":"2024-04-24T13:32:00.577557+0000","last_unstale":"2024-04-24T13:32:26.801451+0000","last_undegraded":"2024-04-24T13:32:26.801451+0000","last_fullsized":"2024-04-24T13:32:26.801451+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:37.412890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4872,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":18,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":125,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.400085+0000","last_change":"2024-04-24T13:30:50.917737+0000","last_active":"2024-04-24T13:32:26.400085+0000","last_peered":"2024-04-24T13:32:26.400085+0000","last_clean":"2024-04-24T13:32:26.400085+0000","last_became_active":"2024-04-24T13:30:50.916920+0000","last_became_peered":"2024-04-24T13:30:50.916920+0000","last_unstale":"2024-04-24T13:32:26.400085+0000","last_undegraded":"2024-04-24T13:32:26.400085+0000","last_fullsized":"2024-04-24T13:32:26.400085+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:12.813827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799985+0000","last_change":"2024-04-24T13:32:00.594436+0000","last_active":"2024-04-24T13:32:26.799985+0000","last_peered":"2024-04-24T13:32:26.799985+0000","last_clean":"2024-04-24T13:32:26.799985+0000","last_became_active":"2024-04-24T13:32:00.593632+0000","last_became_peered":"2024-04-24T13:32:00.593632+0000","last_unstale":"2024-04-24T13:32:26.799985+0000","last_undegraded":"2024-04-24T13:32:26.799985+0000","last_fullsized":"2024-04-24T13:32:26.799985+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:42:19.800985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"81'4","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399705+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:32:26.399705+0000","last_peered":"2024-04-24T13:32:26.399705+0000","last_clean":"2024-04-24T13:32:26.399705+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:32:26.399705+0000","last_undegraded":"2024-04-24T13:32:26.399705+0000","last_fullsized":"2024-04-24T13:32:26.399705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":97,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502322+0000","last_change":"2024-04-24T13:30:50.937903+0000","last_active":"2024-04-24T13:32:26.502322+0000","last_peered":"2024-04-24T13:32:26.502322+0000","last_clean":"2024-04-24T13:32:26.502322+0000","last_became_active":"2024-04-24T13:30:50.937359+0000","last_became_peered":"2024-04-24T13:30:50.937359+0000","last_unstale":"2024-04-24T13:32:26.502322+0000","last_undegraded":"2024-04-24T13:32:26.502322+0000","last_fullsized":"2024-04-24T13:32:26.502322+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:27.651521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"0'0","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399264+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:32:26.399264+0000","last_peered":"2024-04-24T13:32:26.399264+0000","last_clean":"2024-04-24T13:32:26.399264+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:32:26.399264+0000","last_undegraded":"2024-04-24T13:32:26.399264+0000","last_fullsized":"2024-04-24T13:32:26.399264+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503732+0000","last_change":"2024-04-24T13:32:00.582433+0000","last_active":"2024-04-24T13:32:26.503732+0000","last_peered":"2024-04-24T13:32:26.503732+0000","last_clean":"2024-04-24T13:32:26.503732+0000","last_became_active":"2024-04-24T13:32:00.581917+0000","last_became_peered":"2024-04-24T13:32:00.581917+0000","last_unstale":"2024-04-24T13:32:26.503732+0000","last_undegraded":"2024-04-24T13:32:26.503732+0000","last_fullsized":"2024-04-24T13:32:26.503732+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:08.428841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"83'93","reported_seq":289,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503056+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:32:26.503056+0000","last_peered":"2024-04-24T13:32:26.503056+0000","last_clean":"2024-04-24T13:32:26.503056+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:32:26.503056+0000","last_undegraded":"2024-04-24T13:32:26.503056+0000","last_fullsized":"2024-04-24T13:32:26.503056+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":93,"log_dups_size":0,"ondisk_log_size":93,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":129,"num_read_kb":114,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":97,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798711+0000","last_change":"2024-04-24T13:30:50.925382+0000","last_active":"2024-04-24T13:32:26.798711+0000","last_peered":"2024-04-24T13:32:26.798711+0000","last_clean":"2024-04-24T13:32:26.798711+0000","last_became_active":"2024-04-24T13:30:50.924919+0000","last_became_peered":"2024-04-24T13:30:50.924919+0000","last_unstale":"2024-04-24T13:32:26.798711+0000","last_undegraded":"2024-04-24T13:32:26.798711+0000","last_fullsized":"2024-04-24T13:32:26.798711+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502438+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:32:26.502438+0000","last_peered":"2024-04-24T13:32:26.502438+0000","last_clean":"2024-04-24T13:32:26.502438+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:32:26.502438+0000","last_undegraded":"2024-04-24T13:32:26.502438+0000","last_fullsized":"2024-04-24T13:32:26.502438+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":138,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503937+0000","last_change":"2024-04-24T13:32:00.582203+0000","last_active":"2024-04-24T13:32:26.503937+0000","last_peered":"2024-04-24T13:32:26.503937+0000","last_clean":"2024-04-24T13:32:26.503937+0000","last_became_active":"2024-04-24T13:32:00.581535+0000","last_became_peered":"2024-04-24T13:32:00.581535+0000","last_unstale":"2024-04-24T13:32:26.503937+0000","last_undegraded":"2024-04-24T13:32:26.503937+0000","last_fullsized":"2024-04-24T13:32:26.503937+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:37.250085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797457+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:32:26.797457+0000","last_peered":"2024-04-24T13:32:26.797457+0000","last_clean":"2024-04-24T13:32:26.797457+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:32:26.797457+0000","last_undegraded":"2024-04-24T13:32:26.797457+0000","last_fullsized":"2024-04-24T13:32:26.797457+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":138,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502304+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:32:26.502304+0000","last_peered":"2024-04-24T13:32:26.502304+0000","last_clean":"2024-04-24T13:32:26.502304+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:32:26.502304+0000","last_undegraded":"2024-04-24T13:32:26.502304+0000","last_fullsized":"2024-04-24T13:32:26.502304+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799035+0000","last_change":"2024-04-24T13:32:00.591663+0000","last_active":"2024-04-24T13:32:26.799035+0000","last_peered":"2024-04-24T13:32:26.799035+0000","last_clean":"2024-04-24T13:32:26.799035+0000","last_became_active":"2024-04-24T13:32:00.569726+0000","last_became_peered":"2024-04-24T13:32:00.569726+0000","last_unstale":"2024-04-24T13:32:26.799035+0000","last_undegraded":"2024-04-24T13:32:26.799035+0000","last_fullsized":"2024-04-24T13:32:26.799035+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:45.895863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"82'17","reported_seq":175,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802040+0000","last_change":"2024-04-24T13:30:50.991700+0000","last_active":"2024-04-24T13:32:26.802040+0000","last_peered":"2024-04-24T13:32:26.802040+0000","last_clean":"2024-04-24T13:32:26.802040+0000","last_became_active":"2024-04-24T13:30:50.940740+0000","last_became_peered":"2024-04-24T13:30:50.940740+0000","last_unstale":"2024-04-24T13:32:26.802040+0000","last_undegraded":"2024-04-24T13:32:26.802040+0000","last_fullsized":"2024-04-24T13:32:26.802040+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:39.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.398673+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:32:26.398673+0000","last_peered":"2024-04-24T13:32:26.398673+0000","last_clean":"2024-04-24T13:32:26.398673+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:32:26.398673+0000","last_undegraded":"2024-04-24T13:32:26.398673+0000","last_fullsized":"2024-04-24T13:32:26.398673+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799472+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:32:26.799472+0000","last_peered":"2024-04-24T13:32:26.799472+0000","last_clean":"2024-04-24T13:32:26.799472+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:32:26.799472+0000","last_undegraded":"2024-04-24T13:32:26.799472+0000","last_fullsized":"2024-04-24T13:32:26.799472+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"82'2","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503482+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:32:26.503482+0000","last_peered":"2024-04-24T13:32:26.503482+0000","last_clean":"2024-04-24T13:32:26.503482+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:32:26.503482+0000","last_undegraded":"2024-04-24T13:32:26.503482+0000","last_fullsized":"2024-04-24T13:32:26.503482+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503228+0000","last_change":"2024-04-24T13:32:00.588318+0000","last_active":"2024-04-24T13:32:26.503228+0000","last_peered":"2024-04-24T13:32:26.503228+0000","last_clean":"2024-04-24T13:32:26.503228+0000","last_became_active":"2024-04-24T13:32:00.587965+0000","last_became_peered":"2024-04-24T13:32:00.587965+0000","last_unstale":"2024-04-24T13:32:26.503228+0000","last_undegraded":"2024-04-24T13:32:26.503228+0000","last_fullsized":"2024-04-24T13:32:26.503228+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:06.838879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"81'1","reported_seq":143,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.803260+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:32:26.803260+0000","last_peered":"2024-04-24T13:32:26.803260+0000","last_clean":"2024-04-24T13:32:26.803260+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:32:26.803260+0000","last_undegraded":"2024-04-24T13:32:26.803260+0000","last_fullsized":"2024-04-24T13:32:26.803260+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.760398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402293+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:32:26.402293+0000","last_peered":"2024-04-24T13:32:26.402293+0000","last_clean":"2024-04-24T13:32:26.402293+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:32:26.402293+0000","last_undegraded":"2024-04-24T13:32:26.402293+0000","last_fullsized":"2024-04-24T13:32:26.402293+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801167+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:32:26.801167+0000","last_peered":"2024-04-24T13:32:26.801167+0000","last_clean":"2024-04-24T13:32:26.801167+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:32:26.801167+0000","last_undegraded":"2024-04-24T13:32:26.801167+0000","last_fullsized":"2024-04-24T13:32:26.801167+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":119,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801181+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:32:26.801181+0000","last_peered":"2024-04-24T13:32:26.801181+0000","last_clean":"2024-04-24T13:32:26.801181+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:32:26.801181+0000","last_undegraded":"2024-04-24T13:32:26.801181+0000","last_fullsized":"2024-04-24T13:32:26.801181+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"81'4","reported_seq":37,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801544+0000","last_change":"2024-04-24T13:32:00.577712+0000","last_active":"2024-04-24T13:32:26.801544+0000","last_peered":"2024-04-24T13:32:26.801544+0000","last_clean":"2024-04-24T13:32:26.801544+0000","last_became_active":"2024-04-24T13:32:00.575604+0000","last_became_peered":"2024-04-24T13:32:00.575604+0000","last_unstale":"2024-04-24T13:32:26.801544+0000","last_undegraded":"2024-04-24T13:32:26.801544+0000","last_fullsized":"2024-04-24T13:32:26.801544+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:15.663480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":139,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502913+0000","last_change":"2024-04-24T13:32:00.569068+0000","last_active":"2024-04-24T13:32:26.502913+0000","last_peered":"2024-04-24T13:32:26.502913+0000","last_clean":"2024-04-24T13:32:26.502913+0000","last_became_active":"2024-04-24T13:32:00.568763+0000","last_became_peered":"2024-04-24T13:32:00.568763+0000","last_unstale":"2024-04-24T13:32:26.502913+0000","last_undegraded":"2024-04-24T13:32:26.502913+0000","last_fullsized":"2024-04-24T13:32:26.502913+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:56.027255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"81'2","reported_seq":34,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799359+0000","last_change":"2024-04-24T13:32:00.577865+0000","last_active":"2024-04-24T13:32:26.799359+0000","last_peered":"2024-04-24T13:32:26.799359+0000","last_clean":"2024-04-24T13:32:26.799359+0000","last_became_active":"2024-04-24T13:32:00.577564+0000","last_became_peered":"2024-04-24T13:32:00.577564+0000","last_unstale":"2024-04-24T13:32:26.799359+0000","last_undegraded":"2024-04-24T13:32:26.799359+0000","last_fullsized":"2024-04-24T13:32:26.799359+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:52:14.484190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503718+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:32:26.503718+0000","last_peered":"2024-04-24T13:32:26.503718+0000","last_clean":"2024-04-24T13:32:26.503718+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:32:26.503718+0000","last_undegraded":"2024-04-24T13:32:26.503718+0000","last_fullsized":"2024-04-24T13:32:26.503718+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399969+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:32:26.399969+0000","last_peered":"2024-04-24T13:32:26.399969+0000","last_clean":"2024-04-24T13:32:26.399969+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:32:26.399969+0000","last_undegraded":"2024-04-24T13:32:26.399969+0000","last_fullsized":"2024-04-24T13:32:26.399969+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"82'26","reported_seq":165,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.398436+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:32:26.398436+0000","last_peered":"2024-04-24T13:32:26.398436+0000","last_clean":"2024-04-24T13:32:26.398436+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:32:26.398436+0000","last_undegraded":"2024-04-24T13:32:26.398436+0000","last_fullsized":"2024-04-24T13:32:26.398436+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801264+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:32:26.801264+0000","last_peered":"2024-04-24T13:32:26.801264+0000","last_clean":"2024-04-24T13:32:26.801264+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:32:26.801264+0000","last_undegraded":"2024-04-24T13:32:26.801264+0000","last_fullsized":"2024-04-24T13:32:26.801264+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402089+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:32:26.402089+0000","last_peered":"2024-04-24T13:32:26.402089+0000","last_clean":"2024-04-24T13:32:26.402089+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:32:26.402089+0000","last_undegraded":"2024-04-24T13:32:26.402089+0000","last_fullsized":"2024-04-24T13:32:26.402089+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"82'14","reported_seq":187,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.400165+0000","last_change":"2024-04-24T13:32:00.572648+0000","last_active":"2024-04-24T13:32:26.400165+0000","last_peered":"2024-04-24T13:32:26.400165+0000","last_clean":"2024-04-24T13:32:26.400165+0000","last_became_active":"2024-04-24T13:32:00.572370+0000","last_became_peered":"2024-04-24T13:32:00.572370+0000","last_unstale":"2024-04-24T13:32:26.400165+0000","last_undegraded":"2024-04-24T13:32:26.400165+0000","last_fullsized":"2024-04-24T13:32:26.400165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:03:27.828826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":69,"num_read_kb":65,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"0'0","reported_seq":138,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503601+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:32:26.503601+0000","last_peered":"2024-04-24T13:32:26.503601+0000","last_clean":"2024-04-24T13:32:26.503601+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:32:26.503601+0000","last_undegraded":"2024-04-24T13:32:26.503601+0000","last_fullsized":"2024-04-24T13:32:26.503601+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":97,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402556+0000","last_change":"2024-04-24T13:30:50.937016+0000","last_active":"2024-04-24T13:32:26.402556+0000","last_peered":"2024-04-24T13:32:26.402556+0000","last_clean":"2024-04-24T13:32:26.402556+0000","last_became_active":"2024-04-24T13:30:50.934998+0000","last_became_peered":"2024-04-24T13:30:50.934998+0000","last_unstale":"2024-04-24T13:32:26.402556+0000","last_undegraded":"2024-04-24T13:32:26.402556+0000","last_fullsized":"2024-04-24T13:32:26.402556+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:42:03.696601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801975+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:32:26.801975+0000","last_peered":"2024-04-24T13:32:26.801975+0000","last_clean":"2024-04-24T13:32:26.801975+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:32:26.801975+0000","last_undegraded":"2024-04-24T13:32:26.801975+0000","last_fullsized":"2024-04-24T13:32:26.801975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502036+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:32:26.502036+0000","last_peered":"2024-04-24T13:32:26.502036+0000","last_clean":"2024-04-24T13:32:26.502036+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:32:26.502036+0000","last_undegraded":"2024-04-24T13:32:26.502036+0000","last_fullsized":"2024-04-24T13:32:26.502036+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"83'90","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502146+0000","last_change":"2024-04-24T13:32:00.637531+0000","last_active":"2024-04-24T13:32:26.502146+0000","last_peered":"2024-04-24T13:32:26.502146+0000","last_clean":"2024-04-24T13:32:26.502146+0000","last_became_active":"2024-04-24T13:32:00.580902+0000","last_became_peered":"2024-04-24T13:32:00.580902+0000","last_unstale":"2024-04-24T13:32:26.502146+0000","last_undegraded":"2024-04-24T13:32:26.502146+0000","last_fullsized":"2024-04-24T13:32:26.502146+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:39.251312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"81'1","reported_seq":117,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801173+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:32:26.801173+0000","last_peered":"2024-04-24T13:32:26.801173+0000","last_clean":"2024-04-24T13:32:26.801173+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:32:26.801173+0000","last_undegraded":"2024-04-24T13:32:26.801173+0000","last_fullsized":"2024-04-24T13:32:26.801173+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"82'2","reported_seq":91,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.796764+0000","last_change":"2024-04-24T13:31:01.035271+0000","last_active":"2024-04-24T13:32:26.796764+0000","last_peered":"2024-04-24T13:32:26.796764+0000","last_clean":"2024-04-24T13:32:26.796764+0000","last_became_active":"2024-04-24T13:31:01.034314+0000","last_became_peered":"2024-04-24T13:31:01.034314+0000","last_unstale":"2024-04-24T13:32:26.796764+0000","last_undegraded":"2024-04-24T13:32:26.796764+0000","last_fullsized":"2024-04-24T13:32:26.796764+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:45.074671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"81'1","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801011+0000","last_change":"2024-04-24T13:30:50.913675+0000","last_active":"2024-04-24T13:32:26.801011+0000","last_peered":"2024-04-24T13:32:26.801011+0000","last_clean":"2024-04-24T13:32:26.801011+0000","last_became_active":"2024-04-24T13:30:50.912153+0000","last_became_peered":"2024-04-24T13:30:50.912153+0000","last_unstale":"2024-04-24T13:32:26.801011+0000","last_undegraded":"2024-04-24T13:32:26.801011+0000","last_fullsized":"2024-04-24T13:32:26.801011+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.808699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.504117+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:32:26.504117+0000","last_peered":"2024-04-24T13:32:26.504117+0000","last_clean":"2024-04-24T13:32:26.504117+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:32:26.504117+0000","last_undegraded":"2024-04-24T13:32:26.504117+0000","last_fullsized":"2024-04-24T13:32:26.504117+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800616+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:32:26.800616+0000","last_peered":"2024-04-24T13:32:26.800616+0000","last_clean":"2024-04-24T13:32:26.800616+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:32:26.800616+0000","last_undegraded":"2024-04-24T13:32:26.800616+0000","last_fullsized":"2024-04-24T13:32:26.800616+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":139,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800901+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:32:26.800901+0000","last_peered":"2024-04-24T13:32:26.800901+0000","last_clean":"2024-04-24T13:32:26.800901+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:32:26.800901+0000","last_undegraded":"2024-04-24T13:32:26.800901+0000","last_fullsized":"2024-04-24T13:32:26.800901+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"83'89","reported_seq":233,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799959+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:32:26.799959+0000","last_peered":"2024-04-24T13:32:26.799959+0000","last_clean":"2024-04-24T13:32:26.799959+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:32:26.799959+0000","last_undegraded":"2024-04-24T13:32:26.799959+0000","last_fullsized":"2024-04-24T13:32:26.799959+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"82'6","reported_seq":124,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.398752+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:32:26.398752+0000","last_peered":"2024-04-24T13:32:26.398752+0000","last_clean":"2024-04-24T13:32:26.398752+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:32:26.398752+0000","last_undegraded":"2024-04-24T13:32:26.398752+0000","last_fullsized":"2024-04-24T13:32:26.398752+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"82'2","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800148+0000","last_change":"2024-04-24T13:32:00.573698+0000","last_active":"2024-04-24T13:32:26.800148+0000","last_peered":"2024-04-24T13:32:26.800148+0000","last_clean":"2024-04-24T13:32:26.800148+0000","last_became_active":"2024-04-24T13:32:00.572831+0000","last_became_peered":"2024-04-24T13:32:00.572831+0000","last_unstale":"2024-04-24T13:32:26.800148+0000","last_undegraded":"2024-04-24T13:32:26.800148+0000","last_fullsized":"2024-04-24T13:32:26.800148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:37:38.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"0'0","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399447+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:32:26.399447+0000","last_peered":"2024-04-24T13:32:26.399447+0000","last_clean":"2024-04-24T13:32:26.399447+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:32:26.399447+0000","last_undegraded":"2024-04-24T13:32:26.399447+0000","last_fullsized":"2024-04-24T13:32:26.399447+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":147,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.807307+0000","last_change":"2024-04-24T13:30:50.937218+0000","last_active":"2024-04-24T13:32:26.807307+0000","last_peered":"2024-04-24T13:32:26.807307+0000","last_clean":"2024-04-24T13:32:26.807307+0000","last_became_active":"2024-04-24T13:30:50.936420+0000","last_became_peered":"2024-04-24T13:30:50.936420+0000","last_unstale":"2024-04-24T13:32:26.807307+0000","last_undegraded":"2024-04-24T13:32:26.807307+0000","last_fullsized":"2024-04-24T13:32:26.807307+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:08.910360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":129,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801499+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:32:26.801499+0000","last_peered":"2024-04-24T13:32:26.801499+0000","last_clean":"2024-04-24T13:32:26.801499+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:32:26.801499+0000","last_undegraded":"2024-04-24T13:32:26.801499+0000","last_fullsized":"2024-04-24T13:32:26.801499+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"82'31","reported_seq":180,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801260+0000","last_change":"2024-04-24T13:30:50.977698+0000","last_active":"2024-04-24T13:32:26.801260+0000","last_peered":"2024-04-24T13:32:26.801260+0000","last_clean":"2024-04-24T13:32:26.801260+0000","last_became_active":"2024-04-24T13:30:50.936955+0000","last_became_peered":"2024-04-24T13:30:50.936955+0000","last_unstale":"2024-04-24T13:32:26.801260+0000","last_undegraded":"2024-04-24T13:32:26.801260+0000","last_fullsized":"2024-04-24T13:32:26.801260+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:47.349331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799363+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:32:26.799363+0000","last_peered":"2024-04-24T13:32:26.799363+0000","last_clean":"2024-04-24T13:32:26.799363+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:32:26.799363+0000","last_undegraded":"2024-04-24T13:32:26.799363+0000","last_fullsized":"2024-04-24T13:32:26.799363+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"81'4","reported_seq":65,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798540+0000","last_change":"2024-04-24T13:32:00.565416+0000","last_active":"2024-04-24T13:32:26.798540+0000","last_peered":"2024-04-24T13:32:26.798540+0000","last_clean":"2024-04-24T13:32:26.798540+0000","last_became_active":"2024-04-24T13:32:00.565144+0000","last_became_peered":"2024-04-24T13:32:00.565144+0000","last_unstale":"2024-04-24T13:32:26.798540+0000","last_undegraded":"2024-04-24T13:32:26.798540+0000","last_fullsized":"2024-04-24T13:32:26.798540+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"82'2","reported_seq":125,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402352+0000","last_change":"2024-04-24T13:32:00.592514+0000","last_active":"2024-04-24T13:32:26.402352+0000","last_peered":"2024-04-24T13:32:26.402352+0000","last_clean":"2024-04-24T13:32:26.402352+0000","last_became_active":"2024-04-24T13:32:00.591877+0000","last_became_peered":"2024-04-24T13:32:00.591877+0000","last_unstale":"2024-04-24T13:32:26.402352+0000","last_undegraded":"2024-04-24T13:32:26.402352+0000","last_fullsized":"2024-04-24T13:32:26.402352+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:14:57.431228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"82'2","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802349+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:32:26.802349+0000","last_peered":"2024-04-24T13:32:26.802349+0000","last_clean":"2024-04-24T13:32:26.802349+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:32:26.802349+0000","last_undegraded":"2024-04-24T13:32:26.802349+0000","last_fullsized":"2024-04-24T13:32:26.802349+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"0'0","reported_seq":82,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798371+0000","last_change":"2024-04-24T13:31:00.986151+0000","last_active":"2024-04-24T13:32:26.798371+0000","last_peered":"2024-04-24T13:32:26.798371+0000","last_clean":"2024-04-24T13:32:26.798371+0000","last_became_active":"2024-04-24T13:31:00.985421+0000","last_became_peered":"2024-04-24T13:31:00.985421+0000","last_unstale":"2024-04-24T13:32:26.798371+0000","last_undegraded":"2024-04-24T13:32:26.798371+0000","last_fullsized":"2024-04-24T13:32:26.798371+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:42.662404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":198,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502972+0000","last_change":"2024-04-24T13:32:00.636177+0000","last_active":"2024-04-24T13:32:26.502972+0000","last_peered":"2024-04-24T13:32:26.502972+0000","last_clean":"2024-04-24T13:32:26.502972+0000","last_became_active":"2024-04-24T13:32:00.580888+0000","last_became_peered":"2024-04-24T13:32:00.580888+0000","last_unstale":"2024-04-24T13:32:26.502972+0000","last_undegraded":"2024-04-24T13:32:26.502972+0000","last_fullsized":"2024-04-24T13:32:26.502972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:21:21.951639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"82'16","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797235+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:32:26.797235+0000","last_peered":"2024-04-24T13:32:26.797235+0000","last_clean":"2024-04-24T13:32:26.797235+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:32:26.797235+0000","last_undegraded":"2024-04-24T13:32:26.797235+0000","last_fullsized":"2024-04-24T13:32:26.797235+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801520+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:32:26.801520+0000","last_peered":"2024-04-24T13:32:26.801520+0000","last_clean":"2024-04-24T13:32:26.801520+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:32:26.801520+0000","last_undegraded":"2024-04-24T13:32:26.801520+0000","last_fullsized":"2024-04-24T13:32:26.801520+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":121,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800996+0000","last_change":"2024-04-24T13:30:50.930475+0000","last_active":"2024-04-24T13:32:26.800996+0000","last_peered":"2024-04-24T13:32:26.800996+0000","last_clean":"2024-04-24T13:32:26.800996+0000","last_became_active":"2024-04-24T13:30:50.929905+0000","last_became_peered":"2024-04-24T13:30:50.929905+0000","last_unstale":"2024-04-24T13:32:26.800996+0000","last_undegraded":"2024-04-24T13:32:26.800996+0000","last_fullsized":"2024-04-24T13:32:26.800996+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:41.257023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":133,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502767+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:32:26.502767+0000","last_peered":"2024-04-24T13:32:26.502767+0000","last_clean":"2024-04-24T13:32:26.502767+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:32:26.502767+0000","last_undegraded":"2024-04-24T13:32:26.502767+0000","last_fullsized":"2024-04-24T13:32:26.502767+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"0'0","reported_seq":95,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799118+0000","last_change":"2024-04-24T13:30:50.931263+0000","last_active":"2024-04-24T13:32:26.799118+0000","last_peered":"2024-04-24T13:32:26.799118+0000","last_clean":"2024-04-24T13:32:26.799118+0000","last_became_active":"2024-04-24T13:30:50.929683+0000","last_became_peered":"2024-04-24T13:30:50.929683+0000","last_unstale":"2024-04-24T13:32:26.799118+0000","last_undegraded":"2024-04-24T13:32:26.799118+0000","last_fullsized":"2024-04-24T13:32:26.799118+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:28:57.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799396+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:32:26.799396+0000","last_peered":"2024-04-24T13:32:26.799396+0000","last_clean":"2024-04-24T13:32:26.799396+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:32:26.799396+0000","last_undegraded":"2024-04-24T13:32:26.799396+0000","last_fullsized":"2024-04-24T13:32:26.799396+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"50'5","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399133+0000","last_change":"2024-04-24T13:32:00.625842+0000","last_active":"2024-04-24T13:32:26.399133+0000","last_peered":"2024-04-24T13:32:26.399133+0000","last_clean":"2024-04-24T13:32:26.399133+0000","last_became_active":"2024-04-24T13:32:00.571509+0000","last_became_peered":"2024-04-24T13:32:00.571509+0000","last_unstale":"2024-04-24T13:32:26.399133+0000","last_undegraded":"2024-04-24T13:32:26.399133+0000","last_fullsized":"2024-04-24T13:32:26.399133+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:46.222754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":7,"num_read_kb":5,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800075+0000","last_change":"2024-04-24T13:30:50.924952+0000","last_active":"2024-04-24T13:32:26.800075+0000","last_peered":"2024-04-24T13:32:26.800075+0000","last_clean":"2024-04-24T13:32:26.800075+0000","last_became_active":"2024-04-24T13:30:50.923933+0000","last_became_peered":"2024-04-24T13:30:50.923933+0000","last_unstale":"2024-04-24T13:32:26.800075+0000","last_undegraded":"2024-04-24T13:32:26.800075+0000","last_fullsized":"2024-04-24T13:32:26.800075+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:17.479670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"82'4","reported_seq":122,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402300+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:32:26.402300+0000","last_peered":"2024-04-24T13:32:26.402300+0000","last_clean":"2024-04-24T13:32:26.402300+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:32:26.402300+0000","last_undegraded":"2024-04-24T13:32:26.402300+0000","last_fullsized":"2024-04-24T13:32:26.402300+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"82'4","reported_seq":153,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797559+0000","last_change":"2024-04-24T13:30:50.925917+0000","last_active":"2024-04-24T13:32:26.797559+0000","last_peered":"2024-04-24T13:32:26.797559+0000","last_clean":"2024-04-24T13:32:26.797559+0000","last_became_active":"2024-04-24T13:30:50.925580+0000","last_became_peered":"2024-04-24T13:30:50.925580+0000","last_unstale":"2024-04-24T13:32:26.797559+0000","last_undegraded":"2024-04-24T13:32:26.797559+0000","last_fullsized":"2024-04-24T13:32:26.797559+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":79,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503767+0000","last_change":"2024-04-24T13:32:00.578777+0000","last_active":"2024-04-24T13:32:26.503767+0000","last_peered":"2024-04-24T13:32:26.503767+0000","last_clean":"2024-04-24T13:32:26.503767+0000","last_became_active":"2024-04-24T13:32:00.578382+0000","last_became_peered":"2024-04-24T13:32:00.578382+0000","last_unstale":"2024-04-24T13:32:26.503767+0000","last_undegraded":"2024-04-24T13:32:26.503767+0000","last_fullsized":"2024-04-24T13:32:26.503767+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:42:09.741845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799184+0000","last_change":"2024-04-24T13:30:50.934577+0000","last_active":"2024-04-24T13:32:26.799184+0000","last_peered":"2024-04-24T13:32:26.799184+0000","last_clean":"2024-04-24T13:32:26.799184+0000","last_became_active":"2024-04-24T13:30:50.931559+0000","last_became_peered":"2024-04-24T13:30:50.931559+0000","last_unstale":"2024-04-24T13:32:26.799184+0000","last_undegraded":"2024-04-24T13:32:26.799184+0000","last_fullsized":"2024-04-24T13:32:26.799184+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:35.372215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"82'16","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799230+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:32:26.799230+0000","last_peered":"2024-04-24T13:32:26.799230+0000","last_clean":"2024-04-24T13:32:26.799230+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:32:26.799230+0000","last_undegraded":"2024-04-24T13:32:26.799230+0000","last_fullsized":"2024-04-24T13:32:26.799230+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":119,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801846+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:32:26.801846+0000","last_peered":"2024-04-24T13:32:26.801846+0000","last_clean":"2024-04-24T13:32:26.801846+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:32:26.801846+0000","last_undegraded":"2024-04-24T13:32:26.801846+0000","last_fullsized":"2024-04-24T13:32:26.801846+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":59,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802000+0000","last_change":"2024-04-24T13:32:00.574788+0000","last_active":"2024-04-24T13:32:26.802000+0000","last_peered":"2024-04-24T13:32:26.802000+0000","last_clean":"2024-04-24T13:32:26.802000+0000","last_became_active":"2024-04-24T13:32:00.574001+0000","last_became_peered":"2024-04-24T13:32:00.574001+0000","last_unstale":"2024-04-24T13:32:26.802000+0000","last_undegraded":"2024-04-24T13:32:26.802000+0000","last_fullsized":"2024-04-24T13:32:26.802000+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:39:57.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801296+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:32:26.801296+0000","last_peered":"2024-04-24T13:32:26.801296+0000","last_clean":"2024-04-24T13:32:26.801296+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:32:26.801296+0000","last_undegraded":"2024-04-24T13:32:26.801296+0000","last_fullsized":"2024-04-24T13:32:26.801296+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402813+0000","last_change":"2024-04-24T13:32:00.592734+0000","last_active":"2024-04-24T13:32:26.402813+0000","last_peered":"2024-04-24T13:32:26.402813+0000","last_clean":"2024-04-24T13:32:26.402813+0000","last_became_active":"2024-04-24T13:32:00.592231+0000","last_became_peered":"2024-04-24T13:32:00.592231+0000","last_unstale":"2024-04-24T13:32:26.402813+0000","last_undegraded":"2024-04-24T13:32:26.402813+0000","last_fullsized":"2024-04-24T13:32:26.402813+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:23:36.838218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800743+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:32:26.800743+0000","last_peered":"2024-04-24T13:32:26.800743+0000","last_clean":"2024-04-24T13:32:26.800743+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:32:26.800743+0000","last_undegraded":"2024-04-24T13:32:26.800743+0000","last_fullsized":"2024-04-24T13:32:26.800743+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"82'14","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797725+0000","last_change":"2024-04-24T13:30:50.981989+0000","last_active":"2024-04-24T13:32:26.797725+0000","last_peered":"2024-04-24T13:32:26.797725+0000","last_clean":"2024-04-24T13:32:26.797725+0000","last_became_active":"2024-04-24T13:30:50.939707+0000","last_became_peered":"2024-04-24T13:30:50.939707+0000","last_unstale":"2024-04-24T13:32:26.797725+0000","last_undegraded":"2024-04-24T13:32:26.797725+0000","last_fullsized":"2024-04-24T13:32:26.797725+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:38.379316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":125,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399794+0000","last_change":"2024-04-24T13:30:50.935071+0000","last_active":"2024-04-24T13:32:26.399794+0000","last_peered":"2024-04-24T13:32:26.399794+0000","last_clean":"2024-04-24T13:32:26.399794+0000","last_became_active":"2024-04-24T13:30:50.934309+0000","last_became_peered":"2024-04-24T13:30:50.934309+0000","last_unstale":"2024-04-24T13:32:26.399794+0000","last_undegraded":"2024-04-24T13:32:26.399794+0000","last_fullsized":"2024-04-24T13:32:26.399794+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:51.520511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"82'8","reported_seq":168,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.803170+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:32:26.803170+0000","last_peered":"2024-04-24T13:32:26.803170+0000","last_clean":"2024-04-24T13:32:26.803170+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:32:26.803170+0000","last_undegraded":"2024-04-24T13:32:26.803170+0000","last_fullsized":"2024-04-24T13:32:26.803170+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"81'1","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801119+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:32:26.801119+0000","last_peered":"2024-04-24T13:32:26.801119+0000","last_clean":"2024-04-24T13:32:26.801119+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:32:26.801119+0000","last_undegraded":"2024-04-24T13:32:26.801119+0000","last_fullsized":"2024-04-24T13:32:26.801119+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":134,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.400036+0000","last_change":"2024-04-24T13:30:50.921993+0000","last_active":"2024-04-24T13:32:26.400036+0000","last_peered":"2024-04-24T13:32:26.400036+0000","last_clean":"2024-04-24T13:32:26.400036+0000","last_became_active":"2024-04-24T13:30:50.921257+0000","last_became_peered":"2024-04-24T13:30:50.921257+0000","last_unstale":"2024-04-24T13:32:26.400036+0000","last_undegraded":"2024-04-24T13:32:26.400036+0000","last_fullsized":"2024-04-24T13:32:26.400036+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:58.034297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"82'20","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502879+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:32:26.502879+0000","last_peered":"2024-04-24T13:32:26.502879+0000","last_clean":"2024-04-24T13:32:26.502879+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:32:26.502879+0000","last_undegraded":"2024-04-24T13:32:26.502879+0000","last_fullsized":"2024-04-24T13:32:26.502879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798957+0000","last_change":"2024-04-24T13:32:00.575641+0000","last_active":"2024-04-24T13:32:26.798957+0000","last_peered":"2024-04-24T13:32:26.798957+0000","last_clean":"2024-04-24T13:32:26.798957+0000","last_became_active":"2024-04-24T13:32:00.575032+0000","last_became_peered":"2024-04-24T13:32:00.575032+0000","last_unstale":"2024-04-24T13:32:26.798957+0000","last_undegraded":"2024-04-24T13:32:26.798957+0000","last_fullsized":"2024-04-24T13:32:26.798957+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:32.950981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798959+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:32:26.798959+0000","last_peered":"2024-04-24T13:32:26.798959+0000","last_clean":"2024-04-24T13:32:26.798959+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:32:26.798959+0000","last_undegraded":"2024-04-24T13:32:26.798959+0000","last_fullsized":"2024-04-24T13:32:26.798959+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"83'5","reported_seq":156,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399806+0000","last_change":"2024-04-24T13:30:50.917948+0000","last_active":"2024-04-24T13:32:26.399806+0000","last_peered":"2024-04-24T13:32:26.399806+0000","last_clean":"2024-04-24T13:32:26.399806+0000","last_became_active":"2024-04-24T13:30:50.917339+0000","last_became_peered":"2024-04-24T13:30:50.917339+0000","last_unstale":"2024-04-24T13:32:26.399806+0000","last_undegraded":"2024-04-24T13:32:26.399806+0000","last_fullsized":"2024-04-24T13:32:26.399806+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:36:03.041606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"0'0","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502617+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:32:26.502617+0000","last_peered":"2024-04-24T13:32:26.502617+0000","last_clean":"2024-04-24T13:32:26.502617+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:32:26.502617+0000","last_undegraded":"2024-04-24T13:32:26.502617+0000","last_fullsized":"2024-04-24T13:32:26.502617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":127,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801286+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:32:26.801286+0000","last_peered":"2024-04-24T13:32:26.801286+0000","last_clean":"2024-04-24T13:32:26.801286+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:32:26.801286+0000","last_undegraded":"2024-04-24T13:32:26.801286+0000","last_fullsized":"2024-04-24T13:32:26.801286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"82'19","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798585+0000","last_change":"2024-04-24T13:32:00.630779+0000","last_active":"2024-04-24T13:32:26.798585+0000","last_peered":"2024-04-24T13:32:26.798585+0000","last_clean":"2024-04-24T13:32:26.798585+0000","last_became_active":"2024-04-24T13:32:00.580437+0000","last_became_peered":"2024-04-24T13:32:00.580437+0000","last_unstale":"2024-04-24T13:32:26.798585+0000","last_undegraded":"2024-04-24T13:32:26.798585+0000","last_fullsized":"2024-04-24T13:32:26.798585+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:18.907583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":121,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502976+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:32:26.502976+0000","last_peered":"2024-04-24T13:32:26.502976+0000","last_clean":"2024-04-24T13:32:26.502976+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:32:26.502976+0000","last_undegraded":"2024-04-24T13:32:26.502976+0000","last_fullsized":"2024-04-24T13:32:26.502976+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800565+0000","last_change":"2024-04-24T13:30:50.937377+0000","last_active":"2024-04-24T13:32:26.800565+0000","last_peered":"2024-04-24T13:32:26.800565+0000","last_clean":"2024-04-24T13:32:26.800565+0000","last_became_active":"2024-04-24T13:30:50.936540+0000","last_became_peered":"2024-04-24T13:30:50.936540+0000","last_unstale":"2024-04-24T13:32:26.800565+0000","last_undegraded":"2024-04-24T13:32:26.800565+0000","last_fullsized":"2024-04-24T13:32:26.800565+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:44.053660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799207+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:32:26.799207+0000","last_peered":"2024-04-24T13:32:26.799207+0000","last_clean":"2024-04-24T13:32:26.799207+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:32:26.799207+0000","last_undegraded":"2024-04-24T13:32:26.799207+0000","last_fullsized":"2024-04-24T13:32:26.799207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"82'1","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801689+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:32:26.801689+0000","last_peered":"2024-04-24T13:32:26.801689+0000","last_clean":"2024-04-24T13:32:26.801689+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:32:26.801689+0000","last_undegraded":"2024-04-24T13:32:26.801689+0000","last_fullsized":"2024-04-24T13:32:26.801689+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4194304,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.804179+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:32:26.804179+0000","last_peered":"2024-04-24T13:32:26.804179+0000","last_clean":"2024-04-24T13:32:26.804179+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:32:26.804179+0000","last_undegraded":"2024-04-24T13:32:26.804179+0000","last_fullsized":"2024-04-24T13:32:26.804179+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"82'16","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801268+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:32:26.801268+0000","last_peered":"2024-04-24T13:32:26.801268+0000","last_clean":"2024-04-24T13:32:26.801268+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:32:26.801268+0000","last_undegraded":"2024-04-24T13:32:26.801268+0000","last_fullsized":"2024-04-24T13:32:26.801268+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":121,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503426+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:32:26.503426+0000","last_peered":"2024-04-24T13:32:26.503426+0000","last_clean":"2024-04-24T13:32:26.503426+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:32:26.503426+0000","last_undegraded":"2024-04-24T13:32:26.503426+0000","last_fullsized":"2024-04-24T13:32:26.503426+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":122,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402053+0000","last_change":"2024-04-24T13:30:50.929993+0000","last_active":"2024-04-24T13:32:26.402053+0000","last_peered":"2024-04-24T13:32:26.402053+0000","last_clean":"2024-04-24T13:32:26.402053+0000","last_became_active":"2024-04-24T13:30:50.929169+0000","last_became_peered":"2024-04-24T13:30:50.929169+0000","last_unstale":"2024-04-24T13:32:26.402053+0000","last_undegraded":"2024-04-24T13:32:26.402053+0000","last_fullsized":"2024-04-24T13:32:26.402053+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:57.047113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":131,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798718+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:32:26.798718+0000","last_peered":"2024-04-24T13:32:26.798718+0000","last_clean":"2024-04-24T13:32:26.798718+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:32:26.798718+0000","last_undegraded":"2024-04-24T13:32:26.798718+0000","last_fullsized":"2024-04-24T13:32:26.798718+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399836+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:32:26.399836+0000","last_peered":"2024-04-24T13:32:26.399836+0000","last_clean":"2024-04-24T13:32:26.399836+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:32:26.399836+0000","last_undegraded":"2024-04-24T13:32:26.399836+0000","last_fullsized":"2024-04-24T13:32:26.399836+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":129,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503452+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:32:26.503452+0000","last_peered":"2024-04-24T13:32:26.503452+0000","last_clean":"2024-04-24T13:32:26.503452+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:32:26.503452+0000","last_undegraded":"2024-04-24T13:32:26.503452+0000","last_fullsized":"2024-04-24T13:32:26.503452+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.805188+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:32:26.805188+0000","last_peered":"2024-04-24T13:32:26.805188+0000","last_clean":"2024-04-24T13:32:26.805188+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:32:26.805188+0000","last_undegraded":"2024-04-24T13:32:26.805188+0000","last_fullsized":"2024-04-24T13:32:26.805188+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"83'89","reported_seq":232,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800920+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:32:26.800920+0000","last_peered":"2024-04-24T13:32:26.800920+0000","last_clean":"2024-04-24T13:32:26.800920+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:32:26.800920+0000","last_undegraded":"2024-04-24T13:32:26.800920+0000","last_fullsized":"2024-04-24T13:32:26.800920+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":89,"log_dups_size":0,"ondisk_log_size":89,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"82'6","reported_seq":42,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798817+0000","last_change":"2024-04-24T13:32:00.561720+0000","last_active":"2024-04-24T13:32:26.798817+0000","last_peered":"2024-04-24T13:32:26.798817+0000","last_clean":"2024-04-24T13:32:26.798817+0000","last_became_active":"2024-04-24T13:32:00.560052+0000","last_became_peered":"2024-04-24T13:32:00.560052+0000","last_unstale":"2024-04-24T13:32:26.798817+0000","last_undegraded":"2024-04-24T13:32:26.798817+0000","last_fullsized":"2024-04-24T13:32:26.798817+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:40:13.263017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"83'3","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802089+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:32:26.802089+0000","last_peered":"2024-04-24T13:32:26.802089+0000","last_clean":"2024-04-24T13:32:26.802089+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:32:26.802089+0000","last_undegraded":"2024-04-24T13:32:26.802089+0000","last_fullsized":"2024-04-24T13:32:26.802089+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"81'1","reported_seq":32,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802605+0000","last_change":"2024-04-24T13:32:00.571666+0000","last_active":"2024-04-24T13:32:26.802605+0000","last_peered":"2024-04-24T13:32:26.802605+0000","last_clean":"2024-04-24T13:32:26.802605+0000","last_became_active":"2024-04-24T13:32:00.567566+0000","last_became_peered":"2024-04-24T13:32:00.567566+0000","last_unstale":"2024-04-24T13:32:26.802605+0000","last_undegraded":"2024-04-24T13:32:26.802605+0000","last_fullsized":"2024-04-24T13:32:26.802605+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:48.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799578+0000","last_change":"2024-04-24T13:30:50.927331+0000","last_active":"2024-04-24T13:32:26.799578+0000","last_peered":"2024-04-24T13:32:26.799578+0000","last_clean":"2024-04-24T13:32:26.799578+0000","last_became_active":"2024-04-24T13:30:50.926529+0000","last_became_peered":"2024-04-24T13:30:50.926529+0000","last_unstale":"2024-04-24T13:32:26.799578+0000","last_undegraded":"2024-04-24T13:32:26.799578+0000","last_fullsized":"2024-04-24T13:32:26.799578+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:23.529403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"82'21","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502002+0000","last_change":"2024-04-24T13:32:00.601926+0000","last_active":"2024-04-24T13:32:26.502002+0000","last_peered":"2024-04-24T13:32:26.502002+0000","last_clean":"2024-04-24T13:32:26.502002+0000","last_became_active":"2024-04-24T13:32:00.580179+0000","last_became_peered":"2024-04-24T13:32:00.580179+0000","last_unstale":"2024-04-24T13:32:26.502002+0000","last_undegraded":"2024-04-24T13:32:26.502002+0000","last_fullsized":"2024-04-24T13:32:26.502002+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:02.410886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399024+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:32:26.399024+0000","last_peered":"2024-04-24T13:32:26.399024+0000","last_clean":"2024-04-24T13:32:26.399024+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:32:26.399024+0000","last_undegraded":"2024-04-24T13:32:26.399024+0000","last_fullsized":"2024-04-24T13:32:26.399024+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":97,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402271+0000","last_change":"2024-04-24T13:30:50.922108+0000","last_active":"2024-04-24T13:32:26.402271+0000","last_peered":"2024-04-24T13:32:26.402271+0000","last_clean":"2024-04-24T13:32:26.402271+0000","last_became_active":"2024-04-24T13:30:50.921514+0000","last_became_peered":"2024-04-24T13:30:50.921514+0000","last_unstale":"2024-04-24T13:32:26.402271+0000","last_undegraded":"2024-04-24T13:32:26.402271+0000","last_fullsized":"2024-04-24T13:32:26.402271+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:05.867839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"82'4","reported_seq":148,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801164+0000","last_change":"2024-04-24T13:30:23.225100+0000","last_active":"2024-04-24T13:32:26.801164+0000","last_peered":"2024-04-24T13:32:26.801164+0000","last_clean":"2024-04-24T13:32:26.801164+0000","last_became_active":"2024-04-24T13:30:23.224324+0000","last_became_peered":"2024-04-24T13:30:23.224324+0000","last_unstale":"2024-04-24T13:32:26.801164+0000","last_undegraded":"2024-04-24T13:32:26.801164+0000","last_fullsized":"2024-04-24T13:32:26.801164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402351+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:32:26.402351+0000","last_peered":"2024-04-24T13:32:26.402351+0000","last_clean":"2024-04-24T13:32:26.402351+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:32:26.402351+0000","last_undegraded":"2024-04-24T13:32:26.402351+0000","last_fullsized":"2024-04-24T13:32:26.402351+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.400236+0000","last_change":"2024-04-24T13:32:00.595272+0000","last_active":"2024-04-24T13:32:26.400236+0000","last_peered":"2024-04-24T13:32:26.400236+0000","last_clean":"2024-04-24T13:32:26.400236+0000","last_became_active":"2024-04-24T13:32:00.593617+0000","last_became_peered":"2024-04-24T13:32:00.593617+0000","last_unstale":"2024-04-24T13:32:26.400236+0000","last_undegraded":"2024-04-24T13:32:26.400236+0000","last_fullsized":"2024-04-24T13:32:26.400236+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:53:23.482374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"82'13","reported_seq":144,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.398813+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:32:26.398813+0000","last_peered":"2024-04-24T13:32:26.398813+0000","last_clean":"2024-04-24T13:32:26.398813+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:32:26.398813+0000","last_undegraded":"2024-04-24T13:32:26.398813+0000","last_fullsized":"2024-04-24T13:32:26.398813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":124,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800308+0000","last_change":"2024-04-24T13:30:50.938940+0000","last_active":"2024-04-24T13:32:26.800308+0000","last_peered":"2024-04-24T13:32:26.800308+0000","last_clean":"2024-04-24T13:32:26.800308+0000","last_became_active":"2024-04-24T13:30:50.936355+0000","last_became_peered":"2024-04-24T13:30:50.936355+0000","last_unstale":"2024-04-24T13:32:26.800308+0000","last_undegraded":"2024-04-24T13:32:26.800308+0000","last_fullsized":"2024-04-24T13:32:26.800308+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800997+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:32:26.800997+0000","last_peered":"2024-04-24T13:32:26.800997+0000","last_clean":"2024-04-24T13:32:26.800997+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:32:26.800997+0000","last_undegraded":"2024-04-24T13:32:26.800997+0000","last_fullsized":"2024-04-24T13:32:26.800997+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"83'3","reported_seq":93,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402074+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:32:26.402074+0000","last_peered":"2024-04-24T13:32:26.402074+0000","last_clean":"2024-04-24T13:32:26.402074+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:32:26.402074+0000","last_undegraded":"2024-04-24T13:32:26.402074+0000","last_fullsized":"2024-04-24T13:32:26.402074+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":12,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801333+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:32:26.801333+0000","last_peered":"2024-04-24T13:32:26.801333+0000","last_clean":"2024-04-24T13:32:26.801333+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:32:26.801333+0000","last_undegraded":"2024-04-24T13:32:26.801333+0000","last_fullsized":"2024-04-24T13:32:26.801333+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":128,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799166+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:32:26.799166+0000","last_peered":"2024-04-24T13:32:26.799166+0000","last_clean":"2024-04-24T13:32:26.799166+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:32:26.799166+0000","last_undegraded":"2024-04-24T13:32:26.799166+0000","last_fullsized":"2024-04-24T13:32:26.799166+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"82'9","reported_seq":38,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798178+0000","last_change":"2024-04-24T13:32:01.553569+0000","last_active":"2024-04-24T13:32:26.798178+0000","last_peered":"2024-04-24T13:32:26.798178+0000","last_clean":"2024-04-24T13:32:26.798178+0000","last_became_active":"2024-04-24T13:32:01.547833+0000","last_became_peered":"2024-04-24T13:32:01.547833+0000","last_unstale":"2024-04-24T13:32:26.798178+0000","last_undegraded":"2024-04-24T13:32:26.798178+0000","last_fullsized":"2024-04-24T13:32:26.798178+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:10.789162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799310+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:32:26.799310+0000","last_peered":"2024-04-24T13:32:26.799310+0000","last_clean":"2024-04-24T13:32:26.799310+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:32:26.799310+0000","last_undegraded":"2024-04-24T13:32:26.799310+0000","last_fullsized":"2024-04-24T13:32:26.799310+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"82'2","reported_seq":100,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503114+0000","last_change":"2024-04-24T13:30:50.939033+0000","last_active":"2024-04-24T13:32:26.503114+0000","last_peered":"2024-04-24T13:32:26.503114+0000","last_clean":"2024-04-24T13:32:26.503114+0000","last_became_active":"2024-04-24T13:30:50.938747+0000","last_became_peered":"2024-04-24T13:30:50.938747+0000","last_unstale":"2024-04-24T13:32:26.503114+0000","last_undegraded":"2024-04-24T13:32:26.503114+0000","last_fullsized":"2024-04-24T13:32:26.503114+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:48.546868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"82'4","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799657+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:32:26.799657+0000","last_peered":"2024-04-24T13:32:26.799657+0000","last_clean":"2024-04-24T13:32:26.799657+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:32:26.799657+0000","last_undegraded":"2024-04-24T13:32:26.799657+0000","last_fullsized":"2024-04-24T13:32:26.799657+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"0'0","reported_seq":30,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402265+0000","last_change":"2024-04-24T13:32:00.572057+0000","last_active":"2024-04-24T13:32:26.402265+0000","last_peered":"2024-04-24T13:32:26.402265+0000","last_clean":"2024-04-24T13:32:26.402265+0000","last_became_active":"2024-04-24T13:32:00.568612+0000","last_became_peered":"2024-04-24T13:32:00.568612+0000","last_unstale":"2024-04-24T13:32:26.402265+0000","last_undegraded":"2024-04-24T13:32:26.402265+0000","last_fullsized":"2024-04-24T13:32:26.402265+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:49.615982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":139,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502140+0000","last_change":"2024-04-24T13:32:00.574968+0000","last_active":"2024-04-24T13:32:26.502140+0000","last_peered":"2024-04-24T13:32:26.502140+0000","last_clean":"2024-04-24T13:32:26.502140+0000","last_became_active":"2024-04-24T13:32:00.555407+0000","last_became_peered":"2024-04-24T13:32:00.555407+0000","last_unstale":"2024-04-24T13:32:26.502140+0000","last_undegraded":"2024-04-24T13:32:26.502140+0000","last_fullsized":"2024-04-24T13:32:26.502140+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:47.488688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"82'13","reported_seq":159,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.800019+0000","last_change":"2024-04-24T13:32:00.610501+0000","last_active":"2024-04-24T13:32:26.800019+0000","last_peered":"2024-04-24T13:32:26.800019+0000","last_clean":"2024-04-24T13:32:26.800019+0000","last_became_active":"2024-04-24T13:32:00.562130+0000","last_became_peered":"2024-04-24T13:32:00.562130+0000","last_unstale":"2024-04-24T13:32:26.800019+0000","last_undegraded":"2024-04-24T13:32:26.800019+0000","last_fullsized":"2024-04-24T13:32:26.800019+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:24:47.214366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":120,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399746+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:32:26.399746+0000","last_peered":"2024-04-24T13:32:26.399746+0000","last_clean":"2024-04-24T13:32:26.399746+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:32:26.399746+0000","last_undegraded":"2024-04-24T13:32:26.399746+0000","last_fullsized":"2024-04-24T13:32:26.399746+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":116,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802303+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:32:26.802303+0000","last_peered":"2024-04-24T13:32:26.802303+0000","last_clean":"2024-04-24T13:32:26.802303+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:32:26.802303+0000","last_undegraded":"2024-04-24T13:32:26.802303+0000","last_fullsized":"2024-04-24T13:32:26.802303+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"82'6","reported_seq":157,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503835+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:32:26.503835+0000","last_peered":"2024-04-24T13:32:26.503835+0000","last_clean":"2024-04-24T13:32:26.503835+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:32:26.503835+0000","last_undegraded":"2024-04-24T13:32:26.503835+0000","last_fullsized":"2024-04-24T13:32:26.503835+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"0'0","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799366+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:32:26.799366+0000","last_peered":"2024-04-24T13:32:26.799366+0000","last_clean":"2024-04-24T13:32:26.799366+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:32:26.799366+0000","last_undegraded":"2024-04-24T13:32:26.799366+0000","last_fullsized":"2024-04-24T13:32:26.799366+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"82'6","reported_seq":160,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503907+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:32:26.503907+0000","last_peered":"2024-04-24T13:32:26.503907+0000","last_clean":"2024-04-24T13:32:26.503907+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:32:26.503907+0000","last_undegraded":"2024-04-24T13:32:26.503907+0000","last_fullsized":"2024-04-24T13:32:26.503907+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797362+0000","last_change":"2024-04-24T13:32:00.566015+0000","last_active":"2024-04-24T13:32:26.797362+0000","last_peered":"2024-04-24T13:32:26.797362+0000","last_clean":"2024-04-24T13:32:26.797362+0000","last_became_active":"2024-04-24T13:32:00.552968+0000","last_became_peered":"2024-04-24T13:32:00.552968+0000","last_unstale":"2024-04-24T13:32:26.797362+0000","last_undegraded":"2024-04-24T13:32:26.797362+0000","last_fullsized":"2024-04-24T13:32:26.797362+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:26:58.476605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"82'2","reported_seq":83,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798954+0000","last_change":"2024-04-24T13:32:00.596572+0000","last_active":"2024-04-24T13:32:26.798954+0000","last_peered":"2024-04-24T13:32:26.798954+0000","last_clean":"2024-04-24T13:32:26.798954+0000","last_became_active":"2024-04-24T13:32:00.596100+0000","last_became_peered":"2024-04-24T13:32:00.596100+0000","last_unstale":"2024-04-24T13:32:26.798954+0000","last_undegraded":"2024-04-24T13:32:26.798954+0000","last_fullsized":"2024-04-24T13:32:26.798954+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:34.128346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799945+0000","last_change":"2024-04-24T13:32:00.592288+0000","last_active":"2024-04-24T13:32:26.799945+0000","last_peered":"2024-04-24T13:32:26.799945+0000","last_clean":"2024-04-24T13:32:26.799945+0000","last_became_active":"2024-04-24T13:32:00.592025+0000","last_became_peered":"2024-04-24T13:32:00.592025+0000","last_unstale":"2024-04-24T13:32:26.799945+0000","last_undegraded":"2024-04-24T13:32:26.799945+0000","last_fullsized":"2024-04-24T13:32:26.799945+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:15.691070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"0'0","reported_seq":138,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503661+0000","last_change":"2024-04-24T13:30:50.918913+0000","last_active":"2024-04-24T13:32:26.503661+0000","last_peered":"2024-04-24T13:32:26.503661+0000","last_clean":"2024-04-24T13:32:26.503661+0000","last_became_active":"2024-04-24T13:30:50.918221+0000","last_became_peered":"2024-04-24T13:30:50.918221+0000","last_unstale":"2024-04-24T13:32:26.503661+0000","last_undegraded":"2024-04-24T13:32:26.503661+0000","last_fullsized":"2024-04-24T13:32:26.503661+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:43.128644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399945+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:32:26.399945+0000","last_peered":"2024-04-24T13:32:26.399945+0000","last_clean":"2024-04-24T13:32:26.399945+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:32:26.399945+0000","last_undegraded":"2024-04-24T13:32:26.399945+0000","last_fullsized":"2024-04-24T13:32:26.399945+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"82'2","reported_seq":146,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799643+0000","last_change":"2024-04-24T13:30:50.926509+0000","last_active":"2024-04-24T13:32:26.799643+0000","last_peered":"2024-04-24T13:32:26.799643+0000","last_clean":"2024-04-24T13:32:26.799643+0000","last_became_active":"2024-04-24T13:30:50.925894+0000","last_became_peered":"2024-04-24T13:30:50.925894+0000","last_unstale":"2024-04-24T13:32:26.799643+0000","last_undegraded":"2024-04-24T13:32:26.799643+0000","last_fullsized":"2024-04-24T13:32:26.799643+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799773+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:32:26.799773+0000","last_peered":"2024-04-24T13:32:26.799773+0000","last_clean":"2024-04-24T13:32:26.799773+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:32:26.799773+0000","last_undegraded":"2024-04-24T13:32:26.799773+0000","last_fullsized":"2024-04-24T13:32:26.799773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"81'2","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801546+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:32:26.801546+0000","last_peered":"2024-04-24T13:32:26.801546+0000","last_clean":"2024-04-24T13:32:26.801546+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:32:26.801546+0000","last_undegraded":"2024-04-24T13:32:26.801546+0000","last_fullsized":"2024-04-24T13:32:26.801546+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"0'0","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.503615+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:32:26.503615+0000","last_peered":"2024-04-24T13:32:26.503615+0000","last_clean":"2024-04-24T13:32:26.503615+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:32:26.503615+0000","last_undegraded":"2024-04-24T13:32:26.503615+0000","last_fullsized":"2024-04-24T13:32:26.503615+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"82'8","reported_seq":154,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797501+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:32:26.797501+0000","last_peered":"2024-04-24T13:32:26.797501+0000","last_clean":"2024-04-24T13:32:26.797501+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:32:26.797501+0000","last_undegraded":"2024-04-24T13:32:26.797501+0000","last_fullsized":"2024-04-24T13:32:26.797501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":31,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"0'0","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.802747+0000","last_change":"2024-04-24T13:30:50.956474+0000","last_active":"2024-04-24T13:32:26.802747+0000","last_peered":"2024-04-24T13:32:26.802747+0000","last_clean":"2024-04-24T13:32:26.802747+0000","last_became_active":"2024-04-24T13:30:50.955801+0000","last_became_peered":"2024-04-24T13:30:50.955801+0000","last_unstale":"2024-04-24T13:32:26.802747+0000","last_undegraded":"2024-04-24T13:32:26.802747+0000","last_fullsized":"2024-04-24T13:32:26.802747+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:41.114080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":132,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799255+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:32:26.799255+0000","last_peered":"2024-04-24T13:32:26.799255+0000","last_clean":"2024-04-24T13:32:26.799255+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:32:26.799255+0000","last_undegraded":"2024-04-24T13:32:26.799255+0000","last_fullsized":"2024-04-24T13:32:26.799255+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"0'0","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801142+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:32:26.801142+0000","last_peered":"2024-04-24T13:32:26.801142+0000","last_clean":"2024-04-24T13:32:26.801142+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:32:26.801142+0000","last_undegraded":"2024-04-24T13:32:26.801142+0000","last_fullsized":"2024-04-24T13:32:26.801142+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"82'6","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402763+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:32:26.402763+0000","last_peered":"2024-04-24T13:32:26.402763+0000","last_clean":"2024-04-24T13:32:26.402763+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:32:26.402763+0000","last_undegraded":"2024-04-24T13:32:26.402763+0000","last_fullsized":"2024-04-24T13:32:26.402763+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797290+0000","last_change":"2024-04-24T13:32:00.572200+0000","last_active":"2024-04-24T13:32:26.797290+0000","last_peered":"2024-04-24T13:32:26.797290+0000","last_clean":"2024-04-24T13:32:26.797290+0000","last_became_active":"2024-04-24T13:32:00.569529+0000","last_became_peered":"2024-04-24T13:32:00.569529+0000","last_unstale":"2024-04-24T13:32:26.797290+0000","last_undegraded":"2024-04-24T13:32:26.797290+0000","last_fullsized":"2024-04-24T13:32:26.797290+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:14:47.372088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":150,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.805672+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:32:26.805672+0000","last_peered":"2024-04-24T13:32:26.805672+0000","last_clean":"2024-04-24T13:32:26.805672+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:32:26.805672+0000","last_undegraded":"2024-04-24T13:32:26.805672+0000","last_fullsized":"2024-04-24T13:32:26.805672+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"0'0","reported_seq":136,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797610+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:32:26.797610+0000","last_peered":"2024-04-24T13:32:26.797610+0000","last_clean":"2024-04-24T13:32:26.797610+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:32:26.797610+0000","last_undegraded":"2024-04-24T13:32:26.797610+0000","last_fullsized":"2024-04-24T13:32:26.797610+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":131,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798754+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:32:26.798754+0000","last_peered":"2024-04-24T13:32:26.798754+0000","last_clean":"2024-04-24T13:32:26.798754+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:32:26.798754+0000","last_undegraded":"2024-04-24T13:32:26.798754+0000","last_fullsized":"2024-04-24T13:32:26.798754+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"82'2","reported_seq":82,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799981+0000","last_change":"2024-04-24T13:32:00.588017+0000","last_active":"2024-04-24T13:32:26.799981+0000","last_peered":"2024-04-24T13:32:26.799981+0000","last_clean":"2024-04-24T13:32:26.799981+0000","last_became_active":"2024-04-24T13:32:00.587160+0000","last_became_peered":"2024-04-24T13:32:00.587160+0000","last_unstale":"2024-04-24T13:32:26.799981+0000","last_undegraded":"2024-04-24T13:32:26.799981+0000","last_fullsized":"2024-04-24T13:32:26.799981+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:43.467082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":12,"num_write_kb":4096,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"82'6","reported_seq":158,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.803876+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:32:26.803876+0000","last_peered":"2024-04-24T13:32:26.803876+0000","last_clean":"2024-04-24T13:32:26.803876+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:32:26.803876+0000","last_undegraded":"2024-04-24T13:32:26.803876+0000","last_fullsized":"2024-04-24T13:32:26.803876+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"82'1","reported_seq":142,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.400013+0000","last_change":"2024-04-24T13:30:50.920564+0000","last_active":"2024-04-24T13:32:26.400013+0000","last_peered":"2024-04-24T13:32:26.400013+0000","last_clean":"2024-04-24T13:32:26.400013+0000","last_became_active":"2024-04-24T13:30:50.920252+0000","last_became_peered":"2024-04-24T13:30:50.920252+0000","last_unstale":"2024-04-24T13:32:26.400013+0000","last_undegraded":"2024-04-24T13:32:26.400013+0000","last_fullsized":"2024-04-24T13:32:26.400013+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:29.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"82'2","reported_seq":109,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799139+0000","last_change":"2024-04-24T13:32:00.575324+0000","last_active":"2024-04-24T13:32:26.799139+0000","last_peered":"2024-04-24T13:32:26.799139+0000","last_clean":"2024-04-24T13:32:26.799139+0000","last_became_active":"2024-04-24T13:32:00.575008+0000","last_became_peered":"2024-04-24T13:32:00.575008+0000","last_unstale":"2024-04-24T13:32:26.799139+0000","last_undegraded":"2024-04-24T13:32:26.799139+0000","last_fullsized":"2024-04-24T13:32:26.799139+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:53:21.475332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801536+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:32:26.801536+0000","last_peered":"2024-04-24T13:32:26.801536+0000","last_clean":"2024-04-24T13:32:26.801536+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:32:26.801536+0000","last_undegraded":"2024-04-24T13:32:26.801536+0000","last_fullsized":"2024-04-24T13:32:26.801536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"82'4","reported_seq":149,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399460+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:32:26.399460+0000","last_peered":"2024-04-24T13:32:26.399460+0000","last_clean":"2024-04-24T13:32:26.399460+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:32:26.399460+0000","last_undegraded":"2024-04-24T13:32:26.399460+0000","last_fullsized":"2024-04-24T13:32:26.399460+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"81'1","reported_seq":98,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.798799+0000","last_change":"2024-04-24T13:30:50.936271+0000","last_active":"2024-04-24T13:32:26.798799+0000","last_peered":"2024-04-24T13:32:26.798799+0000","last_clean":"2024-04-24T13:32:26.798799+0000","last_became_active":"2024-04-24T13:30:50.935833+0000","last_became_peered":"2024-04-24T13:30:50.935833+0000","last_unstale":"2024-04-24T13:32:26.798799+0000","last_undegraded":"2024-04-24T13:32:26.798799+0000","last_fullsized":"2024-04-24T13:32:26.798799+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:04.149889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":2097152,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":2048,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"82'2","reported_seq":141,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.797452+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:32:26.797452+0000","last_peered":"2024-04-24T13:32:26.797452+0000","last_clean":"2024-04-24T13:32:26.797452+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:32:26.797452+0000","last_undegraded":"2024-04-24T13:32:26.797452+0000","last_fullsized":"2024-04-24T13:32:26.797452+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":135,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.799298+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:32:26.799298+0000","last_peered":"2024-04-24T13:32:26.799298+0000","last_clean":"2024-04-24T13:32:26.799298+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:32:26.799298+0000","last_undegraded":"2024-04-24T13:32:26.799298+0000","last_fullsized":"2024-04-24T13:32:26.799298+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":96,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.801384+0000","last_change":"2024-04-24T13:30:50.913925+0000","last_active":"2024-04-24T13:32:26.801384+0000","last_peered":"2024-04-24T13:32:26.801384+0000","last_clean":"2024-04-24T13:32:26.801384+0000","last_became_active":"2024-04-24T13:30:50.913630+0000","last_became_peered":"2024-04-24T13:30:50.913630+0000","last_unstale":"2024-04-24T13:32:26.801384+0000","last_undegraded":"2024-04-24T13:32:26.801384+0000","last_fullsized":"2024-04-24T13:32:26.801384+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:45.481646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"0'0","reported_seq":79,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.804661+0000","last_change":"2024-04-24T13:32:00.572908+0000","last_active":"2024-04-24T13:32:26.804661+0000","last_peered":"2024-04-24T13:32:26.804661+0000","last_clean":"2024-04-24T13:32:26.804661+0000","last_became_active":"2024-04-24T13:32:00.572224+0000","last_became_peered":"2024-04-24T13:32:00.572224+0000","last_unstale":"2024-04-24T13:32:26.804661+0000","last_undegraded":"2024-04-24T13:32:26.804661+0000","last_fullsized":"2024-04-24T13:32:26.804661+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:51:09.472596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":31,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.398399+0000","last_change":"2024-04-24T13:32:00.568431+0000","last_active":"2024-04-24T13:32:26.398399+0000","last_peered":"2024-04-24T13:32:26.398399+0000","last_clean":"2024-04-24T13:32:26.398399+0000","last_became_active":"2024-04-24T13:32:00.568125+0000","last_became_peered":"2024-04-24T13:32:00.568125+0000","last_unstale":"2024-04-24T13:32:26.398399+0000","last_undegraded":"2024-04-24T13:32:26.398399+0000","last_fullsized":"2024-04-24T13:32:26.398399+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:45:05.439832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"82'2","reported_seq":140,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.402673+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:32:26.402673+0000","last_peered":"2024-04-24T13:32:26.402673+0000","last_clean":"2024-04-24T13:32:26.402673+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:32:26.402673+0000","last_undegraded":"2024-04-24T13:32:26.402673+0000","last_fullsized":"2024-04-24T13:32:26.402673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"0'0","reported_seq":137,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.502536+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:32:26.502536+0000","last_peered":"2024-04-24T13:32:26.502536+0000","last_clean":"2024-04-24T13:32:26.502536+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:32:26.502536+0000","last_undegraded":"2024-04-24T13:32:26.502536+0000","last_fullsized":"2024-04-24T13:32:26.502536+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"82'6","reported_seq":56,"reported_epoch":85,"state":"active+clean","last_fresh":"2024-04-24T13:32:26.399901+0000","last_change":"2024-04-24T13:32:00.595386+0000","last_active":"2024-04-24T13:32:26.399901+0000","last_peered":"2024-04-24T13:32:26.399901+0000","last_clean":"2024-04-24T13:32:26.399901+0000","last_became_active":"2024-04-24T13:32:00.593423+0000","last_became_peered":"2024-04-24T13:32:00.593423+0000","last_unstale":"2024-04-24T13:32:26.399901+0000","last_undegraded":"2024-04-24T13:32:26.399901+0000","last_fullsized":"2024-04-24T13:32:26.399901+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:26.912115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1001,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":243,"num_read_kb":229,"num_write":208,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2002,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":85,"ondisk_log_size":85,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":715,"ondisk_log_size":715,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":21873,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":774,"num_read_kb":533,"num_write":427,"num_write_kb":44,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":2354,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":364544,"data_stored":13332,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":587,"ondisk_log_size":587,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":291,"num_read_kb":291,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1613,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":991,"num_read_kb":975,"num_write":211,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":203,"ondisk_log_size":203,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25165824,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":16,"num_read_kb":12,"num_write":56,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":50331648,"data_stored":50331648,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":16,"ondisk_log_size":16,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":55834574879,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574879,"num_pgs":84,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34828,"kb_used_data":3648,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337012,"statfs":{"total":96636764160,"available":96601100288,"internally_reserved":0,"allocated":3735552,"data_stored":3263874,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574880,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36284,"kb_used_data":5104,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94335556,"statfs":{"total":96636764160,"available":96599609344,"internally_reserved":0,"allocated":5226496,"data_stored":4770626,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574880,"num_pgs":88,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":42448,"kb_used_data":11268,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94329392,"statfs":{"total":96636764160,"available":96593297408,"internally_reserved":0,"allocated":11538432,"data_stored":11062968,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574879,"num_pgs":97,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":38384,"kb_used_data":7204,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94333456,"statfs":{"total":96636764160,"available":96597458944,"internally_reserved":0,"allocated":7376896,"data_stored":6863822,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574880,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":34264,"kb_used_data":3084,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94337576,"statfs":{"total":96636764160,"available":96601677824,"internally_reserved":0,"allocated":3158016,"data_stored":2674250,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574881,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44520,"kb_used_data":13340,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94327320,"statfs":{"total":96636764160,"available":96591175680,"internally_reserved":0,"allocated":13660160,"data_stored":13162104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574880,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":45076,"kb_used_data":13896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94326764,"statfs":{"total":96636764160,"available":96590606336,"internally_reserved":0,"allocated":14229504,"data_stored":13751268,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12582912,"data_stored":12582912,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":6291456,"data_stored":6291456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":10485760,"data_stored":10485760,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4194304,"data_stored":4194304,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":2097152,"data_stored":2097152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":77824,"data_stored":3921,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":1326,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":595,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":406,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:32:30.706 INFO:tasks.thrashosds.thrasher:Setting 4.1a to [6, 2] 2024-04-24T13:32:30.706 INFO:tasks.thrashosds.thrasher:cmd ['osd', 'pg-upmap', '4.1a', '6', '2'] 2024-04-24T13:32:30.706 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pg-upmap 4.1a 6 2 2024-04-24T13:32:30.707 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:30.692+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:30.733 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:30.733 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:30.759 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:32:30.795 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:30.793+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:30.896 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:30.892+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:30.938 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:30.938 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:30.958 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:32:30.997 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:30.993+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:31.098 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:31.092+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:31.103 INFO:tasks.workunit.client.0.smithi071.stdout:adding file to bucket: 1Gb. 2024-04-24T13:32:31.104 INFO:tasks.workunit.client.0.smithi071.stdout:upload file successful 2024-04-24T13:32:31.104 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:31.104 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - set max size and ensure that the max size is in effect 2024-04-24T13:32:31.104 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:31.119 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:31.119 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:31.132 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:32:31.218 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:31.215+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:31.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:32:31.298 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:31.298 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:31.299 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:31.297+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:31.313 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:32:31.346 INFO:tasks.workunit.client.0.smithi071.stdout:user qa_user deleted 2024-04-24T13:32:31.346 INFO:tasks.workunit.client.0.smithi071.stdout:bucket delete succeeded 2024-04-24T13:32:31.372 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:31.372 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:31.388 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:31.389 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:31.400 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:31.397+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:31.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:31.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:31.421 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:31.422 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:31.429 INFO:teuthology.orchestra.run.smithi071.stderr:set 4.1a pg_upmap mapping to [6,2] 2024-04-24T13:32:31.431 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:31.431 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:31.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:31.432 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:31.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.432 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2206 3.f 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:31.432 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:32:31.432 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.1397587319999998, 2024-04-24T13:32:31.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028291495999999999, 2024-04-24T13:32:31.432 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.432 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.432 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.432 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:31.432 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:31.432 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:31.433 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2206 2024-04-24T13:32:31.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.433 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:32:31.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:32:31.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290398+0000", 2024-04-24T13:32:31.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000001e-06 2024-04-24T13:32:31.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294671+0000", 2024-04-24T13:32:31.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042724390000000003 2024-04-24T13:32:31.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294711+0000", 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0376000000000001e-05 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294730+0000", 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8607e-05 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294856+0000", 2024-04-24T13:32:31.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126651 2024-04-24T13:32:31.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295125+0000", 2024-04-24T13:32:31.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026840700000000002 2024-04-24T13:32:31.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:31.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295349+0000", 2024-04-24T13:32:31.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022454699999999999 2024-04-24T13:32:31.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307240+0000", 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011891048 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318593+0000", 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011352777999999999 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318652+0000", 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8677000000000001e-05 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318686+0000", 2024-04-24T13:32:31.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4616000000000002e-05 2024-04-24T13:32:31.438 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.438 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.438 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.438 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2209 3.14 3:287cf44b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:31.438 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:32:31.438 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.0944545720000001, 2024-04-24T13:32:31.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020682494999999999, 2024-04-24T13:32:31.438 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2209 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335702+0000", 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339081+0000", 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003378664 2024-04-24T13:32:31.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339119+0000", 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8355999999999997e-05 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339138+0000", 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8546000000000002e-05 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339268+0000", 2024-04-24T13:32:31.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013028599999999999 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339503+0000", 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023542699999999999 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339734+0000", 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023122 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:31.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.348300+0000", 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085659870000000006 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356108+0000", 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078075109999999996 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356259+0000", 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015104800000000001 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356381+0000", 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012243599999999999 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2216 3.3d e85/20 3:bf22edaf:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_11:head v 85'3, mlcod=81'1)", 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.463347+0000", 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.9668061109999999, 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012453086, 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.444 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463347+0000", 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463347+0000", 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463350+0000", 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4559999999999999e-06 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.465279+0000", 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019287180000000001 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.465303+0000", 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4553999999999999e-05 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.465314+0000", 2024-04-24T13:32:31.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1270999999999999e-05 2024-04-24T13:32:31.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.465393+0000", 2024-04-24T13:32:31.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8990000000000001e-05 2024-04-24T13:32:31.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.465415+0000", 2024-04-24T13:32:31.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2056999999999999e-05 2024-04-24T13:32:31.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475718+0000", 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010302486 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475800+0000", 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2553999999999996e-05 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2219 3.0 e85/20 3:00e6fe99:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_14:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.496088+0000", 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.9340654769999999, 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010775678, 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496088+0000", 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496088+0000", 2024-04-24T13:32:31.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496089+0000", 2024-04-24T13:32:31.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6199999999999998e-07 2024-04-24T13:32:31.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.498067+0000", 2024-04-24T13:32:31.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019785520000000002 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.498090+0000", 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2625000000000001e-05 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.498106+0000", 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6540000000000001e-05 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.498190+0000", 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3469999999999999e-05 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.498221+0000", 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0848e-05 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.506797+0000", 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085763820000000004 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.506864+0000", 2024-04-24T13:32:31.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6798999999999995e-05 2024-04-24T13:32:31.453 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.453 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.453 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.453 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2222 3.13 e85/41 3:c9a14088:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_17:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:31.453 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.530040+0000", 2024-04-24T13:32:31.453 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.900113744, 2024-04-24T13:32:31.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011986185, 2024-04-24T13:32:31.454 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.454 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.454 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.454 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.530040+0000", 2024-04-24T13:32:31.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.530040+0000", 2024-04-24T13:32:31.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.530040+0000", 2024-04-24T13:32:31.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.34e-07 2024-04-24T13:32:31.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.534952+0000", 2024-04-24T13:32:31.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049116300000000002 2024-04-24T13:32:31.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.534988+0000", 2024-04-24T13:32:31.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6022000000000002e-05 2024-04-24T13:32:31.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.535019+0000", 2024-04-24T13:32:31.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0956e-05 2024-04-24T13:32:31.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.535129+0000", 2024-04-24T13:32:31.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000110005 2024-04-24T13:32:31.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.535160+0000", 2024-04-24T13:32:31.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1486999999999999e-05 2024-04-24T13:32:31.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.541968+0000", 2024-04-24T13:32:31.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068080390000000001 2024-04-24T13:32:31.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.542026+0000", 2024-04-24T13:32:31.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7711999999999999e-05 2024-04-24T13:32:31.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.458 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.458 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.459 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2227 3.14 3:28702767:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:31.459 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:32:31.459 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.8531559399999997, 2024-04-24T13:32:31.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017797177000000001, 2024-04-24T13:32:31.459 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.459 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.459 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:31.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:31.459 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:31.460 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2227 2024-04-24T13:32:31.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.460 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:32:31.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:32:31.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.577000+0000", 2024-04-24T13:32:31.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8760000000000001e-06 2024-04-24T13:32:31.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579496+0000", 2024-04-24T13:32:31.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024951740000000002 2024-04-24T13:32:31.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579521+0000", 2024-04-24T13:32:31.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5361e-05 2024-04-24T13:32:31.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579533+0000", 2024-04-24T13:32:31.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2377e-05 2024-04-24T13:32:31.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579602+0000", 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8325999999999996e-05 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579799+0000", 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019773800000000001 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579997+0000", 2024-04-24T13:32:31.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019725299999999999 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.586752+0000", 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006755179 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594712+0000", 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079597049999999992 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594757+0000", 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4956000000000001e-05 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594795+0000", 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8232000000000003e-05 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2232 3.a e85/48 3:53fed644:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_27:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.635793+0000", 2024-04-24T13:32:31.465 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.7943606889999999, 2024-04-24T13:32:31.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012455239999999999, 2024-04-24T13:32:31.466 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.466 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.466 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.466 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.635793+0000", 2024-04-24T13:32:31.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.635793+0000", 2024-04-24T13:32:31.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.635795+0000", 2024-04-24T13:32:31.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8250000000000001e-06 2024-04-24T13:32:31.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.640418+0000", 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004623828 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.640442+0000", 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3331000000000001e-05 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.640456+0000", 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3913999999999999e-05 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.640523+0000", 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7199000000000005e-05 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.640542+0000", 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9103999999999999e-05 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.648202+0000", 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076597109999999996 2024-04-24T13:32:31.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.648248+0000", 2024-04-24T13:32:31.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6328000000000001e-05 2024-04-24T13:32:31.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.470 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.470 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.470 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2240 3.3f e85/48 3:fe4f476b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_35:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:31.470 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.724324+0000", 2024-04-24T13:32:31.471 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.7058297749999998, 2024-04-24T13:32:31.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097820029999999992, 2024-04-24T13:32:31.471 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.471 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.471 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.471 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.724324+0000", 2024-04-24T13:32:31.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.724324+0000", 2024-04-24T13:32:31.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.724326+0000", 2024-04-24T13:32:31.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1110000000000002e-06 2024-04-24T13:32:31.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.728225+0000", 2024-04-24T13:32:31.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038988270000000001 2024-04-24T13:32:31.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.728251+0000", 2024-04-24T13:32:31.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6355000000000001e-05 2024-04-24T13:32:31.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.728262+0000", 2024-04-24T13:32:31.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1214e-05 2024-04-24T13:32:31.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.728331+0000", 2024-04-24T13:32:31.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8533000000000003e-05 2024-04-24T13:32:31.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.728349+0000", 2024-04-24T13:32:31.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8661999999999999e-05 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.734041+0000", 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056910559999999999 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.734106+0000", 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5245000000000003e-05 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2243 3.f 3:f2fed5ba:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.750526+0000", 2024-04-24T13:32:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.6796270240000002, 2024-04-24T13:32:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011938422000000001, 2024-04-24T13:32:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2243 2024-04-24T13:32:31.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.750526+0000", 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.750526+0000", 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.750529+0000", 2024-04-24T13:32:31.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9529999999999999e-06 2024-04-24T13:32:31.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.751981+0000", 2024-04-24T13:32:31.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014517449999999999 2024-04-24T13:32:31.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752014+0000", 2024-04-24T13:32:31.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2638999999999997e-05 2024-04-24T13:32:31.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752028+0000", 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4389000000000001e-05 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752112+0000", 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4047000000000004e-05 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752278+0000", 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016591800000000001 2024-04-24T13:32:31.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752439+0000", 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016045100000000001 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.761891+0000", 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094519819999999994 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762371+0000", 2024-04-24T13:32:31.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00048079900000000002 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762413+0000", 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1665999999999997e-05 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762465+0000", 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1833000000000003e-05 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2244 3.3b 3:ddfbb493:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:32:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.6647570900000002, 2024-04-24T13:32:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020329852999999998, 2024-04-24T13:32:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2244 2024-04-24T13:32:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.482 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765398+0000", 2024-04-24T13:32:31.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.291e-06 2024-04-24T13:32:31.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766959+0000", 2024-04-24T13:32:31.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015617680000000001 2024-04-24T13:32:31.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766985+0000", 2024-04-24T13:32:31.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5899999999999999e-05 2024-04-24T13:32:31.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766996+0000", 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0642000000000001e-05 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767076+0000", 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9542999999999994e-05 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767184+0000", 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107964 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:31.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767269+0000", 2024-04-24T13:32:31.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5798999999999996e-05 2024-04-24T13:32:31.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:31.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.772877+0000", 2024-04-24T13:32:31.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056080560000000002 2024-04-24T13:32:31.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:31.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785554+0000", 2024-04-24T13:32:31.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012676642 2024-04-24T13:32:31.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785639+0000", 2024-04-24T13:32:31.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4938999999999994e-05 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785726+0000", 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7309e-05 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2246 3.9 e85/20 3:92c5067a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_41:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.790209+0000", 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.639944479, 2024-04-24T13:32:31.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011202132, 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.790209+0000", 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.790209+0000", 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.790211+0000", 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8029999999999999e-06 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.795877+0000", 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005666623 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.795915+0000", 2024-04-24T13:32:31.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7228000000000003e-05 2024-04-24T13:32:31.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.795933+0000", 2024-04-24T13:32:31.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7901e-05 2024-04-24T13:32:31.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.796023+0000", 2024-04-24T13:32:31.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0414999999999994e-05 2024-04-24T13:32:31.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.796055+0000", 2024-04-24T13:32:31.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1894999999999999e-05 2024-04-24T13:32:31.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.801357+0000", 2024-04-24T13:32:31.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005301638 2024-04-24T13:32:31.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.801411+0000", 2024-04-24T13:32:31.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4629000000000002e-05 2024-04-24T13:32:31.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.496 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.496 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2249 3.1f e85/74 3:fad54725:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_44:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:31.496 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.817268+0000", 2024-04-24T13:32:31.496 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.61288564, 2024-04-24T13:32:31.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010843930999999999, 2024-04-24T13:32:31.497 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.497 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.497 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.497 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.817268+0000", 2024-04-24T13:32:31.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.817268+0000", 2024-04-24T13:32:31.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.817270+0000", 2024-04-24T13:32:31.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9420000000000002e-06 2024-04-24T13:32:31.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.818701+0000", 2024-04-24T13:32:31.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001430721 2024-04-24T13:32:31.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.818729+0000", 2024-04-24T13:32:31.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8564999999999998e-05 2024-04-24T13:32:31.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.818745+0000", 2024-04-24T13:32:31.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6273000000000002e-05 2024-04-24T13:32:31.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.818827+0000", 2024-04-24T13:32:31.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1415999999999994e-05 2024-04-24T13:32:31.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.818853+0000", 2024-04-24T13:32:31.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6282e-05 2024-04-24T13:32:31.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828031+0000", 2024-04-24T13:32:31.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0091783109999999998 2024-04-24T13:32:31.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828112+0000", 2024-04-24T13:32:31.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0420999999999995e-05 2024-04-24T13:32:31.501 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.501 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.502 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2252 3.4 e85/20 3:22834b58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_47:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:31.502 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.848393+0000", 2024-04-24T13:32:31.502 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.5817606930000001, 2024-04-24T13:32:31.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016435595000000001, 2024-04-24T13:32:31.502 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.502 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.503 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.503 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848393+0000", 2024-04-24T13:32:31.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848393+0000", 2024-04-24T13:32:31.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848395+0000", 2024-04-24T13:32:31.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0109999999999999e-06 2024-04-24T13:32:31.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.851124+0000", 2024-04-24T13:32:31.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002728837 2024-04-24T13:32:31.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.851151+0000", 2024-04-24T13:32:31.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7353999999999999e-05 2024-04-24T13:32:31.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.851167+0000", 2024-04-24T13:32:31.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6036e-05 2024-04-24T13:32:31.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.851263+0000", 2024-04-24T13:32:31.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5767000000000007e-05 2024-04-24T13:32:31.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.851292+0000", 2024-04-24T13:32:31.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8809000000000001e-05 2024-04-24T13:32:31.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.864767+0000", 2024-04-24T13:32:31.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01347548 2024-04-24T13:32:31.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.864828+0000", 2024-04-24T13:32:31.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1301000000000001e-05 2024-04-24T13:32:31.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.507 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.507 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2256 3.21 3:878222a6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:31.508 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.890313+0000", 2024-04-24T13:32:31.508 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.5398403690000002, 2024-04-24T13:32:31.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016559444999999999, 2024-04-24T13:32:31.508 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.508 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.508 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:31.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:31.508 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:31.508 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2256 2024-04-24T13:32:31.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.508 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.890313+0000", 2024-04-24T13:32:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.890313+0000", 2024-04-24T13:32:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.890316+0000", 2024-04-24T13:32:31.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5359999999999999e-06 2024-04-24T13:32:31.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.892396+0000", 2024-04-24T13:32:31.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020804600000000001 2024-04-24T13:32:31.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.892421+0000", 2024-04-24T13:32:31.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.442e-05 2024-04-24T13:32:31.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.892433+0000", 2024-04-24T13:32:31.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2838e-05 2024-04-24T13:32:31.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.892527+0000", 2024-04-24T13:32:31.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3431999999999996e-05 2024-04-24T13:32:31.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.892665+0000", 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000138407 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.892830+0000", 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016460499999999999 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.899416+0000", 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065858740000000002 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.906702+0000", 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072860010000000003 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.906796+0000", 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4236999999999999e-05 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.906873+0000", 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6635000000000001e-05 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.513 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.514 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.514 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2261 3.21 3:86ed920e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_56:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:31.514 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.950664+0000", 2024-04-24T13:32:31.514 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.4794898120000002, 2024-04-24T13:32:31.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011474541, 2024-04-24T13:32:31.514 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.514 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.514 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.514 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:31.514 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:31.514 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2261 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.950664+0000", 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.950664+0000", 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.950666+0000", 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.694e-06 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.951705+0000", 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010380980000000001 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.951727+0000", 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989e-05 2024-04-24T13:32:31.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.951739+0000", 2024-04-24T13:32:31.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1698999999999999e-05 2024-04-24T13:32:31.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.951844+0000", 2024-04-24T13:32:31.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010447500000000001 2024-04-24T13:32:31.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.952089+0000", 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024557700000000002 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.952304+0000", 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021457799999999999 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.956867+0000", 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045633130000000003 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.961994+0000", 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051270250000000003 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.962073+0000", 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8620000000000003e-05 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.962138+0000", 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5473000000000001e-05 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.519 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2265 3.14 3:2a53907b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.4347186230000002, 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016926096000000002, 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:31.520 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2265 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995438+0000", 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1080000000000001e-06 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997447+0000", 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002008625 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997484+0000", 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7070999999999998e-05 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997508+0000", 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4324999999999998e-05 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997617+0000", 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010898799999999999 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997787+0000", 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000169956 2024-04-24T13:32:31.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:31.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997949+0000", 2024-04-24T13:32:31.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016190599999999999 2024-04-24T13:32:31.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:31.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.005098+0000", 2024-04-24T13:32:31.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071488300000000001 2024-04-24T13:32:31.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:31.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012231+0000", 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071334040000000003 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012305+0000", 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4017000000000006e-05 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012361+0000", 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.525 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.526 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2266 3.14 3:280bbce2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_61:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:31.526 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:29.005383+0000", 2024-04-24T13:32:31.526 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.4247702860000002, 2024-04-24T13:32:31.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012070492, 2024-04-24T13:32:31.526 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.526 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.526 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.526 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:31.526 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:31.526 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2266 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.005383+0000", 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.005383+0000", 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.005386+0000", 2024-04-24T13:32:31.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5959999999999998e-06 2024-04-24T13:32:31.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.007616+0000", 2024-04-24T13:32:31.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002230447 2024-04-24T13:32:31.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.007641+0000", 2024-04-24T13:32:31.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5134e-05 2024-04-24T13:32:31.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.007655+0000", 2024-04-24T13:32:31.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3988000000000001e-05 2024-04-24T13:32:31.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.007744+0000", 2024-04-24T13:32:31.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8356000000000006e-05 2024-04-24T13:32:31.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.007878+0000", 2024-04-24T13:32:31.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013433 2024-04-24T13:32:31.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:31.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.008048+0000", 2024-04-24T13:32:31.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016961600000000001 2024-04-24T13:32:31.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:31.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.013763+0000", 2024-04-24T13:32:31.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057152430000000001 2024-04-24T13:32:31.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:31.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.017346+0000", 2024-04-24T13:32:31.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0035827630000000001 2024-04-24T13:32:31.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.017396+0000", 2024-04-24T13:32:31.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0413e-05 2024-04-24T13:32:31.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.017454+0000", 2024-04-24T13:32:31.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7605999999999997e-05 2024-04-24T13:32:31.532 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.532 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.532 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.533 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2267 3.3f e85/48 3:fe72662d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_62:head v 85'3, mlcod=85'1)", 2024-04-24T13:32:31.533 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:29.020079+0000", 2024-04-24T13:32:31.533 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.4100748689999998, 2024-04-24T13:32:31.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013828396999999999, 2024-04-24T13:32:31.533 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.533 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.533 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.533 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.020079+0000", 2024-04-24T13:32:31.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.020079+0000", 2024-04-24T13:32:31.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.020080+0000", 2024-04-24T13:32:31.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.212e-06 2024-04-24T13:32:31.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.023988+0000", 2024-04-24T13:32:31.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039080210000000002 2024-04-24T13:32:31.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.024016+0000", 2024-04-24T13:32:31.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8174000000000002e-05 2024-04-24T13:32:31.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.024029+0000", 2024-04-24T13:32:31.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3324e-05 2024-04-24T13:32:31.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.024124+0000", 2024-04-24T13:32:31.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4557999999999998e-05 2024-04-24T13:32:31.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.024155+0000", 2024-04-24T13:32:31.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1189999999999998e-05 2024-04-24T13:32:31.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.033862+0000", 2024-04-24T13:32:31.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097071510000000007 2024-04-24T13:32:31.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.033907+0000", 2024-04-24T13:32:31.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4767e-05 2024-04-24T13:32:31.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.538 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.538 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2270 3.a e85/48 3:52207169:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_65:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:29.051986+0000", 2024-04-24T13:32:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.3781680029999999, 2024-04-24T13:32:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093598880000000002, 2024-04-24T13:32:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.051986+0000", 2024-04-24T13:32:31.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.051986+0000", 2024-04-24T13:32:31.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.051987+0000", 2024-04-24T13:32:31.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7090000000000001e-06 2024-04-24T13:32:31.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.055905+0000", 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039174400000000003 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.055924+0000", 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9647e-05 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.055935+0000", 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0229e-05 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.056009+0000", 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4635000000000006e-05 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.056038+0000", 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8719000000000001e-05 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.061276+0000", 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052383910000000002 2024-04-24T13:32:31.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.061345+0000", 2024-04-24T13:32:31.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9117999999999998e-05 2024-04-24T13:32:31.543 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.543 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.543 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.543 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2271 3.13 e85/41 3:cb7d029e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_66:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:31.543 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:29.061414+0000", 2024-04-24T13:32:31.543 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.368739476, 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014349028, 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.061414+0000", 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.061414+0000", 2024-04-24T13:32:31.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:31.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:31.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.061416+0000", 2024-04-24T13:32:31.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7579999999999999e-06 2024-04-24T13:32:31.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:31.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.065419+0000", 2024-04-24T13:32:31.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040029590000000004 2024-04-24T13:32:31.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.065447+0000", 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8364000000000002e-05 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.065462+0000", 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5305e-05 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.065550+0000", 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7453000000000004e-05 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.065578+0000", 2024-04-24T13:32:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7922000000000001e-05 2024-04-24T13:32:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.075697+0000", 2024-04-24T13:32:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010119214 2024-04-24T13:32:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.075763+0000", 2024-04-24T13:32:31.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6052999999999999e-05 2024-04-24T13:32:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:31.548 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:31.548 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:31.548 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:32:31.549 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:31.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:31.551 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:31.552 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:31.552 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:31.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:31.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:31.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:31.554 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:31.555 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:31.543+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:31.650 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:31.647+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:31.708 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:31.708 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:31.708 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:31.728 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:31.770 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:31.767+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:31.852 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:31.849+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:31.882 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:31.882 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:31.883 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:31.883 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:31.883 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:31.902 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:31.953 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:31.949+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:32.016 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:32.016 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:32.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:32.017 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:32.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.017 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:32.017 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:32.017 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 119.739366159, 2024-04-24T13:32:32.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:32:32.017 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.017 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.017 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.018 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:32:32.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.018 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:32.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:32:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:32:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:32:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:32:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:32:32.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:32:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:32:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:32:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:32:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:32:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:32:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:32:32.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:32:32.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:32.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:32:32.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:32:32.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:32:32.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:32:32.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:32:32.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:32:32.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:32:32.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:32:32.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:32:32.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:32:32.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.024 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.024 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2207 3.38 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.024 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:32:32.024 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.7127873810000001, 2024-04-24T13:32:32.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022686873999999999, 2024-04-24T13:32:32.024 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2207 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:32:32.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302499+0000", 2024-04-24T13:32:32.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-04-24T13:32:32.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307861+0000", 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053622089999999997 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307899+0000", 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978999999999997e-05 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307917+0000", 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8576999999999998e-05 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308018+0000", 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010080499999999999 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308202+0000", 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000183628 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308352+0000", 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149806 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318520+0000", 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010168744 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.324908+0000", 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063874739999999998 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325063+0000", 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155131 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325182+0000", 2024-04-24T13:32:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011915499999999999 2024-04-24T13:32:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:32:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.689192668, 2024-04-24T13:32:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:32:32.030 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.031 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.031 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.031 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:32:32.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.031 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:32:32.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:32:32.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:32:32.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:32:32.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:32:32.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:32:32.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:32:32.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:32:32.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:32:32.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:32:32.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:32:32.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:32:32.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.036 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.036 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2210 3.23 e85/20 3:c462163d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_5:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.359362+0000", 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6559202750000002, 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014461236000000001, 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.359362+0000", 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.359362+0000", 2024-04-24T13:32:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.359365+0000", 2024-04-24T13:32:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6000000000000001e-06 2024-04-24T13:32:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362822+0000", 2024-04-24T13:32:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034571200000000002 2024-04-24T13:32:32.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362857+0000", 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4968000000000001e-05 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362875+0000", 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7507999999999999e-05 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362965+0000", 2024-04-24T13:32:32.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0742000000000006e-05 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362992+0000", 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7158e-05 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.373695+0000", 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010702211999999999 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.373824+0000", 2024-04-24T13:32:32.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128928 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2211 3.8 3:123ae70b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.379448+0000", 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6358344630000001, 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013985645, 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.041 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2211 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.379448+0000", 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.379448+0000", 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.379452+0000", 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3759999999999999e-06 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.381975+0000", 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002523885 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382016+0000", 2024-04-24T13:32:32.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0865999999999998e-05 2024-04-24T13:32:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382042+0000", 2024-04-24T13:32:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5999e-05 2024-04-24T13:32:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382160+0000", 2024-04-24T13:32:32.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117806 2024-04-24T13:32:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382338+0000", 2024-04-24T13:32:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000177543 2024-04-24T13:32:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382494+0000", 2024-04-24T13:32:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015645500000000001 2024-04-24T13:32:32.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.390114+0000", 2024-04-24T13:32:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076203099999999999 2024-04-24T13:32:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.393358+0000", 2024-04-24T13:32:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032431669999999999 2024-04-24T13:32:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.393402+0000", 2024-04-24T13:32:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4072000000000001e-05 2024-04-24T13:32:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.393434+0000", 2024-04-24T13:32:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2165999999999997e-05 2024-04-24T13:32:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2215 3.23 e85/20 3:c703bbd7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_10:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.454450+0000", 2024-04-24T13:32:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.5608324229999999, 2024-04-24T13:32:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012738266999999999, 2024-04-24T13:32:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.454450+0000", 2024-04-24T13:32:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.454450+0000", 2024-04-24T13:32:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.454452+0000", 2024-04-24T13:32:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.474e-06 2024-04-24T13:32:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455575+0000", 2024-04-24T13:32:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011236519999999999 2024-04-24T13:32:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455609+0000", 2024-04-24T13:32:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3448999999999998e-05 2024-04-24T13:32:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455626+0000", 2024-04-24T13:32:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7274000000000001e-05 2024-04-24T13:32:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455746+0000", 2024-04-24T13:32:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012016299999999999 2024-04-24T13:32:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455784+0000", 2024-04-24T13:32:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8055000000000001e-05 2024-04-24T13:32:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467080+0000", 2024-04-24T13:32:32.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011295846999999999 2024-04-24T13:32:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467188+0000", 2024-04-24T13:32:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108353 2024-04-24T13:32:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:32:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.5441368139999998, 2024-04-24T13:32:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:32:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.054 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:32:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:32:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:32:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:32:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:32:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:32:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:32:32.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:32:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:32:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:32:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:32:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:32:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:32:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:32:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:32:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:32:32.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:32:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:32:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:32:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:32:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:32:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:32:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:32:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:32:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:32:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.060 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2218 3.c 3:338c3e0b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.481902+0000", 2024-04-24T13:32:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.5333808069999999, 2024-04-24T13:32:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013669654, 2024-04-24T13:32:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2218 2024-04-24T13:32:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.481902+0000", 2024-04-24T13:32:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.481902+0000", 2024-04-24T13:32:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.481905+0000", 2024-04-24T13:32:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7590000000000002e-06 2024-04-24T13:32:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483709+0000", 2024-04-24T13:32:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001804915 2024-04-24T13:32:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483731+0000", 2024-04-24T13:32:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:32:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483742+0000", 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0905e-05 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483804+0000", 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1407000000000003e-05 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483931+0000", 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127522 2024-04-24T13:32:32.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.484035+0000", 2024-04-24T13:32:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103825 2024-04-24T13:32:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.490036+0000", 2024-04-24T13:32:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060011739999999997 2024-04-24T13:32:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.495470+0000", 2024-04-24T13:32:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054342319999999998 2024-04-24T13:32:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.495523+0000", 2024-04-24T13:32:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2726999999999998e-05 2024-04-24T13:32:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.495571+0000", 2024-04-24T13:32:32.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8461999999999998e-05 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2233 3.c 3:3257d695:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.641529+0000", 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.3737534600000001, 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018052898000000001, 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2233 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.641529+0000", 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.641529+0000", 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.641532+0000", 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.078e-06 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643295+0000", 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017631700000000001 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643325+0000", 2024-04-24T13:32:32.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9848e-05 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643340+0000", 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4588e-05 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643439+0000", 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8801000000000005e-05 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643659+0000", 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022074099999999999 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643804+0000", 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014435000000000001 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.652553+0000", 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0087494340000000004 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.659491+0000", 2024-04-24T13:32:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069377010000000001 2024-04-24T13:32:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.659531+0000", 2024-04-24T13:32:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0590000000000003e-05 2024-04-24T13:32:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.659582+0000", 2024-04-24T13:32:32.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0596999999999997e-05 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2242 3.b 3:d16b554f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.2756378819999998, 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022940439, 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2242 2024-04-24T13:32:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:32:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:32:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739648+0000", 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.785e-06 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741765+0000", 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002117655 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741781+0000", 2024-04-24T13:32:32.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6062e-05 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741792+0000", 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0937999999999999e-05 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741918+0000", 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623199999999999 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742189+0000", 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027047300000000002 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742430+0000", 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024077699999999999 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752990+0000", 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010559875 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762422+0000", 2024-04-24T13:32:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094325120000000005 2024-04-24T13:32:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762510+0000", 2024-04-24T13:32:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7879000000000003e-05 2024-04-24T13:32:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762585+0000", 2024-04-24T13:32:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5251000000000002e-05 2024-04-24T13:32:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2247 3.2a e85/74 3:56a679bb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_42:head v 85'3, mlcod=81'1)", 2024-04-24T13:32:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.801034+0000", 2024-04-24T13:32:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.2142489890000001, 2024-04-24T13:32:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012987485999999999, 2024-04-24T13:32:32.079 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.801034+0000", 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.801034+0000", 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.801035+0000", 2024-04-24T13:32:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.22e-06 2024-04-24T13:32:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.805927+0000", 2024-04-24T13:32:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048917659999999996 2024-04-24T13:32:32.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.805951+0000", 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4017999999999999e-05 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.805963+0000", 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2217e-05 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.806061+0000", 2024-04-24T13:32:32.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7807999999999996e-05 2024-04-24T13:32:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.806096+0000", 2024-04-24T13:32:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4848000000000002e-05 2024-04-24T13:32:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.813950+0000", 2024-04-24T13:32:32.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078541010000000005 2024-04-24T13:32:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.814021+0000", 2024-04-24T13:32:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1507999999999994e-05 2024-04-24T13:32:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2250 3.3c e85/20 3:3d3fcdd2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_45:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:32.084 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.829385+0000", 2024-04-24T13:32:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.1858975850000002, 2024-04-24T13:32:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013561493000000001, 2024-04-24T13:32:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.829385+0000", 2024-04-24T13:32:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.829385+0000", 2024-04-24T13:32:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.829386+0000", 2024-04-24T13:32:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.33e-06 2024-04-24T13:32:32.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837727+0000", 2024-04-24T13:32:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083405879999999995 2024-04-24T13:32:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837760+0000", 2024-04-24T13:32:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2892999999999998e-05 2024-04-24T13:32:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837776+0000", 2024-04-24T13:32:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6064000000000001e-05 2024-04-24T13:32:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837888+0000", 2024-04-24T13:32:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011175699999999999 2024-04-24T13:32:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837910+0000", 2024-04-24T13:32:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1967000000000002e-05 2024-04-24T13:32:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.842872+0000", 2024-04-24T13:32:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004962246 2024-04-24T13:32:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.842947+0000", 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4647999999999994e-05 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2253 3.27 3:e6835017:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.857410+0000", 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.1578724079999998, 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015395834000000001, 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.090 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2253 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.857410+0000", 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.857410+0000", 2024-04-24T13:32:32.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.857413+0000", 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.236e-06 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859353+0000", 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001939947 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859384+0000", 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1106999999999999e-05 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859401+0000", 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6871000000000002e-05 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859494+0000", 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2901999999999999e-05 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859619+0000", 2024-04-24T13:32:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000124924 2024-04-24T13:32:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859762+0000", 2024-04-24T13:32:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014235800000000001 2024-04-24T13:32:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865768+0000", 2024-04-24T13:32:32.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060064699999999999 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.872676+0000", 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069080460000000002 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.872734+0000", 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7442000000000003e-05 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.872806+0000", 2024-04-24T13:32:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2531000000000001e-05 2024-04-24T13:32:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2255 3.29 3:979257ba:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.878934+0000", 2024-04-24T13:32:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.1363487760000002, 2024-04-24T13:32:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015146641000000001, 2024-04-24T13:32:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.096 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2255 2024-04-24T13:32:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.878934+0000", 2024-04-24T13:32:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.878934+0000", 2024-04-24T13:32:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.878937+0000", 2024-04-24T13:32:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2270000000000002e-06 2024-04-24T13:32:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881027+0000", 2024-04-24T13:32:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020899550000000001 2024-04-24T13:32:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881053+0000", 2024-04-24T13:32:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6139000000000002e-05 2024-04-24T13:32:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881065+0000", 2024-04-24T13:32:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2067e-05 2024-04-24T13:32:32.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881158+0000", 2024-04-24T13:32:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2571000000000005e-05 2024-04-24T13:32:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881323+0000", 2024-04-24T13:32:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016472000000000001 2024-04-24T13:32:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:32.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881452+0000", 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012935600000000001 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.888419+0000", 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069672290000000001 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.893923+0000", 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055036449999999997 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.894016+0000", 2024-04-24T13:32:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3734999999999996e-05 2024-04-24T13:32:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.894080+0000", 2024-04-24T13:32:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3997000000000004e-05 2024-04-24T13:32:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.102 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2258 3.1e 3:788e6d31:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.912760+0000", 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.102522563, 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014178759000000001, 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2258 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.912760+0000", 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.912760+0000", 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.912762+0000", 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.295e-06 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914664+0000", 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001901701 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914688+0000", 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3983000000000001e-05 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914701+0000", 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2914999999999999e-05 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914793+0000", 2024-04-24T13:32:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1995000000000003e-05 2024-04-24T13:32:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914963+0000", 2024-04-24T13:32:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000169994 2024-04-24T13:32:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.915095+0000", 2024-04-24T13:32:32.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000132531 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.920249+0000", 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00515351 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.926800+0000", 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006551037 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.926875+0000", 2024-04-24T13:32:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4894000000000005e-05 2024-04-24T13:32:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.926939+0000", 2024-04-24T13:32:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3904000000000003e-05 2024-04-24T13:32:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2259 3.2 3:43ddbe9c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.925834+0000", 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.089448682, 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013273327999999999, 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2259 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.925834+0000", 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.925834+0000", 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.925837+0000", 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7379999999999999e-06 2024-04-24T13:32:32.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927658+0000", 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001821278 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927689+0000", 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1544000000000002e-05 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927702+0000", 2024-04-24T13:32:32.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2532e-05 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927788+0000", 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6156999999999995e-05 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927979+0000", 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019079700000000001 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:32.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.928152+0000", 2024-04-24T13:32:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017276800000000001 2024-04-24T13:32:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.934746+0000", 2024-04-24T13:32:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065945209999999999 2024-04-24T13:32:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938978+0000", 2024-04-24T13:32:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042313139999999999 2024-04-24T13:32:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.939044+0000", 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6377000000000005e-05 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.939107+0000", 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3301999999999998e-05 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.114 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2262 3.22 3:4683919b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.958433+0000", 2024-04-24T13:32:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.0568500730000001, 2024-04-24T13:32:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012735631000000001, 2024-04-24T13:32:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2262 2024-04-24T13:32:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.115 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.958433+0000", 2024-04-24T13:32:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.958433+0000", 2024-04-24T13:32:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.958435+0000", 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-06 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960127+0000", 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016921729999999999 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960160+0000", 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2227000000000002e-05 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960177+0000", 2024-04-24T13:32:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7017999999999999e-05 2024-04-24T13:32:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960265+0000", 2024-04-24T13:32:32.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8701000000000003e-05 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960402+0000", 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013694 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960498+0000", 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5982000000000004e-05 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.967021+0000", 2024-04-24T13:32:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065223599999999996 2024-04-24T13:32:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.971033+0000", 2024-04-24T13:32:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040127380000000001 2024-04-24T13:32:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.971104+0000", 2024-04-24T13:32:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1042000000000002e-05 2024-04-24T13:32:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.971168+0000", 2024-04-24T13:32:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3769999999999994e-05 2024-04-24T13:32:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2264 3.18 3:1be64b04:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.121 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.981015+0000", 2024-04-24T13:32:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.0342676389999998, 2024-04-24T13:32:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014016457, 2024-04-24T13:32:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.122 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2264 2024-04-24T13:32:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.981015+0000", 2024-04-24T13:32:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.981015+0000", 2024-04-24T13:32:32.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.981017+0000", 2024-04-24T13:32:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1119999999999999e-06 2024-04-24T13:32:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.982917+0000", 2024-04-24T13:32:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001899467 2024-04-24T13:32:32.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.982950+0000", 2024-04-24T13:32:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3050999999999999e-05 2024-04-24T13:32:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.982963+0000", 2024-04-24T13:32:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2925000000000001e-05 2024-04-24T13:32:32.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983063+0000", 2024-04-24T13:32:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010076799999999999 2024-04-24T13:32:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983291+0000", 2024-04-24T13:32:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022722500000000001 2024-04-24T13:32:32.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983510+0000", 2024-04-24T13:32:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000219452 2024-04-24T13:32:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994090+0000", 2024-04-24T13:32:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010579912 2024-04-24T13:32:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994900+0000", 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081024999999999999 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994973+0000", 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2723000000000002e-05 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995031+0000", 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8572000000000001e-05 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2268 3.24 3:278809cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:29.026049+0000", 2024-04-24T13:32:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.9892331629999997, 2024-04-24T13:32:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012981438, 2024-04-24T13:32:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.129 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2268 2024-04-24T13:32:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.026049+0000", 2024-04-24T13:32:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.026049+0000", 2024-04-24T13:32:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.026053+0000", 2024-04-24T13:32:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3330000000000001e-06 2024-04-24T13:32:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.027667+0000", 2024-04-24T13:32:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001613876 2024-04-24T13:32:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.027706+0000", 2024-04-24T13:32:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.93e-05 2024-04-24T13:32:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.027720+0000", 2024-04-24T13:32:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.399e-05 2024-04-24T13:32:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.027823+0000", 2024-04-24T13:32:32.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010285099999999999 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.028034+0000", 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021157399999999999 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.028214+0000", 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000180104 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.035480+0000", 2024-04-24T13:32:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072650420000000002 2024-04-24T13:32:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038951+0000", 2024-04-24T13:32:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034710460000000002 2024-04-24T13:32:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038995+0000", 2024-04-24T13:32:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4676999999999999e-05 2024-04-24T13:32:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.039031+0000", 2024-04-24T13:32:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5645000000000002e-05 2024-04-24T13:32:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2269 3.38 3:1d70d2f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:29.036394+0000", 2024-04-24T13:32:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.9788886539999999, 2024-04-24T13:32:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016649575999999999, 2024-04-24T13:32:32.135 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2269 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.036394+0000", 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.036394+0000", 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.036397+0000", 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0340000000000001e-06 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038367+0000", 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019698290000000002 2024-04-24T13:32:32.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038386+0000", 2024-04-24T13:32:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9366000000000001e-05 2024-04-24T13:32:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038399+0000", 2024-04-24T13:32:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2784e-05 2024-04-24T13:32:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038486+0000", 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7457e-05 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038684+0000", 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000197469 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038863+0000", 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017951499999999999 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.045894+0000", 2024-04-24T13:32:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070301590000000002 2024-04-24T13:32:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.052890+0000", 2024-04-24T13:32:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069962469999999997 2024-04-24T13:32:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.052972+0000", 2024-04-24T13:32:32.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1780999999999995e-05 2024-04-24T13:32:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.053044+0000", 2024-04-24T13:32:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1934999999999995e-05 2024-04-24T13:32:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:32.141 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:32.141 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:32.143 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:32.143 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:32.139+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:32.244 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:32.239+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:32.276 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:32.277 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:32.277 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:32.277 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:32.291 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:32.345 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:32.341+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:32.416 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:32.416 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:32.417 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:32.417 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:32.417 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:32.430 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:32.440 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:32:32.479 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:32.477+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:32.547 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:32.543+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:32.606 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:32:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 125.378191591, 2024-04-24T13:32:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020457065, 2024-04-24T13:32:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.606 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-24T13:32:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-24T13:32:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225903+0000", 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7100000000000001e-06 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225922+0000", 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8919999999999998e-05 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225960+0000", 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7240000000000003e-05 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225987+0000", 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6919000000000001e-05 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226300+0000", 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000313701 2024-04-24T13:32:32.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226317+0000", 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6463000000000001e-05 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231091+0000", 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047739169999999999 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231111+0000", 2024-04-24T13:32:32.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0605999999999999e-05 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246073+0000", 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014961264 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246357+0000", 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028432499999999999 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1615 3.1a 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.398378917, 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020755388999999999, 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1615 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.612 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205715+0000", 2024-04-24T13:32:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4399999999999999e-06 2024-04-24T13:32:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211414+0000", 2024-04-24T13:32:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005699356 2024-04-24T13:32:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211448+0000", 2024-04-24T13:32:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4221999999999999e-05 2024-04-24T13:32:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211466+0000", 2024-04-24T13:32:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7629999999999999e-05 2024-04-24T13:32:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211585+0000", 2024-04-24T13:32:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011937 2024-04-24T13:32:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211840+0000", 2024-04-24T13:32:32.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000254861 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.212059+0000", 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218789 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.225826+0000", 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013767061000000001 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226295+0000", 2024-04-24T13:32:32.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046917399999999999 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226388+0000", 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2190999999999999e-05 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226468+0000", 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0295000000000003e-05 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2208 3.29 e85/20 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.2754441639999996, 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026370000000000001, 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328650+0000", 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.413e-06 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335219+0000", 2024-04-24T13:32:32.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006569788 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335258+0000", 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9062e-05 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335277+0000", 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.836e-05 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335422+0000", 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014537 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335481+0000", 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9259000000000003e-05 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354858+0000", 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019376757000000001 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.355017+0000", 2024-04-24T13:32:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015899100000000001 2024-04-24T13:32:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2213 3.2f 3:f4e7225c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.417904+0000", 2024-04-24T13:32:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.1861875199999998, 2024-04-24T13:32:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019522586000000001, 2024-04-24T13:32:32.622 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:32.623 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2213 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.417904+0000", 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.417904+0000", 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.417907+0000", 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8899999999999999e-06 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424088+0000", 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061813299999999996 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424111+0000", 2024-04-24T13:32:32.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3113e-05 2024-04-24T13:32:32.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424122+0000", 2024-04-24T13:32:32.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1266e-05 2024-04-24T13:32:32.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424210+0000", 2024-04-24T13:32:32.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7690999999999998e-05 2024-04-24T13:32:32.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424356+0000", 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014553499999999999 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424474+0000", 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011881500000000001 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.436943+0000", 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012468137000000001 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.437296+0000", 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035371099999999999 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.437365+0000", 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8573999999999998e-05 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.437426+0000", 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1524000000000003e-05 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.628 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2214 3.1a 3:5b3ced30:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.438843+0000", 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.1652479549999999, 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014929534, 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2214 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.629 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.438843+0000", 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.438843+0000", 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.438845+0000", 2024-04-24T13:32:32.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.367e-06 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442803+0000", 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039578840000000001 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442829+0000", 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6628e-05 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442842+0000", 2024-04-24T13:32:32.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3101e-05 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442980+0000", 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013741599999999999 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.443250+0000", 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027034200000000002 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:32.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.443506+0000", 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025607800000000002 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.450974+0000", 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074679639999999997 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.453594+0000", 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026193840000000002 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.453699+0000", 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010524200000000001 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.453773+0000", 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4128000000000006e-05 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2221 3.26 e85/41 3:67d4e534:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_16:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:32.634 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.519722+0000", 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.0843690290000003, 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012541907999999999, 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519722+0000", 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519722+0000", 2024-04-24T13:32:32.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519724+0000", 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7829999999999999e-06 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522168+0000", 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024435080000000001 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522190+0000", 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2824e-05 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522203+0000", 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2394e-05 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522287+0000", 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.462e-05 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522310+0000", 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2833999999999999e-05 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532185+0000", 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098749189999999994 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532264+0000", 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9025999999999999e-05 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.638 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2222 3.13 3:c9a14088:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.524858+0000", 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.0792330239999997, 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01679514, 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2222 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.639 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.524858+0000", 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.524858+0000", 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.524865+0000", 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6069999999999996e-06 2024-04-24T13:32:32.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528806+0000", 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003940743 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528824+0000", 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8423999999999998e-05 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528834+0000", 2024-04-24T13:32:32.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8190000000000003e-06 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528904+0000", 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0432000000000006e-05 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.529034+0000", 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013008299999999999 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.529153+0000", 2024-04-24T13:32:32.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118348 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538128+0000", 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089753909999999992 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.541554+0000", 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034260860000000001 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.541608+0000", 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4146e-05 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.541653+0000", 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5061000000000001e-05 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2223 3.3 3:c1ee41bc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.534315+0000", 2024-04-24T13:32:32.644 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.0697767469999997, 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015569995999999999, 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2223 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.534315+0000", 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.534315+0000", 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.534317+0000", 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0190000000000001e-06 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538250+0000", 2024-04-24T13:32:32.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003933069 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538268+0000", 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8043e-05 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538283+0000", 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5590000000000002e-05 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538348+0000", 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4311000000000001e-05 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538470+0000", 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121909 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538575+0000", 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105027 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.543353+0000", 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047783419999999997 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549659+0000", 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063060429999999999 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549768+0000", 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108587 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549885+0000", 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117056 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2224 3.2c e85/20 3:3671ead8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_19:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.549217+0000", 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.0548740600000004, 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011251326000000001, 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.650 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549217+0000", 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549217+0000", 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549219+0000", 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3570000000000001e-06 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551026+0000", 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001807428 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551045+0000", 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9366999999999999e-05 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551055+0000", 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3079999999999997e-06 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551167+0000", 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112052 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551197+0000", 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0253999999999999e-05 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560393+0000", 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0091956 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560469+0000", 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5959999999999998e-05 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2234 3.34 3:2f41ca12:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.652422+0000", 2024-04-24T13:32:32.654 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.9516694230000002, 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018886607, 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2234 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.652422+0000", 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.652422+0000", 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.652424+0000", 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1909999999999999e-06 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656447+0000", 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040232530000000001 2024-04-24T13:32:32.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656472+0000", 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4338e-05 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656488+0000", 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6203999999999999e-05 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656586+0000", 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7884e-05 2024-04-24T13:32:32.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656724+0000", 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013806199999999999 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656838+0000", 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113998 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.669565+0000", 2024-04-24T13:32:32.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012727591999999999 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671188+0000", 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001622533 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671251+0000", 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3476e-05 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671309+0000", 2024-04-24T13:32:32.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7076e-05 2024-04-24T13:32:32.660 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.660 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.660 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.660 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2239 3.11 3:8b38e7d5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.660 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.709949+0000", 2024-04-24T13:32:32.660 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.8941422210000001, 2024-04-24T13:32:32.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016665736, 2024-04-24T13:32:32.660 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.660 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.660 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2239 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.709949+0000", 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.709949+0000", 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.709952+0000", 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1540000000000002e-06 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.713909+0000", 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039569870000000004 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.713935+0000", 2024-04-24T13:32:32.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5568999999999999e-05 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.713951+0000", 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529e-05 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.714027+0000", 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.538e-05 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.714170+0000", 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014336199999999999 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.714282+0000", 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111912 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719419+0000", 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051373199999999999 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.726440+0000", 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070210230000000004 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.726535+0000", 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4137999999999999e-05 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.726615+0000", 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0362000000000001e-05 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.666 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2244 3.3b e85/41 3:ddfbb493:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_39:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:32.666 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.766818+0000", 2024-04-24T13:32:32.666 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.837273717, 2024-04-24T13:32:32.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015179241, 2024-04-24T13:32:32.666 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.666 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.666 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.666 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.766818+0000", 2024-04-24T13:32:32.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.766818+0000", 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.766819+0000", 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.564e-06 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771018+0000", 2024-04-24T13:32:32.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041990200000000004 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771049+0000", 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0273999999999998e-05 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771075+0000", 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6103999999999999e-05 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771212+0000", 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136933 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771286+0000", 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4447000000000001e-05 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.781853+0000", 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010567048000000001 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.781997+0000", 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014385099999999999 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2245 3.1d e85/20 3:bb337c31:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_40:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.8240098380000003, 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01557213, 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1899999999999998e-07 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784478+0000", 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00439624 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784506+0000", 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7365999999999999e-05 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784522+0000", 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6268000000000001e-05 2024-04-24T13:32:32.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784616+0000", 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4423e-05 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784640+0000", 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3906000000000001e-05 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795548+0000", 2024-04-24T13:32:32.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01090738 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795654+0000", 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106128 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2246 3.9 3:92c5067a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.784844+0000", 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.8192474000000001, 2024-04-24T13:32:32.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016501108, 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2246 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784844+0000", 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784844+0000", 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784848+0000", 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.563e-06 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.788914+0000", 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040666360000000002 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.788940+0000", 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5573999999999999e-05 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.788952+0000", 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2431e-05 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.789037+0000", 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4593999999999997e-05 2024-04-24T13:32:32.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.789171+0000", 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134015 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.789288+0000", 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117512 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.796833+0000", 2024-04-24T13:32:32.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075444029999999999 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.801059+0000", 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042262280000000003 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.801227+0000", 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000168517 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.801345+0000", 2024-04-24T13:32:32.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011763499999999999 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2248 3.1d e85/20 3:b991c377:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_43:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.809856+0000", 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.794235274, 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011470594000000001, 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809856+0000", 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809856+0000", 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809858+0000", 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309999999999999e-06 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812257+0000", 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002399329 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812283+0000", 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5636e-05 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812297+0000", 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4534e-05 2024-04-24T13:32:32.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812393+0000", 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6039000000000007e-05 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812429+0000", 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5111000000000003e-05 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821231+0000", 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088020389999999993 2024-04-24T13:32:32.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821327+0000", 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6075000000000004e-05 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2253 3.27 e85/20 3:e6835017:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_48:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.859419+0000", 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.7446720180000002, 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012299842, 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.684 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.859419+0000", 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.859419+0000", 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.859421+0000", 2024-04-24T13:32:32.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0329999999999998e-06 2024-04-24T13:32:32.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863395+0000", 2024-04-24T13:32:32.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039737339999999996 2024-04-24T13:32:32.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863425+0000", 2024-04-24T13:32:32.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9793000000000001e-05 2024-04-24T13:32:32.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863439+0000", 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.446e-05 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863598+0000", 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015820600000000001 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863638+0000", 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0225999999999997e-05 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.871631+0000", 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079935089999999993 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.871719+0000", 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7880999999999994e-05 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.688 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2255 3.29 e85/20 3:979257ba:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_50:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.881386+0000", 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.7227057000000001, 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011529885, 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881386+0000", 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881386+0000", 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881413+0000", 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7619000000000001e-05 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885724+0000", 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043102339999999996 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885760+0000", 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6501999999999997e-05 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885777+0000", 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7183000000000001e-05 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885917+0000", 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139491 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885959+0000", 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2023000000000001e-05 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892786+0000", 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068271720000000003 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892916+0000", 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012966099999999999 2024-04-24T13:32:32.692 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2271 3.13 3:cb7d029e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.056244+0000", 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.5478468919999999, 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019201421, 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.693 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2271 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.056244+0000", 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.056244+0000", 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.056259+0000", 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4099e-05 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060075+0000", 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038163260000000001 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060103+0000", 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7949e-05 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060115+0000", 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2298e-05 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060216+0000", 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100883 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060366+0000", 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015035999999999999 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060509+0000", 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142516 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.067630+0000", 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00712066 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.075349+0000", 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077195789999999999 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.075402+0000", 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2905000000000003e-05 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.075446+0000", 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3846e-05 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.698 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2273 3.1c 3:386b02cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.077819+0000", 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.5262726369999999, 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016399364, 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2273 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.077819+0000", 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.077819+0000", 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.077820+0000", 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5740000000000001e-06 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081705+0000", 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038844040000000002 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081723+0000", 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7892000000000001e-05 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081732+0000", 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0569999999999999e-06 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081812+0000", 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0476000000000007e-05 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081961+0000", 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014850599999999999 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.082094+0000", 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013324300000000001 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088394+0000", 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062996700000000003 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.094036+0000", 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056424860000000004 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.094144+0000", 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107983 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.094218+0000", 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4072999999999994e-05 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2274 3.2f 3:f7fb6ab2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.088365+0000", 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 3.5157258919999999, 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012884712, 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:32.704 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2274 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088365+0000", 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088365+0000", 2024-04-24T13:32:32.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088368+0000", 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.261e-06 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092225+0000", 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003857316 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:32.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092243+0000", 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7606999999999999e-05 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092253+0000", 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0095000000000001e-05 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092315+0000", 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2426000000000002e-05 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:32.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092429+0000", 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113515 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092527+0000", 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8812000000000002e-05 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.096526+0000", 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039980129999999999 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:32.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.101159+0000", 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046330169999999997 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.101209+0000", 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0869999999999999e-05 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.101250+0000", 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0779999999999999e-05 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.709 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:32.710 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:32.710 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:32.711 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:32.712 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:32.709+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:32.811 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:32.809+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:32.885 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:32.886 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:32.886 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:32.886 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:32.901 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:32.947 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:32.945+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:33.013 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:33.009+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:33.070 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:33.071 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:33.071 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:33.071 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:33.071 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:33.085 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:33.127 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:33.125+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:33.215 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:33.211+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:33.251 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:33.251 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:33.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:33.251 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:33.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.251 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:33.251 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:33.251 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 123.96831992, 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048388950000000002, 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3799999999999998e-06 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279193+0000", 2024-04-24T13:32:33.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7674e-05 2024-04-24T13:32:33.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279224+0000", 2024-04-24T13:32:33.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0654000000000002e-05 2024-04-24T13:32:33.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279244+0000", 2024-04-24T13:32:33.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:32:33.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279426+0000", 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018255300000000001 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279717+0000", 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029043800000000001 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279993+0000", 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276786 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282898+0000", 2024-04-24T13:32:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002904093 2024-04-24T13:32:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283731+0000", 2024-04-24T13:32:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00083382599999999997 2024-04-24T13:32:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283886+0000", 2024-04-24T13:32:33.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015512600000000001 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284001+0000", 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114405 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410010339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 123.963195325, 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044116340000000002, 2024-04-24T13:32:33.257 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.258 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.258 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.258 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-24T13:32:33.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.258 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:33.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284289+0000", 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.125e-06 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284299+0000", 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0485999999999999e-05 2024-04-24T13:32:33.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284330+0000", 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0528000000000003e-05 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284345+0000", 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4883e-05 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284484+0000", 2024-04-24T13:32:33.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139708 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284655+0000", 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170953 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284981+0000", 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000325648 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.287326+0000", 2024-04-24T13:32:33.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023452709999999999 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288427+0000", 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001100544 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288551+0000", 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012466500000000001 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288698+0000", 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146823 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 120.98398244000001, 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047820809999999997, 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.263 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263503+0000", 2024-04-24T13:32:33.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.039e-06 2024-04-24T13:32:33.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263520+0000", 2024-04-24T13:32:33.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7198e-05 2024-04-24T13:32:33.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263548+0000", 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8158e-05 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263565+0000", 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7008e-05 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263754+0000", 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001894 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263973+0000", 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218593 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.264373+0000", 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040043400000000002 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.266377+0000", 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020033030000000001 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268121+0000", 2024-04-24T13:32:33.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017441049999999999 2024-04-24T13:32:33.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268212+0000", 2024-04-24T13:32:33.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1490000000000007e-05 2024-04-24T13:32:33.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268282+0000", 2024-04-24T13:32:33.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9352999999999998e-05 2024-04-24T13:32:33.271 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.271 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.271 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.272 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:33.272 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:33.272 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 120.90427028800001, 2024-04-24T13:32:33.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034252639999999999, 2024-04-24T13:32:33.272 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.273 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.273 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.273 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.273 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.273 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.274 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 220 2024-04-24T13:32:33.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.274 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:33.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:33.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343214+0000", 2024-04-24T13:32:33.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:32:33.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343227+0000", 2024-04-24T13:32:33.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2941e-05 2024-04-24T13:32:33.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343259+0000", 2024-04-24T13:32:33.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1557000000000003e-05 2024-04-24T13:32:33.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343274+0000", 2024-04-24T13:32:33.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5401999999999999e-05 2024-04-24T13:32:33.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343455+0000", 2024-04-24T13:32:33.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018068700000000001 2024-04-24T13:32:33.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343694+0000", 2024-04-24T13:32:33.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238552 2024-04-24T13:32:33.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:33.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.344088+0000", 2024-04-24T13:32:33.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039456400000000003 2024-04-24T13:32:33.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.345723+0000", 2024-04-24T13:32:33.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016349139999999999 2024-04-24T13:32:33.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346480+0000", 2024-04-24T13:32:33.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075738300000000004 2024-04-24T13:32:33.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346569+0000", 2024-04-24T13:32:33.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8281000000000004e-05 2024-04-24T13:32:33.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346637+0000", 2024-04-24T13:32:33.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8165999999999998e-05 2024-04-24T13:32:33.286 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.286 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.286 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.287 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:33.287 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:33.287 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 120.886529991, 2024-04-24T13:32:33.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032957419999999999, 2024-04-24T13:32:33.287 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.287 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.288 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.288 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.288 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.288 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.288 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-24T13:32:33.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.289 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:33.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:33.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360954+0000", 2024-04-24T13:32:33.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.154e-06 2024-04-24T13:32:33.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360965+0000", 2024-04-24T13:32:33.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1321999999999999e-05 2024-04-24T13:32:33.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360996+0000", 2024-04-24T13:32:33.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0902999999999999e-05 2024-04-24T13:32:33.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361012+0000", 2024-04-24T13:32:33.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:32:33.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361185+0000", 2024-04-24T13:32:33.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172072 2024-04-24T13:32:33.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361404+0000", 2024-04-24T13:32:33.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021965999999999999 2024-04-24T13:32:33.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:33.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361852+0000", 2024-04-24T13:32:33.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000448276 2024-04-24T13:32:33.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.363340+0000", 2024-04-24T13:32:33.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001487169 2024-04-24T13:32:33.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364094+0000", 2024-04-24T13:32:33.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075443699999999995 2024-04-24T13:32:33.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364184+0000", 2024-04-24T13:32:33.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9957000000000006e-05 2024-04-24T13:32:33.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364248+0000", 2024-04-24T13:32:33.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3627000000000006e-05 2024-04-24T13:32:33.297 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.297 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.297 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.297 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:33.298 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:33.298 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 120.882965144, 2024-04-24T13:32:33.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036426480000000001, 2024-04-24T13:32:33.298 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.298 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.298 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.298 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.298 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.298 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.298 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-24T13:32:33.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.298 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364519+0000", 2024-04-24T13:32:33.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364529+0000", 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088999999999999e-05 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364554+0000", 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5537e-05 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364568+0000", 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3372e-05 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364726+0000", 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015809299999999999 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365059+0000", 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000333185 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:33.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365758+0000", 2024-04-24T13:32:33.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069934299999999995 2024-04-24T13:32:33.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.367413+0000", 2024-04-24T13:32:33.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016552349999999999 2024-04-24T13:32:33.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368012+0000", 2024-04-24T13:32:33.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059858700000000003 2024-04-24T13:32:33.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368097+0000", 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5253999999999994e-05 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368159+0000", 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2113000000000007e-05 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 120.853578508, 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033998840000000002, 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393906+0000", 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1569999999999998e-06 2024-04-24T13:32:33.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393917+0000", 2024-04-24T13:32:33.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1348999999999999e-05 2024-04-24T13:32:33.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393942+0000", 2024-04-24T13:32:33.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.527e-05 2024-04-24T13:32:33.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393957+0000", 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4355999999999999e-05 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394127+0000", 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170555 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394352+0000", 2024-04-24T13:32:33.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224539 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394788+0000", 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043600099999999999 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.396137+0000", 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001349404 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397158+0000", 2024-04-24T13:32:33.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001020738 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397237+0000", 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9319000000000004e-05 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397303+0000", 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6196000000000001e-05 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.310 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:437 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:33.310 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:33.310 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 120.78395491400001, 2024-04-24T13:32:33.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048056540000000003, 2024-04-24T13:32:33.310 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.310 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.310 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.310 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.310 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.310 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 437 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463529+0000", 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2479999999999999e-06 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463544+0000", 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463572+0000", 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8294e-05 2024-04-24T13:32:33.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463590+0000", 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464092+0000", 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000502189 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464454+0000", 2024-04-24T13:32:33.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036231300000000001 2024-04-24T13:32:33.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:33.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464831+0000", 2024-04-24T13:32:33.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000377375 2024-04-24T13:32:33.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467473+0000", 2024-04-24T13:32:33.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026414659999999999 2024-04-24T13:32:33.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468185+0000", 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071215199999999997 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468271+0000", 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5593999999999994e-05 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468333+0000", 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1957000000000003e-05 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.315 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 120.378305165, 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033442569999999998, 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.316 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 793 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869179+0000", 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.323e-06 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869190+0000", 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869222+0000", 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1733999999999998e-05 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869237+0000", 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5044e-05 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869396+0000", 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158913 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869763+0000", 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367112 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.870319+0000", 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055558799999999998 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.871509+0000", 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001190607 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872365+0000", 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085535299999999999 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872449+0000", 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3834999999999999e-05 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872521+0000", 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2428999999999994e-05 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:33.321 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:33.322 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 120.19229879300001, 2024-04-24T13:32:33.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003340754, 2024-04-24T13:32:33.322 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.322 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.322 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.322 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.322 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.322 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.322 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 874 2024-04-24T13:32:33.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.322 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055185+0000", 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055197+0000", 2024-04-24T13:32:33.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1606e-05 2024-04-24T13:32:33.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055229+0000", 2024-04-24T13:32:33.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1603000000000002e-05 2024-04-24T13:32:33.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055244+0000", 2024-04-24T13:32:33.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4928e-05 2024-04-24T13:32:33.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055397+0000", 2024-04-24T13:32:33.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015366499999999999 2024-04-24T13:32:33.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055763+0000", 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036565600000000001 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.056317+0000", 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055436600000000004 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.057678+0000", 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001361283 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058258+0000", 2024-04-24T13:32:33.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057942400000000004 2024-04-24T13:32:33.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058407+0000", 2024-04-24T13:32:33.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000149188 2024-04-24T13:32:33.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058524+0000", 2024-04-24T13:32:33.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116805 2024-04-24T13:32:33.327 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1566 4.38 4:1cdfa9df:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.3.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.691307520000001, 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040238560000000001, 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.328 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1566 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556176+0000", 2024-04-24T13:32:33.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.057e-06 2024-04-24T13:32:33.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556187+0000", 2024-04-24T13:32:33.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0693000000000001e-05 2024-04-24T13:32:33.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556219+0000", 2024-04-24T13:32:33.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1718999999999999e-05 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556242+0000", 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2687000000000001e-05 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556384+0000", 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014257899999999999 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556624+0000", 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024014199999999999 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556921+0000", 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029673900000000002 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.559462+0000", 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025407530000000002 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560009+0000", 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054690399999999997 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560096+0000", 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7597999999999997e-05 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560198+0000", 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010198499999999999 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.333 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1721 4.38 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.496941059999999, 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088323519999999999, 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1721 2024-04-24T13:32:33.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750544+0000", 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9569999999999998e-06 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750561+0000", 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7589e-05 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750600+0000", 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8145999999999997e-05 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750621+0000", 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1109999999999999e-05 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750797+0000", 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017672599999999999 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751113+0000", 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031514599999999998 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:33.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751586+0000", 2024-04-24T13:32:33.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047325699999999999 2024-04-24T13:32:33.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753982+0000", 2024-04-24T13:32:33.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023960880000000002 2024-04-24T13:32:33.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759108+0000", 2024-04-24T13:32:33.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051256590000000003 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759247+0000", 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013992400000000001 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759373+0000", 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012574999999999999 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.340 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1724 4.38 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:33.340 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:33.340 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.496814906000001, 2024-04-24T13:32:33.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093322379999999996, 2024-04-24T13:32:33.340 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.340 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.340 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.340 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.341 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.341 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.341 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1724 2024-04-24T13:32:33.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.341 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:33.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:33.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750669+0000", 2024-04-24T13:32:33.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7269999999999999e-06 2024-04-24T13:32:33.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750678+0000", 2024-04-24T13:32:33.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9700000000000005e-06 2024-04-24T13:32:33.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750744+0000", 2024-04-24T13:32:33.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5920999999999994e-05 2024-04-24T13:32:33.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750766+0000", 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.226e-05 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752483+0000", 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001717393 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752795+0000", 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031186000000000001 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:33.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753283+0000", 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048743300000000001 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.756401+0000", 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031181220000000001 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759844+0000", 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003443715 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759934+0000", 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9728000000000006e-05 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759999+0000", 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5109000000000003e-05 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1814 4.38 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:33.346 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.306027729, 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065250220000000001, 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1814 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941457+0000", 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941467+0000", 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0596e-05 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941503+0000", 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5398999999999998e-05 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941524+0000", 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1586e-05 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941687+0000", 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016257000000000001 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941919+0000", 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232315 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942204+0000", 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028527000000000001 2024-04-24T13:32:33.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.945033+0000", 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028291029999999999 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947677+0000", 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026439649999999999 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947848+0000", 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017036699999999999 2024-04-24T13:32:33.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947979+0000", 2024-04-24T13:32:33.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131524 2024-04-24T13:32:33.352 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.352 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.352 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.352 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1817 4.38 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:33.352 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:33.352 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.305918781999999, 2024-04-24T13:32:33.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079573279999999996, 2024-04-24T13:32:33.353 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.353 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.353 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.353 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.353 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.353 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.353 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1817 2024-04-24T13:32:33.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.353 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:33.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:33.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941565+0000", 2024-04-24T13:32:33.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.657e-06 2024-04-24T13:32:33.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941573+0000", 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4169999999999992e-06 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941596+0000", 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2535999999999999e-05 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941610+0000", 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3746e-05 2024-04-24T13:32:33.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944182+0000", 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025729540000000001 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944388+0000", 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000205183 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944557+0000", 2024-04-24T13:32:33.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016964200000000001 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.946998+0000", 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024406670000000001 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949247+0000", 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022489490000000001 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949406+0000", 2024-04-24T13:32:33.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000159436 2024-04-24T13:32:33.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949520+0000", 2024-04-24T13:32:33.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114141 2024-04-24T13:32:33.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.358 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.358 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2212 3.3a 3:5de7fd4f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:33.358 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.849253622, 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024848709, 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2212 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398232+0000", 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405320+0000", 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070884040000000004 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405367+0000", 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6940000000000001e-05 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405393+0000", 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5252000000000001e-05 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405487+0000", 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4596e-05 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405609+0000", 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121892 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405710+0000", 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010121899999999999 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.415423+0000", 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097131219999999994 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.422967+0000", 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00754319 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.423023+0000", 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5958000000000002e-05 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.423077+0000", 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4432999999999999e-05 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2245 3.1d 3:bb337c31:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.4719767990000001, 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020498309999999999, 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.364 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-24T13:32:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:33.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775508+0000", 2024-04-24T13:32:33.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.486e-06 2024-04-24T13:32:33.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779469+0000", 2024-04-24T13:32:33.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003961862 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779497+0000", 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7559000000000002e-05 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779513+0000", 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6450999999999999e-05 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779626+0000", 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112478 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779794+0000", 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016824099999999999 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779922+0000", 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012780199999999999 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.793374+0000", 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013451942 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795894+0000", 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025205079999999999 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795951+0000", 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6131000000000002e-05 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.796003+0000", 2024-04-24T13:32:33.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2849999999999997e-05 2024-04-24T13:32:33.370 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.370 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.370 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.370 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2248 3.1d 3:b991c377:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:33.370 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:33.370 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.4421875359999996, 2024-04-24T13:32:33.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016320675999999999, 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2248 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805301+0000", 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1399999999999997e-06 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809310+0000", 2024-04-24T13:32:33.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040090179999999996 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809337+0000", 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7636000000000001e-05 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809351+0000", 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3728e-05 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809435+0000", 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3956999999999996e-05 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809588+0000", 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015312299999999999 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809713+0000", 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012522299999999999 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.815947+0000", 2024-04-24T13:32:33.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062333359999999999 2024-04-24T13:32:33.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821522+0000", 2024-04-24T13:32:33.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055754239999999998 2024-04-24T13:32:33.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821572+0000", 2024-04-24T13:32:33.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0005e-05 2024-04-24T13:32:33.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821615+0000", 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3086e-05 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2250 3.3c 3:3d3fcdd2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.4234224730000005, 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018935203000000001, 2024-04-24T13:32:33.376 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2250 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:33.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824061+0000", 2024-04-24T13:32:33.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.725e-06 2024-04-24T13:32:33.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827859+0000", 2024-04-24T13:32:33.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037982960000000001 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827885+0000", 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5761e-05 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827896+0000", 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1136e-05 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828017+0000", 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012102100000000001 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828290+0000", 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027271199999999999 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828528+0000", 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023780599999999999 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.835369+0000", 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068407609999999999 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842842+0000", 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074735390000000004 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842928+0000", 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5513999999999995e-05 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842995+0000", 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6932000000000002e-05 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2251 3.3a 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.4126042270000001, 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030524880000000001, 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:33.382 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2251 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834880+0000", 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6769999999999999e-06 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839556+0000", 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046751350000000004 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839593+0000", 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7079999999999997e-05 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839617+0000", 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4015999999999998e-05 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839773+0000", 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015627699999999999 2024-04-24T13:32:33.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840011+0000", 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023843900000000001 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840261+0000", 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024939899999999997 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.853562+0000", 2024-04-24T13:32:33.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013301726999999999 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865276+0000", 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011713779000000001 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865349+0000", 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2624000000000001e-05 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865403+0000", 2024-04-24T13:32:33.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3727000000000002e-05 2024-04-24T13:32:33.388 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.388 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.388 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.388 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:33.388 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:33.388 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:33.389 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:33.390 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:33.387+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:33.491 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:33.487+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:33.520 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:33.521 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:33.521 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:33.521 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:33.535 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:33.555 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:32:33.592 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:33.589+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:33.661 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:33.661 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:33.662 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:33.662 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:33.662 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:33.675 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:33.705 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:33.706 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:33.719 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:33.717+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:33.722 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:33.722 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:33.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:33.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:33.754 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:33.755 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:33.772 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:33.772 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:33.790 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:33.790 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:33.793 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:33.787+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:33.809 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:33.810 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:33.829 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:33.829 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:33.846 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:33.846 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:33.860 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:33.906 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:33.905+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:33.977 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:33.978 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:33.993 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:32:34.035 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:34.033+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:34.096 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:34.091+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:34.159 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:34.159 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:34.173 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:32:34.196 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:34.191+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:34.297 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:34.297 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:34.297 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:34.295+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:34.311 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:32:34.398 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:34.397+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:34.443 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:34.443 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:34.458 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:32:34.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:32:34.503 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:34.499+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:34.573 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:34.574 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:34.589 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:32:34.638 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:34.635+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:34.701 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:34.697+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:34.707 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:34.707 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:34.720 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:32:34.802 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:34.801+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:34.875 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:34.875 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:34.889 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:32:34.934 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:34.931+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:35.004 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:35.001+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:35.007 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:35.008 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:35.020 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:32:35.110 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:35.107+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:35.171 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:35.171 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:35.184 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:32:35.226 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:35.223+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:35.306 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:35.305+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:35.346 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:35.346 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:35.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:32:35.407 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:35.403+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:35.457 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:32:35.487 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:35.487 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:35.500 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:32:35.509 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:35.505+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:35.609 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:35.603+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:35.665 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:35.665 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:35.679 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:35.726 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:35.723+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:35.811 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:35.807+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:35.847 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:32:35.853 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:35.854 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:35.869 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:35.913 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:35.909+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:35.986 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:35.987 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:36.003 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:36.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:36.013 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:36.009+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:36.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:36.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:36.029 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:36.029 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:36.036 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:36.037 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:36.043 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:36.057 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:36.058 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:36.078 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:36.078 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:36.098 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:36.099 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:36.114 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:36.113+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:36.119 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:36.119 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:36.158 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:36.158 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 123.881175105, 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:36.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:32:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:32:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:32:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:32:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:32:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:32:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:32:36.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:32:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:32:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:32:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:32:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:32:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:32:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2207 3.38 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:32:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.8545963270000003, 2024-04-24T13:32:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022686873999999999, 2024-04-24T13:32:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.165 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2207 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302499+0000", 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307861+0000", 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053622089999999997 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307899+0000", 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978999999999997e-05 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307917+0000", 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8576999999999998e-05 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308018+0000", 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010080499999999999 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308202+0000", 2024-04-24T13:32:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000183628 2024-04-24T13:32:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308352+0000", 2024-04-24T13:32:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149806 2024-04-24T13:32:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318520+0000", 2024-04-24T13:32:36.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010168744 2024-04-24T13:32:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.324908+0000", 2024-04-24T13:32:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063874739999999998 2024-04-24T13:32:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325063+0000", 2024-04-24T13:32:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155131 2024-04-24T13:32:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325182+0000", 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011915499999999999 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.8310016139999998, 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.171 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:32:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:32:36.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:32:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:32:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:32:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:32:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:32:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:32:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:32:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:32:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:32:36.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:32:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:32:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:32:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:32:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:36.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:32:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:32:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:32:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:32:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:32:36.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2210 3.23 e85/20 3:c462163d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_5:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.359362+0000", 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.797729221, 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014461236000000001, 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.359362+0000", 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.359362+0000", 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.359365+0000", 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6000000000000001e-06 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362822+0000", 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034571200000000002 2024-04-24T13:32:36.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362857+0000", 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4968000000000001e-05 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362875+0000", 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7507999999999999e-05 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362965+0000", 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0742000000000006e-05 2024-04-24T13:32:36.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362992+0000", 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7158e-05 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.373695+0000", 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010702211999999999 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.373824+0000", 2024-04-24T13:32:36.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128928 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2211 3.8 3:123ae70b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.379448+0000", 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.7776434089999995, 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013985645, 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.182 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2211 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.379448+0000", 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.379448+0000", 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.379452+0000", 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3759999999999999e-06 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.381975+0000", 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002523885 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382016+0000", 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0865999999999998e-05 2024-04-24T13:32:36.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382042+0000", 2024-04-24T13:32:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5999e-05 2024-04-24T13:32:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382160+0000", 2024-04-24T13:32:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117806 2024-04-24T13:32:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382338+0000", 2024-04-24T13:32:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000177543 2024-04-24T13:32:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382494+0000", 2024-04-24T13:32:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015645500000000001 2024-04-24T13:32:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.390114+0000", 2024-04-24T13:32:36.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076203099999999999 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.393358+0000", 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032431669999999999 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.393402+0000", 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4072000000000001e-05 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.393434+0000", 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2165999999999997e-05 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2215 3.23 e85/20 3:c703bbd7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_10:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.454450+0000", 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.7026413690000002, 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012738266999999999, 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.188 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.454450+0000", 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.454450+0000", 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.454452+0000", 2024-04-24T13:32:36.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.474e-06 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455575+0000", 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011236519999999999 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455609+0000", 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3448999999999998e-05 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455626+0000", 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7274000000000001e-05 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455746+0000", 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012016299999999999 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455784+0000", 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8055000000000001e-05 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467080+0000", 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011295846999999999 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467188+0000", 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108353 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.6859457600000001, 2024-04-24T13:32:36.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:32:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:32:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:32:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:32:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:32:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:32:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:32:36.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:32:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:32:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:32:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.198 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2218 3.c 3:338c3e0b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.481902+0000", 2024-04-24T13:32:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.6751897529999997, 2024-04-24T13:32:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013669654, 2024-04-24T13:32:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2218 2024-04-24T13:32:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.481902+0000", 2024-04-24T13:32:36.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.481902+0000", 2024-04-24T13:32:36.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.481905+0000", 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7590000000000002e-06 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483709+0000", 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001804915 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483731+0000", 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483742+0000", 2024-04-24T13:32:36.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0905e-05 2024-04-24T13:32:36.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483804+0000", 2024-04-24T13:32:36.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1407000000000003e-05 2024-04-24T13:32:36.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483931+0000", 2024-04-24T13:32:36.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127522 2024-04-24T13:32:36.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:36.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.484035+0000", 2024-04-24T13:32:36.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103825 2024-04-24T13:32:36.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.490036+0000", 2024-04-24T13:32:36.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060011739999999997 2024-04-24T13:32:36.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.495470+0000", 2024-04-24T13:32:36.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054342319999999998 2024-04-24T13:32:36.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.495523+0000", 2024-04-24T13:32:36.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2726999999999998e-05 2024-04-24T13:32:36.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.495571+0000", 2024-04-24T13:32:36.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8461999999999998e-05 2024-04-24T13:32:36.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.205 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.205 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2233 3.c 3:3257d695:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.205 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.641529+0000", 2024-04-24T13:32:36.206 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.5155624059999999, 2024-04-24T13:32:36.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018052898000000001, 2024-04-24T13:32:36.206 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.206 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.206 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.206 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.206 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.206 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2233 2024-04-24T13:32:36.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.206 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.641529+0000", 2024-04-24T13:32:36.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.641529+0000", 2024-04-24T13:32:36.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.641532+0000", 2024-04-24T13:32:36.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.078e-06 2024-04-24T13:32:36.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643295+0000", 2024-04-24T13:32:36.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017631700000000001 2024-04-24T13:32:36.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643325+0000", 2024-04-24T13:32:36.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9848e-05 2024-04-24T13:32:36.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643340+0000", 2024-04-24T13:32:36.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4588e-05 2024-04-24T13:32:36.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643439+0000", 2024-04-24T13:32:36.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8801000000000005e-05 2024-04-24T13:32:36.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643659+0000", 2024-04-24T13:32:36.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022074099999999999 2024-04-24T13:32:36.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:36.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643804+0000", 2024-04-24T13:32:36.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014435000000000001 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.652553+0000", 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0087494340000000004 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.659491+0000", 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069377010000000001 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.659531+0000", 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0590000000000003e-05 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.659582+0000", 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0596999999999997e-05 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2242 3.b 3:d16b554f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:32:36.212 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.4174468280000001, 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022940439, 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2242 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:32:36.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739648+0000", 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.785e-06 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741765+0000", 2024-04-24T13:32:36.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002117655 2024-04-24T13:32:36.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741781+0000", 2024-04-24T13:32:36.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6062e-05 2024-04-24T13:32:36.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741792+0000", 2024-04-24T13:32:36.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0937999999999999e-05 2024-04-24T13:32:36.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741918+0000", 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623199999999999 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742189+0000", 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027047300000000002 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742430+0000", 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024077699999999999 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752990+0000", 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010559875 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762422+0000", 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094325120000000005 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762510+0000", 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7879000000000003e-05 2024-04-24T13:32:36.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762585+0000", 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5251000000000002e-05 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2247 3.2a e85/74 3:56a679bb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_42:head v 85'3, mlcod=81'1)", 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.801034+0000", 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.3560579349999999, 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012987485999999999, 2024-04-24T13:32:36.218 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.801034+0000", 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.801034+0000", 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.801035+0000", 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.22e-06 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.805927+0000", 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048917659999999996 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.805951+0000", 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4017999999999999e-05 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.805963+0000", 2024-04-24T13:32:36.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2217e-05 2024-04-24T13:32:36.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.806061+0000", 2024-04-24T13:32:36.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7807999999999996e-05 2024-04-24T13:32:36.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.806096+0000", 2024-04-24T13:32:36.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4848000000000002e-05 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.813950+0000", 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078541010000000005 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.814021+0000", 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1507999999999994e-05 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.223 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2250 3.3c e85/20 3:3d3fcdd2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_45:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:36.223 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.829385+0000", 2024-04-24T13:32:36.223 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.3277065310000005, 2024-04-24T13:32:36.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013561493000000001, 2024-04-24T13:32:36.223 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.223 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.223 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.223 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.829385+0000", 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.829385+0000", 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.829386+0000", 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.33e-06 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837727+0000", 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083405879999999995 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837760+0000", 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2892999999999998e-05 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837776+0000", 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6064000000000001e-05 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837888+0000", 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011175699999999999 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837910+0000", 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1967000000000002e-05 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.842872+0000", 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004962246 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.842947+0000", 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4647999999999994e-05 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2253 3.27 3:e6835017:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.857410+0000", 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2996813539999996, 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015395834000000001, 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.227 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2253 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.857410+0000", 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.857410+0000", 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.857413+0000", 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.236e-06 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859353+0000", 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001939947 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859384+0000", 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1106999999999999e-05 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859401+0000", 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6871000000000002e-05 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859494+0000", 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2901999999999999e-05 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859619+0000", 2024-04-24T13:32:36.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000124924 2024-04-24T13:32:36.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:36.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859762+0000", 2024-04-24T13:32:36.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014235800000000001 2024-04-24T13:32:36.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865768+0000", 2024-04-24T13:32:36.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060064699999999999 2024-04-24T13:32:36.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.872676+0000", 2024-04-24T13:32:36.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069080460000000002 2024-04-24T13:32:36.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.872734+0000", 2024-04-24T13:32:36.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7442000000000003e-05 2024-04-24T13:32:36.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.872806+0000", 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2531000000000001e-05 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2255 3.29 3:979257ba:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.878934+0000", 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2781577219999996, 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015146641000000001, 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.233 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.234 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2255 2024-04-24T13:32:36.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.234 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.878934+0000", 2024-04-24T13:32:36.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.878934+0000", 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.878937+0000", 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2270000000000002e-06 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881027+0000", 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020899550000000001 2024-04-24T13:32:36.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881053+0000", 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6139000000000002e-05 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881065+0000", 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2067e-05 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881158+0000", 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2571000000000005e-05 2024-04-24T13:32:36.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881323+0000", 2024-04-24T13:32:36.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016472000000000001 2024-04-24T13:32:36.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:36.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881452+0000", 2024-04-24T13:32:36.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012935600000000001 2024-04-24T13:32:36.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.888419+0000", 2024-04-24T13:32:36.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069672290000000001 2024-04-24T13:32:36.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.893923+0000", 2024-04-24T13:32:36.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055036449999999997 2024-04-24T13:32:36.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.894016+0000", 2024-04-24T13:32:36.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3734999999999996e-05 2024-04-24T13:32:36.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.894080+0000", 2024-04-24T13:32:36.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3997000000000004e-05 2024-04-24T13:32:36.239 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.239 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.239 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.240 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2258 3.1e 3:788e6d31:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.240 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.912760+0000", 2024-04-24T13:32:36.240 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2443315090000002, 2024-04-24T13:32:36.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014178759000000001, 2024-04-24T13:32:36.240 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.240 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.240 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.240 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.240 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.240 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.241 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2258 2024-04-24T13:32:36.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.241 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.912760+0000", 2024-04-24T13:32:36.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.912760+0000", 2024-04-24T13:32:36.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.912762+0000", 2024-04-24T13:32:36.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.295e-06 2024-04-24T13:32:36.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914664+0000", 2024-04-24T13:32:36.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001901701 2024-04-24T13:32:36.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914688+0000", 2024-04-24T13:32:36.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3983000000000001e-05 2024-04-24T13:32:36.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914701+0000", 2024-04-24T13:32:36.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2914999999999999e-05 2024-04-24T13:32:36.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914793+0000", 2024-04-24T13:32:36.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1995000000000003e-05 2024-04-24T13:32:36.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914963+0000", 2024-04-24T13:32:36.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000169994 2024-04-24T13:32:36.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:36.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.915095+0000", 2024-04-24T13:32:36.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000132531 2024-04-24T13:32:36.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.920249+0000", 2024-04-24T13:32:36.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00515351 2024-04-24T13:32:36.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.926800+0000", 2024-04-24T13:32:36.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006551037 2024-04-24T13:32:36.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.926875+0000", 2024-04-24T13:32:36.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4894000000000005e-05 2024-04-24T13:32:36.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.926939+0000", 2024-04-24T13:32:36.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3904000000000003e-05 2024-04-24T13:32:36.247 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.247 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.247 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.247 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2259 3.2 3:43ddbe9c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.925834+0000", 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.2312576279999998, 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013273327999999999, 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2259 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.925834+0000", 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.925834+0000", 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.925837+0000", 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7379999999999999e-06 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927658+0000", 2024-04-24T13:32:36.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001821278 2024-04-24T13:32:36.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927689+0000", 2024-04-24T13:32:36.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1544000000000002e-05 2024-04-24T13:32:36.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927702+0000", 2024-04-24T13:32:36.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2532e-05 2024-04-24T13:32:36.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927788+0000", 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6156999999999995e-05 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927979+0000", 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019079700000000001 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.928152+0000", 2024-04-24T13:32:36.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017276800000000001 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.934746+0000", 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065945209999999999 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938978+0000", 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042313139999999999 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.939044+0000", 2024-04-24T13:32:36.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6377000000000005e-05 2024-04-24T13:32:36.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.939107+0000", 2024-04-24T13:32:36.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3301999999999998e-05 2024-04-24T13:32:36.253 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.253 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.253 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.253 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2262 3.22 3:4683919b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.253 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.958433+0000", 2024-04-24T13:32:36.253 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.1986590189999999, 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012735631000000001, 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2262 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.958433+0000", 2024-04-24T13:32:36.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.958433+0000", 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.958435+0000", 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-06 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960127+0000", 2024-04-24T13:32:36.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016921729999999999 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960160+0000", 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2227000000000002e-05 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960177+0000", 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7017999999999999e-05 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960265+0000", 2024-04-24T13:32:36.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8701000000000003e-05 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960402+0000", 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013694 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960498+0000", 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5982000000000004e-05 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.967021+0000", 2024-04-24T13:32:36.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065223599999999996 2024-04-24T13:32:36.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.971033+0000", 2024-04-24T13:32:36.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040127380000000001 2024-04-24T13:32:36.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.971104+0000", 2024-04-24T13:32:36.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1042000000000002e-05 2024-04-24T13:32:36.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.971168+0000", 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3769999999999994e-05 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2264 3.18 3:1be64b04:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.981015+0000", 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.1760765849999997, 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014016457, 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.259 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2264 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.981015+0000", 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.981015+0000", 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.981017+0000", 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1119999999999999e-06 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.982917+0000", 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001899467 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.982950+0000", 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3050999999999999e-05 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.982963+0000", 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2925000000000001e-05 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983063+0000", 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010076799999999999 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983291+0000", 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022722500000000001 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983510+0000", 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000219452 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994090+0000", 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010579912 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994900+0000", 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081024999999999999 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994973+0000", 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2723000000000002e-05 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995031+0000", 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8572000000000001e-05 2024-04-24T13:32:36.264 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2268 3.24 3:278809cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:29.026049+0000", 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.131042109, 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012981438, 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.265 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2268 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.026049+0000", 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.026049+0000", 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.026053+0000", 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3330000000000001e-06 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.027667+0000", 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001613876 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.027706+0000", 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.93e-05 2024-04-24T13:32:36.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.027720+0000", 2024-04-24T13:32:36.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.399e-05 2024-04-24T13:32:36.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.027823+0000", 2024-04-24T13:32:36.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010285099999999999 2024-04-24T13:32:36.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.028034+0000", 2024-04-24T13:32:36.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021157399999999999 2024-04-24T13:32:36.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:36.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.028214+0000", 2024-04-24T13:32:36.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000180104 2024-04-24T13:32:36.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.035480+0000", 2024-04-24T13:32:36.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072650420000000002 2024-04-24T13:32:36.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038951+0000", 2024-04-24T13:32:36.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034710460000000002 2024-04-24T13:32:36.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038995+0000", 2024-04-24T13:32:36.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4676999999999999e-05 2024-04-24T13:32:36.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.039031+0000", 2024-04-24T13:32:36.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5645000000000002e-05 2024-04-24T13:32:36.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.271 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.271 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2269 3.38 3:1d70d2f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.271 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:29.036394+0000", 2024-04-24T13:32:36.271 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.1206975999999997, 2024-04-24T13:32:36.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016649575999999999, 2024-04-24T13:32:36.271 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:36.272 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:36.272 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:36.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:36.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.272 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2269 2024-04-24T13:32:36.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.272 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:36.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.036394+0000", 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.036394+0000", 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.036397+0000", 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0340000000000001e-06 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:36.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038367+0000", 2024-04-24T13:32:36.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019698290000000002 2024-04-24T13:32:36.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:36.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038386+0000", 2024-04-24T13:32:36.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9366000000000001e-05 2024-04-24T13:32:36.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038399+0000", 2024-04-24T13:32:36.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2784e-05 2024-04-24T13:32:36.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:36.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038486+0000", 2024-04-24T13:32:36.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7457e-05 2024-04-24T13:32:36.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:36.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038684+0000", 2024-04-24T13:32:36.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000197469 2024-04-24T13:32:36.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:36.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038863+0000", 2024-04-24T13:32:36.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017951499999999999 2024-04-24T13:32:36.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:36.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.045894+0000", 2024-04-24T13:32:36.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070301590000000002 2024-04-24T13:32:36.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.052890+0000", 2024-04-24T13:32:36.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069962469999999997 2024-04-24T13:32:36.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:36.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.052972+0000", 2024-04-24T13:32:36.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1780999999999995e-05 2024-04-24T13:32:36.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:36.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:36.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:36.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.053044+0000", 2024-04-24T13:32:36.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1934999999999995e-05 2024-04-24T13:32:36.278 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.278 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.278 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.278 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:36.278 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:36.278 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:36.280 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:36.280 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:36.277+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:36.381 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:36.375+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:36.411 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:36.411 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:36.411 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:36.411 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:36.424 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:36.482 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:36.479+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:36.547 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:36.547 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:36.547 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:36.548 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:36.548 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:36.561 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:36.583 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:36.583+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:36.684 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:36.679+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:36.687 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:36.687 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 129.45861162400001, 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020457065, 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.688 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-24T13:32:36.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.689 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:36.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:36.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225903+0000", 2024-04-24T13:32:36.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7100000000000001e-06 2024-04-24T13:32:36.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225922+0000", 2024-04-24T13:32:36.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8919999999999998e-05 2024-04-24T13:32:36.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225960+0000", 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7240000000000003e-05 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225987+0000", 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6919000000000001e-05 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226300+0000", 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000313701 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:36.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226317+0000", 2024-04-24T13:32:36.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6463000000000001e-05 2024-04-24T13:32:36.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231091+0000", 2024-04-24T13:32:36.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047739169999999999 2024-04-24T13:32:36.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:32:36.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231111+0000", 2024-04-24T13:32:36.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0605999999999999e-05 2024-04-24T13:32:36.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246073+0000", 2024-04-24T13:32:36.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014961264 2024-04-24T13:32:36.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246357+0000", 2024-04-24T13:32:36.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028432499999999999 2024-04-24T13:32:36.693 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.693 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.693 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.694 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1615 3.1a 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:36.694 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:36.694 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.478798950000002, 2024-04-24T13:32:36.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020755388999999999, 2024-04-24T13:32:36.694 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.694 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.694 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.694 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:36.694 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:36.694 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1615 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205715+0000", 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4399999999999999e-06 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211414+0000", 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005699356 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211448+0000", 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4221999999999999e-05 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211466+0000", 2024-04-24T13:32:36.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7629999999999999e-05 2024-04-24T13:32:36.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211585+0000", 2024-04-24T13:32:36.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011937 2024-04-24T13:32:36.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211840+0000", 2024-04-24T13:32:36.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000254861 2024-04-24T13:32:36.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:36.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.212059+0000", 2024-04-24T13:32:36.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218789 2024-04-24T13:32:36.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:36.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.225826+0000", 2024-04-24T13:32:36.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013767061000000001 2024-04-24T13:32:36.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226295+0000", 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046917399999999999 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226388+0000", 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2190999999999999e-05 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226468+0000", 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0295000000000003e-05 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.699 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.700 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.700 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2208 3.29 e85/20 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:36.700 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:32:36.700 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.3558641970000007, 2024-04-24T13:32:36.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026370000000000001, 2024-04-24T13:32:36.700 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.700 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.700 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.700 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328650+0000", 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.413e-06 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335219+0000", 2024-04-24T13:32:36.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006569788 2024-04-24T13:32:36.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335258+0000", 2024-04-24T13:32:36.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9062e-05 2024-04-24T13:32:36.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335277+0000", 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.836e-05 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335422+0000", 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014537 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335481+0000", 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9259000000000003e-05 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354858+0000", 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019376757000000001 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.355017+0000", 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015899100000000001 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2213 3.2f 3:f4e7225c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.417904+0000", 2024-04-24T13:32:36.704 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.2666075530000001, 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019522586000000001, 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2213 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.417904+0000", 2024-04-24T13:32:36.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.417904+0000", 2024-04-24T13:32:36.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.417907+0000", 2024-04-24T13:32:36.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8899999999999999e-06 2024-04-24T13:32:36.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424088+0000", 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061813299999999996 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424111+0000", 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3113e-05 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424122+0000", 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1266e-05 2024-04-24T13:32:36.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424210+0000", 2024-04-24T13:32:36.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7690999999999998e-05 2024-04-24T13:32:36.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424356+0000", 2024-04-24T13:32:36.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014553499999999999 2024-04-24T13:32:36.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:36.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424474+0000", 2024-04-24T13:32:36.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011881500000000001 2024-04-24T13:32:36.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:36.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.436943+0000", 2024-04-24T13:32:36.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012468137000000001 2024-04-24T13:32:36.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.437296+0000", 2024-04-24T13:32:36.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035371099999999999 2024-04-24T13:32:36.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.437365+0000", 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8573999999999998e-05 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.437426+0000", 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1524000000000003e-05 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2214 3.1a 3:5b3ced30:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.438843+0000", 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.2456679879999992, 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014929534, 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2214 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.438843+0000", 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.438843+0000", 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.438845+0000", 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.367e-06 2024-04-24T13:32:36.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442803+0000", 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039578840000000001 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442829+0000", 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6628e-05 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442842+0000", 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3101e-05 2024-04-24T13:32:36.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442980+0000", 2024-04-24T13:32:36.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013741599999999999 2024-04-24T13:32:36.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.443250+0000", 2024-04-24T13:32:36.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027034200000000002 2024-04-24T13:32:36.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:36.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.443506+0000", 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025607800000000002 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.450974+0000", 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074679639999999997 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.453594+0000", 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026193840000000002 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.453699+0000", 2024-04-24T13:32:36.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010524200000000001 2024-04-24T13:32:36.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.453773+0000", 2024-04-24T13:32:36.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4128000000000006e-05 2024-04-24T13:32:36.716 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.716 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.716 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2221 3.26 e85/41 3:67d4e534:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_16:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.519722+0000", 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.1647890620000005, 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012541907999999999, 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519722+0000", 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519722+0000", 2024-04-24T13:32:36.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519724+0000", 2024-04-24T13:32:36.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7829999999999999e-06 2024-04-24T13:32:36.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522168+0000", 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024435080000000001 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522190+0000", 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2824e-05 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522203+0000", 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2394e-05 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522287+0000", 2024-04-24T13:32:36.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.462e-05 2024-04-24T13:32:36.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522310+0000", 2024-04-24T13:32:36.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2833999999999999e-05 2024-04-24T13:32:36.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532185+0000", 2024-04-24T13:32:36.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098749189999999994 2024-04-24T13:32:36.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532264+0000", 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9025999999999999e-05 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2222 3.13 3:c9a14088:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.524858+0000", 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.1596530569999999, 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01679514, 2024-04-24T13:32:36.721 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.722 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.722 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.722 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:36.722 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:36.722 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.722 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2222 2024-04-24T13:32:36.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.722 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.524858+0000", 2024-04-24T13:32:36.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.524858+0000", 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.524865+0000", 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6069999999999996e-06 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528806+0000", 2024-04-24T13:32:36.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003940743 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528824+0000", 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8423999999999998e-05 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528834+0000", 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8190000000000003e-06 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528904+0000", 2024-04-24T13:32:36.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0432000000000006e-05 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.529034+0000", 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013008299999999999 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.529153+0000", 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118348 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:36.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538128+0000", 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089753909999999992 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.541554+0000", 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034260860000000001 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.541608+0000", 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4146e-05 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.541653+0000", 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5061000000000001e-05 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2223 3.3 3:c1ee41bc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.534315+0000", 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.1501967799999999, 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015569995999999999, 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.727 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2223 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.534315+0000", 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.534315+0000", 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.534317+0000", 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0190000000000001e-06 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538250+0000", 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003933069 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538268+0000", 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8043e-05 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538283+0000", 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5590000000000002e-05 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538348+0000", 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4311000000000001e-05 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538470+0000", 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121909 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538575+0000", 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105027 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.543353+0000", 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047783419999999997 2024-04-24T13:32:36.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549659+0000", 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063060429999999999 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549768+0000", 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108587 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549885+0000", 2024-04-24T13:32:36.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117056 2024-04-24T13:32:36.733 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.733 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.733 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.733 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2224 3.2c e85/20 3:3671ead8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_19:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:36.733 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.549217+0000", 2024-04-24T13:32:36.733 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.1352940930000006, 2024-04-24T13:32:36.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011251326000000001, 2024-04-24T13:32:36.733 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.733 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.733 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.733 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549217+0000", 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549217+0000", 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549219+0000", 2024-04-24T13:32:36.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3570000000000001e-06 2024-04-24T13:32:36.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551026+0000", 2024-04-24T13:32:36.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001807428 2024-04-24T13:32:36.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551045+0000", 2024-04-24T13:32:36.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9366999999999999e-05 2024-04-24T13:32:36.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551055+0000", 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3079999999999997e-06 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551167+0000", 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112052 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551197+0000", 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0253999999999999e-05 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560393+0000", 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0091956 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560469+0000", 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5959999999999998e-05 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.737 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2234 3.34 3:2f41ca12:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.738 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.652422+0000", 2024-04-24T13:32:36.738 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.0320894559999996, 2024-04-24T13:32:36.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018886607, 2024-04-24T13:32:36.738 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.738 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.738 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.738 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:36.738 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:36.738 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.738 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2234 2024-04-24T13:32:36.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.652422+0000", 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.652422+0000", 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.652424+0000", 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1909999999999999e-06 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656447+0000", 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040232530000000001 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656472+0000", 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4338e-05 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656488+0000", 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6203999999999999e-05 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656586+0000", 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7884e-05 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656724+0000", 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013806199999999999 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:36.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656838+0000", 2024-04-24T13:32:36.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113998 2024-04-24T13:32:36.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:36.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.669565+0000", 2024-04-24T13:32:36.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012727591999999999 2024-04-24T13:32:36.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671188+0000", 2024-04-24T13:32:36.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001622533 2024-04-24T13:32:36.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671251+0000", 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3476e-05 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671309+0000", 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7076e-05 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.744 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2239 3.11 3:8b38e7d5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.744 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.709949+0000", 2024-04-24T13:32:36.744 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.9745622540000003, 2024-04-24T13:32:36.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016665736, 2024-04-24T13:32:36.744 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.744 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.744 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.744 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:36.744 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:36.744 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.744 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2239 2024-04-24T13:32:36.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.744 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.709949+0000", 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.709949+0000", 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.709952+0000", 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1540000000000002e-06 2024-04-24T13:32:36.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.713909+0000", 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039569870000000004 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.713935+0000", 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5568999999999999e-05 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.713951+0000", 2024-04-24T13:32:36.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529e-05 2024-04-24T13:32:36.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.714027+0000", 2024-04-24T13:32:36.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.538e-05 2024-04-24T13:32:36.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.714170+0000", 2024-04-24T13:32:36.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014336199999999999 2024-04-24T13:32:36.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.714282+0000", 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111912 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719419+0000", 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051373199999999999 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.726440+0000", 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070210230000000004 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.726535+0000", 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4137999999999999e-05 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.726615+0000", 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0362000000000001e-05 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.749 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2244 3.3b e85/41 3:ddfbb493:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_39:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.766818+0000", 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.9176937499999998, 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015179241, 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.766818+0000", 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.766818+0000", 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.766819+0000", 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.564e-06 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771018+0000", 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041990200000000004 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771049+0000", 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0273999999999998e-05 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771075+0000", 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6103999999999999e-05 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771212+0000", 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136933 2024-04-24T13:32:36.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771286+0000", 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4447000000000001e-05 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.781853+0000", 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010567048000000001 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.781997+0000", 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014385099999999999 2024-04-24T13:32:36.753 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.754 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.754 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.754 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2245 3.1d e85/20 3:bb337c31:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_40:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:36.754 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:36.754 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.9044298709999996, 2024-04-24T13:32:36.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01557213, 2024-04-24T13:32:36.754 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.754 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.754 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.754 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:36.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:36.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:36.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1899999999999998e-07 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784478+0000", 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00439624 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784506+0000", 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7365999999999999e-05 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784522+0000", 2024-04-24T13:32:36.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6268000000000001e-05 2024-04-24T13:32:36.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784616+0000", 2024-04-24T13:32:36.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4423e-05 2024-04-24T13:32:36.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784640+0000", 2024-04-24T13:32:36.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3906000000000001e-05 2024-04-24T13:32:36.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795548+0000", 2024-04-24T13:32:36.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01090738 2024-04-24T13:32:36.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795654+0000", 2024-04-24T13:32:36.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106128 2024-04-24T13:32:36.758 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.758 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.758 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2246 3.9 3:92c5067a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.784844+0000", 2024-04-24T13:32:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.8996674330000003, 2024-04-24T13:32:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016501108, 2024-04-24T13:32:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2246 2024-04-24T13:32:36.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784844+0000", 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784844+0000", 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784848+0000", 2024-04-24T13:32:36.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.563e-06 2024-04-24T13:32:36.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.788914+0000", 2024-04-24T13:32:36.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040666360000000002 2024-04-24T13:32:36.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.788940+0000", 2024-04-24T13:32:36.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5573999999999999e-05 2024-04-24T13:32:36.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.788952+0000", 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2431e-05 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.789037+0000", 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4593999999999997e-05 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.789171+0000", 2024-04-24T13:32:36.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134015 2024-04-24T13:32:36.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:36.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.789288+0000", 2024-04-24T13:32:36.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117512 2024-04-24T13:32:36.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:36.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.796833+0000", 2024-04-24T13:32:36.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075444029999999999 2024-04-24T13:32:36.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.801059+0000", 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042262280000000003 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.801227+0000", 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000168517 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.801345+0000", 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011763499999999999 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.764 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2248 3.1d e85/20 3:b991c377:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_43:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.809856+0000", 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.8746553070000003, 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011470594000000001, 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809856+0000", 2024-04-24T13:32:36.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809856+0000", 2024-04-24T13:32:36.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809858+0000", 2024-04-24T13:32:36.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309999999999999e-06 2024-04-24T13:32:36.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812257+0000", 2024-04-24T13:32:36.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002399329 2024-04-24T13:32:36.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812283+0000", 2024-04-24T13:32:36.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5636e-05 2024-04-24T13:32:36.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812297+0000", 2024-04-24T13:32:36.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4534e-05 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812393+0000", 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6039000000000007e-05 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812429+0000", 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5111000000000003e-05 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821231+0000", 2024-04-24T13:32:36.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088020389999999993 2024-04-24T13:32:36.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821327+0000", 2024-04-24T13:32:36.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6075000000000004e-05 2024-04-24T13:32:36.769 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.769 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.769 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.769 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2253 3.27 e85/20 3:e6835017:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_48:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:36.769 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.859419+0000", 2024-04-24T13:32:36.770 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.8250920510000004, 2024-04-24T13:32:36.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012299842, 2024-04-24T13:32:36.770 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.770 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.770 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.770 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.859419+0000", 2024-04-24T13:32:36.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.859419+0000", 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.859421+0000", 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0329999999999998e-06 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863395+0000", 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039737339999999996 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863425+0000", 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9793000000000001e-05 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863439+0000", 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.446e-05 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863598+0000", 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015820600000000001 2024-04-24T13:32:36.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863638+0000", 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0225999999999997e-05 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.871631+0000", 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079935089999999993 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.871719+0000", 2024-04-24T13:32:36.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7880999999999994e-05 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2255 3.29 e85/20 3:979257ba:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_50:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.881386+0000", 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.8031257329999999, 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011529885, 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881386+0000", 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881386+0000", 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881413+0000", 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7619000000000001e-05 2024-04-24T13:32:36.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885724+0000", 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043102339999999996 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885760+0000", 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6501999999999997e-05 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885777+0000", 2024-04-24T13:32:36.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7183000000000001e-05 2024-04-24T13:32:36.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885917+0000", 2024-04-24T13:32:36.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139491 2024-04-24T13:32:36.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885959+0000", 2024-04-24T13:32:36.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2023000000000001e-05 2024-04-24T13:32:36.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892786+0000", 2024-04-24T13:32:36.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068271720000000003 2024-04-24T13:32:36.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892916+0000", 2024-04-24T13:32:36.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012966099999999999 2024-04-24T13:32:36.778 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.778 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.778 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.778 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2271 3.13 3:cb7d029e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.056244+0000", 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.6282669250000001, 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019201421, 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2271 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.056244+0000", 2024-04-24T13:32:36.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.056244+0000", 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.056259+0000", 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4099e-05 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060075+0000", 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038163260000000001 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060103+0000", 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7949e-05 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060115+0000", 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2298e-05 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060216+0000", 2024-04-24T13:32:36.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100883 2024-04-24T13:32:36.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060366+0000", 2024-04-24T13:32:36.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015035999999999999 2024-04-24T13:32:36.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:36.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060509+0000", 2024-04-24T13:32:36.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142516 2024-04-24T13:32:36.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:36.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.067630+0000", 2024-04-24T13:32:36.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00712066 2024-04-24T13:32:36.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.075349+0000", 2024-04-24T13:32:36.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077195789999999999 2024-04-24T13:32:36.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.075402+0000", 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2905000000000003e-05 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.075446+0000", 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3846e-05 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2273 3.1c 3:386b02cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.784 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.077819+0000", 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.6066926700000002, 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016399364, 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2273 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.077819+0000", 2024-04-24T13:32:36.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.077819+0000", 2024-04-24T13:32:36.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.077820+0000", 2024-04-24T13:32:36.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5740000000000001e-06 2024-04-24T13:32:36.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081705+0000", 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038844040000000002 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081723+0000", 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7892000000000001e-05 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081732+0000", 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0569999999999999e-06 2024-04-24T13:32:36.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081812+0000", 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0476000000000007e-05 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081961+0000", 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014850599999999999 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.082094+0000", 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013324300000000001 2024-04-24T13:32:36.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088394+0000", 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062996700000000003 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.094036+0000", 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056424860000000004 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.094144+0000", 2024-04-24T13:32:36.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107983 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.094218+0000", 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4072999999999994e-05 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2274 3.2f 3:f7fb6ab2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.088365+0000", 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.5961459250000001, 2024-04-24T13:32:36.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012884712, 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2274 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088365+0000", 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088365+0000", 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088368+0000", 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.261e-06 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092225+0000", 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003857316 2024-04-24T13:32:36.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092243+0000", 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7606999999999999e-05 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092253+0000", 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0095000000000001e-05 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092315+0000", 2024-04-24T13:32:36.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2426000000000002e-05 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092429+0000", 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113515 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092527+0000", 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8812000000000002e-05 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:36.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.096526+0000", 2024-04-24T13:32:36.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039980129999999999 2024-04-24T13:32:36.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:36.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.101159+0000", 2024-04-24T13:32:36.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046330169999999997 2024-04-24T13:32:36.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:36.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.101209+0000", 2024-04-24T13:32:36.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0869999999999999e-05 2024-04-24T13:32:36.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:36.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:36.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:36.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.101250+0000", 2024-04-24T13:32:36.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0779999999999999e-05 2024-04-24T13:32:36.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.796 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:36.796 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:36.796 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:36.798 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:36.798 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:36.793+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:36.898 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:36.897+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:36.966 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:36.966 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:36.966 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:36.966 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:36.980 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:37.023 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:37.021+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:37.102 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:37.101+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:37.144 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:37.145 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:37.145 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:37.145 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:37.145 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:37.159 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:37.203 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:37.199+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:37.305 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:37.299+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:37.332 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:37.333 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:37.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:37.333 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:37.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.333 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:37.333 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:37.333 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 128.04997790600001, 2024-04-24T13:32:37.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048388950000000002, 2024-04-24T13:32:37.333 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.333 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.333 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.333 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:37.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3799999999999998e-06 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279193+0000", 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7674e-05 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279224+0000", 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0654000000000002e-05 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279244+0000", 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279426+0000", 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018255300000000001 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279717+0000", 2024-04-24T13:32:37.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029043800000000001 2024-04-24T13:32:37.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:37.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279993+0000", 2024-04-24T13:32:37.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276786 2024-04-24T13:32:37.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282898+0000", 2024-04-24T13:32:37.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002904093 2024-04-24T13:32:37.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283731+0000", 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00083382599999999997 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283886+0000", 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015512600000000001 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284001+0000", 2024-04-24T13:32:37.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114405 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410010339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 128.044853311, 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044116340000000002, 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.339 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284289+0000", 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.125e-06 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284299+0000", 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0485999999999999e-05 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284330+0000", 2024-04-24T13:32:37.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0528000000000003e-05 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284345+0000", 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4883e-05 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284484+0000", 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139708 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284655+0000", 2024-04-24T13:32:37.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170953 2024-04-24T13:32:37.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:37.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284981+0000", 2024-04-24T13:32:37.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000325648 2024-04-24T13:32:37.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.287326+0000", 2024-04-24T13:32:37.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023452709999999999 2024-04-24T13:32:37.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288427+0000", 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001100544 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288551+0000", 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012466500000000001 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288698+0000", 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146823 2024-04-24T13:32:37.344 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 125.065640426, 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047820809999999997, 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.345 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-24T13:32:37.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.346 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:37.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:37.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263503+0000", 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.039e-06 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263520+0000", 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7198e-05 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263548+0000", 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8158e-05 2024-04-24T13:32:37.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263565+0000", 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7008e-05 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263754+0000", 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001894 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263973+0000", 2024-04-24T13:32:37.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218593 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.264373+0000", 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040043400000000002 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.266377+0000", 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020033030000000001 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268121+0000", 2024-04-24T13:32:37.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017441049999999999 2024-04-24T13:32:37.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268212+0000", 2024-04-24T13:32:37.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1490000000000007e-05 2024-04-24T13:32:37.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268282+0000", 2024-04-24T13:32:37.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9352999999999998e-05 2024-04-24T13:32:37.350 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.350 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 124.985928274, 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034252639999999999, 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.351 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 220 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343214+0000", 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343227+0000", 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2941e-05 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343259+0000", 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1557000000000003e-05 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343274+0000", 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5401999999999999e-05 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343455+0000", 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018068700000000001 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343694+0000", 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238552 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:37.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.344088+0000", 2024-04-24T13:32:37.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039456400000000003 2024-04-24T13:32:37.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.345723+0000", 2024-04-24T13:32:37.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016349139999999999 2024-04-24T13:32:37.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346480+0000", 2024-04-24T13:32:37.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075738300000000004 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346569+0000", 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8281000000000004e-05 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346637+0000", 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8165999999999998e-05 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 124.968187977, 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032957419999999999, 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.357 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360954+0000", 2024-04-24T13:32:37.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.154e-06 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360965+0000", 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1321999999999999e-05 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360996+0000", 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0902999999999999e-05 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361012+0000", 2024-04-24T13:32:37.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361185+0000", 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172072 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361404+0000", 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021965999999999999 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:37.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361852+0000", 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000448276 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.363340+0000", 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001487169 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364094+0000", 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075443699999999995 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364184+0000", 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9957000000000006e-05 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364248+0000", 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3627000000000006e-05 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:37.362 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 124.96462313000001, 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036426480000000001, 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:37.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364519+0000", 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364529+0000", 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088999999999999e-05 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364554+0000", 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5537e-05 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364568+0000", 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3372e-05 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364726+0000", 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015809299999999999 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365059+0000", 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000333185 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365758+0000", 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069934299999999995 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.367413+0000", 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016552349999999999 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368012+0000", 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059858700000000003 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368097+0000", 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5253999999999994e-05 2024-04-24T13:32:37.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368159+0000", 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2113000000000007e-05 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 124.93523649399999, 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033998840000000002, 2024-04-24T13:32:37.368 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:37.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393906+0000", 2024-04-24T13:32:37.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1569999999999998e-06 2024-04-24T13:32:37.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393917+0000", 2024-04-24T13:32:37.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1348999999999999e-05 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393942+0000", 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.527e-05 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393957+0000", 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4355999999999999e-05 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394127+0000", 2024-04-24T13:32:37.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170555 2024-04-24T13:32:37.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394352+0000", 2024-04-24T13:32:37.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224539 2024-04-24T13:32:37.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:37.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394788+0000", 2024-04-24T13:32:37.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043600099999999999 2024-04-24T13:32:37.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.396137+0000", 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001349404 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397158+0000", 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001020738 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397237+0000", 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9319000000000004e-05 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397303+0000", 2024-04-24T13:32:37.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6196000000000001e-05 2024-04-24T13:32:37.374 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.374 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.374 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.374 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:437 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:37.374 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:37.374 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 124.8656129, 2024-04-24T13:32:37.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048056540000000003, 2024-04-24T13:32:37.374 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.374 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 437 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463529+0000", 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2479999999999999e-06 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463544+0000", 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463572+0000", 2024-04-24T13:32:37.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8294e-05 2024-04-24T13:32:37.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463590+0000", 2024-04-24T13:32:37.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-24T13:32:37.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464092+0000", 2024-04-24T13:32:37.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000502189 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464454+0000", 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036231300000000001 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464831+0000", 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000377375 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467473+0000", 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026414659999999999 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468185+0000", 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071215199999999997 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468271+0000", 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5593999999999994e-05 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468333+0000", 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1957000000000003e-05 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 124.459963151, 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033442569999999998, 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.380 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 793 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:37.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869179+0000", 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.323e-06 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869190+0000", 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869222+0000", 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1733999999999998e-05 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869237+0000", 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5044e-05 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869396+0000", 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158913 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869763+0000", 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367112 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.870319+0000", 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055558799999999998 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.871509+0000", 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001190607 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872365+0000", 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085535299999999999 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872449+0000", 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3834999999999999e-05 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872521+0000", 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2428999999999994e-05 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.385 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 124.273956779, 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003340754, 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.386 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 874 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055185+0000", 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055197+0000", 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1606e-05 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055229+0000", 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1603000000000002e-05 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055244+0000", 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4928e-05 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055397+0000", 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015366499999999999 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055763+0000", 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036565600000000001 2024-04-24T13:32:37.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.056317+0000", 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055436600000000004 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.057678+0000", 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001361283 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058258+0000", 2024-04-24T13:32:37.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057942400000000004 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058407+0000", 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000149188 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058524+0000", 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116805 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.392 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1566 4.38 4:1cdfa9df:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.3.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:37.392 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:37.392 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.772965505999998, 2024-04-24T13:32:37.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040238560000000001, 2024-04-24T13:32:37.392 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.392 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.392 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.392 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.392 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.392 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.392 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1566 2024-04-24T13:32:37.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556176+0000", 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.057e-06 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556187+0000", 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0693000000000001e-05 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556219+0000", 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1718999999999999e-05 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556242+0000", 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2687000000000001e-05 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556384+0000", 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014257899999999999 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556624+0000", 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024014199999999999 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556921+0000", 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029673900000000002 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.559462+0000", 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025407530000000002 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560009+0000", 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054690399999999997 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560096+0000", 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7597999999999997e-05 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560198+0000", 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010198499999999999 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1721 4.38 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:37.397 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:37.398 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.578599046000001, 2024-04-24T13:32:37.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088323519999999999, 2024-04-24T13:32:37.398 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.398 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.398 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.398 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.398 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.398 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.398 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1721 2024-04-24T13:32:37.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.398 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750544+0000", 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9569999999999998e-06 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750561+0000", 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7589e-05 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750600+0000", 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8145999999999997e-05 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750621+0000", 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1109999999999999e-05 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750797+0000", 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017672599999999999 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751113+0000", 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031514599999999998 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751586+0000", 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047325699999999999 2024-04-24T13:32:37.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753982+0000", 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023960880000000002 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759108+0000", 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051256590000000003 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759247+0000", 2024-04-24T13:32:37.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013992400000000001 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759373+0000", 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012574999999999999 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1724 4.38 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.578472892000001, 2024-04-24T13:32:37.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093322379999999996, 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1724 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750669+0000", 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7269999999999999e-06 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750678+0000", 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9700000000000005e-06 2024-04-24T13:32:37.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750744+0000", 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5920999999999994e-05 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750766+0000", 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.226e-05 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752483+0000", 2024-04-24T13:32:37.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001717393 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752795+0000", 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031186000000000001 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753283+0000", 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048743300000000001 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.756401+0000", 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031181220000000001 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759844+0000", 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003443715 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759934+0000", 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9728000000000006e-05 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759999+0000", 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5109000000000003e-05 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1814 4.38 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.387685715, 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065250220000000001, 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.409 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.410 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.410 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.410 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1814 2024-04-24T13:32:37.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.410 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:37.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941457+0000", 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941467+0000", 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0596e-05 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941503+0000", 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5398999999999998e-05 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941524+0000", 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1586e-05 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941687+0000", 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016257000000000001 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941919+0000", 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232315 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942204+0000", 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028527000000000001 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.945033+0000", 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028291029999999999 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947677+0000", 2024-04-24T13:32:37.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026439649999999999 2024-04-24T13:32:37.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947848+0000", 2024-04-24T13:32:37.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017036699999999999 2024-04-24T13:32:37.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947979+0000", 2024-04-24T13:32:37.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131524 2024-04-24T13:32:37.414 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1817 4.38 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.387576767999999, 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079573279999999996, 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.415 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1817 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941565+0000", 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.657e-06 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941573+0000", 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4169999999999992e-06 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941596+0000", 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2535999999999999e-05 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941610+0000", 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3746e-05 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944182+0000", 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025729540000000001 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944388+0000", 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000205183 2024-04-24T13:32:37.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944557+0000", 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016964200000000001 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.946998+0000", 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024406670000000001 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949247+0000", 2024-04-24T13:32:37.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022489490000000001 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949406+0000", 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000159436 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949520+0000", 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114141 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2212 3.3a 3:5de7fd4f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.9309116080000006, 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024848709, 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2212 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398232+0000", 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-24T13:32:37.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405320+0000", 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070884040000000004 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405367+0000", 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6940000000000001e-05 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405393+0000", 2024-04-24T13:32:37.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5252000000000001e-05 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405487+0000", 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4596e-05 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405609+0000", 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121892 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:37.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405710+0000", 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010121899999999999 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.415423+0000", 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097131219999999994 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.422967+0000", 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00754319 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.423023+0000", 2024-04-24T13:32:37.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5958000000000002e-05 2024-04-24T13:32:37.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.423077+0000", 2024-04-24T13:32:37.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4432999999999999e-05 2024-04-24T13:32:37.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.426 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.426 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.426 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2245 3.1d 3:bb337c31:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.5536347849999999, 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020498309999999999, 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:37.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:37.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775508+0000", 2024-04-24T13:32:37.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.486e-06 2024-04-24T13:32:37.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779469+0000", 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003961862 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779497+0000", 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7559000000000002e-05 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779513+0000", 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6450999999999999e-05 2024-04-24T13:32:37.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779626+0000", 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112478 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779794+0000", 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016824099999999999 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779922+0000", 2024-04-24T13:32:37.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012780199999999999 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.793374+0000", 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013451942 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795894+0000", 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025205079999999999 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795951+0000", 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6131000000000002e-05 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.796003+0000", 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2849999999999997e-05 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2248 3.1d 3:b991c377:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:37.432 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.5238455220000002, 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016320675999999999, 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2248 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:37.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805301+0000", 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1399999999999997e-06 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809310+0000", 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040090179999999996 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809337+0000", 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7636000000000001e-05 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809351+0000", 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3728e-05 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809435+0000", 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3956999999999996e-05 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809588+0000", 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015312299999999999 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809713+0000", 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012522299999999999 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.815947+0000", 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062333359999999999 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821522+0000", 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055754239999999998 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821572+0000", 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0005e-05 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821615+0000", 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3086e-05 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2250 3.3c 3:3d3fcdd2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.5050804590000002, 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018935203000000001, 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.438 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.439 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.439 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.439 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.439 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2250 2024-04-24T13:32:37.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.439 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:37.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824061+0000", 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.725e-06 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827859+0000", 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037982960000000001 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827885+0000", 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5761e-05 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827896+0000", 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1136e-05 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828017+0000", 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012102100000000001 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828290+0000", 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027271199999999999 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828528+0000", 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023780599999999999 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.835369+0000", 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068407609999999999 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842842+0000", 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074735390000000004 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842928+0000", 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5513999999999995e-05 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842995+0000", 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6932000000000002e-05 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.443 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2251 3.3a 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.4942622130000007, 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030524880000000001, 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2251 2024-04-24T13:32:37.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834880+0000", 2024-04-24T13:32:37.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6769999999999999e-06 2024-04-24T13:32:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839556+0000", 2024-04-24T13:32:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046751350000000004 2024-04-24T13:32:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839593+0000", 2024-04-24T13:32:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7079999999999997e-05 2024-04-24T13:32:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839617+0000", 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4015999999999998e-05 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839773+0000", 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015627699999999999 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840011+0000", 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023843900000000001 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840261+0000", 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024939899999999997 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.853562+0000", 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013301726999999999 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865276+0000", 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011713779000000001 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865349+0000", 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2624000000000001e-05 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865403+0000", 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3727000000000002e-05 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.449 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:37.451 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:37.451 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:37.447+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:37.477 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:32:37.551 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:37.547+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:37.581 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:37.581 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:37.581 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:37.581 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:37.596 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:37.652 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:37.649+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:37.719 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:37.719 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:37.719 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:37.719 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:37.719 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:37.734 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:37.775 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:37.773+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:37.854 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:37.851+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:37.903 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:37.904 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:37.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:37.904 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:37.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.904 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:37.904 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:37.904 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 128.65548022799999, 2024-04-24T13:32:37.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:32:37.904 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.904 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.904 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.904 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:37.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:32:37.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:32:37.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:32:37.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:32:37.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:32:37.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:32:37.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:32:37.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:32:37.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:32:37.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:32:37.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:32:37.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1618 3.36 3:6e88aafa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:37.911 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.670704815000001, 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025620654, 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1618 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229083+0000", 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2100000000000002e-06 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234443+0000", 2024-04-24T13:32:37.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053597139999999998 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234484+0000", 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0902999999999998e-05 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234502+0000", 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8252000000000001e-05 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234657+0000", 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015551000000000001 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234920+0000", 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263114 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.236227+0000", 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001306179 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.251163+0000", 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014936766000000001 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254465+0000", 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003301151 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254581+0000", 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116224 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254700+0000", 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011963099999999999 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2207 3.38 e85/74 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.5917627670000005, 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015720683999999999, 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.917 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.918 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.918 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:37.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:37.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308024+0000", 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314047+0000", 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060226259999999997 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314095+0000", 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7803000000000003e-05 2024-04-24T13:32:37.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314118+0000", 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3218999999999999e-05 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314281+0000", 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016252399999999999 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314321+0000", 2024-04-24T13:32:37.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0213000000000003e-05 2024-04-24T13:32:37.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.323647+0000", 2024-04-24T13:32:37.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093264079999999996 2024-04-24T13:32:37.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.323742+0000", 2024-04-24T13:32:37.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5198000000000006e-05 2024-04-24T13:32:37.921 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.921 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.921 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2209 3.14 e85/48 3:287cf44b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_4:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.5604090070000005, 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01556167, 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:37.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0699999999999997e-07 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344736+0000", 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053602750000000003 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344764+0000", 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8033000000000001e-05 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344779+0000", 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4693e-05 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344934+0000", 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520399999999999 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344975+0000", 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0368999999999999e-05 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354882+0000", 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099076630000000006 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354937+0000", 2024-04-24T13:32:37.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4926000000000002e-05 2024-04-24T13:32:37.926 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.926 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.926 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.926 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2221 3.26 3:67d4e534:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.926 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:37.926 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3852581869999998, 2024-04-24T13:32:37.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017991152999999999, 2024-04-24T13:32:37.926 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2221 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514529+0000", 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3080000000000002e-06 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519181+0000", 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046525129999999996 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519216+0000", 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5181000000000001e-05 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519228+0000", 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1253000000000001e-05 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519324+0000", 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6564000000000006e-05 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519463+0000", 2024-04-24T13:32:37.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139269 2024-04-24T13:32:37.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:37.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519597+0000", 2024-04-24T13:32:37.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013386999999999999 2024-04-24T13:32:37.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532228+0000", 2024-04-24T13:32:37.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012631009 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532440+0000", 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021200400000000001 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532479+0000", 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8668000000000003e-05 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532518+0000", 2024-04-24T13:32:37.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8513999999999998e-05 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2224 3.2c 3:3671ead8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3550767019999999, 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016019095000000001, 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.933 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.933 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2224 2024-04-24T13:32:37.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.933 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:37.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:37.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544710+0000", 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5040000000000001e-06 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548580+0000", 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003869473 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548609+0000", 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9623000000000001e-05 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548623+0000", 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3498e-05 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548709+0000", 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6390000000000005e-05 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548989+0000", 2024-04-24T13:32:37.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027985500000000002 2024-04-24T13:32:37.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:37.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549084+0000", 2024-04-24T13:32:37.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4568999999999995e-05 2024-04-24T13:32:37.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.559986+0000", 2024-04-24T13:32:37.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010902692 2024-04-24T13:32:37.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560649+0000", 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066290299999999995 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560687+0000", 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7644000000000001e-05 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560727+0000", 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9944000000000002e-05 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.937 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2231 3.36 3:6ddceaef:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.2808716780000005, 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017463218999999999, 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.938 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2231 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618915+0000", 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5620000000000002e-06 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622655+0000", 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003739984 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622683+0000", 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7390999999999999e-05 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622697+0000", 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3694e-05 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622795+0000", 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8518999999999996e-05 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.623022+0000", 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022680700000000001 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:37.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.623244+0000", 2024-04-24T13:32:37.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022219199999999999 2024-04-24T13:32:37.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634301+0000", 2024-04-24T13:32:37.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011056718 2024-04-24T13:32:37.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636075+0000", 2024-04-24T13:32:37.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001774437 2024-04-24T13:32:37.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636243+0000", 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016734399999999999 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636376+0000", 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000133571 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2232 3.a 3:53fed644:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.2691346499999998, 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017222277000000001, 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2232 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630652+0000", 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5119999999999998e-06 2024-04-24T13:32:37.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634591+0000", 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039383990000000004 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634610+0000", 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9530000000000001e-05 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634620+0000", 2024-04-24T13:32:37.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0081000000000001e-05 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634679+0000", 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8483999999999998e-05 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634807+0000", 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012772 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634918+0000", 2024-04-24T13:32:37.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011121 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.641801+0000", 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006883213 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647770+0000", 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059689729999999998 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647818+0000", 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8455000000000003e-05 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647872+0000", 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3699999999999997e-05 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2233 3.c e85/74 3:3257d695:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_28:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:37.949 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.2564936679999992, 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015313149, 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:37.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643292+0000", 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4980000000000001e-06 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647384+0000", 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040918980000000001 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647409+0000", 2024-04-24T13:32:37.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4719000000000002e-05 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647421+0000", 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1956999999999999e-05 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647575+0000", 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015421900000000001 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647642+0000", 2024-04-24T13:32:37.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6822000000000005e-05 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.658477+0000", 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010835200999999999 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.658604+0000", 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126835 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.954 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2234 3.34 e85/20 3:2f41ca12:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_29:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:37.954 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:37.954 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.2427685349999997, 2024-04-24T13:32:37.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013995339000000001, 2024-04-24T13:32:37.954 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.954 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.954 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.954 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.954 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.954 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:37.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657018+0000", 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0700000000000001e-06 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659913+0000", 2024-04-24T13:32:37.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028946079999999999 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659934+0000", 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1154000000000001e-05 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659946+0000", 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1958e-05 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.660012+0000", 2024-04-24T13:32:37.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5870000000000005e-05 2024-04-24T13:32:37.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.660041+0000", 2024-04-24T13:32:37.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9280000000000001e-05 2024-04-24T13:32:37.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.670873+0000", 2024-04-24T13:32:37.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010831591999999999 2024-04-24T13:32:37.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671011+0000", 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013880699999999999 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2238 3.20 3:07ab05cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.2010419639999999, 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019528604000000001, 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.958 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2238 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:37.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698745+0000", 2024-04-24T13:32:37.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-24T13:32:37.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702722+0000", 2024-04-24T13:32:37.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039764370000000002 2024-04-24T13:32:37.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702755+0000", 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3676000000000001e-05 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702771+0000", 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5823000000000001e-05 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702854+0000", 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2804000000000002e-05 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702974+0000", 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120258 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.703104+0000", 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129708 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.710231+0000", 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071274570000000002 2024-04-24T13:32:37.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718023+0000", 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077912720000000001 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718164+0000", 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014127500000000001 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718271+0000", 2024-04-24T13:32:37.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107371 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2240 3.3f 3:fe4f476b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.1804924939999992, 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014610142, 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.964 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2240 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719294+0000", 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0770000000000002e-06 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723057+0000", 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037627060000000002 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723089+0000", 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1968999999999998e-05 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723100+0000", 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0695e-05 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723176+0000", 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6589999999999997e-05 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723313+0000", 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136806 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723434+0000", 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120835 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.727850+0000", 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044163229999999998 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733804+0000", 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059542620000000001 2024-04-24T13:32:37.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733849+0000", 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4455e-05 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733902+0000", 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3424000000000002e-05 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.969 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2247 3.2a 3:56a679bb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.970 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:37.970 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.1049143140000002, 2024-04-24T13:32:37.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018867848, 2024-04-24T13:32:37.970 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.970 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.970 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.970 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.970 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.971 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.971 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2247 2024-04-24T13:32:37.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.971 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:37.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:37.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794873+0000", 2024-04-24T13:32:37.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7130000000000001e-06 2024-04-24T13:32:37.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799547+0000", 2024-04-24T13:32:37.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004674114 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799586+0000", 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9279999999999997e-05 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799613+0000", 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6239000000000001e-05 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799734+0000", 2024-04-24T13:32:37.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120964 2024-04-24T13:32:37.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799986+0000", 2024-04-24T13:32:37.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025243200000000003 2024-04-24T13:32:37.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:37.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.800155+0000", 2024-04-24T13:32:37.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016893400000000001 2024-04-24T13:32:37.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.806810+0000", 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066547459999999996 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813614+0000", 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068047730000000001 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813684+0000", 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9504000000000004e-05 2024-04-24T13:32:37.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813738+0000", 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4148999999999999e-05 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2254 3.20 3:079960b7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.0315313629999991, 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019983331, 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.976 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2254 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868256+0000", 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8890000000000002e-06 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872066+0000", 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038094549999999998 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872090+0000", 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4933e-05 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872104+0000", 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3246e-05 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872222+0000", 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118266 2024-04-24T13:32:37.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872485+0000", 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026320500000000003 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872713+0000", 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022758000000000001 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881332+0000", 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086188640000000004 2024-04-24T13:32:37.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.887928+0000", 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065959490000000003 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.888112+0000", 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018435700000000001 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.888237+0000", 2024-04-24T13:32:37.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012458700000000001 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2256 3.21 e85/74 3:878222a6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_51:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.0074339380000001, 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013390116000000001, 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892353+0000", 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5629999999999999e-06 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896496+0000", 2024-04-24T13:32:37.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041424840000000001 2024-04-24T13:32:37.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896531+0000", 2024-04-24T13:32:37.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5682999999999997e-05 2024-04-24T13:32:37.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896549+0000", 2024-04-24T13:32:37.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7909000000000001e-05 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896687+0000", 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013818200000000001 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896723+0000", 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5194999999999998e-05 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.905615+0000", 2024-04-24T13:32:37.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088924759999999999 2024-04-24T13:32:37.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.905741+0000", 2024-04-24T13:32:37.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012562399999999999 2024-04-24T13:32:37.986 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.986 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.986 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.986 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2263 3.26 3:64e2178e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.986 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:37.986 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.9318968660000007, 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014626548, 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2263 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967890+0000", 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9470000000000002e-06 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971675+0000", 2024-04-24T13:32:37.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037854350000000002 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971700+0000", 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4678e-05 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971710+0000", 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0059e-05 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971802+0000", 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2118000000000001e-05 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971952+0000", 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015013599999999999 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.972085+0000", 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132946 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.981987+0000", 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099020819999999996 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982408+0000", 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042130500000000002 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982466+0000", 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7629e-05 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982514+0000", 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8213000000000001e-05 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2267 3.3f 3:fe72662d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.8846877679999992, 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018629916999999999, 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.992 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.993 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.993 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:37.993 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:37.993 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:37.993 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2267 2024-04-24T13:32:37.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.993 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:37.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:37.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:37.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015099+0000", 2024-04-24T13:32:37.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2199999999999999e-06 2024-04-24T13:32:37.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:37.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018921+0000", 2024-04-24T13:32:37.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038224579999999999 2024-04-24T13:32:37.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:37.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018941+0000", 2024-04-24T13:32:37.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9945999999999998e-05 2024-04-24T13:32:37.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:37.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018952+0000", 2024-04-24T13:32:37.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0361e-05 2024-04-24T13:32:37.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019017+0000", 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5068999999999997e-05 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019148+0000", 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013165299999999999 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019247+0000", 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.87e-05 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:37.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.025115+0000", 2024-04-24T13:32:37.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058674909999999999 2024-04-24T13:32:37.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:37.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033545+0000", 2024-04-24T13:32:37.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084303639999999992 2024-04-24T13:32:37.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:37.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033659+0000", 2024-04-24T13:32:37.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114131 2024-04-24T13:32:37.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:37.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033727+0000", 2024-04-24T13:32:37.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7523999999999999e-05 2024-04-24T13:32:37.998 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.998 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:37.998 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:37.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.998 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2269 3.38 e85/74 3:1d70d2f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_64:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:37.998 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:37.998 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.8614343229999992, 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013439965, 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:37.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:38.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038352+0000", 2024-04-24T13:32:38.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4500000000000001e-06 2024-04-24T13:32:38.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:38.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042479+0000", 2024-04-24T13:32:38.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041270819999999998 2024-04-24T13:32:38.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:38.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042517+0000", 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8550000000000002e-05 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042535+0000", 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8093000000000001e-05 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042678+0000", 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014304399999999999 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042722+0000", 2024-04-24T13:32:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3179000000000001e-05 2024-04-24T13:32:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051734+0000", 2024-04-24T13:32:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0090125280000000006 2024-04-24T13:32:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051790+0000", 2024-04-24T13:32:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6039000000000003e-05 2024-04-24T13:32:38.002 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2270 3.a 3:52207169:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.8530298619999996, 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014332798000000001, 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:38.003 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2270 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046757+0000", 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2450000000000001e-06 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050608+0000", 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038509949999999999 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050632+0000", 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4450000000000001e-05 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:38.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050646+0000", 2024-04-24T13:32:38.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3273e-05 2024-04-24T13:32:38.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:38.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050743+0000", 2024-04-24T13:32:38.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7190999999999998e-05 2024-04-24T13:32:38.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:38.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050918+0000", 2024-04-24T13:32:38.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017516600000000001 2024-04-24T13:32:38.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:38.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051100+0000", 2024-04-24T13:32:38.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018168700000000001 2024-04-24T13:32:38.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:38.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.055983+0000", 2024-04-24T13:32:38.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048829379999999999 2024-04-24T13:32:38.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060902+0000", 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049192430000000002 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.061003+0000", 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101351 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.061087+0000", 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4258999999999994e-05 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:38.008 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:38.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.009 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2279 3.2a 3:57162c53:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:38.009 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:38.009 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 8.7593861850000003, 2024-04-24T13:32:38.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016593472000000001, 2024-04-24T13:32:38.009 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:38.009 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:38.009 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:38.009 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:38.009 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:38.009 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:38.009 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2279 2024-04-24T13:32:38.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.010 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:38.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:38.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:38.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:38.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:38.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:38.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:38.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:38.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140401+0000", 2024-04-24T13:32:38.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5950000000000001e-06 2024-04-24T13:32:38.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:38.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144257+0000", 2024-04-24T13:32:38.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038560869999999998 2024-04-24T13:32:38.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:38.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144277+0000", 2024-04-24T13:32:38.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9976e-05 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144288+0000", 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.059e-05 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144359+0000", 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1550000000000004e-05 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144501+0000", 2024-04-24T13:32:38.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014193499999999999 2024-04-24T13:32:38.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:38.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144633+0000", 2024-04-24T13:32:38.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131748 2024-04-24T13:32:38.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:38.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.148819+0000", 2024-04-24T13:32:38.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041860140000000001 2024-04-24T13:32:38.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156831+0000", 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080120120000000006 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156920+0000", 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9112999999999999e-05 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156992+0000", 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1852000000000003e-05 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:38.014 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:38.015 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:38.015 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:38.015 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:38.015 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:38.017 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:38.017 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:38.015+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:38.117 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:38.113+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:38.135 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:32:38.144 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:38.144 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:38.144 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:38.144 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:38.158 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:32:38.217 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:38.211+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:38.289 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:38.290 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:38.306 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:38.306 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:38.318 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:38.317+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:38.322 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:38.322 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:38.329 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:38.330 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:38.330 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:38.330 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:38.330 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:38.338 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:38.338 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:38.343 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:32:38.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:38.356 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:38.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:38.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:38.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:38.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:38.413 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:38.413 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:38.419 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:38.415+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:38.454 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:32:38.515 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:38.515 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:38.520 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:38.515+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:38.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:32:38.621 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:38.615+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:38.658 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:38.658 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:38.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:32:38.758 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:38.755+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:38.822 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:38.821+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:38.836 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:38.837 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:38.851 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:32:38.938 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:38.935+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:39.018 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:39.018 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:39.024 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:39.019+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:39.033 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:32:39.124 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:39.119+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:39.198 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:39.198 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:39.212 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:32:39.225 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:39.221+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:39.326 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:39.323+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:39.377 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:39.377 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:39.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:32:39.440 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:39.435+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:39.528 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:39.525+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:39.578 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:39.579 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:39.593 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:32:39.629 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:39.625+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:39.726 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:39.726 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:39.729 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:39.723+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:39.740 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:32:39.830 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:39.823+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:39.908 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:39.908 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:39.923 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:32:39.931 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:39.929+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:40.032 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:40.027+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:40.093 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:40.093 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:40.108 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:40.132 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:40.129+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:40.233 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:40.227+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:40.273 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:40.273 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:40.287 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:40.375 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:40.371+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:40.431 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:32:40.436 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:40.431+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:40.456 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:40.456 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:40.471 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:40.475 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:32:40.567 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:40.563+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:40.592 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:40.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:40.610 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:40.610 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:40.627 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:40.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:40.635 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:40.631+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:40.644 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:40.644 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:40.654 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:207 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 128.37660636199999, 2024-04-24T13:32:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011439347000000001, 2024-04-24T13:32:40.655 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 207 2024-04-24T13:32:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275916+0000", 2024-04-24T13:32:40.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275921+0000", 2024-04-24T13:32:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0629999999999999e-06 2024-04-24T13:32:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275940+0000", 2024-04-24T13:32:40.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9066e-05 2024-04-24T13:32:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.275989+0000", 2024-04-24T13:32:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9162000000000001e-05 2024-04-24T13:32:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276013+0000", 2024-04-24T13:32:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4332999999999999e-05 2024-04-24T13:32:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276162+0000", 2024-04-24T13:32:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014894800000000001 2024-04-24T13:32:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:32:40.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.276172+0000", 2024-04-24T13:32:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999997e-06 2024-04-24T13:32:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283618+0000", 2024-04-24T13:32:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074457730000000001 2024-04-24T13:32:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.283850+0000", 2024-04-24T13:32:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023247599999999999 2024-04-24T13:32:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:32:40.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.284203+0000", 2024-04-24T13:32:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000353226 2024-04-24T13:32:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.285440+0000", 2024-04-24T13:32:40.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012367369999999999 2024-04-24T13:32:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287199+0000", 2024-04-24T13:32:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001758374 2024-04-24T13:32:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287289+0000", 2024-04-24T13:32:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0210999999999994e-05 2024-04-24T13:32:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:32.287356+0000", 2024-04-24T13:32:40.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7038000000000004e-05 2024-04-24T13:32:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2207 3.38 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:32:40.667 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.350027583999999, 2024-04-24T13:32:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022686873999999999, 2024-04-24T13:32:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.668 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2207 2024-04-24T13:32:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:32:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:32:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302499+0000", 2024-04-24T13:32:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-04-24T13:32:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307861+0000", 2024-04-24T13:32:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053622089999999997 2024-04-24T13:32:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307899+0000", 2024-04-24T13:32:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978999999999997e-05 2024-04-24T13:32:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307917+0000", 2024-04-24T13:32:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8576999999999998e-05 2024-04-24T13:32:40.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308018+0000", 2024-04-24T13:32:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010080499999999999 2024-04-24T13:32:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308202+0000", 2024-04-24T13:32:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000183628 2024-04-24T13:32:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:40.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308352+0000", 2024-04-24T13:32:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149806 2024-04-24T13:32:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318520+0000", 2024-04-24T13:32:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010168744 2024-04-24T13:32:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.324908+0000", 2024-04-24T13:32:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063874739999999998 2024-04-24T13:32:40.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325063+0000", 2024-04-24T13:32:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155131 2024-04-24T13:32:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325182+0000", 2024-04-24T13:32:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011915499999999999 2024-04-24T13:32:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.674 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:32:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.326432871, 2024-04-24T13:32:40.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:32:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.676 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:32:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:32:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:32:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:32:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:32:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:32:40.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:32:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:32:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:32:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:32:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:32:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:32:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:32:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:32:40.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:32:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:32:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:32:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:32:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:32:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:32:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:32:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:32:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:32:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:32:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:32:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.683 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2210 3.23 e85/20 3:c462163d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_5:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.359362+0000", 2024-04-24T13:32:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.293160478000001, 2024-04-24T13:32:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014461236000000001, 2024-04-24T13:32:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.359362+0000", 2024-04-24T13:32:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.359362+0000", 2024-04-24T13:32:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.359365+0000", 2024-04-24T13:32:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6000000000000001e-06 2024-04-24T13:32:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362822+0000", 2024-04-24T13:32:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034571200000000002 2024-04-24T13:32:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362857+0000", 2024-04-24T13:32:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4968000000000001e-05 2024-04-24T13:32:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362875+0000", 2024-04-24T13:32:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7507999999999999e-05 2024-04-24T13:32:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362965+0000", 2024-04-24T13:32:40.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0742000000000006e-05 2024-04-24T13:32:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.362992+0000", 2024-04-24T13:32:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7158e-05 2024-04-24T13:32:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.373695+0000", 2024-04-24T13:32:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010702211999999999 2024-04-24T13:32:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.373824+0000", 2024-04-24T13:32:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128928 2024-04-24T13:32:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.689 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2211 3.8 3:123ae70b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.379448+0000", 2024-04-24T13:32:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.273074665999999, 2024-04-24T13:32:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013985645, 2024-04-24T13:32:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2211 2024-04-24T13:32:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.690 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.379448+0000", 2024-04-24T13:32:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.379448+0000", 2024-04-24T13:32:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.379452+0000", 2024-04-24T13:32:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3759999999999999e-06 2024-04-24T13:32:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.381975+0000", 2024-04-24T13:32:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002523885 2024-04-24T13:32:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382016+0000", 2024-04-24T13:32:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0865999999999998e-05 2024-04-24T13:32:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382042+0000", 2024-04-24T13:32:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5999e-05 2024-04-24T13:32:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382160+0000", 2024-04-24T13:32:40.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117806 2024-04-24T13:32:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382338+0000", 2024-04-24T13:32:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000177543 2024-04-24T13:32:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382494+0000", 2024-04-24T13:32:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015645500000000001 2024-04-24T13:32:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.390114+0000", 2024-04-24T13:32:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0076203099999999999 2024-04-24T13:32:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.393358+0000", 2024-04-24T13:32:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032431669999999999 2024-04-24T13:32:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.393402+0000", 2024-04-24T13:32:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4072000000000001e-05 2024-04-24T13:32:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.393434+0000", 2024-04-24T13:32:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2165999999999997e-05 2024-04-24T13:32:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.696 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2215 3.23 e85/20 3:c703bbd7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_10:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.454450+0000", 2024-04-24T13:32:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.198072626, 2024-04-24T13:32:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012738266999999999, 2024-04-24T13:32:40.697 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.454450+0000", 2024-04-24T13:32:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.454450+0000", 2024-04-24T13:32:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.454452+0000", 2024-04-24T13:32:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.474e-06 2024-04-24T13:32:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455575+0000", 2024-04-24T13:32:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011236519999999999 2024-04-24T13:32:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455609+0000", 2024-04-24T13:32:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3448999999999998e-05 2024-04-24T13:32:40.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455626+0000", 2024-04-24T13:32:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7274000000000001e-05 2024-04-24T13:32:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455746+0000", 2024-04-24T13:32:40.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012016299999999999 2024-04-24T13:32:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.455784+0000", 2024-04-24T13:32:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8055000000000001e-05 2024-04-24T13:32:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467080+0000", 2024-04-24T13:32:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011295846999999999 2024-04-24T13:32:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467188+0000", 2024-04-24T13:32:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000108353 2024-04-24T13:32:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:32:40.703 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.181377017000001, 2024-04-24T13:32:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:32:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.704 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:32:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:32:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:32:40.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:32:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:32:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:32:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:32:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:32:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:32:40.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:32:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:32:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:32:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:32:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:32:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:32:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:32:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:32:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:32:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:32:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:32:40.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:32:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:32:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:32:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:32:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:32:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.713 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2218 3.c 3:338c3e0b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_13:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.481902+0000", 2024-04-24T13:32:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.17062101, 2024-04-24T13:32:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013669654, 2024-04-24T13:32:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.714 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2218 2024-04-24T13:32:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.481902+0000", 2024-04-24T13:32:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.481902+0000", 2024-04-24T13:32:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.481905+0000", 2024-04-24T13:32:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7590000000000002e-06 2024-04-24T13:32:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483709+0000", 2024-04-24T13:32:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001804915 2024-04-24T13:32:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483731+0000", 2024-04-24T13:32:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:32:40.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483742+0000", 2024-04-24T13:32:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0905e-05 2024-04-24T13:32:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483804+0000", 2024-04-24T13:32:40.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1407000000000003e-05 2024-04-24T13:32:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.483931+0000", 2024-04-24T13:32:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000127522 2024-04-24T13:32:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.484035+0000", 2024-04-24T13:32:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000103825 2024-04-24T13:32:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.490036+0000", 2024-04-24T13:32:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060011739999999997 2024-04-24T13:32:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.495470+0000", 2024-04-24T13:32:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054342319999999998 2024-04-24T13:32:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.495523+0000", 2024-04-24T13:32:40.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2726999999999998e-05 2024-04-24T13:32:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.495571+0000", 2024-04-24T13:32:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8461999999999998e-05 2024-04-24T13:32:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.721 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2233 3.c 3:3257d695:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.641529+0000", 2024-04-24T13:32:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.010993663000001, 2024-04-24T13:32:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018052898000000001, 2024-04-24T13:32:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.722 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2233 2024-04-24T13:32:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.641529+0000", 2024-04-24T13:32:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.641529+0000", 2024-04-24T13:32:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.641532+0000", 2024-04-24T13:32:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.078e-06 2024-04-24T13:32:40.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643295+0000", 2024-04-24T13:32:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017631700000000001 2024-04-24T13:32:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643325+0000", 2024-04-24T13:32:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9848e-05 2024-04-24T13:32:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643340+0000", 2024-04-24T13:32:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4588e-05 2024-04-24T13:32:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643439+0000", 2024-04-24T13:32:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8801000000000005e-05 2024-04-24T13:32:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643659+0000", 2024-04-24T13:32:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022074099999999999 2024-04-24T13:32:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.643804+0000", 2024-04-24T13:32:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014435000000000001 2024-04-24T13:32:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.652553+0000", 2024-04-24T13:32:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0087494340000000004 2024-04-24T13:32:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.659491+0000", 2024-04-24T13:32:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069377010000000001 2024-04-24T13:32:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.659531+0000", 2024-04-24T13:32:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0590000000000003e-05 2024-04-24T13:32:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.659582+0000", 2024-04-24T13:32:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0596999999999997e-05 2024-04-24T13:32:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.729 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2242 3.b 3:d16b554f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:32:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.912878084999999, 2024-04-24T13:32:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022940439, 2024-04-24T13:32:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.730 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2242 2024-04-24T13:32:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:32:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:32:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739648+0000", 2024-04-24T13:32:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.785e-06 2024-04-24T13:32:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741765+0000", 2024-04-24T13:32:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002117655 2024-04-24T13:32:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741781+0000", 2024-04-24T13:32:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6062e-05 2024-04-24T13:32:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741792+0000", 2024-04-24T13:32:40.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0937999999999999e-05 2024-04-24T13:32:40.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741918+0000", 2024-04-24T13:32:40.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623199999999999 2024-04-24T13:32:40.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742189+0000", 2024-04-24T13:32:40.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027047300000000002 2024-04-24T13:32:40.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:40.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742430+0000", 2024-04-24T13:32:40.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024077699999999999 2024-04-24T13:32:40.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752990+0000", 2024-04-24T13:32:40.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010559875 2024-04-24T13:32:40.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762422+0000", 2024-04-24T13:32:40.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094325120000000005 2024-04-24T13:32:40.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762510+0000", 2024-04-24T13:32:40.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7879000000000003e-05 2024-04-24T13:32:40.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762585+0000", 2024-04-24T13:32:40.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5251000000000002e-05 2024-04-24T13:32:40.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.738 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.738 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2247 3.2a e85/74 3:56a679bb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_42:head v 85'3, mlcod=81'1)", 2024-04-24T13:32:40.738 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.801034+0000", 2024-04-24T13:32:40.738 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.851489192000001, 2024-04-24T13:32:40.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012987485999999999, 2024-04-24T13:32:40.738 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.738 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.738 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.739 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.801034+0000", 2024-04-24T13:32:40.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.801034+0000", 2024-04-24T13:32:40.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.801035+0000", 2024-04-24T13:32:40.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.22e-06 2024-04-24T13:32:40.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.805927+0000", 2024-04-24T13:32:40.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048917659999999996 2024-04-24T13:32:40.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.805951+0000", 2024-04-24T13:32:40.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4017999999999999e-05 2024-04-24T13:32:40.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.805963+0000", 2024-04-24T13:32:40.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2217e-05 2024-04-24T13:32:40.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.806061+0000", 2024-04-24T13:32:40.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7807999999999996e-05 2024-04-24T13:32:40.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.806096+0000", 2024-04-24T13:32:40.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4848000000000002e-05 2024-04-24T13:32:40.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.813950+0000", 2024-04-24T13:32:40.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078541010000000005 2024-04-24T13:32:40.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.814021+0000", 2024-04-24T13:32:40.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1507999999999994e-05 2024-04-24T13:32:40.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.745 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.745 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2250 3.3c e85/20 3:3d3fcdd2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_45:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:40.746 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.829385+0000", 2024-04-24T13:32:40.746 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.823137788, 2024-04-24T13:32:40.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013561493000000001, 2024-04-24T13:32:40.746 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.746 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.746 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.747 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.829385+0000", 2024-04-24T13:32:40.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.829385+0000", 2024-04-24T13:32:40.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.829386+0000", 2024-04-24T13:32:40.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.33e-06 2024-04-24T13:32:40.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837727+0000", 2024-04-24T13:32:40.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083405879999999995 2024-04-24T13:32:40.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837760+0000", 2024-04-24T13:32:40.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2892999999999998e-05 2024-04-24T13:32:40.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837776+0000", 2024-04-24T13:32:40.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6064000000000001e-05 2024-04-24T13:32:40.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837888+0000", 2024-04-24T13:32:40.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011175699999999999 2024-04-24T13:32:40.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.837910+0000", 2024-04-24T13:32:40.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1967000000000002e-05 2024-04-24T13:32:40.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.842872+0000", 2024-04-24T13:32:40.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004962246 2024-04-24T13:32:40.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.842947+0000", 2024-04-24T13:32:40.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4647999999999994e-05 2024-04-24T13:32:40.752 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.752 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.752 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.752 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2253 3.27 3:e6835017:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_48:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.753 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.857410+0000", 2024-04-24T13:32:40.753 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.795112611, 2024-04-24T13:32:40.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015395834000000001, 2024-04-24T13:32:40.753 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.753 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.753 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.753 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.753 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.753 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.753 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2253 2024-04-24T13:32:40.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.753 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.857410+0000", 2024-04-24T13:32:40.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.857410+0000", 2024-04-24T13:32:40.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.857413+0000", 2024-04-24T13:32:40.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.236e-06 2024-04-24T13:32:40.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859353+0000", 2024-04-24T13:32:40.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001939947 2024-04-24T13:32:40.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859384+0000", 2024-04-24T13:32:40.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1106999999999999e-05 2024-04-24T13:32:40.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859401+0000", 2024-04-24T13:32:40.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6871000000000002e-05 2024-04-24T13:32:40.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859494+0000", 2024-04-24T13:32:40.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2901999999999999e-05 2024-04-24T13:32:40.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859619+0000", 2024-04-24T13:32:40.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000124924 2024-04-24T13:32:40.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.859762+0000", 2024-04-24T13:32:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014235800000000001 2024-04-24T13:32:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865768+0000", 2024-04-24T13:32:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060064699999999999 2024-04-24T13:32:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.872676+0000", 2024-04-24T13:32:40.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069080460000000002 2024-04-24T13:32:40.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.872734+0000", 2024-04-24T13:32:40.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7442000000000003e-05 2024-04-24T13:32:40.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.872806+0000", 2024-04-24T13:32:40.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2531000000000001e-05 2024-04-24T13:32:40.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.759 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2255 3.29 3:979257ba:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_50:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.878934+0000", 2024-04-24T13:32:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.773588978999999, 2024-04-24T13:32:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015146641000000001, 2024-04-24T13:32:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.760 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2255 2024-04-24T13:32:40.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.761 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.878934+0000", 2024-04-24T13:32:40.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.878934+0000", 2024-04-24T13:32:40.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.878937+0000", 2024-04-24T13:32:40.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2270000000000002e-06 2024-04-24T13:32:40.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881027+0000", 2024-04-24T13:32:40.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020899550000000001 2024-04-24T13:32:40.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881053+0000", 2024-04-24T13:32:40.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6139000000000002e-05 2024-04-24T13:32:40.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881065+0000", 2024-04-24T13:32:40.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2067e-05 2024-04-24T13:32:40.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881158+0000", 2024-04-24T13:32:40.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2571000000000005e-05 2024-04-24T13:32:40.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881323+0000", 2024-04-24T13:32:40.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016472000000000001 2024-04-24T13:32:40.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:40.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.881452+0000", 2024-04-24T13:32:40.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012935600000000001 2024-04-24T13:32:40.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.888419+0000", 2024-04-24T13:32:40.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069672290000000001 2024-04-24T13:32:40.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.893923+0000", 2024-04-24T13:32:40.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055036449999999997 2024-04-24T13:32:40.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.894016+0000", 2024-04-24T13:32:40.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3734999999999996e-05 2024-04-24T13:32:40.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.894080+0000", 2024-04-24T13:32:40.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3997000000000004e-05 2024-04-24T13:32:40.766 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.767 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.767 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2258 3.1e 3:788e6d31:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_53:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.767 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.912760+0000", 2024-04-24T13:32:40.767 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.739762766, 2024-04-24T13:32:40.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014178759000000001, 2024-04-24T13:32:40.767 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.767 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.767 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.768 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2258 2024-04-24T13:32:40.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.768 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.912760+0000", 2024-04-24T13:32:40.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.912760+0000", 2024-04-24T13:32:40.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.912762+0000", 2024-04-24T13:32:40.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.295e-06 2024-04-24T13:32:40.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914664+0000", 2024-04-24T13:32:40.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001901701 2024-04-24T13:32:40.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914688+0000", 2024-04-24T13:32:40.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3983000000000001e-05 2024-04-24T13:32:40.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914701+0000", 2024-04-24T13:32:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2914999999999999e-05 2024-04-24T13:32:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914793+0000", 2024-04-24T13:32:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1995000000000003e-05 2024-04-24T13:32:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914963+0000", 2024-04-24T13:32:40.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000169994 2024-04-24T13:32:40.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:40.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.915095+0000", 2024-04-24T13:32:40.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000132531 2024-04-24T13:32:40.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.920249+0000", 2024-04-24T13:32:40.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00515351 2024-04-24T13:32:40.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.926800+0000", 2024-04-24T13:32:40.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006551037 2024-04-24T13:32:40.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.926875+0000", 2024-04-24T13:32:40.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4894000000000005e-05 2024-04-24T13:32:40.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.926939+0000", 2024-04-24T13:32:40.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3904000000000003e-05 2024-04-24T13:32:40.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.775 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.775 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2259 3.2 3:43ddbe9c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_54:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.775 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.925834+0000", 2024-04-24T13:32:40.775 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.726688885, 2024-04-24T13:32:40.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013273327999999999, 2024-04-24T13:32:40.775 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.776 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.776 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.776 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.776 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.776 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.776 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2259 2024-04-24T13:32:40.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.776 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.925834+0000", 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.925834+0000", 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.925837+0000", 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7379999999999999e-06 2024-04-24T13:32:40.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927658+0000", 2024-04-24T13:32:40.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001821278 2024-04-24T13:32:40.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927689+0000", 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1544000000000002e-05 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927702+0000", 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2532e-05 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927788+0000", 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6156999999999995e-05 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.927979+0000", 2024-04-24T13:32:40.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019079700000000001 2024-04-24T13:32:40.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:40.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.928152+0000", 2024-04-24T13:32:40.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017276800000000001 2024-04-24T13:32:40.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.934746+0000", 2024-04-24T13:32:40.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065945209999999999 2024-04-24T13:32:40.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938978+0000", 2024-04-24T13:32:40.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042313139999999999 2024-04-24T13:32:40.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.939044+0000", 2024-04-24T13:32:40.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6377000000000005e-05 2024-04-24T13:32:40.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.939107+0000", 2024-04-24T13:32:40.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3301999999999998e-05 2024-04-24T13:32:40.782 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.782 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.782 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.782 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2262 3.22 3:4683919b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.782 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.958433+0000", 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.694090276000001, 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012735631000000001, 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2262 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.958433+0000", 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.958433+0000", 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.958435+0000", 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6800000000000002e-06 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960127+0000", 2024-04-24T13:32:40.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016921729999999999 2024-04-24T13:32:40.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960160+0000", 2024-04-24T13:32:40.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2227000000000002e-05 2024-04-24T13:32:40.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960177+0000", 2024-04-24T13:32:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7017999999999999e-05 2024-04-24T13:32:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960265+0000", 2024-04-24T13:32:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8701000000000003e-05 2024-04-24T13:32:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960402+0000", 2024-04-24T13:32:40.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013694 2024-04-24T13:32:40.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:40.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.960498+0000", 2024-04-24T13:32:40.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5982000000000004e-05 2024-04-24T13:32:40.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.967021+0000", 2024-04-24T13:32:40.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065223599999999996 2024-04-24T13:32:40.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.971033+0000", 2024-04-24T13:32:40.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040127380000000001 2024-04-24T13:32:40.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.971104+0000", 2024-04-24T13:32:40.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1042000000000002e-05 2024-04-24T13:32:40.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.971168+0000", 2024-04-24T13:32:40.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3769999999999994e-05 2024-04-24T13:32:40.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.790 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2264 3.18 3:1be64b04:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.981015+0000", 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.671507842, 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014016457, 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2264 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.981015+0000", 2024-04-24T13:32:40.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.981015+0000", 2024-04-24T13:32:40.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.981017+0000", 2024-04-24T13:32:40.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1119999999999999e-06 2024-04-24T13:32:40.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.982917+0000", 2024-04-24T13:32:40.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001899467 2024-04-24T13:32:40.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.982950+0000", 2024-04-24T13:32:40.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3050999999999999e-05 2024-04-24T13:32:40.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.982963+0000", 2024-04-24T13:32:40.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2925000000000001e-05 2024-04-24T13:32:40.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983063+0000", 2024-04-24T13:32:40.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010076799999999999 2024-04-24T13:32:40.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983291+0000", 2024-04-24T13:32:40.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022722500000000001 2024-04-24T13:32:40.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:40.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983510+0000", 2024-04-24T13:32:40.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000219452 2024-04-24T13:32:40.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994090+0000", 2024-04-24T13:32:40.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010579912 2024-04-24T13:32:40.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994900+0000", 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00081024999999999999 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994973+0000", 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.2723000000000002e-05 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995031+0000", 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8572000000000001e-05 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.796 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.797 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2268 3.24 3:278809cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_63:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.797 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:29.026049+0000", 2024-04-24T13:32:40.797 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.626473366000001, 2024-04-24T13:32:40.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012981438, 2024-04-24T13:32:40.797 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.797 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.797 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.797 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.797 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.797 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.797 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2268 2024-04-24T13:32:40.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.798 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.026049+0000", 2024-04-24T13:32:40.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.026049+0000", 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.026053+0000", 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3330000000000001e-06 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.027667+0000", 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001613876 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.027706+0000", 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.93e-05 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.027720+0000", 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.399e-05 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.027823+0000", 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010285099999999999 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.028034+0000", 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021157399999999999 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.028214+0000", 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000180104 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.035480+0000", 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072650420000000002 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038951+0000", 2024-04-24T13:32:40.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034710460000000002 2024-04-24T13:32:40.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038995+0000", 2024-04-24T13:32:40.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4676999999999999e-05 2024-04-24T13:32:40.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.039031+0000", 2024-04-24T13:32:40.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5645000000000002e-05 2024-04-24T13:32:40.803 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.803 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.803 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.803 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2269 3.38 3:1d70d2f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_64:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:40.803 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:29.036394+0000", 2024-04-24T13:32:40.803 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.616128857, 2024-04-24T13:32:40.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016649575999999999, 2024-04-24T13:32:40.803 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:40.803 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2269 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.036394+0000", 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.036394+0000", 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.036397+0000", 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0340000000000001e-06 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038367+0000", 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019698290000000002 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038386+0000", 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9366000000000001e-05 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038399+0000", 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2784e-05 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038486+0000", 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7457e-05 2024-04-24T13:32:40.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:40.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038684+0000", 2024-04-24T13:32:40.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000197469 2024-04-24T13:32:40.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:40.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.038863+0000", 2024-04-24T13:32:40.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017951499999999999 2024-04-24T13:32:40.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:40.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.045894+0000", 2024-04-24T13:32:40.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070301590000000002 2024-04-24T13:32:40.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:40.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.052890+0000", 2024-04-24T13:32:40.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069962469999999997 2024-04-24T13:32:40.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:40.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.052972+0000", 2024-04-24T13:32:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1780999999999995e-05 2024-04-24T13:32:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.053044+0000", 2024-04-24T13:32:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1934999999999995e-05 2024-04-24T13:32:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:40.809 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:40.809 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:40.810 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:40.811 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:40.812 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:40.812 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:40.812 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:40.813 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:40.813 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:40.813 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:40.814 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:40.815 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:40.807+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:40.912 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:40.909+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:40.944 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:40.944 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:40.944 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:40.944 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:40.958 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:41.046 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:41.045+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:41.114 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:41.111+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:41.125 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:41.126 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:41.126 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:41.126 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:41.126 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:41.141 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:41.226 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:41.225+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:41.310 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:41.310 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:41.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:41.310 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:41.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.310 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:32:41.310 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:41.310 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 134.08052657799999, 2024-04-24T13:32:41.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020457065, 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:41.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225903+0000", 2024-04-24T13:32:41.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7100000000000001e-06 2024-04-24T13:32:41.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225922+0000", 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8919999999999998e-05 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225960+0000", 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7240000000000003e-05 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225987+0000", 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6919000000000001e-05 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226300+0000", 2024-04-24T13:32:41.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000313701 2024-04-24T13:32:41.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:41.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226317+0000", 2024-04-24T13:32:41.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6463000000000001e-05 2024-04-24T13:32:41.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231091+0000", 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047739169999999999 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231111+0000", 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0605999999999999e-05 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246073+0000", 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014961264 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246357+0000", 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028432499999999999 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1615 3.1a 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.100713903999999, 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020755388999999999, 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.316 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1615 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205715+0000", 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4399999999999999e-06 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211414+0000", 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005699356 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211448+0000", 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4221999999999999e-05 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211466+0000", 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7629999999999999e-05 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211585+0000", 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011937 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211840+0000", 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000254861 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.212059+0000", 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218789 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.225826+0000", 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013767061000000001 2024-04-24T13:32:41.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226295+0000", 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046917399999999999 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226388+0000", 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2190999999999999e-05 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226468+0000", 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0295000000000003e-05 2024-04-24T13:32:41.321 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2208 3.29 e85/20 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.977779151, 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026370000000000001, 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:32:41.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:32:41.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328650+0000", 2024-04-24T13:32:41.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.413e-06 2024-04-24T13:32:41.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335219+0000", 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006569788 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335258+0000", 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9062e-05 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335277+0000", 2024-04-24T13:32:41.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.836e-05 2024-04-24T13:32:41.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335422+0000", 2024-04-24T13:32:41.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014537 2024-04-24T13:32:41.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335481+0000", 2024-04-24T13:32:41.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9259000000000003e-05 2024-04-24T13:32:41.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354858+0000", 2024-04-24T13:32:41.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019376757000000001 2024-04-24T13:32:41.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.355017+0000", 2024-04-24T13:32:41.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015899100000000001 2024-04-24T13:32:41.326 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.326 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.326 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.326 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2213 3.2f 3:f4e7225c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:41.327 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.417904+0000", 2024-04-24T13:32:41.327 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.888522506999999, 2024-04-24T13:32:41.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019522586000000001, 2024-04-24T13:32:41.327 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.327 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.327 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.327 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.327 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.327 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.327 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2213 2024-04-24T13:32:41.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.327 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.417904+0000", 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.417904+0000", 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.417907+0000", 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8899999999999999e-06 2024-04-24T13:32:41.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424088+0000", 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061813299999999996 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424111+0000", 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3113e-05 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424122+0000", 2024-04-24T13:32:41.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1266e-05 2024-04-24T13:32:41.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424210+0000", 2024-04-24T13:32:41.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7690999999999998e-05 2024-04-24T13:32:41.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424356+0000", 2024-04-24T13:32:41.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014553499999999999 2024-04-24T13:32:41.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424474+0000", 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011881500000000001 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.436943+0000", 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012468137000000001 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.437296+0000", 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035371099999999999 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.437365+0000", 2024-04-24T13:32:41.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8573999999999998e-05 2024-04-24T13:32:41.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.437426+0000", 2024-04-24T13:32:41.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1524000000000003e-05 2024-04-24T13:32:41.332 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.332 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.332 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.333 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2214 3.1a 3:5b3ced30:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:41.333 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.438843+0000", 2024-04-24T13:32:41.333 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.867582942, 2024-04-24T13:32:41.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014929534, 2024-04-24T13:32:41.333 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.333 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.333 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.333 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.333 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.333 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.333 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2214 2024-04-24T13:32:41.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.334 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.438843+0000", 2024-04-24T13:32:41.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.438843+0000", 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.438845+0000", 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.367e-06 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442803+0000", 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039578840000000001 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442829+0000", 2024-04-24T13:32:41.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6628e-05 2024-04-24T13:32:41.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442842+0000", 2024-04-24T13:32:41.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3101e-05 2024-04-24T13:32:41.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442980+0000", 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013741599999999999 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.443250+0000", 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027034200000000002 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.443506+0000", 2024-04-24T13:32:41.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025607800000000002 2024-04-24T13:32:41.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.450974+0000", 2024-04-24T13:32:41.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074679639999999997 2024-04-24T13:32:41.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.453594+0000", 2024-04-24T13:32:41.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026193840000000002 2024-04-24T13:32:41.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.453699+0000", 2024-04-24T13:32:41.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010524200000000001 2024-04-24T13:32:41.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.453773+0000", 2024-04-24T13:32:41.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4128000000000006e-05 2024-04-24T13:32:41.339 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.339 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.340 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.340 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2221 3.26 e85/41 3:67d4e534:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_16:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:41.340 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.519722+0000", 2024-04-24T13:32:41.340 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.786704016, 2024-04-24T13:32:41.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012541907999999999, 2024-04-24T13:32:41.340 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.340 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.340 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.341 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519722+0000", 2024-04-24T13:32:41.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519722+0000", 2024-04-24T13:32:41.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519724+0000", 2024-04-24T13:32:41.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7829999999999999e-06 2024-04-24T13:32:41.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522168+0000", 2024-04-24T13:32:41.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024435080000000001 2024-04-24T13:32:41.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522190+0000", 2024-04-24T13:32:41.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2824e-05 2024-04-24T13:32:41.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522203+0000", 2024-04-24T13:32:41.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2394e-05 2024-04-24T13:32:41.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522287+0000", 2024-04-24T13:32:41.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.462e-05 2024-04-24T13:32:41.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522310+0000", 2024-04-24T13:32:41.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2833999999999999e-05 2024-04-24T13:32:41.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532185+0000", 2024-04-24T13:32:41.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098749189999999994 2024-04-24T13:32:41.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532264+0000", 2024-04-24T13:32:41.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9025999999999999e-05 2024-04-24T13:32:41.345 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.345 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.345 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.346 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2222 3.13 3:c9a14088:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:41.346 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.524858+0000", 2024-04-24T13:32:41.346 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.781568010999999, 2024-04-24T13:32:41.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01679514, 2024-04-24T13:32:41.346 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.346 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.346 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.346 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.346 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.346 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.346 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2222 2024-04-24T13:32:41.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.347 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.524858+0000", 2024-04-24T13:32:41.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.524858+0000", 2024-04-24T13:32:41.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.524865+0000", 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6069999999999996e-06 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528806+0000", 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003940743 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528824+0000", 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8423999999999998e-05 2024-04-24T13:32:41.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528834+0000", 2024-04-24T13:32:41.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8190000000000003e-06 2024-04-24T13:32:41.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528904+0000", 2024-04-24T13:32:41.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0432000000000006e-05 2024-04-24T13:32:41.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.529034+0000", 2024-04-24T13:32:41.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013008299999999999 2024-04-24T13:32:41.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:41.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.529153+0000", 2024-04-24T13:32:41.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118348 2024-04-24T13:32:41.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538128+0000", 2024-04-24T13:32:41.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089753909999999992 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.541554+0000", 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034260860000000001 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.541608+0000", 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4146e-05 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.541653+0000", 2024-04-24T13:32:41.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5061000000000001e-05 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2223 3.3 3:c1ee41bc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.534315+0000", 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.772111733999999, 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015569995999999999, 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.352 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2223 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.534315+0000", 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.534315+0000", 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.534317+0000", 2024-04-24T13:32:41.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0190000000000001e-06 2024-04-24T13:32:41.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538250+0000", 2024-04-24T13:32:41.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003933069 2024-04-24T13:32:41.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538268+0000", 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8043e-05 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538283+0000", 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5590000000000002e-05 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538348+0000", 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4311000000000001e-05 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538470+0000", 2024-04-24T13:32:41.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121909 2024-04-24T13:32:41.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:41.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538575+0000", 2024-04-24T13:32:41.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105027 2024-04-24T13:32:41.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.543353+0000", 2024-04-24T13:32:41.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047783419999999997 2024-04-24T13:32:41.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549659+0000", 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063060429999999999 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549768+0000", 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108587 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549885+0000", 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117056 2024-04-24T13:32:41.357 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2224 3.2c e85/20 3:3671ead8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_19:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.549217+0000", 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.757209047, 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011251326000000001, 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549217+0000", 2024-04-24T13:32:41.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549217+0000", 2024-04-24T13:32:41.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549219+0000", 2024-04-24T13:32:41.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3570000000000001e-06 2024-04-24T13:32:41.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551026+0000", 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001807428 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551045+0000", 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9366999999999999e-05 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551055+0000", 2024-04-24T13:32:41.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3079999999999997e-06 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551167+0000", 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112052 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551197+0000", 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0253999999999999e-05 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560393+0000", 2024-04-24T13:32:41.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0091956 2024-04-24T13:32:41.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560469+0000", 2024-04-24T13:32:41.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5959999999999998e-05 2024-04-24T13:32:41.362 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.362 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.362 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.362 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2234 3.34 3:2f41ca12:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:41.362 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.652422+0000", 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.654004410000001, 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018886607, 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2234 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.652422+0000", 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.652422+0000", 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.652424+0000", 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1909999999999999e-06 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656447+0000", 2024-04-24T13:32:41.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040232530000000001 2024-04-24T13:32:41.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656472+0000", 2024-04-24T13:32:41.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4338e-05 2024-04-24T13:32:41.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656488+0000", 2024-04-24T13:32:41.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6203999999999999e-05 2024-04-24T13:32:41.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656586+0000", 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7884e-05 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656724+0000", 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013806199999999999 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656838+0000", 2024-04-24T13:32:41.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113998 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.669565+0000", 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012727591999999999 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671188+0000", 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001622533 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671251+0000", 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3476e-05 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671309+0000", 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7076e-05 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2239 3.11 3:8b38e7d5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.709949+0000", 2024-04-24T13:32:41.368 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.596477208, 2024-04-24T13:32:41.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016665736, 2024-04-24T13:32:41.369 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.369 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.369 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.369 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.369 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.369 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.369 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2239 2024-04-24T13:32:41.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.370 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.709949+0000", 2024-04-24T13:32:41.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.709949+0000", 2024-04-24T13:32:41.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.709952+0000", 2024-04-24T13:32:41.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1540000000000002e-06 2024-04-24T13:32:41.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.713909+0000", 2024-04-24T13:32:41.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039569870000000004 2024-04-24T13:32:41.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.713935+0000", 2024-04-24T13:32:41.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5568999999999999e-05 2024-04-24T13:32:41.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.713951+0000", 2024-04-24T13:32:41.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529e-05 2024-04-24T13:32:41.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.714027+0000", 2024-04-24T13:32:41.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.538e-05 2024-04-24T13:32:41.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.714170+0000", 2024-04-24T13:32:41.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014336199999999999 2024-04-24T13:32:41.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:41.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.714282+0000", 2024-04-24T13:32:41.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111912 2024-04-24T13:32:41.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719419+0000", 2024-04-24T13:32:41.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051373199999999999 2024-04-24T13:32:41.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.726440+0000", 2024-04-24T13:32:41.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070210230000000004 2024-04-24T13:32:41.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.726535+0000", 2024-04-24T13:32:41.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4137999999999999e-05 2024-04-24T13:32:41.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.726615+0000", 2024-04-24T13:32:41.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0362000000000001e-05 2024-04-24T13:32:41.375 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.375 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.375 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.376 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2244 3.3b e85/41 3:ddfbb493:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_39:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:41.376 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.766818+0000", 2024-04-24T13:32:41.376 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.539608704000001, 2024-04-24T13:32:41.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015179241, 2024-04-24T13:32:41.376 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.376 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.376 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.376 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.766818+0000", 2024-04-24T13:32:41.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.766818+0000", 2024-04-24T13:32:41.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.766819+0000", 2024-04-24T13:32:41.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.564e-06 2024-04-24T13:32:41.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771018+0000", 2024-04-24T13:32:41.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041990200000000004 2024-04-24T13:32:41.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771049+0000", 2024-04-24T13:32:41.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0273999999999998e-05 2024-04-24T13:32:41.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771075+0000", 2024-04-24T13:32:41.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6103999999999999e-05 2024-04-24T13:32:41.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771212+0000", 2024-04-24T13:32:41.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136933 2024-04-24T13:32:41.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771286+0000", 2024-04-24T13:32:41.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4447000000000001e-05 2024-04-24T13:32:41.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.781853+0000", 2024-04-24T13:32:41.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010567048000000001 2024-04-24T13:32:41.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.781997+0000", 2024-04-24T13:32:41.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014385099999999999 2024-04-24T13:32:41.381 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.381 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.381 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.381 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2245 3.1d e85/20 3:bb337c31:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_40:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:41.381 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:41.381 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.526344825000001, 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01557213, 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:41.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:41.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1899999999999998e-07 2024-04-24T13:32:41.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784478+0000", 2024-04-24T13:32:41.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00439624 2024-04-24T13:32:41.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784506+0000", 2024-04-24T13:32:41.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7365999999999999e-05 2024-04-24T13:32:41.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784522+0000", 2024-04-24T13:32:41.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6268000000000001e-05 2024-04-24T13:32:41.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784616+0000", 2024-04-24T13:32:41.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4423e-05 2024-04-24T13:32:41.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784640+0000", 2024-04-24T13:32:41.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3906000000000001e-05 2024-04-24T13:32:41.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795548+0000", 2024-04-24T13:32:41.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01090738 2024-04-24T13:32:41.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795654+0000", 2024-04-24T13:32:41.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106128 2024-04-24T13:32:41.386 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.386 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.386 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.386 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2246 3.9 3:92c5067a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:41.386 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.784844+0000", 2024-04-24T13:32:41.386 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.521582387, 2024-04-24T13:32:41.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016501108, 2024-04-24T13:32:41.387 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.387 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.387 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.387 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.387 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.387 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.387 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2246 2024-04-24T13:32:41.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.387 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784844+0000", 2024-04-24T13:32:41.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784844+0000", 2024-04-24T13:32:41.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784848+0000", 2024-04-24T13:32:41.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.563e-06 2024-04-24T13:32:41.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.788914+0000", 2024-04-24T13:32:41.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040666360000000002 2024-04-24T13:32:41.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.788940+0000", 2024-04-24T13:32:41.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5573999999999999e-05 2024-04-24T13:32:41.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.788952+0000", 2024-04-24T13:32:41.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2431e-05 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.789037+0000", 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4593999999999997e-05 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.789171+0000", 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134015 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:41.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.789288+0000", 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117512 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.796833+0000", 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075444029999999999 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.801059+0000", 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042262280000000003 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.801227+0000", 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000168517 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.801345+0000", 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011763499999999999 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2248 3.1d e85/20 3:b991c377:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_43:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:41.392 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.809856+0000", 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.496570261, 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011470594000000001, 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809856+0000", 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809856+0000", 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809858+0000", 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309999999999999e-06 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812257+0000", 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002399329 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812283+0000", 2024-04-24T13:32:41.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5636e-05 2024-04-24T13:32:41.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812297+0000", 2024-04-24T13:32:41.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4534e-05 2024-04-24T13:32:41.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812393+0000", 2024-04-24T13:32:41.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6039000000000007e-05 2024-04-24T13:32:41.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812429+0000", 2024-04-24T13:32:41.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5111000000000003e-05 2024-04-24T13:32:41.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821231+0000", 2024-04-24T13:32:41.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088020389999999993 2024-04-24T13:32:41.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821327+0000", 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6075000000000004e-05 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2253 3.27 e85/20 3:e6835017:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_48:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.859419+0000", 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.447007005, 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012299842, 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.400 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.859419+0000", 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.859419+0000", 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.859421+0000", 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0329999999999998e-06 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863395+0000", 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039737339999999996 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863425+0000", 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9793000000000001e-05 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863439+0000", 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.446e-05 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863598+0000", 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015820600000000001 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863638+0000", 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0225999999999997e-05 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.871631+0000", 2024-04-24T13:32:41.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079935089999999993 2024-04-24T13:32:41.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.871719+0000", 2024-04-24T13:32:41.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7880999999999994e-05 2024-04-24T13:32:41.404 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.404 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.404 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2255 3.29 e85/20 3:979257ba:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_50:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.881386+0000", 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.425040686999999, 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011529885, 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881386+0000", 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881386+0000", 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881413+0000", 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7619000000000001e-05 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885724+0000", 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043102339999999996 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885760+0000", 2024-04-24T13:32:41.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6501999999999997e-05 2024-04-24T13:32:41.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885777+0000", 2024-04-24T13:32:41.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7183000000000001e-05 2024-04-24T13:32:41.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885917+0000", 2024-04-24T13:32:41.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139491 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885959+0000", 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2023000000000001e-05 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892786+0000", 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068271720000000003 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892916+0000", 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012966099999999999 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2271 3.13 3:cb7d029e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.056244+0000", 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.250181878999999, 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019201421, 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.409 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.410 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.410 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.410 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2271 2024-04-24T13:32:41.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.410 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.056244+0000", 2024-04-24T13:32:41.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.056244+0000", 2024-04-24T13:32:41.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.056259+0000", 2024-04-24T13:32:41.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4099e-05 2024-04-24T13:32:41.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060075+0000", 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038163260000000001 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060103+0000", 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7949e-05 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060115+0000", 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2298e-05 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060216+0000", 2024-04-24T13:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100883 2024-04-24T13:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060366+0000", 2024-04-24T13:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015035999999999999 2024-04-24T13:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060509+0000", 2024-04-24T13:32:41.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142516 2024-04-24T13:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.067630+0000", 2024-04-24T13:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00712066 2024-04-24T13:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.075349+0000", 2024-04-24T13:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077195789999999999 2024-04-24T13:32:41.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.075402+0000", 2024-04-24T13:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2905000000000003e-05 2024-04-24T13:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.075446+0000", 2024-04-24T13:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3846e-05 2024-04-24T13:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2273 3.1c 3:386b02cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.077819+0000", 2024-04-24T13:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.228607624, 2024-04-24T13:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016399364, 2024-04-24T13:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.416 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.417 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.417 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2273 2024-04-24T13:32:41.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.417 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.077819+0000", 2024-04-24T13:32:41.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.077819+0000", 2024-04-24T13:32:41.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.077820+0000", 2024-04-24T13:32:41.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5740000000000001e-06 2024-04-24T13:32:41.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081705+0000", 2024-04-24T13:32:41.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038844040000000002 2024-04-24T13:32:41.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081723+0000", 2024-04-24T13:32:41.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7892000000000001e-05 2024-04-24T13:32:41.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081732+0000", 2024-04-24T13:32:41.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0569999999999999e-06 2024-04-24T13:32:41.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081812+0000", 2024-04-24T13:32:41.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0476000000000007e-05 2024-04-24T13:32:41.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081961+0000", 2024-04-24T13:32:41.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014850599999999999 2024-04-24T13:32:41.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:41.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.082094+0000", 2024-04-24T13:32:41.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013324300000000001 2024-04-24T13:32:41.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088394+0000", 2024-04-24T13:32:41.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062996700000000003 2024-04-24T13:32:41.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.094036+0000", 2024-04-24T13:32:41.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056424860000000004 2024-04-24T13:32:41.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.094144+0000", 2024-04-24T13:32:41.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107983 2024-04-24T13:32:41.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.094218+0000", 2024-04-24T13:32:41.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4072999999999994e-05 2024-04-24T13:32:41.423 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.423 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.423 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.423 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2274 3.2f 3:f7fb6ab2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:41.423 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.088365+0000", 2024-04-24T13:32:41.423 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.218060878999999, 2024-04-24T13:32:41.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012884712, 2024-04-24T13:32:41.423 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2274 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088365+0000", 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088365+0000", 2024-04-24T13:32:41.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088368+0000", 2024-04-24T13:32:41.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.261e-06 2024-04-24T13:32:41.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092225+0000", 2024-04-24T13:32:41.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003857316 2024-04-24T13:32:41.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092243+0000", 2024-04-24T13:32:41.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7606999999999999e-05 2024-04-24T13:32:41.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092253+0000", 2024-04-24T13:32:41.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0095000000000001e-05 2024-04-24T13:32:41.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092315+0000", 2024-04-24T13:32:41.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2426000000000002e-05 2024-04-24T13:32:41.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092429+0000", 2024-04-24T13:32:41.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113515 2024-04-24T13:32:41.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092527+0000", 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8812000000000002e-05 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.096526+0000", 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039980129999999999 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.101159+0000", 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046330169999999997 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.101209+0000", 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0869999999999999e-05 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.101250+0000", 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0779999999999999e-05 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.429 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:41.431 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:41.432 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:41.429+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:41.468 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:32:41.539 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:41.535+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:41.610 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:41.610 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:41.610 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:41.610 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:41.624 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:41.670 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:41.669+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:41.733 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:41.729+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:41.742 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:41.742 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:41.742 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:41.756 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:41.834 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:41.831+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:41.923 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:41.923 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:41.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:41.923 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:41.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.923 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:41.923 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:41.923 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 132.63965640000001, 2024-04-24T13:32:41.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048388950000000002, 2024-04-24T13:32:41.924 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.924 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.924 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.924 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.924 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.924 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.924 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-24T13:32:41.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.924 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:41.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:41.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:32:41.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3799999999999998e-06 2024-04-24T13:32:41.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279193+0000", 2024-04-24T13:32:41.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7674e-05 2024-04-24T13:32:41.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279224+0000", 2024-04-24T13:32:41.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0654000000000002e-05 2024-04-24T13:32:41.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279244+0000", 2024-04-24T13:32:41.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:32:41.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279426+0000", 2024-04-24T13:32:41.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018255300000000001 2024-04-24T13:32:41.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279717+0000", 2024-04-24T13:32:41.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029043800000000001 2024-04-24T13:32:41.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:41.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279993+0000", 2024-04-24T13:32:41.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276786 2024-04-24T13:32:41.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282898+0000", 2024-04-24T13:32:41.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002904093 2024-04-24T13:32:41.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283731+0000", 2024-04-24T13:32:41.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00083382599999999997 2024-04-24T13:32:41.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283886+0000", 2024-04-24T13:32:41.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015512600000000001 2024-04-24T13:32:41.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284001+0000", 2024-04-24T13:32:41.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114405 2024-04-24T13:32:41.931 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.931 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.931 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.931 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410010339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:41.931 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:41.931 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 132.63453180499999, 2024-04-24T13:32:41.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044116340000000002, 2024-04-24T13:32:41.932 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.932 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.932 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.932 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.932 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-24T13:32:41.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.932 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:41.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:41.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284289+0000", 2024-04-24T13:32:41.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.125e-06 2024-04-24T13:32:41.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284299+0000", 2024-04-24T13:32:41.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0485999999999999e-05 2024-04-24T13:32:41.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284330+0000", 2024-04-24T13:32:41.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0528000000000003e-05 2024-04-24T13:32:41.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284345+0000", 2024-04-24T13:32:41.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4883e-05 2024-04-24T13:32:41.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284484+0000", 2024-04-24T13:32:41.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139708 2024-04-24T13:32:41.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284655+0000", 2024-04-24T13:32:41.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170953 2024-04-24T13:32:41.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:41.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284981+0000", 2024-04-24T13:32:41.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000325648 2024-04-24T13:32:41.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.287326+0000", 2024-04-24T13:32:41.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023452709999999999 2024-04-24T13:32:41.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288427+0000", 2024-04-24T13:32:41.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001100544 2024-04-24T13:32:41.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288551+0000", 2024-04-24T13:32:41.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012466500000000001 2024-04-24T13:32:41.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288698+0000", 2024-04-24T13:32:41.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146823 2024-04-24T13:32:41.939 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.939 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.940 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.940 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-24T13:32:41.940 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:41.940 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 129.65531892000001, 2024-04-24T13:32:41.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047820809999999997, 2024-04-24T13:32:41.940 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.940 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.940 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.940 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.941 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.941 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.941 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-24T13:32:41.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.941 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:41.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:41.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263503+0000", 2024-04-24T13:32:41.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.039e-06 2024-04-24T13:32:41.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263520+0000", 2024-04-24T13:32:41.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7198e-05 2024-04-24T13:32:41.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263548+0000", 2024-04-24T13:32:41.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8158e-05 2024-04-24T13:32:41.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263565+0000", 2024-04-24T13:32:41.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7008e-05 2024-04-24T13:32:41.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263754+0000", 2024-04-24T13:32:41.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001894 2024-04-24T13:32:41.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263973+0000", 2024-04-24T13:32:41.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218593 2024-04-24T13:32:41.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:41.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.264373+0000", 2024-04-24T13:32:41.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040043400000000002 2024-04-24T13:32:41.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.266377+0000", 2024-04-24T13:32:41.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020033030000000001 2024-04-24T13:32:41.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268121+0000", 2024-04-24T13:32:41.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017441049999999999 2024-04-24T13:32:41.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268212+0000", 2024-04-24T13:32:41.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1490000000000007e-05 2024-04-24T13:32:41.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268282+0000", 2024-04-24T13:32:41.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9352999999999998e-05 2024-04-24T13:32:41.947 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.947 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.947 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.947 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:41.947 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:41.947 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 129.575606768, 2024-04-24T13:32:41.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034252639999999999, 2024-04-24T13:32:41.947 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.948 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.948 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.948 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.948 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.948 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.948 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 220 2024-04-24T13:32:41.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.948 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:41.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:41.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343214+0000", 2024-04-24T13:32:41.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:32:41.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343227+0000", 2024-04-24T13:32:41.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2941e-05 2024-04-24T13:32:41.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343259+0000", 2024-04-24T13:32:41.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1557000000000003e-05 2024-04-24T13:32:41.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343274+0000", 2024-04-24T13:32:41.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5401999999999999e-05 2024-04-24T13:32:41.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343455+0000", 2024-04-24T13:32:41.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018068700000000001 2024-04-24T13:32:41.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343694+0000", 2024-04-24T13:32:41.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238552 2024-04-24T13:32:41.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:41.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.344088+0000", 2024-04-24T13:32:41.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039456400000000003 2024-04-24T13:32:41.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.345723+0000", 2024-04-24T13:32:41.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016349139999999999 2024-04-24T13:32:41.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346480+0000", 2024-04-24T13:32:41.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075738300000000004 2024-04-24T13:32:41.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346569+0000", 2024-04-24T13:32:41.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8281000000000004e-05 2024-04-24T13:32:41.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346637+0000", 2024-04-24T13:32:41.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8165999999999998e-05 2024-04-24T13:32:41.953 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.953 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.954 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.954 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:41.954 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:41.954 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 129.55786647100001, 2024-04-24T13:32:41.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032957419999999999, 2024-04-24T13:32:41.954 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.954 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.954 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.955 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.955 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-24T13:32:41.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.955 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:41.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:41.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360954+0000", 2024-04-24T13:32:41.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.154e-06 2024-04-24T13:32:41.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360965+0000", 2024-04-24T13:32:41.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1321999999999999e-05 2024-04-24T13:32:41.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360996+0000", 2024-04-24T13:32:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0902999999999999e-05 2024-04-24T13:32:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361012+0000", 2024-04-24T13:32:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:32:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361185+0000", 2024-04-24T13:32:41.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172072 2024-04-24T13:32:41.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361404+0000", 2024-04-24T13:32:41.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021965999999999999 2024-04-24T13:32:41.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:41.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361852+0000", 2024-04-24T13:32:41.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000448276 2024-04-24T13:32:41.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.363340+0000", 2024-04-24T13:32:41.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001487169 2024-04-24T13:32:41.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364094+0000", 2024-04-24T13:32:41.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075443699999999995 2024-04-24T13:32:41.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364184+0000", 2024-04-24T13:32:41.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9957000000000006e-05 2024-04-24T13:32:41.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364248+0000", 2024-04-24T13:32:41.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3627000000000006e-05 2024-04-24T13:32:41.960 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.960 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.960 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.961 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:41.961 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:41.961 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 129.554301624, 2024-04-24T13:32:41.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036426480000000001, 2024-04-24T13:32:41.961 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.961 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.961 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.961 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.961 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.961 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.961 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-24T13:32:41.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.962 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:41.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:41.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364519+0000", 2024-04-24T13:32:41.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-24T13:32:41.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364529+0000", 2024-04-24T13:32:41.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088999999999999e-05 2024-04-24T13:32:41.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364554+0000", 2024-04-24T13:32:41.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5537e-05 2024-04-24T13:32:41.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364568+0000", 2024-04-24T13:32:41.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3372e-05 2024-04-24T13:32:41.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364726+0000", 2024-04-24T13:32:41.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015809299999999999 2024-04-24T13:32:41.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365059+0000", 2024-04-24T13:32:41.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000333185 2024-04-24T13:32:41.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:41.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365758+0000", 2024-04-24T13:32:41.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069934299999999995 2024-04-24T13:32:41.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.367413+0000", 2024-04-24T13:32:41.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016552349999999999 2024-04-24T13:32:41.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368012+0000", 2024-04-24T13:32:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059858700000000003 2024-04-24T13:32:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368097+0000", 2024-04-24T13:32:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5253999999999994e-05 2024-04-24T13:32:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368159+0000", 2024-04-24T13:32:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2113000000000007e-05 2024-04-24T13:32:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 129.52491498800001, 2024-04-24T13:32:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033998840000000002, 2024-04-24T13:32:41.968 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-24T13:32:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:41.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393906+0000", 2024-04-24T13:32:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1569999999999998e-06 2024-04-24T13:32:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393917+0000", 2024-04-24T13:32:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1348999999999999e-05 2024-04-24T13:32:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393942+0000", 2024-04-24T13:32:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.527e-05 2024-04-24T13:32:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393957+0000", 2024-04-24T13:32:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4355999999999999e-05 2024-04-24T13:32:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394127+0000", 2024-04-24T13:32:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170555 2024-04-24T13:32:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394352+0000", 2024-04-24T13:32:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224539 2024-04-24T13:32:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394788+0000", 2024-04-24T13:32:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043600099999999999 2024-04-24T13:32:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.396137+0000", 2024-04-24T13:32:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001349404 2024-04-24T13:32:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397158+0000", 2024-04-24T13:32:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001020738 2024-04-24T13:32:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397237+0000", 2024-04-24T13:32:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9319000000000004e-05 2024-04-24T13:32:41.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397303+0000", 2024-04-24T13:32:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6196000000000001e-05 2024-04-24T13:32:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:437 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 129.455291394, 2024-04-24T13:32:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048056540000000003, 2024-04-24T13:32:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 437 2024-04-24T13:32:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463529+0000", 2024-04-24T13:32:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2479999999999999e-06 2024-04-24T13:32:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463544+0000", 2024-04-24T13:32:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:32:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463572+0000", 2024-04-24T13:32:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8294e-05 2024-04-24T13:32:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463590+0000", 2024-04-24T13:32:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-24T13:32:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464092+0000", 2024-04-24T13:32:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000502189 2024-04-24T13:32:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464454+0000", 2024-04-24T13:32:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036231300000000001 2024-04-24T13:32:41.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:41.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464831+0000", 2024-04-24T13:32:41.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000377375 2024-04-24T13:32:41.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467473+0000", 2024-04-24T13:32:41.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026414659999999999 2024-04-24T13:32:41.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468185+0000", 2024-04-24T13:32:41.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071215199999999997 2024-04-24T13:32:41.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468271+0000", 2024-04-24T13:32:41.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5593999999999994e-05 2024-04-24T13:32:41.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.983 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.983 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468333+0000", 2024-04-24T13:32:41.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1957000000000003e-05 2024-04-24T13:32:41.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.984 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.984 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.984 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:41.984 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:41.984 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 129.04964164500001, 2024-04-24T13:32:41.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033442569999999998, 2024-04-24T13:32:41.984 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.984 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.985 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.985 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.985 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 793 2024-04-24T13:32:41.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.985 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:41.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:41.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869179+0000", 2024-04-24T13:32:41.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.323e-06 2024-04-24T13:32:41.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869190+0000", 2024-04-24T13:32:41.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-24T13:32:41.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869222+0000", 2024-04-24T13:32:41.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1733999999999998e-05 2024-04-24T13:32:41.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869237+0000", 2024-04-24T13:32:41.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5044e-05 2024-04-24T13:32:41.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869396+0000", 2024-04-24T13:32:41.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158913 2024-04-24T13:32:41.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869763+0000", 2024-04-24T13:32:41.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367112 2024-04-24T13:32:41.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:41.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.870319+0000", 2024-04-24T13:32:41.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055558799999999998 2024-04-24T13:32:41.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.871509+0000", 2024-04-24T13:32:41.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001190607 2024-04-24T13:32:41.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872365+0000", 2024-04-24T13:32:41.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085535299999999999 2024-04-24T13:32:41.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872449+0000", 2024-04-24T13:32:41.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3834999999999999e-05 2024-04-24T13:32:41.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872521+0000", 2024-04-24T13:32:41.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2428999999999994e-05 2024-04-24T13:32:41.990 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.991 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.991 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.991 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:41.991 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:41.991 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 128.863635273, 2024-04-24T13:32:41.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003340754, 2024-04-24T13:32:41.991 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.991 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.991 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.991 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.992 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.992 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.992 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 874 2024-04-24T13:32:41.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.992 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:41.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:41.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:41.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055185+0000", 2024-04-24T13:32:41.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:32:41.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:41.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055197+0000", 2024-04-24T13:32:41.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1606e-05 2024-04-24T13:32:41.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:41.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055229+0000", 2024-04-24T13:32:41.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1603000000000002e-05 2024-04-24T13:32:41.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:41.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055244+0000", 2024-04-24T13:32:41.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4928e-05 2024-04-24T13:32:41.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:41.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055397+0000", 2024-04-24T13:32:41.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015366499999999999 2024-04-24T13:32:41.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:41.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055763+0000", 2024-04-24T13:32:41.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036565600000000001 2024-04-24T13:32:41.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:41.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.056317+0000", 2024-04-24T13:32:41.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055436600000000004 2024-04-24T13:32:41.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:41.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.057678+0000", 2024-04-24T13:32:41.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001361283 2024-04-24T13:32:41.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:41.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058258+0000", 2024-04-24T13:32:41.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057942400000000004 2024-04-24T13:32:41.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:41.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058407+0000", 2024-04-24T13:32:41.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000149188 2024-04-24T13:32:41.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:41.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058524+0000", 2024-04-24T13:32:41.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116805 2024-04-24T13:32:41.997 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.997 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:41.998 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:41.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.998 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1566 4.38 4:1cdfa9df:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.3.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:41.998 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:41.998 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.362644, 2024-04-24T13:32:41.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040238560000000001, 2024-04-24T13:32:41.998 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:41.998 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:41.998 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:41.998 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:41.998 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:41.999 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:41.999 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1566 2024-04-24T13:32:41.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.999 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:41.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:41.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:41.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:41.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:41.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:41.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:41.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:42.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556176+0000", 2024-04-24T13:32:42.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.057e-06 2024-04-24T13:32:42.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556187+0000", 2024-04-24T13:32:42.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0693000000000001e-05 2024-04-24T13:32:42.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556219+0000", 2024-04-24T13:32:42.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1718999999999999e-05 2024-04-24T13:32:42.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556242+0000", 2024-04-24T13:32:42.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2687000000000001e-05 2024-04-24T13:32:42.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556384+0000", 2024-04-24T13:32:42.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014257899999999999 2024-04-24T13:32:42.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556624+0000", 2024-04-24T13:32:42.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024014199999999999 2024-04-24T13:32:42.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:42.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556921+0000", 2024-04-24T13:32:42.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029673900000000002 2024-04-24T13:32:42.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.559462+0000", 2024-04-24T13:32:42.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025407530000000002 2024-04-24T13:32:42.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560009+0000", 2024-04-24T13:32:42.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054690399999999997 2024-04-24T13:32:42.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560096+0000", 2024-04-24T13:32:42.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7597999999999997e-05 2024-04-24T13:32:42.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560198+0000", 2024-04-24T13:32:42.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010198499999999999 2024-04-24T13:32:42.005 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.005 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.006 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.006 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1721 4.38 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:42.006 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:42.006 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.168277539999998, 2024-04-24T13:32:42.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088323519999999999, 2024-04-24T13:32:42.006 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.006 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.006 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.007 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.007 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.007 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.007 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1721 2024-04-24T13:32:42.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.007 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:42.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:42.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750544+0000", 2024-04-24T13:32:42.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9569999999999998e-06 2024-04-24T13:32:42.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750561+0000", 2024-04-24T13:32:42.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7589e-05 2024-04-24T13:32:42.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750600+0000", 2024-04-24T13:32:42.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8145999999999997e-05 2024-04-24T13:32:42.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.010 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750621+0000", 2024-04-24T13:32:42.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1109999999999999e-05 2024-04-24T13:32:42.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.010 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750797+0000", 2024-04-24T13:32:42.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017672599999999999 2024-04-24T13:32:42.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751113+0000", 2024-04-24T13:32:42.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031514599999999998 2024-04-24T13:32:42.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:42.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751586+0000", 2024-04-24T13:32:42.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047325699999999999 2024-04-24T13:32:42.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753982+0000", 2024-04-24T13:32:42.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023960880000000002 2024-04-24T13:32:42.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759108+0000", 2024-04-24T13:32:42.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051256590000000003 2024-04-24T13:32:42.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759247+0000", 2024-04-24T13:32:42.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013992400000000001 2024-04-24T13:32:42.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759373+0000", 2024-04-24T13:32:42.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012574999999999999 2024-04-24T13:32:42.014 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.014 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.014 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.014 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1724 4.38 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:42.014 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:42.014 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.168151386000002, 2024-04-24T13:32:42.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093322379999999996, 2024-04-24T13:32:42.015 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.015 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.015 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.015 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.015 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.015 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.015 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1724 2024-04-24T13:32:42.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.015 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:42.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:42.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750669+0000", 2024-04-24T13:32:42.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7269999999999999e-06 2024-04-24T13:32:42.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750678+0000", 2024-04-24T13:32:42.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9700000000000005e-06 2024-04-24T13:32:42.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750744+0000", 2024-04-24T13:32:42.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5920999999999994e-05 2024-04-24T13:32:42.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750766+0000", 2024-04-24T13:32:42.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.226e-05 2024-04-24T13:32:42.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752483+0000", 2024-04-24T13:32:42.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001717393 2024-04-24T13:32:42.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752795+0000", 2024-04-24T13:32:42.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031186000000000001 2024-04-24T13:32:42.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:42.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753283+0000", 2024-04-24T13:32:42.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048743300000000001 2024-04-24T13:32:42.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.756401+0000", 2024-04-24T13:32:42.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031181220000000001 2024-04-24T13:32:42.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759844+0000", 2024-04-24T13:32:42.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003443715 2024-04-24T13:32:42.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759934+0000", 2024-04-24T13:32:42.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9728000000000006e-05 2024-04-24T13:32:42.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759999+0000", 2024-04-24T13:32:42.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5109000000000003e-05 2024-04-24T13:32:42.021 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.021 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.021 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.022 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1814 4.38 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:42.022 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:42.022 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.977364209000001, 2024-04-24T13:32:42.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065250220000000001, 2024-04-24T13:32:42.022 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.022 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.022 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.022 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.022 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.022 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.022 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1814 2024-04-24T13:32:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941457+0000", 2024-04-24T13:32:42.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:42.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941467+0000", 2024-04-24T13:32:42.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0596e-05 2024-04-24T13:32:42.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941503+0000", 2024-04-24T13:32:42.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5398999999999998e-05 2024-04-24T13:32:42.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941524+0000", 2024-04-24T13:32:42.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1586e-05 2024-04-24T13:32:42.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941687+0000", 2024-04-24T13:32:42.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016257000000000001 2024-04-24T13:32:42.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941919+0000", 2024-04-24T13:32:42.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232315 2024-04-24T13:32:42.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:42.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942204+0000", 2024-04-24T13:32:42.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028527000000000001 2024-04-24T13:32:42.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.945033+0000", 2024-04-24T13:32:42.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028291029999999999 2024-04-24T13:32:42.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947677+0000", 2024-04-24T13:32:42.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026439649999999999 2024-04-24T13:32:42.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947848+0000", 2024-04-24T13:32:42.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017036699999999999 2024-04-24T13:32:42.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947979+0000", 2024-04-24T13:32:42.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131524 2024-04-24T13:32:42.028 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.028 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.028 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.028 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1817 4.38 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:42.028 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:42.029 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.977255262, 2024-04-24T13:32:42.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079573279999999996, 2024-04-24T13:32:42.029 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.029 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.029 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.029 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.029 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.029 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.029 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1817 2024-04-24T13:32:42.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.029 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:42.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:42.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941565+0000", 2024-04-24T13:32:42.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.657e-06 2024-04-24T13:32:42.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941573+0000", 2024-04-24T13:32:42.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4169999999999992e-06 2024-04-24T13:32:42.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941596+0000", 2024-04-24T13:32:42.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2535999999999999e-05 2024-04-24T13:32:42.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941610+0000", 2024-04-24T13:32:42.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3746e-05 2024-04-24T13:32:42.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944182+0000", 2024-04-24T13:32:42.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025729540000000001 2024-04-24T13:32:42.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944388+0000", 2024-04-24T13:32:42.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000205183 2024-04-24T13:32:42.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:42.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944557+0000", 2024-04-24T13:32:42.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016964200000000001 2024-04-24T13:32:42.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.946998+0000", 2024-04-24T13:32:42.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024406670000000001 2024-04-24T13:32:42.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949247+0000", 2024-04-24T13:32:42.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022489490000000001 2024-04-24T13:32:42.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949406+0000", 2024-04-24T13:32:42.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000159436 2024-04-24T13:32:42.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949520+0000", 2024-04-24T13:32:42.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114141 2024-04-24T13:32:42.035 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.035 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.035 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.035 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2212 3.3a 3:5de7fd4f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.035 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:42.035 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.520590102, 2024-04-24T13:32:42.036 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024848709, 2024-04-24T13:32:42.036 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.036 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.036 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.036 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.036 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.036 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.036 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2212 2024-04-24T13:32:42.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.037 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:42.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.037 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.037 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.037 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:42.037 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.037 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398232+0000", 2024-04-24T13:32:42.038 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-24T13:32:42.038 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.038 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.038 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.038 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405320+0000", 2024-04-24T13:32:42.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070884040000000004 2024-04-24T13:32:42.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405367+0000", 2024-04-24T13:32:42.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6940000000000001e-05 2024-04-24T13:32:42.039 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.039 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.039 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.039 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405393+0000", 2024-04-24T13:32:42.039 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5252000000000001e-05 2024-04-24T13:32:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405487+0000", 2024-04-24T13:32:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4596e-05 2024-04-24T13:32:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405609+0000", 2024-04-24T13:32:42.040 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121892 2024-04-24T13:32:42.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:42.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405710+0000", 2024-04-24T13:32:42.041 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010121899999999999 2024-04-24T13:32:42.041 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.041 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.041 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.041 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.415423+0000", 2024-04-24T13:32:42.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097131219999999994 2024-04-24T13:32:42.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.422967+0000", 2024-04-24T13:32:42.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00754319 2024-04-24T13:32:42.042 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.042 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.042 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.042 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.423023+0000", 2024-04-24T13:32:42.042 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5958000000000002e-05 2024-04-24T13:32:42.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.043 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.043 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.423077+0000", 2024-04-24T13:32:42.043 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4432999999999999e-05 2024-04-24T13:32:42.043 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.043 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.043 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.043 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.043 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.043 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2245 3.1d 3:bb337c31:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.043 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:42.044 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.143313278999999, 2024-04-24T13:32:42.044 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020498309999999999, 2024-04-24T13:32:42.044 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.044 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.044 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.044 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.044 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.044 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.044 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-24T13:32:42.044 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.044 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.044 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:42.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.045 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.045 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:42.045 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.045 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.045 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775508+0000", 2024-04-24T13:32:42.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.486e-06 2024-04-24T13:32:42.046 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.046 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.046 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.046 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779469+0000", 2024-04-24T13:32:42.046 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003961862 2024-04-24T13:32:42.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779497+0000", 2024-04-24T13:32:42.047 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7559000000000002e-05 2024-04-24T13:32:42.047 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.047 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.047 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.047 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779513+0000", 2024-04-24T13:32:42.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6450999999999999e-05 2024-04-24T13:32:42.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779626+0000", 2024-04-24T13:32:42.048 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112478 2024-04-24T13:32:42.048 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.048 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.048 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.048 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779794+0000", 2024-04-24T13:32:42.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016824099999999999 2024-04-24T13:32:42.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.049 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:42.049 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779922+0000", 2024-04-24T13:32:42.049 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012780199999999999 2024-04-24T13:32:42.049 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.049 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.793374+0000", 2024-04-24T13:32:42.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013451942 2024-04-24T13:32:42.050 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.050 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.050 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.050 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795894+0000", 2024-04-24T13:32:42.050 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025205079999999999 2024-04-24T13:32:42.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795951+0000", 2024-04-24T13:32:42.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6131000000000002e-05 2024-04-24T13:32:42.051 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.051 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.051 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.051 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.796003+0000", 2024-04-24T13:32:42.051 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2849999999999997e-05 2024-04-24T13:32:42.052 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.052 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.052 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.052 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.052 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.052 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2248 3.1d 3:b991c377:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.052 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:42.052 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.113524016, 2024-04-24T13:32:42.052 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016320675999999999, 2024-04-24T13:32:42.052 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.052 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.052 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.052 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.053 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.053 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.053 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2248 2024-04-24T13:32:42.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.053 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.053 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.053 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.053 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:42.053 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.053 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:42.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.054 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.054 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.054 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805301+0000", 2024-04-24T13:32:42.054 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1399999999999997e-06 2024-04-24T13:32:42.054 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809310+0000", 2024-04-24T13:32:42.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040090179999999996 2024-04-24T13:32:42.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.055 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.055 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809337+0000", 2024-04-24T13:32:42.055 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7636000000000001e-05 2024-04-24T13:32:42.055 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.055 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809351+0000", 2024-04-24T13:32:42.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3728e-05 2024-04-24T13:32:42.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.056 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809435+0000", 2024-04-24T13:32:42.056 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3956999999999996e-05 2024-04-24T13:32:42.056 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.056 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.056 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809588+0000", 2024-04-24T13:32:42.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015312299999999999 2024-04-24T13:32:42.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:42.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809713+0000", 2024-04-24T13:32:42.057 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012522299999999999 2024-04-24T13:32:42.057 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.057 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.057 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.057 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.815947+0000", 2024-04-24T13:32:42.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062333359999999999 2024-04-24T13:32:42.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821522+0000", 2024-04-24T13:32:42.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055754239999999998 2024-04-24T13:32:42.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.058 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.058 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.058 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821572+0000", 2024-04-24T13:32:42.058 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0005e-05 2024-04-24T13:32:42.058 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.059 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.059 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821615+0000", 2024-04-24T13:32:42.059 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3086e-05 2024-04-24T13:32:42.059 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.059 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.059 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.059 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.059 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.059 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2250 3.3c 3:3d3fcdd2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.059 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:42.059 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.094758952999999, 2024-04-24T13:32:42.060 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018935203000000001, 2024-04-24T13:32:42.060 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.060 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.060 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.060 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.060 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.060 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.060 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2250 2024-04-24T13:32:42.060 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.060 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.060 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.060 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:42.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:42.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.061 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.061 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.061 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.061 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824061+0000", 2024-04-24T13:32:42.061 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.725e-06 2024-04-24T13:32:42.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827859+0000", 2024-04-24T13:32:42.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037982960000000001 2024-04-24T13:32:42.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.062 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.062 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.062 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827885+0000", 2024-04-24T13:32:42.062 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5761e-05 2024-04-24T13:32:42.062 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827896+0000", 2024-04-24T13:32:42.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1136e-05 2024-04-24T13:32:42.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.063 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828017+0000", 2024-04-24T13:32:42.063 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012102100000000001 2024-04-24T13:32:42.063 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.063 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.063 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828290+0000", 2024-04-24T13:32:42.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027271199999999999 2024-04-24T13:32:42.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:42.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828528+0000", 2024-04-24T13:32:42.064 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023780599999999999 2024-04-24T13:32:42.064 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.064 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.064 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.064 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.835369+0000", 2024-04-24T13:32:42.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068407609999999999 2024-04-24T13:32:42.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842842+0000", 2024-04-24T13:32:42.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074735390000000004 2024-04-24T13:32:42.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.065 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.065 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842928+0000", 2024-04-24T13:32:42.065 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5513999999999995e-05 2024-04-24T13:32:42.065 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.065 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.066 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.066 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842995+0000", 2024-04-24T13:32:42.066 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6932000000000002e-05 2024-04-24T13:32:42.066 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.066 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.066 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.066 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.066 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.066 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2251 3.3a 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.066 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:42.066 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.083940707, 2024-04-24T13:32:42.067 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030524880000000001, 2024-04-24T13:32:42.067 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.067 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.067 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.067 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.067 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.067 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.067 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2251 2024-04-24T13:32:42.067 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.067 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.067 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.067 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:42.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:42.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.068 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.068 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.068 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.068 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834880+0000", 2024-04-24T13:32:42.068 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6769999999999999e-06 2024-04-24T13:32:42.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839556+0000", 2024-04-24T13:32:42.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046751350000000004 2024-04-24T13:32:42.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.069 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839593+0000", 2024-04-24T13:32:42.069 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7079999999999997e-05 2024-04-24T13:32:42.069 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.069 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.069 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.070 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839617+0000", 2024-04-24T13:32:42.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4015999999999998e-05 2024-04-24T13:32:42.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.070 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.070 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839773+0000", 2024-04-24T13:32:42.070 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015627699999999999 2024-04-24T13:32:42.070 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.070 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.070 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.070 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840011+0000", 2024-04-24T13:32:42.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023843900000000001 2024-04-24T13:32:42.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:42.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840261+0000", 2024-04-24T13:32:42.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024939899999999997 2024-04-24T13:32:42.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.071 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.071 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.071 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.853562+0000", 2024-04-24T13:32:42.071 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013301726999999999 2024-04-24T13:32:42.071 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865276+0000", 2024-04-24T13:32:42.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011713779000000001 2024-04-24T13:32:42.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.072 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865349+0000", 2024-04-24T13:32:42.072 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2624000000000001e-05 2024-04-24T13:32:42.072 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.072 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.072 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.073 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865403+0000", 2024-04-24T13:32:42.073 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3727000000000002e-05 2024-04-24T13:32:42.073 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.073 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.073 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.073 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.073 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.073 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:42.075 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:42.076 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:42.071+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:42.176 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:42.173+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:42.201 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:42.201 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:42.201 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:42.201 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:42.216 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:42.277 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:42.275+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:42.377 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:42.373+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:42.382 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:42.383 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:42.383 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:42.383 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:42.383 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:42.397 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:42.478 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:42.475+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:42.564 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:42.564 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:42.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:42.564 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:42.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.565 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:42.565 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:42.565 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 133.31797169500001, 2024-04-24T13:32:42.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:32:42.565 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.565 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.565 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.566 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:32:42.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.566 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:42.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:42.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:32:42.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:32:42.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:32:42.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:32:42.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:32:42.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:32:42.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:32:42.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:32:42.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:32:42.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:32:42.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:42.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:32:42.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:32:42.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:32:42.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:32:42.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:32:42.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:32:42.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:32:42.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:32:42.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:32:42.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:32:42.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:32:42.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:42.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:32:42.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:32:42.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:32:42.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:32:42.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:32:42.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:32:42.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1618 3.36 3:6e88aafa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:42.573 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:42.574 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.333196281999999, 2024-04-24T13:32:42.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025620654, 2024-04-24T13:32:42.574 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.574 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.574 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.574 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.574 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.574 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.574 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1618 2024-04-24T13:32:42.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.574 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:42.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:42.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229083+0000", 2024-04-24T13:32:42.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2100000000000002e-06 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234443+0000", 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053597139999999998 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234484+0000", 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0902999999999998e-05 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234502+0000", 2024-04-24T13:32:42.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8252000000000001e-05 2024-04-24T13:32:42.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234657+0000", 2024-04-24T13:32:42.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015551000000000001 2024-04-24T13:32:42.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234920+0000", 2024-04-24T13:32:42.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263114 2024-04-24T13:32:42.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.236227+0000", 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001306179 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.251163+0000", 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014936766000000001 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254465+0000", 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003301151 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254581+0000", 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116224 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254700+0000", 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011963099999999999 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.579 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2207 3.38 e85/74 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:42.580 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:42.580 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.254254233999999, 2024-04-24T13:32:42.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015720683999999999, 2024-04-24T13:32:42.580 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.580 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.580 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.580 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:42.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308024+0000", 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314047+0000", 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060226259999999997 2024-04-24T13:32:42.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314095+0000", 2024-04-24T13:32:42.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7803000000000003e-05 2024-04-24T13:32:42.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314118+0000", 2024-04-24T13:32:42.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3218999999999999e-05 2024-04-24T13:32:42.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314281+0000", 2024-04-24T13:32:42.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016252399999999999 2024-04-24T13:32:42.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314321+0000", 2024-04-24T13:32:42.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0213000000000003e-05 2024-04-24T13:32:42.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.323647+0000", 2024-04-24T13:32:42.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093264079999999996 2024-04-24T13:32:42.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.323742+0000", 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5198000000000006e-05 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2209 3.14 e85/48 3:287cf44b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_4:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.222900473999999, 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01556167, 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.584 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0699999999999997e-07 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344736+0000", 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053602750000000003 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344764+0000", 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8033000000000001e-05 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344779+0000", 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4693e-05 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344934+0000", 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520399999999999 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344975+0000", 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0368999999999999e-05 2024-04-24T13:32:42.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354882+0000", 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099076630000000006 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354937+0000", 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4926000000000002e-05 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.588 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2221 3.26 3:67d4e534:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.047749654, 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017991152999999999, 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2221 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514529+0000", 2024-04-24T13:32:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3080000000000002e-06 2024-04-24T13:32:42.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519181+0000", 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046525129999999996 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519216+0000", 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5181000000000001e-05 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519228+0000", 2024-04-24T13:32:42.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1253000000000001e-05 2024-04-24T13:32:42.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519324+0000", 2024-04-24T13:32:42.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6564000000000006e-05 2024-04-24T13:32:42.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519463+0000", 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139269 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519597+0000", 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013386999999999999 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532228+0000", 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012631009 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532440+0000", 2024-04-24T13:32:42.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021200400000000001 2024-04-24T13:32:42.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532479+0000", 2024-04-24T13:32:42.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8668000000000003e-05 2024-04-24T13:32:42.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532518+0000", 2024-04-24T13:32:42.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8513999999999998e-05 2024-04-24T13:32:42.595 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.595 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.595 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.595 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2224 3.2c 3:3671ead8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.595 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:42.595 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.017568169, 2024-04-24T13:32:42.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016019095000000001, 2024-04-24T13:32:42.595 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.596 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.596 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.596 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.596 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.596 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.596 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2224 2024-04-24T13:32:42.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.596 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:42.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:42.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544710+0000", 2024-04-24T13:32:42.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5040000000000001e-06 2024-04-24T13:32:42.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548580+0000", 2024-04-24T13:32:42.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003869473 2024-04-24T13:32:42.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548609+0000", 2024-04-24T13:32:42.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9623000000000001e-05 2024-04-24T13:32:42.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548623+0000", 2024-04-24T13:32:42.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3498e-05 2024-04-24T13:32:42.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548709+0000", 2024-04-24T13:32:42.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6390000000000005e-05 2024-04-24T13:32:42.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548989+0000", 2024-04-24T13:32:42.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027985500000000002 2024-04-24T13:32:42.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:42.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549084+0000", 2024-04-24T13:32:42.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4568999999999995e-05 2024-04-24T13:32:42.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.559986+0000", 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010902692 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560649+0000", 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066290299999999995 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560687+0000", 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7644000000000001e-05 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560727+0000", 2024-04-24T13:32:42.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9944000000000002e-05 2024-04-24T13:32:42.602 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.602 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.602 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.602 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2231 3.36 3:6ddceaef:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.602 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:42.602 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.943363144999999, 2024-04-24T13:32:42.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017463218999999999, 2024-04-24T13:32:42.602 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.602 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2231 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:42.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618915+0000", 2024-04-24T13:32:42.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5620000000000002e-06 2024-04-24T13:32:42.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622655+0000", 2024-04-24T13:32:42.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003739984 2024-04-24T13:32:42.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622683+0000", 2024-04-24T13:32:42.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7390999999999999e-05 2024-04-24T13:32:42.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622697+0000", 2024-04-24T13:32:42.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3694e-05 2024-04-24T13:32:42.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622795+0000", 2024-04-24T13:32:42.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8518999999999996e-05 2024-04-24T13:32:42.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.623022+0000", 2024-04-24T13:32:42.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022680700000000001 2024-04-24T13:32:42.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:42.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.623244+0000", 2024-04-24T13:32:42.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022219199999999999 2024-04-24T13:32:42.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634301+0000", 2024-04-24T13:32:42.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011056718 2024-04-24T13:32:42.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636075+0000", 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001774437 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636243+0000", 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016734399999999999 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636376+0000", 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000133571 2024-04-24T13:32:42.608 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.609 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.609 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.609 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2232 3.a 3:53fed644:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.609 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:42.609 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.931626117, 2024-04-24T13:32:42.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017222277000000001, 2024-04-24T13:32:42.609 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.609 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.609 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.609 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.610 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.610 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.610 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2232 2024-04-24T13:32:42.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.610 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:42.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630652+0000", 2024-04-24T13:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5119999999999998e-06 2024-04-24T13:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634591+0000", 2024-04-24T13:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039383990000000004 2024-04-24T13:32:42.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634610+0000", 2024-04-24T13:32:42.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9530000000000001e-05 2024-04-24T13:32:42.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634620+0000", 2024-04-24T13:32:42.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0081000000000001e-05 2024-04-24T13:32:42.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634679+0000", 2024-04-24T13:32:42.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8483999999999998e-05 2024-04-24T13:32:42.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634807+0000", 2024-04-24T13:32:42.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012772 2024-04-24T13:32:42.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:42.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634918+0000", 2024-04-24T13:32:42.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011121 2024-04-24T13:32:42.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.641801+0000", 2024-04-24T13:32:42.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006883213 2024-04-24T13:32:42.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647770+0000", 2024-04-24T13:32:42.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059689729999999998 2024-04-24T13:32:42.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647818+0000", 2024-04-24T13:32:42.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8455000000000003e-05 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647872+0000", 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3699999999999997e-05 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2233 3.c e85/74 3:3257d695:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_28:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.918985135, 2024-04-24T13:32:42.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015313149, 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643292+0000", 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4980000000000001e-06 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647384+0000", 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040918980000000001 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647409+0000", 2024-04-24T13:32:42.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4719000000000002e-05 2024-04-24T13:32:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647421+0000", 2024-04-24T13:32:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1956999999999999e-05 2024-04-24T13:32:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647575+0000", 2024-04-24T13:32:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015421900000000001 2024-04-24T13:32:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647642+0000", 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6822000000000005e-05 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.658477+0000", 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010835200999999999 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.658604+0000", 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126835 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.619 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2234 3.34 e85/20 3:2f41ca12:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_29:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.905260002, 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013995339000000001, 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657018+0000", 2024-04-24T13:32:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0700000000000001e-06 2024-04-24T13:32:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659913+0000", 2024-04-24T13:32:42.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028946079999999999 2024-04-24T13:32:42.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659934+0000", 2024-04-24T13:32:42.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1154000000000001e-05 2024-04-24T13:32:42.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659946+0000", 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1958e-05 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.660012+0000", 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5870000000000005e-05 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.660041+0000", 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9280000000000001e-05 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.670873+0000", 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010831591999999999 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671011+0000", 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013880699999999999 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2238 3.20 3:07ab05cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.624 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:42.625 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.863533431, 2024-04-24T13:32:42.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019528604000000001, 2024-04-24T13:32:42.625 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.625 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.625 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.625 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.625 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.625 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.625 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2238 2024-04-24T13:32:42.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.625 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:42.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:42.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698745+0000", 2024-04-24T13:32:42.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-24T13:32:42.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702722+0000", 2024-04-24T13:32:42.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039764370000000002 2024-04-24T13:32:42.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702755+0000", 2024-04-24T13:32:42.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3676000000000001e-05 2024-04-24T13:32:42.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702771+0000", 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5823000000000001e-05 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702854+0000", 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2804000000000002e-05 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702974+0000", 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120258 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.703104+0000", 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129708 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.710231+0000", 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071274570000000002 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718023+0000", 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077912720000000001 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718164+0000", 2024-04-24T13:32:42.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014127500000000001 2024-04-24T13:32:42.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718271+0000", 2024-04-24T13:32:42.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107371 2024-04-24T13:32:42.630 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.630 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.630 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.630 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2240 3.3f 3:fe4f476b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.842983961, 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014610142, 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2240 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719294+0000", 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0770000000000002e-06 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723057+0000", 2024-04-24T13:32:42.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037627060000000002 2024-04-24T13:32:42.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723089+0000", 2024-04-24T13:32:42.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1968999999999998e-05 2024-04-24T13:32:42.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723100+0000", 2024-04-24T13:32:42.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0695e-05 2024-04-24T13:32:42.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723176+0000", 2024-04-24T13:32:42.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6589999999999997e-05 2024-04-24T13:32:42.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723313+0000", 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136806 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723434+0000", 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120835 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.727850+0000", 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044163229999999998 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733804+0000", 2024-04-24T13:32:42.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059542620000000001 2024-04-24T13:32:42.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733849+0000", 2024-04-24T13:32:42.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4455e-05 2024-04-24T13:32:42.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733902+0000", 2024-04-24T13:32:42.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3424000000000002e-05 2024-04-24T13:32:42.637 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.637 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.637 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.637 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2247 3.2a 3:56a679bb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.637 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:42.637 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.767405781000001, 2024-04-24T13:32:42.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018867848, 2024-04-24T13:32:42.637 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.638 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.638 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.638 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.638 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.638 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.638 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2247 2024-04-24T13:32:42.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.638 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794873+0000", 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7130000000000001e-06 2024-04-24T13:32:42.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799547+0000", 2024-04-24T13:32:42.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004674114 2024-04-24T13:32:42.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799586+0000", 2024-04-24T13:32:42.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9279999999999997e-05 2024-04-24T13:32:42.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799613+0000", 2024-04-24T13:32:42.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6239000000000001e-05 2024-04-24T13:32:42.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799734+0000", 2024-04-24T13:32:42.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120964 2024-04-24T13:32:42.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799986+0000", 2024-04-24T13:32:42.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025243200000000003 2024-04-24T13:32:42.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:42.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.800155+0000", 2024-04-24T13:32:42.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016893400000000001 2024-04-24T13:32:42.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.806810+0000", 2024-04-24T13:32:42.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066547459999999996 2024-04-24T13:32:42.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813614+0000", 2024-04-24T13:32:42.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068047730000000001 2024-04-24T13:32:42.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813684+0000", 2024-04-24T13:32:42.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9504000000000004e-05 2024-04-24T13:32:42.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813738+0000", 2024-04-24T13:32:42.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4148999999999999e-05 2024-04-24T13:32:42.644 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.644 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.644 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.645 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2254 3.20 3:079960b7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.645 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:42.645 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.69402283, 2024-04-24T13:32:42.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019983331, 2024-04-24T13:32:42.645 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.645 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.645 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.645 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.645 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.646 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.646 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2254 2024-04-24T13:32:42.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.646 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:42.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:42.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868256+0000", 2024-04-24T13:32:42.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8890000000000002e-06 2024-04-24T13:32:42.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872066+0000", 2024-04-24T13:32:42.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038094549999999998 2024-04-24T13:32:42.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872090+0000", 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4933e-05 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872104+0000", 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3246e-05 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872222+0000", 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118266 2024-04-24T13:32:42.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872485+0000", 2024-04-24T13:32:42.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026320500000000003 2024-04-24T13:32:42.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:42.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872713+0000", 2024-04-24T13:32:42.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022758000000000001 2024-04-24T13:32:42.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881332+0000", 2024-04-24T13:32:42.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086188640000000004 2024-04-24T13:32:42.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.887928+0000", 2024-04-24T13:32:42.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065959490000000003 2024-04-24T13:32:42.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.888112+0000", 2024-04-24T13:32:42.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018435700000000001 2024-04-24T13:32:42.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.888237+0000", 2024-04-24T13:32:42.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012458700000000001 2024-04-24T13:32:42.651 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.651 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.651 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.651 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2256 3.21 e85/74 3:878222a6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_51:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:42.651 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:42.651 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.669925405000001, 2024-04-24T13:32:42.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013390116000000001, 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892353+0000", 2024-04-24T13:32:42.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5629999999999999e-06 2024-04-24T13:32:42.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896496+0000", 2024-04-24T13:32:42.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041424840000000001 2024-04-24T13:32:42.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896531+0000", 2024-04-24T13:32:42.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5682999999999997e-05 2024-04-24T13:32:42.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896549+0000", 2024-04-24T13:32:42.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7909000000000001e-05 2024-04-24T13:32:42.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896687+0000", 2024-04-24T13:32:42.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013818200000000001 2024-04-24T13:32:42.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896723+0000", 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5194999999999998e-05 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.905615+0000", 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088924759999999999 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.905741+0000", 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012562399999999999 2024-04-24T13:32:42.655 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.656 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.656 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.656 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2263 3.26 3:64e2178e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.656 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:42.656 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.594388332999999, 2024-04-24T13:32:42.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014626548, 2024-04-24T13:32:42.656 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.656 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.656 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.656 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.656 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2263 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967890+0000", 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9470000000000002e-06 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971675+0000", 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037854350000000002 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971700+0000", 2024-04-24T13:32:42.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4678e-05 2024-04-24T13:32:42.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971710+0000", 2024-04-24T13:32:42.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0059e-05 2024-04-24T13:32:42.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971802+0000", 2024-04-24T13:32:42.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2118000000000001e-05 2024-04-24T13:32:42.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971952+0000", 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015013599999999999 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.972085+0000", 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132946 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.981987+0000", 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099020819999999996 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982408+0000", 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042130500000000002 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982466+0000", 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7629e-05 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982514+0000", 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8213000000000001e-05 2024-04-24T13:32:42.661 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2267 3.3f 3:fe72662d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.547179235, 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018629916999999999, 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.662 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2267 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015099+0000", 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2199999999999999e-06 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018921+0000", 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038224579999999999 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018941+0000", 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9945999999999998e-05 2024-04-24T13:32:42.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018952+0000", 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0361e-05 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019017+0000", 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5068999999999997e-05 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019148+0000", 2024-04-24T13:32:42.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013165299999999999 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019247+0000", 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.87e-05 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.025115+0000", 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058674909999999999 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033545+0000", 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084303639999999992 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033659+0000", 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114131 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033727+0000", 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7523999999999999e-05 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.667 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.668 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2269 3.38 e85/74 3:1d70d2f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_64:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:42.668 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:42.668 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.52392579, 2024-04-24T13:32:42.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013439965, 2024-04-24T13:32:42.668 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.668 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.668 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.668 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:42.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:42.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038352+0000", 2024-04-24T13:32:42.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4500000000000001e-06 2024-04-24T13:32:42.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042479+0000", 2024-04-24T13:32:42.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041270819999999998 2024-04-24T13:32:42.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042517+0000", 2024-04-24T13:32:42.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8550000000000002e-05 2024-04-24T13:32:42.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042535+0000", 2024-04-24T13:32:42.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8093000000000001e-05 2024-04-24T13:32:42.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042678+0000", 2024-04-24T13:32:42.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014304399999999999 2024-04-24T13:32:42.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042722+0000", 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3179000000000001e-05 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051734+0000", 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0090125280000000006 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051790+0000", 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6039000000000003e-05 2024-04-24T13:32:42.672 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.673 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.673 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.673 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2270 3.a 3:52207169:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.673 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:42.673 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.515521329, 2024-04-24T13:32:42.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014332798000000001, 2024-04-24T13:32:42.673 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.673 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.674 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.674 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.674 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.674 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.674 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2270 2024-04-24T13:32:42.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.674 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:42.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:42.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046757+0000", 2024-04-24T13:32:42.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2450000000000001e-06 2024-04-24T13:32:42.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050608+0000", 2024-04-24T13:32:42.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038509949999999999 2024-04-24T13:32:42.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050632+0000", 2024-04-24T13:32:42.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4450000000000001e-05 2024-04-24T13:32:42.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050646+0000", 2024-04-24T13:32:42.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3273e-05 2024-04-24T13:32:42.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050743+0000", 2024-04-24T13:32:42.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7190999999999998e-05 2024-04-24T13:32:42.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050918+0000", 2024-04-24T13:32:42.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017516600000000001 2024-04-24T13:32:42.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:42.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051100+0000", 2024-04-24T13:32:42.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018168700000000001 2024-04-24T13:32:42.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.055983+0000", 2024-04-24T13:32:42.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048829379999999999 2024-04-24T13:32:42.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060902+0000", 2024-04-24T13:32:42.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049192430000000002 2024-04-24T13:32:42.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.061003+0000", 2024-04-24T13:32:42.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101351 2024-04-24T13:32:42.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.061087+0000", 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4258999999999994e-05 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2279 3.2a 3:57162c53:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.421877651999999, 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016593472000000001, 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:42.680 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2279 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:42.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:42.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:42.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140401+0000", 2024-04-24T13:32:42.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5950000000000001e-06 2024-04-24T13:32:42.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:42.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144257+0000", 2024-04-24T13:32:42.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038560869999999998 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144277+0000", 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9976e-05 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144288+0000", 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.059e-05 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:42.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144359+0000", 2024-04-24T13:32:42.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1550000000000004e-05 2024-04-24T13:32:42.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:42.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144501+0000", 2024-04-24T13:32:42.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014193499999999999 2024-04-24T13:32:42.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:42.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144633+0000", 2024-04-24T13:32:42.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131748 2024-04-24T13:32:42.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:42.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.148819+0000", 2024-04-24T13:32:42.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041860140000000001 2024-04-24T13:32:42.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:42.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156831+0000", 2024-04-24T13:32:42.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080120120000000006 2024-04-24T13:32:42.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:42.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156920+0000", 2024-04-24T13:32:42.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9112999999999999e-05 2024-04-24T13:32:42.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:42.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:42.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:42.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156992+0000", 2024-04-24T13:32:42.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1852000000000003e-05 2024-04-24T13:32:42.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.686 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.686 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:42.686 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:42.686 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:42.688 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:42.688 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:42.685+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:42.789 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:42.783+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:42.816 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:32:42.863 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:42.863 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:42.864 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:42.864 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:42.878 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:32:42.926 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:42.925+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:42.971 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:42.971 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:42.987 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:42.988 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:42.990 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:42.987+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:42.998 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:42.998 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:42.998 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:42.998 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:42.998 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:43.004 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:43.004 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:43.012 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:32:43.020 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:43.020 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:43.037 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:43.038 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:43.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:43.055 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:43.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:43.072 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:43.091 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:43.091 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:43.091 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:43.087+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:43.179 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:43.179 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:43.193 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:43.189+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:43.193 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:32:43.293 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:43.287+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:43.320 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:43.321 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:43.334 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:32:43.422 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:43.419+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:43.495 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:43.491+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:43.495 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:32:43.504 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:43.504 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:43.519 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:32:43.614 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:43.611+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:43.686 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:43.686 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:43.697 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:43.693+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:43.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:32:43.798 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:43.797+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:43.862 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:43.863 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:43.876 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:32:43.922 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:43.919+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:43.995 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:43.995 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:44.000 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:43.997+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:44.008 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:32:44.100 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:44.097+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:44.171 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:44.171 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:44.184 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:32:44.201 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:44.197+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:44.302 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:44.302 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:44.302 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:44.301+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:44.314 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:32:44.403 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:44.401+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:44.435 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:44.435 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:44.450 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:32:44.494 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:32:44.504 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:44.499+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:44.569 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:44.569 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:44.583 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:44.630 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:44.627+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:44.702 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:44.702 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:44.705 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:44.699+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:44.716 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:44.806 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:44.805+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:44.884 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:44.884 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:44.898 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:44.907 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:44.905+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:45.008 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:45.005+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:45.021 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:45.022 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:45.037 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:45.108 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:32:45.109 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:45.103+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:45.169 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:45.169 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:45.183 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:45.226 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:45.225+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:45.257 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:45.258 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:45.274 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:45.274 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:45.291 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:45.291 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:45.307 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:45.307 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:45.307 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:45.307 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:45.311 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:45.309+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:45.321 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:45.327 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:45.328 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:45.345 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:45.345 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:45.363 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:45.363 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:45.384 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:45.384 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:45.412 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:45.409+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:45.493 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:45.494 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:45.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:45.494 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:45.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.494 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:43 6.2 6:4347d321:::bucket.sync-source-hints.:head [call,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e27)", 2024-04-24T13:32:45.494 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:45.494 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 138.26422572000001, 2024-04-24T13:32:45.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020457065, 2024-04-24T13:32:45.494 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.494 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.494 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-24T13:32:45.495 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:45.495 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:45.495 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:45.495 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 43 2024-04-24T13:32:45.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.495 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:45.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225900+0000", 2024-04-24T13:32:45.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225903+0000", 2024-04-24T13:32:45.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7100000000000001e-06 2024-04-24T13:32:45.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225922+0000", 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8919999999999998e-05 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225960+0000", 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7240000000000003e-05 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.225987+0000", 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6919000000000001e-05 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226300+0000", 2024-04-24T13:32:45.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000313701 2024-04-24T13:32:45.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:45.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.226317+0000", 2024-04-24T13:32:45.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6463000000000001e-05 2024-04-24T13:32:45.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231091+0000", 2024-04-24T13:32:45.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047739169999999999 2024-04-24T13:32:45.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:32:45.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.231111+0000", 2024-04-24T13:32:45.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0605999999999999e-05 2024-04-24T13:32:45.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246073+0000", 2024-04-24T13:32:45.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014961264 2024-04-24T13:32:45.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:27.246357+0000", 2024-04-24T13:32:45.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028432499999999999 2024-04-24T13:32:45.500 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.500 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.500 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.500 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1615 3.1a 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:45.500 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:45.500 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.284413046000001, 2024-04-24T13:32:45.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020755388999999999, 2024-04-24T13:32:45.501 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.501 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.501 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.501 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:45.501 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:45.501 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:45.501 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1615 2024-04-24T13:32:45.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.501 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:45.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205712+0000", 2024-04-24T13:32:45.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.205715+0000", 2024-04-24T13:32:45.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4399999999999999e-06 2024-04-24T13:32:45.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211414+0000", 2024-04-24T13:32:45.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.005699356 2024-04-24T13:32:45.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211448+0000", 2024-04-24T13:32:45.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4221999999999999e-05 2024-04-24T13:32:45.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211466+0000", 2024-04-24T13:32:45.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7629999999999999e-05 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211585+0000", 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011937 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.211840+0000", 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000254861 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:45.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.212059+0000", 2024-04-24T13:32:45.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218789 2024-04-24T13:32:45.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:45.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.225826+0000", 2024-04-24T13:32:45.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013767061000000001 2024-04-24T13:32:45.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:45.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226295+0000", 2024-04-24T13:32:45.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00046917399999999999 2024-04-24T13:32:45.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226388+0000", 2024-04-24T13:32:45.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2190999999999999e-05 2024-04-24T13:32:45.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.226468+0000", 2024-04-24T13:32:45.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0295000000000003e-05 2024-04-24T13:32:45.506 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.506 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.506 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2208 3.29 e85/20 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.161478292999998, 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026370000000000001, 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328650+0000", 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.413e-06 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335219+0000", 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006569788 2024-04-24T13:32:45.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335258+0000", 2024-04-24T13:32:45.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9062e-05 2024-04-24T13:32:45.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335277+0000", 2024-04-24T13:32:45.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.836e-05 2024-04-24T13:32:45.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335422+0000", 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014537 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335481+0000", 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9259000000000003e-05 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354858+0000", 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019376757000000001 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.355017+0000", 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015899100000000001 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2213 3.2f 3:f4e7225c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.417904+0000", 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.072221648999999, 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019522586000000001, 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.511 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2213 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.417904+0000", 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.417904+0000", 2024-04-24T13:32:45.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.417907+0000", 2024-04-24T13:32:45.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8899999999999999e-06 2024-04-24T13:32:45.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424088+0000", 2024-04-24T13:32:45.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061813299999999996 2024-04-24T13:32:45.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424111+0000", 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3113e-05 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424122+0000", 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1266e-05 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424210+0000", 2024-04-24T13:32:45.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7690999999999998e-05 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424356+0000", 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014553499999999999 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.424474+0000", 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011881500000000001 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.436943+0000", 2024-04-24T13:32:45.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012468137000000001 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.437296+0000", 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035371099999999999 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.437365+0000", 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8573999999999998e-05 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.437426+0000", 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1524000000000003e-05 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2214 3.1a 3:5b3ced30:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.438843+0000", 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.051282084, 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014929534, 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.517 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:45.518 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:45.518 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:45.518 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2214 2024-04-24T13:32:45.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.518 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.438843+0000", 2024-04-24T13:32:45.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.438843+0000", 2024-04-24T13:32:45.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.438845+0000", 2024-04-24T13:32:45.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.367e-06 2024-04-24T13:32:45.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442803+0000", 2024-04-24T13:32:45.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039578840000000001 2024-04-24T13:32:45.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442829+0000", 2024-04-24T13:32:45.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6628e-05 2024-04-24T13:32:45.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442842+0000", 2024-04-24T13:32:45.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3101e-05 2024-04-24T13:32:45.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.442980+0000", 2024-04-24T13:32:45.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013741599999999999 2024-04-24T13:32:45.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.443250+0000", 2024-04-24T13:32:45.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027034200000000002 2024-04-24T13:32:45.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:45.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.443506+0000", 2024-04-24T13:32:45.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025607800000000002 2024-04-24T13:32:45.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:45.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.450974+0000", 2024-04-24T13:32:45.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074679639999999997 2024-04-24T13:32:45.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:45.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.453594+0000", 2024-04-24T13:32:45.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026193840000000002 2024-04-24T13:32:45.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.453699+0000", 2024-04-24T13:32:45.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010524200000000001 2024-04-24T13:32:45.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.453773+0000", 2024-04-24T13:32:45.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4128000000000006e-05 2024-04-24T13:32:45.524 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.524 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.524 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.524 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2221 3.26 e85/41 3:67d4e534:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_16:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:45.524 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.519722+0000", 2024-04-24T13:32:45.524 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.970403158, 2024-04-24T13:32:45.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012541907999999999, 2024-04-24T13:32:45.524 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.524 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.525 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.525 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519722+0000", 2024-04-24T13:32:45.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519722+0000", 2024-04-24T13:32:45.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519724+0000", 2024-04-24T13:32:45.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7829999999999999e-06 2024-04-24T13:32:45.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522168+0000", 2024-04-24T13:32:45.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024435080000000001 2024-04-24T13:32:45.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522190+0000", 2024-04-24T13:32:45.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2824e-05 2024-04-24T13:32:45.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522203+0000", 2024-04-24T13:32:45.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2394e-05 2024-04-24T13:32:45.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522287+0000", 2024-04-24T13:32:45.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.462e-05 2024-04-24T13:32:45.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.522310+0000", 2024-04-24T13:32:45.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2833999999999999e-05 2024-04-24T13:32:45.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532185+0000", 2024-04-24T13:32:45.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098749189999999994 2024-04-24T13:32:45.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532264+0000", 2024-04-24T13:32:45.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9025999999999999e-05 2024-04-24T13:32:45.529 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.529 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.529 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2222 3.13 3:c9a14088:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_17:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.524858+0000", 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.965267152999999, 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01679514, 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2222 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.524858+0000", 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.524858+0000", 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.524865+0000", 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6069999999999996e-06 2024-04-24T13:32:45.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528806+0000", 2024-04-24T13:32:45.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003940743 2024-04-24T13:32:45.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528824+0000", 2024-04-24T13:32:45.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8423999999999998e-05 2024-04-24T13:32:45.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528834+0000", 2024-04-24T13:32:45.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8190000000000003e-06 2024-04-24T13:32:45.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.528904+0000", 2024-04-24T13:32:45.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0432000000000006e-05 2024-04-24T13:32:45.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.529034+0000", 2024-04-24T13:32:45.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013008299999999999 2024-04-24T13:32:45.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:45.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.529153+0000", 2024-04-24T13:32:45.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118348 2024-04-24T13:32:45.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:45.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538128+0000", 2024-04-24T13:32:45.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089753909999999992 2024-04-24T13:32:45.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:45.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.541554+0000", 2024-04-24T13:32:45.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034260860000000001 2024-04-24T13:32:45.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.541608+0000", 2024-04-24T13:32:45.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4146e-05 2024-04-24T13:32:45.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.541653+0000", 2024-04-24T13:32:45.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5061000000000001e-05 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2223 3.3 3:c1ee41bc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_18:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.534315+0000", 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.955810876000001, 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015569995999999999, 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:45.536 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2223 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.534315+0000", 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.534315+0000", 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.534317+0000", 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0190000000000001e-06 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538250+0000", 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003933069 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538268+0000", 2024-04-24T13:32:45.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8043e-05 2024-04-24T13:32:45.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538283+0000", 2024-04-24T13:32:45.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5590000000000002e-05 2024-04-24T13:32:45.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538348+0000", 2024-04-24T13:32:45.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4311000000000001e-05 2024-04-24T13:32:45.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538470+0000", 2024-04-24T13:32:45.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121909 2024-04-24T13:32:45.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:45.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.538575+0000", 2024-04-24T13:32:45.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000105027 2024-04-24T13:32:45.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:45.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.543353+0000", 2024-04-24T13:32:45.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047783419999999997 2024-04-24T13:32:45.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549659+0000", 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063060429999999999 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549768+0000", 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108587 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549885+0000", 2024-04-24T13:32:45.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117056 2024-04-24T13:32:45.542 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.542 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.542 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.542 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2224 3.2c e85/20 3:3671ead8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_19:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:45.542 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.549217+0000", 2024-04-24T13:32:45.542 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.940908188999998, 2024-04-24T13:32:45.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011251326000000001, 2024-04-24T13:32:45.542 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.542 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.542 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549217+0000", 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549217+0000", 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549219+0000", 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3570000000000001e-06 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551026+0000", 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001807428 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551045+0000", 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9366999999999999e-05 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551055+0000", 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3079999999999997e-06 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551167+0000", 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112052 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.551197+0000", 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0253999999999999e-05 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560393+0000", 2024-04-24T13:32:45.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0091956 2024-04-24T13:32:45.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560469+0000", 2024-04-24T13:32:45.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5959999999999998e-05 2024-04-24T13:32:45.546 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.546 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.546 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2234 3.34 3:2f41ca12:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_29:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.652422+0000", 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.837703552000001, 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018886607, 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2234 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.652422+0000", 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.652422+0000", 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.652424+0000", 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1909999999999999e-06 2024-04-24T13:32:45.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656447+0000", 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040232530000000001 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656472+0000", 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4338e-05 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656488+0000", 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6203999999999999e-05 2024-04-24T13:32:45.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656586+0000", 2024-04-24T13:32:45.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7884e-05 2024-04-24T13:32:45.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656724+0000", 2024-04-24T13:32:45.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013806199999999999 2024-04-24T13:32:45.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.656838+0000", 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113998 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.669565+0000", 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012727591999999999 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671188+0000", 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001622533 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671251+0000", 2024-04-24T13:32:45.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3476e-05 2024-04-24T13:32:45.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671309+0000", 2024-04-24T13:32:45.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7076e-05 2024-04-24T13:32:45.552 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.552 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.552 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.553 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2239 3.11 3:8b38e7d5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_34:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:45.553 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.709949+0000", 2024-04-24T13:32:45.553 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.780176350000001, 2024-04-24T13:32:45.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016665736, 2024-04-24T13:32:45.553 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.553 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.553 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.553 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:45.553 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:45.554 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:45.554 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2239 2024-04-24T13:32:45.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.554 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.709949+0000", 2024-04-24T13:32:45.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.709949+0000", 2024-04-24T13:32:45.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.709952+0000", 2024-04-24T13:32:45.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1540000000000002e-06 2024-04-24T13:32:45.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.713909+0000", 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039569870000000004 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.713935+0000", 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5568999999999999e-05 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.713951+0000", 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529e-05 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.714027+0000", 2024-04-24T13:32:45.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.538e-05 2024-04-24T13:32:45.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.714170+0000", 2024-04-24T13:32:45.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014336199999999999 2024-04-24T13:32:45.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:45.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.714282+0000", 2024-04-24T13:32:45.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111912 2024-04-24T13:32:45.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:45.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719419+0000", 2024-04-24T13:32:45.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051373199999999999 2024-04-24T13:32:45.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:45.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.726440+0000", 2024-04-24T13:32:45.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070210230000000004 2024-04-24T13:32:45.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.726535+0000", 2024-04-24T13:32:45.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4137999999999999e-05 2024-04-24T13:32:45.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.726615+0000", 2024-04-24T13:32:45.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0362000000000001e-05 2024-04-24T13:32:45.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.560 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.560 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2244 3.3b e85/41 3:ddfbb493:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_39:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:45.560 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.766818+0000", 2024-04-24T13:32:45.560 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.723307846000001, 2024-04-24T13:32:45.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015179241, 2024-04-24T13:32:45.560 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.560 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.561 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.561 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.766818+0000", 2024-04-24T13:32:45.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.766818+0000", 2024-04-24T13:32:45.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.766819+0000", 2024-04-24T13:32:45.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.564e-06 2024-04-24T13:32:45.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771018+0000", 2024-04-24T13:32:45.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041990200000000004 2024-04-24T13:32:45.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771049+0000", 2024-04-24T13:32:45.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0273999999999998e-05 2024-04-24T13:32:45.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771075+0000", 2024-04-24T13:32:45.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6103999999999999e-05 2024-04-24T13:32:45.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771212+0000", 2024-04-24T13:32:45.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136933 2024-04-24T13:32:45.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.771286+0000", 2024-04-24T13:32:45.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4447000000000001e-05 2024-04-24T13:32:45.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.781853+0000", 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010567048000000001 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.781997+0000", 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014385099999999999 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.565 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2245 3.1d e85/20 3:bb337c31:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_40:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:45.566 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:45.566 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.710043967000001, 2024-04-24T13:32:45.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01557213, 2024-04-24T13:32:45.566 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.566 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.566 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.566 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:45.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.780082+0000", 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1899999999999998e-07 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784478+0000", 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00439624 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784506+0000", 2024-04-24T13:32:45.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7365999999999999e-05 2024-04-24T13:32:45.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784522+0000", 2024-04-24T13:32:45.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6268000000000001e-05 2024-04-24T13:32:45.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784616+0000", 2024-04-24T13:32:45.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4423e-05 2024-04-24T13:32:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784640+0000", 2024-04-24T13:32:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3906000000000001e-05 2024-04-24T13:32:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795548+0000", 2024-04-24T13:32:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01090738 2024-04-24T13:32:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795654+0000", 2024-04-24T13:32:45.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106128 2024-04-24T13:32:45.570 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.570 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.570 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.570 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2246 3.9 3:92c5067a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:45.570 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.784844+0000", 2024-04-24T13:32:45.570 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.705281529000001, 2024-04-24T13:32:45.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016501108, 2024-04-24T13:32:45.571 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.571 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.571 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:45.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:45.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:45.571 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2246 2024-04-24T13:32:45.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.571 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784844+0000", 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784844+0000", 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.784848+0000", 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.563e-06 2024-04-24T13:32:45.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.788914+0000", 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040666360000000002 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.788940+0000", 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5573999999999999e-05 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.788952+0000", 2024-04-24T13:32:45.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2431e-05 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.789037+0000", 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4593999999999997e-05 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.789171+0000", 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134015 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:45.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.789288+0000", 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117512 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.796833+0000", 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075444029999999999 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.801059+0000", 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042262280000000003 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.801227+0000", 2024-04-24T13:32:45.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000168517 2024-04-24T13:32:45.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.801345+0000", 2024-04-24T13:32:45.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011763499999999999 2024-04-24T13:32:45.576 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.576 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.576 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.576 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2248 3.1d e85/20 3:b991c377:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_43:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.809856+0000", 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.680269403, 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011470594000000001, 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809856+0000", 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809856+0000", 2024-04-24T13:32:45.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809858+0000", 2024-04-24T13:32:45.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8309999999999999e-06 2024-04-24T13:32:45.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812257+0000", 2024-04-24T13:32:45.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002399329 2024-04-24T13:32:45.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812283+0000", 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5636e-05 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812297+0000", 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4534e-05 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812393+0000", 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6039000000000007e-05 2024-04-24T13:32:45.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.812429+0000", 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5111000000000003e-05 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821231+0000", 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088020389999999993 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821327+0000", 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6075000000000004e-05 2024-04-24T13:32:45.580 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.581 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.581 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.581 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2253 3.27 e85/20 3:e6835017:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_48:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:45.581 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.859419+0000", 2024-04-24T13:32:45.581 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.630706147000001, 2024-04-24T13:32:45.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012299842, 2024-04-24T13:32:45.581 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.581 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.581 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.581 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.859419+0000", 2024-04-24T13:32:45.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.859419+0000", 2024-04-24T13:32:45.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.859421+0000", 2024-04-24T13:32:45.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0329999999999998e-06 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863395+0000", 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039737339999999996 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863425+0000", 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9793000000000001e-05 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863439+0000", 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.446e-05 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863598+0000", 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015820600000000001 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.863638+0000", 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0225999999999997e-05 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.871631+0000", 2024-04-24T13:32:45.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079935089999999993 2024-04-24T13:32:45.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.871719+0000", 2024-04-24T13:32:45.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7880999999999994e-05 2024-04-24T13:32:45.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.585 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.585 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2255 3.29 e85/20 3:979257ba:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_50:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.881386+0000", 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.608739829000001, 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011529885, 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881386+0000", 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881386+0000", 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881413+0000", 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7619000000000001e-05 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885724+0000", 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043102339999999996 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885760+0000", 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6501999999999997e-05 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885777+0000", 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7183000000000001e-05 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885917+0000", 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139491 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.885959+0000", 2024-04-24T13:32:45.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2023000000000001e-05 2024-04-24T13:32:45.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892786+0000", 2024-04-24T13:32:45.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068271720000000003 2024-04-24T13:32:45.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892916+0000", 2024-04-24T13:32:45.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012966099999999999 2024-04-24T13:32:45.589 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.590 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.590 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.590 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2271 3.13 3:cb7d029e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:45.590 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.056244+0000", 2024-04-24T13:32:45.590 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.433881021000001, 2024-04-24T13:32:45.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019201421, 2024-04-24T13:32:45.590 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.590 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.591 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.591 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:45.591 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:45.591 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:45.591 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2271 2024-04-24T13:32:45.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.591 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.056244+0000", 2024-04-24T13:32:45.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.056244+0000", 2024-04-24T13:32:45.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.056259+0000", 2024-04-24T13:32:45.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4099e-05 2024-04-24T13:32:45.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060075+0000", 2024-04-24T13:32:45.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038163260000000001 2024-04-24T13:32:45.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060103+0000", 2024-04-24T13:32:45.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7949e-05 2024-04-24T13:32:45.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060115+0000", 2024-04-24T13:32:45.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2298e-05 2024-04-24T13:32:45.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060216+0000", 2024-04-24T13:32:45.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100883 2024-04-24T13:32:45.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060366+0000", 2024-04-24T13:32:45.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015035999999999999 2024-04-24T13:32:45.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:45.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060509+0000", 2024-04-24T13:32:45.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142516 2024-04-24T13:32:45.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:45.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.067630+0000", 2024-04-24T13:32:45.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00712066 2024-04-24T13:32:45.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.075349+0000", 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077195789999999999 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.075402+0000", 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2905000000000003e-05 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.075446+0000", 2024-04-24T13:32:45.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3846e-05 2024-04-24T13:32:45.597 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.597 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.597 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.597 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2273 3.1c 3:386b02cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:45.597 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.077819+0000", 2024-04-24T13:32:45.597 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.412306766, 2024-04-24T13:32:45.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016399364, 2024-04-24T13:32:45.597 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.598 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.598 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.598 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:45.598 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:45.598 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:45.598 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2273 2024-04-24T13:32:45.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.598 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.077819+0000", 2024-04-24T13:32:45.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.077819+0000", 2024-04-24T13:32:45.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.077820+0000", 2024-04-24T13:32:45.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5740000000000001e-06 2024-04-24T13:32:45.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081705+0000", 2024-04-24T13:32:45.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038844040000000002 2024-04-24T13:32:45.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081723+0000", 2024-04-24T13:32:45.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7892000000000001e-05 2024-04-24T13:32:45.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081732+0000", 2024-04-24T13:32:45.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0569999999999999e-06 2024-04-24T13:32:45.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081812+0000", 2024-04-24T13:32:45.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0476000000000007e-05 2024-04-24T13:32:45.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.081961+0000", 2024-04-24T13:32:45.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014850599999999999 2024-04-24T13:32:45.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:45.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.082094+0000", 2024-04-24T13:32:45.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013324300000000001 2024-04-24T13:32:45.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:45.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088394+0000", 2024-04-24T13:32:45.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062996700000000003 2024-04-24T13:32:45.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:45.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.094036+0000", 2024-04-24T13:32:45.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056424860000000004 2024-04-24T13:32:45.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.094144+0000", 2024-04-24T13:32:45.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107983 2024-04-24T13:32:45.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.094218+0000", 2024-04-24T13:32:45.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4072999999999994e-05 2024-04-24T13:32:45.607 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.607 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.607 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.607 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2274 3.2f 3:f7fb6ab2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:45.608 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.088365+0000", 2024-04-24T13:32:45.608 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.401760021000001, 2024-04-24T13:32:45.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012884712, 2024-04-24T13:32:45.608 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:45.608 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:45.608 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:45.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:45.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:45.608 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:45.608 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2274 2024-04-24T13:32:45.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.608 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088365+0000", 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088365+0000", 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.088368+0000", 2024-04-24T13:32:45.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.261e-06 2024-04-24T13:32:45.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:45.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092225+0000", 2024-04-24T13:32:45.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003857316 2024-04-24T13:32:45.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:45.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092243+0000", 2024-04-24T13:32:45.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7606999999999999e-05 2024-04-24T13:32:45.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:45.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092253+0000", 2024-04-24T13:32:45.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0095000000000001e-05 2024-04-24T13:32:45.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:45.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092315+0000", 2024-04-24T13:32:45.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2426000000000002e-05 2024-04-24T13:32:45.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:45.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092429+0000", 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113515 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.092527+0000", 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8812000000000002e-05 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.096526+0000", 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039980129999999999 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:45.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.101159+0000", 2024-04-24T13:32:45.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046330169999999997 2024-04-24T13:32:45.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:45.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.101209+0000", 2024-04-24T13:32:45.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0869999999999999e-05 2024-04-24T13:32:45.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:45.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:45.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:45.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.101250+0000", 2024-04-24T13:32:45.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0779999999999999e-05 2024-04-24T13:32:45.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.614 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.614 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.614 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:45.614 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:45.614 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:45.615 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:45.616 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:45.615+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:45.717 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:45.715+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:45.788 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:45.788 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:45.788 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:45.788 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:45.802 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:45.817 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:45.815+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:45.918 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:45.917+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:45.920 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:45.920 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:45.920 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:45.934 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:46.026 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:46.025+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:46.108 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:46.108 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:46.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:46.108 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:46.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.108 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:46.108 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:46.108 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 136.82483571099999, 2024-04-24T13:32:46.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048388950000000002, 2024-04-24T13:32:46.108 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.108 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:46.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:32:46.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3799999999999998e-06 2024-04-24T13:32:46.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279193+0000", 2024-04-24T13:32:46.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7674e-05 2024-04-24T13:32:46.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279224+0000", 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0654000000000002e-05 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279244+0000", 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279426+0000", 2024-04-24T13:32:46.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018255300000000001 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279717+0000", 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029043800000000001 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279993+0000", 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276786 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282898+0000", 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002904093 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283731+0000", 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00083382599999999997 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283886+0000", 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015512600000000001 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284001+0000", 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114405 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410010339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 136.81971111600001, 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044116340000000002, 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.114 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:46.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284289+0000", 2024-04-24T13:32:46.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.125e-06 2024-04-24T13:32:46.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284299+0000", 2024-04-24T13:32:46.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0485999999999999e-05 2024-04-24T13:32:46.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284330+0000", 2024-04-24T13:32:46.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0528000000000003e-05 2024-04-24T13:32:46.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284345+0000", 2024-04-24T13:32:46.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4883e-05 2024-04-24T13:32:46.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284484+0000", 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139708 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284655+0000", 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170953 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284981+0000", 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000325648 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.287326+0000", 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023452709999999999 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288427+0000", 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001100544 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288551+0000", 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012466500000000001 2024-04-24T13:32:46.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288698+0000", 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146823 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 133.840498231, 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047820809999999997, 2024-04-24T13:32:46.120 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:46.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263503+0000", 2024-04-24T13:32:46.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.039e-06 2024-04-24T13:32:46.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263520+0000", 2024-04-24T13:32:46.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7198e-05 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263548+0000", 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8158e-05 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263565+0000", 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7008e-05 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263754+0000", 2024-04-24T13:32:46.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001894 2024-04-24T13:32:46.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263973+0000", 2024-04-24T13:32:46.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218593 2024-04-24T13:32:46.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:46.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.264373+0000", 2024-04-24T13:32:46.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040043400000000002 2024-04-24T13:32:46.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.266377+0000", 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020033030000000001 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268121+0000", 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017441049999999999 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268212+0000", 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1490000000000007e-05 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268282+0000", 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9352999999999998e-05 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 133.76078607900001, 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034252639999999999, 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.126 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 220 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:46.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343214+0000", 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343227+0000", 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2941e-05 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343259+0000", 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1557000000000003e-05 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343274+0000", 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5401999999999999e-05 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343455+0000", 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018068700000000001 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343694+0000", 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238552 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.344088+0000", 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039456400000000003 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.345723+0000", 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016349139999999999 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346480+0000", 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075738300000000004 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346569+0000", 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8281000000000004e-05 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346637+0000", 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8165999999999998e-05 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.131 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 133.743045782, 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032957419999999999, 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-24T13:32:46.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360954+0000", 2024-04-24T13:32:46.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.154e-06 2024-04-24T13:32:46.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360965+0000", 2024-04-24T13:32:46.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1321999999999999e-05 2024-04-24T13:32:46.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360996+0000", 2024-04-24T13:32:46.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0902999999999999e-05 2024-04-24T13:32:46.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361012+0000", 2024-04-24T13:32:46.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:32:46.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361185+0000", 2024-04-24T13:32:46.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172072 2024-04-24T13:32:46.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361404+0000", 2024-04-24T13:32:46.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021965999999999999 2024-04-24T13:32:46.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361852+0000", 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000448276 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.363340+0000", 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001487169 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364094+0000", 2024-04-24T13:32:46.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075443699999999995 2024-04-24T13:32:46.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364184+0000", 2024-04-24T13:32:46.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9957000000000006e-05 2024-04-24T13:32:46.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364248+0000", 2024-04-24T13:32:46.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3627000000000006e-05 2024-04-24T13:32:46.137 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.137 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.137 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 133.73948093499999, 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036426480000000001, 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-24T13:32:46.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.139 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:46.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:46.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364519+0000", 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364529+0000", 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088999999999999e-05 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364554+0000", 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5537e-05 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364568+0000", 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3372e-05 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364726+0000", 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015809299999999999 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365059+0000", 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000333185 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:46.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365758+0000", 2024-04-24T13:32:46.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069934299999999995 2024-04-24T13:32:46.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.367413+0000", 2024-04-24T13:32:46.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016552349999999999 2024-04-24T13:32:46.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368012+0000", 2024-04-24T13:32:46.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059858700000000003 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368097+0000", 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5253999999999994e-05 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368159+0000", 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2113000000000007e-05 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.144 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:46.144 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:46.144 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 133.71009429899999, 2024-04-24T13:32:46.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033998840000000002, 2024-04-24T13:32:46.144 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.144 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.144 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.144 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.144 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.144 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.144 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-24T13:32:46.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393906+0000", 2024-04-24T13:32:46.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1569999999999998e-06 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393917+0000", 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1348999999999999e-05 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393942+0000", 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.527e-05 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393957+0000", 2024-04-24T13:32:46.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4355999999999999e-05 2024-04-24T13:32:46.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394127+0000", 2024-04-24T13:32:46.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170555 2024-04-24T13:32:46.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394352+0000", 2024-04-24T13:32:46.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224539 2024-04-24T13:32:46.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394788+0000", 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043600099999999999 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.396137+0000", 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001349404 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397158+0000", 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001020738 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397237+0000", 2024-04-24T13:32:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9319000000000004e-05 2024-04-24T13:32:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397303+0000", 2024-04-24T13:32:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6196000000000001e-05 2024-04-24T13:32:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:437 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 133.64047070500001, 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048056540000000003, 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 437 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463529+0000", 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2479999999999999e-06 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463544+0000", 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463572+0000", 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8294e-05 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463590+0000", 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-24T13:32:46.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464092+0000", 2024-04-24T13:32:46.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000502189 2024-04-24T13:32:46.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464454+0000", 2024-04-24T13:32:46.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036231300000000001 2024-04-24T13:32:46.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:46.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464831+0000", 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000377375 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467473+0000", 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026414659999999999 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468185+0000", 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071215199999999997 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468271+0000", 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5593999999999994e-05 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468333+0000", 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1957000000000003e-05 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:46.155 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 133.23482095599999, 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033442569999999998, 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 793 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:46.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:46.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869179+0000", 2024-04-24T13:32:46.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.323e-06 2024-04-24T13:32:46.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869190+0000", 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869222+0000", 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1733999999999998e-05 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869237+0000", 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5044e-05 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869396+0000", 2024-04-24T13:32:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158913 2024-04-24T13:32:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869763+0000", 2024-04-24T13:32:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367112 2024-04-24T13:32:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.870319+0000", 2024-04-24T13:32:46.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055558799999999998 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.871509+0000", 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001190607 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872365+0000", 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085535299999999999 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872449+0000", 2024-04-24T13:32:46.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3834999999999999e-05 2024-04-24T13:32:46.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872521+0000", 2024-04-24T13:32:46.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2428999999999994e-05 2024-04-24T13:32:46.161 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.161 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.161 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.161 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:46.161 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:46.162 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 133.04881458400001, 2024-04-24T13:32:46.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003340754, 2024-04-24T13:32:46.162 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.162 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.162 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.162 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.162 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.162 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.162 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 874 2024-04-24T13:32:46.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.162 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055185+0000", 2024-04-24T13:32:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:32:46.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055197+0000", 2024-04-24T13:32:46.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1606e-05 2024-04-24T13:32:46.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055229+0000", 2024-04-24T13:32:46.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1603000000000002e-05 2024-04-24T13:32:46.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055244+0000", 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4928e-05 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055397+0000", 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015366499999999999 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055763+0000", 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036565600000000001 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:46.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.056317+0000", 2024-04-24T13:32:46.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055436600000000004 2024-04-24T13:32:46.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.057678+0000", 2024-04-24T13:32:46.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001361283 2024-04-24T13:32:46.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058258+0000", 2024-04-24T13:32:46.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057942400000000004 2024-04-24T13:32:46.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058407+0000", 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000149188 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058524+0000", 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116805 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1566 4.38 4:1cdfa9df:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.3.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.547823310999998, 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040238560000000001, 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1566 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556176+0000", 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.057e-06 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556187+0000", 2024-04-24T13:32:46.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0693000000000001e-05 2024-04-24T13:32:46.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556219+0000", 2024-04-24T13:32:46.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1718999999999999e-05 2024-04-24T13:32:46.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556242+0000", 2024-04-24T13:32:46.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2687000000000001e-05 2024-04-24T13:32:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556384+0000", 2024-04-24T13:32:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014257899999999999 2024-04-24T13:32:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556624+0000", 2024-04-24T13:32:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024014199999999999 2024-04-24T13:32:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556921+0000", 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029673900000000002 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.559462+0000", 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025407530000000002 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560009+0000", 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054690399999999997 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560096+0000", 2024-04-24T13:32:46.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7597999999999997e-05 2024-04-24T13:32:46.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560198+0000", 2024-04-24T13:32:46.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010198499999999999 2024-04-24T13:32:46.173 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.173 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.173 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.173 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1721 4.38 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.353456851000001, 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088323519999999999, 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1721 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750544+0000", 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9569999999999998e-06 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750561+0000", 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7589e-05 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750600+0000", 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8145999999999997e-05 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750621+0000", 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1109999999999999e-05 2024-04-24T13:32:46.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750797+0000", 2024-04-24T13:32:46.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017672599999999999 2024-04-24T13:32:46.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751113+0000", 2024-04-24T13:32:46.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031514599999999998 2024-04-24T13:32:46.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751586+0000", 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047325699999999999 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753982+0000", 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023960880000000002 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759108+0000", 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051256590000000003 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759247+0000", 2024-04-24T13:32:46.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013992400000000001 2024-04-24T13:32:46.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759373+0000", 2024-04-24T13:32:46.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012574999999999999 2024-04-24T13:32:46.179 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.179 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.179 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1724 4.38 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.353330697000001, 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093322379999999996, 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1724 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750669+0000", 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7269999999999999e-06 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750678+0000", 2024-04-24T13:32:46.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9700000000000005e-06 2024-04-24T13:32:46.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750744+0000", 2024-04-24T13:32:46.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5920999999999994e-05 2024-04-24T13:32:46.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750766+0000", 2024-04-24T13:32:46.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.226e-05 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752483+0000", 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001717393 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752795+0000", 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031186000000000001 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753283+0000", 2024-04-24T13:32:46.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048743300000000001 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.756401+0000", 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031181220000000001 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759844+0000", 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003443715 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759934+0000", 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9728000000000006e-05 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759999+0000", 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5109000000000003e-05 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1814 4.38 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:46.185 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.16254352, 2024-04-24T13:32:46.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065250220000000001, 2024-04-24T13:32:46.186 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.186 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.186 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.186 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1814 2024-04-24T13:32:46.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.186 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:46.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:46.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941457+0000", 2024-04-24T13:32:46.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941467+0000", 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0596e-05 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941503+0000", 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5398999999999998e-05 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941524+0000", 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1586e-05 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941687+0000", 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016257000000000001 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941919+0000", 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232315 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942204+0000", 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028527000000000001 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.945033+0000", 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028291029999999999 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947677+0000", 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026439649999999999 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947848+0000", 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017036699999999999 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947979+0000", 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131524 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.191 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1817 4.38 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.162434572999999, 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079573279999999996, 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1817 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941565+0000", 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.657e-06 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941573+0000", 2024-04-24T13:32:46.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4169999999999992e-06 2024-04-24T13:32:46.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941596+0000", 2024-04-24T13:32:46.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2535999999999999e-05 2024-04-24T13:32:46.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941610+0000", 2024-04-24T13:32:46.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3746e-05 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944182+0000", 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025729540000000001 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944388+0000", 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000205183 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:46.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944557+0000", 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016964200000000001 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.946998+0000", 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024406670000000001 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949247+0000", 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022489490000000001 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949406+0000", 2024-04-24T13:32:46.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000159436 2024-04-24T13:32:46.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949520+0000", 2024-04-24T13:32:46.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114141 2024-04-24T13:32:46.197 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.197 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.197 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.197 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2212 3.3a 3:5de7fd4f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.198 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:46.198 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.705769412999999, 2024-04-24T13:32:46.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024848709, 2024-04-24T13:32:46.198 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.198 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.198 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.198 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.198 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.198 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.198 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2212 2024-04-24T13:32:46.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.198 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398232+0000", 2024-04-24T13:32:46.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405320+0000", 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070884040000000004 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405367+0000", 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6940000000000001e-05 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405393+0000", 2024-04-24T13:32:46.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5252000000000001e-05 2024-04-24T13:32:46.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405487+0000", 2024-04-24T13:32:46.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4596e-05 2024-04-24T13:32:46.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405609+0000", 2024-04-24T13:32:46.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121892 2024-04-24T13:32:46.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405710+0000", 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010121899999999999 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.415423+0000", 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097131219999999994 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.422967+0000", 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00754319 2024-04-24T13:32:46.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.423023+0000", 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5958000000000002e-05 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.423077+0000", 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4432999999999999e-05 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2245 3.1d 3:bb337c31:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.32849259, 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020498309999999999, 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:46.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:46.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775508+0000", 2024-04-24T13:32:46.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.486e-06 2024-04-24T13:32:46.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779469+0000", 2024-04-24T13:32:46.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003961862 2024-04-24T13:32:46.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779497+0000", 2024-04-24T13:32:46.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7559000000000002e-05 2024-04-24T13:32:46.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779513+0000", 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6450999999999999e-05 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779626+0000", 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112478 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779794+0000", 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016824099999999999 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779922+0000", 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012780199999999999 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.793374+0000", 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013451942 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795894+0000", 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025205079999999999 2024-04-24T13:32:46.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795951+0000", 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6131000000000002e-05 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.796003+0000", 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2849999999999997e-05 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.210 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2248 3.1d 3:b991c377:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.210 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:46.210 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.298703326999998, 2024-04-24T13:32:46.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016320675999999999, 2024-04-24T13:32:46.210 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.210 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.210 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.210 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2248 2024-04-24T13:32:46.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.210 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805301+0000", 2024-04-24T13:32:46.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1399999999999997e-06 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809310+0000", 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040090179999999996 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809337+0000", 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7636000000000001e-05 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809351+0000", 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3728e-05 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809435+0000", 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3956999999999996e-05 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809588+0000", 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015312299999999999 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809713+0000", 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012522299999999999 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.815947+0000", 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062333359999999999 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821522+0000", 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055754239999999998 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821572+0000", 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0005e-05 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821615+0000", 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3086e-05 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.215 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2250 3.3c 3:3d3fcdd2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.279938263999998, 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018935203000000001, 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2250 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824061+0000", 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.725e-06 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827859+0000", 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037982960000000001 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827885+0000", 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5761e-05 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827896+0000", 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1136e-05 2024-04-24T13:32:46.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828017+0000", 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012102100000000001 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828290+0000", 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027271199999999999 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828528+0000", 2024-04-24T13:32:46.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023780599999999999 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.835369+0000", 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068407609999999999 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842842+0000", 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074735390000000004 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842928+0000", 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5513999999999995e-05 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842995+0000", 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6932000000000002e-05 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2251 3.3a 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:46.221 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.269120017999999, 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030524880000000001, 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2251 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:46.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834880+0000", 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6769999999999999e-06 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.223 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839556+0000", 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046751350000000004 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839593+0000", 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7079999999999997e-05 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839617+0000", 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4015999999999998e-05 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839773+0000", 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015627699999999999 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840011+0000", 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023843900000000001 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840261+0000", 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024939899999999997 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.853562+0000", 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013301726999999999 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865276+0000", 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011713779000000001 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865349+0000", 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2624000000000001e-05 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865403+0000", 2024-04-24T13:32:46.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3727000000000002e-05 2024-04-24T13:32:46.227 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.227 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.227 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.227 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.227 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.227 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:46.229 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:46.229 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:46.225+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:46.330 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:46.327+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:46.398 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:46.398 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:46.398 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:46.399 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:46.413 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:46.458 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:46.457+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:46.518 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:32:46.537 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:46.537 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:46.537 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:46.537 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:46.537 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:46.551 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:46.562 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:46.563+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:46.632 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:46.631+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:46.721 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:46.721 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:46.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:46.722 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:46.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.722 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:46.722 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:46.722 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 137.473604271, 2024-04-24T13:32:46.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:32:46.722 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.722 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.722 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.722 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.722 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.722 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.723 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:32:46.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.723 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:46.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:46.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:32:46.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:32:46.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:32:46.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:32:46.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:46.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:32:46.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:32:46.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:32:46.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:32:46.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:32:46.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:32:46.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:32:46.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:32:46.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:32:46.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:32:46.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:32:46.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:32:46.729 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.729 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.729 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.729 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1618 3.36 3:6e88aafa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:46.729 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:46.730 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.488828858000002, 2024-04-24T13:32:46.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025620654, 2024-04-24T13:32:46.730 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.730 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.730 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.730 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.730 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.730 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.730 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1618 2024-04-24T13:32:46.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.730 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229083+0000", 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2100000000000002e-06 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234443+0000", 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053597139999999998 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234484+0000", 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0902999999999998e-05 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234502+0000", 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8252000000000001e-05 2024-04-24T13:32:46.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234657+0000", 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015551000000000001 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234920+0000", 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263114 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.236227+0000", 2024-04-24T13:32:46.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001306179 2024-04-24T13:32:46.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.251163+0000", 2024-04-24T13:32:46.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014936766000000001 2024-04-24T13:32:46.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254465+0000", 2024-04-24T13:32:46.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003301151 2024-04-24T13:32:46.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254581+0000", 2024-04-24T13:32:46.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116224 2024-04-24T13:32:46.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254700+0000", 2024-04-24T13:32:46.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011963099999999999 2024-04-24T13:32:46.735 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.735 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.735 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.736 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2207 3.38 e85/74 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:46.736 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:46.736 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.40988681, 2024-04-24T13:32:46.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015720683999999999, 2024-04-24T13:32:46.736 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.736 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.736 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.736 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:46.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308024+0000", 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314047+0000", 2024-04-24T13:32:46.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060226259999999997 2024-04-24T13:32:46.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314095+0000", 2024-04-24T13:32:46.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7803000000000003e-05 2024-04-24T13:32:46.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314118+0000", 2024-04-24T13:32:46.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3218999999999999e-05 2024-04-24T13:32:46.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314281+0000", 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016252399999999999 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314321+0000", 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0213000000000003e-05 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.323647+0000", 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093264079999999996 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.323742+0000", 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5198000000000006e-05 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2209 3.14 e85/48 3:287cf44b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_4:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.378533050000001, 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01556167, 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.740 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0699999999999997e-07 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344736+0000", 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053602750000000003 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344764+0000", 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8033000000000001e-05 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344779+0000", 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4693e-05 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344934+0000", 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520399999999999 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344975+0000", 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0368999999999999e-05 2024-04-24T13:32:46.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354882+0000", 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099076630000000006 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354937+0000", 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4926000000000002e-05 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.745 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2221 3.26 3:67d4e534:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.745 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:46.745 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.203382229999999, 2024-04-24T13:32:46.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017991152999999999, 2024-04-24T13:32:46.745 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.745 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.745 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.745 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.745 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.745 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.745 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2221 2024-04-24T13:32:46.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.746 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:46.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:46.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514529+0000", 2024-04-24T13:32:46.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3080000000000002e-06 2024-04-24T13:32:46.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519181+0000", 2024-04-24T13:32:46.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046525129999999996 2024-04-24T13:32:46.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519216+0000", 2024-04-24T13:32:46.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5181000000000001e-05 2024-04-24T13:32:46.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519228+0000", 2024-04-24T13:32:46.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1253000000000001e-05 2024-04-24T13:32:46.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519324+0000", 2024-04-24T13:32:46.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6564000000000006e-05 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519463+0000", 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139269 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519597+0000", 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013386999999999999 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532228+0000", 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012631009 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532440+0000", 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021200400000000001 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532479+0000", 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8668000000000003e-05 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532518+0000", 2024-04-24T13:32:46.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8513999999999998e-05 2024-04-24T13:32:46.751 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.751 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.751 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.751 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2224 3.2c 3:3671ead8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.751 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:46.751 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.173200744999999, 2024-04-24T13:32:46.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016019095000000001, 2024-04-24T13:32:46.751 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.751 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2224 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544710+0000", 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5040000000000001e-06 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548580+0000", 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003869473 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548609+0000", 2024-04-24T13:32:46.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9623000000000001e-05 2024-04-24T13:32:46.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548623+0000", 2024-04-24T13:32:46.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3498e-05 2024-04-24T13:32:46.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548709+0000", 2024-04-24T13:32:46.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6390000000000005e-05 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548989+0000", 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027985500000000002 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549084+0000", 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4568999999999995e-05 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.559986+0000", 2024-04-24T13:32:46.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010902692 2024-04-24T13:32:46.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560649+0000", 2024-04-24T13:32:46.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066290299999999995 2024-04-24T13:32:46.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560687+0000", 2024-04-24T13:32:46.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7644000000000001e-05 2024-04-24T13:32:46.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560727+0000", 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9944000000000002e-05 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2231 3.36 3:6ddceaef:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.098995721000001, 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017463218999999999, 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.757 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2231 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618915+0000", 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5620000000000002e-06 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622655+0000", 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003739984 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622683+0000", 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7390999999999999e-05 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622697+0000", 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3694e-05 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622795+0000", 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8518999999999996e-05 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.623022+0000", 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022680700000000001 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.623244+0000", 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022219199999999999 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634301+0000", 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011056718 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636075+0000", 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001774437 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636243+0000", 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016734399999999999 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636376+0000", 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000133571 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.762 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.763 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.763 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2232 3.a 3:53fed644:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.763 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:46.763 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.087258692999999, 2024-04-24T13:32:46.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017222277000000001, 2024-04-24T13:32:46.763 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.763 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.763 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.763 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.763 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.763 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2232 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630652+0000", 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5119999999999998e-06 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634591+0000", 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039383990000000004 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634610+0000", 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9530000000000001e-05 2024-04-24T13:32:46.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634620+0000", 2024-04-24T13:32:46.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0081000000000001e-05 2024-04-24T13:32:46.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634679+0000", 2024-04-24T13:32:46.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8483999999999998e-05 2024-04-24T13:32:46.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634807+0000", 2024-04-24T13:32:46.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012772 2024-04-24T13:32:46.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:46.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634918+0000", 2024-04-24T13:32:46.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011121 2024-04-24T13:32:46.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.767 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.641801+0000", 2024-04-24T13:32:46.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006883213 2024-04-24T13:32:46.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647770+0000", 2024-04-24T13:32:46.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059689729999999998 2024-04-24T13:32:46.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647818+0000", 2024-04-24T13:32:46.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8455000000000003e-05 2024-04-24T13:32:46.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647872+0000", 2024-04-24T13:32:46.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3699999999999997e-05 2024-04-24T13:32:46.769 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.769 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.769 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.769 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2233 3.c e85/74 3:3257d695:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_28:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:46.770 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:46.770 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.074617710999998, 2024-04-24T13:32:46.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015313149, 2024-04-24T13:32:46.770 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.770 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.770 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.770 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:46.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:46.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643292+0000", 2024-04-24T13:32:46.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4980000000000001e-06 2024-04-24T13:32:46.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647384+0000", 2024-04-24T13:32:46.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040918980000000001 2024-04-24T13:32:46.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647409+0000", 2024-04-24T13:32:46.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4719000000000002e-05 2024-04-24T13:32:46.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647421+0000", 2024-04-24T13:32:46.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1956999999999999e-05 2024-04-24T13:32:46.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647575+0000", 2024-04-24T13:32:46.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015421900000000001 2024-04-24T13:32:46.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647642+0000", 2024-04-24T13:32:46.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6822000000000005e-05 2024-04-24T13:32:46.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.658477+0000", 2024-04-24T13:32:46.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010835200999999999 2024-04-24T13:32:46.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.658604+0000", 2024-04-24T13:32:46.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126835 2024-04-24T13:32:46.774 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.774 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.774 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.775 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2234 3.34 e85/20 3:2f41ca12:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_29:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:46.775 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:46.775 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.060892578000001, 2024-04-24T13:32:46.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013995339000000001, 2024-04-24T13:32:46.775 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.775 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.775 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.775 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657018+0000", 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0700000000000001e-06 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659913+0000", 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028946079999999999 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659934+0000", 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1154000000000001e-05 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659946+0000", 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1958e-05 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.660012+0000", 2024-04-24T13:32:46.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5870000000000005e-05 2024-04-24T13:32:46.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.660041+0000", 2024-04-24T13:32:46.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9280000000000001e-05 2024-04-24T13:32:46.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.670873+0000", 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010831591999999999 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671011+0000", 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013880699999999999 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2238 3.20 3:07ab05cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:46.779 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.019166006999999, 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019528604000000001, 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2238 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:46.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698745+0000", 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702722+0000", 2024-04-24T13:32:46.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039764370000000002 2024-04-24T13:32:46.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702755+0000", 2024-04-24T13:32:46.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3676000000000001e-05 2024-04-24T13:32:46.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702771+0000", 2024-04-24T13:32:46.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5823000000000001e-05 2024-04-24T13:32:46.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702854+0000", 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2804000000000002e-05 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702974+0000", 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120258 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.703104+0000", 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129708 2024-04-24T13:32:46.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.710231+0000", 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071274570000000002 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718023+0000", 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077912720000000001 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718164+0000", 2024-04-24T13:32:46.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014127500000000001 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718271+0000", 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107371 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2240 3.3f 3:fe4f476b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.998616537, 2024-04-24T13:32:46.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014610142, 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2240 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719294+0000", 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0770000000000002e-06 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723057+0000", 2024-04-24T13:32:46.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037627060000000002 2024-04-24T13:32:46.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723089+0000", 2024-04-24T13:32:46.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1968999999999998e-05 2024-04-24T13:32:46.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723100+0000", 2024-04-24T13:32:46.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0695e-05 2024-04-24T13:32:46.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723176+0000", 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6589999999999997e-05 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723313+0000", 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136806 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723434+0000", 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120835 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.727850+0000", 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044163229999999998 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733804+0000", 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059542620000000001 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733849+0000", 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4455e-05 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733902+0000", 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3424000000000002e-05 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2247 3.2a 3:56a679bb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.923038356999999, 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018867848, 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.791 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.792 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.792 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.792 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.792 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2247 2024-04-24T13:32:46.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.792 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:46.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:46.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794873+0000", 2024-04-24T13:32:46.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7130000000000001e-06 2024-04-24T13:32:46.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799547+0000", 2024-04-24T13:32:46.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004674114 2024-04-24T13:32:46.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799586+0000", 2024-04-24T13:32:46.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9279999999999997e-05 2024-04-24T13:32:46.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799613+0000", 2024-04-24T13:32:46.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6239000000000001e-05 2024-04-24T13:32:46.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799734+0000", 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120964 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799986+0000", 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025243200000000003 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.800155+0000", 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016893400000000001 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.806810+0000", 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066547459999999996 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813614+0000", 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068047730000000001 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813684+0000", 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9504000000000004e-05 2024-04-24T13:32:46.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813738+0000", 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4148999999999999e-05 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2254 3.20 3:079960b7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.849655406, 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019983331, 2024-04-24T13:32:46.797 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2254 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868256+0000", 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8890000000000002e-06 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872066+0000", 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038094549999999998 2024-04-24T13:32:46.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872090+0000", 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4933e-05 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872104+0000", 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3246e-05 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872222+0000", 2024-04-24T13:32:46.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118266 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872485+0000", 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026320500000000003 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872713+0000", 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022758000000000001 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881332+0000", 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086188640000000004 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.887928+0000", 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065959490000000003 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.888112+0000", 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018435700000000001 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.888237+0000", 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012458700000000001 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2256 3.21 e85/74 3:878222a6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_51:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.825557980999999, 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013390116000000001, 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.803 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.804 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:46.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:46.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892353+0000", 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5629999999999999e-06 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896496+0000", 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041424840000000001 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896531+0000", 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5682999999999997e-05 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896549+0000", 2024-04-24T13:32:46.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7909000000000001e-05 2024-04-24T13:32:46.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896687+0000", 2024-04-24T13:32:46.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013818200000000001 2024-04-24T13:32:46.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896723+0000", 2024-04-24T13:32:46.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5194999999999998e-05 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.905615+0000", 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088924759999999999 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.905741+0000", 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012562399999999999 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2263 3.26 3:64e2178e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.750020909, 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014626548, 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2263 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.808 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967890+0000", 2024-04-24T13:32:46.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9470000000000002e-06 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971675+0000", 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037854350000000002 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971700+0000", 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4678e-05 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971710+0000", 2024-04-24T13:32:46.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0059e-05 2024-04-24T13:32:46.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971802+0000", 2024-04-24T13:32:46.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2118000000000001e-05 2024-04-24T13:32:46.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971952+0000", 2024-04-24T13:32:46.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015013599999999999 2024-04-24T13:32:46.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.972085+0000", 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132946 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.981987+0000", 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099020819999999996 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982408+0000", 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042130500000000002 2024-04-24T13:32:46.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982466+0000", 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7629e-05 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982514+0000", 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8213000000000001e-05 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.814 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2267 3.3f 3:fe72662d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.814 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:46.814 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.702811811, 2024-04-24T13:32:46.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018629916999999999, 2024-04-24T13:32:46.814 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.814 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.814 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.814 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.814 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.814 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.814 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2267 2024-04-24T13:32:46.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.814 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015099+0000", 2024-04-24T13:32:46.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2199999999999999e-06 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018921+0000", 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038224579999999999 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018941+0000", 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9945999999999998e-05 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018952+0000", 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0361e-05 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019017+0000", 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5068999999999997e-05 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019148+0000", 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013165299999999999 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:46.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019247+0000", 2024-04-24T13:32:46.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.87e-05 2024-04-24T13:32:46.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.025115+0000", 2024-04-24T13:32:46.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058674909999999999 2024-04-24T13:32:46.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033545+0000", 2024-04-24T13:32:46.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084303639999999992 2024-04-24T13:32:46.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033659+0000", 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114131 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033727+0000", 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7523999999999999e-05 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.819 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2269 3.38 e85/74 3:1d70d2f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_64:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.679558365999998, 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013439965, 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:46.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038352+0000", 2024-04-24T13:32:46.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4500000000000001e-06 2024-04-24T13:32:46.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042479+0000", 2024-04-24T13:32:46.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041270819999999998 2024-04-24T13:32:46.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042517+0000", 2024-04-24T13:32:46.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8550000000000002e-05 2024-04-24T13:32:46.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042535+0000", 2024-04-24T13:32:46.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8093000000000001e-05 2024-04-24T13:32:46.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042678+0000", 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014304399999999999 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042722+0000", 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3179000000000001e-05 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051734+0000", 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0090125280000000006 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051790+0000", 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6039000000000003e-05 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2270 3.a 3:52207169:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.671153905000001, 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014332798000000001, 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.824 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2270 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:46.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046757+0000", 2024-04-24T13:32:46.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2450000000000001e-06 2024-04-24T13:32:46.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050608+0000", 2024-04-24T13:32:46.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038509949999999999 2024-04-24T13:32:46.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050632+0000", 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4450000000000001e-05 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050646+0000", 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3273e-05 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050743+0000", 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7190999999999998e-05 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050918+0000", 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017516600000000001 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051100+0000", 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018168700000000001 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.055983+0000", 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048829379999999999 2024-04-24T13:32:46.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060902+0000", 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049192430000000002 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.061003+0000", 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101351 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.061087+0000", 2024-04-24T13:32:46.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4258999999999994e-05 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2279 3.2a 3:57162c53:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 17.577510228000001, 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016593472000000001, 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:46.830 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2279 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140401+0000", 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5950000000000001e-06 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144257+0000", 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038560869999999998 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144277+0000", 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9976e-05 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144288+0000", 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.059e-05 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144359+0000", 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1550000000000004e-05 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144501+0000", 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014193499999999999 2024-04-24T13:32:46.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:46.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144633+0000", 2024-04-24T13:32:46.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131748 2024-04-24T13:32:46.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:46.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.148819+0000", 2024-04-24T13:32:46.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041860140000000001 2024-04-24T13:32:46.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156831+0000", 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080120120000000006 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156920+0000", 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9112999999999999e-05 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156992+0000", 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1852000000000003e-05 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.835 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.836 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.836 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:46.836 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:46.836 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:46.837 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:46.838 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:46.833+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:46.938 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:46.937+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:47.005 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:47.005 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:47.005 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:47.006 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:47.019 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:32:47.039 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:47.039+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:47.140 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:47.139+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:47.186 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:47.186 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:47.187 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:47.187 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:47.187 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:47.200 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:32:47.241 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:47.239+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:47.325 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:47.325 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:47.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:47.325 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:47.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.325 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.326 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:32:47.326 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.465748929, 2024-04-24T13:32:47.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:32:47.326 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.326 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.326 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.326 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.326 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.326 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.326 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:32:47.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.326 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:32:47.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:32:47.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:32:47.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:32:47.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:32:47.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:32:47.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:32:47.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:32:47.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:32:47.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:32:47.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:32:47.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:32:47.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:32:47.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:32:47.331 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.331 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.331 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.465726155, 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.332 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:32:47.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:32:47.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:32:47.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:32:47.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:32:47.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:32:47.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:32:47.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:32:47.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:32:47.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:32:47.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:32:47.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:32:47.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:32:47.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:32:47.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:32:47.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:32:47.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:32:47.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:32:47.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:32:47.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:32:47.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:32:47.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:32:47.337 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.338 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.338 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.338 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.338 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:32:47.338 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.36811872199999, 2024-04-24T13:32:47.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:32:47.338 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.338 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.338 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.338 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.339 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.339 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.339 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:32:47.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.339 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:32:47.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:32:47.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:32:47.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:32:47.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:32:47.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:32:47.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:32:47.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:32:47.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:32:47.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:32:47.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:32:47.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:32:47.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:32:47.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:32:47.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:32:47.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:32:47.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:32:47.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:32:47.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:32:47.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:32:47.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:32:47.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:32:47.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:32:47.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:32:47.344 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.344 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.344 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.344 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.344 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:32:47.344 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.36803108500001, 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:32:47.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:32:47.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:32:47.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:32:47.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:32:47.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:32:47.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:32:47.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:32:47.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:32:47.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:32:47.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:32:47.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:32:47.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:32:47.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:32:47.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:32:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:32:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:32:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:32:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:32:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:32:47.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:32:47.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:32:47.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:32:47.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:32:47.350 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.350 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.350 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.351 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.351 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:32:47.351 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.262377198, 2024-04-24T13:32:47.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:32:47.351 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.351 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.351 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.351 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.351 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.351 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.351 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:32:47.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.352 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:32:47.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:32:47.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:32:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:32:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:32:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:32:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.26217267999999, 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.357 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.358 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.358 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.358 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:32:47.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.358 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:32:47.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:32:47.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:32:47.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:32:47.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:32:47.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:32:47.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.261812857, 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.363 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.364 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.364 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:32:47.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.364 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:32:47.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:32:47.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:32:47.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:32:47.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:32:47.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:32:47.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:32:47.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.26164445399999, 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.369 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.370 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:32:47.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.370 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:32:47.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:32:47.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:32:47.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:32:47.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:32:47.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:32:47.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:32:47.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:32:47.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:32:47.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:32:47.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:32:47.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:32:47.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:32:47.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:32:47.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:32:47.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:32:47.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:32:47.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:32:47.375 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.375 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.375 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.375 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.376 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:32:47.376 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.26143606299999, 2024-04-24T13:32:47.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:32:47.376 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.376 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.376 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.376 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.376 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.376 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.376 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:32:47.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.377 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:32:47.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:32:47.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:32:47.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:32:47.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:32:47.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:32:47.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:32:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:32:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:32:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:32:47.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:32:47.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:32:47.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:32:47.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:32:47.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:32:47.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:32:47.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:32:47.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:32:47.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:32:47.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:32:47.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:32:47.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:32:47.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:32:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:32:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:32:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.26133820999999, 2024-04-24T13:32:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:32:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.383 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:32:47.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:32:47.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:32:47.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:32:47.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:32:47.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:32:47.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:32:47.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:32:47.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:32:47.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:32:47.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:32:47.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:32:47.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:32:47.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:32:47.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:32:47.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:32:47.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:32:47.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:32:47.390 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.390 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.390 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.390 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.390 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:32:47.390 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.261237061, 2024-04-24T13:32:47.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:32:47.390 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.390 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.390 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:32:47.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:32:47.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:32:47.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:32:47.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:32:47.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:32:47.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:32:47.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:32:47.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:32:47.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:32:47.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:32:47.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:32:47.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:32:47.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:32:47.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:32:47.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:32:47.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:32:47.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.26098034899999, 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.396 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.397 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.397 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.397 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.397 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.397 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:32:47.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.397 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:32:47.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:32:47.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:32:47.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:32:47.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:32:47.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:32:47.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:32:47.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:32:47.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:32:47.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:32:47.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:32:47.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:32:47.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:32:47.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:32:47.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:32:47.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:32:47.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:32:47.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:32:47.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:32:47.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:32:47.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:32:47.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:32:47.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.403 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.403 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:32:47.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:32:47.403 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.403 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.403 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.403 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.403 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.404 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:32:47.404 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.26087068699999, 2024-04-24T13:32:47.404 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:32:47.404 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.404 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.404 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.404 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.404 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.404 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.404 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:32:47.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.405 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:32:47.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:32:47.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:32:47.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:32:47.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:32:47.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:32:47.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:32:47.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:32:47.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:32:47.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:32:47.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:32:47.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:32:47.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:32:47.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:32:47.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:32:47.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:32:47.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:32:47.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:32:47.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:32:47.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:32:47.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:32:47.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:32:47.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.410 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.410 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:32:47.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:32:47.410 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.410 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.411 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.411 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.411 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:32:47.411 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.260798658, 2024-04-24T13:32:47.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:32:47.411 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.411 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.411 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.411 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.411 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.412 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.412 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:32:47.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.412 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:32:47.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:32:47.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:32:47.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:32:47.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:32:47.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:32:47.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:32:47.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:32:47.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:32:47.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:32:47.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:32:47.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:32:47.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:32:47.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:32:47.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:32:47.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:32:47.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:32:47.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:32:47.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:32:47.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:32:47.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:32:47.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:32:47.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.417 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:32:47.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:32:47.418 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.418 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.418 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.418 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.418 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:32:47.418 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.26062762199999, 2024-04-24T13:32:47.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:32:47.418 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.418 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.419 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.419 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.419 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.419 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.419 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:32:47.419 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.419 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:32:47.419 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:32:47.420 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.420 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.420 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.420 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.420 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:32:47.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:32:47.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.421 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.421 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:32:47.421 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:32:47.421 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.421 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:32:47.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:32:47.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.422 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.422 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:32:47.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:32:47.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.422 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:32:47.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:32:47.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:32:47.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:32:47.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:32:47.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:32:47.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:32:47.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:32:47.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:32:47.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:32:47.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.425 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:32:47.426 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.26058812900001, 2024-04-24T13:32:47.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:32:47.426 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.426 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.426 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.426 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.426 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.426 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.426 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:32:47.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.426 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:32:47.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:32:47.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:32:47.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:32:47.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:32:47.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:32:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:32:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:32:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:32:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:32:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:32:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.431 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.00726887299999, 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:32:47.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:32:47.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:32:47.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:32:47.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:32:47.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:32:47.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:32:47.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:32:47.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.434 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.434 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:32:47.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:32:47.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:32:47.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:32:47.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:32:47.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:32:47.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.438 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.438 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:32:47.438 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.00724282499999, 2024-04-24T13:32:47.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:32:47.438 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.438 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.438 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.438 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.438 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.438 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.438 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:32:47.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.438 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:32:47.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:32:47.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:32:47.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:32:47.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:32:47.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:32:47.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:32:47.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:32:47.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:32:47.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:32:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:32:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:32:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:32:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.443 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.444 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.444 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:32:47.444 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.00721746900001, 2024-04-24T13:32:47.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:32:47.444 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.444 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.445 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.445 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.445 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:32:47.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.445 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:32:47.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:32:47.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:32:47.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:32:47.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:32:47.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:32:47.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.447 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.447 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:32:47.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:32:47.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:32:47.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:32:47.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:32:47.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:32:47.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:32:47.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:32:47.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:32:47.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:32:47.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:32:47.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:32:47.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:32:47.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:32:47.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:32:47.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:32:47.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:32:47.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:32:47.451 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.451 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.451 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.452 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:47.452 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:32:47.452 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 158.0071264, 2024-04-24T13:32:47.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:32:47.452 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:47.453 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:47.453 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:47.453 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:47.453 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:47.453 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:47.453 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:32:47.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.453 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:47.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:47.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:32:47.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:47.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:32:47.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:47.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:47.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:32:47.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:32:47.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:47.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:32:47.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:47.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:32:47.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:32:47.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:47.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:32:47.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:32:47.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:47.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:32:47.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:32:47.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:32:47.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:47.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:47.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:47.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:32:47.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:32:47.459 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.459 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.459 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.459 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:47.459 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:47.459 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:47.460 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:32:47.461 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:47.457+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:47.462 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:32:47.529 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:32:47.561 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:47.557+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:47.596 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:47.597 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:47.597 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:47.597 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:47.613 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:32:47.623 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:47.623 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:47.643 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:47.643 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:47.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:47.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:47.662 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:47.661+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:47.676 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:47.676 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:47.697 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:47.697 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:47.717 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:47.718 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:47.738 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:47.738 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:47.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:47.738 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:47.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:32:47.763 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:47.761+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:47.764 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:47.764 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:47.864 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:47.863+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:47.879 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:47.879 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:47.893 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:32:47.978 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:47.979+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:48.061 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:48.061 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:48.066 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:48.061+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:48.075 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:32:48.166 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:48.165+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:48.240 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:48.240 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:48.254 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:32:48.299 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:48.299+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:48.368 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:48.367+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:48.373 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:48.373 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:48.387 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:32:48.474 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:48.475+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:48.558 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:48.559 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:48.570 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:48.565+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:48.572 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:32:48.671 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:48.671+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:48.739 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:48.739 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:48.753 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:32:48.771 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:48.769+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:48.872 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:48.869+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:48.912 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:48.912 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:48.926 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:48.972 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:48.969+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:49.048 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:49.048 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:49.062 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:49.107 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:49.107+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:49.174 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:49.173+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:49.183 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:49.183 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:49.197 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:49.275 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:49.273+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:49.361 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:49.361 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:49.376 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:49.376 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:49.375+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:49.477 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:49.475+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:49.507 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:49.508 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:49.522 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:49.553 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:32:49.599 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:49.599+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:49.639 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:49.640 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:49.653 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:49.703 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:49.701+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:49.777 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:49.777 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:49.780 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:49.779+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:49.782 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:32:49.791 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:49.889 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:49.885+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:50.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:50.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:50.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:50.594 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:50.594 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:50.594 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:50.595 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:50.595 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:50.596 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:50.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:50.596 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:50.596 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:50.597 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:50.597 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:50.597 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:50.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:50.598 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:50.598 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:50.599 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:50.600 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:32:50.600 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:50.595+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:50.696 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:50.695+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:50.766 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:50.766 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:50.766 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:50.766 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:50.766 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:50.780 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:50.795 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:50.795+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:50.893 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:50.893 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:50.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:50.894 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:50.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.894 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:48 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:50.894 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:50.894 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 141.61052865600001, 2024-04-24T13:32:50.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048388950000000002, 2024-04-24T13:32:50.894 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.894 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.894 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.894 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.894 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.894 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.895 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 48 2024-04-24T13:32:50.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.895 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:50.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279162+0000", 2024-04-24T13:32:50.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279165+0000", 2024-04-24T13:32:50.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3799999999999998e-06 2024-04-24T13:32:50.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279193+0000", 2024-04-24T13:32:50.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7674e-05 2024-04-24T13:32:50.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279224+0000", 2024-04-24T13:32:50.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0654000000000002e-05 2024-04-24T13:32:50.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279244+0000", 2024-04-24T13:32:50.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:32:50.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279426+0000", 2024-04-24T13:32:50.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018255300000000001 2024-04-24T13:32:50.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279717+0000", 2024-04-24T13:32:50.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029043800000000001 2024-04-24T13:32:50.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:50.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.279993+0000", 2024-04-24T13:32:50.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276786 2024-04-24T13:32:50.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.282898+0000", 2024-04-24T13:32:50.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002904093 2024-04-24T13:32:50.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283731+0000", 2024-04-24T13:32:50.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00083382599999999997 2024-04-24T13:32:50.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.283886+0000", 2024-04-24T13:32:50.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015512600000000001 2024-04-24T13:32:50.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284001+0000", 2024-04-24T13:32:50.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114405 2024-04-24T13:32:50.900 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.900 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.900 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.900 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:49 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94410010339456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:50.900 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:50.901 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 141.605404061, 2024-04-24T13:32:50.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044116340000000002, 2024-04-24T13:32:50.901 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.901 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.901 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.901 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.901 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.901 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.901 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 49 2024-04-24T13:32:50.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.901 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:50.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284287+0000", 2024-04-24T13:32:50.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284289+0000", 2024-04-24T13:32:50.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.125e-06 2024-04-24T13:32:50.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284299+0000", 2024-04-24T13:32:50.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0485999999999999e-05 2024-04-24T13:32:50.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284330+0000", 2024-04-24T13:32:50.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0528000000000003e-05 2024-04-24T13:32:50.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284345+0000", 2024-04-24T13:32:50.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4883e-05 2024-04-24T13:32:50.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.904 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.904 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284484+0000", 2024-04-24T13:32:50.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139708 2024-04-24T13:32:50.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284655+0000", 2024-04-24T13:32:50.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170953 2024-04-24T13:32:50.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:50.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.284981+0000", 2024-04-24T13:32:50.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000325648 2024-04-24T13:32:50.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.287326+0000", 2024-04-24T13:32:50.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023452709999999999 2024-04-24T13:32:50.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288427+0000", 2024-04-24T13:32:50.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001100544 2024-04-24T13:32:50.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288551+0000", 2024-04-24T13:32:50.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012466500000000001 2024-04-24T13:32:50.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.288698+0000", 2024-04-24T13:32:50.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146823 2024-04-24T13:32:50.907 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.907 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.907 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.908 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:205 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e31)", 2024-04-24T13:32:50.908 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:50.908 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 138.62619117599999, 2024-04-24T13:32:50.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047820809999999997, 2024-04-24T13:32:50.908 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.908 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.908 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.908 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.908 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.908 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.909 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 205 2024-04-24T13:32:50.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.909 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:50.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263499+0000", 2024-04-24T13:32:50.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263503+0000", 2024-04-24T13:32:50.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.039e-06 2024-04-24T13:32:50.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.910 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.910 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.910 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263520+0000", 2024-04-24T13:32:50.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7198e-05 2024-04-24T13:32:50.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263548+0000", 2024-04-24T13:32:50.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8158e-05 2024-04-24T13:32:50.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263565+0000", 2024-04-24T13:32:50.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7008e-05 2024-04-24T13:32:50.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263754+0000", 2024-04-24T13:32:50.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0001894 2024-04-24T13:32:50.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.263973+0000", 2024-04-24T13:32:50.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000218593 2024-04-24T13:32:50.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:50.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.264373+0000", 2024-04-24T13:32:50.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040043400000000002 2024-04-24T13:32:50.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.266377+0000", 2024-04-24T13:32:50.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0020033030000000001 2024-04-24T13:32:50.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268121+0000", 2024-04-24T13:32:50.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0017441049999999999 2024-04-24T13:32:50.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268212+0000", 2024-04-24T13:32:50.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1490000000000007e-05 2024-04-24T13:32:50.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.268282+0000", 2024-04-24T13:32:50.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9352999999999998e-05 2024-04-24T13:32:50.914 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.914 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.915 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.915 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:220 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:50.915 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:50.915 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 138.54647902400001, 2024-04-24T13:32:50.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0034252639999999999, 2024-04-24T13:32:50.915 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.915 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.915 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.915 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.915 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 220 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343212+0000", 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.916 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343214+0000", 2024-04-24T13:32:50.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:32:50.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343227+0000", 2024-04-24T13:32:50.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2941e-05 2024-04-24T13:32:50.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343259+0000", 2024-04-24T13:32:50.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1557000000000003e-05 2024-04-24T13:32:50.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343274+0000", 2024-04-24T13:32:50.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5401999999999999e-05 2024-04-24T13:32:50.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343455+0000", 2024-04-24T13:32:50.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018068700000000001 2024-04-24T13:32:50.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.343694+0000", 2024-04-24T13:32:50.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000238552 2024-04-24T13:32:50.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:50.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.344088+0000", 2024-04-24T13:32:50.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039456400000000003 2024-04-24T13:32:50.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.345723+0000", 2024-04-24T13:32:50.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016349139999999999 2024-04-24T13:32:50.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346480+0000", 2024-04-24T13:32:50.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075738300000000004 2024-04-24T13:32:50.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346569+0000", 2024-04-24T13:32:50.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.8281000000000004e-05 2024-04-24T13:32:50.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.346637+0000", 2024-04-24T13:32:50.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8165999999999998e-05 2024-04-24T13:32:50.921 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.921 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.921 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.921 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:225 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:50.921 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:50.921 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 138.52873872699999, 2024-04-24T13:32:50.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032957419999999999, 2024-04-24T13:32:50.921 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.922 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.922 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.922 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.922 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.922 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.922 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 225 2024-04-24T13:32:50.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.922 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:50.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360952+0000", 2024-04-24T13:32:50.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360954+0000", 2024-04-24T13:32:50.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.154e-06 2024-04-24T13:32:50.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360965+0000", 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1321999999999999e-05 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.360996+0000", 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0902999999999999e-05 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361012+0000", 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6164999999999999e-05 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361185+0000", 2024-04-24T13:32:50.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172072 2024-04-24T13:32:50.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361404+0000", 2024-04-24T13:32:50.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021965999999999999 2024-04-24T13:32:50.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:50.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.361852+0000", 2024-04-24T13:32:50.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000448276 2024-04-24T13:32:50.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.363340+0000", 2024-04-24T13:32:50.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001487169 2024-04-24T13:32:50.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364094+0000", 2024-04-24T13:32:50.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075443699999999995 2024-04-24T13:32:50.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364184+0000", 2024-04-24T13:32:50.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9957000000000006e-05 2024-04-24T13:32:50.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364248+0000", 2024-04-24T13:32:50.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3627000000000006e-05 2024-04-24T13:32:50.927 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.927 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.927 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.928 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:226 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:50.928 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:50.928 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 138.52517388000001, 2024-04-24T13:32:50.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0036426480000000001, 2024-04-24T13:32:50.928 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.928 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.928 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.928 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.928 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.928 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.928 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 226 2024-04-24T13:32:50.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364517+0000", 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364519+0000", 2024-04-24T13:32:50.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.84e-06 2024-04-24T13:32:50.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364529+0000", 2024-04-24T13:32:50.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0088999999999999e-05 2024-04-24T13:32:50.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364554+0000", 2024-04-24T13:32:50.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5537e-05 2024-04-24T13:32:50.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364568+0000", 2024-04-24T13:32:50.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3372e-05 2024-04-24T13:32:50.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.364726+0000", 2024-04-24T13:32:50.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015809299999999999 2024-04-24T13:32:50.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365059+0000", 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000333185 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.365758+0000", 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00069934299999999995 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.367413+0000", 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0016552349999999999 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368012+0000", 2024-04-24T13:32:50.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00059858700000000003 2024-04-24T13:32:50.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368097+0000", 2024-04-24T13:32:50.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5253999999999994e-05 2024-04-24T13:32:50.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.368159+0000", 2024-04-24T13:32:50.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2113000000000007e-05 2024-04-24T13:32:50.934 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.934 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.934 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.934 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:234 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=18b,call rgw_gc.rgw_gc_queue_init in=23b,call version.set in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:50.934 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:50.934 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 138.49578724400001, 2024-04-24T13:32:50.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033998840000000002, 2024-04-24T13:32:50.934 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.934 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.934 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.935 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.935 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 234 2024-04-24T13:32:50.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.935 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:50.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393903+0000", 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393906+0000", 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1569999999999998e-06 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393917+0000", 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1348999999999999e-05 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393942+0000", 2024-04-24T13:32:50.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.527e-05 2024-04-24T13:32:50.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.393957+0000", 2024-04-24T13:32:50.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4355999999999999e-05 2024-04-24T13:32:50.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394127+0000", 2024-04-24T13:32:50.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000170555 2024-04-24T13:32:50.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394352+0000", 2024-04-24T13:32:50.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224539 2024-04-24T13:32:50.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:50.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.394788+0000", 2024-04-24T13:32:50.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043600099999999999 2024-04-24T13:32:50.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.396137+0000", 2024-04-24T13:32:50.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001349404 2024-04-24T13:32:50.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397158+0000", 2024-04-24T13:32:50.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001020738 2024-04-24T13:32:50.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397237+0000", 2024-04-24T13:32:50.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9319000000000004e-05 2024-04-24T13:32:50.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.397303+0000", 2024-04-24T13:32:50.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6196000000000001e-05 2024-04-24T13:32:50.940 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.940 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.940 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.941 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:437 6.a 6:55b0279d:reshard::reshard.0000000009:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:50.941 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:50.941 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 138.42616365000001, 2024-04-24T13:32:50.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048056540000000003, 2024-04-24T13:32:50.941 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.941 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.941 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.941 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.941 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.941 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.941 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 437 2024-04-24T13:32:50.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.942 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:50.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.942 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463527+0000", 2024-04-24T13:32:50.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463529+0000", 2024-04-24T13:32:50.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2479999999999999e-06 2024-04-24T13:32:50.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463544+0000", 2024-04-24T13:32:50.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:32:50.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463572+0000", 2024-04-24T13:32:50.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8294e-05 2024-04-24T13:32:50.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.463590+0000", 2024-04-24T13:32:50.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7329999999999998e-05 2024-04-24T13:32:50.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464092+0000", 2024-04-24T13:32:50.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000502189 2024-04-24T13:32:50.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464454+0000", 2024-04-24T13:32:50.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036231300000000001 2024-04-24T13:32:50.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:32:50.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.464831+0000", 2024-04-24T13:32:50.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000377375 2024-04-24T13:32:50.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.467473+0000", 2024-04-24T13:32:50.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026414659999999999 2024-04-24T13:32:50.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468185+0000", 2024-04-24T13:32:50.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071215199999999997 2024-04-24T13:32:50.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468271+0000", 2024-04-24T13:32:50.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5593999999999994e-05 2024-04-24T13:32:50.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.468333+0000", 2024-04-24T13:32:50.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1957000000000003e-05 2024-04-24T13:32:50.947 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.947 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.947 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.947 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:793 6.d 6:b4f60f75:::obj_delete_at_hint.0000000072:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:50.947 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:50.947 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 138.02051390099999, 2024-04-24T13:32:50.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033442569999999998, 2024-04-24T13:32:50.948 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.948 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.948 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.948 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.948 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.948 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.948 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 793 2024-04-24T13:32:50.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.948 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.948 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.948 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:50.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869177+0000", 2024-04-24T13:32:50.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869179+0000", 2024-04-24T13:32:50.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.323e-06 2024-04-24T13:32:50.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869190+0000", 2024-04-24T13:32:50.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1319e-05 2024-04-24T13:32:50.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869222+0000", 2024-04-24T13:32:50.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1733999999999998e-05 2024-04-24T13:32:50.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869237+0000", 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5044e-05 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869396+0000", 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158913 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.869763+0000", 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000367112 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:50.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.870319+0000", 2024-04-24T13:32:50.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055558799999999998 2024-04-24T13:32:50.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.871509+0000", 2024-04-24T13:32:50.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001190607 2024-04-24T13:32:50.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872365+0000", 2024-04-24T13:32:50.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00085535299999999999 2024-04-24T13:32:50.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872449+0000", 2024-04-24T13:32:50.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3834999999999999e-05 2024-04-24T13:32:50.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:32.872521+0000", 2024-04-24T13:32:50.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2428999999999994e-05 2024-04-24T13:32:50.953 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.953 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.954 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.954 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:874 6.d 6:b110eaf6:::obj_delete_at_hint.0000000099:head [call lock.lock in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e32)", 2024-04-24T13:32:50.954 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:50.954 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 137.83450752900001, 2024-04-24T13:32:50.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003340754, 2024-04-24T13:32:50.954 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.954 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.954 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.955 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.955 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 874 2024-04-24T13:32:50.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.955 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:50.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055183+0000", 2024-04-24T13:32:50.957 INFO:tasks.workunit.client.0.smithi071.stderr:200+0 records in 2024-04-24T13:32:50.957 INFO:tasks.workunit.client.0.smithi071.stderr:200+0 records out 2024-04-24T13:32:50.957 INFO:tasks.workunit.client.0.smithi071.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 19.3195 s, 109 MB/s 2024-04-24T13:32:50.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055185+0000", 2024-04-24T13:32:50.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2299999999999998e-06 2024-04-24T13:32:50.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055197+0000", 2024-04-24T13:32:50.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1606e-05 2024-04-24T13:32:50.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055229+0000", 2024-04-24T13:32:50.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1603000000000002e-05 2024-04-24T13:32:50.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055244+0000", 2024-04-24T13:32:50.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4928e-05 2024-04-24T13:32:50.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055397+0000", 2024-04-24T13:32:50.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015366499999999999 2024-04-24T13:32:50.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.960 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.960 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.055763+0000", 2024-04-24T13:32:50.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036565600000000001 2024-04-24T13:32:50.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:50.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.056317+0000", 2024-04-24T13:32:50.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055436600000000004 2024-04-24T13:32:50.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.057678+0000", 2024-04-24T13:32:50.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001361283 2024-04-24T13:32:50.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058258+0000", 2024-04-24T13:32:50.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00057942400000000004 2024-04-24T13:32:50.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058407+0000", 2024-04-24T13:32:50.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000149188 2024-04-24T13:32:50.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:33.058524+0000", 2024-04-24T13:32:50.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116805 2024-04-24T13:32:50.963 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.963 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.963 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.963 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1566 4.38 4:1cdfa9df:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.3.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:50.963 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:50.963 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.333516256000003, 2024-04-24T13:32:50.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040238560000000001, 2024-04-24T13:32:50.963 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.963 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.963 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.964 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.964 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.964 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.964 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1566 2024-04-24T13:32:50.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.964 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:50.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556174+0000", 2024-04-24T13:32:50.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556176+0000", 2024-04-24T13:32:50.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.057e-06 2024-04-24T13:32:50.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556187+0000", 2024-04-24T13:32:50.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0693000000000001e-05 2024-04-24T13:32:50.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556219+0000", 2024-04-24T13:32:50.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1718999999999999e-05 2024-04-24T13:32:50.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556242+0000", 2024-04-24T13:32:50.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2687000000000001e-05 2024-04-24T13:32:50.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.966 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.966 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556384+0000", 2024-04-24T13:32:50.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014257899999999999 2024-04-24T13:32:50.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556624+0000", 2024-04-24T13:32:50.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024014199999999999 2024-04-24T13:32:50.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:50.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.556921+0000", 2024-04-24T13:32:50.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029673900000000002 2024-04-24T13:32:50.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.559462+0000", 2024-04-24T13:32:50.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025407530000000002 2024-04-24T13:32:50.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560009+0000", 2024-04-24T13:32:50.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00054690399999999997 2024-04-24T13:32:50.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560096+0000", 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7597999999999997e-05 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:17.560198+0000", 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010198499999999999 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1721 4.38 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:50.969 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.139149795999998, 2024-04-24T13:32:50.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088323519999999999, 2024-04-24T13:32:50.970 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.970 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.970 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.970 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.970 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.970 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.970 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1721 2024-04-24T13:32:50.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.970 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:50.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750541+0000", 2024-04-24T13:32:50.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750544+0000", 2024-04-24T13:32:50.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9569999999999998e-06 2024-04-24T13:32:50.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750561+0000", 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7589e-05 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750600+0000", 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8145999999999997e-05 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750621+0000", 2024-04-24T13:32:50.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1109999999999999e-05 2024-04-24T13:32:50.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750797+0000", 2024-04-24T13:32:50.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017672599999999999 2024-04-24T13:32:50.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751113+0000", 2024-04-24T13:32:50.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031514599999999998 2024-04-24T13:32:50.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:50.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.751586+0000", 2024-04-24T13:32:50.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047325699999999999 2024-04-24T13:32:50.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753982+0000", 2024-04-24T13:32:50.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023960880000000002 2024-04-24T13:32:50.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759108+0000", 2024-04-24T13:32:50.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051256590000000003 2024-04-24T13:32:50.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759247+0000", 2024-04-24T13:32:50.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013992400000000001 2024-04-24T13:32:50.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759373+0000", 2024-04-24T13:32:50.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012574999999999999 2024-04-24T13:32:50.976 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.976 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.976 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.976 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1724 4.38 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:50.976 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:50.976 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 32.139023641999998, 2024-04-24T13:32:50.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093322379999999996, 2024-04-24T13:32:50.976 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.977 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.977 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.977 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.977 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1724 2024-04-24T13:32:50.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.977 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.977 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:50.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750667+0000", 2024-04-24T13:32:50.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750669+0000", 2024-04-24T13:32:50.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7269999999999999e-06 2024-04-24T13:32:50.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750678+0000", 2024-04-24T13:32:50.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9700000000000005e-06 2024-04-24T13:32:50.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750744+0000", 2024-04-24T13:32:50.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5920999999999994e-05 2024-04-24T13:32:50.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.750766+0000", 2024-04-24T13:32:50.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.226e-05 2024-04-24T13:32:50.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752483+0000", 2024-04-24T13:32:50.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001717393 2024-04-24T13:32:50.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.752795+0000", 2024-04-24T13:32:50.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031186000000000001 2024-04-24T13:32:50.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:50.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.753283+0000", 2024-04-24T13:32:50.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00048743300000000001 2024-04-24T13:32:50.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.756401+0000", 2024-04-24T13:32:50.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031181220000000001 2024-04-24T13:32:50.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759844+0000", 2024-04-24T13:32:50.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003443715 2024-04-24T13:32:50.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759934+0000", 2024-04-24T13:32:50.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9728000000000006e-05 2024-04-24T13:32:50.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.759999+0000", 2024-04-24T13:32:50.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5109000000000003e-05 2024-04-24T13:32:50.982 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.983 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.983 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.983 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1814 4.38 4:1f50c967:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:50.983 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:50.983 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.948236465000001, 2024-04-24T13:32:50.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065250220000000001, 2024-04-24T13:32:50.983 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.983 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.983 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.984 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.984 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1814 2024-04-24T13:32:50.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.984 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:50.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941454+0000", 2024-04-24T13:32:50.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941457+0000", 2024-04-24T13:32:50.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3269999999999999e-06 2024-04-24T13:32:50.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941467+0000", 2024-04-24T13:32:50.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0596e-05 2024-04-24T13:32:50.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941503+0000", 2024-04-24T13:32:50.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5398999999999998e-05 2024-04-24T13:32:50.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941524+0000", 2024-04-24T13:32:50.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1586e-05 2024-04-24T13:32:50.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941687+0000", 2024-04-24T13:32:50.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016257000000000001 2024-04-24T13:32:50.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941919+0000", 2024-04-24T13:32:50.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232315 2024-04-24T13:32:50.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:50.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.942204+0000", 2024-04-24T13:32:50.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028527000000000001 2024-04-24T13:32:50.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.945033+0000", 2024-04-24T13:32:50.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028291029999999999 2024-04-24T13:32:50.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947677+0000", 2024-04-24T13:32:50.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0026439649999999999 2024-04-24T13:32:50.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947848+0000", 2024-04-24T13:32:50.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017036699999999999 2024-04-24T13:32:50.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.989 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.947979+0000", 2024-04-24T13:32:50.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131524 2024-04-24T13:32:50.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.989 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.989 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.990 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1817 4.38 4:1e48b193:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:50.990 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:50.990 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.948127518, 2024-04-24T13:32:50.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079573279999999996, 2024-04-24T13:32:50.990 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.990 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.990 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.990 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.990 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.990 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.990 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1817 2024-04-24T13:32:50.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.991 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:50.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941563+0000", 2024-04-24T13:32:50.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941565+0000", 2024-04-24T13:32:50.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.657e-06 2024-04-24T13:32:50.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941573+0000", 2024-04-24T13:32:50.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4169999999999992e-06 2024-04-24T13:32:50.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941596+0000", 2024-04-24T13:32:50.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2535999999999999e-05 2024-04-24T13:32:50.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:50.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.941610+0000", 2024-04-24T13:32:50.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3746e-05 2024-04-24T13:32:50.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:50.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944182+0000", 2024-04-24T13:32:50.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025729540000000001 2024-04-24T13:32:50.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:50.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944388+0000", 2024-04-24T13:32:50.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000205183 2024-04-24T13:32:50.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:50.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.944557+0000", 2024-04-24T13:32:50.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016964200000000001 2024-04-24T13:32:50.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:50.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.946998+0000", 2024-04-24T13:32:50.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024406670000000001 2024-04-24T13:32:50.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:50.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949247+0000", 2024-04-24T13:32:50.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022489490000000001 2024-04-24T13:32:50.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:50.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949406+0000", 2024-04-24T13:32:50.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000159436 2024-04-24T13:32:50.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:50.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.949520+0000", 2024-04-24T13:32:50.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114141 2024-04-24T13:32:50.996 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.996 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:50.996 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:50.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.996 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2212 3.3a 3:5de7fd4f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_7:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:50.996 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:50.996 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.491462358, 2024-04-24T13:32:50.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024848709, 2024-04-24T13:32:50.997 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:50.997 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:50.997 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:50.997 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:50.997 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:50.997 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:50.997 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2212 2024-04-24T13:32:50.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.997 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:50.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:50.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:50.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:50.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398228+0000", 2024-04-24T13:32:50.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:50.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:50.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.398232+0000", 2024-04-24T13:32:50.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.703e-06 2024-04-24T13:32:50.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:50.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405320+0000", 2024-04-24T13:32:50.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070884040000000004 2024-04-24T13:32:50.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:50.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:50.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:50.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405367+0000", 2024-04-24T13:32:50.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6940000000000001e-05 2024-04-24T13:32:50.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405393+0000", 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5252000000000001e-05 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405487+0000", 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4596e-05 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405609+0000", 2024-04-24T13:32:51.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121892 2024-04-24T13:32:51.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:51.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.405710+0000", 2024-04-24T13:32:51.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010121899999999999 2024-04-24T13:32:51.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.415423+0000", 2024-04-24T13:32:51.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0097131219999999994 2024-04-24T13:32:51.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.422967+0000", 2024-04-24T13:32:51.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00754319 2024-04-24T13:32:51.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.423023+0000", 2024-04-24T13:32:51.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5958000000000002e-05 2024-04-24T13:32:51.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.423077+0000", 2024-04-24T13:32:51.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4432999999999999e-05 2024-04-24T13:32:51.003 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.003 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.003 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.003 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2245 3.1d 3:bb337c31:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_40:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.003 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:51.003 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.114185535000001, 2024-04-24T13:32:51.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020498309999999999, 2024-04-24T13:32:51.003 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.003 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.003 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.004 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.004 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.004 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.004 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2245 2024-04-24T13:32:51.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.004 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:51.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775505+0000", 2024-04-24T13:32:51.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.775508+0000", 2024-04-24T13:32:51.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.486e-06 2024-04-24T13:32:51.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779469+0000", 2024-04-24T13:32:51.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003961862 2024-04-24T13:32:51.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779497+0000", 2024-04-24T13:32:51.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7559000000000002e-05 2024-04-24T13:32:51.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779513+0000", 2024-04-24T13:32:51.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6450999999999999e-05 2024-04-24T13:32:51.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779626+0000", 2024-04-24T13:32:51.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000112478 2024-04-24T13:32:51.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779794+0000", 2024-04-24T13:32:51.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016824099999999999 2024-04-24T13:32:51.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:51.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.779922+0000", 2024-04-24T13:32:51.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012780199999999999 2024-04-24T13:32:51.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.793374+0000", 2024-04-24T13:32:51.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013451942 2024-04-24T13:32:51.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795894+0000", 2024-04-24T13:32:51.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025205079999999999 2024-04-24T13:32:51.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.795951+0000", 2024-04-24T13:32:51.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6131000000000002e-05 2024-04-24T13:32:51.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.796003+0000", 2024-04-24T13:32:51.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2849999999999997e-05 2024-04-24T13:32:51.009 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.009 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.009 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.009 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2248 3.1d 3:b991c377:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.010 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:51.010 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.084396271999999, 2024-04-24T13:32:51.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016320675999999999, 2024-04-24T13:32:51.010 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.010 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.010 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.010 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.010 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.010 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.010 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2248 2024-04-24T13:32:51.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.014 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:51.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805294+0000", 2024-04-24T13:32:51.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.805301+0000", 2024-04-24T13:32:51.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1399999999999997e-06 2024-04-24T13:32:51.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809310+0000", 2024-04-24T13:32:51.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040090179999999996 2024-04-24T13:32:51.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809337+0000", 2024-04-24T13:32:51.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7636000000000001e-05 2024-04-24T13:32:51.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809351+0000", 2024-04-24T13:32:51.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3728e-05 2024-04-24T13:32:51.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809435+0000", 2024-04-24T13:32:51.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3956999999999996e-05 2024-04-24T13:32:51.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809588+0000", 2024-04-24T13:32:51.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015312299999999999 2024-04-24T13:32:51.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:51.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.809713+0000", 2024-04-24T13:32:51.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012522299999999999 2024-04-24T13:32:51.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.815947+0000", 2024-04-24T13:32:51.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062333359999999999 2024-04-24T13:32:51.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821522+0000", 2024-04-24T13:32:51.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055754239999999998 2024-04-24T13:32:51.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821572+0000", 2024-04-24T13:32:51.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0005e-05 2024-04-24T13:32:51.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.019 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.019 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.821615+0000", 2024-04-24T13:32:51.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3086e-05 2024-04-24T13:32:51.019 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.019 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.019 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.020 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2250 3.3c 3:3d3fcdd2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.020 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:51.020 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.065631208999999, 2024-04-24T13:32:51.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018935203000000001, 2024-04-24T13:32:51.020 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.020 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.020 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.020 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.020 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.020 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2250 2024-04-24T13:32:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824059+0000", 2024-04-24T13:32:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.824061+0000", 2024-04-24T13:32:51.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.725e-06 2024-04-24T13:32:51.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827859+0000", 2024-04-24T13:32:51.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037982960000000001 2024-04-24T13:32:51.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827885+0000", 2024-04-24T13:32:51.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5761e-05 2024-04-24T13:32:51.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.827896+0000", 2024-04-24T13:32:51.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1136e-05 2024-04-24T13:32:51.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828017+0000", 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012102100000000001 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828290+0000", 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027271199999999999 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.828528+0000", 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023780599999999999 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.835369+0000", 2024-04-24T13:32:51.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068407609999999999 2024-04-24T13:32:51.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842842+0000", 2024-04-24T13:32:51.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074735390000000004 2024-04-24T13:32:51.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842928+0000", 2024-04-24T13:32:51.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5513999999999995e-05 2024-04-24T13:32:51.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.842995+0000", 2024-04-24T13:32:51.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6932000000000002e-05 2024-04-24T13:32:51.026 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.026 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.026 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.026 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2251 3.3a 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.026 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:51.027 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.054812963, 2024-04-24T13:32:51.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030524880000000001, 2024-04-24T13:32:51.027 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.027 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.027 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.027 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.027 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.027 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.027 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2251 2024-04-24T13:32:51.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.027 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:51.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:32:51.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834880+0000", 2024-04-24T13:32:51.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6769999999999999e-06 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839556+0000", 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046751350000000004 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839593+0000", 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7079999999999997e-05 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839617+0000", 2024-04-24T13:32:51.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4015999999999998e-05 2024-04-24T13:32:51.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839773+0000", 2024-04-24T13:32:51.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015627699999999999 2024-04-24T13:32:51.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.030 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.030 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840011+0000", 2024-04-24T13:32:51.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023843900000000001 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840261+0000", 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024939899999999997 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.853562+0000", 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013301726999999999 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865276+0000", 2024-04-24T13:32:51.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011713779000000001 2024-04-24T13:32:51.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865349+0000", 2024-04-24T13:32:51.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2624000000000001e-05 2024-04-24T13:32:51.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865403+0000", 2024-04-24T13:32:51.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3727000000000002e-05 2024-04-24T13:32:51.032 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.033 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.033 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.033 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.033 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.033 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:51.033 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:51.034 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:50.953+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:51.079 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:51.077+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:51.104 INFO:tasks.workunit.client.0.smithi071.stdout:Bucket Created: buck_2024_03_24_13_32_51 2024-04-24T13:32:51.159 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:51.157+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:51.161 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:51.161 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:51.161 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:51.161 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:51.175 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:51.262 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:51.261+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:51.351 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:51.351 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:51.351 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:51.351 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:51.351 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:51.360 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:51.357+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:51.366 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:51.370 INFO:tasks.workunit.client.0.smithi071.stdout:bucket quota max size set for the given user: buck_2024_03_24_13_32_51 2024-04-24T13:32:51.460 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:51.459+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:51.532 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:51.532 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:51.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:51.532 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:51.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.532 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:51.532 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:51.532 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 142.285979204, 2024-04-24T13:32:51.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:32:51.533 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.533 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.533 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.533 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:32:51.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.533 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:51.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:51.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:32:51.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:32:51.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:32:51.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:32:51.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:32:51.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:32:51.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:32:51.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:32:51.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:32:51.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:32:51.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:51.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:32:51.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:32:51.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:32:51.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:32:51.540 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.540 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.540 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.540 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1618 3.36 3:6e88aafa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:51.540 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:51.540 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.301203790999999, 2024-04-24T13:32:51.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025620654, 2024-04-24T13:32:51.540 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1618 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229083+0000", 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2100000000000002e-06 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234443+0000", 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053597139999999998 2024-04-24T13:32:51.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234484+0000", 2024-04-24T13:32:51.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0902999999999998e-05 2024-04-24T13:32:51.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234502+0000", 2024-04-24T13:32:51.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8252000000000001e-05 2024-04-24T13:32:51.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234657+0000", 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015551000000000001 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234920+0000", 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263114 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.236227+0000", 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001306179 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.251163+0000", 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014936766000000001 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254465+0000", 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003301151 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254581+0000", 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116224 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254700+0000", 2024-04-24T13:32:51.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011963099999999999 2024-04-24T13:32:51.546 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.546 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.546 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.546 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2207 3.38 e85/74 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:51.546 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:51.546 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.222261743000001, 2024-04-24T13:32:51.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015720683999999999, 2024-04-24T13:32:51.546 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.547 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.547 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.547 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:51.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:51.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308024+0000", 2024-04-24T13:32:51.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:32:51.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314047+0000", 2024-04-24T13:32:51.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060226259999999997 2024-04-24T13:32:51.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314095+0000", 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7803000000000003e-05 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314118+0000", 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3218999999999999e-05 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314281+0000", 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016252399999999999 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314321+0000", 2024-04-24T13:32:51.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0213000000000003e-05 2024-04-24T13:32:51.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.323647+0000", 2024-04-24T13:32:51.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093264079999999996 2024-04-24T13:32:51.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.323742+0000", 2024-04-24T13:32:51.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5198000000000006e-05 2024-04-24T13:32:51.550 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.551 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.551 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.551 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2209 3.14 e85/48 3:287cf44b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_4:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:51.551 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:51.551 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.190907982999999, 2024-04-24T13:32:51.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01556167, 2024-04-24T13:32:51.551 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.551 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.551 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.551 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0699999999999997e-07 2024-04-24T13:32:51.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344736+0000", 2024-04-24T13:32:51.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053602750000000003 2024-04-24T13:32:51.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344764+0000", 2024-04-24T13:32:51.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8033000000000001e-05 2024-04-24T13:32:51.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344779+0000", 2024-04-24T13:32:51.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4693e-05 2024-04-24T13:32:51.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344934+0000", 2024-04-24T13:32:51.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520399999999999 2024-04-24T13:32:51.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344975+0000", 2024-04-24T13:32:51.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0368999999999999e-05 2024-04-24T13:32:51.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354882+0000", 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099076630000000006 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354937+0000", 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4926000000000002e-05 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2221 3.26 3:67d4e534:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.015757163, 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017991152999999999, 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2221 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514529+0000", 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3080000000000002e-06 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519181+0000", 2024-04-24T13:32:51.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046525129999999996 2024-04-24T13:32:51.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519216+0000", 2024-04-24T13:32:51.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5181000000000001e-05 2024-04-24T13:32:51.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519228+0000", 2024-04-24T13:32:51.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1253000000000001e-05 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519324+0000", 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6564000000000006e-05 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519463+0000", 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139269 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:51.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519597+0000", 2024-04-24T13:32:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013386999999999999 2024-04-24T13:32:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532228+0000", 2024-04-24T13:32:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012631009 2024-04-24T13:32:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532440+0000", 2024-04-24T13:32:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021200400000000001 2024-04-24T13:32:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532479+0000", 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8668000000000003e-05 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532518+0000", 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8513999999999998e-05 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.561 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2224 3.2c 3:3671ead8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.985575678, 2024-04-24T13:32:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016019095000000001, 2024-04-24T13:32:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2224 2024-04-24T13:32:51.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.563 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:51.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:51.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544710+0000", 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5040000000000001e-06 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548580+0000", 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003869473 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548609+0000", 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9623000000000001e-05 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548623+0000", 2024-04-24T13:32:51.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3498e-05 2024-04-24T13:32:51.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548709+0000", 2024-04-24T13:32:51.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6390000000000005e-05 2024-04-24T13:32:51.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548989+0000", 2024-04-24T13:32:51.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027985500000000002 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549084+0000", 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4568999999999995e-05 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.559986+0000", 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010902692 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560649+0000", 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066290299999999995 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560687+0000", 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7644000000000001e-05 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560727+0000", 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9944000000000002e-05 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.568 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2231 3.36 3:6ddceaef:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.568 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:51.568 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.911370653999999, 2024-04-24T13:32:51.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017463218999999999, 2024-04-24T13:32:51.568 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.568 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.568 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.568 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.568 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.568 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.568 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2231 2024-04-24T13:32:51.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618915+0000", 2024-04-24T13:32:51.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5620000000000002e-06 2024-04-24T13:32:51.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622655+0000", 2024-04-24T13:32:51.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003739984 2024-04-24T13:32:51.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622683+0000", 2024-04-24T13:32:51.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7390999999999999e-05 2024-04-24T13:32:51.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622697+0000", 2024-04-24T13:32:51.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3694e-05 2024-04-24T13:32:51.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622795+0000", 2024-04-24T13:32:51.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8518999999999996e-05 2024-04-24T13:32:51.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.623022+0000", 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022680700000000001 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.623244+0000", 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022219199999999999 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634301+0000", 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011056718 2024-04-24T13:32:51.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636075+0000", 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001774437 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636243+0000", 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016734399999999999 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636376+0000", 2024-04-24T13:32:51.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000133571 2024-04-24T13:32:51.574 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.574 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.574 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.574 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2232 3.a 3:53fed644:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.574 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:51.574 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.899633626, 2024-04-24T13:32:51.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017222277000000001, 2024-04-24T13:32:51.574 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.574 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.574 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2232 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630652+0000", 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5119999999999998e-06 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634591+0000", 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039383990000000004 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634610+0000", 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9530000000000001e-05 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634620+0000", 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0081000000000001e-05 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634679+0000", 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8483999999999998e-05 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634807+0000", 2024-04-24T13:32:51.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012772 2024-04-24T13:32:51.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:51.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634918+0000", 2024-04-24T13:32:51.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011121 2024-04-24T13:32:51.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.641801+0000", 2024-04-24T13:32:51.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006883213 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647770+0000", 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059689729999999998 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647818+0000", 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8455000000000003e-05 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647872+0000", 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3699999999999997e-05 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2233 3.c e85/74 3:3257d695:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_28:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.886992643999999, 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015313149, 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.580 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643292+0000", 2024-04-24T13:32:51.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4980000000000001e-06 2024-04-24T13:32:51.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647384+0000", 2024-04-24T13:32:51.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040918980000000001 2024-04-24T13:32:51.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647409+0000", 2024-04-24T13:32:51.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4719000000000002e-05 2024-04-24T13:32:51.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647421+0000", 2024-04-24T13:32:51.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1956999999999999e-05 2024-04-24T13:32:51.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647575+0000", 2024-04-24T13:32:51.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015421900000000001 2024-04-24T13:32:51.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647642+0000", 2024-04-24T13:32:51.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6822000000000005e-05 2024-04-24T13:32:51.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.658477+0000", 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010835200999999999 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.658604+0000", 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126835 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2234 3.34 e85/20 3:2f41ca12:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_29:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.873267511000002, 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013995339000000001, 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657018+0000", 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0700000000000001e-06 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659913+0000", 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028946079999999999 2024-04-24T13:32:51.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659934+0000", 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1154000000000001e-05 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659946+0000", 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1958e-05 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.660012+0000", 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5870000000000005e-05 2024-04-24T13:32:51.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.660041+0000", 2024-04-24T13:32:51.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9280000000000001e-05 2024-04-24T13:32:51.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.670873+0000", 2024-04-24T13:32:51.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010831591999999999 2024-04-24T13:32:51.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671011+0000", 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013880699999999999 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2238 3.20 3:07ab05cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.83154094, 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019528604000000001, 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.589 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.590 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.590 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.590 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2238 2024-04-24T13:32:51.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.590 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:51.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:51.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698745+0000", 2024-04-24T13:32:51.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-24T13:32:51.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.591 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.591 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702722+0000", 2024-04-24T13:32:51.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039764370000000002 2024-04-24T13:32:51.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702755+0000", 2024-04-24T13:32:51.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3676000000000001e-05 2024-04-24T13:32:51.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702771+0000", 2024-04-24T13:32:51.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5823000000000001e-05 2024-04-24T13:32:51.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702854+0000", 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2804000000000002e-05 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702974+0000", 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120258 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.703104+0000", 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129708 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.710231+0000", 2024-04-24T13:32:51.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071274570000000002 2024-04-24T13:32:51.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718023+0000", 2024-04-24T13:32:51.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077912720000000001 2024-04-24T13:32:51.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718164+0000", 2024-04-24T13:32:51.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014127500000000001 2024-04-24T13:32:51.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718271+0000", 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107371 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2240 3.3f 3:fe4f476b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.810991470000001, 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014610142, 2024-04-24T13:32:51.595 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2240 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719294+0000", 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0770000000000002e-06 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723057+0000", 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037627060000000002 2024-04-24T13:32:51.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723089+0000", 2024-04-24T13:32:51.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1968999999999998e-05 2024-04-24T13:32:51.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723100+0000", 2024-04-24T13:32:51.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0695e-05 2024-04-24T13:32:51.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723176+0000", 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6589999999999997e-05 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723313+0000", 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136806 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723434+0000", 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120835 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.727850+0000", 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044163229999999998 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733804+0000", 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059542620000000001 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733849+0000", 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4455e-05 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733902+0000", 2024-04-24T13:32:51.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3424000000000002e-05 2024-04-24T13:32:51.601 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.601 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.601 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.601 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2247 3.2a 3:56a679bb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.601 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:51.601 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.73541329, 2024-04-24T13:32:51.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018867848, 2024-04-24T13:32:51.601 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2247 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794873+0000", 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7130000000000001e-06 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799547+0000", 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004674114 2024-04-24T13:32:51.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799586+0000", 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9279999999999997e-05 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799613+0000", 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6239000000000001e-05 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799734+0000", 2024-04-24T13:32:51.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120964 2024-04-24T13:32:51.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799986+0000", 2024-04-24T13:32:51.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025243200000000003 2024-04-24T13:32:51.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:51.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.800155+0000", 2024-04-24T13:32:51.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016893400000000001 2024-04-24T13:32:51.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.806810+0000", 2024-04-24T13:32:51.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066547459999999996 2024-04-24T13:32:51.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813614+0000", 2024-04-24T13:32:51.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068047730000000001 2024-04-24T13:32:51.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813684+0000", 2024-04-24T13:32:51.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9504000000000004e-05 2024-04-24T13:32:51.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813738+0000", 2024-04-24T13:32:51.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4148999999999999e-05 2024-04-24T13:32:51.608 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.608 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.608 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.608 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2254 3.20 3:079960b7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.608 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:51.608 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.662030339000001, 2024-04-24T13:32:51.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019983331, 2024-04-24T13:32:51.608 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2254 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:51.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868256+0000", 2024-04-24T13:32:51.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8890000000000002e-06 2024-04-24T13:32:51.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872066+0000", 2024-04-24T13:32:51.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038094549999999998 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872090+0000", 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4933e-05 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872104+0000", 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3246e-05 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872222+0000", 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118266 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872485+0000", 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026320500000000003 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872713+0000", 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022758000000000001 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881332+0000", 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086188640000000004 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.887928+0000", 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065959490000000003 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.888112+0000", 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018435700000000001 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.888237+0000", 2024-04-24T13:32:51.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012458700000000001 2024-04-24T13:32:51.614 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.614 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.614 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.614 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2256 3.21 e85/74 3:878222a6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_51:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:51.614 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:51.614 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.637932914, 2024-04-24T13:32:51.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013390116000000001, 2024-04-24T13:32:51.614 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892353+0000", 2024-04-24T13:32:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5629999999999999e-06 2024-04-24T13:32:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896496+0000", 2024-04-24T13:32:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041424840000000001 2024-04-24T13:32:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896531+0000", 2024-04-24T13:32:51.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5682999999999997e-05 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896549+0000", 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7909000000000001e-05 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896687+0000", 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013818200000000001 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896723+0000", 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5194999999999998e-05 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.905615+0000", 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088924759999999999 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.905741+0000", 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012562399999999999 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.618 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2263 3.26 3:64e2178e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.562395842000001, 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014626548, 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2263 2024-04-24T13:32:51.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.620 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:51.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:51.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967890+0000", 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9470000000000002e-06 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971675+0000", 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037854350000000002 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971700+0000", 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4678e-05 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971710+0000", 2024-04-24T13:32:51.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0059e-05 2024-04-24T13:32:51.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971802+0000", 2024-04-24T13:32:51.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2118000000000001e-05 2024-04-24T13:32:51.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971952+0000", 2024-04-24T13:32:51.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015013599999999999 2024-04-24T13:32:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.972085+0000", 2024-04-24T13:32:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132946 2024-04-24T13:32:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.981987+0000", 2024-04-24T13:32:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099020819999999996 2024-04-24T13:32:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982408+0000", 2024-04-24T13:32:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042130500000000002 2024-04-24T13:32:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982466+0000", 2024-04-24T13:32:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7629e-05 2024-04-24T13:32:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982514+0000", 2024-04-24T13:32:51.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8213000000000001e-05 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2267 3.3f 3:fe72662d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.515186744000001, 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018629916999999999, 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.625 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.626 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.626 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2267 2024-04-24T13:32:51.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.626 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:51.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015099+0000", 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2199999999999999e-06 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018921+0000", 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038224579999999999 2024-04-24T13:32:51.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018941+0000", 2024-04-24T13:32:51.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9945999999999998e-05 2024-04-24T13:32:51.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018952+0000", 2024-04-24T13:32:51.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0361e-05 2024-04-24T13:32:51.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019017+0000", 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5068999999999997e-05 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019148+0000", 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013165299999999999 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019247+0000", 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.87e-05 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.025115+0000", 2024-04-24T13:32:51.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058674909999999999 2024-04-24T13:32:51.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033545+0000", 2024-04-24T13:32:51.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084303639999999992 2024-04-24T13:32:51.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033659+0000", 2024-04-24T13:32:51.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114131 2024-04-24T13:32:51.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033727+0000", 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7523999999999999e-05 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2269 3.38 e85/74 3:1d70d2f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_64:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.491933298999999, 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013439965, 2024-04-24T13:32:51.631 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038352+0000", 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4500000000000001e-06 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042479+0000", 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041270819999999998 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042517+0000", 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8550000000000002e-05 2024-04-24T13:32:51.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042535+0000", 2024-04-24T13:32:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8093000000000001e-05 2024-04-24T13:32:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042678+0000", 2024-04-24T13:32:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014304399999999999 2024-04-24T13:32:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042722+0000", 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3179000000000001e-05 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051734+0000", 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0090125280000000006 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051790+0000", 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6039000000000003e-05 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.635 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.636 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2270 3.a 3:52207169:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.636 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:51.636 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.483528838000002, 2024-04-24T13:32:51.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014332798000000001, 2024-04-24T13:32:51.636 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.636 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.636 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.636 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.636 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.636 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.636 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2270 2024-04-24T13:32:51.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.637 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:51.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:51.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046757+0000", 2024-04-24T13:32:51.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2450000000000001e-06 2024-04-24T13:32:51.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050608+0000", 2024-04-24T13:32:51.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038509949999999999 2024-04-24T13:32:51.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050632+0000", 2024-04-24T13:32:51.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4450000000000001e-05 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050646+0000", 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3273e-05 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050743+0000", 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7190999999999998e-05 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050918+0000", 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017516600000000001 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051100+0000", 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018168700000000001 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.055983+0000", 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048829379999999999 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060902+0000", 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049192430000000002 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.061003+0000", 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101351 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.061087+0000", 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4258999999999994e-05 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.641 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.642 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.642 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2279 3.2a 3:57162c53:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:51.642 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:51.642 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 22.389885160999999, 2024-04-24T13:32:51.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016593472000000001, 2024-04-24T13:32:51.642 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:51.642 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:51.642 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:51.642 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:51.642 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:51.642 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2279 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:51.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140401+0000", 2024-04-24T13:32:51.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5950000000000001e-06 2024-04-24T13:32:51.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:51.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144257+0000", 2024-04-24T13:32:51.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038560869999999998 2024-04-24T13:32:51.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:51.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144277+0000", 2024-04-24T13:32:51.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9976e-05 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144288+0000", 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.059e-05 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144359+0000", 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1550000000000004e-05 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:51.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144501+0000", 2024-04-24T13:32:51.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014193499999999999 2024-04-24T13:32:51.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:51.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144633+0000", 2024-04-24T13:32:51.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131748 2024-04-24T13:32:51.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:51.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.148819+0000", 2024-04-24T13:32:51.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041860140000000001 2024-04-24T13:32:51.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:51.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156831+0000", 2024-04-24T13:32:51.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080120120000000006 2024-04-24T13:32:51.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156920+0000", 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9112999999999999e-05 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156992+0000", 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1852000000000003e-05 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:51.651 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:51.652 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:51.654 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:51.655 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:51.649+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:51.754 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:51.751+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:51.825 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:51.825 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:51.825 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:51.825 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:51.839 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:32:51.854 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:51.855+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:51.955 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:51.955+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:51.956 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:51.956 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:51.956 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:51.956 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:51.956 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:51.972 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:32:52.056 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:52.053+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:52.093 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:32:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.23357616000001, 2024-04-24T13:32:52.093 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:32:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:32:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:32:52.094 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.095 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.096 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.097 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:32:52.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:32:52.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:32:52.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:32:52.098 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.098 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.098 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.098 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:32:52.098 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.23355338600001, 2024-04-24T13:32:52.099 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.100 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:32:52.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:32:52.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:32:52.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:32:52.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:32:52.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:32:52.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:32:52.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:32:52.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:32:52.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:32:52.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:32:52.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.135945953, 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:32:52.105 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.106 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.106 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.106 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.106 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.106 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.106 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:32:52.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.106 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:32:52.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:32:52.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:32:52.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:32:52.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:32:52.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:32:52.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:32:52.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:32:52.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:32:52.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:32:52.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:32:52.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:32:52.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:32:52.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:32:52.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:32:52.111 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.135858316, 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:32:52.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.114 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:32:52.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:32:52.117 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.117 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.117 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.117 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.117 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:32:52.117 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.03020442900001, 2024-04-24T13:32:52.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:32:52.117 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:32:52.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:32:52.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.122 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:32:52.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:32:52.123 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.123 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.123 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.123 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.123 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:32:52.123 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.029999911, 2024-04-24T13:32:52.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:32:52.123 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.123 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:32:52.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:32:52.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.02964008800001, 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.129 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:32:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:32:52.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:32:52.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:32:52.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:32:52.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:32:52.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:32:52.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:32:52.134 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.134 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.029471685, 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.135 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:32:52.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:32:52.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:32:52.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:32:52.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:32:52.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:32:52.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:32:52.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.029263294, 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.141 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:32:52.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:32:52.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:32:52.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:32:52.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:32:52.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:32:52.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:32:52.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:32:52.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:32:52.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:32:52.146 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.146 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.146 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.029165441, 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:32:52.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:32:52.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:32:52.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:32:52.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:32:52.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:32:52.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:32:52.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:32:52.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:32:52.152 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.152 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.152 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.152 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.152 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:32:52.152 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.02906429199999, 2024-04-24T13:32:52.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:32:52.153 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.153 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.153 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.153 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.153 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.153 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.153 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:32:52.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.153 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:32:52.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:32:52.158 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.158 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.158 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.158 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.158 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:32:52.158 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.02880758000001, 2024-04-24T13:32:52.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:32:52.158 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.159 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.159 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.159 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.159 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.159 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.159 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:32:52.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.159 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:32:52.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:32:52.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:32:52.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:32:52.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:32:52.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:32:52.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:32:52.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.02869791800001, 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.164 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:32:52.169 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.02862588900001, 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.170 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.171 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:32:52.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.171 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:32:52.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:32:52.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:32:52.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:32:52.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:32:52.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:32:52.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:32:52.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:32:52.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:32:52.175 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.028454853, 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.176 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.177 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:32:52.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.177 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:32:52.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:32:52.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:32:52.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:32:52.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:32:52.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:32:52.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:32:52.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:32:52.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:32:52.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:32:52.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:32:52.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:32:52.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:32:52.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:32:52.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:32:52.182 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.182 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.182 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.182 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.182 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:32:52.182 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 163.02841536, 2024-04-24T13:32:52.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:32:52.182 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.182 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.182 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.182 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.183 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.183 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:32:52.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.183 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:32:52.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:32:52.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:32:52.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:32:52.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:32:52.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:32:52.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:32:52.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:32:52.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:32:52.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.188 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 162.775096104, 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:32:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:32:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:32:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:32:52.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:32:52.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:32:52.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:32:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:32:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:32:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:32:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:32:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.194 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.195 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:32:52.195 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 162.775070056, 2024-04-24T13:32:52.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:32:52.195 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.195 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.195 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.195 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.195 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.195 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.195 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:32:52.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.195 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:32:52.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:32:52.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:32:52.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:32:52.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:32:52.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:32:52.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:32:52.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:32:52.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:32:52.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:32:52.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:32:52.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:32:52.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:32:52.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 162.7750447, 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:32:52.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:32:52.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:32:52.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:32:52.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:32:52.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:32:52.206 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.206 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.206 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.206 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 162.77495363099999, 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:52.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:32:52.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:32:52.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:52.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:32:52.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:32:52.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:32:52.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:32:52.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:52.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:32:52.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:32:52.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:52.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:32:52.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:32:52.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:52.212 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:52.214 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:32:52.215 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:52.211+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:52.315 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:52.313+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:52.334 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:52.335 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:52.335 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:52.335 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:52.348 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:32:52.416 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:52.413+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:52.465 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:52.465 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:52.465 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:52.465 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:52.465 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:52.479 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:32:52.517 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:52.517+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:52.600 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:32:52.601 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:32:52.612 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:52.612 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:52.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:52.612 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:52.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.612 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2206 3.f e85/48 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:52.612 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:32:52.612 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.313596273999998, 2024-04-24T13:32:52.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022785151, 2024-04-24T13:32:52.612 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.613 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.613 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.613 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:32:52.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:32:52.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295567+0000", 2024-04-24T13:32:52.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3939999999999999e-06 2024-04-24T13:32:52.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299770+0000", 2024-04-24T13:32:52.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042038029999999999 2024-04-24T13:32:52.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299808+0000", 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7703000000000001e-05 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299826+0000", 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8142999999999999e-05 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299972+0000", 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000146095 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.300023+0000", 2024-04-24T13:32:52.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0294999999999999e-05 2024-04-24T13:32:52.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318209+0000", 2024-04-24T13:32:52.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018186099000000001 2024-04-24T13:32:52.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318349+0000", 2024-04-24T13:32:52.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140619 2024-04-24T13:32:52.617 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.617 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.617 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.617 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2210 3.23 3:c462163d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:52.617 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.355657+0000", 2024-04-24T13:32:52.617 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.253503468000002, 2024-04-24T13:32:52.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018889975999999999, 2024-04-24T13:32:52.617 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.617 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.617 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.617 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:52.618 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:52.618 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:52.618 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2210 2024-04-24T13:32:52.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.618 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.355657+0000", 2024-04-24T13:32:52.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.618 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.618 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.355657+0000", 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.355661+0000", 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.517e-06 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358401+0000", 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027400219999999999 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358440+0000", 2024-04-24T13:32:52.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9348999999999999e-05 2024-04-24T13:32:52.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358466+0000", 2024-04-24T13:32:52.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.561e-05 2024-04-24T13:32:52.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358635+0000", 2024-04-24T13:32:52.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016971799999999999 2024-04-24T13:32:52.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358913+0000", 2024-04-24T13:32:52.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027758600000000002 2024-04-24T13:32:52.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:52.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.359151+0000", 2024-04-24T13:32:52.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023834999999999999 2024-04-24T13:32:52.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374171+0000", 2024-04-24T13:32:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015020179 2024-04-24T13:32:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374235+0000", 2024-04-24T13:32:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3862000000000006e-05 2024-04-24T13:32:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374415+0000", 2024-04-24T13:32:52.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000179758 2024-04-24T13:32:52.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374547+0000", 2024-04-24T13:32:52.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000132025 2024-04-24T13:32:52.623 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.623 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.623 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.623 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2212 3.3a e85/20 3:5de7fd4f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_7:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:52.623 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.406594+0000", 2024-04-24T13:32:52.623 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.202566061999999, 2024-04-24T13:32:52.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016608241999999999, 2024-04-24T13:32:52.624 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.624 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.624 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.624 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.406594+0000", 2024-04-24T13:32:52.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.406594+0000", 2024-04-24T13:32:52.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.406597+0000", 2024-04-24T13:32:52.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8260000000000001e-06 2024-04-24T13:32:52.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412366+0000", 2024-04-24T13:32:52.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057682439999999996 2024-04-24T13:32:52.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412410+0000", 2024-04-24T13:32:52.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4656000000000001e-05 2024-04-24T13:32:52.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412432+0000", 2024-04-24T13:32:52.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1971e-05 2024-04-24T13:32:52.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412637+0000", 2024-04-24T13:32:52.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020509900000000001 2024-04-24T13:32:52.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412680+0000", 2024-04-24T13:32:52.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2326000000000001e-05 2024-04-24T13:32:52.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.423087+0000", 2024-04-24T13:32:52.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010407533 2024-04-24T13:32:52.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.423203+0000", 2024-04-24T13:32:52.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115587 2024-04-24T13:32:52.628 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.628 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.628 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.628 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2215 3.23 3:c703bbd7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:52.628 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.451222+0000", 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.157939044999999, 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016321080000000002, 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2215 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.451222+0000", 2024-04-24T13:32:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.451222+0000", 2024-04-24T13:32:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.451225+0000", 2024-04-24T13:32:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4199999999999999e-06 2024-04-24T13:32:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453253+0000", 2024-04-24T13:32:52.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020277300000000002 2024-04-24T13:32:52.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453279+0000", 2024-04-24T13:32:52.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6684000000000001e-05 2024-04-24T13:32:52.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453292+0000", 2024-04-24T13:32:52.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3016999999999999e-05 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453382+0000", 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9310999999999999e-05 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453520+0000", 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013785300000000001 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:52.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453651+0000", 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000131497 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467323+0000", 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013671513999999999 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467428+0000", 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105499 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467488+0000", 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0075999999999999e-05 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467543+0000", 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4478999999999998e-05 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2216 3.3d 3:bf22edaf:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:52.634 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:32:52.635 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.147843262999999, 2024-04-24T13:32:52.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027972988000000001, 2024-04-24T13:32:52.635 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.635 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.635 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.635 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:52.635 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:52.635 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:52.635 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2216 2024-04-24T13:32:52.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.635 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461320+0000", 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7049999999999999e-06 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462822+0000", 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015018919999999999 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462846+0000", 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4229000000000001e-05 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462856+0000", 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8619999999999998e-06 2024-04-24T13:32:52.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462932+0000", 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6126999999999998e-05 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463098+0000", 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016631400000000001 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463231+0000", 2024-04-24T13:32:52.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013278699999999999 2024-04-24T13:32:52.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:52.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475573+0000", 2024-04-24T13:32:52.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012342148000000001 2024-04-24T13:32:52.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489102+0000", 2024-04-24T13:32:52.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013528755 2024-04-24T13:32:52.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489210+0000", 2024-04-24T13:32:52.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010779400000000001 2024-04-24T13:32:52.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489290+0000", 2024-04-24T13:32:52.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0375000000000002e-05 2024-04-24T13:32:52.640 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.640 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.640 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.640 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2217 3.7 e85/41 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.135433920000001, 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022815940999999999, 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473728+0000", 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6080000000000001e-06 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475783+0000", 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002054349 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475801+0000", 2024-04-24T13:32:52.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8054e-05 2024-04-24T13:32:52.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475814+0000", 2024-04-24T13:32:52.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3515e-05 2024-04-24T13:32:52.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488934+0000", 2024-04-24T13:32:52.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013119772 2024-04-24T13:32:52.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488977+0000", 2024-04-24T13:32:52.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2922e-05 2024-04-24T13:32:52.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496474+0000", 2024-04-24T13:32:52.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074975320000000003 2024-04-24T13:32:52.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496543+0000", 2024-04-24T13:32:52.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8188999999999994e-05 2024-04-24T13:32:52.647 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop_reply(client.4385.0:2216 3.3d e85/20 ondisk, result = 0)", 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.475903+0000", 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.133257226000001, 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013396491, 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475903+0000", 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475903+0000", 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475904+0000", 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6700000000000002e-07 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475909+0000", 2024-04-24T13:32:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0660000000000003e-06 2024-04-24T13:32:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488939+0000", 2024-04-24T13:32:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013029850000000001 2024-04-24T13:32:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488960+0000", 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1185000000000001e-05 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489075+0000", 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114324 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489094+0000", 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9449e-05 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489300+0000", 2024-04-24T13:32:52.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020565000000000001 2024-04-24T13:32:52.652 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.652 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.652 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.652 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2220 3.1b 3:da538345:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:52.652 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.502923+0000", 2024-04-24T13:32:52.652 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.106237317000001, 2024-04-24T13:32:52.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012431563, 2024-04-24T13:32:52.652 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.652 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.652 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.653 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:52.653 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:52.653 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:52.653 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2220 2024-04-24T13:32:52.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.653 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.502923+0000", 2024-04-24T13:32:52.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.502923+0000", 2024-04-24T13:32:52.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.502926+0000", 2024-04-24T13:32:52.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6589999999999999e-06 2024-04-24T13:32:52.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504795+0000", 2024-04-24T13:32:52.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018686810000000001 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504827+0000", 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.243e-05 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504840+0000", 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3329999999999999e-05 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504915+0000", 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4484e-05 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.505074+0000", 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158913 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.505171+0000", 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7263999999999996e-05 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.510540+0000", 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053688659999999999 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.515256+0000", 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047159009999999998 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.515302+0000", 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6230000000000003e-05 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.515355+0000", 2024-04-24T13:32:52.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2805e-05 2024-04-24T13:32:52.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.658 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.658 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2225 3.23 3:c532fe0d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:52.658 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.555517+0000", 2024-04-24T13:32:52.658 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.053643705999999, 2024-04-24T13:32:52.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015590068, 2024-04-24T13:32:52.658 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2225 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.555517+0000", 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.555517+0000", 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.555519+0000", 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1289999999999999e-06 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557097+0000", 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001577813 2024-04-24T13:32:52.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557130+0000", 2024-04-24T13:32:52.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3290999999999997e-05 2024-04-24T13:32:52.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557146+0000", 2024-04-24T13:32:52.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6030000000000001e-05 2024-04-24T13:32:52.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557267+0000", 2024-04-24T13:32:52.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012072 2024-04-24T13:32:52.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557381+0000", 2024-04-24T13:32:52.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114648 2024-04-24T13:32:52.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:52.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557501+0000", 2024-04-24T13:32:52.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119775 2024-04-24T13:32:52.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.569052+0000", 2024-04-24T13:32:52.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011551074 2024-04-24T13:32:52.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:52.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.570970+0000", 2024-04-24T13:32:52.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019174719999999999 2024-04-24T13:32:52.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.571039+0000", 2024-04-24T13:32:52.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9556999999999998e-05 2024-04-24T13:32:52.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.571107+0000", 2024-04-24T13:32:52.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7558999999999995e-05 2024-04-24T13:32:52.664 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.664 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.664 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.664 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2226 3.1b 3:dbfdc3e7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:52.664 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.566142+0000", 2024-04-24T13:32:52.664 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.043018152999998, 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013010147999999999, 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2226 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.566142+0000", 2024-04-24T13:32:52.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.566142+0000", 2024-04-24T13:32:52.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.566145+0000", 2024-04-24T13:32:52.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9399999999999998e-06 2024-04-24T13:32:52.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567556+0000", 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014105700000000001 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567583+0000", 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7039e-05 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567598+0000", 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4659e-05 2024-04-24T13:32:52.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567691+0000", 2024-04-24T13:32:52.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3346999999999999e-05 2024-04-24T13:32:52.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567862+0000", 2024-04-24T13:32:52.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017056100000000001 2024-04-24T13:32:52.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:52.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.568014+0000", 2024-04-24T13:32:52.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152311 2024-04-24T13:32:52.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:52.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.574588+0000", 2024-04-24T13:32:52.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065744899999999997 2024-04-24T13:32:52.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579073+0000", 2024-04-24T13:32:52.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044842220000000004 2024-04-24T13:32:52.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579117+0000", 2024-04-24T13:32:52.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4181000000000003e-05 2024-04-24T13:32:52.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579153+0000", 2024-04-24T13:32:52.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5828000000000003e-05 2024-04-24T13:32:52.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2229 3.39 3:9efe271b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.598350+0000", 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.01081099, 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013444141999999999, 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:52.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2229 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.598350+0000", 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.598350+0000", 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.598353+0000", 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3680000000000002e-06 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600329+0000", 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019763620000000002 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600346+0000", 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6606999999999999e-05 2024-04-24T13:32:52.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600356+0000", 2024-04-24T13:32:52.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7599999999999997e-06 2024-04-24T13:32:52.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600426+0000", 2024-04-24T13:32:52.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0476999999999996e-05 2024-04-24T13:32:52.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600552+0000", 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012618699999999999 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600638+0000", 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6020999999999995e-05 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.606922+0000", 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062841049999999999 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.611633+0000", 2024-04-24T13:32:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047101690000000002 2024-04-24T13:32:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.611729+0000", 2024-04-24T13:32:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6557000000000004e-05 2024-04-24T13:32:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.611794+0000", 2024-04-24T13:32:52.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4529000000000005e-05 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2236 3.37 3:ee852927:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.678352+0000", 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.930808636999998, 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017640311999999998, 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:52.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2236 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.678352+0000", 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.678352+0000", 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.678355+0000", 2024-04-24T13:32:52.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0699999999999998e-06 2024-04-24T13:32:52.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681073+0000", 2024-04-24T13:32:52.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027178359999999999 2024-04-24T13:32:52.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681114+0000", 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0695000000000003e-05 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681132+0000", 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8601999999999999e-05 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681219+0000", 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6773000000000004e-05 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681393+0000", 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174227 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681540+0000", 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014642799999999999 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692163+0000", 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010623873000000001 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.695844+0000", 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036807739999999999 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.695924+0000", 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9967000000000002e-05 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.695992+0000", 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8066999999999997e-05 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.682 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.683 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2238 3.20 e85/20 3:07ab05cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_33:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:52.683 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.703968+0000", 2024-04-24T13:32:52.683 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.905192478, 2024-04-24T13:32:52.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014394229, 2024-04-24T13:32:52.683 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.683 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.683 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.703968+0000", 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.703968+0000", 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.703970+0000", 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8369999999999999e-06 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708553+0000", 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045833100000000002 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708574+0000", 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0548999999999999e-05 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708586+0000", 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1861e-05 2024-04-24T13:32:52.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708652+0000", 2024-04-24T13:32:52.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6321000000000004e-05 2024-04-24T13:32:52.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708675+0000", 2024-04-24T13:32:52.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2849000000000001e-05 2024-04-24T13:32:52.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.718318+0000", 2024-04-24T13:32:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.009642856 2024-04-24T13:32:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.718362+0000", 2024-04-24T13:32:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4645999999999999e-05 2024-04-24T13:32:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2241 3.23 3:c5282e4b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:52.687 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.729720+0000", 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.879440287000001, 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012358245, 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2241 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.729720+0000", 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.729720+0000", 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.729724+0000", 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8190000000000002e-06 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732683+0000", 2024-04-24T13:32:52.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029589490000000002 2024-04-24T13:32:52.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732712+0000", 2024-04-24T13:32:52.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8924e-05 2024-04-24T13:32:52.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732727+0000", 2024-04-24T13:32:52.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5537e-05 2024-04-24T13:32:52.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732814+0000", 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6144999999999996e-05 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732956+0000", 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014276299999999999 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.733063+0000", 2024-04-24T13:32:52.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106393 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741648+0000", 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085851190000000004 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741977+0000", 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032933000000000002 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742038+0000", 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1134000000000001e-05 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742079+0000", 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0132000000000001e-05 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2249 3.1f 3:fad54725:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.815100+0000", 2024-04-24T13:32:52.693 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.794060371, 2024-04-24T13:32:52.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013270862, 2024-04-24T13:32:52.694 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.694 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.694 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:52.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:52.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:52.694 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2249 2024-04-24T13:32:52.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.694 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.815100+0000", 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.815100+0000", 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.815103+0000", 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0189999999999998e-06 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816657+0000", 2024-04-24T13:32:52.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015535029999999999 2024-04-24T13:32:52.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816684+0000", 2024-04-24T13:32:52.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6956000000000001e-05 2024-04-24T13:32:52.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816695+0000", 2024-04-24T13:32:52.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1681e-05 2024-04-24T13:32:52.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816785+0000", 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9753999999999995e-05 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816960+0000", 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017443600000000001 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.817127+0000", 2024-04-24T13:32:52.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016774499999999999 2024-04-24T13:32:52.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:52.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.827609+0000", 2024-04-24T13:32:52.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01048137 2024-04-24T13:32:52.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828263+0000", 2024-04-24T13:32:52.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000654746 2024-04-24T13:32:52.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828309+0000", 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6102e-05 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828371+0000", 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1550000000000005e-05 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2251 3.3a e85/20 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head v 85'3, mlcod=81'1)", 2024-04-24T13:32:52.699 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.767934244999999, 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024431608, 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:32:52.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841228+0000", 2024-04-24T13:32:52.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.781e-06 2024-04-24T13:32:52.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846614+0000", 2024-04-24T13:32:52.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053854419999999998 2024-04-24T13:32:52.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846650+0000", 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6133000000000001e-05 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846669+0000", 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9199e-05 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846763+0000", 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4335999999999999e-05 2024-04-24T13:32:52.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846799+0000", 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5796000000000001e-05 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865616+0000", 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018816825999999998 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865658+0000", 2024-04-24T13:32:52.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2095000000000003e-05 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2254 3.20 e85/20 3:079960b7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_49:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.873589+0000", 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.735571806999999, 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014660608, 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.873589+0000", 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.873589+0000", 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.873590+0000", 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5069999999999999e-06 2024-04-24T13:32:52.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877724+0000", 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041334249999999996 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877754+0000", 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9960000000000001e-05 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877766+0000", 2024-04-24T13:32:52.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2115e-05 2024-04-24T13:32:52.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877845+0000", 2024-04-24T13:32:52.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8988999999999999e-05 2024-04-24T13:32:52.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877874+0000", 2024-04-24T13:32:52.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9329999999999999e-05 2024-04-24T13:32:52.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.888153+0000", 2024-04-24T13:32:52.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010279104000000001 2024-04-24T13:32:52.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.888249+0000", 2024-04-24T13:32:52.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6178e-05 2024-04-24T13:32:52.708 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.708 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.708 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.708 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2257 3.2b 3:d53685f1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.901887+0000", 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.707273999000002, 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012527972, 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2257 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.901887+0000", 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.901887+0000", 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.901889+0000", 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.509e-06 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903738+0000", 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001848969 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903768+0000", 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0088000000000001e-05 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903791+0000", 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2932e-05 2024-04-24T13:32:52.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903872+0000", 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1304000000000006e-05 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.904052+0000", 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018003999999999999 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.904226+0000", 2024-04-24T13:32:52.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017409500000000001 2024-04-24T13:32:52.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:52.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.909209+0000", 2024-04-24T13:32:52.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049826030000000004 2024-04-24T13:32:52.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914239+0000", 2024-04-24T13:32:52.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050297759999999997 2024-04-24T13:32:52.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914336+0000", 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7233999999999998e-05 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914415+0000", 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8422000000000002e-05 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2260 3.2b 3:d45c7bdc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:52.714 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.936956+0000", 2024-04-24T13:32:52.715 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.672204175000001, 2024-04-24T13:32:52.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011846031, 2024-04-24T13:32:52.715 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.715 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:52.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:52.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:52.715 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2260 2024-04-24T13:32:52.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.715 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.936956+0000", 2024-04-24T13:32:52.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.936956+0000", 2024-04-24T13:32:52.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.936959+0000", 2024-04-24T13:32:52.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1020000000000001e-06 2024-04-24T13:32:52.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938499+0000", 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015395369999999999 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938536+0000", 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6514000000000003e-05 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938552+0000", 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6758000000000001e-05 2024-04-24T13:32:52.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938657+0000", 2024-04-24T13:32:52.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104491 2024-04-24T13:32:52.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938840+0000", 2024-04-24T13:32:52.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018292199999999999 2024-04-24T13:32:52.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:52.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.939014+0000", 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174072 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.944477+0000", 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054635380000000004 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948667+0000", 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041893970000000001 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948741+0000", 2024-04-24T13:32:52.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4612999999999999e-05 2024-04-24T13:32:52.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948802+0000", 2024-04-24T13:32:52.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1087000000000007e-05 2024-04-24T13:32:52.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.720 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.720 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2264 3.18 e85/20 3:1be64b04:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_59:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.983667+0000", 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.625493181, 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011049814999999999, 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983667+0000", 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983667+0000", 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983683+0000", 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5894999999999999e-05 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985777+0000", 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020935950000000002 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:52.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985806+0000", 2024-04-24T13:32:52.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9274000000000001e-05 2024-04-24T13:32:52.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:52.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985820+0000", 2024-04-24T13:32:52.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4059e-05 2024-04-24T13:32:52.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:52.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985906+0000", 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5333000000000004e-05 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985937+0000", 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1636e-05 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994652+0000", 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.008714655 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:52.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:52.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994717+0000", 2024-04-24T13:32:52.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5368000000000002e-05 2024-04-24T13:32:52.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.725 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:52.725 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:52.725 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:52.727 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:32:52.727 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:52.725+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:52.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:52.737 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:52.753 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:52.753 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:52.770 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:52.770 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:52.786 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:52.786 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:52.807 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:52.807 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:52.827 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:52.828 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:52.828 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:52.825+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:52.848 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:52.848 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:52.849 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:52.850 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:52.863 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:32:52.869 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:52.869 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:52.930 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:52.931+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:52.977 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:52.978 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:52.990 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:32:53.029 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:53.025+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:53.131 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:53.129+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:53.146 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:53.146 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:53.159 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:32:53.231 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:53.229+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:53.276 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:53.276 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:53.289 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:32:53.334 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:53.335+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:53.406 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:53.406 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:53.419 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:32:53.462 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:53.463+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:53.534 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:53.531+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:53.551 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:32:53.582 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:53.582 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:53.594 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:53.638 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:53.639+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:53.736 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:53.735+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:53.762 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:53.762 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:53.775 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:53.863 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:53.863+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:53.933 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:53.933 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:53.938 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:53.937+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:53.946 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:54.039 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:54.037+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:54.111 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:54.111 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:54.125 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:54.170 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:54.169+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:54.240 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:54.239+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:54.256 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:54.256 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:54.270 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:54.342 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:54.339+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:54.436 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:54.436 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:54.442 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:54.437+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:54.450 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:54.542 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:54.543+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:54.618 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:54.619 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:54.633 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:54.678 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:54.677+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:54.745 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:54.741+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:54.757 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:54.757 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:54.771 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:54.845 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:54.843+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:54.887 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:32:54.930 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:54.931 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:54.945 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:54.946 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:54.945+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:55.025 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:55.025 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:55.041 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:55.041 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:55.047 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:55.047+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:55.059 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:55.059 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:55.065 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:55.065 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:55.077 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:55.077 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:55.080 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:55.095 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:55.095 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:55.112 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:55.112 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:55.129 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:55.130 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:55.147 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:55.147 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:55.148 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:55.147+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:55.206 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:55.207 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:55.207 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:55.207 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:55.221 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:55.270 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:55.269+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:55.343 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:55.343 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:55.343 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:55.343 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:55.343 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:55.350 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:55.345+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:55.357 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:55.451 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:55.451+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:55.482 INFO:tasks.workunit.client.0.smithi071.stdout:quota enabled for the bucket: buck_2024_03_24_13_32_51 2024-04-24T13:32:55.482 INFO:tasks.workunit.client.0.smithi071.stdout:adding file to bucket: 2Gb. 2024-04-24T13:32:55.482 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:55.483 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - set max size for a given user and ensure that objects upload beyond max size is not entertained 2024-04-24T13:32:55.483 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:32:55.483 INFO:tasks.workunit.client.0.smithi071.stdout:delete objects successful 2024-04-24T13:32:55.523 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:55.523 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:55.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:55.523 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:55.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 146.27543994499999, 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:32:55.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:32:55.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:32:55.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:32:55.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:32:55.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.530 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1618 3.36 3:6e88aafa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 37.290664532000001, 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025620654, 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1618 2024-04-24T13:32:55.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.532 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:55.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:55.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229083+0000", 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2100000000000002e-06 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234443+0000", 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053597139999999998 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234484+0000", 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0902999999999998e-05 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234502+0000", 2024-04-24T13:32:55.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8252000000000001e-05 2024-04-24T13:32:55.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234657+0000", 2024-04-24T13:32:55.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015551000000000001 2024-04-24T13:32:55.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234920+0000", 2024-04-24T13:32:55.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263114 2024-04-24T13:32:55.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:55.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.236227+0000", 2024-04-24T13:32:55.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001306179 2024-04-24T13:32:55.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.251163+0000", 2024-04-24T13:32:55.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014936766000000001 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254465+0000", 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003301151 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254581+0000", 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116224 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254700+0000", 2024-04-24T13:32:55.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011963099999999999 2024-04-24T13:32:55.538 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.538 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.538 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.538 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2207 3.38 e85/74 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:55.538 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:55.538 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.211722483999999, 2024-04-24T13:32:55.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015720683999999999, 2024-04-24T13:32:55.538 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.538 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.539 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.539 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:55.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308024+0000", 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314047+0000", 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060226259999999997 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314095+0000", 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7803000000000003e-05 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314118+0000", 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3218999999999999e-05 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314281+0000", 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016252399999999999 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314321+0000", 2024-04-24T13:32:55.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0213000000000003e-05 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.323647+0000", 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093264079999999996 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.323742+0000", 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5198000000000006e-05 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2209 3.14 e85/48 3:287cf44b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_4:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.180368724000001, 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01556167, 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0699999999999997e-07 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344736+0000", 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053602750000000003 2024-04-24T13:32:55.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344764+0000", 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8033000000000001e-05 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344779+0000", 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4693e-05 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344934+0000", 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520399999999999 2024-04-24T13:32:55.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344975+0000", 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0368999999999999e-05 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354882+0000", 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099076630000000006 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354937+0000", 2024-04-24T13:32:55.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4926000000000002e-05 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2221 3.26 3:67d4e534:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.005217903999998, 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017991152999999999, 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.547 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2221 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514529+0000", 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3080000000000002e-06 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519181+0000", 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046525129999999996 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519216+0000", 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5181000000000001e-05 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519228+0000", 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1253000000000001e-05 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519324+0000", 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6564000000000006e-05 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519463+0000", 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139269 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519597+0000", 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013386999999999999 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532228+0000", 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012631009 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532440+0000", 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021200400000000001 2024-04-24T13:32:55.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532479+0000", 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8668000000000003e-05 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532518+0000", 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8513999999999998e-05 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.552 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2224 3.2c 3:3671ead8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:55.553 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:55.553 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.975036418999998, 2024-04-24T13:32:55.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016019095000000001, 2024-04-24T13:32:55.553 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.553 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.553 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.553 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.553 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.553 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.553 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2224 2024-04-24T13:32:55.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.553 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:55.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:55.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544710+0000", 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5040000000000001e-06 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548580+0000", 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003869473 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548609+0000", 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9623000000000001e-05 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548623+0000", 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3498e-05 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548709+0000", 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6390000000000005e-05 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548989+0000", 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027985500000000002 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:55.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549084+0000", 2024-04-24T13:32:55.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4568999999999995e-05 2024-04-24T13:32:55.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.559986+0000", 2024-04-24T13:32:55.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010902692 2024-04-24T13:32:55.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560649+0000", 2024-04-24T13:32:55.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066290299999999995 2024-04-24T13:32:55.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560687+0000", 2024-04-24T13:32:55.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7644000000000001e-05 2024-04-24T13:32:55.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560727+0000", 2024-04-24T13:32:55.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9944000000000002e-05 2024-04-24T13:32:55.558 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.558 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.558 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.559 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2231 3.36 3:6ddceaef:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:55.559 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:55.559 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.900831395000001, 2024-04-24T13:32:55.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017463218999999999, 2024-04-24T13:32:55.559 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.559 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.559 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.559 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.559 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.559 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2231 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618915+0000", 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5620000000000002e-06 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622655+0000", 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003739984 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622683+0000", 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7390999999999999e-05 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622697+0000", 2024-04-24T13:32:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3694e-05 2024-04-24T13:32:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622795+0000", 2024-04-24T13:32:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8518999999999996e-05 2024-04-24T13:32:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.623022+0000", 2024-04-24T13:32:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022680700000000001 2024-04-24T13:32:55.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.623244+0000", 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022219199999999999 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634301+0000", 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011056718 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636075+0000", 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001774437 2024-04-24T13:32:55.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636243+0000", 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016734399999999999 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636376+0000", 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000133571 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2232 3.a 3:53fed644:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.889094366999998, 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017222277000000001, 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2232 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:55.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:55.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630652+0000", 2024-04-24T13:32:55.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5119999999999998e-06 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634591+0000", 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039383990000000004 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634610+0000", 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9530000000000001e-05 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634620+0000", 2024-04-24T13:32:55.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0081000000000001e-05 2024-04-24T13:32:55.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634679+0000", 2024-04-24T13:32:55.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8483999999999998e-05 2024-04-24T13:32:55.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634807+0000", 2024-04-24T13:32:55.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012772 2024-04-24T13:32:55.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634918+0000", 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011121 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.641801+0000", 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006883213 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647770+0000", 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059689729999999998 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647818+0000", 2024-04-24T13:32:55.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8455000000000003e-05 2024-04-24T13:32:55.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647872+0000", 2024-04-24T13:32:55.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3699999999999997e-05 2024-04-24T13:32:55.570 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.570 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.570 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.571 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2233 3.c e85/74 3:3257d695:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_28:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:55.571 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:55.571 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.876453385000001, 2024-04-24T13:32:55.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015313149, 2024-04-24T13:32:55.571 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.571 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.571 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.571 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:55.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643292+0000", 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4980000000000001e-06 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647384+0000", 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040918980000000001 2024-04-24T13:32:55.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647409+0000", 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4719000000000002e-05 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647421+0000", 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1956999999999999e-05 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647575+0000", 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015421900000000001 2024-04-24T13:32:55.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647642+0000", 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6822000000000005e-05 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.658477+0000", 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010835200999999999 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.658604+0000", 2024-04-24T13:32:55.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126835 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2234 3.34 e85/20 3:2f41ca12:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_29:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.862728252, 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013995339000000001, 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657018+0000", 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0700000000000001e-06 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659913+0000", 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028946079999999999 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659934+0000", 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1154000000000001e-05 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659946+0000", 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1958e-05 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.660012+0000", 2024-04-24T13:32:55.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5870000000000005e-05 2024-04-24T13:32:55.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.660041+0000", 2024-04-24T13:32:55.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9280000000000001e-05 2024-04-24T13:32:55.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.670873+0000", 2024-04-24T13:32:55.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010831591999999999 2024-04-24T13:32:55.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.579 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.579 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671011+0000", 2024-04-24T13:32:55.579 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013880699999999999 2024-04-24T13:32:55.579 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.579 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.579 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.579 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.579 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.579 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2238 3.20 3:07ab05cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:55.579 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.821001680999998, 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019528604000000001, 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2238 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:55.580 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698745+0000", 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702722+0000", 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039764370000000002 2024-04-24T13:32:55.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702755+0000", 2024-04-24T13:32:55.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3676000000000001e-05 2024-04-24T13:32:55.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702771+0000", 2024-04-24T13:32:55.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5823000000000001e-05 2024-04-24T13:32:55.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702854+0000", 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2804000000000002e-05 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702974+0000", 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120258 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.703104+0000", 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129708 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.710231+0000", 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071274570000000002 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718023+0000", 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077912720000000001 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718164+0000", 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014127500000000001 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718271+0000", 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107371 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2240 3.3f 3:fe4f476b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.800452211, 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014610142, 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.585 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2240 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:55.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719294+0000", 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0770000000000002e-06 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723057+0000", 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037627060000000002 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723089+0000", 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1968999999999998e-05 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723100+0000", 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0695e-05 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723176+0000", 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6589999999999997e-05 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723313+0000", 2024-04-24T13:32:55.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136806 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723434+0000", 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120835 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.727850+0000", 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044163229999999998 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733804+0000", 2024-04-24T13:32:55.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059542620000000001 2024-04-24T13:32:55.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733849+0000", 2024-04-24T13:32:55.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4455e-05 2024-04-24T13:32:55.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733902+0000", 2024-04-24T13:32:55.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3424000000000002e-05 2024-04-24T13:32:55.590 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.590 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.590 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2247 3.2a 3:56a679bb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.724874030999999, 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018867848, 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2247 2024-04-24T13:32:55.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794873+0000", 2024-04-24T13:32:55.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7130000000000001e-06 2024-04-24T13:32:55.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799547+0000", 2024-04-24T13:32:55.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004674114 2024-04-24T13:32:55.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.593 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.593 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799586+0000", 2024-04-24T13:32:55.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9279999999999997e-05 2024-04-24T13:32:55.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799613+0000", 2024-04-24T13:32:55.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6239000000000001e-05 2024-04-24T13:32:55.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799734+0000", 2024-04-24T13:32:55.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120964 2024-04-24T13:32:55.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.594 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799986+0000", 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025243200000000003 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.800155+0000", 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016893400000000001 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.806810+0000", 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066547459999999996 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813614+0000", 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068047730000000001 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813684+0000", 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9504000000000004e-05 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813738+0000", 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4148999999999999e-05 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.596 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2254 3.20 3:079960b7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.65149108, 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019983331, 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.597 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2254 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868256+0000", 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8890000000000002e-06 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872066+0000", 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038094549999999998 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872090+0000", 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4933e-05 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872104+0000", 2024-04-24T13:32:55.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3246e-05 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872222+0000", 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118266 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872485+0000", 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026320500000000003 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872713+0000", 2024-04-24T13:32:55.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022758000000000001 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881332+0000", 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086188640000000004 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.887928+0000", 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065959490000000003 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.888112+0000", 2024-04-24T13:32:55.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018435700000000001 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.888237+0000", 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012458700000000001 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2256 3.21 e85/74 3:878222a6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_51:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.627393654999999, 2024-04-24T13:32:55.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013390116000000001, 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892353+0000", 2024-04-24T13:32:55.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5629999999999999e-06 2024-04-24T13:32:55.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896496+0000", 2024-04-24T13:32:55.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041424840000000001 2024-04-24T13:32:55.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896531+0000", 2024-04-24T13:32:55.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5682999999999997e-05 2024-04-24T13:32:55.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896549+0000", 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7909000000000001e-05 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896687+0000", 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013818200000000001 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896723+0000", 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5194999999999998e-05 2024-04-24T13:32:55.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.905615+0000", 2024-04-24T13:32:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088924759999999999 2024-04-24T13:32:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.905741+0000", 2024-04-24T13:32:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012562399999999999 2024-04-24T13:32:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2263 3.26 3:64e2178e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.551856582999999, 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014626548, 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2263 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967890+0000", 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9470000000000002e-06 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971675+0000", 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037854350000000002 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971700+0000", 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4678e-05 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971710+0000", 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0059e-05 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971802+0000", 2024-04-24T13:32:55.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2118000000000001e-05 2024-04-24T13:32:55.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971952+0000", 2024-04-24T13:32:55.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015013599999999999 2024-04-24T13:32:55.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.972085+0000", 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132946 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.981987+0000", 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099020819999999996 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982408+0000", 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042130500000000002 2024-04-24T13:32:55.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982466+0000", 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7629e-05 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982514+0000", 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8213000000000001e-05 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2267 3.3f 3:fe72662d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:55.612 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.504647485, 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018629916999999999, 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2267 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:55.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:55.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015099+0000", 2024-04-24T13:32:55.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2199999999999999e-06 2024-04-24T13:32:55.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018921+0000", 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038224579999999999 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018941+0000", 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9945999999999998e-05 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018952+0000", 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0361e-05 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019017+0000", 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5068999999999997e-05 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019148+0000", 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013165299999999999 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019247+0000", 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.87e-05 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.025115+0000", 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058674909999999999 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033545+0000", 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084303639999999992 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033659+0000", 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114131 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033727+0000", 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7523999999999999e-05 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2269 3.38 e85/74 3:1d70d2f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_64:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.481394040000001, 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013439965, 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.618 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038352+0000", 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4500000000000001e-06 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042479+0000", 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041270819999999998 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042517+0000", 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8550000000000002e-05 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042535+0000", 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8093000000000001e-05 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042678+0000", 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014304399999999999 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042722+0000", 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3179000000000001e-05 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051734+0000", 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0090125280000000006 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051790+0000", 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6039000000000003e-05 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2270 3.a 3:52207169:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.472989579, 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014332798000000001, 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.622 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2270 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046757+0000", 2024-04-24T13:32:55.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2450000000000001e-06 2024-04-24T13:32:55.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050608+0000", 2024-04-24T13:32:55.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038509949999999999 2024-04-24T13:32:55.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050632+0000", 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4450000000000001e-05 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050646+0000", 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3273e-05 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050743+0000", 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7190999999999998e-05 2024-04-24T13:32:55.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050918+0000", 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017516600000000001 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051100+0000", 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018168700000000001 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.055983+0000", 2024-04-24T13:32:55.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048829379999999999 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060902+0000", 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049192430000000002 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.061003+0000", 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101351 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.061087+0000", 2024-04-24T13:32:55.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4258999999999994e-05 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2279 3.2a 3:57162c53:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 26.379345902000001, 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016593472000000001, 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:55.628 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2279 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140401+0000", 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5950000000000001e-06 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144257+0000", 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038560869999999998 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144277+0000", 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9976e-05 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:55.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144288+0000", 2024-04-24T13:32:55.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.059e-05 2024-04-24T13:32:55.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:55.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144359+0000", 2024-04-24T13:32:55.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1550000000000004e-05 2024-04-24T13:32:55.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:55.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144501+0000", 2024-04-24T13:32:55.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014193499999999999 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144633+0000", 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131748 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.148819+0000", 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041860140000000001 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:55.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156831+0000", 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080120120000000006 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156920+0000", 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9112999999999999e-05 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156992+0000", 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1852000000000003e-05 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.633 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.634 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:55.634 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:55.634 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:55.634 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:32:55.636 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:55.636 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:55.633+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:55.736 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:55.735+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:55.807 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:55.808 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:55.808 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:32:55.808 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:55.822 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:32:55.866 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:55.865+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:55.938 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:55.933+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:55.946 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:55.947 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:32:55.947 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:32:55.947 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:32:55.947 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:55.961 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:32:56.046 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:56.045+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:56.129 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:56.130 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:56.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:56.130 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:56.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.130 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.130 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:32:56.130 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.27024505399999, 2024-04-24T13:32:56.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:32:56.130 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.130 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.130 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.130 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.130 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:32:56.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:32:56.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:32:56.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:32:56.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.132 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.132 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:32:56.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:32:56.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:32:56.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:32:56.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:32:56.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:32:56.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:32:56.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.135 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.27022228000001, 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.136 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:32:56.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.141 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.17261484700001, 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:32:56.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:32:56.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:32:56.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:32:56.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:32:56.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:32:56.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:32:56.147 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.147 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.147 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.147 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.147 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:32:56.147 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.17252721, 2024-04-24T13:32:56.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.152 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.06687332300001, 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.153 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:32:56.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.154 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:32:56.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:32:56.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:32:56.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:32:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:32:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:32:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:32:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.158 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.06666880500001, 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:32:56.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.162 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.164 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.06630898200001, 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:32:56.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.06614057900001, 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.170 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:32:56.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:32:56.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:32:56.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:32:56.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:32:56.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:32:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:32:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.065932188, 2024-04-24T13:32:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:32:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.176 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:32:56.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:32:56.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:32:56.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.06583433500001, 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:32:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:32:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:32:56.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:32:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:32:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:32:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:32:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:32:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:32:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:32:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:32:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:32:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:32:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:32:56.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.06573318599999, 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:32:56.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:32:56.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:32:56.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:32:56.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:32:56.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:32:56.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:32:56.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:32:56.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:32:56.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.192 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.192 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:32:56.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:32:56.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.193 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:32:56.194 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.06547647400001, 2024-04-24T13:32:56.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:32:56.194 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.194 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.194 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.194 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.194 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.194 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.194 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:32:56.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.194 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:32:56.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:32:56.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:32:56.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:32:56.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:32:56.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:32:56.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:32:56.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:32:56.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.198 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:32:56.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:32:56.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:32:56.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:32:56.199 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.199 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.199 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.06536681200001, 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:32:56.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:32:56.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:32:56.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:32:56.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:32:56.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:32:56.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:32:56.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.06529478300001, 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.205 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.210 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.065123747, 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:32:56.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.212 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:32:56.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:32:56.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:32:56.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.216 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.217 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.217 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:32:56.217 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 167.065084254, 2024-04-24T13:32:56.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:32:56.217 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.217 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.217 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.217 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.217 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.217 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.217 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:32:56.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.217 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:32:56.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:32:56.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:32:56.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:32:56.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:32:56.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:32:56.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:32:56.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:32:56.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:32:56.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:32:56.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:32:56.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:32:56.222 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.222 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.222 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 166.811764998, 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.223 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:32:56.224 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:32:56.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:32:56.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:32:56.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.225 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:32:56.225 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:32:56.225 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.225 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.225 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:32:56.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:32:56.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:32:56.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:32:56.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.226 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.226 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.226 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:32:56.226 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:32:56.226 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:32:56.227 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.228 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 166.81173895000001, 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.229 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:32:56.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:32:56.230 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.230 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.230 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.230 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.230 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.231 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.232 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.233 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:32:56.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:32:56.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.234 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.234 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:32:56.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:32:56.234 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.234 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.234 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.234 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.234 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.235 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:32:56.235 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 166.811713594, 2024-04-24T13:32:56.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:32:56.235 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.235 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.235 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.235 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.235 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.235 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.235 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:32:56.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.235 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:32:56.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:32:56.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:32:56.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:32:56.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:32:56.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.239 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:32:56.240 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 166.81162252499999, 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:56.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:32:56.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:32:56.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:56.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:56.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:56.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:32:56.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:32:56.246 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.246 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.246 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.246 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:56.246 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:56.246 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:56.248 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:56.245+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:56.248 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:32:56.349 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:56.347+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:56.369 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:56.369 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:56.369 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:56.383 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:32:56.470 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:56.471+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:56.543 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:56.543 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:56.543 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:56.543 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:56.543 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:56.550 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:56.551+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:56.555 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:32:56.557 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:32:56.652 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:56.649+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:56.678 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:56.678 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:32:56.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:32:56.678 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:32:56.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2206 3.f e85/48 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.379920771999998, 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022785151, 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295567+0000", 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3939999999999999e-06 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299770+0000", 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042038029999999999 2024-04-24T13:32:56.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299808+0000", 2024-04-24T13:32:56.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7703000000000001e-05 2024-04-24T13:32:56.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299826+0000", 2024-04-24T13:32:56.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8142999999999999e-05 2024-04-24T13:32:56.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299972+0000", 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000146095 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.300023+0000", 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0294999999999999e-05 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318209+0000", 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018186099000000001 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318349+0000", 2024-04-24T13:32:56.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140619 2024-04-24T13:32:56.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.683 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.683 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2210 3.23 3:c462163d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:56.683 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.355657+0000", 2024-04-24T13:32:56.683 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.319827965999998, 2024-04-24T13:32:56.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018889975999999999, 2024-04-24T13:32:56.683 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2210 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.355657+0000", 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.355657+0000", 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.355661+0000", 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.517e-06 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358401+0000", 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027400219999999999 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358440+0000", 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9348999999999999e-05 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358466+0000", 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.561e-05 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358635+0000", 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016971799999999999 2024-04-24T13:32:56.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358913+0000", 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027758600000000002 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.359151+0000", 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023834999999999999 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374171+0000", 2024-04-24T13:32:56.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015020179 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374235+0000", 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3862000000000006e-05 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374415+0000", 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000179758 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374547+0000", 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000132025 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2212 3.3a e85/20 3:5de7fd4f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_7:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.406594+0000", 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.268890559999999, 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016608241999999999, 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.689 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.406594+0000", 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.406594+0000", 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.406597+0000", 2024-04-24T13:32:56.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8260000000000001e-06 2024-04-24T13:32:56.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412366+0000", 2024-04-24T13:32:56.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057682439999999996 2024-04-24T13:32:56.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412410+0000", 2024-04-24T13:32:56.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4656000000000001e-05 2024-04-24T13:32:56.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412432+0000", 2024-04-24T13:32:56.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1971e-05 2024-04-24T13:32:56.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412637+0000", 2024-04-24T13:32:56.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020509900000000001 2024-04-24T13:32:56.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412680+0000", 2024-04-24T13:32:56.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2326000000000001e-05 2024-04-24T13:32:56.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.423087+0000", 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010407533 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.423203+0000", 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115587 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.694 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2215 3.23 3:c703bbd7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:56.694 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.451222+0000", 2024-04-24T13:32:56.694 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.224263542999999, 2024-04-24T13:32:56.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016321080000000002, 2024-04-24T13:32:56.694 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.694 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.694 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:56.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:56.694 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:56.694 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2215 2024-04-24T13:32:56.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.694 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.451222+0000", 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.451222+0000", 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.451225+0000", 2024-04-24T13:32:56.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4199999999999999e-06 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453253+0000", 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020277300000000002 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453279+0000", 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6684000000000001e-05 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453292+0000", 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3016999999999999e-05 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453382+0000", 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9310999999999999e-05 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453520+0000", 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013785300000000001 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:56.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453651+0000", 2024-04-24T13:32:56.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000131497 2024-04-24T13:32:56.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:56.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467323+0000", 2024-04-24T13:32:56.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013671513999999999 2024-04-24T13:32:56.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467428+0000", 2024-04-24T13:32:56.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105499 2024-04-24T13:32:56.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467488+0000", 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0075999999999999e-05 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467543+0000", 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4478999999999998e-05 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2216 3.3d 3:bf22edaf:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.214167760999999, 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027972988000000001, 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2216 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461320+0000", 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7049999999999999e-06 2024-04-24T13:32:56.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462822+0000", 2024-04-24T13:32:56.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015018919999999999 2024-04-24T13:32:56.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462846+0000", 2024-04-24T13:32:56.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4229000000000001e-05 2024-04-24T13:32:56.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462856+0000", 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8619999999999998e-06 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462932+0000", 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6126999999999998e-05 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463098+0000", 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016631400000000001 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463231+0000", 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013278699999999999 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475573+0000", 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012342148000000001 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489102+0000", 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013528755 2024-04-24T13:32:56.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489210+0000", 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010779400000000001 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489290+0000", 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0375000000000002e-05 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.706 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2217 3.7 e85/41 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:56.706 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:32:56.706 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.201758418000001, 2024-04-24T13:32:56.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022815940999999999, 2024-04-24T13:32:56.706 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.706 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.706 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.706 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:32:56.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:32:56.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473728+0000", 2024-04-24T13:32:56.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6080000000000001e-06 2024-04-24T13:32:56.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475783+0000", 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002054349 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475801+0000", 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8054e-05 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475814+0000", 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3515e-05 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488934+0000", 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013119772 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488977+0000", 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2922e-05 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496474+0000", 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074975320000000003 2024-04-24T13:32:56.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496543+0000", 2024-04-24T13:32:56.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8188999999999994e-05 2024-04-24T13:32:56.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.710 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.710 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop_reply(client.4385.0:2216 3.3d e85/20 ondisk, result = 0)", 2024-04-24T13:32:56.710 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.475903+0000", 2024-04-24T13:32:56.710 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.199581724000002, 2024-04-24T13:32:56.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013396491, 2024-04-24T13:32:56.711 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.711 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.711 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-24T13:32:56.711 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475903+0000", 2024-04-24T13:32:56.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475903+0000", 2024-04-24T13:32:56.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475904+0000", 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6700000000000002e-07 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475909+0000", 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0660000000000003e-06 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488939+0000", 2024-04-24T13:32:56.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013029850000000001 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488960+0000", 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1185000000000001e-05 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489075+0000", 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114324 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489094+0000", 2024-04-24T13:32:56.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9449e-05 2024-04-24T13:32:56.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489300+0000", 2024-04-24T13:32:56.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020565000000000001 2024-04-24T13:32:56.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.714 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.714 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.714 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2220 3.1b 3:da538345:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:56.714 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.502923+0000", 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.172561815000002, 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012431563, 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2220 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.502923+0000", 2024-04-24T13:32:56.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.502923+0000", 2024-04-24T13:32:56.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.502926+0000", 2024-04-24T13:32:56.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6589999999999999e-06 2024-04-24T13:32:56.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504795+0000", 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018686810000000001 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504827+0000", 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.243e-05 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504840+0000", 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3329999999999999e-05 2024-04-24T13:32:56.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504915+0000", 2024-04-24T13:32:56.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4484e-05 2024-04-24T13:32:56.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.505074+0000", 2024-04-24T13:32:56.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158913 2024-04-24T13:32:56.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:56.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.505171+0000", 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7263999999999996e-05 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.510540+0000", 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053688659999999999 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.515256+0000", 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047159009999999998 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.515302+0000", 2024-04-24T13:32:56.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6230000000000003e-05 2024-04-24T13:32:56.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.515355+0000", 2024-04-24T13:32:56.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2805e-05 2024-04-24T13:32:56.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.720 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.720 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2225 3.23 3:c532fe0d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.555517+0000", 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.119968203999999, 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015590068, 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2225 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.555517+0000", 2024-04-24T13:32:56.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.555517+0000", 2024-04-24T13:32:56.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.555519+0000", 2024-04-24T13:32:56.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1289999999999999e-06 2024-04-24T13:32:56.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557097+0000", 2024-04-24T13:32:56.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001577813 2024-04-24T13:32:56.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557130+0000", 2024-04-24T13:32:56.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3290999999999997e-05 2024-04-24T13:32:56.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557146+0000", 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6030000000000001e-05 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557267+0000", 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012072 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557381+0000", 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114648 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:56.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557501+0000", 2024-04-24T13:32:56.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119775 2024-04-24T13:32:56.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.569052+0000", 2024-04-24T13:32:56.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011551074 2024-04-24T13:32:56.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:56.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.570970+0000", 2024-04-24T13:32:56.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019174719999999999 2024-04-24T13:32:56.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.571039+0000", 2024-04-24T13:32:56.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9556999999999998e-05 2024-04-24T13:32:56.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.571107+0000", 2024-04-24T13:32:56.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7558999999999995e-05 2024-04-24T13:32:56.726 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.726 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.726 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2226 3.1b 3:dbfdc3e7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.566142+0000", 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.109342650999999, 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013010147999999999, 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2226 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.727 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.566142+0000", 2024-04-24T13:32:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.566142+0000", 2024-04-24T13:32:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.566145+0000", 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9399999999999998e-06 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567556+0000", 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014105700000000001 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567583+0000", 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7039e-05 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567598+0000", 2024-04-24T13:32:56.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4659e-05 2024-04-24T13:32:56.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567691+0000", 2024-04-24T13:32:56.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3346999999999999e-05 2024-04-24T13:32:56.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567862+0000", 2024-04-24T13:32:56.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017056100000000001 2024-04-24T13:32:56.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:56.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.568014+0000", 2024-04-24T13:32:56.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152311 2024-04-24T13:32:56.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:56.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.574588+0000", 2024-04-24T13:32:56.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065744899999999997 2024-04-24T13:32:56.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579073+0000", 2024-04-24T13:32:56.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044842220000000004 2024-04-24T13:32:56.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579117+0000", 2024-04-24T13:32:56.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4181000000000003e-05 2024-04-24T13:32:56.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579153+0000", 2024-04-24T13:32:56.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5828000000000003e-05 2024-04-24T13:32:56.732 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.732 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2229 3.39 3:9efe271b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.598350+0000", 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.077135488, 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013444141999999999, 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:56.733 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2229 2024-04-24T13:32:56.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.734 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.598350+0000", 2024-04-24T13:32:56.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.598350+0000", 2024-04-24T13:32:56.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.598353+0000", 2024-04-24T13:32:56.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3680000000000002e-06 2024-04-24T13:32:56.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600329+0000", 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019763620000000002 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600346+0000", 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6606999999999999e-05 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600356+0000", 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7599999999999997e-06 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600426+0000", 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0476999999999996e-05 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600552+0000", 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012618699999999999 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600638+0000", 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6020999999999995e-05 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.606922+0000", 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062841049999999999 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.611633+0000", 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047101690000000002 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.611729+0000", 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6557000000000004e-05 2024-04-24T13:32:56.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.611794+0000", 2024-04-24T13:32:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4529000000000005e-05 2024-04-24T13:32:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2236 3.37 3:ee852927:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.678352+0000", 2024-04-24T13:32:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.997133134999999, 2024-04-24T13:32:56.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017640311999999998, 2024-04-24T13:32:56.743 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.743 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.743 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.743 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:56.743 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:56.743 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:56.743 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2236 2024-04-24T13:32:56.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.743 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.678352+0000", 2024-04-24T13:32:56.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.678352+0000", 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.678355+0000", 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0699999999999998e-06 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681073+0000", 2024-04-24T13:32:56.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027178359999999999 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681114+0000", 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0695000000000003e-05 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681132+0000", 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8601999999999999e-05 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681219+0000", 2024-04-24T13:32:56.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6773000000000004e-05 2024-04-24T13:32:56.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681393+0000", 2024-04-24T13:32:56.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174227 2024-04-24T13:32:56.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:56.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681540+0000", 2024-04-24T13:32:56.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014642799999999999 2024-04-24T13:32:56.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692163+0000", 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010623873000000001 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.695844+0000", 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036807739999999999 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.695924+0000", 2024-04-24T13:32:56.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9967000000000002e-05 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.695992+0000", 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8066999999999997e-05 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2238 3.20 e85/20 3:07ab05cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_33:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.703968+0000", 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.971516976, 2024-04-24T13:32:56.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014394229, 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.703968+0000", 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.703968+0000", 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.703970+0000", 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8369999999999999e-06 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708553+0000", 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045833100000000002 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708574+0000", 2024-04-24T13:32:56.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0548999999999999e-05 2024-04-24T13:32:56.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708586+0000", 2024-04-24T13:32:56.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1861e-05 2024-04-24T13:32:56.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708652+0000", 2024-04-24T13:32:56.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6321000000000004e-05 2024-04-24T13:32:56.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708675+0000", 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2849000000000001e-05 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.718318+0000", 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.009642856 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.718362+0000", 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4645999999999999e-05 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.752 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2241 3.23 3:c5282e4b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.729720+0000", 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.945764785000001, 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012358245, 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:56.753 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2241 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.729720+0000", 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.729720+0000", 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.729724+0000", 2024-04-24T13:32:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8190000000000002e-06 2024-04-24T13:32:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732683+0000", 2024-04-24T13:32:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029589490000000002 2024-04-24T13:32:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732712+0000", 2024-04-24T13:32:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8924e-05 2024-04-24T13:32:56.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732727+0000", 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5537e-05 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732814+0000", 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6144999999999996e-05 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732956+0000", 2024-04-24T13:32:56.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014276299999999999 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.733063+0000", 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106393 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741648+0000", 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085851190000000004 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741977+0000", 2024-04-24T13:32:56.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032933000000000002 2024-04-24T13:32:56.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742038+0000", 2024-04-24T13:32:56.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1134000000000001e-05 2024-04-24T13:32:56.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742079+0000", 2024-04-24T13:32:56.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0132000000000001e-05 2024-04-24T13:32:56.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.758 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2249 3.1f 3:fad54725:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.815100+0000", 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.860384869000001, 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013270862, 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2249 2024-04-24T13:32:56.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.760 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.815100+0000", 2024-04-24T13:32:56.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.815100+0000", 2024-04-24T13:32:56.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.815103+0000", 2024-04-24T13:32:56.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0189999999999998e-06 2024-04-24T13:32:56.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816657+0000", 2024-04-24T13:32:56.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015535029999999999 2024-04-24T13:32:56.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816684+0000", 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6956000000000001e-05 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816695+0000", 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1681e-05 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816785+0000", 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9753999999999995e-05 2024-04-24T13:32:56.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816960+0000", 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017443600000000001 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.817127+0000", 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016774499999999999 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.827609+0000", 2024-04-24T13:32:56.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01048137 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828263+0000", 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000654746 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828309+0000", 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6102e-05 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828371+0000", 2024-04-24T13:32:56.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1550000000000005e-05 2024-04-24T13:32:56.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.765 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.765 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2251 3.3a e85/20 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head v 85'3, mlcod=81'1)", 2024-04-24T13:32:56.765 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:32:56.765 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.834258742999999, 2024-04-24T13:32:56.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024431608, 2024-04-24T13:32:56.765 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.765 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.765 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.766 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:32:56.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:32:56.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841228+0000", 2024-04-24T13:32:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.781e-06 2024-04-24T13:32:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846614+0000", 2024-04-24T13:32:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053854419999999998 2024-04-24T13:32:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846650+0000", 2024-04-24T13:32:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6133000000000001e-05 2024-04-24T13:32:56.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846669+0000", 2024-04-24T13:32:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9199e-05 2024-04-24T13:32:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846763+0000", 2024-04-24T13:32:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4335999999999999e-05 2024-04-24T13:32:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846799+0000", 2024-04-24T13:32:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5796000000000001e-05 2024-04-24T13:32:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865616+0000", 2024-04-24T13:32:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018816825999999998 2024-04-24T13:32:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865658+0000", 2024-04-24T13:32:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2095000000000003e-05 2024-04-24T13:32:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.769 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2254 3.20 e85/20 3:079960b7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_49:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.873589+0000", 2024-04-24T13:32:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.801896305, 2024-04-24T13:32:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014660608, 2024-04-24T13:32:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.873589+0000", 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.873589+0000", 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.873590+0000", 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5069999999999999e-06 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877724+0000", 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041334249999999996 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877754+0000", 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9960000000000001e-05 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877766+0000", 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2115e-05 2024-04-24T13:32:56.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877845+0000", 2024-04-24T13:32:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8988999999999999e-05 2024-04-24T13:32:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877874+0000", 2024-04-24T13:32:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9329999999999999e-05 2024-04-24T13:32:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.888153+0000", 2024-04-24T13:32:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010279104000000001 2024-04-24T13:32:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.888249+0000", 2024-04-24T13:32:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6178e-05 2024-04-24T13:32:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2257 3.2b 3:d53685f1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:56.774 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.901887+0000", 2024-04-24T13:32:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.773598497000002, 2024-04-24T13:32:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012527972, 2024-04-24T13:32:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2257 2024-04-24T13:32:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.901887+0000", 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.901887+0000", 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.901889+0000", 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.509e-06 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903738+0000", 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001848969 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903768+0000", 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0088000000000001e-05 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903791+0000", 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2932e-05 2024-04-24T13:32:56.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903872+0000", 2024-04-24T13:32:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1304000000000006e-05 2024-04-24T13:32:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.904052+0000", 2024-04-24T13:32:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018003999999999999 2024-04-24T13:32:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:56.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.904226+0000", 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017409500000000001 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.909209+0000", 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049826030000000004 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914239+0000", 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050297759999999997 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914336+0000", 2024-04-24T13:32:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7233999999999998e-05 2024-04-24T13:32:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914415+0000", 2024-04-24T13:32:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8422000000000002e-05 2024-04-24T13:32:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.780 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2260 3.2b 3:d45c7bdc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.936956+0000", 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.738528673000001, 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011846031, 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2260 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.936956+0000", 2024-04-24T13:32:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.936956+0000", 2024-04-24T13:32:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.936959+0000", 2024-04-24T13:32:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1020000000000001e-06 2024-04-24T13:32:56.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938499+0000", 2024-04-24T13:32:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015395369999999999 2024-04-24T13:32:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938536+0000", 2024-04-24T13:32:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6514000000000003e-05 2024-04-24T13:32:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938552+0000", 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6758000000000001e-05 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938657+0000", 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104491 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938840+0000", 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018292199999999999 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.939014+0000", 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174072 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.944477+0000", 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054635380000000004 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948667+0000", 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041893970000000001 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948741+0000", 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4612999999999999e-05 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948802+0000", 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1087000000000007e-05 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.786 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2264 3.18 e85/20 3:1be64b04:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_59:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.983667+0000", 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.691817679, 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011049814999999999, 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983667+0000", 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983667+0000", 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983683+0000", 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5894999999999999e-05 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985777+0000", 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020935950000000002 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:32:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985806+0000", 2024-04-24T13:32:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9274000000000001e-05 2024-04-24T13:32:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:32:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985820+0000", 2024-04-24T13:32:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4059e-05 2024-04-24T13:32:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:32:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985906+0000", 2024-04-24T13:32:56.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5333000000000004e-05 2024-04-24T13:32:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:32:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985937+0000", 2024-04-24T13:32:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1636e-05 2024-04-24T13:32:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:32:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994652+0000", 2024-04-24T13:32:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.008714655 2024-04-24T13:32:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:32:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:32:56.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:32:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994717+0000", 2024-04-24T13:32:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5368000000000002e-05 2024-04-24T13:32:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:32:56.791 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:32:56.791 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:56.793 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:32:56.793 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:56.791+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:56.894 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:56.891+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:56.965 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:56.965 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:56.965 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:32:56.965 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:56.979 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:32:56.995 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:56.993+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:57.095 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:57.095+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:57.153 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:32:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:32:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:32:57.153 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:32:57.154 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:32:57.164 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:32:57.167 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:32:57.196 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:57.193+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:57.298 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:57.293+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:57.302 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:57.302 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:57.319 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:57.319 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:57.333 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:57.333 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:57.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:57.336 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:57.351 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:32:57.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:57.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:57.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:57.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:57.395 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:57.395 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:57.398 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:57.399+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:57.416 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:57.416 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:57.437 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:57.437 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:57.465 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:57.465 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:57.479 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:32:57.500 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:57.497+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:57.600 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:57.599+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:57.646 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:57.646 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:57.660 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:32:57.702 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:57.697+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:57.802 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:57.797+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:57.828 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:57.828 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:57.843 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:32:57.903 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:57.903+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:57.966 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:57.967 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:57.981 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:32:58.023 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:58.023+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:58.106 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:58.103+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:58.150 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:58.150 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:58.164 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:32:58.207 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:58.207+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:58.308 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:58.307+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:58.327 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:58.327 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:58.341 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:32:58.409 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:58.407+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:58.474 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:58.474 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:58.489 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:32:58.534 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:32:58.533+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:32:58.586 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:32:58.610 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:58.609+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:32:58.612 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:58.612 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:58.627 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:32:58.714 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:58.713+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:58.796 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:58.796 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:58.810 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:32:58.812 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:58.811+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:32:58.913 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:58.909+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:58.979 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:58.980 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:58.993 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:32:59.034 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:59.033+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:59.115 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:32:59.115+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:32:59.150 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:59.151 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:59.165 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:32:59.216 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:59.213+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:59.289 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:59.289 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:59.304 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:32:59.316 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:59.315+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:59.417 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:32:59.413+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:32:59.456 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:32:59.470 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:59.470 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:59.484 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:32:59.518 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:32:59.515+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:32:59.587 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:32:59.611 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:32:59.612 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:32:59.619 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:32:59.619+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:32:59.628 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:32:59.629 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:32:59.645 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:32:59.646 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:32:59.646 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:32:59.647 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:32:59.661 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:32:59.663 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:32:59.663 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:32:59.682 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:32:59.682 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:32:59.701 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:32:59.701 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:32:59.719 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:32:59.720 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:32:59.720 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:32:59.717+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:32:59.738 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:32:59.739 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:32:59.788 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:32:59.788 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:32:59.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:32:59.788 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:32:59.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.788 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:32:59.788 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:59.788 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 150.54029892700001, 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:59.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:32:59.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:32:59.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:32:59.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:32:59.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:32:59.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:32:59.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:32:59.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:32:59.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:32:59.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:32:59.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:32:59.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:32:59.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:59.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:32:59.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:32:59.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:32:59.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:32:59.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:32:59.795 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:1618 3.36 3:6e88aafa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4_10Mb.:head [create,setxattr user.rgw.idtag (62) in=14b,setxattr user.rgw.tail_tag (62) in=17b,writefull 0~4194304,setxattr user.rgw.manifest (356) in=17b,setxattr user.rgw.acl (147) in=12b,setxattr user.rgw.content_type (11) in=21b,setxattr user.rgw.etag (32) in=13b,setxattr user.rgw.x-amz-content-sha256 (17) in=29b,setxattr user.rgw.x-amz-date (17) in=19b,call rgw.obj_store_pg_ver in=19b,setxattr user.rgw.source_zone (4) in=20b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 41.555523514000001, 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025620654, 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.796 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 1618 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229080+0000", 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.229083+0000", 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2100000000000002e-06 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234443+0000", 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053597139999999998 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234484+0000", 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0902999999999998e-05 2024-04-24T13:32:59.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234502+0000", 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8252000000000001e-05 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234657+0000", 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015551000000000001 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.234920+0000", 2024-04-24T13:32:59.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263114 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.236227+0000", 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001306179 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.251163+0000", 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014936766000000001 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254465+0000", 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003301151 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254581+0000", 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116224 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:18.254700+0000", 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011963099999999999 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.801 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.802 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2207 3.38 e85/74 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:59.802 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:59.802 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.476581465999999, 2024-04-24T13:32:59.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015720683999999999, 2024-04-24T13:32:59.802 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.802 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.802 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.802 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308022+0000", 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.308024+0000", 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6929999999999999e-06 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314047+0000", 2024-04-24T13:32:59.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060226259999999997 2024-04-24T13:32:59.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314095+0000", 2024-04-24T13:32:59.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7803000000000003e-05 2024-04-24T13:32:59.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314118+0000", 2024-04-24T13:32:59.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3218999999999999e-05 2024-04-24T13:32:59.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314281+0000", 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016252399999999999 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.314321+0000", 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0213000000000003e-05 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.323647+0000", 2024-04-24T13:32:59.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093264079999999996 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.323742+0000", 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5198000000000006e-05 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2209 3.14 e85/48 3:287cf44b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_4:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.445227706000001, 2024-04-24T13:32:59.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01556167, 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.339376+0000", 2024-04-24T13:32:59.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0699999999999997e-07 2024-04-24T13:32:59.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344736+0000", 2024-04-24T13:32:59.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053602750000000003 2024-04-24T13:32:59.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344764+0000", 2024-04-24T13:32:59.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8033000000000001e-05 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344779+0000", 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4693e-05 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344934+0000", 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015520399999999999 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.344975+0000", 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0368999999999999e-05 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354882+0000", 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099076630000000006 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354937+0000", 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4926000000000002e-05 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.810 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.811 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2221 3.26 3:67d4e534:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:59.811 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:59.811 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.270076885999998, 2024-04-24T13:32:59.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017991152999999999, 2024-04-24T13:32:59.811 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.811 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.811 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.811 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.811 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.811 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.811 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2221 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514526+0000", 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.514529+0000", 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3080000000000002e-06 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519181+0000", 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046525129999999996 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519216+0000", 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5181000000000001e-05 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519228+0000", 2024-04-24T13:32:59.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1253000000000001e-05 2024-04-24T13:32:59.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519324+0000", 2024-04-24T13:32:59.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6564000000000006e-05 2024-04-24T13:32:59.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519463+0000", 2024-04-24T13:32:59.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139269 2024-04-24T13:32:59.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.519597+0000", 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013386999999999999 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532228+0000", 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012631009 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532440+0000", 2024-04-24T13:32:59.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021200400000000001 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532479+0000", 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8668000000000003e-05 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.532518+0000", 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8513999999999998e-05 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.817 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2224 3.2c 3:3671ead8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:59.817 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:59.817 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.239895400999998, 2024-04-24T13:32:59.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016019095000000001, 2024-04-24T13:32:59.817 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.817 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.817 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.817 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.817 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.817 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.817 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2224 2024-04-24T13:32:59.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.818 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:59.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544708+0000", 2024-04-24T13:32:59.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.544710+0000", 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5040000000000001e-06 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548580+0000", 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003869473 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548609+0000", 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9623000000000001e-05 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548623+0000", 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3498e-05 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548709+0000", 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6390000000000005e-05 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.548989+0000", 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027985500000000002 2024-04-24T13:32:59.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.549084+0000", 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4568999999999995e-05 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.559986+0000", 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010902692 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560649+0000", 2024-04-24T13:32:59.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00066290299999999995 2024-04-24T13:32:59.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560687+0000", 2024-04-24T13:32:59.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7644000000000001e-05 2024-04-24T13:32:59.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.560727+0000", 2024-04-24T13:32:59.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9944000000000002e-05 2024-04-24T13:32:59.822 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.822 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.822 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2231 3.36 3:6ddceaef:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_26:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.165690377000001, 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017463218999999999, 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2231 2024-04-24T13:32:59.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618913+0000", 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.618915+0000", 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5620000000000002e-06 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622655+0000", 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003739984 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622683+0000", 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7390999999999999e-05 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622697+0000", 2024-04-24T13:32:59.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3694e-05 2024-04-24T13:32:59.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.622795+0000", 2024-04-24T13:32:59.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8518999999999996e-05 2024-04-24T13:32:59.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.623022+0000", 2024-04-24T13:32:59.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022680700000000001 2024-04-24T13:32:59.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.623244+0000", 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022219199999999999 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634301+0000", 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011056718 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636075+0000", 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001774437 2024-04-24T13:32:59.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636243+0000", 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016734399999999999 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.636376+0000", 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000133571 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.829 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2232 3.a 3:53fed644:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:59.829 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:59.829 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.153953348999998, 2024-04-24T13:32:59.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017222277000000001, 2024-04-24T13:32:59.829 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.829 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.829 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.829 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.829 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.829 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.829 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2232 2024-04-24T13:32:59.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.829 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:59.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630650+0000", 2024-04-24T13:32:59.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.630652+0000", 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5119999999999998e-06 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634591+0000", 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039383990000000004 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634610+0000", 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9530000000000001e-05 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634620+0000", 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0081000000000001e-05 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634679+0000", 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8483999999999998e-05 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634807+0000", 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012772 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.634918+0000", 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011121 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.641801+0000", 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006883213 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647770+0000", 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059689729999999998 2024-04-24T13:32:59.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647818+0000", 2024-04-24T13:32:59.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8455000000000003e-05 2024-04-24T13:32:59.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647872+0000", 2024-04-24T13:32:59.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3699999999999997e-05 2024-04-24T13:32:59.834 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.834 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2233 3.c e85/74 3:3257d695:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_28:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.141312367000001, 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015313149, 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643291+0000", 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.643292+0000", 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4980000000000001e-06 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647384+0000", 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040918980000000001 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647409+0000", 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4719000000000002e-05 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647421+0000", 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1956999999999999e-05 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647575+0000", 2024-04-24T13:32:59.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015421900000000001 2024-04-24T13:32:59.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.647642+0000", 2024-04-24T13:32:59.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.6822000000000005e-05 2024-04-24T13:32:59.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.838 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.658477+0000", 2024-04-24T13:32:59.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010835200999999999 2024-04-24T13:32:59.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.658604+0000", 2024-04-24T13:32:59.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126835 2024-04-24T13:32:59.839 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.839 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.839 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.839 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2234 3.34 e85/20 3:2f41ca12:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_29:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:59.839 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:59.839 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.127587234, 2024-04-24T13:32:59.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013995339000000001, 2024-04-24T13:32:59.840 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.840 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.840 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.840 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:59.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657016+0000", 2024-04-24T13:32:59.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.657018+0000", 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0700000000000001e-06 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659913+0000", 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028946079999999999 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659934+0000", 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1154000000000001e-05 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.659946+0000", 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1958e-05 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.660012+0000", 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5870000000000005e-05 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.660041+0000", 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9280000000000001e-05 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.670873+0000", 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010831591999999999 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.671011+0000", 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013880699999999999 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.843 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2238 3.20 3:07ab05cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_33:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.085860662999998, 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019528604000000001, 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.844 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2238 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698743+0000", 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.698745+0000", 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5229999999999998e-06 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702722+0000", 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039764370000000002 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702755+0000", 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3676000000000001e-05 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702771+0000", 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5823000000000001e-05 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702854+0000", 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2804000000000002e-05 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.702974+0000", 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120258 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.703104+0000", 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129708 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.710231+0000", 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071274570000000002 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718023+0000", 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077912720000000001 2024-04-24T13:32:59.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718164+0000", 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014127500000000001 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.718271+0000", 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000107371 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2240 3.3f 3:fe4f476b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 31.065311192999999, 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014610142, 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2240 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719292+0000", 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.719294+0000", 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0770000000000002e-06 2024-04-24T13:32:59.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723057+0000", 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037627060000000002 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723089+0000", 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1968999999999998e-05 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723100+0000", 2024-04-24T13:32:59.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0695e-05 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723176+0000", 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6589999999999997e-05 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723313+0000", 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136806 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:59.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.723434+0000", 2024-04-24T13:32:59.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120835 2024-04-24T13:32:59.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.727850+0000", 2024-04-24T13:32:59.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044163229999999998 2024-04-24T13:32:59.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733804+0000", 2024-04-24T13:32:59.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0059542620000000001 2024-04-24T13:32:59.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733849+0000", 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4455e-05 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.733902+0000", 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3424000000000002e-05 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.855 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2247 3.2a 3:56a679bb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.989733012999999, 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018867848, 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2247 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794870+0000", 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.794873+0000", 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7130000000000001e-06 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799547+0000", 2024-04-24T13:32:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004674114 2024-04-24T13:32:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799586+0000", 2024-04-24T13:32:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9279999999999997e-05 2024-04-24T13:32:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799613+0000", 2024-04-24T13:32:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6239000000000001e-05 2024-04-24T13:32:59.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799734+0000", 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120964 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.799986+0000", 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025243200000000003 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.800155+0000", 2024-04-24T13:32:59.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016893400000000001 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.806810+0000", 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066547459999999996 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813614+0000", 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068047730000000001 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813684+0000", 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9504000000000004e-05 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.813738+0000", 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4148999999999999e-05 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2254 3.20 3:079960b7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.916350061999999, 2024-04-24T13:32:59.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019983331, 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2254 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868253+0000", 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.868256+0000", 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8890000000000002e-06 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872066+0000", 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038094549999999998 2024-04-24T13:32:59.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872090+0000", 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4933e-05 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872104+0000", 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3246e-05 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872222+0000", 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118266 2024-04-24T13:32:59.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872485+0000", 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026320500000000003 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.872713+0000", 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022758000000000001 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.881332+0000", 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086188640000000004 2024-04-24T13:32:59.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.887928+0000", 2024-04-24T13:32:59.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065959490000000003 2024-04-24T13:32:59.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.888112+0000", 2024-04-24T13:32:59.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018435700000000001 2024-04-24T13:32:59.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.888237+0000", 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012458700000000001 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2256 3.21 e85/74 3:878222a6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_51:head v 85'1, mlcod=0'0)", 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.892252636999999, 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013390116000000001, 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.867 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892351+0000", 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.892353+0000", 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5629999999999999e-06 2024-04-24T13:32:59.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896496+0000", 2024-04-24T13:32:59.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041424840000000001 2024-04-24T13:32:59.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896531+0000", 2024-04-24T13:32:59.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5682999999999997e-05 2024-04-24T13:32:59.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896549+0000", 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7909000000000001e-05 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896687+0000", 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013818200000000001 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.896723+0000", 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5194999999999998e-05 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.905615+0000", 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088924759999999999 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.905741+0000", 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012562399999999999 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2263 3.26 3:64e2178e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:59.871 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.816715564999999, 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014626548, 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2263 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967888+0000", 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.967890+0000", 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9470000000000002e-06 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971675+0000", 2024-04-24T13:32:59.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037854350000000002 2024-04-24T13:32:59.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971700+0000", 2024-04-24T13:32:59.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4678e-05 2024-04-24T13:32:59.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971710+0000", 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0059e-05 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971802+0000", 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.2118000000000001e-05 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.971952+0000", 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015013599999999999 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.972085+0000", 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132946 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.981987+0000", 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099020819999999996 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982408+0000", 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042130500000000002 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982466+0000", 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.7629e-05 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.982514+0000", 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8213000000000001e-05 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2267 3.3f 3:fe72662d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_62:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:59.877 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.769506466999999, 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018629916999999999, 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2267 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:59.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015097+0000", 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.015099+0000", 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2199999999999999e-06 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018921+0000", 2024-04-24T13:32:59.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038224579999999999 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018941+0000", 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9945999999999998e-05 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.018952+0000", 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0361e-05 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019017+0000", 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5068999999999997e-05 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019148+0000", 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013165299999999999 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.019247+0000", 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.87e-05 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.025115+0000", 2024-04-24T13:32:59.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058674909999999999 2024-04-24T13:32:59.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033545+0000", 2024-04-24T13:32:59.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084303639999999992 2024-04-24T13:32:59.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033659+0000", 2024-04-24T13:32:59.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114131 2024-04-24T13:32:59.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.033727+0000", 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7523999999999999e-05 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2269 3.38 e85/74 3:1d70d2f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_64:head v 85'2, mlcod=0'0)", 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.746253022000001, 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013439965, 2024-04-24T13:32:59.883 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038350+0000", 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.038352+0000", 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4500000000000001e-06 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042479+0000", 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041270819999999998 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042517+0000", 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8550000000000002e-05 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042535+0000", 2024-04-24T13:32:59.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8093000000000001e-05 2024-04-24T13:32:59.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042678+0000", 2024-04-24T13:32:59.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014304399999999999 2024-04-24T13:32:59.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.042722+0000", 2024-04-24T13:32:59.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3179000000000001e-05 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051734+0000", 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0090125280000000006 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051790+0000", 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.6039000000000003e-05 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2270 3.a 3:52207169:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_65:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.737848561, 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014332798000000001, 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2270 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046755+0000", 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.046757+0000", 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2450000000000001e-06 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050608+0000", 2024-04-24T13:32:59.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038509949999999999 2024-04-24T13:32:59.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050632+0000", 2024-04-24T13:32:59.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4450000000000001e-05 2024-04-24T13:32:59.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050646+0000", 2024-04-24T13:32:59.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3273e-05 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050743+0000", 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7190999999999998e-05 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.050918+0000", 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017516600000000001 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:32:59.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.051100+0000", 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018168700000000001 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.055983+0000", 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048829379999999999 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.060902+0000", 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049192430000000002 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.061003+0000", 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101351 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.061087+0000", 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4258999999999994e-05 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2279 3.2a 3:57162c53:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_74:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:59.893 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.644204884000001, 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016593472000000001, 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2279 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:59.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140398+0000", 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.140401+0000", 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5950000000000001e-06 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:32:59.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144257+0000", 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038560869999999998 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144277+0000", 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9976e-05 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144288+0000", 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.059e-05 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144359+0000", 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1550000000000004e-05 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144501+0000", 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014193499999999999 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.144633+0000", 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131748 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:32:59.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.148819+0000", 2024-04-24T13:32:59.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041860140000000001 2024-04-24T13:32:59.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:32:59.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156831+0000", 2024-04-24T13:32:59.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0080120120000000006 2024-04-24T13:32:59.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.898 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:32:59.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156920+0000", 2024-04-24T13:32:59.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9112999999999999e-05 2024-04-24T13:32:59.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:32:59.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:32:59.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:32:59.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:29.156992+0000", 2024-04-24T13:32:59.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1852000000000003e-05 2024-04-24T13:32:59.899 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.899 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.899 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.899 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:32:59.899 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:32:59.899 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:32:59.900 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:32:59.901 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:32:59.899+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:00.001 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:32:59.997+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:00.070 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:00.070 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:00.070 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:33:00.070 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:00.084 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:00.102 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:00.103+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:00.203 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:00.203+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:00.252 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:00.252 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:00.252 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:33:00.252 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:33:00.252 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:00.267 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:00.304 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:00.303+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:00.389 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:00.389 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:33:00.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:33:00.389 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:33:00.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.389 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.389 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:33:00.389 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.530283199, 2024-04-24T13:33:00.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:33:00.390 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.390 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.390 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.390 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.390 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.390 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.390 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:33:00.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.390 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:33:00.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:33:00.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:33:00.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:33:00.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:33:00.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:33:00.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:33:00.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:33:00.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:33:00.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:33:00.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:33:00.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:33:00.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:33:00.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:33:00.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:33:00.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.396 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.53026042499999, 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:33:00.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:33:00.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:33:00.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:33:00.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:33:00.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:33:00.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:33:00.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.402 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.402 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:33:00.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:33:00.402 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.402 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.402 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.402 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.403 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.403 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.403 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:33:00.403 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.43265299199999, 2024-04-24T13:33:00.403 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:33:00.404 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.404 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.404 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.404 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.404 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.404 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.404 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:33:00.404 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.404 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.404 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.404 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.404 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:33:00.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:33:00.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.405 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.405 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.405 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.405 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:33:00.405 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:33:00.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:33:00.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:33:00.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.406 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.406 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:33:00.406 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:33:00.406 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.406 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:33:00.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:33:00.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:33:00.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:33:00.407 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.407 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.407 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.407 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:33:00.407 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:33:00.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:33:00.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:33:00.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.408 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:33:00.408 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:33:00.408 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.408 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.408 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:33:00.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:33:00.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:33:00.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:33:00.409 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.409 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.409 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.409 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:33:00.409 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:33:00.410 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.410 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.410 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.410 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.410 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.410 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.410 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:33:00.410 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.43256535500001, 2024-04-24T13:33:00.410 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:33:00.410 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.410 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.410 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.410 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.411 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.411 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.411 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:33:00.411 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.411 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.411 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.411 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.411 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:33:00.411 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.412 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:33:00.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:33:00.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.413 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:33:00.413 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:33:00.413 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.413 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.413 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:33:00.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:33:00.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:33:00.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:33:00.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.414 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.414 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.414 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:33:00.414 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:33:00.414 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:33:00.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:33:00.415 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.415 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.415 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.415 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:33:00.415 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:33:00.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:33:00.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:33:00.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.416 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:33:00.416 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:33:00.416 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.416 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.416 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.417 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:33:00.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:33:00.417 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.417 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.417 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.417 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.417 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.417 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.417 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:33:00.417 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.32691146799999, 2024-04-24T13:33:00.417 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:33:00.417 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.417 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.418 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.418 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.418 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.418 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.418 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:33:00.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.418 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.418 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.418 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.418 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:33:00.418 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.418 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.419 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.419 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.419 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:33:00.422 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.422 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:33:00.423 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:33:00.423 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.423 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.423 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.423 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:33:00.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:33:00.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:33:00.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:33:00.424 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.424 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.424 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.424 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:33:00.424 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:33:00.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:33:00.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:33:00.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.425 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:33:00.425 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:33:00.425 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.425 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.425 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:33:00.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:33:00.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:33:00.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:33:00.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.426 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.426 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.426 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:33:00.426 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:33:00.426 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.427 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.428 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.428 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:33:00.428 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.32670694999999, 2024-04-24T13:33:00.428 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:33:00.428 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.428 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.428 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.428 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.428 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.428 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.428 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:33:00.428 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.428 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:33:00.429 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:33:00.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:33:00.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:33:00.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.430 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.430 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:33:00.430 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:33:00.430 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.430 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:33:00.431 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:33:00.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:33:00.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:33:00.432 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:33:00.432 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.432 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.432 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.432 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:33:00.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:33:00.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:33:00.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:33:00.433 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.433 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.433 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.433 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:33:00.433 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:33:00.433 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.433 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.434 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.434 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.434 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.434 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.434 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:33:00.434 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.32634712699999, 2024-04-24T13:33:00.434 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:33:00.434 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.434 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.434 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.434 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.435 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:33:00.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.435 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:33:00.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.435 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.435 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.435 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.435 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:33:00.435 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:33:00.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:33:00.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.436 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.436 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:33:00.436 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:33:00.436 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.436 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:33:00.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:33:00.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:33:00.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:33:00.437 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.437 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.437 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.437 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:33:00.437 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:33:00.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:33:00.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:33:00.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.438 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.438 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:33:00.438 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:33:00.438 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.438 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:33:00.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:33:00.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:33:00.439 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:33:00.439 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.439 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.439 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.439 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:33:00.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:33:00.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.440 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.440 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:33:00.440 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:33:00.440 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.440 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.440 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.440 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.440 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.440 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.440 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:33:00.441 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.32617872399999, 2024-04-24T13:33:00.441 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:33:00.441 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.441 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.441 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.441 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.441 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.441 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.441 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:33:00.441 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.441 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.441 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.441 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:33:00.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:33:00.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.442 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.442 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.442 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:33:00.442 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:33:00.442 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:33:00.443 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:33:00.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:33:00.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:33:00.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.444 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:33:00.444 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:33:00.444 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.444 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.444 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:33:00.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:33:00.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:33:00.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:33:00.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.445 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.445 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.445 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:33:00.445 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:33:00.445 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:33:00.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:33:00.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.446 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.446 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.446 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:33:00.446 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:33:00.446 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.446 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.446 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.446 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.447 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.447 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.447 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:33:00.447 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.32597033299999, 2024-04-24T13:33:00.447 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:33:00.447 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.447 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.447 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.447 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.447 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.447 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.447 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:33:00.447 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.448 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:33:00.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.448 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:33:00.448 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.448 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.448 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.448 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.449 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:33:00.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:33:00.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:33:00.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:33:00.450 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.450 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.450 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.450 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:33:00.450 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:33:00.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:33:00.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:33:00.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.451 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.451 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:33:00.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:33:00.451 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:33:00.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:33:00.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:33:00.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:33:00.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:33:00.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:33:00.453 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.453 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.453 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.453 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.453 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:33:00.453 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.32587247999999, 2024-04-24T13:33:00.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:33:00.453 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.454 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.454 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.454 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.454 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.454 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.454 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:33:00.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.454 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:33:00.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:33:00.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:33:00.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:33:00.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:33:00.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:33:00.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:33:00.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:33:00.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:33:00.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:33:00.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:33:00.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:33:00.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:33:00.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:33:00.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:33:00.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:33:00.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:33:00.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:33:00.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:33:00.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:33:00.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:33:00.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:33:00.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:33:00.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:33:00.461 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.461 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.461 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.462 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.462 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:33:00.462 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.325771331, 2024-04-24T13:33:00.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:33:00.462 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.462 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.462 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.462 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:33:00.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.463 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:33:00.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:33:00.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:33:00.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:33:00.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:33:00.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:33:00.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:33:00.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:33:00.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:33:00.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:33:00.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:33:00.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:33:00.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:33:00.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:33:00.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:33:00.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:33:00.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:33:00.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:33:00.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:33:00.467 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.468 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.468 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.468 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.468 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:33:00.468 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.32551461899999, 2024-04-24T13:33:00.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:33:00.468 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.468 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.469 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.469 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.469 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.469 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.469 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:33:00.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.470 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:33:00.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:33:00.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:33:00.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:33:00.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:33:00.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:33:00.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:33:00.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:33:00.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:33:00.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:33:00.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:33:00.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:33:00.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:33:00.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:33:00.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:33:00.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:33:00.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:33:00.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:33:00.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:33:00.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:33:00.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:33:00.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:33:00.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:33:00.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:33:00.476 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.476 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.476 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.477 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.477 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:33:00.477 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.32540495699999, 2024-04-24T13:33:00.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:33:00.477 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.477 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.477 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.478 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.478 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.478 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.478 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:33:00.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.478 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:33:00.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:33:00.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:33:00.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:33:00.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:33:00.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:33:00.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:33:00.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:33:00.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:33:00.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:33:00.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:33:00.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:33:00.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:33:00.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:33:00.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:33:00.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:33:00.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:33:00.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:33:00.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:33:00.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:33:00.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:33:00.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:33:00.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:33:00.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:33:00.486 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.486 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.486 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.486 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.486 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:33:00.486 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.32533292799999, 2024-04-24T13:33:00.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:33:00.486 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.486 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.486 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.486 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.487 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.487 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.487 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:33:00.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.487 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:33:00.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:33:00.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:33:00.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:33:00.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:33:00.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:33:00.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:33:00.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:33:00.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:33:00.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:33:00.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:33:00.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.32516189200001, 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.492 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:33:00.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:33:00.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:33:00.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:33:00.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:33:00.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:33:00.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:33:00.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:33:00.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:33:00.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:33:00.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:33:00.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:33:00.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:33:00.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:33:00.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:33:00.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:33:00.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:33:00.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.498 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.498 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.498 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:33:00.498 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.32512239900001, 2024-04-24T13:33:00.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:33:00.498 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:33:00.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:33:00.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:33:00.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:33:00.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:33:00.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:33:00.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:33:00.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:33:00.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:33:00.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:33:00.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:33:00.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:33:00.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:33:00.504 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.504 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.504 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.504 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.504 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:33:00.504 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.07180314300001, 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:33:00.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:33:00.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:33:00.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:33:00.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:33:00.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:33:00.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:33:00.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:33:00.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:33:00.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:33:00.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:33:00.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:33:00.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:33:00.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:33:00.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:33:00.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:33:00.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:33:00.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:33:00.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:33:00.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:33:00.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:33:00.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:33:00.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:33:00.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:33:00.512 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.512 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.512 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.512 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.513 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:33:00.513 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.07177709499999, 2024-04-24T13:33:00.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:33:00.513 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.513 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.513 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.513 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.513 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.513 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.513 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:33:00.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.514 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:33:00.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:33:00.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:33:00.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:33:00.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:33:00.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:33:00.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:33:00.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:33:00.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:33:00.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:33:00.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:33:00.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:33:00.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:33:00.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:33:00.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:33:00.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:33:00.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:33:00.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:33:00.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:33:00.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:33:00.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:33:00.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:33:00.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:33:00.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:33:00.522 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.522 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.522 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.523 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.523 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:33:00.523 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.07175173900001, 2024-04-24T13:33:00.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:33:00.523 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.523 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.523 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.523 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.523 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.524 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.524 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:33:00.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.524 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:33:00.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:33:00.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:33:00.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:33:00.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:33:00.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:33:00.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:33:00.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:33:00.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:33:00.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:33:00.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:33:00.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:33:00.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:33:00.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:33:00.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:33:00.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:33:00.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:33:00.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:33:00.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:33:00.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:33:00.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:33:00.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:33:00.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:33:00.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:33:00.531 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.531 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:33:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 171.07166067, 2024-04-24T13:33:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:33:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:00.532 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:33:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:00.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:33:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:33:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:00.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:33:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:33:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:33:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:33:00.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:33:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:33:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:33:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:33:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:33:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:33:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:33:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:33:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:33:00.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:33:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:33:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:33:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:33:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:33:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:33:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:33:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:33:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:33:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.539 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:00.540 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:00.540 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:00.540 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:00.541 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:00.453+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:00.559 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:00.553+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:00.658 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:00.655+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:00.668 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:00.669 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:00.683 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:00.762 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:00.757+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:00.857 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:00.857 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:00.857 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:00.857 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:00.857 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:00.866 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:00.861+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:00.872 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:00.964 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:00.963+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:01.002 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:01.002 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:01.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:01.002 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:01.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.002 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2206 3.f e85/48 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:01.002 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:01.002 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.705403887999999, 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022785151, 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:01.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295567+0000", 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3939999999999999e-06 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299770+0000", 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042038029999999999 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299808+0000", 2024-04-24T13:33:01.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7703000000000001e-05 2024-04-24T13:33:01.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299826+0000", 2024-04-24T13:33:01.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8142999999999999e-05 2024-04-24T13:33:01.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299972+0000", 2024-04-24T13:33:01.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000146095 2024-04-24T13:33:01.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.300023+0000", 2024-04-24T13:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0294999999999999e-05 2024-04-24T13:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318209+0000", 2024-04-24T13:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018186099000000001 2024-04-24T13:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318349+0000", 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140619 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2210 3.23 3:c462163d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.355657+0000", 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.645311081999999, 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018889975999999999, 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2210 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.355657+0000", 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.355657+0000", 2024-04-24T13:33:01.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.355661+0000", 2024-04-24T13:33:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.517e-06 2024-04-24T13:33:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358401+0000", 2024-04-24T13:33:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027400219999999999 2024-04-24T13:33:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358440+0000", 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9348999999999999e-05 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358466+0000", 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.561e-05 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358635+0000", 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016971799999999999 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358913+0000", 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027758600000000002 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.359151+0000", 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023834999999999999 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374171+0000", 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015020179 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374235+0000", 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3862000000000006e-05 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374415+0000", 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000179758 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374547+0000", 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000132025 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.012 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2212 3.3a e85/20 3:5de7fd4f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_7:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.406594+0000", 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.594373676000004, 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016608241999999999, 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.406594+0000", 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.406594+0000", 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.406597+0000", 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8260000000000001e-06 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412366+0000", 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057682439999999996 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412410+0000", 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4656000000000001e-05 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412432+0000", 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1971e-05 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412637+0000", 2024-04-24T13:33:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020509900000000001 2024-04-24T13:33:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412680+0000", 2024-04-24T13:33:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2326000000000001e-05 2024-04-24T13:33:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.423087+0000", 2024-04-24T13:33:01.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010407533 2024-04-24T13:33:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.423203+0000", 2024-04-24T13:33:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115587 2024-04-24T13:33:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2215 3.23 3:c703bbd7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.451222+0000", 2024-04-24T13:33:01.017 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.549746659, 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016321080000000002, 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2215 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.451222+0000", 2024-04-24T13:33:01.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.451222+0000", 2024-04-24T13:33:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.451225+0000", 2024-04-24T13:33:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4199999999999999e-06 2024-04-24T13:33:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453253+0000", 2024-04-24T13:33:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020277300000000002 2024-04-24T13:33:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453279+0000", 2024-04-24T13:33:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6684000000000001e-05 2024-04-24T13:33:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453292+0000", 2024-04-24T13:33:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3016999999999999e-05 2024-04-24T13:33:01.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453382+0000", 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9310999999999999e-05 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453520+0000", 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013785300000000001 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453651+0000", 2024-04-24T13:33:01.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000131497 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467323+0000", 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013671513999999999 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467428+0000", 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105499 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467488+0000", 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0075999999999999e-05 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467543+0000", 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4478999999999998e-05 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2216 3.3d 3:bf22edaf:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:01.023 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.539650877, 2024-04-24T13:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027972988000000001, 2024-04-24T13:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2216 2024-04-24T13:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461320+0000", 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7049999999999999e-06 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462822+0000", 2024-04-24T13:33:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015018919999999999 2024-04-24T13:33:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462846+0000", 2024-04-24T13:33:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4229000000000001e-05 2024-04-24T13:33:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462856+0000", 2024-04-24T13:33:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8619999999999998e-06 2024-04-24T13:33:01.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462932+0000", 2024-04-24T13:33:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6126999999999998e-05 2024-04-24T13:33:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463098+0000", 2024-04-24T13:33:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016631400000000001 2024-04-24T13:33:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:01.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463231+0000", 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013278699999999999 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475573+0000", 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012342148000000001 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489102+0000", 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013528755 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489210+0000", 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010779400000000001 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489290+0000", 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0375000000000002e-05 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2217 3.7 e85/41 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:01.029 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.527241533999998, 2024-04-24T13:33:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022815940999999999, 2024-04-24T13:33:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:01.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473728+0000", 2024-04-24T13:33:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6080000000000001e-06 2024-04-24T13:33:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475783+0000", 2024-04-24T13:33:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002054349 2024-04-24T13:33:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475801+0000", 2024-04-24T13:33:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8054e-05 2024-04-24T13:33:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475814+0000", 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3515e-05 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488934+0000", 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013119772 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488977+0000", 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2922e-05 2024-04-24T13:33:01.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496474+0000", 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074975320000000003 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496543+0000", 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8188999999999994e-05 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop_reply(client.4385.0:2216 3.3d e85/20 ondisk, result = 0)", 2024-04-24T13:33:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.475903+0000", 2024-04-24T13:33:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.525064839999999, 2024-04-24T13:33:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013396491, 2024-04-24T13:33:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-24T13:33:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475903+0000", 2024-04-24T13:33:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475903+0000", 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475904+0000", 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6700000000000002e-07 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475909+0000", 2024-04-24T13:33:01.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0660000000000003e-06 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488939+0000", 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013029850000000001 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488960+0000", 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1185000000000001e-05 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489075+0000", 2024-04-24T13:33:01.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114324 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489094+0000", 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9449e-05 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489300+0000", 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020565000000000001 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2220 3.1b 3:da538345:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.502923+0000", 2024-04-24T13:33:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.498044931000003, 2024-04-24T13:33:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012431563, 2024-04-24T13:33:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.042 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2220 2024-04-24T13:33:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.043 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.502923+0000", 2024-04-24T13:33:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.502923+0000", 2024-04-24T13:33:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.502926+0000", 2024-04-24T13:33:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6589999999999999e-06 2024-04-24T13:33:01.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504795+0000", 2024-04-24T13:33:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018686810000000001 2024-04-24T13:33:01.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504827+0000", 2024-04-24T13:33:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.243e-05 2024-04-24T13:33:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504840+0000", 2024-04-24T13:33:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3329999999999999e-05 2024-04-24T13:33:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504915+0000", 2024-04-24T13:33:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4484e-05 2024-04-24T13:33:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.505074+0000", 2024-04-24T13:33:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158913 2024-04-24T13:33:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:01.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.505171+0000", 2024-04-24T13:33:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7263999999999996e-05 2024-04-24T13:33:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.510540+0000", 2024-04-24T13:33:01.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053688659999999999 2024-04-24T13:33:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.515256+0000", 2024-04-24T13:33:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047159009999999998 2024-04-24T13:33:01.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.515302+0000", 2024-04-24T13:33:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6230000000000003e-05 2024-04-24T13:33:01.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.515355+0000", 2024-04-24T13:33:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2805e-05 2024-04-24T13:33:01.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2225 3.23 3:c532fe0d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.055 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.555517+0000", 2024-04-24T13:33:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.445451319999997, 2024-04-24T13:33:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015590068, 2024-04-24T13:33:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.056 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2225 2024-04-24T13:33:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.057 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.555517+0000", 2024-04-24T13:33:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.555517+0000", 2024-04-24T13:33:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.555519+0000", 2024-04-24T13:33:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1289999999999999e-06 2024-04-24T13:33:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557097+0000", 2024-04-24T13:33:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001577813 2024-04-24T13:33:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557130+0000", 2024-04-24T13:33:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3290999999999997e-05 2024-04-24T13:33:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557146+0000", 2024-04-24T13:33:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6030000000000001e-05 2024-04-24T13:33:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557267+0000", 2024-04-24T13:33:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012072 2024-04-24T13:33:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557381+0000", 2024-04-24T13:33:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114648 2024-04-24T13:33:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557501+0000", 2024-04-24T13:33:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119775 2024-04-24T13:33:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.569052+0000", 2024-04-24T13:33:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011551074 2024-04-24T13:33:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.570970+0000", 2024-04-24T13:33:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019174719999999999 2024-04-24T13:33:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.571039+0000", 2024-04-24T13:33:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9556999999999998e-05 2024-04-24T13:33:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.571107+0000", 2024-04-24T13:33:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7558999999999995e-05 2024-04-24T13:33:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2226 3.1b 3:dbfdc3e7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.566142+0000", 2024-04-24T13:33:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.434825767, 2024-04-24T13:33:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013010147999999999, 2024-04-24T13:33:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2226 2024-04-24T13:33:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.566142+0000", 2024-04-24T13:33:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.566142+0000", 2024-04-24T13:33:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.566145+0000", 2024-04-24T13:33:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9399999999999998e-06 2024-04-24T13:33:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567556+0000", 2024-04-24T13:33:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014105700000000001 2024-04-24T13:33:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567583+0000", 2024-04-24T13:33:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7039e-05 2024-04-24T13:33:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567598+0000", 2024-04-24T13:33:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4659e-05 2024-04-24T13:33:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567691+0000", 2024-04-24T13:33:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3346999999999999e-05 2024-04-24T13:33:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567862+0000", 2024-04-24T13:33:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017056100000000001 2024-04-24T13:33:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.568014+0000", 2024-04-24T13:33:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152311 2024-04-24T13:33:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.574588+0000", 2024-04-24T13:33:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065744899999999997 2024-04-24T13:33:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579073+0000", 2024-04-24T13:33:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044842220000000004 2024-04-24T13:33:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579117+0000", 2024-04-24T13:33:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4181000000000003e-05 2024-04-24T13:33:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579153+0000", 2024-04-24T13:33:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5828000000000003e-05 2024-04-24T13:33:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2229 3.39 3:9efe271b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.598350+0000", 2024-04-24T13:33:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.402618603999997, 2024-04-24T13:33:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013444141999999999, 2024-04-24T13:33:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2229 2024-04-24T13:33:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.598350+0000", 2024-04-24T13:33:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.598350+0000", 2024-04-24T13:33:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.598353+0000", 2024-04-24T13:33:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3680000000000002e-06 2024-04-24T13:33:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600329+0000", 2024-04-24T13:33:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019763620000000002 2024-04-24T13:33:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600346+0000", 2024-04-24T13:33:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6606999999999999e-05 2024-04-24T13:33:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600356+0000", 2024-04-24T13:33:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7599999999999997e-06 2024-04-24T13:33:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600426+0000", 2024-04-24T13:33:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0476999999999996e-05 2024-04-24T13:33:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600552+0000", 2024-04-24T13:33:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012618699999999999 2024-04-24T13:33:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600638+0000", 2024-04-24T13:33:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6020999999999995e-05 2024-04-24T13:33:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.606922+0000", 2024-04-24T13:33:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062841049999999999 2024-04-24T13:33:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.611633+0000", 2024-04-24T13:33:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047101690000000002 2024-04-24T13:33:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.611729+0000", 2024-04-24T13:33:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6557000000000004e-05 2024-04-24T13:33:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.611794+0000", 2024-04-24T13:33:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4529000000000005e-05 2024-04-24T13:33:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2236 3.37 3:ee852927:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.678352+0000", 2024-04-24T13:33:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.322616250999999, 2024-04-24T13:33:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017640311999999998, 2024-04-24T13:33:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2236 2024-04-24T13:33:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.678352+0000", 2024-04-24T13:33:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.678352+0000", 2024-04-24T13:33:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.678355+0000", 2024-04-24T13:33:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0699999999999998e-06 2024-04-24T13:33:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681073+0000", 2024-04-24T13:33:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027178359999999999 2024-04-24T13:33:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681114+0000", 2024-04-24T13:33:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0695000000000003e-05 2024-04-24T13:33:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681132+0000", 2024-04-24T13:33:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8601999999999999e-05 2024-04-24T13:33:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681219+0000", 2024-04-24T13:33:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6773000000000004e-05 2024-04-24T13:33:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681393+0000", 2024-04-24T13:33:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174227 2024-04-24T13:33:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681540+0000", 2024-04-24T13:33:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014642799999999999 2024-04-24T13:33:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692163+0000", 2024-04-24T13:33:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010623873000000001 2024-04-24T13:33:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.695844+0000", 2024-04-24T13:33:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036807739999999999 2024-04-24T13:33:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.695924+0000", 2024-04-24T13:33:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9967000000000002e-05 2024-04-24T13:33:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.695992+0000", 2024-04-24T13:33:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8066999999999997e-05 2024-04-24T13:33:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2238 3.20 e85/20 3:07ab05cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_33:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.703968+0000", 2024-04-24T13:33:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.297000091999998, 2024-04-24T13:33:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014394229, 2024-04-24T13:33:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.703968+0000", 2024-04-24T13:33:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.703968+0000", 2024-04-24T13:33:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.703970+0000", 2024-04-24T13:33:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8369999999999999e-06 2024-04-24T13:33:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708553+0000", 2024-04-24T13:33:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045833100000000002 2024-04-24T13:33:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708574+0000", 2024-04-24T13:33:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0548999999999999e-05 2024-04-24T13:33:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708586+0000", 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1861e-05 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708652+0000", 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6321000000000004e-05 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708675+0000", 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2849000000000001e-05 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.718318+0000", 2024-04-24T13:33:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.009642856 2024-04-24T13:33:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.718362+0000", 2024-04-24T13:33:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4645999999999999e-05 2024-04-24T13:33:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2241 3.23 3:c5282e4b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.729720+0000", 2024-04-24T13:33:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.271247901000002, 2024-04-24T13:33:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012358245, 2024-04-24T13:33:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2241 2024-04-24T13:33:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.729720+0000", 2024-04-24T13:33:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.729720+0000", 2024-04-24T13:33:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.729724+0000", 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8190000000000002e-06 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732683+0000", 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029589490000000002 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732712+0000", 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8924e-05 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732727+0000", 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5537e-05 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732814+0000", 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6144999999999996e-05 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732956+0000", 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014276299999999999 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.733063+0000", 2024-04-24T13:33:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106393 2024-04-24T13:33:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741648+0000", 2024-04-24T13:33:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085851190000000004 2024-04-24T13:33:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741977+0000", 2024-04-24T13:33:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032933000000000002 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742038+0000", 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1134000000000001e-05 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742079+0000", 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0132000000000001e-05 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2249 3.1f 3:fad54725:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.815100+0000", 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.185867985000002, 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013270862, 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2249 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.815100+0000", 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.815100+0000", 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.815103+0000", 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0189999999999998e-06 2024-04-24T13:33:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816657+0000", 2024-04-24T13:33:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015535029999999999 2024-04-24T13:33:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816684+0000", 2024-04-24T13:33:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6956000000000001e-05 2024-04-24T13:33:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816695+0000", 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1681e-05 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816785+0000", 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9753999999999995e-05 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816960+0000", 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017443600000000001 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.817127+0000", 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016774499999999999 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.827609+0000", 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01048137 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828263+0000", 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000654746 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828309+0000", 2024-04-24T13:33:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6102e-05 2024-04-24T13:33:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828371+0000", 2024-04-24T13:33:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1550000000000005e-05 2024-04-24T13:33:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2251 3.3a e85/20 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head v 85'3, mlcod=81'1)", 2024-04-24T13:33:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.159741859, 2024-04-24T13:33:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024431608, 2024-04-24T13:33:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841228+0000", 2024-04-24T13:33:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.781e-06 2024-04-24T13:33:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846614+0000", 2024-04-24T13:33:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053854419999999998 2024-04-24T13:33:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846650+0000", 2024-04-24T13:33:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6133000000000001e-05 2024-04-24T13:33:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846669+0000", 2024-04-24T13:33:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9199e-05 2024-04-24T13:33:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846763+0000", 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4335999999999999e-05 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846799+0000", 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5796000000000001e-05 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865616+0000", 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018816825999999998 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865658+0000", 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2095000000000003e-05 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2254 3.20 e85/20 3:079960b7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_49:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.873589+0000", 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.127379421000001, 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014660608, 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.873589+0000", 2024-04-24T13:33:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.873589+0000", 2024-04-24T13:33:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.873590+0000", 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5069999999999999e-06 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877724+0000", 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041334249999999996 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877754+0000", 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9960000000000001e-05 2024-04-24T13:33:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877766+0000", 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2115e-05 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877845+0000", 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8988999999999999e-05 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877874+0000", 2024-04-24T13:33:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9329999999999999e-05 2024-04-24T13:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.888153+0000", 2024-04-24T13:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010279104000000001 2024-04-24T13:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.888249+0000", 2024-04-24T13:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6178e-05 2024-04-24T13:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2257 3.2b 3:d53685f1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.901887+0000", 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.099081613000003, 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012527972, 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2257 2024-04-24T13:33:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.901887+0000", 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.901887+0000", 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.901889+0000", 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.509e-06 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903738+0000", 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001848969 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903768+0000", 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0088000000000001e-05 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903791+0000", 2024-04-24T13:33:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2932e-05 2024-04-24T13:33:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903872+0000", 2024-04-24T13:33:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1304000000000006e-05 2024-04-24T13:33:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.904052+0000", 2024-04-24T13:33:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018003999999999999 2024-04-24T13:33:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.904226+0000", 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017409500000000001 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.909209+0000", 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049826030000000004 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914239+0000", 2024-04-24T13:33:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050297759999999997 2024-04-24T13:33:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914336+0000", 2024-04-24T13:33:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7233999999999998e-05 2024-04-24T13:33:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914415+0000", 2024-04-24T13:33:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8422000000000002e-05 2024-04-24T13:33:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2260 3.2b 3:d45c7bdc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.936956+0000", 2024-04-24T13:33:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.064011788999998, 2024-04-24T13:33:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011846031, 2024-04-24T13:33:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2260 2024-04-24T13:33:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.936956+0000", 2024-04-24T13:33:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.936956+0000", 2024-04-24T13:33:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.936959+0000", 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1020000000000001e-06 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938499+0000", 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015395369999999999 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938536+0000", 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6514000000000003e-05 2024-04-24T13:33:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938552+0000", 2024-04-24T13:33:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6758000000000001e-05 2024-04-24T13:33:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938657+0000", 2024-04-24T13:33:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104491 2024-04-24T13:33:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938840+0000", 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018292199999999999 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.939014+0000", 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174072 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.944477+0000", 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054635380000000004 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948667+0000", 2024-04-24T13:33:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041893970000000001 2024-04-24T13:33:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948741+0000", 2024-04-24T13:33:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4612999999999999e-05 2024-04-24T13:33:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948802+0000", 2024-04-24T13:33:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1087000000000007e-05 2024-04-24T13:33:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2264 3.18 e85/20 3:1be64b04:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_59:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.983667+0000", 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.017300794999997, 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011049814999999999, 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983667+0000", 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983667+0000", 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983683+0000", 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5894999999999999e-05 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985777+0000", 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020935950000000002 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985806+0000", 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9274000000000001e-05 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985820+0000", 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4059e-05 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985906+0000", 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5333000000000004e-05 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985937+0000", 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1636e-05 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994652+0000", 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.008714655 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994717+0000", 2024-04-24T13:33:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5368000000000002e-05 2024-04-24T13:33:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.155 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:01.156 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:01.156 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:01.085+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:01.189 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:01.189+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:01.290 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:01.287+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:01.294 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:01.294 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:01.294 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:01.294 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:01.310 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:33:01.404 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:01.403+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:01.481 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:01.481 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:01.481 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:01.482 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:01.482 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:01.493 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:01.491+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:01.495 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:33:01.552 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-24T13:33:01.553 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-24T13:33:01.609 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:33:01.632 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:01.631+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:01.671 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:33:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:33:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 156.45329309499999, 2024-04-24T13:33:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:33:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:33:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:33:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:33:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:33:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:33:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:33:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:33:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:33:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:33:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:33:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:33:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:33:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:33:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:33:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:33:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1584 4.4 4:22d8a9f0:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.2:head [create,call] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:33:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:17.733626+0000", 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.936371115, 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044360459999999999, 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1584 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733626+0000", 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733626+0000", 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733627+0000", 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9999999999999998e-07 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733630+0000", 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2499999999999998e-06 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733637+0000", 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0090000000000001e-06 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733647+0000", 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0134e-05 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733698+0000", 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0587000000000002e-05 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733828+0000", 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013058000000000001 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.733961+0000", 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000133089 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.734946+0000", 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00098401000000000001 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.737978+0000", 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030324340000000001 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738024+0000", 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6473e-05 2024-04-24T13:33:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:17.738062+0000", 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7979999999999999e-05 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5165.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.097370+0000", 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.572627443000002, 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052317040000000002, 2024-04-24T13:33:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5165", 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/3607738460", 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 48 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097370+0000", 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097370+0000", 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097371+0000", 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5000000000000003e-07 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097374+0000", 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1020000000000001e-06 2024-04-24T13:33:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097382+0000", 2024-04-24T13:33:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9440000000000005e-06 2024-04-24T13:33:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097387+0000", 2024-04-24T13:33:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5879999999999997e-06 2024-04-24T13:33:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097449+0000", 2024-04-24T13:33:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1939000000000004e-05 2024-04-24T13:33:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097533+0000", 2024-04-24T13:33:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4295000000000005e-05 2024-04-24T13:33:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.097652+0000", 2024-04-24T13:33:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011874099999999999 2024-04-24T13:33:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.099879+0000", 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002227035 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.102504+0000", 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026247499999999999 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.102558+0000", 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3557999999999998e-05 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.102602+0000", 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4202000000000001e-05 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1615 3.1a e82/20 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head v 82'1, mlcod=0'0)", 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.457013258000003, 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013622553000000001, 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212985+0000", 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1370000000000001e-06 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219240+0000", 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062543240000000003 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219257+0000", 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6940999999999999e-05 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219267+0000", 2024-04-24T13:33:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0283e-05 2024-04-24T13:33:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219324+0000", 2024-04-24T13:33:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6950999999999997e-05 2024-04-24T13:33:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219343+0000", 2024-04-24T13:33:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8681999999999998e-05 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226529+0000", 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071867169999999996 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226607+0000", 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7517999999999999e-05 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1618 3.36 e82/74 3:6e88aafa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4_10Mb.:head v 82'1, mlcod=0'0)", 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.237136+0000", 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.432861088999999, 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010263291000000001, 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.237136+0000", 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.237136+0000", 2024-04-24T13:33:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.237137+0000", 2024-04-24T13:33:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0300000000000001e-06 2024-04-24T13:33:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.242425+0000", 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0052873820000000002 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.242446+0000", 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1325e-05 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.242458+0000", 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1748e-05 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.242538+0000", 2024-04-24T13:33:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0125999999999998e-05 2024-04-24T13:33:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.242558+0000", 2024-04-24T13:33:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0188999999999999e-05 2024-04-24T13:33:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.247357+0000", 2024-04-24T13:33:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047993020000000001 2024-04-24T13:33:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.247400+0000", 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2188999999999999e-05 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1702 4.4 4:22d8a9f0:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.4.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.605947+0000", 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 43.064050373999997, 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047668060000000002, 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1702 2024-04-24T13:33:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605947+0000", 2024-04-24T13:33:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605947+0000", 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605948+0000", 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7800000000000002e-07 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605950+0000", 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1600000000000001e-06 2024-04-24T13:33:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605956+0000", 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.579e-06 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.605962+0000", 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5670000000000002e-06 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606002+0000", 2024-04-24T13:33:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9983e-05 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606063+0000", 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1371000000000006e-05 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.606144+0000", 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0307000000000002e-05 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.607804+0000", 2024-04-24T13:33:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001660796 2024-04-24T13:33:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610642+0000", 2024-04-24T13:33:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028376249999999999 2024-04-24T13:33:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610673+0000", 2024-04-24T13:33:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0939999999999999e-05 2024-04-24T13:33:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.610714+0000", 2024-04-24T13:33:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1e-05 2024-04-24T13:33:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1730 8.15 8:a9005206:root::buck_2024_03_24_13_32_18:head [create,call version.set in=10b,writefull 0~192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:33:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.763558+0000", 2024-04-24T13:33:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.906439442, 2024-04-24T13:33:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047981330000000004, 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1730 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763558+0000", 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763558+0000", 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763559+0000", 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9399999999999993e-07 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763563+0000", 2024-04-24T13:33:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2699999999999998e-06 2024-04-24T13:33:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763575+0000", 2024-04-24T13:33:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1399e-05 2024-04-24T13:33:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763580+0000", 2024-04-24T13:33:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5289999999999999e-06 2024-04-24T13:33:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763623+0000", 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2605000000000003e-05 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763705+0000", 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2568e-05 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.763797+0000", 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1699000000000004e-05 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.764256+0000", 2024-04-24T13:33:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000458646 2024-04-24T13:33:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.768258+0000", 2024-04-24T13:33:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040020059999999998 2024-04-24T13:33:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.768311+0000", 2024-04-24T13:33:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3482000000000001e-05 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.768356+0000", 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4935000000000003e-05 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:1923 4.39 4:9f83bdcd:::.dir.e142676b-7cd6-4a83-935a-7deccd638cec.4385.6.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e82)", 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:19.274441+0000", 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.395556824000003, 2024-04-24T13:33:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042793869999999999, 2024-04-24T13:33:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 1923 2024-04-24T13:33:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274441+0000", 2024-04-24T13:33:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274441+0000", 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274441+0000", 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4700000000000001e-07 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274444+0000", 2024-04-24T13:33:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.88e-06 2024-04-24T13:33:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274451+0000", 2024-04-24T13:33:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0670000000000003e-06 2024-04-24T13:33:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274457+0000", 2024-04-24T13:33:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5380000000000002e-06 2024-04-24T13:33:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274511+0000", 2024-04-24T13:33:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4138999999999998e-05 2024-04-24T13:33:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274581+0000", 2024-04-24T13:33:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0042999999999993e-05 2024-04-24T13:33:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.274672+0000", 2024-04-24T13:33:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0823999999999996e-05 2024-04-24T13:33:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.275470+0000", 2024-04-24T13:33:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00079784500000000004 2024-04-24T13:33:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.278668+0000", 2024-04-24T13:33:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0031979209999999998 2024-04-24T13:33:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.278696+0000", 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8835000000000001e-05 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:19.278720+0000", 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3547999999999999e-05 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2211 3.8 e85/20 3:123ae70b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_6:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.382654+0000", 2024-04-24T13:33:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.287343043999996, 2024-04-24T13:33:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010426609, 2024-04-24T13:33:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382654+0000", 2024-04-24T13:33:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382654+0000", 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.382657+0000", 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4959999999999999e-06 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.387392+0000", 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004735553 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.387428+0000", 2024-04-24T13:33:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5493000000000001e-05 2024-04-24T13:33:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.387451+0000", 2024-04-24T13:33:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3025999999999999e-05 2024-04-24T13:33:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.387550+0000", 2024-04-24T13:33:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8577000000000002e-05 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.387575+0000", 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5877e-05 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.393039+0000", 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054634159999999996 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.393081+0000", 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2171e-05 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2214 3.1a e85/20 3:5b3ced30:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_9:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.444464+0000", 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.225533247999998, 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095313129999999996, 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.444464+0000", 2024-04-24T13:33:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.444464+0000", 2024-04-24T13:33:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.444465+0000", 2024-04-24T13:33:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7599999999999998e-07 2024-04-24T13:33:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.449241+0000", 2024-04-24T13:33:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004776789 2024-04-24T13:33:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.449270+0000", 2024-04-24T13:33:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8671e-05 2024-04-24T13:33:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.449284+0000", 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4158999999999999e-05 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.449391+0000", 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106338 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.449410+0000", 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9097e-05 2024-04-24T13:33:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453927+0000", 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045175800000000002 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453996+0000", 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8303e-05 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2219 3.0 3:00e6fe99:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.177858864000001, 2024-04-24T13:33:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01535366, 2024-04-24T13:33:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2219 2024-04-24T13:33:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492150+0000", 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1046999999999999e-05 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494106+0000", 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019561940000000001 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494133+0000", 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7617999999999999e-05 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494150+0000", 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6096999999999999e-05 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494240+0000", 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0786999999999997e-05 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494435+0000", 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000195021 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494611+0000", 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017601100000000001 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507078+0000", 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012466395 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507374+0000", 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029577100000000001 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507429+0000", 2024-04-24T13:33:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5928999999999999e-05 2024-04-24T13:33:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507492+0000", 2024-04-24T13:33:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.279e-05 2024-04-24T13:33:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2223 3.3 e85/48 3:c1ee41bc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_18:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.539419+0000", 2024-04-24T13:33:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.130578661999998, 2024-04-24T13:33:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010699759, 2024-04-24T13:33:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.539419+0000", 2024-04-24T13:33:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.539419+0000", 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.539421+0000", 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.781e-06 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.543832+0000", 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044113650000000004 2024-04-24T13:33:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.543851+0000", 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8597000000000002e-05 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.543860+0000", 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5980000000000003e-06 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.543947+0000", 2024-04-24T13:33:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6914000000000002e-05 2024-04-24T13:33:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.543980+0000", 2024-04-24T13:33:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3423999999999997e-05 2024-04-24T13:33:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.550037+0000", 2024-04-24T13:33:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060562869999999996 2024-04-24T13:33:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.550119+0000", 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1792999999999994e-05 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2228 3.3e 3:7d0db293:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.587544+0000", 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.082453504999997, 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012513471999999999, 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2228 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.587544+0000", 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.587544+0000", 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.587547+0000", 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0769999999999999e-06 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.589054+0000", 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015069969999999999 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.589085+0000", 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0822999999999999e-05 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.589100+0000", 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5438999999999999e-05 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.589168+0000", 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7917999999999996e-05 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.589279+0000", 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011125599999999999 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.589397+0000", 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117631 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.599257+0000", 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0098601820000000003 2024-04-24T13:33:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.599967+0000", 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070969700000000002 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600023+0000", 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5763000000000001e-05 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600057+0000", 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4688999999999999e-05 2024-04-24T13:33:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2230 3.19 3:99352026:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.061875874000002, 2024-04-24T13:33:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013072217000000001, 2024-04-24T13:33:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2230 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608124+0000", 2024-04-24T13:33:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6740000000000001e-06 2024-04-24T13:33:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609736+0000", 2024-04-24T13:33:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016116430000000001 2024-04-24T13:33:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609766+0000", 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0497e-05 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609781+0000", 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4810999999999999e-05 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609861+0000", 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9320999999999995e-05 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609972+0000", 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111116 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.610087+0000", 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115161 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.620611+0000", 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010524554 2024-04-24T13:33:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621126+0000", 2024-04-24T13:33:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051447699999999995 2024-04-24T13:33:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621163+0000", 2024-04-24T13:33:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6838999999999997e-05 2024-04-24T13:33:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621194+0000", 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1124000000000002e-05 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2231 3.36 e85/74 3:6ddceaef:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_26:head v 85'3, mlcod=82'1)", 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.624392+0000", 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.045605700999999, 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010159865000000001, 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.624392+0000", 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.624392+0000", 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.624392+0000", 2024-04-24T13:33:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8999999999999997e-07 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.629437+0000", 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050451469999999998 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.629466+0000", 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8912999999999999e-05 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.629481+0000", 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4232e-05 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.629555+0000", 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4732000000000002e-05 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.629576+0000", 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0815e-05 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.634489+0000", 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004913199 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.634552+0000", 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2336999999999996e-05 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2236 3.37 e85/74 3:ee852927:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_31:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.681646+0000", 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.988351481999999, 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010827566, 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681646+0000", 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681646+0000", 2024-04-24T13:33:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681648+0000", 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.835e-06 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.684001+0000", 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023527560000000001 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.684034+0000", 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3386000000000002e-05 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.684049+0000", 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4873e-05 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.684161+0000", 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111965 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.684182+0000", 2024-04-24T13:33:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1475999999999999e-05 2024-04-24T13:33:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692411+0000", 2024-04-24T13:33:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0082288799999999992 2024-04-24T13:33:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692474+0000", 2024-04-24T13:33:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2395000000000001e-05 2024-04-24T13:33:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2237 3.25 3:a6fa5a1e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.689504+0000", 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.980493404000001, 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01220517, 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2237 2024-04-24T13:33:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.689504+0000", 2024-04-24T13:33:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.689504+0000", 2024-04-24T13:33:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.689507+0000", 2024-04-24T13:33:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8940000000000002e-06 2024-04-24T13:33:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692056+0000", 2024-04-24T13:33:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025493159999999998 2024-04-24T13:33:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692075+0000", 2024-04-24T13:33:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8813000000000001e-05 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692087+0000", 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2153999999999999e-05 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692166+0000", 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8782000000000006e-05 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692310+0000", 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014354099999999999 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692467+0000", 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015749399999999999 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.701192+0000", 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0087253699999999997 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.701583+0000", 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000390582 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.701652+0000", 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8534999999999993e-05 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.701709+0000", 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7689000000000003e-05 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2252 3.4 3:22834b58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.824418924, 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932545999999999, 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2252 2024-04-24T13:33:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845581+0000", 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847834+0000", 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002252843 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847863+0000", 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.904e-05 2024-04-24T13:33:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847877+0000", 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4126e-05 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847963+0000", 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6162999999999995e-05 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848105+0000", 2024-04-24T13:33:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014117900000000001 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848252+0000", 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014774800000000001 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865043+0000", 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016790848000000001 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865405+0000", 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036176900000000001 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865460+0000", 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5334000000000002e-05 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865511+0000", 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0784e-05 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2257 3.2b e85/41 3:d53685f1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_52:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.904367+0000", 2024-04-24T13:33:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.765630324, 2024-04-24T13:33:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0096071509999999995, 2024-04-24T13:33:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.904367+0000", 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.904367+0000", 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.904369+0000", 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.074e-06 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.906132+0000", 2024-04-24T13:33:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001762818 2024-04-24T13:33:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.906164+0000", 2024-04-24T13:33:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2293999999999999e-05 2024-04-24T13:33:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.906180+0000", 2024-04-24T13:33:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5991999999999999e-05 2024-04-24T13:33:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.906279+0000", 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9128000000000004e-05 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.906314+0000", 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4771999999999998e-05 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.913885+0000", 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075708340000000002 2024-04-24T13:33:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.913974+0000", 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9239000000000004e-05 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2260 3.2b e85/41 3:d45c7bdc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_55:head v 85'3, mlcod=82'1)", 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.939209+0000", 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.730788138999998, 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0092006999999999992, 2024-04-24T13:33:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.939209+0000", 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.939209+0000", 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.939211+0000", 2024-04-24T13:33:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.705e-06 2024-04-24T13:33:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.941104+0000", 2024-04-24T13:33:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001892604 2024-04-24T13:33:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.941137+0000", 2024-04-24T13:33:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3107e-05 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.941153+0000", 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6379999999999999e-05 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.941247+0000", 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3685999999999997e-05 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.941276+0000", 2024-04-24T13:33:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8756e-05 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948342+0000", 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070663840000000002 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948410+0000", 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8077999999999994e-05 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:01.777 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:01.777 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:33:01.778 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:01.777+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:01.779 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:33:01.879 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:01.879+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:01.938 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:01.938 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:01.938 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:01.954 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:33:01.960 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:01.960 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:01.977 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:01.977 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:01.980 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:01.977+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:01.993 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:01.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:02.009 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:02.010 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:02.030 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:02.031 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:02.055 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:02.056 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:02.072 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:02.072 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:02.073 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:02.073 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:02.081 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:02.077+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:02.087 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:33:02.094 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:02.094 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:02.182 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:02.181+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:02.210 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:02.210 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:02.223 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:33:02.284 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:02.281+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:02.344 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:02.345 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:02.359 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:33:02.386 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:02.381+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:02.482 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:02.482 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:02.486 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:02.483+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:02.497 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:33:02.587 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:02.585+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:02.601 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.0 to 1 (10000) 2024-04-24T13:33:02.601 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:33:02.629 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-24T13:33:02.680 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:02.680 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:02.688 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:02.685+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:02.695 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:33:02.789 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:02.787+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:02.827 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:02.827 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:02.841 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:33:02.890 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:02.889+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:02.965 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:02.966 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:02.981 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:33:03.022 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:03.021+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:03.092 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:03.089+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:03.095 INFO:tasks.workunit.client.0.smithi071.stderr:100+0 records in 2024-04-24T13:33:03.095 INFO:tasks.workunit.client.0.smithi071.stderr:100+0 records out 2024-04-24T13:33:03.095 INFO:tasks.workunit.client.0.smithi071.stderr:1048576000 bytes (1.0 GB, 1000 MiB) copied, 7.49622 s, 140 MB/s 2024-04-24T13:33:03.140 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:03.140 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:03.155 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:33:03.192 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:03.191+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:03.293 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:03.291+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:03.321 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:03.322 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:03.335 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:33:03.394 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:03.391+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:03.453 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:03.453 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:03.467 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:33:03.495 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:03.495+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:03.589 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:03.589 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:03.595 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:03.593+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:03.604 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:33:03.607 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.1 to 1 (10000) 2024-04-24T13:33:03.628 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-24T13:33:03.715 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:03.715+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:03.769 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:03.769 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:03.783 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:33:03.830 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:03.829+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:03.898 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:03.893+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:03.902 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:03.902 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:03.916 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:33:04.002 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:04.001+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:04.083 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:04.083 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:04.097 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:33:04.112 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:33:04.138 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:04.137+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:04.201 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:04.197+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:04.254 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:04.254 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:04.263 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:04.263 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:04.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:04.272 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:04.278 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:04.289 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:04.289 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:04.305 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:04.305 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:04.325 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:04.325 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:04.326 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:04.325+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:04.343 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:04.343 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:04.360 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:04.361 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:04.391 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:04.391 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:04.403 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:04.401+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:04.450 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:04.451 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:04.451 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:33:04.451 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:33:04.451 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:04.464 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:04.506 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:04.505+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:04.605 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:04.603+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:04.612 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.2 to 1 (10000) 2024-04-24T13:33:04.633 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:04.633 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:33:04.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:33:04.633 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:33:04.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.633 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.633 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:33:04.633 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.77357962799999, 2024-04-24T13:33:04.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:33:04.633 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.634 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.634 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.634 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.634 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.634 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.634 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:33:04.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.634 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:33:04.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:33:04.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:33:04.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:33:04.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:33:04.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:33:04.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:33:04.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:33:04.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:33:04.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:33:04.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:33:04.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:33:04.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:33:04.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:33:04.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:33:04.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:33:04.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.639 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:33:04.640 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.77355685399999, 2024-04-24T13:33:04.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:33:04.640 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.640 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.640 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.640 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.640 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.640 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.640 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:33:04.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.640 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:33:04.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:33:04.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:33:04.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:33:04.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:33:04.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:33:04.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:33:04.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:33:04.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:33:04.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:33:04.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:33:04.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:33:04.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:33:04.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:33:04.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:33:04.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:33:04.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:33:04.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:33:04.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:33:04.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:33:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:33:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:33:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:33:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:33:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.645 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.646 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.646 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:33:04.646 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.67594942100001, 2024-04-24T13:33:04.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:33:04.646 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.646 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.646 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.646 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.646 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.646 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.646 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:33:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:33:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:33:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:33:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:33:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:33:04.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:33:04.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.651 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.652 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.652 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:33:04.652 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.67586178400001, 2024-04-24T13:33:04.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:33:04.652 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.652 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.652 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.652 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.652 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.652 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.652 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:33:04.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:33:04.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:33:04.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:33:04.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:33:04.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:33:04.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:33:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:33:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:33:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:33:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:33:04.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:33:04.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:33:04.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:33:04.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:33:04.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:33:04.657 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.57020789699999, 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.658 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.659 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:33:04.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.659 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:33:04.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:33:04.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:33:04.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:33:04.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:33:04.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:33:04.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:33:04.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:33:04.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:33:04.663 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.57000337900001, 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.664 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.665 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:33:04.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.665 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:33:04.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:33:04.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:33:04.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:33:04.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:33:04.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:33:04.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:33:04.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:33:04.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:33:04.669 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.670 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.670 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.670 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.670 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:33:04.670 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.56964355599999, 2024-04-24T13:33:04.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:33:04.670 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.670 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.670 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.670 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.670 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:33:04.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:33:04.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:33:04.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:33:04.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:33:04.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:33:04.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:33:04.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:33:04.675 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.56947515300001, 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.676 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:33:04.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:33:04.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:33:04.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:33:04.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:33:04.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:33:04.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:33:04.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:33:04.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:33:04.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:33:04.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:33:04.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:33:04.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:33:04.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:33:04.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:33:04.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:33:04.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:33:04.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.56926676200001, 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.682 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.683 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.683 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:33:04.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.683 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:33:04.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:33:04.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:33:04.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:33:04.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:33:04.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:33:04.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:33:04.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:33:04.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:33:04.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:33:04.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:33:04.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:33:04.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:33:04.688 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.688 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.688 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.688 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.688 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:33:04.688 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.56916890900001, 2024-04-24T13:33:04.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:33:04.688 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.688 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.688 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.689 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.689 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.689 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.689 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:33:04.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.689 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:33:04.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:33:04.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:33:04.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:33:04.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:33:04.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:33:04.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:33:04.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.56906776, 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.694 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.695 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.695 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.695 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.695 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:33:04.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.695 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:33:04.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:33:04.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:33:04.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:33:04.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:33:04.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:33:04.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:33:04.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:33:04.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:33:04.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:33:04.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:33:04.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:33:04.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:33:04.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:33:04.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:33:04.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:33:04.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:33:04.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.56881104799999, 2024-04-24T13:33:04.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:33:04.701 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.701 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.701 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.701 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.701 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.701 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.701 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:33:04.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.701 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:33:04.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:33:04.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:33:04.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:33:04.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:33:04.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:33:04.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:33:04.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:33:04.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:33:04.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:33:04.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:33:04.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:33:04.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:33:04.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:33:04.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:33:04.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:33:04.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:33:04.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:33:04.706 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.706 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.706 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.706 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:33:04.706 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:33:04.706 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.706 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.706 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.707 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.707 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.707 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.707 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:33:04.707 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.56870138599999, 2024-04-24T13:33:04.707 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:33:04.707 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.707 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.707 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.707 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.707 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.707 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.707 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.708 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:33:04.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:33:04.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:33:04.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:33:04.709 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.709 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.709 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.709 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:33:04.709 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:33:04.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:33:04.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:33:04.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.710 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:33:04.710 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:33:04.710 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.710 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.710 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:33:04.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:33:04.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:33:04.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:33:04.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.711 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.711 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:33:04.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:33:04.711 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:33:04.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:33:04.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:33:04.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:33:04.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:33:04.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:33:04.713 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.713 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.713 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.713 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.713 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:33:04.713 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.56862935699999, 2024-04-24T13:33:04.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:33:04.713 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.713 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:33:04.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:33:04.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:33:04.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:33:04.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:33:04.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:33:04.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:33:04.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:33:04.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:33:04.719 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.719 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.719 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.719 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.719 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:33:04.719 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.56845832100001, 2024-04-24T13:33:04.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:33:04.719 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.719 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.720 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.720 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.720 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.720 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.720 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:33:04.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.720 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:33:04.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:33:04.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:33:04.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:33:04.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:33:04.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:33:04.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:33:04.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:33:04.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:33:04.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:33:04.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:33:04.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:33:04.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:33:04.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:33:04.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:33:04.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:33:04.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:33:04.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:33:04.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:33:04.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:33:04.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:33:04.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:33:04.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:33:04.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:33:04.725 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.725 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.725 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.725 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.726 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:33:04.726 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.56841882800001, 2024-04-24T13:33:04.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:33:04.726 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.726 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.726 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.726 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.726 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.726 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.726 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:33:04.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.726 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:33:04.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:33:04.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:33:04.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:33:04.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:33:04.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:33:04.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:33:04.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:33:04.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:33:04.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:33:04.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.729 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.729 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:33:04.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:33:04.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:33:04.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.31509957200001, 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.732 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:33:04.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:33:04.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:33:04.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:33:04.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:33:04.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:33:04.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:33:04.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:33:04.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:33:04.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:33:04.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:33:04.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:33:04.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.735 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.735 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:33:04.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:33:04.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:33:04.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:33:04.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:33:04.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:33:04.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:33:04.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:33:04.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:33:04.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:33:04.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:33:04.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:33:04.738 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.738 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.738 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.738 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.738 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:33:04.738 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.31507352400001, 2024-04-24T13:33:04.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:33:04.738 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.739 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.739 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.739 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.739 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.739 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.739 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:33:04.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.739 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:33:04.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:33:04.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.741 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:33:04.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:33:04.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:33:04.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:33:04.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:33:04.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:33:04.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:33:04.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:33:04.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:33:04.744 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.744 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.744 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.744 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.744 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:33:04.744 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.315048168, 2024-04-24T13:33:04.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:33:04.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:33:04.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.748 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:33:04.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:33:04.750 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.750 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.750 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.750 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:04.750 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:33:04.750 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 175.314957099, 2024-04-24T13:33:04.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:33:04.750 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:04.750 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:04.750 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:04.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:33:04.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:04.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:04.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:33:04.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:33:04.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:04.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:33:04.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:33:04.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:33:04.754 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:33:04.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:33:04.756 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.756 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.756 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.756 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:04.756 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:04.756 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:04.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:33:04.758 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-24T13:33:04.759 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:04.755+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:04.759 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:04.859 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:04.859+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:04.918 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:04.919 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:04.919 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:04.919 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:04.934 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:04.960 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:04.957+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:05.061 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:05.057+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:05.088 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:05.088 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:05.088 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:05.088 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:05.088 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:05.101 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:05.163 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:05.161+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:05.250 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:05.250 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:05.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:05.251 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:05.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.251 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2206 3.f e85/48 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:05.251 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:05.251 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.953791527999996, 2024-04-24T13:33:05.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022785151, 2024-04-24T13:33:05.251 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.251 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.251 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295567+0000", 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3939999999999999e-06 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299770+0000", 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042038029999999999 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299808+0000", 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7703000000000001e-05 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299826+0000", 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8142999999999999e-05 2024-04-24T13:33:05.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299972+0000", 2024-04-24T13:33:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000146095 2024-04-24T13:33:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.300023+0000", 2024-04-24T13:33:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0294999999999999e-05 2024-04-24T13:33:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318209+0000", 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018186099000000001 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318349+0000", 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140619 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2210 3.23 3:c462163d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.355657+0000", 2024-04-24T13:33:05.255 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.893698722000003, 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018889975999999999, 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2210 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.355657+0000", 2024-04-24T13:33:05.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.355657+0000", 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.355661+0000", 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.517e-06 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358401+0000", 2024-04-24T13:33:05.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027400219999999999 2024-04-24T13:33:05.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358440+0000", 2024-04-24T13:33:05.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9348999999999999e-05 2024-04-24T13:33:05.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358466+0000", 2024-04-24T13:33:05.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.561e-05 2024-04-24T13:33:05.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358635+0000", 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016971799999999999 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.358913+0000", 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027758600000000002 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.359151+0000", 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023834999999999999 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374171+0000", 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015020179 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374235+0000", 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3862000000000006e-05 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374415+0000", 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000179758 2024-04-24T13:33:05.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.374547+0000", 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000132025 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2212 3.3a e85/20 3:5de7fd4f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_7:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.406594+0000", 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.842761316000001, 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016608241999999999, 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.261 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.406594+0000", 2024-04-24T13:33:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.406594+0000", 2024-04-24T13:33:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.406597+0000", 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8260000000000001e-06 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412366+0000", 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057682439999999996 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412410+0000", 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4656000000000001e-05 2024-04-24T13:33:05.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412432+0000", 2024-04-24T13:33:05.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1971e-05 2024-04-24T13:33:05.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412637+0000", 2024-04-24T13:33:05.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020509900000000001 2024-04-24T13:33:05.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.412680+0000", 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2326000000000001e-05 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.423087+0000", 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010407533 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.423203+0000", 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115587 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.265 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2215 3.23 3:c703bbd7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_10:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.451222+0000", 2024-04-24T13:33:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.798134298999997, 2024-04-24T13:33:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016321080000000002, 2024-04-24T13:33:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2215 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.451222+0000", 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.451222+0000", 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.451225+0000", 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4199999999999999e-06 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453253+0000", 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020277300000000002 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453279+0000", 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6684000000000001e-05 2024-04-24T13:33:05.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453292+0000", 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3016999999999999e-05 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453382+0000", 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9310999999999999e-05 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453520+0000", 2024-04-24T13:33:05.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013785300000000001 2024-04-24T13:33:05.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:05.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.453651+0000", 2024-04-24T13:33:05.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000131497 2024-04-24T13:33:05.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467323+0000", 2024-04-24T13:33:05.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013671513999999999 2024-04-24T13:33:05.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467428+0000", 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105499 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467488+0000", 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0075999999999999e-05 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.467543+0000", 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4478999999999998e-05 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.271 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2216 3.3d 3:bf22edaf:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.788038516999997, 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027972988000000001, 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.272 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2216 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461320+0000", 2024-04-24T13:33:05.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7049999999999999e-06 2024-04-24T13:33:05.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462822+0000", 2024-04-24T13:33:05.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015018919999999999 2024-04-24T13:33:05.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462846+0000", 2024-04-24T13:33:05.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4229000000000001e-05 2024-04-24T13:33:05.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462856+0000", 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8619999999999998e-06 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462932+0000", 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6126999999999998e-05 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463098+0000", 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016631400000000001 2024-04-24T13:33:05.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:05.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463231+0000", 2024-04-24T13:33:05.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013278699999999999 2024-04-24T13:33:05.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475573+0000", 2024-04-24T13:33:05.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012342148000000001 2024-04-24T13:33:05.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489102+0000", 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013528755 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489210+0000", 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010779400000000001 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489290+0000", 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0375000000000002e-05 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.278 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2217 3.7 e85/41 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:05.278 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:05.278 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.775629174000002, 2024-04-24T13:33:05.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022815940999999999, 2024-04-24T13:33:05.278 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.278 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.278 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.278 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:05.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473728+0000", 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6080000000000001e-06 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475783+0000", 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002054349 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475801+0000", 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8054e-05 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475814+0000", 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3515e-05 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488934+0000", 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013119772 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488977+0000", 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2922e-05 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496474+0000", 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074975320000000003 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496543+0000", 2024-04-24T13:33:05.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8188999999999994e-05 2024-04-24T13:33:05.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.282 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.282 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop_reply(client.4385.0:2216 3.3d e85/20 ondisk, result = 0)", 2024-04-24T13:33:05.282 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.475903+0000", 2024-04-24T13:33:05.282 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.773452480000003, 2024-04-24T13:33:05.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013396491, 2024-04-24T13:33:05.282 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475903+0000", 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475903+0000", 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475904+0000", 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6700000000000002e-07 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475909+0000", 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0660000000000003e-06 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488939+0000", 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013029850000000001 2024-04-24T13:33:05.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488960+0000", 2024-04-24T13:33:05.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1185000000000001e-05 2024-04-24T13:33:05.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489075+0000", 2024-04-24T13:33:05.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114324 2024-04-24T13:33:05.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489094+0000", 2024-04-24T13:33:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9449e-05 2024-04-24T13:33:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489300+0000", 2024-04-24T13:33:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020565000000000001 2024-04-24T13:33:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2220 3.1b 3:da538345:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.286 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.502923+0000", 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.746432571, 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012431563, 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2220 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.502923+0000", 2024-04-24T13:33:05.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.502923+0000", 2024-04-24T13:33:05.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.502926+0000", 2024-04-24T13:33:05.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6589999999999999e-06 2024-04-24T13:33:05.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504795+0000", 2024-04-24T13:33:05.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018686810000000001 2024-04-24T13:33:05.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504827+0000", 2024-04-24T13:33:05.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.243e-05 2024-04-24T13:33:05.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504840+0000", 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3329999999999999e-05 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.504915+0000", 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4484e-05 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.505074+0000", 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158913 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.505171+0000", 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7263999999999996e-05 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.510540+0000", 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053688659999999999 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.515256+0000", 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047159009999999998 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.515302+0000", 2024-04-24T13:33:05.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6230000000000003e-05 2024-04-24T13:33:05.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.515355+0000", 2024-04-24T13:33:05.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2805e-05 2024-04-24T13:33:05.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.292 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.292 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2225 3.23 3:c532fe0d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_20:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.555517+0000", 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.693838960000001, 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015590068, 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2225 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.555517+0000", 2024-04-24T13:33:05.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.555517+0000", 2024-04-24T13:33:05.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.555519+0000", 2024-04-24T13:33:05.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1289999999999999e-06 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557097+0000", 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001577813 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557130+0000", 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3290999999999997e-05 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557146+0000", 2024-04-24T13:33:05.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6030000000000001e-05 2024-04-24T13:33:05.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557267+0000", 2024-04-24T13:33:05.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012072 2024-04-24T13:33:05.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557381+0000", 2024-04-24T13:33:05.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114648 2024-04-24T13:33:05.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.557501+0000", 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119775 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.569052+0000", 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011551074 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.570970+0000", 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019174719999999999 2024-04-24T13:33:05.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.571039+0000", 2024-04-24T13:33:05.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9556999999999998e-05 2024-04-24T13:33:05.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.571107+0000", 2024-04-24T13:33:05.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7558999999999995e-05 2024-04-24T13:33:05.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.298 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.298 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.299 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2226 3.1b 3:dbfdc3e7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.299 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.566142+0000", 2024-04-24T13:33:05.299 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.683213406999997, 2024-04-24T13:33:05.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013010147999999999, 2024-04-24T13:33:05.299 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.299 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.299 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.299 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.299 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2226 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.566142+0000", 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.566142+0000", 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.566145+0000", 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9399999999999998e-06 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567556+0000", 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014105700000000001 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567583+0000", 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7039e-05 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567598+0000", 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4659e-05 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567691+0000", 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3346999999999999e-05 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.567862+0000", 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017056100000000001 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.568014+0000", 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152311 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.574588+0000", 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065744899999999997 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579073+0000", 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044842220000000004 2024-04-24T13:33:05.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579117+0000", 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4181000000000003e-05 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579153+0000", 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5828000000000003e-05 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2229 3.39 3:9efe271b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.598350+0000", 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.651006244000001, 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013444141999999999, 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2229 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.598350+0000", 2024-04-24T13:33:05.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.598350+0000", 2024-04-24T13:33:05.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.598353+0000", 2024-04-24T13:33:05.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3680000000000002e-06 2024-04-24T13:33:05.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600329+0000", 2024-04-24T13:33:05.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019763620000000002 2024-04-24T13:33:05.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600346+0000", 2024-04-24T13:33:05.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6606999999999999e-05 2024-04-24T13:33:05.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600356+0000", 2024-04-24T13:33:05.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7599999999999997e-06 2024-04-24T13:33:05.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600426+0000", 2024-04-24T13:33:05.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0476999999999996e-05 2024-04-24T13:33:05.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600552+0000", 2024-04-24T13:33:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012618699999999999 2024-04-24T13:33:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600638+0000", 2024-04-24T13:33:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6020999999999995e-05 2024-04-24T13:33:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.606922+0000", 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062841049999999999 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.611633+0000", 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047101690000000002 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.611729+0000", 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6557000000000004e-05 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.611794+0000", 2024-04-24T13:33:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4529000000000005e-05 2024-04-24T13:33:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2236 3.37 3:ee852927:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_31:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.678352+0000", 2024-04-24T13:33:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.571003890999997, 2024-04-24T13:33:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017640311999999998, 2024-04-24T13:33:05.311 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2236 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.678352+0000", 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.678352+0000", 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.678355+0000", 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0699999999999998e-06 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681073+0000", 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027178359999999999 2024-04-24T13:33:05.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681114+0000", 2024-04-24T13:33:05.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0695000000000003e-05 2024-04-24T13:33:05.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681132+0000", 2024-04-24T13:33:05.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8601999999999999e-05 2024-04-24T13:33:05.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681219+0000", 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6773000000000004e-05 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681393+0000", 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174227 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.681540+0000", 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014642799999999999 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692163+0000", 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010623873000000001 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.695844+0000", 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036807739999999999 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.695924+0000", 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9967000000000002e-05 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.695992+0000", 2024-04-24T13:33:05.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8066999999999997e-05 2024-04-24T13:33:05.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.317 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.317 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.317 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2238 3.20 e85/20 3:07ab05cc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_33:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:05.317 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.703968+0000", 2024-04-24T13:33:05.317 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.545387732000002, 2024-04-24T13:33:05.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014394229, 2024-04-24T13:33:05.318 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.318 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.318 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.318 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.703968+0000", 2024-04-24T13:33:05.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.703968+0000", 2024-04-24T13:33:05.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.703970+0000", 2024-04-24T13:33:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8369999999999999e-06 2024-04-24T13:33:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708553+0000", 2024-04-24T13:33:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045833100000000002 2024-04-24T13:33:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708574+0000", 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0548999999999999e-05 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708586+0000", 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1861e-05 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708652+0000", 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6321000000000004e-05 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.708675+0000", 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2849000000000001e-05 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.718318+0000", 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.009642856 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.718362+0000", 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4645999999999999e-05 2024-04-24T13:33:05.321 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.322 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.322 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.322 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2241 3.23 3:c5282e4b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.322 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.729720+0000", 2024-04-24T13:33:05.322 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.519635541, 2024-04-24T13:33:05.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012358245, 2024-04-24T13:33:05.322 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.322 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.322 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.322 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.322 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2241 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.729720+0000", 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.729720+0000", 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.729724+0000", 2024-04-24T13:33:05.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8190000000000002e-06 2024-04-24T13:33:05.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732683+0000", 2024-04-24T13:33:05.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0029589490000000002 2024-04-24T13:33:05.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732712+0000", 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8924e-05 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732727+0000", 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5537e-05 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732814+0000", 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6144999999999996e-05 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.732956+0000", 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014276299999999999 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.733063+0000", 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106393 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741648+0000", 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085851190000000004 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741977+0000", 2024-04-24T13:33:05.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00032933000000000002 2024-04-24T13:33:05.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742038+0000", 2024-04-24T13:33:05.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1134000000000001e-05 2024-04-24T13:33:05.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742079+0000", 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0132000000000001e-05 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2249 3.1f 3:fad54725:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_44:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.815100+0000", 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.434255624999999, 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013270862, 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.328 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2249 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.815100+0000", 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.815100+0000", 2024-04-24T13:33:05.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.815103+0000", 2024-04-24T13:33:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0189999999999998e-06 2024-04-24T13:33:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816657+0000", 2024-04-24T13:33:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015535029999999999 2024-04-24T13:33:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816684+0000", 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6956000000000001e-05 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816695+0000", 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1681e-05 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816785+0000", 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9753999999999995e-05 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.816960+0000", 2024-04-24T13:33:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017443600000000001 2024-04-24T13:33:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.817127+0000", 2024-04-24T13:33:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016774499999999999 2024-04-24T13:33:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.827609+0000", 2024-04-24T13:33:05.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01048137 2024-04-24T13:33:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828263+0000", 2024-04-24T13:33:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000654746 2024-04-24T13:33:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828309+0000", 2024-04-24T13:33:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6102e-05 2024-04-24T13:33:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.828371+0000", 2024-04-24T13:33:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1550000000000005e-05 2024-04-24T13:33:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2251 3.3a e85/20 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head v 85'3, mlcod=81'1)", 2024-04-24T13:33:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.408129498999998, 2024-04-24T13:33:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024431608, 2024-04-24T13:33:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.334 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841228+0000", 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.781e-06 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846614+0000", 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053854419999999998 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846650+0000", 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6133000000000001e-05 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846669+0000", 2024-04-24T13:33:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9199e-05 2024-04-24T13:33:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846763+0000", 2024-04-24T13:33:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4335999999999999e-05 2024-04-24T13:33:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846799+0000", 2024-04-24T13:33:05.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5796000000000001e-05 2024-04-24T13:33:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865616+0000", 2024-04-24T13:33:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018816825999999998 2024-04-24T13:33:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865658+0000", 2024-04-24T13:33:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2095000000000003e-05 2024-04-24T13:33:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2254 3.20 e85/20 3:079960b7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_49:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.873589+0000", 2024-04-24T13:33:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.375767060999998, 2024-04-24T13:33:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014660608, 2024-04-24T13:33:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.873589+0000", 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.873589+0000", 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.873590+0000", 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5069999999999999e-06 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877724+0000", 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041334249999999996 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877754+0000", 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9960000000000001e-05 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877766+0000", 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2115e-05 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877845+0000", 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8988999999999999e-05 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.877874+0000", 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9329999999999999e-05 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.888153+0000", 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010279104000000001 2024-04-24T13:33:05.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.888249+0000", 2024-04-24T13:33:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6178e-05 2024-04-24T13:33:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2257 3.2b 3:d53685f1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.901887+0000", 2024-04-24T13:33:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.347469253, 2024-04-24T13:33:05.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012527972, 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2257 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.901887+0000", 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.901887+0000", 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.901889+0000", 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.509e-06 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903738+0000", 2024-04-24T13:33:05.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001848969 2024-04-24T13:33:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903768+0000", 2024-04-24T13:33:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0088000000000001e-05 2024-04-24T13:33:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903791+0000", 2024-04-24T13:33:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2932e-05 2024-04-24T13:33:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.903872+0000", 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1304000000000006e-05 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.904052+0000", 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018003999999999999 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.904226+0000", 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017409500000000001 2024-04-24T13:33:05.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.909209+0000", 2024-04-24T13:33:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049826030000000004 2024-04-24T13:33:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914239+0000", 2024-04-24T13:33:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050297759999999997 2024-04-24T13:33:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914336+0000", 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7233999999999998e-05 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.914415+0000", 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8422000000000002e-05 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2260 3.2b 3:d45c7bdc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.936956+0000", 2024-04-24T13:33:05.349 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.312399429000003, 2024-04-24T13:33:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011846031, 2024-04-24T13:33:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2260 2024-04-24T13:33:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.936956+0000", 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.936956+0000", 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.936959+0000", 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1020000000000001e-06 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938499+0000", 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015395369999999999 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938536+0000", 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6514000000000003e-05 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938552+0000", 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6758000000000001e-05 2024-04-24T13:33:05.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938657+0000", 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104491 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.938840+0000", 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018292199999999999 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.939014+0000", 2024-04-24T13:33:05.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174072 2024-04-24T13:33:05.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.944477+0000", 2024-04-24T13:33:05.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054635380000000004 2024-04-24T13:33:05.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948667+0000", 2024-04-24T13:33:05.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041893970000000001 2024-04-24T13:33:05.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948741+0000", 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4612999999999999e-05 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.948802+0000", 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1087000000000007e-05 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2264 3.18 e85/20 3:1be64b04:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_59:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:05.355 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.983667+0000", 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.265688435000001, 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011049814999999999, 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983667+0000", 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983667+0000", 2024-04-24T13:33:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.983683+0000", 2024-04-24T13:33:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5894999999999999e-05 2024-04-24T13:33:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985777+0000", 2024-04-24T13:33:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020935950000000002 2024-04-24T13:33:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985806+0000", 2024-04-24T13:33:05.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9274000000000001e-05 2024-04-24T13:33:05.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985820+0000", 2024-04-24T13:33:05.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4059e-05 2024-04-24T13:33:05.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985906+0000", 2024-04-24T13:33:05.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5333000000000004e-05 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.985937+0000", 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1636e-05 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994652+0000", 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.008714655 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.994717+0000", 2024-04-24T13:33:05.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5368000000000002e-05 2024-04-24T13:33:05.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.360 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.360 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.360 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.360 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:05.361 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:05.362 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:05.357+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:05.462 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:05.459+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:05.506 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:05.506 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:05.506 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:05.526 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:33:05.563 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:05.561+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:05.626 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:33:05.634 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.3 to 1 (10000) 2024-04-24T13:33:05.665 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:05.661+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:05.687 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-24T13:33:05.736 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:05.737 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:05.737 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:05.737 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:05.737 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:05.760 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:33:05.765 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:05.761+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:05.866 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:05.865+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:05.952 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:05.952 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:05.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:05.952 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:05.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.952 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4440.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e25)", 2024-04-24T13:33:05.952 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:33:05.952 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 160.734071306, 2024-04-24T13:33:05.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011066818000000001, 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "reached pg", 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4440", 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/588118290", 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216704+0000", 2024-04-24T13:33:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216708+0000", 2024-04-24T13:33:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2839999999999998e-06 2024-04-24T13:33:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216722+0000", 2024-04-24T13:33:05.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4226000000000001e-05 2024-04-24T13:33:05.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216754+0000", 2024-04-24T13:33:05.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2036999999999998e-05 2024-04-24T13:33:05.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.216778+0000", 2024-04-24T13:33:05.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:33:05.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217728+0000", 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094958900000000003 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.217744+0000", 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6271000000000001e-05 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227474+0000", 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097306200000000006 2024-04-24T13:33:05.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:30:25.227771+0000", 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029669800000000002 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1615 3.1a e82/20 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head v 82'1, mlcod=0'0)", 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.737791469000001, 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013622553000000001, 2024-04-24T13:33:05.957 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.958 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.958 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.958 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:05.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:05.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212985+0000", 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1370000000000001e-06 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219240+0000", 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062543240000000003 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219257+0000", 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6940999999999999e-05 2024-04-24T13:33:05.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219267+0000", 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0283e-05 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219324+0000", 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6950999999999997e-05 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219343+0000", 2024-04-24T13:33:05.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8681999999999998e-05 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226529+0000", 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071867169999999996 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226607+0000", 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7517999999999999e-05 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2219 3.0 3:00e6fe99:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.458637074999999, 2024-04-24T13:33:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01535366, 2024-04-24T13:33:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2219 2024-04-24T13:33:05.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492150+0000", 2024-04-24T13:33:05.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1046999999999999e-05 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494106+0000", 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019561940000000001 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494133+0000", 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7617999999999999e-05 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494150+0000", 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6096999999999999e-05 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494240+0000", 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0786999999999997e-05 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494435+0000", 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000195021 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:05.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494611+0000", 2024-04-24T13:33:05.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017601100000000001 2024-04-24T13:33:05.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507078+0000", 2024-04-24T13:33:05.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012466395 2024-04-24T13:33:05.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507374+0000", 2024-04-24T13:33:05.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029577100000000001 2024-04-24T13:33:05.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507429+0000", 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5928999999999999e-05 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507492+0000", 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.279e-05 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2228 3.3e 3:7d0db293:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_23:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.587544+0000", 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.363231716000001, 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012513471999999999, 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2228 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.587544+0000", 2024-04-24T13:33:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.587544+0000", 2024-04-24T13:33:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.587547+0000", 2024-04-24T13:33:05.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0769999999999999e-06 2024-04-24T13:33:05.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.589054+0000", 2024-04-24T13:33:05.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015069969999999999 2024-04-24T13:33:05.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.589085+0000", 2024-04-24T13:33:05.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0822999999999999e-05 2024-04-24T13:33:05.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.589100+0000", 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5438999999999999e-05 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.589168+0000", 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7917999999999996e-05 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.589279+0000", 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011125599999999999 2024-04-24T13:33:05.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:05.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.589397+0000", 2024-04-24T13:33:05.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117631 2024-04-24T13:33:05.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.599257+0000", 2024-04-24T13:33:05.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0098601820000000003 2024-04-24T13:33:05.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.599967+0000", 2024-04-24T13:33:05.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00070969700000000002 2024-04-24T13:33:05.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600023+0000", 2024-04-24T13:33:05.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5763000000000001e-05 2024-04-24T13:33:05.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.600057+0000", 2024-04-24T13:33:05.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4688999999999999e-05 2024-04-24T13:33:05.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.973 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.974 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.974 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2230 3.19 3:99352026:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.974 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:05.974 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.342654084999999, 2024-04-24T13:33:05.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013072217000000001, 2024-04-24T13:33:05.974 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.974 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.974 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.975 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2230 2024-04-24T13:33:05.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.975 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:05.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:05.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608124+0000", 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6740000000000001e-06 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609736+0000", 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016116430000000001 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609766+0000", 2024-04-24T13:33:05.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0497e-05 2024-04-24T13:33:05.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609781+0000", 2024-04-24T13:33:05.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4810999999999999e-05 2024-04-24T13:33:05.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609861+0000", 2024-04-24T13:33:05.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9320999999999995e-05 2024-04-24T13:33:05.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609972+0000", 2024-04-24T13:33:05.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111116 2024-04-24T13:33:05.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:05.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.610087+0000", 2024-04-24T13:33:05.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115161 2024-04-24T13:33:05.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.620611+0000", 2024-04-24T13:33:05.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010524554 2024-04-24T13:33:05.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621126+0000", 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051447699999999995 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621163+0000", 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6838999999999997e-05 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621194+0000", 2024-04-24T13:33:05.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1124000000000002e-05 2024-04-24T13:33:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2237 3.25 3:a6fa5a1e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.689504+0000", 2024-04-24T13:33:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.261271614999998, 2024-04-24T13:33:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01220517, 2024-04-24T13:33:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.980 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.981 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.981 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.981 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.981 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2237 2024-04-24T13:33:05.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.981 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.689504+0000", 2024-04-24T13:33:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.689504+0000", 2024-04-24T13:33:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.689507+0000", 2024-04-24T13:33:05.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8940000000000002e-06 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692056+0000", 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025493159999999998 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692075+0000", 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8813000000000001e-05 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692087+0000", 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2153999999999999e-05 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692166+0000", 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8782000000000006e-05 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692310+0000", 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014354099999999999 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.692467+0000", 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015749399999999999 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.701192+0000", 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0087253699999999997 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.701583+0000", 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000390582 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.701652+0000", 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8534999999999993e-05 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.701709+0000", 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7689000000000003e-05 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.986 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2252 3.4 3:22834b58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:05.987 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:05.987 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.105197134999997, 2024-04-24T13:33:05.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932545999999999, 2024-04-24T13:33:05.987 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.987 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.987 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.987 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2252 2024-04-24T13:33:05.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.987 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845581+0000", 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:33:05.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847834+0000", 2024-04-24T13:33:05.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002252843 2024-04-24T13:33:05.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847863+0000", 2024-04-24T13:33:05.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.904e-05 2024-04-24T13:33:05.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847877+0000", 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4126e-05 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847963+0000", 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6162999999999995e-05 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848105+0000", 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014117900000000001 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848252+0000", 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014774800000000001 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865043+0000", 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016790848000000001 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865405+0000", 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036176900000000001 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865460+0000", 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5334000000000002e-05 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865511+0000", 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0784e-05 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2663 3.0 3:01df44a3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:05.992 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.81142310200000001, 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020742727999999998, 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2663 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:05.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139355+0000", 2024-04-24T13:33:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2529999999999999e-06 2024-04-24T13:33:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:05.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141777+0000", 2024-04-24T13:33:05.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002422638 2024-04-24T13:33:05.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:05.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141800+0000", 2024-04-24T13:33:05.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2949e-05 2024-04-24T13:33:05.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:05.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141812+0000", 2024-04-24T13:33:05.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1551e-05 2024-04-24T13:33:05.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141907+0000", 2024-04-24T13:33:05.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5296000000000004e-05 2024-04-24T13:33:05.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141917+0000", 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.414e-06 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144519+0000", 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026024220000000001 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144684+0000", 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164511 2024-04-24T13:33:05.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:05.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144845+0000", 2024-04-24T13:33:05.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016157000000000001 2024-04-24T13:33:05.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:05.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.156972+0000", 2024-04-24T13:33:05.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012126855000000001 2024-04-24T13:33:05.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.159989+0000", 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003016609 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160059+0000", 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0598000000000004e-05 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160095+0000", 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6062000000000001e-05 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:05.999 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2664 3.4 3:21467061:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.79792350499999998, 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013894336, 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2664 2024-04-24T13:33:06.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152854+0000", 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0109999999999999e-06 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154070+0000", 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012153940000000001 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154096+0000", 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6109e-05 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154110+0000", 2024-04-24T13:33:06.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4489e-05 2024-04-24T13:33:06.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154184+0000", 2024-04-24T13:33:06.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4035000000000005e-05 2024-04-24T13:33:06.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154325+0000", 2024-04-24T13:33:06.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014115500000000001 2024-04-24T13:33:06.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154474+0000", 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000148811 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.165413+0000", 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010938333999999999 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166625+0000", 2024-04-24T13:33:06.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001212526 2024-04-24T13:33:06.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166692+0000", 2024-04-24T13:33:06.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7013000000000004e-05 2024-04-24T13:33:06.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166747+0000", 2024-04-24T13:33:06.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4459000000000002e-05 2024-04-24T13:33:06.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.006 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.006 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.006 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2666 3.19 3:986cc6d0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:06.006 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.172155+0000", 2024-04-24T13:33:06.006 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.778620533, 2024-04-24T13:33:06.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012650389, 2024-04-24T13:33:06.006 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.006 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.006 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.007 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.007 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2666 2024-04-24T13:33:06.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.007 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.172155+0000", 2024-04-24T13:33:06.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.172155+0000", 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.172158+0000", 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9490000000000001e-06 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.173899+0000", 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017404759999999999 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.173929+0000", 2024-04-24T13:33:06.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0216999999999999e-05 2024-04-24T13:33:06.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.173942+0000", 2024-04-24T13:33:06.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3536999999999999e-05 2024-04-24T13:33:06.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.174016+0000", 2024-04-24T13:33:06.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3867000000000003e-05 2024-04-24T13:33:06.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.174133+0000", 2024-04-24T13:33:06.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011686199999999999 2024-04-24T13:33:06.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:06.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.174250+0000", 2024-04-24T13:33:06.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117376 2024-04-24T13:33:06.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.178529+0000", 2024-04-24T13:33:06.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042784169999999996 2024-04-24T13:33:06.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.184691+0000", 2024-04-24T13:33:06.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006162257 2024-04-24T13:33:06.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.184755+0000", 2024-04-24T13:33:06.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4247999999999999e-05 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.184806+0000", 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0182999999999997e-05 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2672 3.1c e100/74 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head v 100'4, mlcod=85'2)", 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.71328154499999996, 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022091785999999999, 2024-04-24T13:33:06.012 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237495+0000", 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1500000000000005e-07 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243044+0000", 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055497869999999996 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243082+0000", 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7208e-05 2024-04-24T13:33:06.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243097+0000", 2024-04-24T13:33:06.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5554e-05 2024-04-24T13:33:06.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243175+0000", 2024-04-24T13:33:06.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7849999999999995e-05 2024-04-24T13:33:06.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243194+0000", 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8822999999999999e-05 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259527+0000", 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016333007 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259586+0000", 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9042000000000002e-05 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.016 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2677 3.25 3:a4f04b59:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.66839579299999996, 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015627926, 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2677 2024-04-24T13:33:06.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282383+0000", 2024-04-24T13:33:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1499999999999999e-06 2024-04-24T13:33:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283869+0000", 2024-04-24T13:33:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014862269999999999 2024-04-24T13:33:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283897+0000", 2024-04-24T13:33:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7596000000000001e-05 2024-04-24T13:33:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283911+0000", 2024-04-24T13:33:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.367e-05 2024-04-24T13:33:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283981+0000", 2024-04-24T13:33:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0349e-05 2024-04-24T13:33:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284117+0000", 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013656000000000001 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284214+0000", 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6558999999999995e-05 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296745+0000", 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012530845000000001 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297925+0000", 2024-04-24T13:33:06.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001179706 2024-04-24T13:33:06.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297961+0000", 2024-04-24T13:33:06.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6514999999999999e-05 2024-04-24T13:33:06.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.298008+0000", 2024-04-24T13:33:06.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6749000000000003e-05 2024-04-24T13:33:06.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.023 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.023 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.023 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2687 3.37 e100/74 3:ec5fbb46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_26:head v 100'5, mlcod=86'3)", 2024-04-24T13:33:06.023 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.382306+0000", 2024-04-24T13:33:06.023 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.56846991000000002, 2024-04-24T13:33:06.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010862770000000001, 2024-04-24T13:33:06.023 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.023 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.023 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.023 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.382306+0000", 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.382306+0000", 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.382308+0000", 2024-04-24T13:33:06.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3429999999999998e-06 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.383630+0000", 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013220339999999999 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.383657+0000", 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6401e-05 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.383681+0000", 2024-04-24T13:33:06.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4519e-05 2024-04-24T13:33:06.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.383762+0000", 2024-04-24T13:33:06.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0703000000000003e-05 2024-04-24T13:33:06.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.383797+0000", 2024-04-24T13:33:06.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4788e-05 2024-04-24T13:33:06.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.393108+0000", 2024-04-24T13:33:06.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093117070000000007 2024-04-24T13:33:06.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.393169+0000", 2024-04-24T13:33:06.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0275000000000001e-05 2024-04-24T13:33:06.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.027 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.027 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2706 3.1c e100/74 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head v 100'5, mlcod=86'3)", 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.47597586400000003, 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021017514000000001, 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:06.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474802+0000", 2024-04-24T13:33:06.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1399999999999998e-06 2024-04-24T13:33:06.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480124+0000", 2024-04-24T13:33:06.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053217059999999998 2024-04-24T13:33:06.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480147+0000", 2024-04-24T13:33:06.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3646e-05 2024-04-24T13:33:06.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480159+0000", 2024-04-24T13:33:06.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2133999999999999e-05 2024-04-24T13:33:06.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480237+0000", 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7531e-05 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480291+0000", 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3851999999999999e-05 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495746+0000", 2024-04-24T13:33:06.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015454684 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495817+0000", 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1821000000000002e-05 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2714 3.3e 3:7db6704a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.552080+0000", 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.39869572199999997, 2024-04-24T13:33:06.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010957918000000001, 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2714 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.552080+0000", 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.552080+0000", 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.552082+0000", 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1959999999999998e-06 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.553488+0000", 2024-04-24T13:33:06.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014054549999999999 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.553514+0000", 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6865000000000001e-05 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.553525+0000", 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0241000000000001e-05 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.553604+0000", 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9529000000000004e-05 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.553734+0000", 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012929400000000001 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.553828+0000", 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4431000000000004e-05 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.562222+0000", 2024-04-24T13:33:06.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0083940300000000002 2024-04-24T13:33:06.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.562939+0000", 2024-04-24T13:33:06.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00071674300000000005 2024-04-24T13:33:06.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.562985+0000", 2024-04-24T13:33:06.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5868000000000002e-05 2024-04-24T13:33:06.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.563038+0000", 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3266000000000001e-05 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2722 3.25 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.31857185399999999, 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035782711000000002, 2024-04-24T13:33:06.038 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.039 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.039 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.039 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.039 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.039 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.039 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2722 2024-04-24T13:33:06.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.039 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:06.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:06.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632207+0000", 2024-04-24T13:33:06.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.252e-06 2024-04-24T13:33:06.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634575+0000", 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023682500000000001 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634606+0000", 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0284999999999999e-05 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634619+0000", 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3491e-05 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634703+0000", 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4214000000000004e-05 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634711+0000", 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9719999999999992e-06 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639813+0000", 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051013830000000001 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639969+0000", 2024-04-24T13:33:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015674600000000001 2024-04-24T13:33:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.640112+0000", 2024-04-24T13:33:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142347 2024-04-24T13:33:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647222+0000", 2024-04-24T13:33:06.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071106520000000003 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667844+0000", 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020621746999999999 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667925+0000", 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0717999999999995e-05 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667987+0000", 2024-04-24T13:33:06.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1654000000000003e-05 2024-04-24T13:33:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2723 3.37 e101/74 3:ecde4b94:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_52:head v 101'6, mlcod=86'4)", 2024-04-24T13:33:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.655572+0000", 2024-04-24T13:33:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.29520318499999998, 2024-04-24T13:33:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011195531, 2024-04-24T13:33:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.045 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.655572+0000", 2024-04-24T13:33:06.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.655572+0000", 2024-04-24T13:33:06.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.655573+0000", 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.23e-07 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.656961+0000", 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013878569999999999 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.656991+0000", 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0085000000000001e-05 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.657005+0000", 2024-04-24T13:33:06.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3881e-05 2024-04-24T13:33:06.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.657164+0000", 2024-04-24T13:33:06.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000159536 2024-04-24T13:33:06.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.657188+0000", 2024-04-24T13:33:06.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4283000000000001e-05 2024-04-24T13:33:06.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666708+0000", 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095196659999999995 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666768+0000", 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.049 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2730 3.19 3:984637ec:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:06.050 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:06.050 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.22692538100000001, 2024-04-24T13:33:06.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014952841999999999, 2024-04-24T13:33:06.050 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.050 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.050 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.050 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.050 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2730 2024-04-24T13:33:06.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.050 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:06.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:06.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723854+0000", 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4180000000000001e-06 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725292+0000", 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014378870000000001 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725322+0000", 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0596999999999999e-05 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725337+0000", 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4684999999999999e-05 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725423+0000", 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5997999999999999e-05 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725596+0000", 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000172654 2024-04-24T13:33:06.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:06.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725755+0000", 2024-04-24T13:33:06.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015988600000000001 2024-04-24T13:33:06.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734196+0000", 2024-04-24T13:33:06.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084404170000000004 2024-04-24T13:33:06.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738679+0000", 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044834189999999998 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738747+0000", 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7890000000000002e-05 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738803+0000", 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5991e-05 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.055 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2736 3.8 e101/20 3:100a958f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_65:head v 101'5, mlcod=86'3)", 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.785530+0000", 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.16524541200000001, 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011228671000000001, 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.785530+0000", 2024-04-24T13:33:06.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.785530+0000", 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.785532+0000", 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.007e-06 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.787885+0000", 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023524259999999999 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.787904+0000", 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9656e-05 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.787914+0000", 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4609999999999997e-06 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.787987+0000", 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3201999999999995e-05 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.788013+0000", 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6214999999999999e-05 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.796695+0000", 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086816610000000002 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.796759+0000", 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4042999999999997e-05 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2737 3.4 3:23416714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.15763975, 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019181262000000001, 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.060 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2737 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:06.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793139+0000", 2024-04-24T13:33:06.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-04-24T13:33:06.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795403+0000", 2024-04-24T13:33:06.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002264252 2024-04-24T13:33:06.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795439+0000", 2024-04-24T13:33:06.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5701999999999998e-05 2024-04-24T13:33:06.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795454+0000", 2024-04-24T13:33:06.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5262999999999999e-05 2024-04-24T13:33:06.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795541+0000", 2024-04-24T13:33:06.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6989000000000003e-05 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795719+0000", 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000177906 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795875+0000", 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155785 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.808532+0000", 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012657695 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812189+0000", 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036562809999999999 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812258+0000", 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9210999999999999e-05 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812317+0000", 2024-04-24T13:33:06.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9407000000000002e-05 2024-04-24T13:33:06.066 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.066 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.066 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.066 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.066 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.066 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:06.068 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:33:06.068 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:06.067+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:06.168 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:06.167+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:06.250 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:06.250 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:06.250 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:06.250 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:06.269 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:06.267+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:06.275 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:33:06.370 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:06.367+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:06.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:33:06.461 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:06.462 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:06.462 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:06.462 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:06.462 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:06.471 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:06.469+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:06.482 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:33:06.571 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:06.569+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:06.609 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:06.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:06.632 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:06.633 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:06.649 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.4 to 1 (10000) 2024-04-24T13:33:06.652 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:06.652 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:06.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:06.652 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:06.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.652 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2206 3.f 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:06.652 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:06.652 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.359274800000001, 2024-04-24T13:33:06.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028291495999999999, 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2206 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:06.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290398+0000", 2024-04-24T13:33:06.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000001e-06 2024-04-24T13:33:06.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294671+0000", 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042724390000000003 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294711+0000", 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0376000000000001e-05 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294730+0000", 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8607e-05 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294856+0000", 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126651 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295125+0000", 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026840700000000002 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295349+0000", 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022454699999999999 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307240+0000", 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011891048 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318593+0000", 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011352777999999999 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318652+0000", 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8677000000000001e-05 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318686+0000", 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4616000000000002e-05 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2209 3.14 3:287cf44b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.313970640000001, 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020682494999999999, 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.658 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2209 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335702+0000", 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339081+0000", 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003378664 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339119+0000", 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8355999999999997e-05 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339138+0000", 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8546000000000002e-05 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339268+0000", 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013028599999999999 2024-04-24T13:33:06.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339503+0000", 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023542699999999999 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339734+0000", 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023122 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.348300+0000", 2024-04-24T13:33:06.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085659870000000006 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356108+0000", 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078075109999999996 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356259+0000", 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015104800000000001 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356381+0000", 2024-04-24T13:33:06.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012243599999999999 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2227 3.14 3:28702767:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 38.072672007999998, 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017797177000000001, 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.664 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2227 2024-04-24T13:33:06.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.665 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:06.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:06.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.577000+0000", 2024-04-24T13:33:06.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8760000000000001e-06 2024-04-24T13:33:06.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579496+0000", 2024-04-24T13:33:06.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024951740000000002 2024-04-24T13:33:06.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579521+0000", 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5361e-05 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579533+0000", 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2377e-05 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579602+0000", 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8325999999999996e-05 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579799+0000", 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019773800000000001 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579997+0000", 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019725299999999999 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.586752+0000", 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006755179 2024-04-24T13:33:06.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594712+0000", 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079597049999999992 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594757+0000", 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4956000000000001e-05 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594795+0000", 2024-04-24T13:33:06.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8232000000000003e-05 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2244 3.3b 3:ddfbb493:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.884273157999999, 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020329852999999998, 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.672 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.672 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2244 2024-04-24T13:33:06.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.672 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:06.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:06.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765398+0000", 2024-04-24T13:33:06.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.291e-06 2024-04-24T13:33:06.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766959+0000", 2024-04-24T13:33:06.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015617680000000001 2024-04-24T13:33:06.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766985+0000", 2024-04-24T13:33:06.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5899999999999999e-05 2024-04-24T13:33:06.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766996+0000", 2024-04-24T13:33:06.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0642000000000001e-05 2024-04-24T13:33:06.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767076+0000", 2024-04-24T13:33:06.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9542999999999994e-05 2024-04-24T13:33:06.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767184+0000", 2024-04-24T13:33:06.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107964 2024-04-24T13:33:06.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767269+0000", 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5798999999999996e-05 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.772877+0000", 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056080560000000002 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785554+0000", 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012676642 2024-04-24T13:33:06.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785639+0000", 2024-04-24T13:33:06.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4938999999999994e-05 2024-04-24T13:33:06.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785726+0000", 2024-04-24T13:33:06.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7309e-05 2024-04-24T13:33:06.677 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2256 3.21 3:878222a6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.890313+0000", 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.759356437000001, 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016559444999999999, 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.678 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.679 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2256 2024-04-24T13:33:06.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.679 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.890313+0000", 2024-04-24T13:33:06.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.890313+0000", 2024-04-24T13:33:06.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.890316+0000", 2024-04-24T13:33:06.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5359999999999999e-06 2024-04-24T13:33:06.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.892396+0000", 2024-04-24T13:33:06.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020804600000000001 2024-04-24T13:33:06.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.892421+0000", 2024-04-24T13:33:06.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.442e-05 2024-04-24T13:33:06.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.892433+0000", 2024-04-24T13:33:06.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2838e-05 2024-04-24T13:33:06.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.892527+0000", 2024-04-24T13:33:06.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3431999999999996e-05 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.892665+0000", 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000138407 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.892830+0000", 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016460499999999999 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.899416+0000", 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065858740000000002 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.906702+0000", 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072860010000000003 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.906796+0000", 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4236999999999999e-05 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.906873+0000", 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6635000000000001e-05 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2265 3.14 3:2a53907b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.654234690999999, 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016926096000000002, 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.686 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.687 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.687 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.687 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.687 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2265 2024-04-24T13:33:06.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.687 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:06.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995438+0000", 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1080000000000001e-06 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997447+0000", 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002008625 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997484+0000", 2024-04-24T13:33:06.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7070999999999998e-05 2024-04-24T13:33:06.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997508+0000", 2024-04-24T13:33:06.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4324999999999998e-05 2024-04-24T13:33:06.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997617+0000", 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010898799999999999 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997787+0000", 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000169956 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997949+0000", 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016190599999999999 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.005098+0000", 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071488300000000001 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012231+0000", 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071334040000000003 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012305+0000", 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4017000000000006e-05 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012361+0000", 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2669 3.21 3:86a0e0c3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.4473441409999999, 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020962138000000002, 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.692 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.693 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.693 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.693 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.693 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.693 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2669 2024-04-24T13:33:06.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.693 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:06.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:06.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202328+0000", 2024-04-24T13:33:06.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-06 2024-04-24T13:33:06.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204239+0000", 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019104409999999999 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204265+0000", 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6054000000000002e-05 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204279+0000", 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3654e-05 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204361+0000", 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2522999999999996e-05 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204523+0000", 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000162332 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204661+0000", 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013798200000000001 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.210336+0000", 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056743339999999996 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223107+0000", 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012771714999999999 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223228+0000", 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012061300000000001 2024-04-24T13:33:06.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223288+0000", 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9537999999999998e-05 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2670 3.14 3:2b621d8a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.4379381069999999, 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018441043000000001, 2024-04-24T13:33:06.698 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.699 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.699 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.699 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.699 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2670 2024-04-24T13:33:06.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.699 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211734+0000", 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3429999999999998e-06 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213786+0000", 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002052637 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213813+0000", 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6193000000000001e-05 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213825+0000", 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1905999999999999e-05 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213906+0000", 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1075999999999994e-05 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.214023+0000", 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117738 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.214134+0000", 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011082900000000001 2024-04-24T13:33:06.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.220138+0000", 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060042059999999998 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230042+0000", 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099037559999999997 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230116+0000", 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3742e-05 2024-04-24T13:33:06.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230173+0000", 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6616999999999997e-05 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2710 3.3b 3:ddce91ac:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.1375417329999999, 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026438756000000001, 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.704 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2710 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512131+0000", 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0130000000000002e-06 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514363+0000", 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022325940000000001 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514394+0000", 2024-04-24T13:33:06.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0144000000000001e-05 2024-04-24T13:33:06.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514409+0000", 2024-04-24T13:33:06.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5786000000000001e-05 2024-04-24T13:33:06.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514497+0000", 2024-04-24T13:33:06.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7876999999999999e-05 2024-04-24T13:33:06.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514670+0000", 2024-04-24T13:33:06.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000173096 2024-04-24T13:33:06.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:06.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514768+0000", 2024-04-24T13:33:06.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8089000000000002e-05 2024-04-24T13:33:06.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.523354+0000", 2024-04-24T13:33:06.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085854190000000004 2024-04-24T13:33:06.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538483+0000", 2024-04-24T13:33:06.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015128922 2024-04-24T13:33:06.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538527+0000", 2024-04-24T13:33:06.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3835999999999998e-05 2024-04-24T13:33:06.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538567+0000", 2024-04-24T13:33:06.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.998e-05 2024-04-24T13:33:06.710 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.710 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2711 3.13 e100/41 3:c9a0442c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_40:head v 100'9, mlcod=86'7)", 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.122199317, 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016831724999999999, 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:06.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:06.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527472+0000", 2024-04-24T13:33:06.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6619999999999999e-06 2024-04-24T13:33:06.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533965+0000", 2024-04-24T13:33:06.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064927159999999999 2024-04-24T13:33:06.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533980+0000", 2024-04-24T13:33:06.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5192e-05 2024-04-24T13:33:06.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533989+0000", 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3950000000000007e-06 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.534040+0000", 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0822000000000002e-05 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.534066+0000", 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6341000000000001e-05 2024-04-24T13:33:06.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.544246+0000", 2024-04-24T13:33:06.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010179354 2024-04-24T13:33:06.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.544302+0000", 2024-04-24T13:33:06.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6242999999999997e-05 2024-04-24T13:33:06.715 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.715 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.716 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.716 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2712 3.2e 3:74e2d347:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:06.716 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.532098+0000", 2024-04-24T13:33:06.716 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.1175717199999999, 2024-04-24T13:33:06.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016599603000000001, 2024-04-24T13:33:06.716 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.716 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.716 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.716 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.716 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.717 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.717 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2712 2024-04-24T13:33:06.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.717 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.532098+0000", 2024-04-24T13:33:06.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.532098+0000", 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.532101+0000", 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1860000000000001e-06 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533278+0000", 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001177188 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533313+0000", 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5212000000000001e-05 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533329+0000", 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5866e-05 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533406+0000", 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6520000000000006e-05 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533570+0000", 2024-04-24T13:33:06.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016464100000000001 2024-04-24T13:33:06.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533729+0000", 2024-04-24T13:33:06.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015817199999999999 2024-04-24T13:33:06.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.541495+0000", 2024-04-24T13:33:06.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077664429999999996 2024-04-24T13:33:06.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.548603+0000", 2024-04-24T13:33:06.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071077240000000002 2024-04-24T13:33:06.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.548642+0000", 2024-04-24T13:33:06.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8838999999999999e-05 2024-04-24T13:33:06.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.548697+0000", 2024-04-24T13:33:06.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5812e-05 2024-04-24T13:33:06.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.722 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.722 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2716 3.13 e100/41 3:c8fec211:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_45:head v 100'10, mlcod=86'8)", 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0725288369999999, 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017185506, 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577143+0000", 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.824e-06 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581297+0000", 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041541770000000002 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581333+0000", 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6559e-05 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581349+0000", 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6036999999999999e-05 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581429+0000", 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9404000000000001e-05 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581449+0000", 2024-04-24T13:33:06.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9949000000000002e-05 2024-04-24T13:33:06.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.594260+0000", 2024-04-24T13:33:06.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012811207999999999 2024-04-24T13:33:06.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.594326+0000", 2024-04-24T13:33:06.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6347999999999996e-05 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2728 3.21 3:8520d077:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.94232996199999997, 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019867991000000002, 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2728 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707342+0000", 2024-04-24T13:33:06.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8480000000000001e-06 2024-04-24T13:33:06.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709741+0000", 2024-04-24T13:33:06.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002398346 2024-04-24T13:33:06.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709770+0000", 2024-04-24T13:33:06.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9522e-05 2024-04-24T13:33:06.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709786+0000", 2024-04-24T13:33:06.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5373e-05 2024-04-24T13:33:06.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709865+0000", 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9024999999999996e-05 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709984+0000", 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011908000000000001 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.710086+0000", 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102656 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.719183+0000", 2024-04-24T13:33:06.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.009096491 2024-04-24T13:33:06.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727080+0000", 2024-04-24T13:33:06.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078969309999999994 2024-04-24T13:33:06.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727152+0000", 2024-04-24T13:33:06.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1816999999999994e-05 2024-04-24T13:33:06.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727208+0000", 2024-04-24T13:33:06.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5902000000000001e-05 2024-04-24T13:33:06.733 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.733 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.733 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.733 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2738 3.2d 3:b6fa79b0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:06.733 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:06.734 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.84693122899999995, 2024-04-24T13:33:06.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016982181999999998, 2024-04-24T13:33:06.734 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.734 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.734 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.734 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.734 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.734 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.734 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2738 2024-04-24T13:33:06.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.734 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802741+0000", 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1739999999999999e-06 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804165+0000", 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014248780000000001 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804188+0000", 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989e-05 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804199+0000", 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0179e-05 2024-04-24T13:33:06.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804281+0000", 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2139999999999996e-05 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804456+0000", 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000175074 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804566+0000", 2024-04-24T13:33:06.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109931 2024-04-24T13:33:06.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.811275+0000", 2024-04-24T13:33:06.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067095560000000002 2024-04-24T13:33:06.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819557+0000", 2024-04-24T13:33:06.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0082818370000000002 2024-04-24T13:33:06.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819644+0000", 2024-04-24T13:33:06.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6885000000000006e-05 2024-04-24T13:33:06.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819721+0000", 2024-04-24T13:33:06.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6538999999999993e-05 2024-04-24T13:33:06.739 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.739 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.739 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.740 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2750 3.2e 3:76c7df3c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:06.740 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:06.740 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.71637314100000005, 2024-04-24T13:33:06.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019169064, 2024-04-24T13:33:06.740 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.740 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.740 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.740 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.740 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.740 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.740 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2750 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933299+0000", 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.751e-06 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935078+0000", 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017788420000000001 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935120+0000", 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1875999999999997e-05 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935138+0000", 2024-04-24T13:33:06.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7784000000000001e-05 2024-04-24T13:33:06.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935244+0000", 2024-04-24T13:33:06.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106041 2024-04-24T13:33:06.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935426+0000", 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018206299999999999 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935583+0000", 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000156754 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.944883+0000", 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093004400000000001 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952389+0000", 2024-04-24T13:33:06.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075064149999999998 2024-04-24T13:33:06.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952431+0000", 2024-04-24T13:33:06.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1801999999999997e-05 2024-04-24T13:33:06.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952466+0000", 2024-04-24T13:33:06.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4295999999999998e-05 2024-04-24T13:33:06.746 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.746 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.746 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.746 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2751 3.2e 3:7757132e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:06.746 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:06.746 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.706635609, 2024-04-24T13:33:06.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019504242000000001, 2024-04-24T13:33:06.746 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.746 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.746 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.746 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.747 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.747 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.747 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2751 2024-04-24T13:33:06.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.747 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:06.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:06.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943037+0000", 2024-04-24T13:33:06.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9189999999999999e-06 2024-04-24T13:33:06.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946091+0000", 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030545709999999998 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946117+0000", 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5666000000000001e-05 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946131+0000", 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4243999999999999e-05 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946202+0000", 2024-04-24T13:33:06.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0798999999999998e-05 2024-04-24T13:33:06.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946357+0000", 2024-04-24T13:33:06.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154785 2024-04-24T13:33:06.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946465+0000", 2024-04-24T13:33:06.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107675 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952338+0000", 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058734720000000002 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962433+0000", 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010094462 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962484+0000", 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1913999999999998e-05 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962538+0000", 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3735e-05 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2789 3.14 3:283784b4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.325110909, 2024-04-24T13:33:06.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017567818999999998, 2024-04-24T13:33:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2789 2024-04-24T13:33:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:06.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324561+0000", 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5780000000000001e-06 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325957+0000", 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013953640000000001 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325979+0000", 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2724000000000001e-05 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325989+0000", 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0135999999999999e-05 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326053+0000", 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3554999999999997e-05 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326175+0000", 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121558 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326275+0000", 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100512 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.332109+0000", 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058341080000000002 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342050+0000", 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099405489999999999 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342093+0000", 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3472e-05 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342127+0000", 2024-04-24T13:33:06.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3263000000000003e-05 2024-04-24T13:33:06.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.758 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.758 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2798 3.3b 3:de5094ab:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:06.758 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:06.758 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.22823599, 2024-04-24T13:33:06.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019231912, 2024-04-24T13:33:06.759 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.759 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.759 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.760 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.760 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2798 2024-04-24T13:33:06.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.760 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:06.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:06.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421436+0000", 2024-04-24T13:33:06.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7300000000000001e-06 2024-04-24T13:33:06.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423782+0000", 2024-04-24T13:33:06.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023461250000000001 2024-04-24T13:33:06.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423810+0000", 2024-04-24T13:33:06.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7937e-05 2024-04-24T13:33:06.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423823+0000", 2024-04-24T13:33:06.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.279e-05 2024-04-24T13:33:06.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423938+0000", 2024-04-24T13:33:06.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011457 2024-04-24T13:33:06.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.424090+0000", 2024-04-24T13:33:06.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015250600000000001 2024-04-24T13:33:06.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:06.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.424183+0000", 2024-04-24T13:33:06.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2351999999999999e-05 2024-04-24T13:33:06.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.429881+0000", 2024-04-24T13:33:06.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056981360000000003 2024-04-24T13:33:06.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440513+0000", 2024-04-24T13:33:06.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010632354 2024-04-24T13:33:06.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440598+0000", 2024-04-24T13:33:06.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4860999999999999e-05 2024-04-24T13:33:06.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440666+0000", 2024-04-24T13:33:06.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7551000000000004e-05 2024-04-24T13:33:06.770 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.770 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.770 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.771 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2806 3.2d 3:b44f16d5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:06.771 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:06.771 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.14246247500000001, 2024-04-24T13:33:06.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017054071000000001, 2024-04-24T13:33:06.771 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.772 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.772 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.772 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.772 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.772 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.772 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2806 2024-04-24T13:33:06.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.773 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:06.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:06.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507209+0000", 2024-04-24T13:33:06.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2620000000000001e-06 2024-04-24T13:33:06.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508811+0000", 2024-04-24T13:33:06.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016020940000000001 2024-04-24T13:33:06.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508837+0000", 2024-04-24T13:33:06.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5207000000000001e-05 2024-04-24T13:33:06.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508849+0000", 2024-04-24T13:33:06.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2571999999999999e-05 2024-04-24T13:33:06.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508927+0000", 2024-04-24T13:33:06.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7448999999999997e-05 2024-04-24T13:33:06.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.509058+0000", 2024-04-24T13:33:06.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013080599999999999 2024-04-24T13:33:06.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.509198+0000", 2024-04-24T13:33:06.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014016500000000001 2024-04-24T13:33:06.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.514234+0000", 2024-04-24T13:33:06.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050359230000000003 2024-04-24T13:33:06.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524162+0000", 2024-04-24T13:33:06.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099284430000000003 2024-04-24T13:33:06.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524207+0000", 2024-04-24T13:33:06.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126000000000001e-05 2024-04-24T13:33:06.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524261+0000", 2024-04-24T13:33:06.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4024000000000003e-05 2024-04-24T13:33:06.783 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.783 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.783 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.784 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2808 3.2e 3:7441f999:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:06.784 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:06.784 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.11830703200000001, 2024-04-24T13:33:06.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021413788, 2024-04-24T13:33:06.784 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:06.784 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:06.784 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:06.784 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:06.784 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:06.785 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:06.785 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2808 2024-04-24T13:33:06.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.785 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:06.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:06.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:06.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:06.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:06.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:06.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:06.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531366+0000", 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1089999999999998e-06 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533059+0000", 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001693186 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533088+0000", 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9470000000000001e-05 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:06.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533100+0000", 2024-04-24T13:33:06.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1979e-05 2024-04-24T13:33:06.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:06.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533176+0000", 2024-04-24T13:33:06.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5691000000000004e-05 2024-04-24T13:33:06.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:06.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533334+0000", 2024-04-24T13:33:06.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015822199999999999 2024-04-24T13:33:06.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:06.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533513+0000", 2024-04-24T13:33:06.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178846 2024-04-24T13:33:06.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:06.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.546303+0000", 2024-04-24T13:33:06.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012790331 2024-04-24T13:33:06.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:06.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552696+0000", 2024-04-24T13:33:06.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063923169999999998 2024-04-24T13:33:06.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:06.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552741+0000", 2024-04-24T13:33:06.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126999999999997e-05 2024-04-24T13:33:06.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:06.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:06.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:06.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552776+0000", 2024-04-24T13:33:06.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5509999999999997e-05 2024-04-24T13:33:06.790 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.790 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:06.791 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:06.791 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:06.792 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:06.792 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:06.793 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:33:06.794 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-24T13:33:06.795 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:06.795 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:06.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:06.796 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:06.796 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:06.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:06.797 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:06.797 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:06.797 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:06.791+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:06.807 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:06.808 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:06.893 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:06.889+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:06.994 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:06.993+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:07.019 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:07.019 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:07.049 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:33:07.095 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:07.093+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:07.197 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:07.193+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:07.203 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:07.203 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:07.230 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:33:07.299 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:07.297+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:07.374 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:07.374 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:07.395 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:33:07.399 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:07.399+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:07.500 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:07.497+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:07.538 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:07.539 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:07.553 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:33:07.601 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:07.599+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:07.658 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.5 to 1 (10000) 2024-04-24T13:33:07.666 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:33:07.702 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:07.701+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:07.710 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-24T13:33:07.737 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:07.737 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:07.757 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:33:07.802 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:07.803+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:07.903 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:07.901+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:07.920 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:07.920 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:07.934 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:33:08.004 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:08.003+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:08.105 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:08.103+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:08.105 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:08.106 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:08.120 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:33:08.206 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:08.203+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:08.243 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:08.243 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:08.257 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:33:08.306 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:08.305+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:08.376 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:08.376 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:08.390 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:33:08.407 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:08.407+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:08.508 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:08.507+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:08.559 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:08.559 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:08.573 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:33:08.610 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:08.607+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:08.655 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.6 to 1 (10000) 2024-04-24T13:33:08.674 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:33:08.703 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-24T13:33:08.703 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:33:08.710 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:08.709+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:08.719 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:08.719 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:08.743 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:33:08.810 INFO:tasks.workunit.client.0.smithi071.stdout:adding file to bucket: 1Gb. 2024-04-24T13:33:08.810 INFO:tasks.workunit.client.0.smithi071.stdout:upload file successful 2024-04-24T13:33:08.810 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:33:08.810 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - set max size for a given user and ensure that the max size is in effect 2024-04-24T13:33:08.810 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:33:08.830 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:08.829+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:08.837 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:33:08.912 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:08.911+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:08.927 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:08.928 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:08.947 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:33:08.974 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:08.975 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:08.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:08.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:09.008 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:09.008 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:09.012 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:09.011+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:09.024 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:09.024 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:09.043 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:09.043 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:09.064 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:09.064 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:09.072 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:33:09.078 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:33:09.085 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:09.085 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:09.088 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":187,"stamp":"2024-04-24T13:33:08.656786+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2047492863,"num_objects":701,"num_object_clones":0,"num_object_copies":1402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":701,"num_whiteouts":0,"num_read":2673,"num_read_kb":2378,"num_write":1641,"num_write_kb":2021954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":594335,"num_keys_recovered":2,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2416,"ondisk_log_size":2416,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":3922836,"kb_used_data":3704536,"kb_used_omap":10,"kb_used_meta":218165,"kb_avail":656680044,"statfs":{"total":676457349120,"available":672440365056,"internally_reserved":0,"allocated":3793444864,"data_stored":3789549451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11161,"internal_metadata":223401063},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":977272832,"num_objects":233,"num_object_clones":0,"num_object_copies":466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":954368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.042215"},"pg_stats":[{"pgid":"3.3f","version":"102'9","reported_seq":144,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.739137+0000","last_change":"2024-04-24T13:31:00.989667+0000","last_active":"2024-04-24T13:33:06.739137+0000","last_peered":"2024-04-24T13:33:06.739137+0000","last_clean":"2024-04-24T13:33:06.739137+0000","last_became_active":"2024-04-24T13:31:00.989365+0000","last_became_peered":"2024-04-24T13:31:00.989365+0000","last_unstale":"2024-04-24T13:33:06.739137+0000","last_undegraded":"2024-04-24T13:33:06.739137+0000","last_fullsized":"2024-04-24T13:33:06.739137+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:00:51.108396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.38","version":"82'14","reported_seq":213,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647139+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:33:06.647139+0000","last_peered":"2024-04-24T13:33:06.647139+0000","last_clean":"2024-04-24T13:33:06.647139+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:33:06.647139+0000","last_undegraded":"2024-04-24T13:33:06.647139+0000","last_fullsized":"2024-04-24T13:33:06.647139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"100'4","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704858+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:33:06.704858+0000","last_peered":"2024-04-24T13:33:06.704858+0000","last_clean":"2024-04-24T13:33:06.704858+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:33:06.704858+0000","last_undegraded":"2024-04-24T13:33:06.704858+0000","last_fullsized":"2024-04-24T13:33:06.704858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"82'4","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703227+0000","last_change":"2024-04-24T13:30:50.941589+0000","last_active":"2024-04-24T13:33:06.703227+0000","last_peered":"2024-04-24T13:33:06.703227+0000","last_clean":"2024-04-24T13:33:06.703227+0000","last_became_active":"2024-04-24T13:30:50.941305+0000","last_became_peered":"2024-04-24T13:30:50.941305+0000","last_unstale":"2024-04-24T13:33:06.703227+0000","last_undegraded":"2024-04-24T13:33:06.703227+0000","last_fullsized":"2024-04-24T13:33:06.703227+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:23.793119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"101'8","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762324+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:33:06.762324+0000","last_peered":"2024-04-24T13:33:06.762324+0000","last_clean":"2024-04-24T13:33:06.762324+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:33:06.762324+0000","last_undegraded":"2024-04-24T13:33:06.762324+0000","last_fullsized":"2024-04-24T13:33:06.762324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660164+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:33:06.660164+0000","last_peered":"2024-04-24T13:33:06.660164+0000","last_clean":"2024-04-24T13:33:06.660164+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:33:06.660164+0000","last_undegraded":"2024-04-24T13:33:06.660164+0000","last_fullsized":"2024-04-24T13:33:06.660164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"101'5","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647570+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:33:06.647570+0000","last_peered":"2024-04-24T13:33:06.647570+0000","last_clean":"2024-04-24T13:33:06.647570+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:33:06.647570+0000","last_undegraded":"2024-04-24T13:33:06.647570+0000","last_fullsized":"2024-04-24T13:33:06.647570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"86'4","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761901+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:33:06.761901+0000","last_peered":"2024-04-24T13:33:06.761901+0000","last_clean":"2024-04-24T13:33:06.761901+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:33:06.761901+0000","last_undegraded":"2024-04-24T13:33:06.761901+0000","last_fullsized":"2024-04-24T13:33:06.761901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"101'10","reported_seq":141,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646923+0000","last_change":"2024-04-24T13:30:50.941360+0000","last_active":"2024-04-24T13:33:06.646923+0000","last_peered":"2024-04-24T13:33:06.646923+0000","last_clean":"2024-04-24T13:33:06.646923+0000","last_became_active":"2024-04-24T13:30:50.940816+0000","last_became_peered":"2024-04-24T13:30:50.940816+0000","last_unstale":"2024-04-24T13:33:06.646923+0000","last_undegraded":"2024-04-24T13:33:06.646923+0000","last_fullsized":"2024-04-24T13:33:06.646923+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:04.247947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"82'2","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.736369+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:33:06.736369+0000","last_peered":"2024-04-24T13:33:06.736369+0000","last_clean":"2024-04-24T13:33:06.736369+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:33:06.736369+0000","last_undegraded":"2024-04-24T13:33:06.736369+0000","last_fullsized":"2024-04-24T13:33:06.736369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"101'13","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647215+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:33:06.647215+0000","last_peered":"2024-04-24T13:33:06.647215+0000","last_clean":"2024-04-24T13:33:06.647215+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:33:06.647215+0000","last_undegraded":"2024-04-24T13:33:06.647215+0000","last_fullsized":"2024-04-24T13:33:06.647215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"82'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.659022+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:33:06.659022+0000","last_peered":"2024-04-24T13:33:06.659022+0000","last_clean":"2024-04-24T13:33:06.659022+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:33:06.659022+0000","last_undegraded":"2024-04-24T13:33:06.659022+0000","last_fullsized":"2024-04-24T13:33:06.659022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"102'12","reported_seq":143,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.351833+0000","last_change":"2024-04-24T13:30:50.911441+0000","last_active":"2024-04-24T13:33:07.351833+0000","last_peered":"2024-04-24T13:33:07.351833+0000","last_clean":"2024-04-24T13:33:07.351833+0000","last_became_active":"2024-04-24T13:30:50.911096+0000","last_became_peered":"2024-04-24T13:30:50.911096+0000","last_unstale":"2024-04-24T13:33:07.351833+0000","last_undegraded":"2024-04-24T13:33:07.351833+0000","last_fullsized":"2024-04-24T13:33:07.351833+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:12.878818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"82'2","reported_seq":75,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704400+0000","last_change":"2024-04-24T13:32:00.564552+0000","last_active":"2024-04-24T13:33:06.704400+0000","last_peered":"2024-04-24T13:33:06.704400+0000","last_clean":"2024-04-24T13:33:06.704400+0000","last_became_active":"2024-04-24T13:32:00.564271+0000","last_became_peered":"2024-04-24T13:32:00.564271+0000","last_unstale":"2024-04-24T13:33:06.704400+0000","last_undegraded":"2024-04-24T13:33:06.704400+0000","last_fullsized":"2024-04-24T13:33:06.704400+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:31.661093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"101'3","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708319+0000","last_change":"2024-04-24T13:32:00.576894+0000","last_active":"2024-04-24T13:33:06.708319+0000","last_peered":"2024-04-24T13:33:06.708319+0000","last_clean":"2024-04-24T13:33:06.708319+0000","last_became_active":"2024-04-24T13:32:00.575339+0000","last_became_peered":"2024-04-24T13:32:00.575339+0000","last_unstale":"2024-04-24T13:33:06.708319+0000","last_undegraded":"2024-04-24T13:33:06.708319+0000","last_fullsized":"2024-04-24T13:33:06.708319+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:40.193989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"82'6","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.649542+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:33:06.649542+0000","last_peered":"2024-04-24T13:33:06.649542+0000","last_clean":"2024-04-24T13:33:06.649542+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:33:06.649542+0000","last_undegraded":"2024-04-24T13:33:06.649542+0000","last_fullsized":"2024-04-24T13:33:06.649542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"86'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657513+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:33:06.657513+0000","last_peered":"2024-04-24T13:33:06.657513+0000","last_clean":"2024-04-24T13:33:06.657513+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:33:06.657513+0000","last_undegraded":"2024-04-24T13:33:06.657513+0000","last_fullsized":"2024-04-24T13:33:06.657513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"101'7","reported_seq":74,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762918+0000","last_change":"2024-04-24T13:32:00.572932+0000","last_active":"2024-04-24T13:33:06.762918+0000","last_peered":"2024-04-24T13:33:06.762918+0000","last_clean":"2024-04-24T13:33:06.762918+0000","last_became_active":"2024-04-24T13:32:00.571887+0000","last_became_peered":"2024-04-24T13:32:00.571887+0000","last_unstale":"2024-04-24T13:33:06.762918+0000","last_undegraded":"2024-04-24T13:33:06.762918+0000","last_fullsized":"2024-04-24T13:33:06.762918+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:41.648006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"82'4","reported_seq":148,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702944+0000","last_change":"2024-04-24T13:30:50.937742+0000","last_active":"2024-04-24T13:33:06.702944+0000","last_peered":"2024-04-24T13:33:06.702944+0000","last_clean":"2024-04-24T13:33:06.702944+0000","last_became_active":"2024-04-24T13:30:50.937395+0000","last_became_peered":"2024-04-24T13:30:50.937395+0000","last_unstale":"2024-04-24T13:33:06.702944+0000","last_undegraded":"2024-04-24T13:33:06.702944+0000","last_fullsized":"2024-04-24T13:33:06.702944+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:43.335130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"102'9","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.511680+0000","last_change":"2024-04-24T13:32:00.584981+0000","last_active":"2024-04-24T13:33:07.511680+0000","last_peered":"2024-04-24T13:33:07.511680+0000","last_clean":"2024-04-24T13:33:07.511680+0000","last_became_active":"2024-04-24T13:32:00.584186+0000","last_became_peered":"2024-04-24T13:32:00.584186+0000","last_unstale":"2024-04-24T13:33:07.511680+0000","last_undegraded":"2024-04-24T13:33:07.511680+0000","last_fullsized":"2024-04-24T13:33:07.511680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.808699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"86'6","reported_seq":93,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646955+0000","last_change":"2024-04-24T13:32:00.565847+0000","last_active":"2024-04-24T13:33:06.646955+0000","last_peered":"2024-04-24T13:33:06.646955+0000","last_clean":"2024-04-24T13:33:06.646955+0000","last_became_active":"2024-04-24T13:32:00.565548+0000","last_became_peered":"2024-04-24T13:32:00.565548+0000","last_unstale":"2024-04-24T13:33:06.646955+0000","last_undegraded":"2024-04-24T13:33:06.646955+0000","last_fullsized":"2024-04-24T13:33:06.646955+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:21.522361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"102'5","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.319488+0000","last_change":"2024-04-24T13:32:00.599603+0000","last_active":"2024-04-24T13:33:07.319488+0000","last_peered":"2024-04-24T13:33:07.319488+0000","last_clean":"2024-04-24T13:33:07.319488+0000","last_became_active":"2024-04-24T13:32:00.598954+0000","last_became_peered":"2024-04-24T13:32:00.598954+0000","last_unstale":"2024-04-24T13:33:07.319488+0000","last_undegraded":"2024-04-24T13:33:07.319488+0000","last_fullsized":"2024-04-24T13:33:07.319488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:35.235521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647090+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:33:06.647090+0000","last_peered":"2024-04-24T13:33:06.647090+0000","last_clean":"2024-04-24T13:33:06.647090+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:33:06.647090+0000","last_undegraded":"2024-04-24T13:33:06.647090+0000","last_fullsized":"2024-04-24T13:33:06.647090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"102'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658196+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:33:06.658196+0000","last_peered":"2024-04-24T13:33:06.658196+0000","last_clean":"2024-04-24T13:33:06.658196+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:33:06.658196+0000","last_undegraded":"2024-04-24T13:33:06.658196+0000","last_fullsized":"2024-04-24T13:33:06.658196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"86'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648400+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:33:06.648400+0000","last_peered":"2024-04-24T13:33:06.648400+0000","last_clean":"2024-04-24T13:33:06.648400+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:33:06.648400+0000","last_undegraded":"2024-04-24T13:33:06.648400+0000","last_fullsized":"2024-04-24T13:33:06.648400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"102'11","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.848011+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:33:06.848011+0000","last_peered":"2024-04-24T13:33:06.848011+0000","last_clean":"2024-04-24T13:33:06.848011+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:33:06.848011+0000","last_undegraded":"2024-04-24T13:33:06.848011+0000","last_fullsized":"2024-04-24T13:33:06.848011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"82'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658874+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:33:06.658874+0000","last_peered":"2024-04-24T13:33:06.658874+0000","last_clean":"2024-04-24T13:33:06.658874+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:33:06.658874+0000","last_undegraded":"2024-04-24T13:33:06.658874+0000","last_fullsized":"2024-04-24T13:33:06.658874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"102'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.235186+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:33:07.235186+0000","last_peered":"2024-04-24T13:33:07.235186+0000","last_clean":"2024-04-24T13:33:07.235186+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:33:07.235186+0000","last_undegraded":"2024-04-24T13:33:07.235186+0000","last_fullsized":"2024-04-24T13:33:07.235186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.656725+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:33:06.656725+0000","last_peered":"2024-04-24T13:33:06.656725+0000","last_clean":"2024-04-24T13:33:06.656725+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:33:06.656725+0000","last_undegraded":"2024-04-24T13:33:06.656725+0000","last_fullsized":"2024-04-24T13:33:06.656725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"82'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.711111+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:33:06.711111+0000","last_peered":"2024-04-24T13:33:06.711111+0000","last_clean":"2024-04-24T13:33:06.711111+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:33:06.711111+0000","last_undegraded":"2024-04-24T13:33:06.711111+0000","last_fullsized":"2024-04-24T13:33:06.711111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"102'14","reported_seq":145,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.662593+0000","last_change":"2024-04-24T13:30:50.929479+0000","last_active":"2024-04-24T13:33:06.662593+0000","last_peered":"2024-04-24T13:33:06.662593+0000","last_clean":"2024-04-24T13:33:06.662593+0000","last_became_active":"2024-04-24T13:30:50.928545+0000","last_became_peered":"2024-04-24T13:30:50.928545+0000","last_unstale":"2024-04-24T13:33:06.662593+0000","last_undegraded":"2024-04-24T13:33:06.662593+0000","last_fullsized":"2024-04-24T13:33:06.662593+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:26:58.476605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":144,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703973+0000","last_change":"2024-04-24T13:32:00.646571+0000","last_active":"2024-04-24T13:33:06.703973+0000","last_peered":"2024-04-24T13:33:06.703973+0000","last_clean":"2024-04-24T13:33:06.703973+0000","last_became_active":"2024-04-24T13:32:00.596446+0000","last_became_peered":"2024-04-24T13:32:00.596446+0000","last_unstale":"2024-04-24T13:33:06.703973+0000","last_undegraded":"2024-04-24T13:33:06.703973+0000","last_fullsized":"2024-04-24T13:33:06.703973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:29:02.008315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"86'14","reported_seq":195,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763020+0000","last_change":"2024-04-24T13:30:50.953480+0000","last_active":"2024-04-24T13:33:06.763020+0000","last_peered":"2024-04-24T13:33:06.763020+0000","last_clean":"2024-04-24T13:33:06.763020+0000","last_became_active":"2024-04-24T13:30:50.917577+0000","last_became_peered":"2024-04-24T13:30:50.917577+0000","last_unstale":"2024-04-24T13:33:06.763020+0000","last_undegraded":"2024-04-24T13:33:06.763020+0000","last_fullsized":"2024-04-24T13:33:06.763020+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:41.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":67,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.649197+0000","last_change":"2024-04-24T13:32:00.550424+0000","last_active":"2024-04-24T13:33:06.649197+0000","last_peered":"2024-04-24T13:33:06.649197+0000","last_clean":"2024-04-24T13:33:06.649197+0000","last_became_active":"2024-04-24T13:32:00.550098+0000","last_became_peered":"2024-04-24T13:32:00.550098+0000","last_unstale":"2024-04-24T13:33:06.649197+0000","last_undegraded":"2024-04-24T13:33:06.649197+0000","last_fullsized":"2024-04-24T13:33:06.649197+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:51:43.235825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"94'37","reported_seq":116,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658789+0000","last_change":"2024-04-24T13:32:00.576594+0000","last_active":"2024-04-24T13:33:06.658789+0000","last_peered":"2024-04-24T13:33:06.658789+0000","last_clean":"2024-04-24T13:33:06.658789+0000","last_became_active":"2024-04-24T13:32:00.575785+0000","last_became_peered":"2024-04-24T13:32:00.575785+0000","last_unstale":"2024-04-24T13:33:06.658789+0000","last_undegraded":"2024-04-24T13:33:06.658789+0000","last_fullsized":"2024-04-24T13:33:06.658789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:46:13.469865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":87,"num_write":74,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"82'4","reported_seq":124,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710632+0000","last_change":"2024-04-24T13:32:00.594661+0000","last_active":"2024-04-24T13:33:06.710632+0000","last_peered":"2024-04-24T13:33:06.710632+0000","last_clean":"2024-04-24T13:33:06.710632+0000","last_became_active":"2024-04-24T13:32:00.594387+0000","last_became_peered":"2024-04-24T13:32:00.594387+0000","last_unstale":"2024-04-24T13:33:06.710632+0000","last_undegraded":"2024-04-24T13:33:06.710632+0000","last_fullsized":"2024-04-24T13:33:06.710632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:05.797402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"102'10","reported_seq":186,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762144+0000","last_change":"2024-04-24T13:30:50.915215+0000","last_active":"2024-04-24T13:33:06.762144+0000","last_peered":"2024-04-24T13:33:06.762144+0000","last_clean":"2024-04-24T13:33:06.762144+0000","last_became_active":"2024-04-24T13:30:50.913930+0000","last_became_peered":"2024-04-24T13:30:50.913930+0000","last_unstale":"2024-04-24T13:33:06.762144+0000","last_undegraded":"2024-04-24T13:33:06.762144+0000","last_fullsized":"2024-04-24T13:33:06.762144+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:53.839067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710970+0000","last_change":"2024-04-24T13:30:50.926673+0000","last_active":"2024-04-24T13:33:06.710970+0000","last_peered":"2024-04-24T13:33:06.710970+0000","last_clean":"2024-04-24T13:33:06.710970+0000","last_became_active":"2024-04-24T13:30:50.926286+0000","last_became_peered":"2024-04-24T13:30:50.926286+0000","last_unstale":"2024-04-24T13:33:06.710970+0000","last_undegraded":"2024-04-24T13:33:06.710970+0000","last_fullsized":"2024-04-24T13:33:06.710970+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:21:21.951639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660010+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:33:06.660010+0000","last_peered":"2024-04-24T13:33:06.660010+0000","last_clean":"2024-04-24T13:33:06.660010+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:33:06.660010+0000","last_undegraded":"2024-04-24T13:33:06.660010+0000","last_fullsized":"2024-04-24T13:33:06.660010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658657+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:33:06.658657+0000","last_peered":"2024-04-24T13:33:06.658657+0000","last_clean":"2024-04-24T13:33:06.658657+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:33:06.658657+0000","last_undegraded":"2024-04-24T13:33:06.658657+0000","last_fullsized":"2024-04-24T13:33:06.658657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761786+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:33:06.761786+0000","last_peered":"2024-04-24T13:33:06.761786+0000","last_clean":"2024-04-24T13:33:06.761786+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:33:06.761786+0000","last_undegraded":"2024-04-24T13:33:06.761786+0000","last_fullsized":"2024-04-24T13:33:06.761786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"86'10","reported_seq":198,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762403+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:33:06.762403+0000","last_peered":"2024-04-24T13:33:06.762403+0000","last_clean":"2024-04-24T13:33:06.762403+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:33:06.762403+0000","last_undegraded":"2024-04-24T13:33:06.762403+0000","last_fullsized":"2024-04-24T13:33:06.762403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"101'7","reported_seq":137,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657492+0000","last_change":"2024-04-24T13:30:50.946908+0000","last_active":"2024-04-24T13:33:06.657492+0000","last_peered":"2024-04-24T13:33:06.657492+0000","last_clean":"2024-04-24T13:33:06.657492+0000","last_became_active":"2024-04-24T13:30:50.932201+0000","last_became_peered":"2024-04-24T13:30:50.932201+0000","last_unstale":"2024-04-24T13:33:06.657492+0000","last_undegraded":"2024-04-24T13:33:06.657492+0000","last_fullsized":"2024-04-24T13:33:06.657492+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:41.874257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715584+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:33:06.715584+0000","last_peered":"2024-04-24T13:33:06.715584+0000","last_clean":"2024-04-24T13:33:06.715584+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:33:06.715584+0000","last_undegraded":"2024-04-24T13:33:06.715584+0000","last_fullsized":"2024-04-24T13:33:06.715584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648020+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:33:06.648020+0000","last_peered":"2024-04-24T13:33:06.648020+0000","last_clean":"2024-04-24T13:33:06.648020+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:33:06.648020+0000","last_undegraded":"2024-04-24T13:33:06.648020+0000","last_fullsized":"2024-04-24T13:33:06.648020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"94'105","reported_seq":273,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703560+0000","last_change":"2024-04-24T13:30:50.933595+0000","last_active":"2024-04-24T13:33:06.703560+0000","last_peered":"2024-04-24T13:33:06.703560+0000","last_clean":"2024-04-24T13:33:06.703560+0000","last_became_active":"2024-04-24T13:30:50.926963+0000","last_became_peered":"2024-04-24T13:30:50.926963+0000","last_unstale":"2024-04-24T13:33:06.703560+0000","last_undegraded":"2024-04-24T13:33:06.703560+0000","last_fullsized":"2024-04-24T13:33:06.703560+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"94'7","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657955+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:33:06.657955+0000","last_peered":"2024-04-24T13:33:06.657955+0000","last_clean":"2024-04-24T13:33:06.657955+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:33:06.657955+0000","last_undegraded":"2024-04-24T13:33:06.657955+0000","last_fullsized":"2024-04-24T13:33:06.657955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"86'2","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715489+0000","last_change":"2024-04-24T13:30:50.921336+0000","last_active":"2024-04-24T13:33:06.715489+0000","last_peered":"2024-04-24T13:33:06.715489+0000","last_clean":"2024-04-24T13:33:06.715489+0000","last_became_active":"2024-04-24T13:30:50.920829+0000","last_became_peered":"2024-04-24T13:30:50.920829+0000","last_unstale":"2024-04-24T13:33:06.715489+0000","last_undegraded":"2024-04-24T13:33:06.715489+0000","last_fullsized":"2024-04-24T13:33:06.715489+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:37.250085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"101'7","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735625+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:33:06.735625+0000","last_peered":"2024-04-24T13:33:06.735625+0000","last_clean":"2024-04-24T13:33:06.735625+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:33:06.735625+0000","last_undegraded":"2024-04-24T13:33:06.735625+0000","last_fullsized":"2024-04-24T13:33:06.735625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":64,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715226+0000","last_change":"2024-04-24T13:32:00.575312+0000","last_active":"2024-04-24T13:33:06.715226+0000","last_peered":"2024-04-24T13:33:06.715226+0000","last_clean":"2024-04-24T13:33:06.715226+0000","last_became_active":"2024-04-24T13:32:00.575004+0000","last_became_peered":"2024-04-24T13:32:00.575004+0000","last_unstale":"2024-04-24T13:33:06.715226+0000","last_undegraded":"2024-04-24T13:33:06.715226+0000","last_fullsized":"2024-04-24T13:33:06.715226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:23:40.859824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"86'14","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737776+0000","last_change":"2024-04-24T13:30:51.001114+0000","last_active":"2024-04-24T13:33:06.737776+0000","last_peered":"2024-04-24T13:33:06.737776+0000","last_clean":"2024-04-24T13:33:06.737776+0000","last_became_active":"2024-04-24T13:30:50.954422+0000","last_became_peered":"2024-04-24T13:30:50.954422+0000","last_unstale":"2024-04-24T13:33:06.737776+0000","last_undegraded":"2024-04-24T13:33:06.737776+0000","last_fullsized":"2024-04-24T13:33:06.737776+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:44.516492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"94'104","reported_seq":298,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710659+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:33:06.710659+0000","last_peered":"2024-04-24T13:33:06.710659+0000","last_clean":"2024-04-24T13:33:06.710659+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:33:06.710659+0000","last_undegraded":"2024-04-24T13:33:06.710659+0000","last_fullsized":"2024-04-24T13:33:06.710659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"82'2","reported_seq":116,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.734873+0000","last_change":"2024-04-24T13:32:00.583583+0000","last_active":"2024-04-24T13:33:06.734873+0000","last_peered":"2024-04-24T13:33:06.734873+0000","last_clean":"2024-04-24T13:33:06.734873+0000","last_became_active":"2024-04-24T13:32:00.577955+0000","last_became_peered":"2024-04-24T13:32:00.577955+0000","last_unstale":"2024-04-24T13:33:06.734873+0000","last_undegraded":"2024-04-24T13:33:06.734873+0000","last_fullsized":"2024-04-24T13:33:06.734873+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:31.661093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"102'6","reported_seq":122,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.037037+0000","last_change":"2024-04-24T13:31:01.035289+0000","last_active":"2024-04-24T13:33:07.037037+0000","last_peered":"2024-04-24T13:33:07.037037+0000","last_clean":"2024-04-24T13:33:07.037037+0000","last_became_active":"2024-04-24T13:31:01.034325+0000","last_became_peered":"2024-04-24T13:31:01.034325+0000","last_unstale":"2024-04-24T13:33:07.037037+0000","last_undegraded":"2024-04-24T13:33:07.037037+0000","last_fullsized":"2024-04-24T13:33:07.037037+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:08.322191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":130,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.736018+0000","last_change":"2024-04-24T13:30:50.948387+0000","last_active":"2024-04-24T13:33:06.736018+0000","last_peered":"2024-04-24T13:33:06.736018+0000","last_clean":"2024-04-24T13:33:06.736018+0000","last_became_active":"2024-04-24T13:30:50.947644+0000","last_became_peered":"2024-04-24T13:30:50.947644+0000","last_unstale":"2024-04-24T13:33:06.736018+0000","last_undegraded":"2024-04-24T13:33:06.736018+0000","last_fullsized":"2024-04-24T13:33:06.736018+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:03.622375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"86'24","reported_seq":138,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737411+0000","last_change":"2024-04-24T13:32:00.642541+0000","last_active":"2024-04-24T13:33:06.737411+0000","last_peered":"2024-04-24T13:33:06.737411+0000","last_clean":"2024-04-24T13:33:06.737411+0000","last_became_active":"2024-04-24T13:32:00.600504+0000","last_became_peered":"2024-04-24T13:32:00.600504+0000","last_unstale":"2024-04-24T13:33:06.737411+0000","last_undegraded":"2024-04-24T13:33:06.737411+0000","last_fullsized":"2024-04-24T13:33:06.737411+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:10.436000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703202+0000","last_change":"2024-04-24T13:32:00.572217+0000","last_active":"2024-04-24T13:33:06.703202+0000","last_peered":"2024-04-24T13:33:06.703202+0000","last_clean":"2024-04-24T13:33:06.703202+0000","last_became_active":"2024-04-24T13:32:00.571455+0000","last_became_peered":"2024-04-24T13:32:00.571455+0000","last_unstale":"2024-04-24T13:33:06.703202+0000","last_undegraded":"2024-04-24T13:33:06.703202+0000","last_fullsized":"2024-04-24T13:33:06.703202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:03.862128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"86'7","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647307+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:33:06.647307+0000","last_peered":"2024-04-24T13:33:06.647307+0000","last_clean":"2024-04-24T13:33:06.647307+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:33:06.647307+0000","last_undegraded":"2024-04-24T13:33:06.647307+0000","last_fullsized":"2024-04-24T13:33:06.647307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658233+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:33:06.658233+0000","last_peered":"2024-04-24T13:33:06.658233+0000","last_clean":"2024-04-24T13:33:06.658233+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:33:06.658233+0000","last_undegraded":"2024-04-24T13:33:06.658233+0000","last_fullsized":"2024-04-24T13:33:06.658233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"101'5","reported_seq":136,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660766+0000","last_change":"2024-04-24T13:30:50.930041+0000","last_active":"2024-04-24T13:33:06.660766+0000","last_peered":"2024-04-24T13:33:06.660766+0000","last_clean":"2024-04-24T13:33:06.660766+0000","last_became_active":"2024-04-24T13:30:50.929179+0000","last_became_peered":"2024-04-24T13:30:50.929179+0000","last_unstale":"2024-04-24T13:33:06.660766+0000","last_undegraded":"2024-04-24T13:33:06.660766+0000","last_fullsized":"2024-04-24T13:33:06.660766+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:46.987972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646180+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:33:06.646180+0000","last_peered":"2024-04-24T13:33:06.646180+0000","last_clean":"2024-04-24T13:33:06.646180+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:33:06.646180+0000","last_undegraded":"2024-04-24T13:33:06.646180+0000","last_fullsized":"2024-04-24T13:33:06.646180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"86'15","reported_seq":195,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710868+0000","last_change":"2024-04-24T13:30:50.948850+0000","last_active":"2024-04-24T13:33:06.710868+0000","last_peered":"2024-04-24T13:33:06.710868+0000","last_clean":"2024-04-24T13:33:06.710868+0000","last_became_active":"2024-04-24T13:30:50.921374+0000","last_became_peered":"2024-04-24T13:30:50.921374+0000","last_unstale":"2024-04-24T13:33:06.710868+0000","last_undegraded":"2024-04-24T13:33:06.710868+0000","last_fullsized":"2024-04-24T13:33:06.710868+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:22:03.728196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708104+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:33:06.708104+0000","last_peered":"2024-04-24T13:33:06.708104+0000","last_clean":"2024-04-24T13:33:06.708104+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:33:06.708104+0000","last_undegraded":"2024-04-24T13:33:06.708104+0000","last_fullsized":"2024-04-24T13:33:06.708104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737095+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:33:06.737095+0000","last_peered":"2024-04-24T13:33:06.737095+0000","last_clean":"2024-04-24T13:33:06.737095+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:33:06.737095+0000","last_undegraded":"2024-04-24T13:33:06.737095+0000","last_fullsized":"2024-04-24T13:33:06.737095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"82'4","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735135+0000","last_change":"2024-04-24T13:32:01.548738+0000","last_active":"2024-04-24T13:33:06.735135+0000","last_peered":"2024-04-24T13:33:06.735135+0000","last_clean":"2024-04-24T13:33:06.735135+0000","last_became_active":"2024-04-24T13:32:01.548259+0000","last_became_peered":"2024-04-24T13:32:01.548259+0000","last_unstale":"2024-04-24T13:33:06.735135+0000","last_undegraded":"2024-04-24T13:33:06.735135+0000","last_fullsized":"2024-04-24T13:33:06.735135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"102'8","reported_seq":74,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.104063+0000","last_change":"2024-04-24T13:32:00.584693+0000","last_active":"2024-04-24T13:33:07.104063+0000","last_peered":"2024-04-24T13:33:07.104063+0000","last_clean":"2024-04-24T13:33:07.104063+0000","last_became_active":"2024-04-24T13:32:00.583818+0000","last_became_peered":"2024-04-24T13:32:00.583818+0000","last_unstale":"2024-04-24T13:33:07.104063+0000","last_undegraded":"2024-04-24T13:33:07.104063+0000","last_fullsized":"2024-04-24T13:33:07.104063+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:54.012692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646777+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:33:06.646777+0000","last_peered":"2024-04-24T13:33:06.646777+0000","last_clean":"2024-04-24T13:33:06.646777+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:33:06.646777+0000","last_undegraded":"2024-04-24T13:33:06.646777+0000","last_fullsized":"2024-04-24T13:33:06.646777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"86'20","reported_seq":196,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646079+0000","last_change":"2024-04-24T13:30:50.970163+0000","last_active":"2024-04-24T13:33:06.646079+0000","last_peered":"2024-04-24T13:33:06.646079+0000","last_clean":"2024-04-24T13:33:06.646079+0000","last_became_active":"2024-04-24T13:30:50.920182+0000","last_became_peered":"2024-04-24T13:30:50.920182+0000","last_unstale":"2024-04-24T13:33:06.646079+0000","last_undegraded":"2024-04-24T13:33:06.646079+0000","last_fullsized":"2024-04-24T13:33:06.646079+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:29.765956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"94'104","reported_seq":372,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761957+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:33:06.761957+0000","last_peered":"2024-04-24T13:33:06.761957+0000","last_clean":"2024-04-24T13:33:06.761957+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:33:06.761957+0000","last_undegraded":"2024-04-24T13:33:06.761957+0000","last_fullsized":"2024-04-24T13:33:06.761957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"82'3","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762953+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:33:06.762953+0000","last_peered":"2024-04-24T13:33:06.762953+0000","last_clean":"2024-04-24T13:33:06.762953+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:33:06.762953+0000","last_undegraded":"2024-04-24T13:33:06.762953+0000","last_fullsized":"2024-04-24T13:33:06.762953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"94'7","reported_seq":194,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.764067+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:33:06.764067+0000","last_peered":"2024-04-24T13:33:06.764067+0000","last_clean":"2024-04-24T13:33:06.764067+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:33:06.764067+0000","last_undegraded":"2024-04-24T13:33:06.764067+0000","last_fullsized":"2024-04-24T13:33:06.764067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"102'8","reported_seq":72,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.711490+0000","last_change":"2024-04-24T13:32:00.594022+0000","last_active":"2024-04-24T13:33:06.711490+0000","last_peered":"2024-04-24T13:33:06.711490+0000","last_clean":"2024-04-24T13:33:06.711490+0000","last_became_active":"2024-04-24T13:32:00.593750+0000","last_became_peered":"2024-04-24T13:32:00.593750+0000","last_unstale":"2024-04-24T13:33:06.711490+0000","last_undegraded":"2024-04-24T13:33:06.711490+0000","last_fullsized":"2024-04-24T13:33:06.711490+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:53:33.468353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646870+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:33:06.646870+0000","last_peered":"2024-04-24T13:33:06.646870+0000","last_clean":"2024-04-24T13:33:06.646870+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:33:06.646870+0000","last_undegraded":"2024-04-24T13:33:06.646870+0000","last_fullsized":"2024-04-24T13:33:06.646870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'22","reported_seq":209,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761771+0000","last_change":"2024-04-24T13:30:51.000083+0000","last_active":"2024-04-24T13:33:06.761771+0000","last_peered":"2024-04-24T13:33:06.761771+0000","last_clean":"2024-04-24T13:33:06.761771+0000","last_became_active":"2024-04-24T13:30:50.934568+0000","last_became_peered":"2024-04-24T13:30:50.934568+0000","last_unstale":"2024-04-24T13:33:06.761771+0000","last_undegraded":"2024-04-24T13:33:06.761771+0000","last_fullsized":"2024-04-24T13:33:06.761771+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:10.436000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":159,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.645983+0000","last_change":"2024-04-24T13:30:50.908390+0000","last_active":"2024-04-24T13:33:06.645983+0000","last_peered":"2024-04-24T13:33:06.645983+0000","last_clean":"2024-04-24T13:33:06.645983+0000","last_became_active":"2024-04-24T13:30:50.908013+0000","last_became_peered":"2024-04-24T13:30:50.908013+0000","last_unstale":"2024-04-24T13:33:06.645983+0000","last_undegraded":"2024-04-24T13:33:06.645983+0000","last_fullsized":"2024-04-24T13:33:06.645983+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'10","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.705383+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:33:06.705383+0000","last_peered":"2024-04-24T13:33:06.705383+0000","last_clean":"2024-04-24T13:33:06.705383+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:33:06.705383+0000","last_undegraded":"2024-04-24T13:33:06.705383+0000","last_fullsized":"2024-04-24T13:33:06.705383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"82'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.659991+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:33:06.659991+0000","last_peered":"2024-04-24T13:33:06.659991+0000","last_clean":"2024-04-24T13:33:06.659991+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:33:06.659991+0000","last_undegraded":"2024-04-24T13:33:06.659991+0000","last_fullsized":"2024-04-24T13:33:06.659991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"102'11","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.929694+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:33:06.929694+0000","last_peered":"2024-04-24T13:33:06.929694+0000","last_clean":"2024-04-24T13:33:06.929694+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:33:06.929694+0000","last_undegraded":"2024-04-24T13:33:06.929694+0000","last_fullsized":"2024-04-24T13:33:06.929694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648211+0000","last_change":"2024-04-24T13:32:00.570272+0000","last_active":"2024-04-24T13:33:06.648211+0000","last_peered":"2024-04-24T13:33:06.648211+0000","last_clean":"2024-04-24T13:33:06.648211+0000","last_became_active":"2024-04-24T13:32:00.569572+0000","last_became_peered":"2024-04-24T13:32:00.569572+0000","last_unstale":"2024-04-24T13:33:06.648211+0000","last_undegraded":"2024-04-24T13:33:06.648211+0000","last_fullsized":"2024-04-24T13:33:06.648211+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:51.009578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'16","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658670+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:33:06.658670+0000","last_peered":"2024-04-24T13:33:06.658670+0000","last_clean":"2024-04-24T13:33:06.658670+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:33:06.658670+0000","last_undegraded":"2024-04-24T13:33:06.658670+0000","last_fullsized":"2024-04-24T13:33:06.658670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763072+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:33:06.763072+0000","last_peered":"2024-04-24T13:33:06.763072+0000","last_clean":"2024-04-24T13:33:06.763072+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:33:06.763072+0000","last_undegraded":"2024-04-24T13:33:06.763072+0000","last_fullsized":"2024-04-24T13:33:06.763072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708996+0000","last_change":"2024-04-24T13:32:00.577449+0000","last_active":"2024-04-24T13:33:06.708996+0000","last_peered":"2024-04-24T13:33:06.708996+0000","last_clean":"2024-04-24T13:33:06.708996+0000","last_became_active":"2024-04-24T13:32:00.576582+0000","last_became_peered":"2024-04-24T13:32:00.576582+0000","last_unstale":"2024-04-24T13:33:06.708996+0000","last_undegraded":"2024-04-24T13:33:06.708996+0000","last_fullsized":"2024-04-24T13:33:06.708996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:42.720281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660073+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:33:06.660073+0000","last_peered":"2024-04-24T13:33:06.660073+0000","last_clean":"2024-04-24T13:33:06.660073+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:33:06.660073+0000","last_undegraded":"2024-04-24T13:33:06.660073+0000","last_fullsized":"2024-04-24T13:33:06.660073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"102'8","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.185650+0000","last_change":"2024-04-24T13:31:00.986244+0000","last_active":"2024-04-24T13:33:07.185650+0000","last_peered":"2024-04-24T13:33:07.185650+0000","last_clean":"2024-04-24T13:33:07.185650+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:33:07.185650+0000","last_undegraded":"2024-04-24T13:33:07.185650+0000","last_fullsized":"2024-04-24T13:33:07.185650+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:23.355231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":164,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703617+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:33:06.703617+0000","last_peered":"2024-04-24T13:33:06.703617+0000","last_clean":"2024-04-24T13:33:06.703617+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:33:06.703617+0000","last_undegraded":"2024-04-24T13:33:06.703617+0000","last_fullsized":"2024-04-24T13:33:06.703617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"86'22","reported_seq":190,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.649374+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:33:06.649374+0000","last_peered":"2024-04-24T13:33:06.649374+0000","last_clean":"2024-04-24T13:33:06.649374+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:33:06.649374+0000","last_undegraded":"2024-04-24T13:33:06.649374+0000","last_fullsized":"2024-04-24T13:33:06.649374+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"94'105","reported_seq":311,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648749+0000","last_change":"2024-04-24T13:32:00.643512+0000","last_active":"2024-04-24T13:33:06.648749+0000","last_peered":"2024-04-24T13:33:06.648749+0000","last_clean":"2024-04-24T13:33:06.648749+0000","last_became_active":"2024-04-24T13:32:00.581919+0000","last_became_peered":"2024-04-24T13:32:00.581919+0000","last_unstale":"2024-04-24T13:33:06.648749+0000","last_undegraded":"2024-04-24T13:33:06.648749+0000","last_fullsized":"2024-04-24T13:33:06.648749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:01.892496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":152,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702970+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:33:06.702970+0000","last_peered":"2024-04-24T13:33:06.702970+0000","last_clean":"2024-04-24T13:33:06.702970+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:33:06.702970+0000","last_undegraded":"2024-04-24T13:33:06.702970+0000","last_fullsized":"2024-04-24T13:33:06.702970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660403+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:33:06.660403+0000","last_peered":"2024-04-24T13:33:06.660403+0000","last_clean":"2024-04-24T13:33:06.660403+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:33:06.660403+0000","last_undegraded":"2024-04-24T13:33:06.660403+0000","last_fullsized":"2024-04-24T13:33:06.660403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"101'10","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657054+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:33:06.657054+0000","last_peered":"2024-04-24T13:33:06.657054+0000","last_clean":"2024-04-24T13:33:06.657054+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:33:06.657054+0000","last_undegraded":"2024-04-24T13:33:06.657054+0000","last_fullsized":"2024-04-24T13:33:06.657054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":215,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660585+0000","last_change":"2024-04-24T13:32:00.620428+0000","last_active":"2024-04-24T13:33:06.660585+0000","last_peered":"2024-04-24T13:33:06.660585+0000","last_clean":"2024-04-24T13:33:06.660585+0000","last_became_active":"2024-04-24T13:32:00.580756+0000","last_became_peered":"2024-04-24T13:32:00.580756+0000","last_unstale":"2024-04-24T13:33:06.660585+0000","last_undegraded":"2024-04-24T13:33:06.660585+0000","last_fullsized":"2024-04-24T13:33:06.660585+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:02.973502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"82'11","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710755+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:33:06.710755+0000","last_peered":"2024-04-24T13:33:06.710755+0000","last_clean":"2024-04-24T13:33:06.710755+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:33:06.710755+0000","last_undegraded":"2024-04-24T13:33:06.710755+0000","last_fullsized":"2024-04-24T13:33:06.710755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"94'104","reported_seq":327,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737358+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:33:06.737358+0000","last_peered":"2024-04-24T13:33:06.737358+0000","last_clean":"2024-04-24T13:33:06.737358+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:33:06.737358+0000","last_undegraded":"2024-04-24T13:33:06.737358+0000","last_fullsized":"2024-04-24T13:33:06.737358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.659152+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:33:06.659152+0000","last_peered":"2024-04-24T13:33:06.659152+0000","last_clean":"2024-04-24T13:33:06.659152+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:33:06.659152+0000","last_undegraded":"2024-04-24T13:33:06.659152+0000","last_fullsized":"2024-04-24T13:33:06.659152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"86'4","reported_seq":186,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.705632+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:33:06.705632+0000","last_peered":"2024-04-24T13:33:06.705632+0000","last_clean":"2024-04-24T13:33:06.705632+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:33:06.705632+0000","last_undegraded":"2024-04-24T13:33:06.705632+0000","last_fullsized":"2024-04-24T13:33:06.705632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"102'8","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708143+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:33:06.708143+0000","last_peered":"2024-04-24T13:33:06.708143+0000","last_clean":"2024-04-24T13:33:06.708143+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:33:06.708143+0000","last_undegraded":"2024-04-24T13:33:06.708143+0000","last_fullsized":"2024-04-24T13:33:06.708143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.659938+0000","last_change":"2024-04-24T13:32:00.575444+0000","last_active":"2024-04-24T13:33:06.659938+0000","last_peered":"2024-04-24T13:33:06.659938+0000","last_clean":"2024-04-24T13:33:06.659938+0000","last_became_active":"2024-04-24T13:32:00.574616+0000","last_became_peered":"2024-04-24T13:32:00.574616+0000","last_unstale":"2024-04-24T13:33:06.659938+0000","last_undegraded":"2024-04-24T13:33:06.659938+0000","last_fullsized":"2024-04-24T13:33:06.659938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:51.796840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"86'22","reported_seq":134,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704191+0000","last_change":"2024-04-24T13:32:00.659945+0000","last_active":"2024-04-24T13:33:06.704191+0000","last_peered":"2024-04-24T13:33:06.704191+0000","last_clean":"2024-04-24T13:33:06.704191+0000","last_became_active":"2024-04-24T13:32:00.596498+0000","last_became_peered":"2024-04-24T13:32:00.596498+0000","last_unstale":"2024-04-24T13:33:06.704191+0000","last_undegraded":"2024-04-24T13:33:06.704191+0000","last_fullsized":"2024-04-24T13:33:06.704191+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:22:03.728196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":153,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735917+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:33:06.735917+0000","last_peered":"2024-04-24T13:33:06.735917+0000","last_clean":"2024-04-24T13:33:06.735917+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:33:06.735917+0000","last_undegraded":"2024-04-24T13:33:06.735917+0000","last_fullsized":"2024-04-24T13:33:06.735917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"82'2","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703148+0000","last_change":"2024-04-24T13:32:00.562685+0000","last_active":"2024-04-24T13:33:06.703148+0000","last_peered":"2024-04-24T13:33:06.703148+0000","last_clean":"2024-04-24T13:33:06.703148+0000","last_became_active":"2024-04-24T13:32:00.562306+0000","last_became_peered":"2024-04-24T13:32:00.562306+0000","last_unstale":"2024-04-24T13:33:06.703148+0000","last_undegraded":"2024-04-24T13:33:06.703148+0000","last_fullsized":"2024-04-24T13:33:06.703148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:36:11.086183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"94'3","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.738055+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:33:06.738055+0000","last_peered":"2024-04-24T13:33:06.738055+0000","last_clean":"2024-04-24T13:33:06.738055+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:33:06.738055+0000","last_undegraded":"2024-04-24T13:33:06.738055+0000","last_fullsized":"2024-04-24T13:33:06.738055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":296,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761960+0000","last_change":"2024-04-24T13:30:53.928527+0000","last_active":"2024-04-24T13:33:06.761960+0000","last_peered":"2024-04-24T13:33:06.761960+0000","last_clean":"2024-04-24T13:33:06.761960+0000","last_became_active":"2024-04-24T13:30:53.928167+0000","last_became_peered":"2024-04-24T13:30:53.928167+0000","last_unstale":"2024-04-24T13:33:06.761960+0000","last_undegraded":"2024-04-24T13:33:06.761960+0000","last_fullsized":"2024-04-24T13:33:06.761960+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:43.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646681+0000","last_change":"2024-04-24T13:32:00.578098+0000","last_active":"2024-04-24T13:33:06.646681+0000","last_peered":"2024-04-24T13:33:06.646681+0000","last_clean":"2024-04-24T13:33:06.646681+0000","last_became_active":"2024-04-24T13:32:00.577790+0000","last_became_peered":"2024-04-24T13:32:00.577790+0000","last_unstale":"2024-04-24T13:33:06.646681+0000","last_undegraded":"2024-04-24T13:33:06.646681+0000","last_fullsized":"2024-04-24T13:33:06.646681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:25.305366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"102'8","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.423042+0000","last_change":"2024-04-24T13:32:00.603123+0000","last_active":"2024-04-24T13:33:07.423042+0000","last_peered":"2024-04-24T13:33:07.423042+0000","last_clean":"2024-04-24T13:33:07.423042+0000","last_became_active":"2024-04-24T13:32:00.602796+0000","last_became_peered":"2024-04-24T13:32:00.602796+0000","last_unstale":"2024-04-24T13:33:07.423042+0000","last_undegraded":"2024-04-24T13:33:07.423042+0000","last_fullsized":"2024-04-24T13:33:07.423042+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:00.666218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":137,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648134+0000","last_change":"2024-04-24T13:32:00.570311+0000","last_active":"2024-04-24T13:33:06.648134+0000","last_peered":"2024-04-24T13:33:06.648134+0000","last_clean":"2024-04-24T13:33:06.648134+0000","last_became_active":"2024-04-24T13:32:00.570038+0000","last_became_peered":"2024-04-24T13:32:00.570038+0000","last_unstale":"2024-04-24T13:33:06.648134+0000","last_undegraded":"2024-04-24T13:33:06.648134+0000","last_fullsized":"2024-04-24T13:33:06.648134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:18.009342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"86'31","reported_seq":139,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715702+0000","last_change":"2024-04-24T13:32:00.618901+0000","last_active":"2024-04-24T13:33:06.715702+0000","last_peered":"2024-04-24T13:33:06.715702+0000","last_clean":"2024-04-24T13:33:06.715702+0000","last_became_active":"2024-04-24T13:32:00.577557+0000","last_became_peered":"2024-04-24T13:32:00.577557+0000","last_unstale":"2024-04-24T13:33:06.715702+0000","last_undegraded":"2024-04-24T13:33:06.715702+0000","last_fullsized":"2024-04-24T13:33:06.715702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:37.412890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62524,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":20,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":160,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762902+0000","last_change":"2024-04-24T13:30:50.917737+0000","last_active":"2024-04-24T13:33:06.762902+0000","last_peered":"2024-04-24T13:33:06.762902+0000","last_clean":"2024-04-24T13:33:06.762902+0000","last_became_active":"2024-04-24T13:30:50.916920+0000","last_became_peered":"2024-04-24T13:30:50.916920+0000","last_unstale":"2024-04-24T13:33:06.762902+0000","last_undegraded":"2024-04-24T13:33:06.762902+0000","last_fullsized":"2024-04-24T13:33:06.762902+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:12.813827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735181+0000","last_change":"2024-04-24T13:32:00.594436+0000","last_active":"2024-04-24T13:33:06.735181+0000","last_peered":"2024-04-24T13:33:06.735181+0000","last_clean":"2024-04-24T13:33:06.735181+0000","last_became_active":"2024-04-24T13:32:00.593632+0000","last_became_peered":"2024-04-24T13:32:00.593632+0000","last_unstale":"2024-04-24T13:33:06.735181+0000","last_undegraded":"2024-04-24T13:33:06.735181+0000","last_fullsized":"2024-04-24T13:33:06.735181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:42:19.800985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"94'5","reported_seq":187,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762568+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:33:06.762568+0000","last_peered":"2024-04-24T13:33:06.762568+0000","last_clean":"2024-04-24T13:33:06.762568+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:33:06.762568+0000","last_undegraded":"2024-04-24T13:33:06.762568+0000","last_fullsized":"2024-04-24T13:33:06.762568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":132,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702901+0000","last_change":"2024-04-24T13:30:50.937903+0000","last_active":"2024-04-24T13:33:06.702901+0000","last_peered":"2024-04-24T13:33:06.702901+0000","last_clean":"2024-04-24T13:33:06.702901+0000","last_became_active":"2024-04-24T13:30:50.937359+0000","last_became_peered":"2024-04-24T13:30:50.937359+0000","last_unstale":"2024-04-24T13:33:06.702901+0000","last_undegraded":"2024-04-24T13:33:06.702901+0000","last_fullsized":"2024-04-24T13:33:06.702901+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:27.651521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"102'7","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761914+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:33:06.761914+0000","last_peered":"2024-04-24T13:33:06.761914+0000","last_clean":"2024-04-24T13:33:06.761914+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:33:06.761914+0000","last_undegraded":"2024-04-24T13:33:06.761914+0000","last_fullsized":"2024-04-24T13:33:06.761914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":65,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.705485+0000","last_change":"2024-04-24T13:32:00.582433+0000","last_active":"2024-04-24T13:33:06.705485+0000","last_peered":"2024-04-24T13:33:06.705485+0000","last_clean":"2024-04-24T13:33:06.705485+0000","last_became_active":"2024-04-24T13:32:00.581917+0000","last_became_peered":"2024-04-24T13:32:00.581917+0000","last_unstale":"2024-04-24T13:33:06.705485+0000","last_undegraded":"2024-04-24T13:33:06.705485+0000","last_fullsized":"2024-04-24T13:33:06.705485+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:08.428841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"94'106","reported_seq":350,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703520+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:33:06.703520+0000","last_peered":"2024-04-24T13:33:06.703520+0000","last_clean":"2024-04-24T13:33:06.703520+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:33:06.703520+0000","last_undegraded":"2024-04-24T13:33:06.703520+0000","last_fullsized":"2024-04-24T13:33:06.703520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":144,"num_read_kb":129,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":132,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648374+0000","last_change":"2024-04-24T13:30:50.925382+0000","last_active":"2024-04-24T13:33:06.648374+0000","last_peered":"2024-04-24T13:33:06.648374+0000","last_clean":"2024-04-24T13:33:06.648374+0000","last_became_active":"2024-04-24T13:30:50.924919+0000","last_became_peered":"2024-04-24T13:30:50.924919+0000","last_unstale":"2024-04-24T13:33:06.648374+0000","last_undegraded":"2024-04-24T13:33:06.648374+0000","last_fullsized":"2024-04-24T13:33:06.648374+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":152,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702894+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:33:06.702894+0000","last_peered":"2024-04-24T13:33:06.702894+0000","last_clean":"2024-04-24T13:33:06.702894+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:33:06.702894+0000","last_undegraded":"2024-04-24T13:33:06.702894+0000","last_fullsized":"2024-04-24T13:33:06.702894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.705710+0000","last_change":"2024-04-24T13:32:00.582203+0000","last_active":"2024-04-24T13:33:06.705710+0000","last_peered":"2024-04-24T13:33:06.705710+0000","last_clean":"2024-04-24T13:33:06.705710+0000","last_became_active":"2024-04-24T13:32:00.581535+0000","last_became_peered":"2024-04-24T13:32:00.581535+0000","last_unstale":"2024-04-24T13:33:06.705710+0000","last_undegraded":"2024-04-24T13:33:06.705710+0000","last_fullsized":"2024-04-24T13:33:06.705710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:37.250085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646263+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:33:06.646263+0000","last_peered":"2024-04-24T13:33:06.646263+0000","last_clean":"2024-04-24T13:33:06.646263+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:33:06.646263+0000","last_undegraded":"2024-04-24T13:33:06.646263+0000","last_fullsized":"2024-04-24T13:33:06.646263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"102'6","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.189113+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:33:07.189113+0000","last_peered":"2024-04-24T13:33:07.189113+0000","last_clean":"2024-04-24T13:33:07.189113+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:33:07.189113+0000","last_undegraded":"2024-04-24T13:33:07.189113+0000","last_fullsized":"2024-04-24T13:33:07.189113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648828+0000","last_change":"2024-04-24T13:32:00.591663+0000","last_active":"2024-04-24T13:33:06.648828+0000","last_peered":"2024-04-24T13:33:06.648828+0000","last_clean":"2024-04-24T13:33:06.648828+0000","last_became_active":"2024-04-24T13:32:00.569726+0000","last_became_peered":"2024-04-24T13:32:00.569726+0000","last_unstale":"2024-04-24T13:33:06.648828+0000","last_undegraded":"2024-04-24T13:33:06.648828+0000","last_fullsized":"2024-04-24T13:33:06.648828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:45.895863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"82'17","reported_seq":217,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737620+0000","last_change":"2024-04-24T13:30:50.991700+0000","last_active":"2024-04-24T13:33:06.737620+0000","last_peered":"2024-04-24T13:33:06.737620+0000","last_clean":"2024-04-24T13:33:06.737620+0000","last_became_active":"2024-04-24T13:30:50.940740+0000","last_became_peered":"2024-04-24T13:30:50.940740+0000","last_unstale":"2024-04-24T13:33:06.737620+0000","last_undegraded":"2024-04-24T13:33:06.737620+0000","last_fullsized":"2024-04-24T13:33:06.737620+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:39.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762495+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:33:06.762495+0000","last_peered":"2024-04-24T13:33:06.762495+0000","last_clean":"2024-04-24T13:33:06.762495+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:33:06.762495+0000","last_undegraded":"2024-04-24T13:33:06.762495+0000","last_fullsized":"2024-04-24T13:33:06.762495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.711201+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:33:06.711201+0000","last_peered":"2024-04-24T13:33:06.711201+0000","last_clean":"2024-04-24T13:33:06.711201+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:33:06.711201+0000","last_undegraded":"2024-04-24T13:33:06.711201+0000","last_fullsized":"2024-04-24T13:33:06.711201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"82'2","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703838+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:33:06.703838+0000","last_peered":"2024-04-24T13:33:06.703838+0000","last_clean":"2024-04-24T13:33:06.703838+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:33:06.703838+0000","last_undegraded":"2024-04-24T13:33:06.703838+0000","last_fullsized":"2024-04-24T13:33:06.703838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703419+0000","last_change":"2024-04-24T13:32:00.588318+0000","last_active":"2024-04-24T13:33:06.703419+0000","last_peered":"2024-04-24T13:33:06.703419+0000","last_clean":"2024-04-24T13:33:06.703419+0000","last_became_active":"2024-04-24T13:32:00.587965+0000","last_became_peered":"2024-04-24T13:32:00.587965+0000","last_unstale":"2024-04-24T13:33:06.703419+0000","last_undegraded":"2024-04-24T13:33:06.703419+0000","last_fullsized":"2024-04-24T13:33:06.703419+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:06.838879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"102'9","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.714784+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:33:06.714784+0000","last_peered":"2024-04-24T13:33:06.714784+0000","last_clean":"2024-04-24T13:33:06.714784+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:33:06.714784+0000","last_undegraded":"2024-04-24T13:33:06.714784+0000","last_fullsized":"2024-04-24T13:33:06.714784+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.760398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762194+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:33:06.762194+0000","last_peered":"2024-04-24T13:33:06.762194+0000","last_clean":"2024-04-24T13:33:06.762194+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:33:06.762194+0000","last_undegraded":"2024-04-24T13:33:06.762194+0000","last_fullsized":"2024-04-24T13:33:06.762194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715126+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:33:06.715126+0000","last_peered":"2024-04-24T13:33:06.715126+0000","last_clean":"2024-04-24T13:33:06.715126+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:33:06.715126+0000","last_undegraded":"2024-04-24T13:33:06.715126+0000","last_fullsized":"2024-04-24T13:33:06.715126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":153,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.738199+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:33:06.738199+0000","last_peered":"2024-04-24T13:33:06.738199+0000","last_clean":"2024-04-24T13:33:06.738199+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:33:06.738199+0000","last_undegraded":"2024-04-24T13:33:06.738199+0000","last_fullsized":"2024-04-24T13:33:06.738199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"81'4","reported_seq":70,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708885+0000","last_change":"2024-04-24T13:32:00.577712+0000","last_active":"2024-04-24T13:33:06.708885+0000","last_peered":"2024-04-24T13:33:06.708885+0000","last_clean":"2024-04-24T13:33:06.708885+0000","last_became_active":"2024-04-24T13:32:00.575604+0000","last_became_peered":"2024-04-24T13:32:00.575604+0000","last_unstale":"2024-04-24T13:33:06.708885+0000","last_undegraded":"2024-04-24T13:33:06.708885+0000","last_fullsized":"2024-04-24T13:33:06.708885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:15.663480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703231+0000","last_change":"2024-04-24T13:32:00.569068+0000","last_active":"2024-04-24T13:33:06.703231+0000","last_peered":"2024-04-24T13:33:06.703231+0000","last_clean":"2024-04-24T13:33:06.703231+0000","last_became_active":"2024-04-24T13:32:00.568763+0000","last_became_peered":"2024-04-24T13:32:00.568763+0000","last_unstale":"2024-04-24T13:33:06.703231+0000","last_undegraded":"2024-04-24T13:33:06.703231+0000","last_fullsized":"2024-04-24T13:33:06.703231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:56.027255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"100'8","reported_seq":73,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.714543+0000","last_change":"2024-04-24T13:32:00.577865+0000","last_active":"2024-04-24T13:33:06.714543+0000","last_peered":"2024-04-24T13:33:06.714543+0000","last_clean":"2024-04-24T13:33:06.714543+0000","last_became_active":"2024-04-24T13:32:00.577564+0000","last_became_peered":"2024-04-24T13:32:00.577564+0000","last_unstale":"2024-04-24T13:33:06.714543+0000","last_undegraded":"2024-04-24T13:33:06.714543+0000","last_fullsized":"2024-04-24T13:33:06.714543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:52:14.484190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704285+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:33:06.704285+0000","last_peered":"2024-04-24T13:33:06.704285+0000","last_clean":"2024-04-24T13:33:06.704285+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:33:06.704285+0000","last_undegraded":"2024-04-24T13:33:06.704285+0000","last_fullsized":"2024-04-24T13:33:06.704285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762086+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:33:06.762086+0000","last_peered":"2024-04-24T13:33:06.762086+0000","last_clean":"2024-04-24T13:33:06.762086+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:33:06.762086+0000","last_undegraded":"2024-04-24T13:33:06.762086+0000","last_fullsized":"2024-04-24T13:33:06.762086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'28","reported_seq":201,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761513+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:33:06.761513+0000","last_peered":"2024-04-24T13:33:06.761513+0000","last_clean":"2024-04-24T13:33:06.761513+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:33:06.761513+0000","last_undegraded":"2024-04-24T13:33:06.761513+0000","last_fullsized":"2024-04-24T13:33:06.761513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.659114+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:33:06.659114+0000","last_peered":"2024-04-24T13:33:06.659114+0000","last_clean":"2024-04-24T13:33:06.659114+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:33:06.659114+0000","last_undegraded":"2024-04-24T13:33:06.659114+0000","last_fullsized":"2024-04-24T13:33:06.659114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763107+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:33:06.763107+0000","last_peered":"2024-04-24T13:33:06.763107+0000","last_clean":"2024-04-24T13:33:06.763107+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:33:06.763107+0000","last_undegraded":"2024-04-24T13:33:06.763107+0000","last_fullsized":"2024-04-24T13:33:06.763107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'15","reported_seq":223,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763966+0000","last_change":"2024-04-24T13:32:00.572648+0000","last_active":"2024-04-24T13:33:06.763966+0000","last_peered":"2024-04-24T13:33:06.763966+0000","last_clean":"2024-04-24T13:33:06.763966+0000","last_became_active":"2024-04-24T13:32:00.572370+0000","last_became_peered":"2024-04-24T13:32:00.572370+0000","last_unstale":"2024-04-24T13:33:06.763966+0000","last_undegraded":"2024-04-24T13:33:06.763966+0000","last_fullsized":"2024-04-24T13:33:06.763966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:03:27.828826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"102'4","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703984+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:33:06.703984+0000","last_peered":"2024-04-24T13:33:06.703984+0000","last_clean":"2024-04-24T13:33:06.703984+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:33:06.703984+0000","last_undegraded":"2024-04-24T13:33:06.703984+0000","last_fullsized":"2024-04-24T13:33:06.703984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":132,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762432+0000","last_change":"2024-04-24T13:30:50.937016+0000","last_active":"2024-04-24T13:33:06.762432+0000","last_peered":"2024-04-24T13:33:06.762432+0000","last_clean":"2024-04-24T13:33:06.762432+0000","last_became_active":"2024-04-24T13:30:50.934998+0000","last_became_peered":"2024-04-24T13:30:50.934998+0000","last_unstale":"2024-04-24T13:33:06.762432+0000","last_undegraded":"2024-04-24T13:33:06.762432+0000","last_fullsized":"2024-04-24T13:33:06.762432+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:42:03.696601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735883+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:33:06.735883+0000","last_peered":"2024-04-24T13:33:06.735883+0000","last_clean":"2024-04-24T13:33:06.735883+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:33:06.735883+0000","last_undegraded":"2024-04-24T13:33:06.735883+0000","last_fullsized":"2024-04-24T13:33:06.735883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702678+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:33:06.702678+0000","last_peered":"2024-04-24T13:33:06.702678+0000","last_clean":"2024-04-24T13:33:06.702678+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:33:06.702678+0000","last_undegraded":"2024-04-24T13:33:06.702678+0000","last_fullsized":"2024-04-24T13:33:06.702678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"94'105","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702755+0000","last_change":"2024-04-24T13:32:00.637531+0000","last_active":"2024-04-24T13:33:06.702755+0000","last_peered":"2024-04-24T13:33:06.702755+0000","last_clean":"2024-04-24T13:33:06.702755+0000","last_became_active":"2024-04-24T13:32:00.580902+0000","last_became_peered":"2024-04-24T13:32:00.580902+0000","last_unstale":"2024-04-24T13:33:06.702755+0000","last_undegraded":"2024-04-24T13:33:06.702755+0000","last_fullsized":"2024-04-24T13:33:06.702755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:39.251312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"81'1","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715320+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:33:06.715320+0000","last_peered":"2024-04-24T13:33:06.715320+0000","last_clean":"2024-04-24T13:33:06.715320+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:33:06.715320+0000","last_undegraded":"2024-04-24T13:33:06.715320+0000","last_fullsized":"2024-04-24T13:33:06.715320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"82'2","reported_seq":126,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.645860+0000","last_change":"2024-04-24T13:31:01.035271+0000","last_active":"2024-04-24T13:33:06.645860+0000","last_peered":"2024-04-24T13:33:06.645860+0000","last_clean":"2024-04-24T13:33:06.645860+0000","last_became_active":"2024-04-24T13:31:01.034314+0000","last_became_peered":"2024-04-24T13:31:01.034314+0000","last_unstale":"2024-04-24T13:33:06.645860+0000","last_undegraded":"2024-04-24T13:33:06.645860+0000","last_fullsized":"2024-04-24T13:33:06.645860+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:45.074671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"102'10","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.228018+0000","last_change":"2024-04-24T13:30:50.913675+0000","last_active":"2024-04-24T13:33:07.228018+0000","last_peered":"2024-04-24T13:33:07.228018+0000","last_clean":"2024-04-24T13:33:07.228018+0000","last_became_active":"2024-04-24T13:30:50.912153+0000","last_became_peered":"2024-04-24T13:30:50.912153+0000","last_unstale":"2024-04-24T13:33:07.228018+0000","last_undegraded":"2024-04-24T13:33:07.228018+0000","last_fullsized":"2024-04-24T13:33:07.228018+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.808699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704961+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:33:06.704961+0000","last_peered":"2024-04-24T13:33:06.704961+0000","last_clean":"2024-04-24T13:33:06.704961+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:33:06.704961+0000","last_undegraded":"2024-04-24T13:33:06.704961+0000","last_fullsized":"2024-04-24T13:33:06.704961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658502+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:33:06.658502+0000","last_peered":"2024-04-24T13:33:06.658502+0000","last_clean":"2024-04-24T13:33:06.658502+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:33:06.658502+0000","last_undegraded":"2024-04-24T13:33:06.658502+0000","last_fullsized":"2024-04-24T13:33:06.658502+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660427+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:33:06.660427+0000","last_peered":"2024-04-24T13:33:06.660427+0000","last_clean":"2024-04-24T13:33:06.660427+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:33:06.660427+0000","last_undegraded":"2024-04-24T13:33:06.660427+0000","last_fullsized":"2024-04-24T13:33:06.660427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"94'104","reported_seq":290,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.711106+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:33:06.711106+0000","last_peered":"2024-04-24T13:33:06.711106+0000","last_clean":"2024-04-24T13:33:06.711106+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:33:06.711106+0000","last_undegraded":"2024-04-24T13:33:06.711106+0000","last_fullsized":"2024-04-24T13:33:06.711106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"82'6","reported_seq":159,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762490+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:33:06.762490+0000","last_peered":"2024-04-24T13:33:06.762490+0000","last_clean":"2024-04-24T13:33:06.762490+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:33:06.762490+0000","last_undegraded":"2024-04-24T13:33:06.762490+0000","last_fullsized":"2024-04-24T13:33:06.762490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"94'3","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657769+0000","last_change":"2024-04-24T13:32:00.573698+0000","last_active":"2024-04-24T13:33:06.657769+0000","last_peered":"2024-04-24T13:33:06.657769+0000","last_clean":"2024-04-24T13:33:06.657769+0000","last_became_active":"2024-04-24T13:32:00.572831+0000","last_became_peered":"2024-04-24T13:32:00.572831+0000","last_unstale":"2024-04-24T13:33:06.657769+0000","last_undegraded":"2024-04-24T13:33:06.657769+0000","last_fullsized":"2024-04-24T13:33:06.657769+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:37:38.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"102'10","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.368056+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:33:07.368056+0000","last_peered":"2024-04-24T13:33:07.368056+0000","last_clean":"2024-04-24T13:33:07.368056+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:33:07.368056+0000","last_undegraded":"2024-04-24T13:33:07.368056+0000","last_fullsized":"2024-04-24T13:33:07.368056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.739273+0000","last_change":"2024-04-24T13:30:50.937218+0000","last_active":"2024-04-24T13:33:06.739273+0000","last_peered":"2024-04-24T13:33:06.739273+0000","last_clean":"2024-04-24T13:33:06.739273+0000","last_became_active":"2024-04-24T13:30:50.936420+0000","last_became_peered":"2024-04-24T13:30:50.936420+0000","last_unstale":"2024-04-24T13:33:06.739273+0000","last_undegraded":"2024-04-24T13:33:06.739273+0000","last_fullsized":"2024-04-24T13:33:06.739273+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:08.910360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708635+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:33:06.708635+0000","last_peered":"2024-04-24T13:33:06.708635+0000","last_clean":"2024-04-24T13:33:06.708635+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:33:06.708635+0000","last_undegraded":"2024-04-24T13:33:06.708635+0000","last_fullsized":"2024-04-24T13:33:06.708635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"86'34","reported_seq":217,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735657+0000","last_change":"2024-04-24T13:30:50.977698+0000","last_active":"2024-04-24T13:33:06.735657+0000","last_peered":"2024-04-24T13:33:06.735657+0000","last_clean":"2024-04-24T13:33:06.735657+0000","last_became_active":"2024-04-24T13:30:50.936955+0000","last_became_peered":"2024-04-24T13:30:50.936955+0000","last_unstale":"2024-04-24T13:33:06.735657+0000","last_undegraded":"2024-04-24T13:33:06.735657+0000","last_fullsized":"2024-04-24T13:33:06.735657+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:47.349331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708189+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:33:06.708189+0000","last_peered":"2024-04-24T13:33:06.708189+0000","last_clean":"2024-04-24T13:33:06.708189+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:33:06.708189+0000","last_undegraded":"2024-04-24T13:33:06.708189+0000","last_fullsized":"2024-04-24T13:33:06.708189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"94'5","reported_seq":102,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647972+0000","last_change":"2024-04-24T13:32:00.565416+0000","last_active":"2024-04-24T13:33:06.647972+0000","last_peered":"2024-04-24T13:33:06.647972+0000","last_clean":"2024-04-24T13:33:06.647972+0000","last_became_active":"2024-04-24T13:32:00.565144+0000","last_became_peered":"2024-04-24T13:32:00.565144+0000","last_unstale":"2024-04-24T13:33:06.647972+0000","last_undegraded":"2024-04-24T13:33:06.647972+0000","last_fullsized":"2024-04-24T13:33:06.647972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"82'2","reported_seq":160,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762793+0000","last_change":"2024-04-24T13:32:00.592514+0000","last_active":"2024-04-24T13:33:06.762793+0000","last_peered":"2024-04-24T13:33:06.762793+0000","last_clean":"2024-04-24T13:33:06.762793+0000","last_became_active":"2024-04-24T13:32:00.591877+0000","last_became_peered":"2024-04-24T13:32:00.591877+0000","last_unstale":"2024-04-24T13:33:06.762793+0000","last_undegraded":"2024-04-24T13:33:06.762793+0000","last_fullsized":"2024-04-24T13:33:06.762793+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:14:57.431228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"82'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658086+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:33:06.658086+0000","last_peered":"2024-04-24T13:33:06.658086+0000","last_clean":"2024-04-24T13:33:06.658086+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:33:06.658086+0000","last_undegraded":"2024-04-24T13:33:06.658086+0000","last_fullsized":"2024-04-24T13:33:06.658086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"102'14","reported_seq":130,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646815+0000","last_change":"2024-04-24T13:31:00.986151+0000","last_active":"2024-04-24T13:33:06.646815+0000","last_peered":"2024-04-24T13:33:06.646815+0000","last_clean":"2024-04-24T13:33:06.646815+0000","last_became_active":"2024-04-24T13:31:00.985421+0000","last_became_peered":"2024-04-24T13:31:00.985421+0000","last_unstale":"2024-04-24T13:33:06.646815+0000","last_undegraded":"2024-04-24T13:33:06.646815+0000","last_fullsized":"2024-04-24T13:33:06.646815+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:42.662404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":243,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704047+0000","last_change":"2024-04-24T13:32:00.636177+0000","last_active":"2024-04-24T13:33:06.704047+0000","last_peered":"2024-04-24T13:33:06.704047+0000","last_clean":"2024-04-24T13:33:06.704047+0000","last_became_active":"2024-04-24T13:32:00.580888+0000","last_became_peered":"2024-04-24T13:32:00.580888+0000","last_unstale":"2024-04-24T13:33:06.704047+0000","last_undegraded":"2024-04-24T13:33:06.704047+0000","last_fullsized":"2024-04-24T13:33:06.704047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:21:21.951639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"86'17","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708024+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:33:06.708024+0000","last_peered":"2024-04-24T13:33:06.708024+0000","last_clean":"2024-04-24T13:33:06.708024+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:33:06.708024+0000","last_undegraded":"2024-04-24T13:33:06.708024+0000","last_fullsized":"2024-04-24T13:33:06.708024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708790+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:33:06.708790+0000","last_peered":"2024-04-24T13:33:06.708790+0000","last_clean":"2024-04-24T13:33:06.708790+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:33:06.708790+0000","last_undegraded":"2024-04-24T13:33:06.708790+0000","last_fullsized":"2024-04-24T13:33:06.708790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.714832+0000","last_change":"2024-04-24T13:30:50.930475+0000","last_active":"2024-04-24T13:33:06.714832+0000","last_peered":"2024-04-24T13:33:06.714832+0000","last_clean":"2024-04-24T13:33:06.714832+0000","last_became_active":"2024-04-24T13:30:50.929905+0000","last_became_peered":"2024-04-24T13:30:50.929905+0000","last_unstale":"2024-04-24T13:33:06.714832+0000","last_undegraded":"2024-04-24T13:33:06.714832+0000","last_fullsized":"2024-04-24T13:33:06.714832+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:41.257023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703142+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:33:06.703142+0000","last_peered":"2024-04-24T13:33:06.703142+0000","last_clean":"2024-04-24T13:33:06.703142+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:33:06.703142+0000","last_undegraded":"2024-04-24T13:33:06.703142+0000","last_fullsized":"2024-04-24T13:33:06.703142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"101'6","reported_seq":134,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710861+0000","last_change":"2024-04-24T13:30:50.931263+0000","last_active":"2024-04-24T13:33:06.710861+0000","last_peered":"2024-04-24T13:33:06.710861+0000","last_clean":"2024-04-24T13:33:06.710861+0000","last_became_active":"2024-04-24T13:30:50.929683+0000","last_became_peered":"2024-04-24T13:30:50.929683+0000","last_unstale":"2024-04-24T13:33:06.710861+0000","last_undegraded":"2024-04-24T13:33:06.710861+0000","last_fullsized":"2024-04-24T13:33:06.710861+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:28:57.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710601+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:33:06.710601+0000","last_peered":"2024-04-24T13:33:06.710601+0000","last_clean":"2024-04-24T13:33:06.710601+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:33:06.710601+0000","last_undegraded":"2024-04-24T13:33:06.710601+0000","last_fullsized":"2024-04-24T13:33:06.710601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"97'7","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761633+0000","last_change":"2024-04-24T13:32:00.625842+0000","last_active":"2024-04-24T13:33:06.761633+0000","last_peered":"2024-04-24T13:33:06.761633+0000","last_clean":"2024-04-24T13:33:06.761633+0000","last_became_active":"2024-04-24T13:32:00.571509+0000","last_became_peered":"2024-04-24T13:32:00.571509+0000","last_unstale":"2024-04-24T13:33:06.761633+0000","last_undegraded":"2024-04-24T13:33:06.761633+0000","last_fullsized":"2024-04-24T13:33:06.761633+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:46.222754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":24,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":129,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735472+0000","last_change":"2024-04-24T13:30:50.924952+0000","last_active":"2024-04-24T13:33:06.735472+0000","last_peered":"2024-04-24T13:33:06.735472+0000","last_clean":"2024-04-24T13:33:06.735472+0000","last_became_active":"2024-04-24T13:30:50.923933+0000","last_became_peered":"2024-04-24T13:30:50.923933+0000","last_unstale":"2024-04-24T13:33:06.735472+0000","last_undegraded":"2024-04-24T13:33:06.735472+0000","last_fullsized":"2024-04-24T13:33:06.735472+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:17.479670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"82'4","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762097+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:33:06.762097+0000","last_peered":"2024-04-24T13:33:06.762097+0000","last_clean":"2024-04-24T13:33:06.762097+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:33:06.762097+0000","last_undegraded":"2024-04-24T13:33:06.762097+0000","last_fullsized":"2024-04-24T13:33:06.762097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"82'4","reported_seq":187,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708427+0000","last_change":"2024-04-24T13:30:50.925917+0000","last_active":"2024-04-24T13:33:06.708427+0000","last_peered":"2024-04-24T13:33:06.708427+0000","last_clean":"2024-04-24T13:33:06.708427+0000","last_became_active":"2024-04-24T13:30:50.925580+0000","last_became_peered":"2024-04-24T13:30:50.925580+0000","last_unstale":"2024-04-24T13:33:06.708427+0000","last_undegraded":"2024-04-24T13:33:06.708427+0000","last_fullsized":"2024-04-24T13:33:06.708427+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"101'5","reported_seq":118,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704513+0000","last_change":"2024-04-24T13:32:00.578777+0000","last_active":"2024-04-24T13:33:06.704513+0000","last_peered":"2024-04-24T13:33:06.704513+0000","last_clean":"2024-04-24T13:33:06.704513+0000","last_became_active":"2024-04-24T13:32:00.578382+0000","last_became_peered":"2024-04-24T13:32:00.578382+0000","last_unstale":"2024-04-24T13:33:06.704513+0000","last_undegraded":"2024-04-24T13:33:06.704513+0000","last_fullsized":"2024-04-24T13:33:06.704513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:42:09.741845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":130,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657106+0000","last_change":"2024-04-24T13:30:50.934577+0000","last_active":"2024-04-24T13:33:06.657106+0000","last_peered":"2024-04-24T13:33:06.657106+0000","last_clean":"2024-04-24T13:33:06.657106+0000","last_became_active":"2024-04-24T13:30:50.931559+0000","last_became_peered":"2024-04-24T13:30:50.931559+0000","last_unstale":"2024-04-24T13:33:06.657106+0000","last_undegraded":"2024-04-24T13:33:06.657106+0000","last_fullsized":"2024-04-24T13:33:06.657106+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:35.372215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"86'17","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710491+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:33:06.710491+0000","last_peered":"2024-04-24T13:33:06.710491+0000","last_clean":"2024-04-24T13:33:06.710491+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:33:06.710491+0000","last_undegraded":"2024-04-24T13:33:06.710491+0000","last_fullsized":"2024-04-24T13:33:06.710491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":153,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.736137+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:33:06.736137+0000","last_peered":"2024-04-24T13:33:06.736137+0000","last_clean":"2024-04-24T13:33:06.736137+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:33:06.736137+0000","last_undegraded":"2024-04-24T13:33:06.736137+0000","last_fullsized":"2024-04-24T13:33:06.736137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":93,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658299+0000","last_change":"2024-04-24T13:32:00.574788+0000","last_active":"2024-04-24T13:33:06.658299+0000","last_peered":"2024-04-24T13:33:06.658299+0000","last_clean":"2024-04-24T13:33:06.658299+0000","last_became_active":"2024-04-24T13:32:00.574001+0000","last_became_peered":"2024-04-24T13:32:00.574001+0000","last_unstale":"2024-04-24T13:33:06.658299+0000","last_undegraded":"2024-04-24T13:33:06.658299+0000","last_fullsized":"2024-04-24T13:33:06.658299+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:39:57.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708431+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:33:06.708431+0000","last_peered":"2024-04-24T13:33:06.708431+0000","last_clean":"2024-04-24T13:33:06.708431+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:33:06.708431+0000","last_undegraded":"2024-04-24T13:33:06.708431+0000","last_fullsized":"2024-04-24T13:33:06.708431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"102'8","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.150842+0000","last_change":"2024-04-24T13:32:00.592734+0000","last_active":"2024-04-24T13:33:07.150842+0000","last_peered":"2024-04-24T13:33:07.150842+0000","last_clean":"2024-04-24T13:33:07.150842+0000","last_became_active":"2024-04-24T13:32:00.592231+0000","last_became_peered":"2024-04-24T13:32:00.592231+0000","last_unstale":"2024-04-24T13:33:07.150842+0000","last_undegraded":"2024-04-24T13:33:07.150842+0000","last_fullsized":"2024-04-24T13:33:07.150842+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:23:36.838218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.736442+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:33:06.736442+0000","last_peered":"2024-04-24T13:33:06.736442+0000","last_clean":"2024-04-24T13:33:06.736442+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:33:06.736442+0000","last_undegraded":"2024-04-24T13:33:06.736442+0000","last_fullsized":"2024-04-24T13:33:06.736442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"86'15","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646743+0000","last_change":"2024-04-24T13:30:50.981989+0000","last_active":"2024-04-24T13:33:06.646743+0000","last_peered":"2024-04-24T13:33:06.646743+0000","last_clean":"2024-04-24T13:33:06.646743+0000","last_became_active":"2024-04-24T13:30:50.939707+0000","last_became_peered":"2024-04-24T13:30:50.939707+0000","last_unstale":"2024-04-24T13:33:06.646743+0000","last_undegraded":"2024-04-24T13:33:06.646743+0000","last_fullsized":"2024-04-24T13:33:06.646743+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:38.379316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":160,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761807+0000","last_change":"2024-04-24T13:30:50.935071+0000","last_active":"2024-04-24T13:33:06.761807+0000","last_peered":"2024-04-24T13:33:06.761807+0000","last_clean":"2024-04-24T13:33:06.761807+0000","last_became_active":"2024-04-24T13:30:50.934309+0000","last_became_peered":"2024-04-24T13:30:50.934309+0000","last_unstale":"2024-04-24T13:33:06.761807+0000","last_undegraded":"2024-04-24T13:33:06.761807+0000","last_fullsized":"2024-04-24T13:33:06.761807+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:51.520511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"82'8","reported_seq":201,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.738463+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:33:06.738463+0000","last_peered":"2024-04-24T13:33:06.738463+0000","last_clean":"2024-04-24T13:33:06.738463+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:33:06.738463+0000","last_undegraded":"2024-04-24T13:33:06.738463+0000","last_fullsized":"2024-04-24T13:33:06.738463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"102'7","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708254+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:33:06.708254+0000","last_peered":"2024-04-24T13:33:06.708254+0000","last_clean":"2024-04-24T13:33:06.708254+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:33:06.708254+0000","last_undegraded":"2024-04-24T13:33:06.708254+0000","last_fullsized":"2024-04-24T13:33:06.708254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762843+0000","last_change":"2024-04-24T13:30:50.921993+0000","last_active":"2024-04-24T13:33:06.762843+0000","last_peered":"2024-04-24T13:33:06.762843+0000","last_clean":"2024-04-24T13:33:06.762843+0000","last_became_active":"2024-04-24T13:30:50.921257+0000","last_became_peered":"2024-04-24T13:30:50.921257+0000","last_unstale":"2024-04-24T13:33:06.762843+0000","last_undegraded":"2024-04-24T13:33:06.762843+0000","last_fullsized":"2024-04-24T13:33:06.762843+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:58.034297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"86'22","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703650+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:33:06.703650+0000","last_peered":"2024-04-24T13:33:06.703650+0000","last_clean":"2024-04-24T13:33:06.703650+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:33:06.703650+0000","last_undegraded":"2024-04-24T13:33:06.703650+0000","last_fullsized":"2024-04-24T13:33:06.703650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":64,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710556+0000","last_change":"2024-04-24T13:32:00.575641+0000","last_active":"2024-04-24T13:33:06.710556+0000","last_peered":"2024-04-24T13:33:06.710556+0000","last_clean":"2024-04-24T13:33:06.710556+0000","last_became_active":"2024-04-24T13:32:00.575032+0000","last_became_peered":"2024-04-24T13:32:00.575032+0000","last_unstale":"2024-04-24T13:33:06.710556+0000","last_undegraded":"2024-04-24T13:33:06.710556+0000","last_fullsized":"2024-04-24T13:33:06.710556+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:32.950981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710365+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:33:06.710365+0000","last_peered":"2024-04-24T13:33:06.710365+0000","last_clean":"2024-04-24T13:33:06.710365+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:33:06.710365+0000","last_undegraded":"2024-04-24T13:33:06.710365+0000","last_fullsized":"2024-04-24T13:33:06.710365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"86'6","reported_seq":197,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762675+0000","last_change":"2024-04-24T13:30:50.917948+0000","last_active":"2024-04-24T13:33:06.762675+0000","last_peered":"2024-04-24T13:33:06.762675+0000","last_clean":"2024-04-24T13:33:06.762675+0000","last_became_active":"2024-04-24T13:30:50.917339+0000","last_became_peered":"2024-04-24T13:30:50.917339+0000","last_unstale":"2024-04-24T13:33:06.762675+0000","last_undegraded":"2024-04-24T13:33:06.762675+0000","last_fullsized":"2024-04-24T13:33:06.762675+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:36:03.041606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"101'6","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703335+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:33:06.703335+0000","last_peered":"2024-04-24T13:33:06.703335+0000","last_clean":"2024-04-24T13:33:06.703335+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:33:06.703335+0000","last_undegraded":"2024-04-24T13:33:06.703335+0000","last_fullsized":"2024-04-24T13:33:06.703335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.738326+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:33:06.738326+0000","last_peered":"2024-04-24T13:33:06.738326+0000","last_clean":"2024-04-24T13:33:06.738326+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:33:06.738326+0000","last_undegraded":"2024-04-24T13:33:06.738326+0000","last_fullsized":"2024-04-24T13:33:06.738326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"86'20","reported_seq":131,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648235+0000","last_change":"2024-04-24T13:32:00.630779+0000","last_active":"2024-04-24T13:33:06.648235+0000","last_peered":"2024-04-24T13:33:06.648235+0000","last_clean":"2024-04-24T13:33:06.648235+0000","last_became_active":"2024-04-24T13:32:00.580437+0000","last_became_peered":"2024-04-24T13:32:00.580437+0000","last_unstale":"2024-04-24T13:33:06.648235+0000","last_undegraded":"2024-04-24T13:33:06.648235+0000","last_fullsized":"2024-04-24T13:33:06.648235+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:18.907583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":156,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703750+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:33:06.703750+0000","last_peered":"2024-04-24T13:33:06.703750+0000","last_clean":"2024-04-24T13:33:06.703750+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:33:06.703750+0000","last_undegraded":"2024-04-24T13:33:06.703750+0000","last_fullsized":"2024-04-24T13:33:06.703750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.736721+0000","last_change":"2024-04-24T13:30:50.937377+0000","last_active":"2024-04-24T13:33:06.736721+0000","last_peered":"2024-04-24T13:33:06.736721+0000","last_clean":"2024-04-24T13:33:06.736721+0000","last_became_active":"2024-04-24T13:30:50.936540+0000","last_became_peered":"2024-04-24T13:30:50.936540+0000","last_unstale":"2024-04-24T13:33:06.736721+0000","last_undegraded":"2024-04-24T13:33:06.736721+0000","last_fullsized":"2024-04-24T13:33:06.736721+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:44.053660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.714142+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:33:06.714142+0000","last_peered":"2024-04-24T13:33:06.714142+0000","last_clean":"2024-04-24T13:33:06.714142+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:33:06.714142+0000","last_undegraded":"2024-04-24T13:33:06.714142+0000","last_fullsized":"2024-04-24T13:33:06.714142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"101'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660968+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:33:06.660968+0000","last_peered":"2024-04-24T13:33:06.660968+0000","last_clean":"2024-04-24T13:33:06.660968+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:33:06.660968+0000","last_undegraded":"2024-04-24T13:33:06.660968+0000","last_fullsized":"2024-04-24T13:33:06.660968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660975+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:33:06.660975+0000","last_peered":"2024-04-24T13:33:06.660975+0000","last_clean":"2024-04-24T13:33:06.660975+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:33:06.660975+0000","last_undegraded":"2024-04-24T13:33:06.660975+0000","last_fullsized":"2024-04-24T13:33:06.660975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"86'17","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715469+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:33:06.715469+0000","last_peered":"2024-04-24T13:33:06.715469+0000","last_clean":"2024-04-24T13:33:06.715469+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:33:06.715469+0000","last_undegraded":"2024-04-24T13:33:06.715469+0000","last_fullsized":"2024-04-24T13:33:06.715469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":156,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704197+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:33:06.704197+0000","last_peered":"2024-04-24T13:33:06.704197+0000","last_clean":"2024-04-24T13:33:06.704197+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:33:06.704197+0000","last_undegraded":"2024-04-24T13:33:06.704197+0000","last_fullsized":"2024-04-24T13:33:06.704197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647215+0000","last_change":"2024-04-24T13:30:50.929993+0000","last_active":"2024-04-24T13:33:06.647215+0000","last_peered":"2024-04-24T13:33:06.647215+0000","last_clean":"2024-04-24T13:33:06.647215+0000","last_became_active":"2024-04-24T13:30:50.929169+0000","last_became_peered":"2024-04-24T13:30:50.929169+0000","last_unstale":"2024-04-24T13:33:06.647215+0000","last_undegraded":"2024-04-24T13:33:06.647215+0000","last_fullsized":"2024-04-24T13:33:06.647215+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:57.047113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648499+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:33:06.648499+0000","last_peered":"2024-04-24T13:33:06.648499+0000","last_clean":"2024-04-24T13:33:06.648499+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:33:06.648499+0000","last_undegraded":"2024-04-24T13:33:06.648499+0000","last_fullsized":"2024-04-24T13:33:06.648499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"102'7","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762114+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:33:06.762114+0000","last_peered":"2024-04-24T13:33:06.762114+0000","last_clean":"2024-04-24T13:33:06.762114+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:33:06.762114+0000","last_undegraded":"2024-04-24T13:33:06.762114+0000","last_fullsized":"2024-04-24T13:33:06.762114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":164,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704286+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:33:06.704286+0000","last_peered":"2024-04-24T13:33:06.704286+0000","last_clean":"2024-04-24T13:33:06.704286+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:33:06.704286+0000","last_undegraded":"2024-04-24T13:33:06.704286+0000","last_fullsized":"2024-04-24T13:33:06.704286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658988+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:33:06.658988+0000","last_peered":"2024-04-24T13:33:06.658988+0000","last_clean":"2024-04-24T13:33:06.658988+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:33:06.658988+0000","last_undegraded":"2024-04-24T13:33:06.658988+0000","last_fullsized":"2024-04-24T13:33:06.658988+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"94'104","reported_seq":289,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737165+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:33:06.737165+0000","last_peered":"2024-04-24T13:33:06.737165+0000","last_clean":"2024-04-24T13:33:06.737165+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:33:06.737165+0000","last_undegraded":"2024-04-24T13:33:06.737165+0000","last_fullsized":"2024-04-24T13:33:06.737165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"82'6","reported_seq":76,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.656716+0000","last_change":"2024-04-24T13:32:00.561720+0000","last_active":"2024-04-24T13:33:06.656716+0000","last_peered":"2024-04-24T13:33:06.656716+0000","last_clean":"2024-04-24T13:33:06.656716+0000","last_became_active":"2024-04-24T13:32:00.560052+0000","last_became_peered":"2024-04-24T13:32:00.560052+0000","last_unstale":"2024-04-24T13:33:06.656716+0000","last_undegraded":"2024-04-24T13:33:06.656716+0000","last_fullsized":"2024-04-24T13:33:06.656716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:40:13.263017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"86'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657791+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:33:06.657791+0000","last_peered":"2024-04-24T13:33:06.657791+0000","last_clean":"2024-04-24T13:33:06.657791+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:33:06.657791+0000","last_undegraded":"2024-04-24T13:33:06.657791+0000","last_fullsized":"2024-04-24T13:33:06.657791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"102'10","reported_seq":75,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.729955+0000","last_change":"2024-04-24T13:32:00.571666+0000","last_active":"2024-04-24T13:33:06.729955+0000","last_peered":"2024-04-24T13:33:06.729955+0000","last_clean":"2024-04-24T13:33:06.729955+0000","last_became_active":"2024-04-24T13:32:00.567566+0000","last_became_peered":"2024-04-24T13:32:00.567566+0000","last_unstale":"2024-04-24T13:33:06.729955+0000","last_undegraded":"2024-04-24T13:33:06.729955+0000","last_fullsized":"2024-04-24T13:33:06.729955+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:48.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":130,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657687+0000","last_change":"2024-04-24T13:30:50.927331+0000","last_active":"2024-04-24T13:33:06.657687+0000","last_peered":"2024-04-24T13:33:06.657687+0000","last_clean":"2024-04-24T13:33:06.657687+0000","last_became_active":"2024-04-24T13:30:50.926529+0000","last_became_peered":"2024-04-24T13:30:50.926529+0000","last_unstale":"2024-04-24T13:33:06.657687+0000","last_undegraded":"2024-04-24T13:33:06.657687+0000","last_fullsized":"2024-04-24T13:33:06.657687+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:23.529403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"86'22","reported_seq":131,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702672+0000","last_change":"2024-04-24T13:32:00.601926+0000","last_active":"2024-04-24T13:33:06.702672+0000","last_peered":"2024-04-24T13:33:06.702672+0000","last_clean":"2024-04-24T13:33:06.702672+0000","last_became_active":"2024-04-24T13:32:00.580179+0000","last_became_peered":"2024-04-24T13:32:00.580179+0000","last_unstale":"2024-04-24T13:33:06.702672+0000","last_undegraded":"2024-04-24T13:33:06.702672+0000","last_fullsized":"2024-04-24T13:33:06.702672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:02.410886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763845+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:33:06.763845+0000","last_peered":"2024-04-24T13:33:06.763845+0000","last_clean":"2024-04-24T13:33:06.763845+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:33:06.763845+0000","last_undegraded":"2024-04-24T13:33:06.763845+0000","last_fullsized":"2024-04-24T13:33:06.763845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":131,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762659+0000","last_change":"2024-04-24T13:30:50.922108+0000","last_active":"2024-04-24T13:33:06.762659+0000","last_peered":"2024-04-24T13:33:06.762659+0000","last_clean":"2024-04-24T13:33:06.762659+0000","last_became_active":"2024-04-24T13:30:50.921514+0000","last_became_peered":"2024-04-24T13:30:50.921514+0000","last_unstale":"2024-04-24T13:33:06.762659+0000","last_undegraded":"2024-04-24T13:33:06.762659+0000","last_fullsized":"2024-04-24T13:33:06.762659+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:05.867839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"94'5","reported_seq":47,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735012+0000","last_change":"2024-04-24T13:32:32.751387+0000","last_active":"2024-04-24T13:33:06.735012+0000","last_peered":"2024-04-24T13:33:06.735012+0000","last_clean":"2024-04-24T13:33:06.735012+0000","last_became_active":"2024-04-24T13:32:32.741990+0000","last_became_peered":"2024-04-24T13:32:32.741990+0000","last_unstale":"2024-04-24T13:33:06.735012+0000","last_undegraded":"2024-04-24T13:33:06.735012+0000","last_fullsized":"2024-04-24T13:33:06.735012+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:49.789798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"102'6","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.854238+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:33:06.854238+0000","last_peered":"2024-04-24T13:33:06.854238+0000","last_clean":"2024-04-24T13:33:06.854238+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:33:06.854238+0000","last_undegraded":"2024-04-24T13:33:06.854238+0000","last_fullsized":"2024-04-24T13:33:06.854238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":65,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.764165+0000","last_change":"2024-04-24T13:32:00.595272+0000","last_active":"2024-04-24T13:33:06.764165+0000","last_peered":"2024-04-24T13:33:06.764165+0000","last_clean":"2024-04-24T13:33:06.764165+0000","last_became_active":"2024-04-24T13:32:00.593617+0000","last_became_peered":"2024-04-24T13:32:00.593617+0000","last_unstale":"2024-04-24T13:33:06.764165+0000","last_undegraded":"2024-04-24T13:33:06.764165+0000","last_fullsized":"2024-04-24T13:33:06.764165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:53:23.482374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"86'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762294+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:33:06.762294+0000","last_peered":"2024-04-24T13:33:06.762294+0000","last_clean":"2024-04-24T13:33:06.762294+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:33:06.762294+0000","last_undegraded":"2024-04-24T13:33:06.762294+0000","last_fullsized":"2024-04-24T13:33:06.762294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735612+0000","last_change":"2024-04-24T13:30:50.938940+0000","last_active":"2024-04-24T13:33:06.735612+0000","last_peered":"2024-04-24T13:33:06.735612+0000","last_clean":"2024-04-24T13:33:06.735612+0000","last_became_active":"2024-04-24T13:30:50.936355+0000","last_became_peered":"2024-04-24T13:30:50.936355+0000","last_unstale":"2024-04-24T13:33:06.735612+0000","last_undegraded":"2024-04-24T13:33:06.735612+0000","last_fullsized":"2024-04-24T13:33:06.735612+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.714938+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:33:06.714938+0000","last_peered":"2024-04-24T13:33:06.714938+0000","last_clean":"2024-04-24T13:33:06.714938+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:33:06.714938+0000","last_undegraded":"2024-04-24T13:33:06.714938+0000","last_fullsized":"2024-04-24T13:33:06.714938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"94'9","reported_seq":140,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647279+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:33:06.647279+0000","last_peered":"2024-04-24T13:33:06.647279+0000","last_clean":"2024-04-24T13:33:06.647279+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:33:06.647279+0000","last_undegraded":"2024-04-24T13:33:06.647279+0000","last_fullsized":"2024-04-24T13:33:06.647279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"101'8","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715466+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:33:06.715466+0000","last_peered":"2024-04-24T13:33:06.715466+0000","last_clean":"2024-04-24T13:33:06.715466+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:33:06.715466+0000","last_undegraded":"2024-04-24T13:33:06.715466+0000","last_fullsized":"2024-04-24T13:33:06.715466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658266+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:33:06.658266+0000","last_peered":"2024-04-24T13:33:06.658266+0000","last_clean":"2024-04-24T13:33:06.658266+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:33:06.658266+0000","last_undegraded":"2024-04-24T13:33:06.658266+0000","last_fullsized":"2024-04-24T13:33:06.658266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"86'10","reported_seq":73,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647254+0000","last_change":"2024-04-24T13:32:01.553569+0000","last_active":"2024-04-24T13:33:06.647254+0000","last_peered":"2024-04-24T13:33:06.647254+0000","last_clean":"2024-04-24T13:33:06.647254+0000","last_became_active":"2024-04-24T13:32:01.547833+0000","last_became_peered":"2024-04-24T13:32:01.547833+0000","last_unstale":"2024-04-24T13:33:06.647254+0000","last_undegraded":"2024-04-24T13:33:06.647254+0000","last_fullsized":"2024-04-24T13:33:06.647254+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:10.789162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657443+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:33:06.657443+0000","last_peered":"2024-04-24T13:33:06.657443+0000","last_clean":"2024-04-24T13:33:06.657443+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:33:06.657443+0000","last_undegraded":"2024-04-24T13:33:06.657443+0000","last_fullsized":"2024-04-24T13:33:06.657443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"82'2","reported_seq":134,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703877+0000","last_change":"2024-04-24T13:30:50.939033+0000","last_active":"2024-04-24T13:33:06.703877+0000","last_peered":"2024-04-24T13:33:06.703877+0000","last_clean":"2024-04-24T13:33:06.703877+0000","last_became_active":"2024-04-24T13:30:50.938747+0000","last_became_peered":"2024-04-24T13:30:50.938747+0000","last_unstale":"2024-04-24T13:33:06.703877+0000","last_undegraded":"2024-04-24T13:33:06.703877+0000","last_fullsized":"2024-04-24T13:33:06.703877+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:48.546868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"82'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657949+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:33:06.657949+0000","last_peered":"2024-04-24T13:33:06.657949+0000","last_clean":"2024-04-24T13:33:06.657949+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:33:06.657949+0000","last_undegraded":"2024-04-24T13:33:06.657949+0000","last_fullsized":"2024-04-24T13:33:06.657949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"102'4","reported_seq":68,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762600+0000","last_change":"2024-04-24T13:32:00.572057+0000","last_active":"2024-04-24T13:33:06.762600+0000","last_peered":"2024-04-24T13:33:06.762600+0000","last_clean":"2024-04-24T13:33:06.762600+0000","last_became_active":"2024-04-24T13:32:00.568612+0000","last_became_peered":"2024-04-24T13:32:00.568612+0000","last_unstale":"2024-04-24T13:33:06.762600+0000","last_undegraded":"2024-04-24T13:33:06.762600+0000","last_fullsized":"2024-04-24T13:33:06.762600+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:49.615982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702798+0000","last_change":"2024-04-24T13:32:00.574968+0000","last_active":"2024-04-24T13:33:06.702798+0000","last_peered":"2024-04-24T13:33:06.702798+0000","last_clean":"2024-04-24T13:33:06.702798+0000","last_became_active":"2024-04-24T13:32:00.555407+0000","last_became_peered":"2024-04-24T13:32:00.555407+0000","last_unstale":"2024-04-24T13:33:06.702798+0000","last_undegraded":"2024-04-24T13:33:06.702798+0000","last_fullsized":"2024-04-24T13:33:06.702798+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:47.488688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"86'14","reported_seq":195,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658079+0000","last_change":"2024-04-24T13:32:00.610501+0000","last_active":"2024-04-24T13:33:06.658079+0000","last_peered":"2024-04-24T13:33:06.658079+0000","last_clean":"2024-04-24T13:33:06.658079+0000","last_became_active":"2024-04-24T13:32:00.562130+0000","last_became_peered":"2024-04-24T13:32:00.562130+0000","last_unstale":"2024-04-24T13:33:06.658079+0000","last_undegraded":"2024-04-24T13:33:06.658079+0000","last_fullsized":"2024-04-24T13:33:06.658079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:24:47.214366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761785+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:33:06.761785+0000","last_peered":"2024-04-24T13:33:06.761785+0000","last_clean":"2024-04-24T13:33:06.761785+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:33:06.761785+0000","last_undegraded":"2024-04-24T13:33:06.761785+0000","last_fullsized":"2024-04-24T13:33:06.761785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657525+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:33:06.657525+0000","last_peered":"2024-04-24T13:33:06.657525+0000","last_clean":"2024-04-24T13:33:06.657525+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:33:06.657525+0000","last_undegraded":"2024-04-24T13:33:06.657525+0000","last_fullsized":"2024-04-24T13:33:06.657525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"82'6","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.705565+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:33:06.705565+0000","last_peered":"2024-04-24T13:33:06.705565+0000","last_clean":"2024-04-24T13:33:06.705565+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:33:06.705565+0000","last_undegraded":"2024-04-24T13:33:06.705565+0000","last_fullsized":"2024-04-24T13:33:06.705565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"101'6","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735446+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:33:06.735446+0000","last_peered":"2024-04-24T13:33:06.735446+0000","last_clean":"2024-04-24T13:33:06.735446+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:33:06.735446+0000","last_undegraded":"2024-04-24T13:33:06.735446+0000","last_fullsized":"2024-04-24T13:33:06.735446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"94'7","reported_seq":197,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704689+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:33:06.704689+0000","last_peered":"2024-04-24T13:33:06.704689+0000","last_clean":"2024-04-24T13:33:06.704689+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:33:06.704689+0000","last_undegraded":"2024-04-24T13:33:06.704689+0000","last_fullsized":"2024-04-24T13:33:06.704689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"101'7","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646095+0000","last_change":"2024-04-24T13:32:00.566015+0000","last_active":"2024-04-24T13:33:06.646095+0000","last_peered":"2024-04-24T13:33:06.646095+0000","last_clean":"2024-04-24T13:33:06.646095+0000","last_became_active":"2024-04-24T13:32:00.552968+0000","last_became_peered":"2024-04-24T13:32:00.552968+0000","last_unstale":"2024-04-24T13:33:06.646095+0000","last_undegraded":"2024-04-24T13:33:06.646095+0000","last_fullsized":"2024-04-24T13:33:06.646095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:26:58.476605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"82'2","reported_seq":116,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710752+0000","last_change":"2024-04-24T13:32:00.596572+0000","last_active":"2024-04-24T13:33:06.710752+0000","last_peered":"2024-04-24T13:33:06.710752+0000","last_clean":"2024-04-24T13:33:06.710752+0000","last_became_active":"2024-04-24T13:32:00.596100+0000","last_became_peered":"2024-04-24T13:32:00.596100+0000","last_unstale":"2024-04-24T13:33:06.710752+0000","last_undegraded":"2024-04-24T13:33:06.710752+0000","last_fullsized":"2024-04-24T13:33:06.710752+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:34.128346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"102'11","reported_seq":75,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.947589+0000","last_change":"2024-04-24T13:32:00.592288+0000","last_active":"2024-04-24T13:33:06.947589+0000","last_peered":"2024-04-24T13:33:06.947589+0000","last_clean":"2024-04-24T13:33:06.947589+0000","last_became_active":"2024-04-24T13:32:00.592025+0000","last_became_peered":"2024-04-24T13:32:00.592025+0000","last_unstale":"2024-04-24T13:33:06.947589+0000","last_undegraded":"2024-04-24T13:33:06.947589+0000","last_fullsized":"2024-04-24T13:33:06.947589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:15.691070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"94'1","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704179+0000","last_change":"2024-04-24T13:30:50.918913+0000","last_active":"2024-04-24T13:33:06.704179+0000","last_peered":"2024-04-24T13:33:06.704179+0000","last_clean":"2024-04-24T13:33:06.704179+0000","last_became_active":"2024-04-24T13:30:50.918221+0000","last_became_peered":"2024-04-24T13:30:50.918221+0000","last_unstale":"2024-04-24T13:33:06.704179+0000","last_undegraded":"2024-04-24T13:33:06.704179+0000","last_fullsized":"2024-04-24T13:33:06.704179+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:43.128644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"102'12","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762039+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:33:06.762039+0000","last_peered":"2024-04-24T13:33:06.762039+0000","last_clean":"2024-04-24T13:33:06.762039+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:33:06.762039+0000","last_undegraded":"2024-04-24T13:33:06.762039+0000","last_fullsized":"2024-04-24T13:33:06.762039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"82'2","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710774+0000","last_change":"2024-04-24T13:30:50.926509+0000","last_active":"2024-04-24T13:33:06.710774+0000","last_peered":"2024-04-24T13:33:06.710774+0000","last_clean":"2024-04-24T13:33:06.710774+0000","last_became_active":"2024-04-24T13:30:50.925894+0000","last_became_peered":"2024-04-24T13:30:50.925894+0000","last_unstale":"2024-04-24T13:33:06.710774+0000","last_undegraded":"2024-04-24T13:33:06.710774+0000","last_fullsized":"2024-04-24T13:33:06.710774+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"102'7","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.711401+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:33:06.711401+0000","last_peered":"2024-04-24T13:33:06.711401+0000","last_clean":"2024-04-24T13:33:06.711401+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:33:06.711401+0000","last_undegraded":"2024-04-24T13:33:06.711401+0000","last_fullsized":"2024-04-24T13:33:06.711401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"81'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660701+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:33:06.660701+0000","last_peered":"2024-04-24T13:33:06.660701+0000","last_clean":"2024-04-24T13:33:06.660701+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:33:06.660701+0000","last_undegraded":"2024-04-24T13:33:06.660701+0000","last_fullsized":"2024-04-24T13:33:06.660701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"102'8","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761110+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:33:06.761110+0000","last_peered":"2024-04-24T13:33:06.761110+0000","last_clean":"2024-04-24T13:33:06.761110+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:33:06.761110+0000","last_undegraded":"2024-04-24T13:33:06.761110+0000","last_fullsized":"2024-04-24T13:33:06.761110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"94'9","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708335+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:33:06.708335+0000","last_peered":"2024-04-24T13:33:06.708335+0000","last_clean":"2024-04-24T13:33:06.708335+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:33:06.708335+0000","last_undegraded":"2024-04-24T13:33:06.708335+0000","last_fullsized":"2024-04-24T13:33:06.708335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"102'9","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.759891+0000","last_change":"2024-04-24T13:30:50.956474+0000","last_active":"2024-04-24T13:33:06.759891+0000","last_peered":"2024-04-24T13:33:06.759891+0000","last_clean":"2024-04-24T13:33:06.759891+0000","last_became_active":"2024-04-24T13:30:50.955801+0000","last_became_peered":"2024-04-24T13:30:50.955801+0000","last_unstale":"2024-04-24T13:33:06.759891+0000","last_undegraded":"2024-04-24T13:33:06.759891+0000","last_fullsized":"2024-04-24T13:33:06.759891+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:41.114080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":165,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735360+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:33:06.735360+0000","last_peered":"2024-04-24T13:33:06.735360+0000","last_clean":"2024-04-24T13:33:06.735360+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:33:06.735360+0000","last_undegraded":"2024-04-24T13:33:06.735360+0000","last_fullsized":"2024-04-24T13:33:06.735360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"102'7","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.818346+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:33:06.818346+0000","last_peered":"2024-04-24T13:33:06.818346+0000","last_clean":"2024-04-24T13:33:06.818346+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:33:06.818346+0000","last_undegraded":"2024-04-24T13:33:06.818346+0000","last_fullsized":"2024-04-24T13:33:06.818346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"94'7","reported_seq":195,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763388+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:33:06.763388+0000","last_peered":"2024-04-24T13:33:06.763388+0000","last_clean":"2024-04-24T13:33:06.763388+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:33:06.763388+0000","last_undegraded":"2024-04-24T13:33:06.763388+0000","last_fullsized":"2024-04-24T13:33:06.763388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"102'9","reported_seq":73,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.952281+0000","last_change":"2024-04-24T13:32:00.572200+0000","last_active":"2024-04-24T13:33:06.952281+0000","last_peered":"2024-04-24T13:33:06.952281+0000","last_clean":"2024-04-24T13:33:06.952281+0000","last_became_active":"2024-04-24T13:32:00.569529+0000","last_became_peered":"2024-04-24T13:32:00.569529+0000","last_unstale":"2024-04-24T13:33:06.952281+0000","last_undegraded":"2024-04-24T13:33:06.952281+0000","last_fullsized":"2024-04-24T13:33:06.952281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:14:47.372088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660259+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:33:06.660259+0000","last_peered":"2024-04-24T13:33:06.660259+0000","last_clean":"2024-04-24T13:33:06.660259+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:33:06.660259+0000","last_undegraded":"2024-04-24T13:33:06.660259+0000","last_fullsized":"2024-04-24T13:33:06.660259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"102'12","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.403339+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:33:07.403339+0000","last_peered":"2024-04-24T13:33:07.403339+0000","last_clean":"2024-04-24T13:33:07.403339+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:33:07.403339+0000","last_undegraded":"2024-04-24T13:33:07.403339+0000","last_fullsized":"2024-04-24T13:33:07.403339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648586+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:33:06.648586+0000","last_peered":"2024-04-24T13:33:06.648586+0000","last_clean":"2024-04-24T13:33:06.648586+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:33:06.648586+0000","last_undegraded":"2024-04-24T13:33:06.648586+0000","last_fullsized":"2024-04-24T13:33:06.648586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"86'7","reported_seq":120,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737585+0000","last_change":"2024-04-24T13:32:00.588017+0000","last_active":"2024-04-24T13:33:06.737585+0000","last_peered":"2024-04-24T13:33:06.737585+0000","last_clean":"2024-04-24T13:33:06.737585+0000","last_became_active":"2024-04-24T13:32:00.587160+0000","last_became_peered":"2024-04-24T13:32:00.587160+0000","last_unstale":"2024-04-24T13:33:06.737585+0000","last_undegraded":"2024-04-24T13:33:06.737585+0000","last_fullsized":"2024-04-24T13:33:06.737585+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:43.467082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"82'6","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660581+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:33:06.660581+0000","last_peered":"2024-04-24T13:33:06.660581+0000","last_clean":"2024-04-24T13:33:06.660581+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:33:06.660581+0000","last_undegraded":"2024-04-24T13:33:06.660581+0000","last_fullsized":"2024-04-24T13:33:06.660581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"102'12","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.243404+0000","last_change":"2024-04-24T13:30:50.920564+0000","last_active":"2024-04-24T13:33:07.243404+0000","last_peered":"2024-04-24T13:33:07.243404+0000","last_clean":"2024-04-24T13:33:07.243404+0000","last_became_active":"2024-04-24T13:30:50.920252+0000","last_became_peered":"2024-04-24T13:30:50.920252+0000","last_unstale":"2024-04-24T13:33:07.243404+0000","last_undegraded":"2024-04-24T13:33:07.243404+0000","last_fullsized":"2024-04-24T13:33:07.243404+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:29.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"82'2","reported_seq":143,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710543+0000","last_change":"2024-04-24T13:32:00.575324+0000","last_active":"2024-04-24T13:33:06.710543+0000","last_peered":"2024-04-24T13:33:06.710543+0000","last_clean":"2024-04-24T13:33:06.710543+0000","last_became_active":"2024-04-24T13:32:00.575008+0000","last_became_peered":"2024-04-24T13:32:00.575008+0000","last_unstale":"2024-04-24T13:33:06.710543+0000","last_undegraded":"2024-04-24T13:33:06.710543+0000","last_fullsized":"2024-04-24T13:33:06.710543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:53:21.475332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"102'6","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.502501+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:33:07.502501+0000","last_peered":"2024-04-24T13:33:07.502501+0000","last_clean":"2024-04-24T13:33:07.502501+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:33:07.502501+0000","last_undegraded":"2024-04-24T13:33:07.502501+0000","last_fullsized":"2024-04-24T13:33:07.502501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"82'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761705+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:33:06.761705+0000","last_peered":"2024-04-24T13:33:06.761705+0000","last_clean":"2024-04-24T13:33:06.761705+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:33:06.761705+0000","last_undegraded":"2024-04-24T13:33:06.761705+0000","last_fullsized":"2024-04-24T13:33:06.761705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"102'6","reported_seq":138,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.105984+0000","last_change":"2024-04-24T13:30:50.936271+0000","last_active":"2024-04-24T13:33:07.105984+0000","last_peered":"2024-04-24T13:33:07.105984+0000","last_clean":"2024-04-24T13:33:07.105984+0000","last_became_active":"2024-04-24T13:30:50.935833+0000","last_became_peered":"2024-04-24T13:30:50.935833+0000","last_unstale":"2024-04-24T13:33:07.105984+0000","last_undegraded":"2024-04-24T13:33:07.105984+0000","last_fullsized":"2024-04-24T13:33:07.105984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:04.149889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"82'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708238+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:33:06.708238+0000","last_peered":"2024-04-24T13:33:06.708238+0000","last_clean":"2024-04-24T13:33:06.708238+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:33:06.708238+0000","last_undegraded":"2024-04-24T13:33:06.708238+0000","last_fullsized":"2024-04-24T13:33:06.708238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"102'5","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648998+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:33:06.648998+0000","last_peered":"2024-04-24T13:33:06.648998+0000","last_clean":"2024-04-24T13:33:06.648998+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:33:06.648998+0000","last_undegraded":"2024-04-24T13:33:06.648998+0000","last_fullsized":"2024-04-24T13:33:06.648998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":130,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708542+0000","last_change":"2024-04-24T13:30:50.913925+0000","last_active":"2024-04-24T13:33:06.708542+0000","last_peered":"2024-04-24T13:33:06.708542+0000","last_clean":"2024-04-24T13:33:06.708542+0000","last_became_active":"2024-04-24T13:30:50.913630+0000","last_became_peered":"2024-04-24T13:30:50.913630+0000","last_unstale":"2024-04-24T13:33:06.708542+0000","last_undegraded":"2024-04-24T13:33:06.708542+0000","last_fullsized":"2024-04-24T13:33:06.708542+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:45.481646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":121,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658654+0000","last_change":"2024-04-24T13:32:00.572908+0000","last_active":"2024-04-24T13:33:06.658654+0000","last_peered":"2024-04-24T13:33:06.658654+0000","last_clean":"2024-04-24T13:33:06.658654+0000","last_became_active":"2024-04-24T13:32:00.572224+0000","last_became_peered":"2024-04-24T13:32:00.572224+0000","last_unstale":"2024-04-24T13:33:06.658654+0000","last_undegraded":"2024-04-24T13:33:06.658654+0000","last_fullsized":"2024-04-24T13:33:06.658654+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:51:09.472596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"102'10","reported_seq":75,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761671+0000","last_change":"2024-04-24T13:32:00.568431+0000","last_active":"2024-04-24T13:33:06.761671+0000","last_peered":"2024-04-24T13:33:06.761671+0000","last_clean":"2024-04-24T13:33:06.761671+0000","last_became_active":"2024-04-24T13:32:00.568125+0000","last_became_peered":"2024-04-24T13:32:00.568125+0000","last_unstale":"2024-04-24T13:33:06.761671+0000","last_undegraded":"2024-04-24T13:33:06.761671+0000","last_fullsized":"2024-04-24T13:33:06.761671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:45:05.439832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"82'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763229+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:33:06.763229+0000","last_peered":"2024-04-24T13:33:06.763229+0000","last_clean":"2024-04-24T13:33:06.763229+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:33:06.763229+0000","last_undegraded":"2024-04-24T13:33:06.763229+0000","last_fullsized":"2024-04-24T13:33:06.763229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"102'4","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.261933+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:33:07.261933+0000","last_peered":"2024-04-24T13:33:07.261933+0000","last_clean":"2024-04-24T13:33:07.261933+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:33:07.261933+0000","last_undegraded":"2024-04-24T13:33:07.261933+0000","last_fullsized":"2024-04-24T13:33:07.261933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"82'6","reported_seq":90,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762780+0000","last_change":"2024-04-24T13:32:00.595386+0000","last_active":"2024-04-24T13:33:06.762780+0000","last_peered":"2024-04-24T13:33:06.762780+0000","last_clean":"2024-04-24T13:33:06.762780+0000","last_became_active":"2024-04-24T13:32:00.593423+0000","last_became_peered":"2024-04-24T13:32:00.593423+0000","last_unstale":"2024-04-24T13:33:06.762780+0000","last_undegraded":"2024-04-24T13:33:06.762780+0000","last_fullsized":"2024-04-24T13:33:06.762780+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:26.912115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1005,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":280,"num_read_kb":264,"num_write":236,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":835,"ondisk_log_size":835,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":79525,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":800,"num_read_kb":562,"num_write":447,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":2354,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":479232,"data_stored":128636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":633,"ondisk_log_size":633,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":341,"num_read_kb":341,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1613,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1116,"num_read_kb":1096,"num_write":239,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2046820352,"num_objects":490,"num_object_clones":0,"num_object_copies":980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":490,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":550,"num_write_kb":2019328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4097835008,"data_stored":4097835008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":55834574887,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":628964,"kb_used_data":597776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93742876,"statfs":{"total":96636764160,"available":95992705024,"internally_reserved":0,"allocated":612122624,"data_stored":611573397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126600,"kb_used_data":95416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94245240,"statfs":{"total":96636764160,"available":96507125760,"internally_reserved":0,"allocated":97705984,"data_stored":97180157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":640728,"kb_used_data":609544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93731112,"statfs":{"total":96636764160,"available":95980658688,"internally_reserved":0,"allocated":624173056,"data_stored":623624255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":837380,"kb_used_data":806192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93534460,"statfs":{"total":96636764160,"available":95779287040,"internally_reserved":0,"allocated":825540608,"data_stored":824953735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":521908,"kb_used_data":490720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93849932,"statfs":{"total":96636764160,"available":96102330368,"internally_reserved":0,"allocated":502497280,"data_stored":501932277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376496,"kb_used_data":345316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93995344,"statfs":{"total":96636764160,"available":96251232256,"internally_reserved":0,"allocated":353603584,"data_stored":353035785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":790760,"kb_used_data":759572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93581080,"statfs":{"total":96636764160,"available":95827025920,"internally_reserved":0,"allocated":777801728,"data_stored":777249845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":792723456,"data_stored":792723456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":465567744,"data_stored":465567744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":509607936,"data_stored":509607936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":832569344,"data_stored":832569344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":723517440,"data_stored":723517440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":673185792,"data_stored":673185792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":61573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:33:09.101 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:33:09.104 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:09.104 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:09.121 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:09.119+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:09.125 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:09.125 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:09.125 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:33:09.125 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:09.143 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:09.215 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:09.215+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:09.290 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:09.290 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:09.291 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:33:09.291 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:33:09.291 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:09.308 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:09.315 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:09.315+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:09.416 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:09.413+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:09.426 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:33:09.432 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:33:09.442 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":188,"stamp":"2024-04-24T13:33:09.282675+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":2047492863,"num_objects":701,"num_object_clones":0,"num_object_copies":1402,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":701,"num_whiteouts":0,"num_read":2673,"num_read_kb":2378,"num_write":1641,"num_write_kb":2021954,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":104,"num_bytes_recovered":594335,"num_keys_recovered":2,"num_objects_omap":13,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2416,"ondisk_log_size":2416,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":3922836,"kb_used_data":3704536,"kb_used_omap":10,"kb_used_meta":218165,"kb_avail":656680044,"statfs":{"total":676457349120,"available":672440365056,"internally_reserved":0,"allocated":3793444864,"data_stored":3789549451,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11161,"internal_metadata":223401063},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":62,"apply_latency_ms":62,"commit_latency_ns":62000000,"apply_latency_ns":62000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":977272832,"num_objects":233,"num_object_clones":0,"num_object_copies":466,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":233,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":233,"num_write_kb":954368,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.001243"},"pg_stats":[{"pgid":"3.3f","version":"102'9","reported_seq":144,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.739137+0000","last_change":"2024-04-24T13:31:00.989667+0000","last_active":"2024-04-24T13:33:06.739137+0000","last_peered":"2024-04-24T13:33:06.739137+0000","last_clean":"2024-04-24T13:33:06.739137+0000","last_became_active":"2024-04-24T13:31:00.989365+0000","last_became_peered":"2024-04-24T13:31:00.989365+0000","last_unstale":"2024-04-24T13:33:06.739137+0000","last_undegraded":"2024-04-24T13:33:06.739137+0000","last_fullsized":"2024-04-24T13:33:06.739137+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:00:51.108396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.38","version":"82'14","reported_seq":213,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647139+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:33:06.647139+0000","last_peered":"2024-04-24T13:33:06.647139+0000","last_clean":"2024-04-24T13:33:06.647139+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:33:06.647139+0000","last_undegraded":"2024-04-24T13:33:06.647139+0000","last_fullsized":"2024-04-24T13:33:06.647139+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"100'4","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704858+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:33:06.704858+0000","last_peered":"2024-04-24T13:33:06.704858+0000","last_clean":"2024-04-24T13:33:06.704858+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:33:06.704858+0000","last_undegraded":"2024-04-24T13:33:06.704858+0000","last_fullsized":"2024-04-24T13:33:06.704858+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"82'4","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703227+0000","last_change":"2024-04-24T13:30:50.941589+0000","last_active":"2024-04-24T13:33:06.703227+0000","last_peered":"2024-04-24T13:33:06.703227+0000","last_clean":"2024-04-24T13:33:06.703227+0000","last_became_active":"2024-04-24T13:30:50.941305+0000","last_became_peered":"2024-04-24T13:30:50.941305+0000","last_unstale":"2024-04-24T13:33:06.703227+0000","last_undegraded":"2024-04-24T13:33:06.703227+0000","last_fullsized":"2024-04-24T13:33:06.703227+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:23.793119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"101'8","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762324+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:33:06.762324+0000","last_peered":"2024-04-24T13:33:06.762324+0000","last_clean":"2024-04-24T13:33:06.762324+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:33:06.762324+0000","last_undegraded":"2024-04-24T13:33:06.762324+0000","last_fullsized":"2024-04-24T13:33:06.762324+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660164+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:33:06.660164+0000","last_peered":"2024-04-24T13:33:06.660164+0000","last_clean":"2024-04-24T13:33:06.660164+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:33:06.660164+0000","last_undegraded":"2024-04-24T13:33:06.660164+0000","last_fullsized":"2024-04-24T13:33:06.660164+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"101'5","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647570+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:33:06.647570+0000","last_peered":"2024-04-24T13:33:06.647570+0000","last_clean":"2024-04-24T13:33:06.647570+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:33:06.647570+0000","last_undegraded":"2024-04-24T13:33:06.647570+0000","last_fullsized":"2024-04-24T13:33:06.647570+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"86'4","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761901+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:33:06.761901+0000","last_peered":"2024-04-24T13:33:06.761901+0000","last_clean":"2024-04-24T13:33:06.761901+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:33:06.761901+0000","last_undegraded":"2024-04-24T13:33:06.761901+0000","last_fullsized":"2024-04-24T13:33:06.761901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"101'10","reported_seq":141,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646923+0000","last_change":"2024-04-24T13:30:50.941360+0000","last_active":"2024-04-24T13:33:06.646923+0000","last_peered":"2024-04-24T13:33:06.646923+0000","last_clean":"2024-04-24T13:33:06.646923+0000","last_became_active":"2024-04-24T13:30:50.940816+0000","last_became_peered":"2024-04-24T13:30:50.940816+0000","last_unstale":"2024-04-24T13:33:06.646923+0000","last_undegraded":"2024-04-24T13:33:06.646923+0000","last_fullsized":"2024-04-24T13:33:06.646923+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:04.247947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"82'2","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.736369+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:33:06.736369+0000","last_peered":"2024-04-24T13:33:06.736369+0000","last_clean":"2024-04-24T13:33:06.736369+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:33:06.736369+0000","last_undegraded":"2024-04-24T13:33:06.736369+0000","last_fullsized":"2024-04-24T13:33:06.736369+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"101'13","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647215+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:33:06.647215+0000","last_peered":"2024-04-24T13:33:06.647215+0000","last_clean":"2024-04-24T13:33:06.647215+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:33:06.647215+0000","last_undegraded":"2024-04-24T13:33:06.647215+0000","last_fullsized":"2024-04-24T13:33:06.647215+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"82'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.659022+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:33:06.659022+0000","last_peered":"2024-04-24T13:33:06.659022+0000","last_clean":"2024-04-24T13:33:06.659022+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:33:06.659022+0000","last_undegraded":"2024-04-24T13:33:06.659022+0000","last_fullsized":"2024-04-24T13:33:06.659022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"102'12","reported_seq":143,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.351833+0000","last_change":"2024-04-24T13:30:50.911441+0000","last_active":"2024-04-24T13:33:07.351833+0000","last_peered":"2024-04-24T13:33:07.351833+0000","last_clean":"2024-04-24T13:33:07.351833+0000","last_became_active":"2024-04-24T13:30:50.911096+0000","last_became_peered":"2024-04-24T13:30:50.911096+0000","last_unstale":"2024-04-24T13:33:07.351833+0000","last_undegraded":"2024-04-24T13:33:07.351833+0000","last_fullsized":"2024-04-24T13:33:07.351833+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:12.878818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"82'2","reported_seq":75,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704400+0000","last_change":"2024-04-24T13:32:00.564552+0000","last_active":"2024-04-24T13:33:06.704400+0000","last_peered":"2024-04-24T13:33:06.704400+0000","last_clean":"2024-04-24T13:33:06.704400+0000","last_became_active":"2024-04-24T13:32:00.564271+0000","last_became_peered":"2024-04-24T13:32:00.564271+0000","last_unstale":"2024-04-24T13:33:06.704400+0000","last_undegraded":"2024-04-24T13:33:06.704400+0000","last_fullsized":"2024-04-24T13:33:06.704400+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:31.661093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.38","version":"101'3","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708319+0000","last_change":"2024-04-24T13:32:00.576894+0000","last_active":"2024-04-24T13:33:06.708319+0000","last_peered":"2024-04-24T13:33:06.708319+0000","last_clean":"2024-04-24T13:33:06.708319+0000","last_became_active":"2024-04-24T13:32:00.575339+0000","last_became_peered":"2024-04-24T13:32:00.575339+0000","last_unstale":"2024-04-24T13:33:06.708319+0000","last_undegraded":"2024-04-24T13:33:06.708319+0000","last_fullsized":"2024-04-24T13:33:06.708319+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:40.193989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"82'6","reported_seq":191,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.649542+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:33:06.649542+0000","last_peered":"2024-04-24T13:33:06.649542+0000","last_clean":"2024-04-24T13:33:06.649542+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:33:06.649542+0000","last_undegraded":"2024-04-24T13:33:06.649542+0000","last_fullsized":"2024-04-24T13:33:06.649542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"86'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657513+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:33:06.657513+0000","last_peered":"2024-04-24T13:33:06.657513+0000","last_clean":"2024-04-24T13:33:06.657513+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:33:06.657513+0000","last_undegraded":"2024-04-24T13:33:06.657513+0000","last_fullsized":"2024-04-24T13:33:06.657513+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"101'7","reported_seq":74,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762918+0000","last_change":"2024-04-24T13:32:00.572932+0000","last_active":"2024-04-24T13:33:06.762918+0000","last_peered":"2024-04-24T13:33:06.762918+0000","last_clean":"2024-04-24T13:33:06.762918+0000","last_became_active":"2024-04-24T13:32:00.571887+0000","last_became_peered":"2024-04-24T13:32:00.571887+0000","last_unstale":"2024-04-24T13:33:06.762918+0000","last_undegraded":"2024-04-24T13:33:06.762918+0000","last_fullsized":"2024-04-24T13:33:06.762918+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:41.648006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.31","version":"82'4","reported_seq":148,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702944+0000","last_change":"2024-04-24T13:30:50.937742+0000","last_active":"2024-04-24T13:33:06.702944+0000","last_peered":"2024-04-24T13:33:06.702944+0000","last_clean":"2024-04-24T13:33:06.702944+0000","last_became_active":"2024-04-24T13:30:50.937395+0000","last_became_peered":"2024-04-24T13:30:50.937395+0000","last_unstale":"2024-04-24T13:33:06.702944+0000","last_undegraded":"2024-04-24T13:33:06.702944+0000","last_fullsized":"2024-04-24T13:33:06.702944+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:43.335130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"102'9","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.511680+0000","last_change":"2024-04-24T13:32:00.584981+0000","last_active":"2024-04-24T13:33:07.511680+0000","last_peered":"2024-04-24T13:33:07.511680+0000","last_clean":"2024-04-24T13:33:07.511680+0000","last_became_active":"2024-04-24T13:32:00.584186+0000","last_became_peered":"2024-04-24T13:32:00.584186+0000","last_unstale":"2024-04-24T13:33:07.511680+0000","last_undegraded":"2024-04-24T13:33:07.511680+0000","last_fullsized":"2024-04-24T13:33:07.511680+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.808699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":19,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"86'6","reported_seq":93,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646955+0000","last_change":"2024-04-24T13:32:00.565847+0000","last_active":"2024-04-24T13:33:06.646955+0000","last_peered":"2024-04-24T13:33:06.646955+0000","last_clean":"2024-04-24T13:33:06.646955+0000","last_became_active":"2024-04-24T13:32:00.565548+0000","last_became_peered":"2024-04-24T13:32:00.565548+0000","last_unstale":"2024-04-24T13:33:06.646955+0000","last_undegraded":"2024-04-24T13:33:06.646955+0000","last_fullsized":"2024-04-24T13:33:06.646955+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:21.522361+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.35","version":"102'5","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.319488+0000","last_change":"2024-04-24T13:32:00.599603+0000","last_active":"2024-04-24T13:33:07.319488+0000","last_peered":"2024-04-24T13:33:07.319488+0000","last_clean":"2024-04-24T13:33:07.319488+0000","last_became_active":"2024-04-24T13:32:00.598954+0000","last_became_peered":"2024-04-24T13:32:00.598954+0000","last_unstale":"2024-04-24T13:33:07.319488+0000","last_undegraded":"2024-04-24T13:33:07.319488+0000","last_fullsized":"2024-04-24T13:33:07.319488+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:35.235521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647090+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:33:06.647090+0000","last_peered":"2024-04-24T13:33:06.647090+0000","last_clean":"2024-04-24T13:33:06.647090+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:33:06.647090+0000","last_undegraded":"2024-04-24T13:33:06.647090+0000","last_fullsized":"2024-04-24T13:33:06.647090+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"102'6","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658196+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:33:06.658196+0000","last_peered":"2024-04-24T13:33:06.658196+0000","last_clean":"2024-04-24T13:33:06.658196+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:33:06.658196+0000","last_undegraded":"2024-04-24T13:33:06.658196+0000","last_fullsized":"2024-04-24T13:33:06.658196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"86'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648400+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:33:06.648400+0000","last_peered":"2024-04-24T13:33:06.648400+0000","last_clean":"2024-04-24T13:33:06.648400+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:33:06.648400+0000","last_undegraded":"2024-04-24T13:33:06.648400+0000","last_fullsized":"2024-04-24T13:33:06.648400+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"102'11","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.848011+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:33:06.848011+0000","last_peered":"2024-04-24T13:33:06.848011+0000","last_clean":"2024-04-24T13:33:06.848011+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:33:06.848011+0000","last_undegraded":"2024-04-24T13:33:06.848011+0000","last_fullsized":"2024-04-24T13:33:06.848011+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"82'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658874+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:33:06.658874+0000","last_peered":"2024-04-24T13:33:06.658874+0000","last_clean":"2024-04-24T13:33:06.658874+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:33:06.658874+0000","last_undegraded":"2024-04-24T13:33:06.658874+0000","last_fullsized":"2024-04-24T13:33:06.658874+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"102'4","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.235186+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:33:07.235186+0000","last_peered":"2024-04-24T13:33:07.235186+0000","last_clean":"2024-04-24T13:33:07.235186+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:33:07.235186+0000","last_undegraded":"2024-04-24T13:33:07.235186+0000","last_fullsized":"2024-04-24T13:33:07.235186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.656725+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:33:06.656725+0000","last_peered":"2024-04-24T13:33:06.656725+0000","last_clean":"2024-04-24T13:33:06.656725+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:33:06.656725+0000","last_undegraded":"2024-04-24T13:33:06.656725+0000","last_fullsized":"2024-04-24T13:33:06.656725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"82'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.711111+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:33:06.711111+0000","last_peered":"2024-04-24T13:33:06.711111+0000","last_clean":"2024-04-24T13:33:06.711111+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:33:06.711111+0000","last_undegraded":"2024-04-24T13:33:06.711111+0000","last_fullsized":"2024-04-24T13:33:06.711111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"102'14","reported_seq":145,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.662593+0000","last_change":"2024-04-24T13:30:50.929479+0000","last_active":"2024-04-24T13:33:06.662593+0000","last_peered":"2024-04-24T13:33:06.662593+0000","last_clean":"2024-04-24T13:33:06.662593+0000","last_became_active":"2024-04-24T13:30:50.928545+0000","last_became_peered":"2024-04-24T13:30:50.928545+0000","last_unstale":"2024-04-24T13:33:06.662593+0000","last_undegraded":"2024-04-24T13:33:06.662593+0000","last_fullsized":"2024-04-24T13:33:06.662593+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:26:58.476605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":144,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703973+0000","last_change":"2024-04-24T13:32:00.646571+0000","last_active":"2024-04-24T13:33:06.703973+0000","last_peered":"2024-04-24T13:33:06.703973+0000","last_clean":"2024-04-24T13:33:06.703973+0000","last_became_active":"2024-04-24T13:32:00.596446+0000","last_became_peered":"2024-04-24T13:32:00.596446+0000","last_unstale":"2024-04-24T13:33:06.703973+0000","last_undegraded":"2024-04-24T13:33:06.703973+0000","last_fullsized":"2024-04-24T13:33:06.703973+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:29:02.008315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":102,"num_read_kb":102,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.16","version":"86'14","reported_seq":195,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763020+0000","last_change":"2024-04-24T13:30:50.953480+0000","last_active":"2024-04-24T13:33:06.763020+0000","last_peered":"2024-04-24T13:33:06.763020+0000","last_clean":"2024-04-24T13:33:06.763020+0000","last_became_active":"2024-04-24T13:30:50.917577+0000","last_became_peered":"2024-04-24T13:30:50.917577+0000","last_unstale":"2024-04-24T13:33:06.763020+0000","last_undegraded":"2024-04-24T13:33:06.763020+0000","last_fullsized":"2024-04-24T13:33:06.763020+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:41.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":67,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.649197+0000","last_change":"2024-04-24T13:32:00.550424+0000","last_active":"2024-04-24T13:33:06.649197+0000","last_peered":"2024-04-24T13:33:06.649197+0000","last_clean":"2024-04-24T13:33:06.649197+0000","last_became_active":"2024-04-24T13:32:00.550098+0000","last_became_peered":"2024-04-24T13:32:00.550098+0000","last_unstale":"2024-04-24T13:33:06.649197+0000","last_undegraded":"2024-04-24T13:33:06.649197+0000","last_fullsized":"2024-04-24T13:33:06.649197+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:51:43.235825+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.19","version":"94'37","reported_seq":116,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658789+0000","last_change":"2024-04-24T13:32:00.576594+0000","last_active":"2024-04-24T13:33:06.658789+0000","last_peered":"2024-04-24T13:33:06.658789+0000","last_clean":"2024-04-24T13:33:06.658789+0000","last_became_active":"2024-04-24T13:32:00.575785+0000","last_became_peered":"2024-04-24T13:32:00.575785+0000","last_unstale":"2024-04-24T13:33:06.658789+0000","last_undegraded":"2024-04-24T13:33:06.658789+0000","last_fullsized":"2024-04-24T13:33:06.658789+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:46:13.469865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":87,"num_read_kb":87,"num_write":74,"num_write_kb":28,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.15","version":"82'4","reported_seq":124,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710632+0000","last_change":"2024-04-24T13:32:00.594661+0000","last_active":"2024-04-24T13:33:06.710632+0000","last_peered":"2024-04-24T13:33:06.710632+0000","last_clean":"2024-04-24T13:33:06.710632+0000","last_became_active":"2024-04-24T13:32:00.594387+0000","last_became_peered":"2024-04-24T13:32:00.594387+0000","last_unstale":"2024-04-24T13:33:06.710632+0000","last_undegraded":"2024-04-24T13:33:06.710632+0000","last_fullsized":"2024-04-24T13:33:06.710632+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:05.797402+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"102'10","reported_seq":186,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762144+0000","last_change":"2024-04-24T13:30:50.915215+0000","last_active":"2024-04-24T13:33:06.762144+0000","last_peered":"2024-04-24T13:33:06.762144+0000","last_clean":"2024-04-24T13:33:06.762144+0000","last_became_active":"2024-04-24T13:30:50.913930+0000","last_became_peered":"2024-04-24T13:30:50.913930+0000","last_unstale":"2024-04-24T13:33:06.762144+0000","last_undegraded":"2024-04-24T13:33:06.762144+0000","last_fullsized":"2024-04-24T13:33:06.762144+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:53.839067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710970+0000","last_change":"2024-04-24T13:30:50.926673+0000","last_active":"2024-04-24T13:33:06.710970+0000","last_peered":"2024-04-24T13:33:06.710970+0000","last_clean":"2024-04-24T13:33:06.710970+0000","last_became_active":"2024-04-24T13:30:50.926286+0000","last_became_peered":"2024-04-24T13:30:50.926286+0000","last_unstale":"2024-04-24T13:33:06.710970+0000","last_undegraded":"2024-04-24T13:33:06.710970+0000","last_fullsized":"2024-04-24T13:33:06.710970+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:21:21.951639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660010+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:33:06.660010+0000","last_peered":"2024-04-24T13:33:06.660010+0000","last_clean":"2024-04-24T13:33:06.660010+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:33:06.660010+0000","last_undegraded":"2024-04-24T13:33:06.660010+0000","last_fullsized":"2024-04-24T13:33:06.660010+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658657+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:33:06.658657+0000","last_peered":"2024-04-24T13:33:06.658657+0000","last_clean":"2024-04-24T13:33:06.658657+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:33:06.658657+0000","last_undegraded":"2024-04-24T13:33:06.658657+0000","last_fullsized":"2024-04-24T13:33:06.658657+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761786+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:33:06.761786+0000","last_peered":"2024-04-24T13:33:06.761786+0000","last_clean":"2024-04-24T13:33:06.761786+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:33:06.761786+0000","last_undegraded":"2024-04-24T13:33:06.761786+0000","last_fullsized":"2024-04-24T13:33:06.761786+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"86'10","reported_seq":198,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762403+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:33:06.762403+0000","last_peered":"2024-04-24T13:33:06.762403+0000","last_clean":"2024-04-24T13:33:06.762403+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:33:06.762403+0000","last_undegraded":"2024-04-24T13:33:06.762403+0000","last_fullsized":"2024-04-24T13:33:06.762403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"101'7","reported_seq":137,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657492+0000","last_change":"2024-04-24T13:30:50.946908+0000","last_active":"2024-04-24T13:33:06.657492+0000","last_peered":"2024-04-24T13:33:06.657492+0000","last_clean":"2024-04-24T13:33:06.657492+0000","last_became_active":"2024-04-24T13:30:50.932201+0000","last_became_peered":"2024-04-24T13:30:50.932201+0000","last_unstale":"2024-04-24T13:33:06.657492+0000","last_undegraded":"2024-04-24T13:33:06.657492+0000","last_fullsized":"2024-04-24T13:33:06.657492+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:41.874257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715584+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:33:06.715584+0000","last_peered":"2024-04-24T13:33:06.715584+0000","last_clean":"2024-04-24T13:33:06.715584+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:33:06.715584+0000","last_undegraded":"2024-04-24T13:33:06.715584+0000","last_fullsized":"2024-04-24T13:33:06.715584+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648020+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:33:06.648020+0000","last_peered":"2024-04-24T13:33:06.648020+0000","last_clean":"2024-04-24T13:33:06.648020+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:33:06.648020+0000","last_undegraded":"2024-04-24T13:33:06.648020+0000","last_fullsized":"2024-04-24T13:33:06.648020+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"94'105","reported_seq":273,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703560+0000","last_change":"2024-04-24T13:30:50.933595+0000","last_active":"2024-04-24T13:33:06.703560+0000","last_peered":"2024-04-24T13:33:06.703560+0000","last_clean":"2024-04-24T13:33:06.703560+0000","last_became_active":"2024-04-24T13:30:50.926963+0000","last_became_peered":"2024-04-24T13:30:50.926963+0000","last_unstale":"2024-04-24T13:33:06.703560+0000","last_undegraded":"2024-04-24T13:33:06.703560+0000","last_fullsized":"2024-04-24T13:33:06.703560+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"94'7","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657955+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:33:06.657955+0000","last_peered":"2024-04-24T13:33:06.657955+0000","last_clean":"2024-04-24T13:33:06.657955+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:33:06.657955+0000","last_undegraded":"2024-04-24T13:33:06.657955+0000","last_fullsized":"2024-04-24T13:33:06.657955+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":408,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":22,"num_read_kb":18,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"86'2","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715489+0000","last_change":"2024-04-24T13:30:50.921336+0000","last_active":"2024-04-24T13:33:06.715489+0000","last_peered":"2024-04-24T13:33:06.715489+0000","last_clean":"2024-04-24T13:33:06.715489+0000","last_became_active":"2024-04-24T13:30:50.920829+0000","last_became_peered":"2024-04-24T13:30:50.920829+0000","last_unstale":"2024-04-24T13:33:06.715489+0000","last_undegraded":"2024-04-24T13:33:06.715489+0000","last_fullsized":"2024-04-24T13:33:06.715489+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:37.250085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"101'7","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735625+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:33:06.735625+0000","last_peered":"2024-04-24T13:33:06.735625+0000","last_clean":"2024-04-24T13:33:06.735625+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:33:06.735625+0000","last_undegraded":"2024-04-24T13:33:06.735625+0000","last_fullsized":"2024-04-24T13:33:06.735625+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":64,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715226+0000","last_change":"2024-04-24T13:32:00.575312+0000","last_active":"2024-04-24T13:33:06.715226+0000","last_peered":"2024-04-24T13:33:06.715226+0000","last_clean":"2024-04-24T13:33:06.715226+0000","last_became_active":"2024-04-24T13:32:00.575004+0000","last_became_peered":"2024-04-24T13:32:00.575004+0000","last_unstale":"2024-04-24T13:33:06.715226+0000","last_undegraded":"2024-04-24T13:33:06.715226+0000","last_fullsized":"2024-04-24T13:33:06.715226+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:23:40.859824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"86'14","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737776+0000","last_change":"2024-04-24T13:30:51.001114+0000","last_active":"2024-04-24T13:33:06.737776+0000","last_peered":"2024-04-24T13:33:06.737776+0000","last_clean":"2024-04-24T13:33:06.737776+0000","last_became_active":"2024-04-24T13:30:50.954422+0000","last_became_peered":"2024-04-24T13:30:50.954422+0000","last_unstale":"2024-04-24T13:33:06.737776+0000","last_undegraded":"2024-04-24T13:33:06.737776+0000","last_fullsized":"2024-04-24T13:33:06.737776+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:44.516492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"94'104","reported_seq":298,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710659+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:33:06.710659+0000","last_peered":"2024-04-24T13:33:06.710659+0000","last_clean":"2024-04-24T13:33:06.710659+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:33:06.710659+0000","last_undegraded":"2024-04-24T13:33:06.710659+0000","last_fullsized":"2024-04-24T13:33:06.710659+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"82'2","reported_seq":116,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.734873+0000","last_change":"2024-04-24T13:32:00.583583+0000","last_active":"2024-04-24T13:33:06.734873+0000","last_peered":"2024-04-24T13:33:06.734873+0000","last_clean":"2024-04-24T13:33:06.734873+0000","last_became_active":"2024-04-24T13:32:00.577955+0000","last_became_peered":"2024-04-24T13:32:00.577955+0000","last_unstale":"2024-04-24T13:33:06.734873+0000","last_undegraded":"2024-04-24T13:33:06.734873+0000","last_fullsized":"2024-04-24T13:33:06.734873+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:31.661093+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.f","version":"102'6","reported_seq":122,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.037037+0000","last_change":"2024-04-24T13:31:01.035289+0000","last_active":"2024-04-24T13:33:07.037037+0000","last_peered":"2024-04-24T13:33:07.037037+0000","last_clean":"2024-04-24T13:33:07.037037+0000","last_became_active":"2024-04-24T13:31:01.034325+0000","last_became_peered":"2024-04-24T13:31:01.034325+0000","last_unstale":"2024-04-24T13:33:07.037037+0000","last_undegraded":"2024-04-24T13:33:07.037037+0000","last_fullsized":"2024-04-24T13:33:07.037037+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:08.322191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":130,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.736018+0000","last_change":"2024-04-24T13:30:50.948387+0000","last_active":"2024-04-24T13:33:06.736018+0000","last_peered":"2024-04-24T13:33:06.736018+0000","last_clean":"2024-04-24T13:33:06.736018+0000","last_became_active":"2024-04-24T13:30:50.947644+0000","last_became_peered":"2024-04-24T13:30:50.947644+0000","last_unstale":"2024-04-24T13:33:06.736018+0000","last_undegraded":"2024-04-24T13:33:06.736018+0000","last_fullsized":"2024-04-24T13:33:06.736018+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:03.622375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"86'24","reported_seq":138,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737411+0000","last_change":"2024-04-24T13:32:00.642541+0000","last_active":"2024-04-24T13:33:06.737411+0000","last_peered":"2024-04-24T13:33:06.737411+0000","last_clean":"2024-04-24T13:33:06.737411+0000","last_became_active":"2024-04-24T13:32:00.600504+0000","last_became_peered":"2024-04-24T13:32:00.600504+0000","last_unstale":"2024-04-24T13:33:06.737411+0000","last_undegraded":"2024-04-24T13:33:06.737411+0000","last_fullsized":"2024-04-24T13:33:06.737411+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:10.436000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703202+0000","last_change":"2024-04-24T13:32:00.572217+0000","last_active":"2024-04-24T13:33:06.703202+0000","last_peered":"2024-04-24T13:33:06.703202+0000","last_clean":"2024-04-24T13:33:06.703202+0000","last_became_active":"2024-04-24T13:32:00.571455+0000","last_became_peered":"2024-04-24T13:32:00.571455+0000","last_unstale":"2024-04-24T13:33:06.703202+0000","last_undegraded":"2024-04-24T13:33:06.703202+0000","last_fullsized":"2024-04-24T13:33:06.703202+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:03.862128+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"86'7","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647307+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:33:06.647307+0000","last_peered":"2024-04-24T13:33:06.647307+0000","last_clean":"2024-04-24T13:33:06.647307+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:33:06.647307+0000","last_undegraded":"2024-04-24T13:33:06.647307+0000","last_fullsized":"2024-04-24T13:33:06.647307+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658233+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:33:06.658233+0000","last_peered":"2024-04-24T13:33:06.658233+0000","last_clean":"2024-04-24T13:33:06.658233+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:33:06.658233+0000","last_undegraded":"2024-04-24T13:33:06.658233+0000","last_fullsized":"2024-04-24T13:33:06.658233+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"101'5","reported_seq":136,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660766+0000","last_change":"2024-04-24T13:30:50.930041+0000","last_active":"2024-04-24T13:33:06.660766+0000","last_peered":"2024-04-24T13:33:06.660766+0000","last_clean":"2024-04-24T13:33:06.660766+0000","last_became_active":"2024-04-24T13:30:50.929179+0000","last_became_peered":"2024-04-24T13:30:50.929179+0000","last_unstale":"2024-04-24T13:33:06.660766+0000","last_undegraded":"2024-04-24T13:33:06.660766+0000","last_fullsized":"2024-04-24T13:33:06.660766+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:46.987972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646180+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:33:06.646180+0000","last_peered":"2024-04-24T13:33:06.646180+0000","last_clean":"2024-04-24T13:33:06.646180+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:33:06.646180+0000","last_undegraded":"2024-04-24T13:33:06.646180+0000","last_fullsized":"2024-04-24T13:33:06.646180+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"86'15","reported_seq":195,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710868+0000","last_change":"2024-04-24T13:30:50.948850+0000","last_active":"2024-04-24T13:33:06.710868+0000","last_peered":"2024-04-24T13:33:06.710868+0000","last_clean":"2024-04-24T13:33:06.710868+0000","last_became_active":"2024-04-24T13:30:50.921374+0000","last_became_peered":"2024-04-24T13:30:50.921374+0000","last_unstale":"2024-04-24T13:33:06.710868+0000","last_undegraded":"2024-04-24T13:33:06.710868+0000","last_fullsized":"2024-04-24T13:33:06.710868+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:22:03.728196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708104+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:33:06.708104+0000","last_peered":"2024-04-24T13:33:06.708104+0000","last_clean":"2024-04-24T13:33:06.708104+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:33:06.708104+0000","last_undegraded":"2024-04-24T13:33:06.708104+0000","last_fullsized":"2024-04-24T13:33:06.708104+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":149,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737095+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:33:06.737095+0000","last_peered":"2024-04-24T13:33:06.737095+0000","last_clean":"2024-04-24T13:33:06.737095+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:33:06.737095+0000","last_undegraded":"2024-04-24T13:33:06.737095+0000","last_fullsized":"2024-04-24T13:33:06.737095+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"82'4","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735135+0000","last_change":"2024-04-24T13:32:01.548738+0000","last_active":"2024-04-24T13:33:06.735135+0000","last_peered":"2024-04-24T13:33:06.735135+0000","last_clean":"2024-04-24T13:33:06.735135+0000","last_became_active":"2024-04-24T13:32:01.548259+0000","last_became_peered":"2024-04-24T13:32:01.548259+0000","last_unstale":"2024-04-24T13:33:06.735135+0000","last_undegraded":"2024-04-24T13:33:06.735135+0000","last_fullsized":"2024-04-24T13:33:06.735135+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"102'8","reported_seq":74,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.104063+0000","last_change":"2024-04-24T13:32:00.584693+0000","last_active":"2024-04-24T13:33:07.104063+0000","last_peered":"2024-04-24T13:33:07.104063+0000","last_clean":"2024-04-24T13:33:07.104063+0000","last_became_active":"2024-04-24T13:32:00.583818+0000","last_became_peered":"2024-04-24T13:32:00.583818+0000","last_unstale":"2024-04-24T13:33:07.104063+0000","last_undegraded":"2024-04-24T13:33:07.104063+0000","last_fullsized":"2024-04-24T13:33:07.104063+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:54.012692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646777+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:33:06.646777+0000","last_peered":"2024-04-24T13:33:06.646777+0000","last_clean":"2024-04-24T13:33:06.646777+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:33:06.646777+0000","last_undegraded":"2024-04-24T13:33:06.646777+0000","last_fullsized":"2024-04-24T13:33:06.646777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"86'20","reported_seq":196,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646079+0000","last_change":"2024-04-24T13:30:50.970163+0000","last_active":"2024-04-24T13:33:06.646079+0000","last_peered":"2024-04-24T13:33:06.646079+0000","last_clean":"2024-04-24T13:33:06.646079+0000","last_became_active":"2024-04-24T13:30:50.920182+0000","last_became_peered":"2024-04-24T13:30:50.920182+0000","last_unstale":"2024-04-24T13:33:06.646079+0000","last_undegraded":"2024-04-24T13:33:06.646079+0000","last_fullsized":"2024-04-24T13:33:06.646079+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:29.765956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"94'104","reported_seq":372,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761957+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:33:06.761957+0000","last_peered":"2024-04-24T13:33:06.761957+0000","last_clean":"2024-04-24T13:33:06.761957+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:33:06.761957+0000","last_undegraded":"2024-04-24T13:33:06.761957+0000","last_fullsized":"2024-04-24T13:33:06.761957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"82'3","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762953+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:33:06.762953+0000","last_peered":"2024-04-24T13:33:06.762953+0000","last_clean":"2024-04-24T13:33:06.762953+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:33:06.762953+0000","last_undegraded":"2024-04-24T13:33:06.762953+0000","last_fullsized":"2024-04-24T13:33:06.762953+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"94'7","reported_seq":194,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.764067+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:33:06.764067+0000","last_peered":"2024-04-24T13:33:06.764067+0000","last_clean":"2024-04-24T13:33:06.764067+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:33:06.764067+0000","last_undegraded":"2024-04-24T13:33:06.764067+0000","last_fullsized":"2024-04-24T13:33:06.764067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"102'8","reported_seq":72,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.711490+0000","last_change":"2024-04-24T13:32:00.594022+0000","last_active":"2024-04-24T13:33:06.711490+0000","last_peered":"2024-04-24T13:33:06.711490+0000","last_clean":"2024-04-24T13:33:06.711490+0000","last_became_active":"2024-04-24T13:32:00.593750+0000","last_became_peered":"2024-04-24T13:32:00.593750+0000","last_unstale":"2024-04-24T13:33:06.711490+0000","last_undegraded":"2024-04-24T13:33:06.711490+0000","last_fullsized":"2024-04-24T13:33:06.711490+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:53:33.468353+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646870+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:33:06.646870+0000","last_peered":"2024-04-24T13:33:06.646870+0000","last_clean":"2024-04-24T13:33:06.646870+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:33:06.646870+0000","last_undegraded":"2024-04-24T13:33:06.646870+0000","last_fullsized":"2024-04-24T13:33:06.646870+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"86'22","reported_seq":209,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761771+0000","last_change":"2024-04-24T13:30:51.000083+0000","last_active":"2024-04-24T13:33:06.761771+0000","last_peered":"2024-04-24T13:33:06.761771+0000","last_clean":"2024-04-24T13:33:06.761771+0000","last_became_active":"2024-04-24T13:30:50.934568+0000","last_became_peered":"2024-04-24T13:30:50.934568+0000","last_unstale":"2024-04-24T13:33:06.761771+0000","last_undegraded":"2024-04-24T13:33:06.761771+0000","last_fullsized":"2024-04-24T13:33:06.761771+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:10.436000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":159,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.645983+0000","last_change":"2024-04-24T13:30:50.908390+0000","last_active":"2024-04-24T13:33:06.645983+0000","last_peered":"2024-04-24T13:33:06.645983+0000","last_clean":"2024-04-24T13:33:06.645983+0000","last_became_active":"2024-04-24T13:30:50.908013+0000","last_became_peered":"2024-04-24T13:30:50.908013+0000","last_unstale":"2024-04-24T13:33:06.645983+0000","last_undegraded":"2024-04-24T13:33:06.645983+0000","last_fullsized":"2024-04-24T13:33:06.645983+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'10","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.705383+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:33:06.705383+0000","last_peered":"2024-04-24T13:33:06.705383+0000","last_clean":"2024-04-24T13:33:06.705383+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:33:06.705383+0000","last_undegraded":"2024-04-24T13:33:06.705383+0000","last_fullsized":"2024-04-24T13:33:06.705383+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":69,"num_read_kb":69,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"82'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.659991+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:33:06.659991+0000","last_peered":"2024-04-24T13:33:06.659991+0000","last_clean":"2024-04-24T13:33:06.659991+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:33:06.659991+0000","last_undegraded":"2024-04-24T13:33:06.659991+0000","last_fullsized":"2024-04-24T13:33:06.659991+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"102'11","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.929694+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:33:06.929694+0000","last_peered":"2024-04-24T13:33:06.929694+0000","last_clean":"2024-04-24T13:33:06.929694+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:33:06.929694+0000","last_undegraded":"2024-04-24T13:33:06.929694+0000","last_fullsized":"2024-04-24T13:33:06.929694+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648211+0000","last_change":"2024-04-24T13:32:00.570272+0000","last_active":"2024-04-24T13:33:06.648211+0000","last_peered":"2024-04-24T13:33:06.648211+0000","last_clean":"2024-04-24T13:33:06.648211+0000","last_became_active":"2024-04-24T13:32:00.569572+0000","last_became_peered":"2024-04-24T13:32:00.569572+0000","last_unstale":"2024-04-24T13:33:06.648211+0000","last_undegraded":"2024-04-24T13:33:06.648211+0000","last_fullsized":"2024-04-24T13:33:06.648211+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:51.009578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"86'16","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658670+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:33:06.658670+0000","last_peered":"2024-04-24T13:33:06.658670+0000","last_clean":"2024-04-24T13:33:06.658670+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:33:06.658670+0000","last_undegraded":"2024-04-24T13:33:06.658670+0000","last_fullsized":"2024-04-24T13:33:06.658670+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763072+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:33:06.763072+0000","last_peered":"2024-04-24T13:33:06.763072+0000","last_clean":"2024-04-24T13:33:06.763072+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:33:06.763072+0000","last_undegraded":"2024-04-24T13:33:06.763072+0000","last_fullsized":"2024-04-24T13:33:06.763072+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708996+0000","last_change":"2024-04-24T13:32:00.577449+0000","last_active":"2024-04-24T13:33:06.708996+0000","last_peered":"2024-04-24T13:33:06.708996+0000","last_clean":"2024-04-24T13:33:06.708996+0000","last_became_active":"2024-04-24T13:32:00.576582+0000","last_became_peered":"2024-04-24T13:32:00.576582+0000","last_unstale":"2024-04-24T13:33:06.708996+0000","last_undegraded":"2024-04-24T13:33:06.708996+0000","last_fullsized":"2024-04-24T13:33:06.708996+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:42.720281+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660073+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:33:06.660073+0000","last_peered":"2024-04-24T13:33:06.660073+0000","last_clean":"2024-04-24T13:33:06.660073+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:33:06.660073+0000","last_undegraded":"2024-04-24T13:33:06.660073+0000","last_fullsized":"2024-04-24T13:33:06.660073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"102'8","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.185650+0000","last_change":"2024-04-24T13:31:00.986244+0000","last_active":"2024-04-24T13:33:07.185650+0000","last_peered":"2024-04-24T13:33:07.185650+0000","last_clean":"2024-04-24T13:33:07.185650+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:33:07.185650+0000","last_undegraded":"2024-04-24T13:33:07.185650+0000","last_fullsized":"2024-04-24T13:33:07.185650+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:23.355231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":164,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703617+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:33:06.703617+0000","last_peered":"2024-04-24T13:33:06.703617+0000","last_clean":"2024-04-24T13:33:06.703617+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:33:06.703617+0000","last_undegraded":"2024-04-24T13:33:06.703617+0000","last_fullsized":"2024-04-24T13:33:06.703617+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"86'22","reported_seq":190,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.649374+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:33:06.649374+0000","last_peered":"2024-04-24T13:33:06.649374+0000","last_clean":"2024-04-24T13:33:06.649374+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:33:06.649374+0000","last_undegraded":"2024-04-24T13:33:06.649374+0000","last_fullsized":"2024-04-24T13:33:06.649374+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"94'105","reported_seq":311,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648749+0000","last_change":"2024-04-24T13:32:00.643512+0000","last_active":"2024-04-24T13:33:06.648749+0000","last_peered":"2024-04-24T13:33:06.648749+0000","last_clean":"2024-04-24T13:33:06.648749+0000","last_became_active":"2024-04-24T13:32:00.581919+0000","last_became_peered":"2024-04-24T13:32:00.581919+0000","last_unstale":"2024-04-24T13:33:06.648749+0000","last_undegraded":"2024-04-24T13:33:06.648749+0000","last_fullsized":"2024-04-24T13:33:06.648749+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:01.892496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":152,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702970+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:33:06.702970+0000","last_peered":"2024-04-24T13:33:06.702970+0000","last_clean":"2024-04-24T13:33:06.702970+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:33:06.702970+0000","last_undegraded":"2024-04-24T13:33:06.702970+0000","last_fullsized":"2024-04-24T13:33:06.702970+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"0'0","reported_seq":167,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660403+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:33:06.660403+0000","last_peered":"2024-04-24T13:33:06.660403+0000","last_clean":"2024-04-24T13:33:06.660403+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:33:06.660403+0000","last_undegraded":"2024-04-24T13:33:06.660403+0000","last_fullsized":"2024-04-24T13:33:06.660403+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"101'10","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657054+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:33:06.657054+0000","last_peered":"2024-04-24T13:33:06.657054+0000","last_clean":"2024-04-24T13:33:06.657054+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:33:06.657054+0000","last_undegraded":"2024-04-24T13:33:06.657054+0000","last_fullsized":"2024-04-24T13:33:06.657054+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":215,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660585+0000","last_change":"2024-04-24T13:32:00.620428+0000","last_active":"2024-04-24T13:33:06.660585+0000","last_peered":"2024-04-24T13:33:06.660585+0000","last_clean":"2024-04-24T13:33:06.660585+0000","last_became_active":"2024-04-24T13:32:00.580756+0000","last_became_peered":"2024-04-24T13:32:00.580756+0000","last_unstale":"2024-04-24T13:33:06.660585+0000","last_undegraded":"2024-04-24T13:33:06.660585+0000","last_fullsized":"2024-04-24T13:33:06.660585+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:02.973502+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.c","version":"82'11","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710755+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:33:06.710755+0000","last_peered":"2024-04-24T13:33:06.710755+0000","last_clean":"2024-04-24T13:33:06.710755+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:33:06.710755+0000","last_undegraded":"2024-04-24T13:33:06.710755+0000","last_fullsized":"2024-04-24T13:33:06.710755+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"94'104","reported_seq":327,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737358+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:33:06.737358+0000","last_peered":"2024-04-24T13:33:06.737358+0000","last_clean":"2024-04-24T13:33:06.737358+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:33:06.737358+0000","last_undegraded":"2024-04-24T13:33:06.737358+0000","last_fullsized":"2024-04-24T13:33:06.737358+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.659152+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:33:06.659152+0000","last_peered":"2024-04-24T13:33:06.659152+0000","last_clean":"2024-04-24T13:33:06.659152+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:33:06.659152+0000","last_undegraded":"2024-04-24T13:33:06.659152+0000","last_fullsized":"2024-04-24T13:33:06.659152+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"86'4","reported_seq":186,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.705632+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:33:06.705632+0000","last_peered":"2024-04-24T13:33:06.705632+0000","last_clean":"2024-04-24T13:33:06.705632+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:33:06.705632+0000","last_undegraded":"2024-04-24T13:33:06.705632+0000","last_fullsized":"2024-04-24T13:33:06.705632+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"102'8","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708143+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:33:06.708143+0000","last_peered":"2024-04-24T13:33:06.708143+0000","last_clean":"2024-04-24T13:33:06.708143+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:33:06.708143+0000","last_undegraded":"2024-04-24T13:33:06.708143+0000","last_fullsized":"2024-04-24T13:33:06.708143+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.659938+0000","last_change":"2024-04-24T13:32:00.575444+0000","last_active":"2024-04-24T13:33:06.659938+0000","last_peered":"2024-04-24T13:33:06.659938+0000","last_clean":"2024-04-24T13:33:06.659938+0000","last_became_active":"2024-04-24T13:32:00.574616+0000","last_became_peered":"2024-04-24T13:32:00.574616+0000","last_unstale":"2024-04-24T13:33:06.659938+0000","last_undegraded":"2024-04-24T13:33:06.659938+0000","last_fullsized":"2024-04-24T13:33:06.659938+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:51.796840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"86'22","reported_seq":134,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704191+0000","last_change":"2024-04-24T13:32:00.659945+0000","last_active":"2024-04-24T13:33:06.704191+0000","last_peered":"2024-04-24T13:33:06.704191+0000","last_clean":"2024-04-24T13:33:06.704191+0000","last_became_active":"2024-04-24T13:32:00.596498+0000","last_became_peered":"2024-04-24T13:32:00.596498+0000","last_unstale":"2024-04-24T13:33:06.704191+0000","last_undegraded":"2024-04-24T13:33:06.704191+0000","last_fullsized":"2024-04-24T13:33:06.704191+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:22:03.728196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":153,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735917+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:33:06.735917+0000","last_peered":"2024-04-24T13:33:06.735917+0000","last_clean":"2024-04-24T13:33:06.735917+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:33:06.735917+0000","last_undegraded":"2024-04-24T13:33:06.735917+0000","last_fullsized":"2024-04-24T13:33:06.735917+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"82'2","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703148+0000","last_change":"2024-04-24T13:32:00.562685+0000","last_active":"2024-04-24T13:33:06.703148+0000","last_peered":"2024-04-24T13:33:06.703148+0000","last_clean":"2024-04-24T13:33:06.703148+0000","last_became_active":"2024-04-24T13:32:00.562306+0000","last_became_peered":"2024-04-24T13:32:00.562306+0000","last_unstale":"2024-04-24T13:33:06.703148+0000","last_undegraded":"2024-04-24T13:33:06.703148+0000","last_fullsized":"2024-04-24T13:33:06.703148+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:36:11.086183+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"94'3","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.738055+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:33:06.738055+0000","last_peered":"2024-04-24T13:33:06.738055+0000","last_clean":"2024-04-24T13:33:06.738055+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:33:06.738055+0000","last_undegraded":"2024-04-24T13:33:06.738055+0000","last_fullsized":"2024-04-24T13:33:06.738055+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":296,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761960+0000","last_change":"2024-04-24T13:30:53.928527+0000","last_active":"2024-04-24T13:33:06.761960+0000","last_peered":"2024-04-24T13:33:06.761960+0000","last_clean":"2024-04-24T13:33:06.761960+0000","last_became_active":"2024-04-24T13:30:53.928167+0000","last_became_peered":"2024-04-24T13:30:53.928167+0000","last_unstale":"2024-04-24T13:33:06.761960+0000","last_undegraded":"2024-04-24T13:33:06.761960+0000","last_fullsized":"2024-04-24T13:33:06.761960+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:43.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":65,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646681+0000","last_change":"2024-04-24T13:32:00.578098+0000","last_active":"2024-04-24T13:33:06.646681+0000","last_peered":"2024-04-24T13:33:06.646681+0000","last_clean":"2024-04-24T13:33:06.646681+0000","last_became_active":"2024-04-24T13:32:00.577790+0000","last_became_peered":"2024-04-24T13:32:00.577790+0000","last_unstale":"2024-04-24T13:33:06.646681+0000","last_undegraded":"2024-04-24T13:33:06.646681+0000","last_fullsized":"2024-04-24T13:33:06.646681+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:25.305366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2","version":"102'8","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.423042+0000","last_change":"2024-04-24T13:32:00.603123+0000","last_active":"2024-04-24T13:33:07.423042+0000","last_peered":"2024-04-24T13:33:07.423042+0000","last_clean":"2024-04-24T13:33:07.423042+0000","last_became_active":"2024-04-24T13:32:00.602796+0000","last_became_peered":"2024-04-24T13:32:00.602796+0000","last_unstale":"2024-04-24T13:33:07.423042+0000","last_undegraded":"2024-04-24T13:33:07.423042+0000","last_fullsized":"2024-04-24T13:33:07.423042+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:00.666218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":137,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648134+0000","last_change":"2024-04-24T13:32:00.570311+0000","last_active":"2024-04-24T13:33:06.648134+0000","last_peered":"2024-04-24T13:33:06.648134+0000","last_clean":"2024-04-24T13:33:06.648134+0000","last_became_active":"2024-04-24T13:32:00.570038+0000","last_became_peered":"2024-04-24T13:32:00.570038+0000","last_unstale":"2024-04-24T13:33:06.648134+0000","last_undegraded":"2024-04-24T13:33:06.648134+0000","last_fullsized":"2024-04-24T13:33:06.648134+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:18.009342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"86'31","reported_seq":139,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715702+0000","last_change":"2024-04-24T13:32:00.618901+0000","last_active":"2024-04-24T13:33:06.715702+0000","last_peered":"2024-04-24T13:33:06.715702+0000","last_clean":"2024-04-24T13:33:06.715702+0000","last_became_active":"2024-04-24T13:32:00.577557+0000","last_became_peered":"2024-04-24T13:32:00.577557+0000","last_unstale":"2024-04-24T13:33:06.715702+0000","last_undegraded":"2024-04-24T13:33:06.715702+0000","last_fullsized":"2024-04-24T13:33:06.715702+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:37.412890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62524,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":20,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":160,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762902+0000","last_change":"2024-04-24T13:30:50.917737+0000","last_active":"2024-04-24T13:33:06.762902+0000","last_peered":"2024-04-24T13:33:06.762902+0000","last_clean":"2024-04-24T13:33:06.762902+0000","last_became_active":"2024-04-24T13:30:50.916920+0000","last_became_peered":"2024-04-24T13:30:50.916920+0000","last_unstale":"2024-04-24T13:33:06.762902+0000","last_undegraded":"2024-04-24T13:33:06.762902+0000","last_fullsized":"2024-04-24T13:33:06.762902+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:12.813827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735181+0000","last_change":"2024-04-24T13:32:00.594436+0000","last_active":"2024-04-24T13:33:06.735181+0000","last_peered":"2024-04-24T13:33:06.735181+0000","last_clean":"2024-04-24T13:33:06.735181+0000","last_became_active":"2024-04-24T13:32:00.593632+0000","last_became_peered":"2024-04-24T13:32:00.593632+0000","last_unstale":"2024-04-24T13:33:06.735181+0000","last_undegraded":"2024-04-24T13:33:06.735181+0000","last_fullsized":"2024-04-24T13:33:06.735181+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:42:19.800985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"94'5","reported_seq":187,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762568+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:33:06.762568+0000","last_peered":"2024-04-24T13:33:06.762568+0000","last_clean":"2024-04-24T13:33:06.762568+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:33:06.762568+0000","last_undegraded":"2024-04-24T13:33:06.762568+0000","last_fullsized":"2024-04-24T13:33:06.762568+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":132,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702901+0000","last_change":"2024-04-24T13:30:50.937903+0000","last_active":"2024-04-24T13:33:06.702901+0000","last_peered":"2024-04-24T13:33:06.702901+0000","last_clean":"2024-04-24T13:33:06.702901+0000","last_became_active":"2024-04-24T13:30:50.937359+0000","last_became_peered":"2024-04-24T13:30:50.937359+0000","last_unstale":"2024-04-24T13:33:06.702901+0000","last_undegraded":"2024-04-24T13:33:06.702901+0000","last_fullsized":"2024-04-24T13:33:06.702901+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:27.651521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"102'7","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761914+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:33:06.761914+0000","last_peered":"2024-04-24T13:33:06.761914+0000","last_clean":"2024-04-24T13:33:06.761914+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:33:06.761914+0000","last_undegraded":"2024-04-24T13:33:06.761914+0000","last_fullsized":"2024-04-24T13:33:06.761914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":65,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.705485+0000","last_change":"2024-04-24T13:32:00.582433+0000","last_active":"2024-04-24T13:33:06.705485+0000","last_peered":"2024-04-24T13:33:06.705485+0000","last_clean":"2024-04-24T13:33:06.705485+0000","last_became_active":"2024-04-24T13:32:00.581917+0000","last_became_peered":"2024-04-24T13:32:00.581917+0000","last_unstale":"2024-04-24T13:33:06.705485+0000","last_undegraded":"2024-04-24T13:33:06.705485+0000","last_fullsized":"2024-04-24T13:33:06.705485+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:08.428841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.4","version":"94'106","reported_seq":350,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703520+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:33:06.703520+0000","last_peered":"2024-04-24T13:33:06.703520+0000","last_clean":"2024-04-24T13:33:06.703520+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:33:06.703520+0000","last_undegraded":"2024-04-24T13:33:06.703520+0000","last_fullsized":"2024-04-24T13:33:06.703520+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":106,"log_dups_size":0,"ondisk_log_size":106,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":144,"num_read_kb":129,"num_write":26,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":132,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648374+0000","last_change":"2024-04-24T13:30:50.925382+0000","last_active":"2024-04-24T13:33:06.648374+0000","last_peered":"2024-04-24T13:33:06.648374+0000","last_clean":"2024-04-24T13:33:06.648374+0000","last_became_active":"2024-04-24T13:30:50.924919+0000","last_became_peered":"2024-04-24T13:30:50.924919+0000","last_unstale":"2024-04-24T13:33:06.648374+0000","last_undegraded":"2024-04-24T13:33:06.648374+0000","last_fullsized":"2024-04-24T13:33:06.648374+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":152,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702894+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:33:06.702894+0000","last_peered":"2024-04-24T13:33:06.702894+0000","last_clean":"2024-04-24T13:33:06.702894+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:33:06.702894+0000","last_undegraded":"2024-04-24T13:33:06.702894+0000","last_fullsized":"2024-04-24T13:33:06.702894+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.705710+0000","last_change":"2024-04-24T13:32:00.582203+0000","last_active":"2024-04-24T13:33:06.705710+0000","last_peered":"2024-04-24T13:33:06.705710+0000","last_clean":"2024-04-24T13:33:06.705710+0000","last_became_active":"2024-04-24T13:32:00.581535+0000","last_became_peered":"2024-04-24T13:32:00.581535+0000","last_unstale":"2024-04-24T13:33:06.705710+0000","last_undegraded":"2024-04-24T13:33:06.705710+0000","last_fullsized":"2024-04-24T13:33:06.705710+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:37.250085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646263+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:33:06.646263+0000","last_peered":"2024-04-24T13:33:06.646263+0000","last_clean":"2024-04-24T13:33:06.646263+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:33:06.646263+0000","last_undegraded":"2024-04-24T13:33:06.646263+0000","last_fullsized":"2024-04-24T13:33:06.646263+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"102'6","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.189113+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:33:07.189113+0000","last_peered":"2024-04-24T13:33:07.189113+0000","last_clean":"2024-04-24T13:33:07.189113+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:33:07.189113+0000","last_undegraded":"2024-04-24T13:33:07.189113+0000","last_fullsized":"2024-04-24T13:33:07.189113+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":172,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648828+0000","last_change":"2024-04-24T13:32:00.591663+0000","last_active":"2024-04-24T13:33:06.648828+0000","last_peered":"2024-04-24T13:33:06.648828+0000","last_clean":"2024-04-24T13:33:06.648828+0000","last_became_active":"2024-04-24T13:32:00.569726+0000","last_became_peered":"2024-04-24T13:32:00.569726+0000","last_unstale":"2024-04-24T13:33:06.648828+0000","last_undegraded":"2024-04-24T13:33:06.648828+0000","last_fullsized":"2024-04-24T13:33:06.648828+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:45.895863+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"82'17","reported_seq":217,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737620+0000","last_change":"2024-04-24T13:30:50.991700+0000","last_active":"2024-04-24T13:33:06.737620+0000","last_peered":"2024-04-24T13:33:06.737620+0000","last_clean":"2024-04-24T13:33:06.737620+0000","last_became_active":"2024-04-24T13:30:50.940740+0000","last_became_peered":"2024-04-24T13:30:50.940740+0000","last_unstale":"2024-04-24T13:33:06.737620+0000","last_undegraded":"2024-04-24T13:33:06.737620+0000","last_fullsized":"2024-04-24T13:33:06.737620+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:39.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762495+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:33:06.762495+0000","last_peered":"2024-04-24T13:33:06.762495+0000","last_clean":"2024-04-24T13:33:06.762495+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:33:06.762495+0000","last_undegraded":"2024-04-24T13:33:06.762495+0000","last_fullsized":"2024-04-24T13:33:06.762495+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.711201+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:33:06.711201+0000","last_peered":"2024-04-24T13:33:06.711201+0000","last_clean":"2024-04-24T13:33:06.711201+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:33:06.711201+0000","last_undegraded":"2024-04-24T13:33:06.711201+0000","last_fullsized":"2024-04-24T13:33:06.711201+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"82'2","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703838+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:33:06.703838+0000","last_peered":"2024-04-24T13:33:06.703838+0000","last_clean":"2024-04-24T13:33:06.703838+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:33:06.703838+0000","last_undegraded":"2024-04-24T13:33:06.703838+0000","last_fullsized":"2024-04-24T13:33:06.703838+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":65,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703419+0000","last_change":"2024-04-24T13:32:00.588318+0000","last_active":"2024-04-24T13:33:06.703419+0000","last_peered":"2024-04-24T13:33:06.703419+0000","last_clean":"2024-04-24T13:33:06.703419+0000","last_became_active":"2024-04-24T13:32:00.587965+0000","last_became_peered":"2024-04-24T13:32:00.587965+0000","last_unstale":"2024-04-24T13:33:06.703419+0000","last_undegraded":"2024-04-24T13:33:06.703419+0000","last_fullsized":"2024-04-24T13:33:06.703419+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:06.838879+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3","version":"102'9","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.714784+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:33:06.714784+0000","last_peered":"2024-04-24T13:33:06.714784+0000","last_clean":"2024-04-24T13:33:06.714784+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:33:06.714784+0000","last_undegraded":"2024-04-24T13:33:06.714784+0000","last_fullsized":"2024-04-24T13:33:06.714784+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.760398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762194+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:33:06.762194+0000","last_peered":"2024-04-24T13:33:06.762194+0000","last_clean":"2024-04-24T13:33:06.762194+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:33:06.762194+0000","last_undegraded":"2024-04-24T13:33:06.762194+0000","last_fullsized":"2024-04-24T13:33:06.762194+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715126+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:33:06.715126+0000","last_peered":"2024-04-24T13:33:06.715126+0000","last_clean":"2024-04-24T13:33:06.715126+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:33:06.715126+0000","last_undegraded":"2024-04-24T13:33:06.715126+0000","last_fullsized":"2024-04-24T13:33:06.715126+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":153,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.738199+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:33:06.738199+0000","last_peered":"2024-04-24T13:33:06.738199+0000","last_clean":"2024-04-24T13:33:06.738199+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:33:06.738199+0000","last_undegraded":"2024-04-24T13:33:06.738199+0000","last_fullsized":"2024-04-24T13:33:06.738199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"81'4","reported_seq":70,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708885+0000","last_change":"2024-04-24T13:32:00.577712+0000","last_active":"2024-04-24T13:33:06.708885+0000","last_peered":"2024-04-24T13:33:06.708885+0000","last_clean":"2024-04-24T13:33:06.708885+0000","last_became_active":"2024-04-24T13:32:00.575604+0000","last_became_peered":"2024-04-24T13:32:00.575604+0000","last_unstale":"2024-04-24T13:33:06.708885+0000","last_undegraded":"2024-04-24T13:33:06.708885+0000","last_fullsized":"2024-04-24T13:33:06.708885+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:15.663480+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":173,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703231+0000","last_change":"2024-04-24T13:32:00.569068+0000","last_active":"2024-04-24T13:33:06.703231+0000","last_peered":"2024-04-24T13:33:06.703231+0000","last_clean":"2024-04-24T13:33:06.703231+0000","last_became_active":"2024-04-24T13:32:00.568763+0000","last_became_peered":"2024-04-24T13:32:00.568763+0000","last_unstale":"2024-04-24T13:33:06.703231+0000","last_undegraded":"2024-04-24T13:33:06.703231+0000","last_fullsized":"2024-04-24T13:33:06.703231+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:56.027255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"100'8","reported_seq":73,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.714543+0000","last_change":"2024-04-24T13:32:00.577865+0000","last_active":"2024-04-24T13:33:06.714543+0000","last_peered":"2024-04-24T13:33:06.714543+0000","last_clean":"2024-04-24T13:33:06.714543+0000","last_became_active":"2024-04-24T13:32:00.577564+0000","last_became_peered":"2024-04-24T13:32:00.577564+0000","last_unstale":"2024-04-24T13:33:06.714543+0000","last_undegraded":"2024-04-24T13:33:06.714543+0000","last_fullsized":"2024-04-24T13:33:06.714543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:52:14.484190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":18,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704285+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:33:06.704285+0000","last_peered":"2024-04-24T13:33:06.704285+0000","last_clean":"2024-04-24T13:33:06.704285+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:33:06.704285+0000","last_undegraded":"2024-04-24T13:33:06.704285+0000","last_fullsized":"2024-04-24T13:33:06.704285+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762086+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:33:06.762086+0000","last_peered":"2024-04-24T13:33:06.762086+0000","last_clean":"2024-04-24T13:33:06.762086+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:33:06.762086+0000","last_undegraded":"2024-04-24T13:33:06.762086+0000","last_fullsized":"2024-04-24T13:33:06.762086+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"86'28","reported_seq":201,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761513+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:33:06.761513+0000","last_peered":"2024-04-24T13:33:06.761513+0000","last_clean":"2024-04-24T13:33:06.761513+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:33:06.761513+0000","last_undegraded":"2024-04-24T13:33:06.761513+0000","last_fullsized":"2024-04-24T13:33:06.761513+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.659114+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:33:06.659114+0000","last_peered":"2024-04-24T13:33:06.659114+0000","last_clean":"2024-04-24T13:33:06.659114+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:33:06.659114+0000","last_undegraded":"2024-04-24T13:33:06.659114+0000","last_fullsized":"2024-04-24T13:33:06.659114+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763107+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:33:06.763107+0000","last_peered":"2024-04-24T13:33:06.763107+0000","last_clean":"2024-04-24T13:33:06.763107+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:33:06.763107+0000","last_undegraded":"2024-04-24T13:33:06.763107+0000","last_fullsized":"2024-04-24T13:33:06.763107+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"94'15","reported_seq":223,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763966+0000","last_change":"2024-04-24T13:32:00.572648+0000","last_active":"2024-04-24T13:33:06.763966+0000","last_peered":"2024-04-24T13:33:06.763966+0000","last_clean":"2024-04-24T13:33:06.763966+0000","last_became_active":"2024-04-24T13:32:00.572370+0000","last_became_peered":"2024-04-24T13:32:00.572370+0000","last_unstale":"2024-04-24T13:33:06.763966+0000","last_undegraded":"2024-04-24T13:33:06.763966+0000","last_fullsized":"2024-04-24T13:33:06.763966+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:03:27.828826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":70,"num_read_kb":66,"num_write":17,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"102'4","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703984+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:33:06.703984+0000","last_peered":"2024-04-24T13:33:06.703984+0000","last_clean":"2024-04-24T13:33:06.703984+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:33:06.703984+0000","last_undegraded":"2024-04-24T13:33:06.703984+0000","last_fullsized":"2024-04-24T13:33:06.703984+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":132,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762432+0000","last_change":"2024-04-24T13:30:50.937016+0000","last_active":"2024-04-24T13:33:06.762432+0000","last_peered":"2024-04-24T13:33:06.762432+0000","last_clean":"2024-04-24T13:33:06.762432+0000","last_became_active":"2024-04-24T13:30:50.934998+0000","last_became_peered":"2024-04-24T13:30:50.934998+0000","last_unstale":"2024-04-24T13:33:06.762432+0000","last_undegraded":"2024-04-24T13:33:06.762432+0000","last_fullsized":"2024-04-24T13:33:06.762432+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:42:03.696601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735883+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:33:06.735883+0000","last_peered":"2024-04-24T13:33:06.735883+0000","last_clean":"2024-04-24T13:33:06.735883+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:33:06.735883+0000","last_undegraded":"2024-04-24T13:33:06.735883+0000","last_fullsized":"2024-04-24T13:33:06.735883+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"32'14","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702678+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:33:06.702678+0000","last_peered":"2024-04-24T13:33:06.702678+0000","last_clean":"2024-04-24T13:33:06.702678+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:33:06.702678+0000","last_undegraded":"2024-04-24T13:33:06.702678+0000","last_fullsized":"2024-04-24T13:33:06.702678+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"94'105","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702755+0000","last_change":"2024-04-24T13:32:00.637531+0000","last_active":"2024-04-24T13:33:06.702755+0000","last_peered":"2024-04-24T13:33:06.702755+0000","last_clean":"2024-04-24T13:33:06.702755+0000","last_became_active":"2024-04-24T13:32:00.580902+0000","last_became_peered":"2024-04-24T13:32:00.580902+0000","last_unstale":"2024-04-24T13:33:06.702755+0000","last_undegraded":"2024-04-24T13:33:06.702755+0000","last_fullsized":"2024-04-24T13:33:06.702755+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":105,"log_dups_size":0,"ondisk_log_size":105,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:39.251312+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"81'1","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715320+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:33:06.715320+0000","last_peered":"2024-04-24T13:33:06.715320+0000","last_clean":"2024-04-24T13:33:06.715320+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:33:06.715320+0000","last_undegraded":"2024-04-24T13:33:06.715320+0000","last_fullsized":"2024-04-24T13:33:06.715320+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"82'2","reported_seq":126,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.645860+0000","last_change":"2024-04-24T13:31:01.035271+0000","last_active":"2024-04-24T13:33:06.645860+0000","last_peered":"2024-04-24T13:33:06.645860+0000","last_clean":"2024-04-24T13:33:06.645860+0000","last_became_active":"2024-04-24T13:31:01.034314+0000","last_became_peered":"2024-04-24T13:31:01.034314+0000","last_unstale":"2024-04-24T13:33:06.645860+0000","last_undegraded":"2024-04-24T13:33:06.645860+0000","last_fullsized":"2024-04-24T13:33:06.645860+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:45.074671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"102'10","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.228018+0000","last_change":"2024-04-24T13:30:50.913675+0000","last_active":"2024-04-24T13:33:07.228018+0000","last_peered":"2024-04-24T13:33:07.228018+0000","last_clean":"2024-04-24T13:33:07.228018+0000","last_became_active":"2024-04-24T13:30:50.912153+0000","last_became_peered":"2024-04-24T13:30:50.912153+0000","last_unstale":"2024-04-24T13:33:07.228018+0000","last_undegraded":"2024-04-24T13:33:07.228018+0000","last_fullsized":"2024-04-24T13:33:07.228018+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.808699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704961+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:33:06.704961+0000","last_peered":"2024-04-24T13:33:06.704961+0000","last_clean":"2024-04-24T13:33:06.704961+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:33:06.704961+0000","last_undegraded":"2024-04-24T13:33:06.704961+0000","last_fullsized":"2024-04-24T13:33:06.704961+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658502+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:33:06.658502+0000","last_peered":"2024-04-24T13:33:06.658502+0000","last_clean":"2024-04-24T13:33:06.658502+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:33:06.658502+0000","last_undegraded":"2024-04-24T13:33:06.658502+0000","last_fullsized":"2024-04-24T13:33:06.658502+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660427+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:33:06.660427+0000","last_peered":"2024-04-24T13:33:06.660427+0000","last_clean":"2024-04-24T13:33:06.660427+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:33:06.660427+0000","last_undegraded":"2024-04-24T13:33:06.660427+0000","last_fullsized":"2024-04-24T13:33:06.660427+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"94'104","reported_seq":290,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.711106+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:33:06.711106+0000","last_peered":"2024-04-24T13:33:06.711106+0000","last_clean":"2024-04-24T13:33:06.711106+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:33:06.711106+0000","last_undegraded":"2024-04-24T13:33:06.711106+0000","last_fullsized":"2024-04-24T13:33:06.711106+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"82'6","reported_seq":159,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762490+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:33:06.762490+0000","last_peered":"2024-04-24T13:33:06.762490+0000","last_clean":"2024-04-24T13:33:06.762490+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:33:06.762490+0000","last_undegraded":"2024-04-24T13:33:06.762490+0000","last_fullsized":"2024-04-24T13:33:06.762490+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"94'3","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657769+0000","last_change":"2024-04-24T13:32:00.573698+0000","last_active":"2024-04-24T13:33:06.657769+0000","last_peered":"2024-04-24T13:33:06.657769+0000","last_clean":"2024-04-24T13:33:06.657769+0000","last_became_active":"2024-04-24T13:32:00.572831+0000","last_became_peered":"2024-04-24T13:32:00.572831+0000","last_unstale":"2024-04-24T13:33:06.657769+0000","last_undegraded":"2024-04-24T13:33:06.657769+0000","last_fullsized":"2024-04-24T13:33:06.657769+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:37:38.611243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":3,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"102'10","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.368056+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:33:07.368056+0000","last_peered":"2024-04-24T13:33:07.368056+0000","last_clean":"2024-04-24T13:33:07.368056+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:33:07.368056+0000","last_undegraded":"2024-04-24T13:33:07.368056+0000","last_fullsized":"2024-04-24T13:33:07.368056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.739273+0000","last_change":"2024-04-24T13:30:50.937218+0000","last_active":"2024-04-24T13:33:06.739273+0000","last_peered":"2024-04-24T13:33:06.739273+0000","last_clean":"2024-04-24T13:33:06.739273+0000","last_became_active":"2024-04-24T13:30:50.936420+0000","last_became_peered":"2024-04-24T13:30:50.936420+0000","last_unstale":"2024-04-24T13:33:06.739273+0000","last_undegraded":"2024-04-24T13:33:06.739273+0000","last_fullsized":"2024-04-24T13:33:06.739273+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:08.910360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708635+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:33:06.708635+0000","last_peered":"2024-04-24T13:33:06.708635+0000","last_clean":"2024-04-24T13:33:06.708635+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:33:06.708635+0000","last_undegraded":"2024-04-24T13:33:06.708635+0000","last_fullsized":"2024-04-24T13:33:06.708635+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"86'34","reported_seq":217,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735657+0000","last_change":"2024-04-24T13:30:50.977698+0000","last_active":"2024-04-24T13:33:06.735657+0000","last_peered":"2024-04-24T13:33:06.735657+0000","last_clean":"2024-04-24T13:33:06.735657+0000","last_became_active":"2024-04-24T13:30:50.936955+0000","last_became_peered":"2024-04-24T13:30:50.936955+0000","last_unstale":"2024-04-24T13:33:06.735657+0000","last_undegraded":"2024-04-24T13:33:06.735657+0000","last_fullsized":"2024-04-24T13:33:06.735657+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:47.349331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708189+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:33:06.708189+0000","last_peered":"2024-04-24T13:33:06.708189+0000","last_clean":"2024-04-24T13:33:06.708189+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:33:06.708189+0000","last_undegraded":"2024-04-24T13:33:06.708189+0000","last_fullsized":"2024-04-24T13:33:06.708189+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"94'5","reported_seq":102,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647972+0000","last_change":"2024-04-24T13:32:00.565416+0000","last_active":"2024-04-24T13:33:06.647972+0000","last_peered":"2024-04-24T13:33:06.647972+0000","last_clean":"2024-04-24T13:33:06.647972+0000","last_became_active":"2024-04-24T13:32:00.565144+0000","last_became_peered":"2024-04-24T13:32:00.565144+0000","last_unstale":"2024-04-24T13:33:06.647972+0000","last_undegraded":"2024-04-24T13:33:06.647972+0000","last_fullsized":"2024-04-24T13:33:06.647972+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":194,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"82'2","reported_seq":160,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762793+0000","last_change":"2024-04-24T13:32:00.592514+0000","last_active":"2024-04-24T13:33:06.762793+0000","last_peered":"2024-04-24T13:33:06.762793+0000","last_clean":"2024-04-24T13:33:06.762793+0000","last_became_active":"2024-04-24T13:32:00.591877+0000","last_became_peered":"2024-04-24T13:32:00.591877+0000","last_unstale":"2024-04-24T13:33:06.762793+0000","last_undegraded":"2024-04-24T13:33:06.762793+0000","last_fullsized":"2024-04-24T13:33:06.762793+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:14:57.431228+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"82'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658086+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:33:06.658086+0000","last_peered":"2024-04-24T13:33:06.658086+0000","last_clean":"2024-04-24T13:33:06.658086+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:33:06.658086+0000","last_undegraded":"2024-04-24T13:33:06.658086+0000","last_fullsized":"2024-04-24T13:33:06.658086+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"102'14","reported_seq":130,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646815+0000","last_change":"2024-04-24T13:31:00.986151+0000","last_active":"2024-04-24T13:33:06.646815+0000","last_peered":"2024-04-24T13:33:06.646815+0000","last_clean":"2024-04-24T13:33:06.646815+0000","last_became_active":"2024-04-24T13:31:00.985421+0000","last_became_peered":"2024-04-24T13:31:00.985421+0000","last_unstale":"2024-04-24T13:33:06.646815+0000","last_undegraded":"2024-04-24T13:33:06.646815+0000","last_fullsized":"2024-04-24T13:33:06.646815+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:42.662404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":243,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704047+0000","last_change":"2024-04-24T13:32:00.636177+0000","last_active":"2024-04-24T13:33:06.704047+0000","last_peered":"2024-04-24T13:33:06.704047+0000","last_clean":"2024-04-24T13:33:06.704047+0000","last_became_active":"2024-04-24T13:32:00.580888+0000","last_became_peered":"2024-04-24T13:32:00.580888+0000","last_unstale":"2024-04-24T13:33:06.704047+0000","last_undegraded":"2024-04-24T13:33:06.704047+0000","last_fullsized":"2024-04-24T13:33:06.704047+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:21:21.951639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":436,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"86'17","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708024+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:33:06.708024+0000","last_peered":"2024-04-24T13:33:06.708024+0000","last_clean":"2024-04-24T13:33:06.708024+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:33:06.708024+0000","last_undegraded":"2024-04-24T13:33:06.708024+0000","last_fullsized":"2024-04-24T13:33:06.708024+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708790+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:33:06.708790+0000","last_peered":"2024-04-24T13:33:06.708790+0000","last_clean":"2024-04-24T13:33:06.708790+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:33:06.708790+0000","last_undegraded":"2024-04-24T13:33:06.708790+0000","last_fullsized":"2024-04-24T13:33:06.708790+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.714832+0000","last_change":"2024-04-24T13:30:50.930475+0000","last_active":"2024-04-24T13:33:06.714832+0000","last_peered":"2024-04-24T13:33:06.714832+0000","last_clean":"2024-04-24T13:33:06.714832+0000","last_became_active":"2024-04-24T13:30:50.929905+0000","last_became_peered":"2024-04-24T13:30:50.929905+0000","last_unstale":"2024-04-24T13:33:06.714832+0000","last_undegraded":"2024-04-24T13:33:06.714832+0000","last_fullsized":"2024-04-24T13:33:06.714832+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:41.257023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703142+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:33:06.703142+0000","last_peered":"2024-04-24T13:33:06.703142+0000","last_clean":"2024-04-24T13:33:06.703142+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:33:06.703142+0000","last_undegraded":"2024-04-24T13:33:06.703142+0000","last_fullsized":"2024-04-24T13:33:06.703142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"101'6","reported_seq":134,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710861+0000","last_change":"2024-04-24T13:30:50.931263+0000","last_active":"2024-04-24T13:33:06.710861+0000","last_peered":"2024-04-24T13:33:06.710861+0000","last_clean":"2024-04-24T13:33:06.710861+0000","last_became_active":"2024-04-24T13:30:50.929683+0000","last_became_peered":"2024-04-24T13:30:50.929683+0000","last_unstale":"2024-04-24T13:33:06.710861+0000","last_undegraded":"2024-04-24T13:33:06.710861+0000","last_fullsized":"2024-04-24T13:33:06.710861+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:28:57.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":162,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710601+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:33:06.710601+0000","last_peered":"2024-04-24T13:33:06.710601+0000","last_clean":"2024-04-24T13:33:06.710601+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:33:06.710601+0000","last_undegraded":"2024-04-24T13:33:06.710601+0000","last_fullsized":"2024-04-24T13:33:06.710601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"97'7","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761633+0000","last_change":"2024-04-24T13:32:00.625842+0000","last_active":"2024-04-24T13:33:06.761633+0000","last_peered":"2024-04-24T13:33:06.761633+0000","last_clean":"2024-04-24T13:33:06.761633+0000","last_became_active":"2024-04-24T13:32:00.571509+0000","last_became_peered":"2024-04-24T13:32:00.571509+0000","last_unstale":"2024-04-24T13:33:06.761633+0000","last_undegraded":"2024-04-24T13:33:06.761633+0000","last_fullsized":"2024-04-24T13:33:06.761633+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:46.222754+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":24,"num_write_kb":20,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":129,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735472+0000","last_change":"2024-04-24T13:30:50.924952+0000","last_active":"2024-04-24T13:33:06.735472+0000","last_peered":"2024-04-24T13:33:06.735472+0000","last_clean":"2024-04-24T13:33:06.735472+0000","last_became_active":"2024-04-24T13:30:50.923933+0000","last_became_peered":"2024-04-24T13:30:50.923933+0000","last_unstale":"2024-04-24T13:33:06.735472+0000","last_undegraded":"2024-04-24T13:33:06.735472+0000","last_fullsized":"2024-04-24T13:33:06.735472+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:17.479670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"82'4","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762097+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:33:06.762097+0000","last_peered":"2024-04-24T13:33:06.762097+0000","last_clean":"2024-04-24T13:33:06.762097+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:33:06.762097+0000","last_undegraded":"2024-04-24T13:33:06.762097+0000","last_fullsized":"2024-04-24T13:33:06.762097+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"82'4","reported_seq":187,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708427+0000","last_change":"2024-04-24T13:30:50.925917+0000","last_active":"2024-04-24T13:33:06.708427+0000","last_peered":"2024-04-24T13:33:06.708427+0000","last_clean":"2024-04-24T13:33:06.708427+0000","last_became_active":"2024-04-24T13:30:50.925580+0000","last_became_peered":"2024-04-24T13:30:50.925580+0000","last_unstale":"2024-04-24T13:33:06.708427+0000","last_undegraded":"2024-04-24T13:33:06.708427+0000","last_fullsized":"2024-04-24T13:33:06.708427+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"101'5","reported_seq":118,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704513+0000","last_change":"2024-04-24T13:32:00.578777+0000","last_active":"2024-04-24T13:33:06.704513+0000","last_peered":"2024-04-24T13:33:06.704513+0000","last_clean":"2024-04-24T13:33:06.704513+0000","last_became_active":"2024-04-24T13:32:00.578382+0000","last_became_peered":"2024-04-24T13:32:00.578382+0000","last_unstale":"2024-04-24T13:33:06.704513+0000","last_undegraded":"2024-04-24T13:33:06.704513+0000","last_fullsized":"2024-04-24T13:33:06.704513+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:42:09.741845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":130,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657106+0000","last_change":"2024-04-24T13:30:50.934577+0000","last_active":"2024-04-24T13:33:06.657106+0000","last_peered":"2024-04-24T13:33:06.657106+0000","last_clean":"2024-04-24T13:33:06.657106+0000","last_became_active":"2024-04-24T13:30:50.931559+0000","last_became_peered":"2024-04-24T13:30:50.931559+0000","last_unstale":"2024-04-24T13:33:06.657106+0000","last_undegraded":"2024-04-24T13:33:06.657106+0000","last_fullsized":"2024-04-24T13:33:06.657106+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:35.372215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"86'17","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710491+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:33:06.710491+0000","last_peered":"2024-04-24T13:33:06.710491+0000","last_clean":"2024-04-24T13:33:06.710491+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:33:06.710491+0000","last_undegraded":"2024-04-24T13:33:06.710491+0000","last_fullsized":"2024-04-24T13:33:06.710491+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":153,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.736137+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:33:06.736137+0000","last_peered":"2024-04-24T13:33:06.736137+0000","last_clean":"2024-04-24T13:33:06.736137+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:33:06.736137+0000","last_undegraded":"2024-04-24T13:33:06.736137+0000","last_fullsized":"2024-04-24T13:33:06.736137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":93,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658299+0000","last_change":"2024-04-24T13:32:00.574788+0000","last_active":"2024-04-24T13:33:06.658299+0000","last_peered":"2024-04-24T13:33:06.658299+0000","last_clean":"2024-04-24T13:33:06.658299+0000","last_became_active":"2024-04-24T13:32:00.574001+0000","last_became_peered":"2024-04-24T13:32:00.574001+0000","last_unstale":"2024-04-24T13:33:06.658299+0000","last_undegraded":"2024-04-24T13:33:06.658299+0000","last_fullsized":"2024-04-24T13:33:06.658299+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:39:57.430952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708431+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:33:06.708431+0000","last_peered":"2024-04-24T13:33:06.708431+0000","last_clean":"2024-04-24T13:33:06.708431+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:33:06.708431+0000","last_undegraded":"2024-04-24T13:33:06.708431+0000","last_fullsized":"2024-04-24T13:33:06.708431+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"102'8","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.150842+0000","last_change":"2024-04-24T13:32:00.592734+0000","last_active":"2024-04-24T13:33:07.150842+0000","last_peered":"2024-04-24T13:33:07.150842+0000","last_clean":"2024-04-24T13:33:07.150842+0000","last_became_active":"2024-04-24T13:32:00.592231+0000","last_became_peered":"2024-04-24T13:32:00.592231+0000","last_unstale":"2024-04-24T13:33:07.150842+0000","last_undegraded":"2024-04-24T13:33:07.150842+0000","last_fullsized":"2024-04-24T13:33:07.150842+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:23:36.838218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.736442+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:33:06.736442+0000","last_peered":"2024-04-24T13:33:06.736442+0000","last_clean":"2024-04-24T13:33:06.736442+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:33:06.736442+0000","last_undegraded":"2024-04-24T13:33:06.736442+0000","last_fullsized":"2024-04-24T13:33:06.736442+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"86'15","reported_seq":181,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646743+0000","last_change":"2024-04-24T13:30:50.981989+0000","last_active":"2024-04-24T13:33:06.646743+0000","last_peered":"2024-04-24T13:33:06.646743+0000","last_clean":"2024-04-24T13:33:06.646743+0000","last_became_active":"2024-04-24T13:30:50.939707+0000","last_became_peered":"2024-04-24T13:30:50.939707+0000","last_unstale":"2024-04-24T13:33:06.646743+0000","last_undegraded":"2024-04-24T13:33:06.646743+0000","last_fullsized":"2024-04-24T13:33:06.646743+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:38.379316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":160,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761807+0000","last_change":"2024-04-24T13:30:50.935071+0000","last_active":"2024-04-24T13:33:06.761807+0000","last_peered":"2024-04-24T13:33:06.761807+0000","last_clean":"2024-04-24T13:33:06.761807+0000","last_became_active":"2024-04-24T13:30:50.934309+0000","last_became_peered":"2024-04-24T13:30:50.934309+0000","last_unstale":"2024-04-24T13:33:06.761807+0000","last_undegraded":"2024-04-24T13:33:06.761807+0000","last_fullsized":"2024-04-24T13:33:06.761807+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:51.520511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"82'8","reported_seq":201,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.738463+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:33:06.738463+0000","last_peered":"2024-04-24T13:33:06.738463+0000","last_clean":"2024-04-24T13:33:06.738463+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:33:06.738463+0000","last_undegraded":"2024-04-24T13:33:06.738463+0000","last_fullsized":"2024-04-24T13:33:06.738463+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"102'7","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708254+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:33:06.708254+0000","last_peered":"2024-04-24T13:33:06.708254+0000","last_clean":"2024-04-24T13:33:06.708254+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:33:06.708254+0000","last_undegraded":"2024-04-24T13:33:06.708254+0000","last_fullsized":"2024-04-24T13:33:06.708254+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":168,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762843+0000","last_change":"2024-04-24T13:30:50.921993+0000","last_active":"2024-04-24T13:33:06.762843+0000","last_peered":"2024-04-24T13:33:06.762843+0000","last_clean":"2024-04-24T13:33:06.762843+0000","last_became_active":"2024-04-24T13:30:50.921257+0000","last_became_peered":"2024-04-24T13:30:50.921257+0000","last_unstale":"2024-04-24T13:33:06.762843+0000","last_undegraded":"2024-04-24T13:33:06.762843+0000","last_fullsized":"2024-04-24T13:33:06.762843+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:58.034297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"86'22","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703650+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:33:06.703650+0000","last_peered":"2024-04-24T13:33:06.703650+0000","last_clean":"2024-04-24T13:33:06.703650+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:33:06.703650+0000","last_undegraded":"2024-04-24T13:33:06.703650+0000","last_fullsized":"2024-04-24T13:33:06.703650+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":64,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710556+0000","last_change":"2024-04-24T13:32:00.575641+0000","last_active":"2024-04-24T13:33:06.710556+0000","last_peered":"2024-04-24T13:33:06.710556+0000","last_clean":"2024-04-24T13:33:06.710556+0000","last_became_active":"2024-04-24T13:32:00.575032+0000","last_became_peered":"2024-04-24T13:32:00.575032+0000","last_unstale":"2024-04-24T13:33:06.710556+0000","last_undegraded":"2024-04-24T13:33:06.710556+0000","last_fullsized":"2024-04-24T13:33:06.710556+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:32.950981+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710365+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:33:06.710365+0000","last_peered":"2024-04-24T13:33:06.710365+0000","last_clean":"2024-04-24T13:33:06.710365+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:33:06.710365+0000","last_undegraded":"2024-04-24T13:33:06.710365+0000","last_fullsized":"2024-04-24T13:33:06.710365+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"86'6","reported_seq":197,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762675+0000","last_change":"2024-04-24T13:30:50.917948+0000","last_active":"2024-04-24T13:33:06.762675+0000","last_peered":"2024-04-24T13:33:06.762675+0000","last_clean":"2024-04-24T13:33:06.762675+0000","last_became_active":"2024-04-24T13:30:50.917339+0000","last_became_peered":"2024-04-24T13:30:50.917339+0000","last_unstale":"2024-04-24T13:33:06.762675+0000","last_undegraded":"2024-04-24T13:33:06.762675+0000","last_fullsized":"2024-04-24T13:33:06.762675+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:36:03.041606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"101'6","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703335+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:33:06.703335+0000","last_peered":"2024-04-24T13:33:06.703335+0000","last_clean":"2024-04-24T13:33:06.703335+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:33:06.703335+0000","last_undegraded":"2024-04-24T13:33:06.703335+0000","last_fullsized":"2024-04-24T13:33:06.703335+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":161,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.738326+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:33:06.738326+0000","last_peered":"2024-04-24T13:33:06.738326+0000","last_clean":"2024-04-24T13:33:06.738326+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:33:06.738326+0000","last_undegraded":"2024-04-24T13:33:06.738326+0000","last_fullsized":"2024-04-24T13:33:06.738326+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"86'20","reported_seq":131,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648235+0000","last_change":"2024-04-24T13:32:00.630779+0000","last_active":"2024-04-24T13:33:06.648235+0000","last_peered":"2024-04-24T13:33:06.648235+0000","last_clean":"2024-04-24T13:33:06.648235+0000","last_became_active":"2024-04-24T13:32:00.580437+0000","last_became_peered":"2024-04-24T13:32:00.580437+0000","last_unstale":"2024-04-24T13:33:06.648235+0000","last_undegraded":"2024-04-24T13:33:06.648235+0000","last_fullsized":"2024-04-24T13:33:06.648235+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:18.907583+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":156,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703750+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:33:06.703750+0000","last_peered":"2024-04-24T13:33:06.703750+0000","last_clean":"2024-04-24T13:33:06.703750+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:33:06.703750+0000","last_undegraded":"2024-04-24T13:33:06.703750+0000","last_fullsized":"2024-04-24T13:33:06.703750+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":154,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.736721+0000","last_change":"2024-04-24T13:30:50.937377+0000","last_active":"2024-04-24T13:33:06.736721+0000","last_peered":"2024-04-24T13:33:06.736721+0000","last_clean":"2024-04-24T13:33:06.736721+0000","last_became_active":"2024-04-24T13:30:50.936540+0000","last_became_peered":"2024-04-24T13:30:50.936540+0000","last_unstale":"2024-04-24T13:33:06.736721+0000","last_undegraded":"2024-04-24T13:33:06.736721+0000","last_fullsized":"2024-04-24T13:33:06.736721+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:44.053660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.714142+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:33:06.714142+0000","last_peered":"2024-04-24T13:33:06.714142+0000","last_clean":"2024-04-24T13:33:06.714142+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:33:06.714142+0000","last_undegraded":"2024-04-24T13:33:06.714142+0000","last_fullsized":"2024-04-24T13:33:06.714142+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"101'3","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660968+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:33:06.660968+0000","last_peered":"2024-04-24T13:33:06.660968+0000","last_clean":"2024-04-24T13:33:06.660968+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:33:06.660968+0000","last_undegraded":"2024-04-24T13:33:06.660968+0000","last_fullsized":"2024-04-24T13:33:06.660968+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":12582912,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":3,"num_write_kb":12288,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660975+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:33:06.660975+0000","last_peered":"2024-04-24T13:33:06.660975+0000","last_clean":"2024-04-24T13:33:06.660975+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:33:06.660975+0000","last_undegraded":"2024-04-24T13:33:06.660975+0000","last_fullsized":"2024-04-24T13:33:06.660975+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"86'17","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715469+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:33:06.715469+0000","last_peered":"2024-04-24T13:33:06.715469+0000","last_clean":"2024-04-24T13:33:06.715469+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:33:06.715469+0000","last_undegraded":"2024-04-24T13:33:06.715469+0000","last_fullsized":"2024-04-24T13:33:06.715469+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":156,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704197+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:33:06.704197+0000","last_peered":"2024-04-24T13:33:06.704197+0000","last_clean":"2024-04-24T13:33:06.704197+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:33:06.704197+0000","last_undegraded":"2024-04-24T13:33:06.704197+0000","last_fullsized":"2024-04-24T13:33:06.704197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":157,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647215+0000","last_change":"2024-04-24T13:30:50.929993+0000","last_active":"2024-04-24T13:33:06.647215+0000","last_peered":"2024-04-24T13:33:06.647215+0000","last_clean":"2024-04-24T13:33:06.647215+0000","last_became_active":"2024-04-24T13:30:50.929169+0000","last_became_peered":"2024-04-24T13:30:50.929169+0000","last_unstale":"2024-04-24T13:33:06.647215+0000","last_undegraded":"2024-04-24T13:33:06.647215+0000","last_fullsized":"2024-04-24T13:33:06.647215+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:57.047113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648499+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:33:06.648499+0000","last_peered":"2024-04-24T13:33:06.648499+0000","last_clean":"2024-04-24T13:33:06.648499+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:33:06.648499+0000","last_undegraded":"2024-04-24T13:33:06.648499+0000","last_fullsized":"2024-04-24T13:33:06.648499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"102'7","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762114+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:33:06.762114+0000","last_peered":"2024-04-24T13:33:06.762114+0000","last_clean":"2024-04-24T13:33:06.762114+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:33:06.762114+0000","last_undegraded":"2024-04-24T13:33:06.762114+0000","last_fullsized":"2024-04-24T13:33:06.762114+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":164,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704286+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:33:06.704286+0000","last_peered":"2024-04-24T13:33:06.704286+0000","last_clean":"2024-04-24T13:33:06.704286+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:33:06.704286+0000","last_undegraded":"2024-04-24T13:33:06.704286+0000","last_fullsized":"2024-04-24T13:33:06.704286+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658988+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:33:06.658988+0000","last_peered":"2024-04-24T13:33:06.658988+0000","last_clean":"2024-04-24T13:33:06.658988+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:33:06.658988+0000","last_undegraded":"2024-04-24T13:33:06.658988+0000","last_fullsized":"2024-04-24T13:33:06.658988+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"94'104","reported_seq":289,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737165+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:33:06.737165+0000","last_peered":"2024-04-24T13:33:06.737165+0000","last_clean":"2024-04-24T13:33:06.737165+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:33:06.737165+0000","last_undegraded":"2024-04-24T13:33:06.737165+0000","last_fullsized":"2024-04-24T13:33:06.737165+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":104,"log_dups_size":0,"ondisk_log_size":104,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"82'6","reported_seq":76,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.656716+0000","last_change":"2024-04-24T13:32:00.561720+0000","last_active":"2024-04-24T13:33:06.656716+0000","last_peered":"2024-04-24T13:33:06.656716+0000","last_clean":"2024-04-24T13:33:06.656716+0000","last_became_active":"2024-04-24T13:32:00.560052+0000","last_became_peered":"2024-04-24T13:32:00.560052+0000","last_unstale":"2024-04-24T13:33:06.656716+0000","last_undegraded":"2024-04-24T13:33:06.656716+0000","last_fullsized":"2024-04-24T13:33:06.656716+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:40:13.263017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.1b","version":"86'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657791+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:33:06.657791+0000","last_peered":"2024-04-24T13:33:06.657791+0000","last_clean":"2024-04-24T13:33:06.657791+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:33:06.657791+0000","last_undegraded":"2024-04-24T13:33:06.657791+0000","last_fullsized":"2024-04-24T13:33:06.657791+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"102'10","reported_seq":75,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.729955+0000","last_change":"2024-04-24T13:32:00.571666+0000","last_active":"2024-04-24T13:33:06.729955+0000","last_peered":"2024-04-24T13:33:06.729955+0000","last_clean":"2024-04-24T13:33:06.729955+0000","last_became_active":"2024-04-24T13:32:00.567566+0000","last_became_peered":"2024-04-24T13:32:00.567566+0000","last_unstale":"2024-04-24T13:33:06.729955+0000","last_undegraded":"2024-04-24T13:33:06.729955+0000","last_fullsized":"2024-04-24T13:33:06.729955+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:48.037961+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":39845888,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":38912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":130,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657687+0000","last_change":"2024-04-24T13:30:50.927331+0000","last_active":"2024-04-24T13:33:06.657687+0000","last_peered":"2024-04-24T13:33:06.657687+0000","last_clean":"2024-04-24T13:33:06.657687+0000","last_became_active":"2024-04-24T13:30:50.926529+0000","last_became_peered":"2024-04-24T13:30:50.926529+0000","last_unstale":"2024-04-24T13:33:06.657687+0000","last_undegraded":"2024-04-24T13:33:06.657687+0000","last_fullsized":"2024-04-24T13:33:06.657687+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:23.529403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"86'22","reported_seq":131,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702672+0000","last_change":"2024-04-24T13:32:00.601926+0000","last_active":"2024-04-24T13:33:06.702672+0000","last_peered":"2024-04-24T13:33:06.702672+0000","last_clean":"2024-04-24T13:33:06.702672+0000","last_became_active":"2024-04-24T13:32:00.580179+0000","last_became_peered":"2024-04-24T13:32:00.580179+0000","last_unstale":"2024-04-24T13:33:06.702672+0000","last_undegraded":"2024-04-24T13:33:06.702672+0000","last_fullsized":"2024-04-24T13:33:06.702672+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:40:02.410886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763845+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:33:06.763845+0000","last_peered":"2024-04-24T13:33:06.763845+0000","last_clean":"2024-04-24T13:33:06.763845+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:33:06.763845+0000","last_undegraded":"2024-04-24T13:33:06.763845+0000","last_fullsized":"2024-04-24T13:33:06.763845+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":131,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762659+0000","last_change":"2024-04-24T13:30:50.922108+0000","last_active":"2024-04-24T13:33:06.762659+0000","last_peered":"2024-04-24T13:33:06.762659+0000","last_clean":"2024-04-24T13:33:06.762659+0000","last_became_active":"2024-04-24T13:30:50.921514+0000","last_became_peered":"2024-04-24T13:30:50.921514+0000","last_unstale":"2024-04-24T13:33:06.762659+0000","last_undegraded":"2024-04-24T13:33:06.762659+0000","last_fullsized":"2024-04-24T13:33:06.762659+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:05.867839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"94'5","reported_seq":47,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735012+0000","last_change":"2024-04-24T13:32:32.751387+0000","last_active":"2024-04-24T13:33:06.735012+0000","last_peered":"2024-04-24T13:33:06.735012+0000","last_clean":"2024-04-24T13:33:06.735012+0000","last_became_active":"2024-04-24T13:32:32.741990+0000","last_became_peered":"2024-04-24T13:32:32.741990+0000","last_unstale":"2024-04-24T13:33:06.735012+0000","last_undegraded":"2024-04-24T13:33:06.735012+0000","last_fullsized":"2024-04-24T13:33:06.735012+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:49.789798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"102'6","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.854238+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:33:06.854238+0000","last_peered":"2024-04-24T13:33:06.854238+0000","last_clean":"2024-04-24T13:33:06.854238+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:33:06.854238+0000","last_undegraded":"2024-04-24T13:33:06.854238+0000","last_fullsized":"2024-04-24T13:33:06.854238+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":65,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.764165+0000","last_change":"2024-04-24T13:32:00.595272+0000","last_active":"2024-04-24T13:33:06.764165+0000","last_peered":"2024-04-24T13:33:06.764165+0000","last_clean":"2024-04-24T13:33:06.764165+0000","last_became_active":"2024-04-24T13:32:00.593617+0000","last_became_peered":"2024-04-24T13:32:00.593617+0000","last_unstale":"2024-04-24T13:33:06.764165+0000","last_undegraded":"2024-04-24T13:33:06.764165+0000","last_fullsized":"2024-04-24T13:33:06.764165+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:53:23.482374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.18","version":"86'14","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762294+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:33:06.762294+0000","last_peered":"2024-04-24T13:33:06.762294+0000","last_clean":"2024-04-24T13:33:06.762294+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:33:06.762294+0000","last_undegraded":"2024-04-24T13:33:06.762294+0000","last_fullsized":"2024-04-24T13:33:06.762294+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":158,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735612+0000","last_change":"2024-04-24T13:30:50.938940+0000","last_active":"2024-04-24T13:33:06.735612+0000","last_peered":"2024-04-24T13:33:06.735612+0000","last_clean":"2024-04-24T13:33:06.735612+0000","last_became_active":"2024-04-24T13:30:50.936355+0000","last_became_peered":"2024-04-24T13:30:50.936355+0000","last_unstale":"2024-04-24T13:33:06.735612+0000","last_undegraded":"2024-04-24T13:33:06.735612+0000","last_fullsized":"2024-04-24T13:33:06.735612+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":150,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.714938+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:33:06.714938+0000","last_peered":"2024-04-24T13:33:06.714938+0000","last_clean":"2024-04-24T13:33:06.714938+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:33:06.714938+0000","last_undegraded":"2024-04-24T13:33:06.714938+0000","last_fullsized":"2024-04-24T13:33:06.714938+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"94'9","reported_seq":140,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647279+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:33:06.647279+0000","last_peered":"2024-04-24T13:33:06.647279+0000","last_clean":"2024-04-24T13:33:06.647279+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:33:06.647279+0000","last_undegraded":"2024-04-24T13:33:06.647279+0000","last_fullsized":"2024-04-24T13:33:06.647279+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":37,"num_read_kb":33,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"101'8","reported_seq":178,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.715466+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:33:06.715466+0000","last_peered":"2024-04-24T13:33:06.715466+0000","last_clean":"2024-04-24T13:33:06.715466+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:33:06.715466+0000","last_undegraded":"2024-04-24T13:33:06.715466+0000","last_fullsized":"2024-04-24T13:33:06.715466+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":163,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658266+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:33:06.658266+0000","last_peered":"2024-04-24T13:33:06.658266+0000","last_clean":"2024-04-24T13:33:06.658266+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:33:06.658266+0000","last_undegraded":"2024-04-24T13:33:06.658266+0000","last_fullsized":"2024-04-24T13:33:06.658266+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"86'10","reported_seq":73,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.647254+0000","last_change":"2024-04-24T13:32:01.553569+0000","last_active":"2024-04-24T13:33:06.647254+0000","last_peered":"2024-04-24T13:33:06.647254+0000","last_clean":"2024-04-24T13:33:06.647254+0000","last_became_active":"2024-04-24T13:32:01.547833+0000","last_became_peered":"2024-04-24T13:32:01.547833+0000","last_unstale":"2024-04-24T13:33:06.647254+0000","last_undegraded":"2024-04-24T13:33:06.647254+0000","last_fullsized":"2024-04-24T13:33:06.647254+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:10.789162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657443+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:33:06.657443+0000","last_peered":"2024-04-24T13:33:06.657443+0000","last_clean":"2024-04-24T13:33:06.657443+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:33:06.657443+0000","last_undegraded":"2024-04-24T13:33:06.657443+0000","last_fullsized":"2024-04-24T13:33:06.657443+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"82'2","reported_seq":134,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.703877+0000","last_change":"2024-04-24T13:30:50.939033+0000","last_active":"2024-04-24T13:33:06.703877+0000","last_peered":"2024-04-24T13:33:06.703877+0000","last_clean":"2024-04-24T13:33:06.703877+0000","last_became_active":"2024-04-24T13:30:50.938747+0000","last_became_peered":"2024-04-24T13:30:50.938747+0000","last_unstale":"2024-04-24T13:33:06.703877+0000","last_undegraded":"2024-04-24T13:33:06.703877+0000","last_fullsized":"2024-04-24T13:33:06.703877+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:48.546868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"82'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657949+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:33:06.657949+0000","last_peered":"2024-04-24T13:33:06.657949+0000","last_clean":"2024-04-24T13:33:06.657949+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:33:06.657949+0000","last_undegraded":"2024-04-24T13:33:06.657949+0000","last_fullsized":"2024-04-24T13:33:06.657949+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"102'4","reported_seq":68,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762600+0000","last_change":"2024-04-24T13:32:00.572057+0000","last_active":"2024-04-24T13:33:06.762600+0000","last_peered":"2024-04-24T13:33:06.762600+0000","last_clean":"2024-04-24T13:33:06.762600+0000","last_became_active":"2024-04-24T13:32:00.568612+0000","last_became_peered":"2024-04-24T13:32:00.568612+0000","last_unstale":"2024-04-24T13:33:06.762600+0000","last_undegraded":"2024-04-24T13:33:06.762600+0000","last_fullsized":"2024-04-24T13:33:06.762600+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:49.615982+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":174,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.702798+0000","last_change":"2024-04-24T13:32:00.574968+0000","last_active":"2024-04-24T13:33:06.702798+0000","last_peered":"2024-04-24T13:33:06.702798+0000","last_clean":"2024-04-24T13:33:06.702798+0000","last_became_active":"2024-04-24T13:32:00.555407+0000","last_became_peered":"2024-04-24T13:32:00.555407+0000","last_unstale":"2024-04-24T13:33:06.702798+0000","last_undegraded":"2024-04-24T13:33:06.702798+0000","last_fullsized":"2024-04-24T13:33:06.702798+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:47.488688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":46,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"86'14","reported_seq":195,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658079+0000","last_change":"2024-04-24T13:32:00.610501+0000","last_active":"2024-04-24T13:33:06.658079+0000","last_peered":"2024-04-24T13:33:06.658079+0000","last_clean":"2024-04-24T13:33:06.658079+0000","last_became_active":"2024-04-24T13:32:00.562130+0000","last_became_peered":"2024-04-24T13:32:00.562130+0000","last_unstale":"2024-04-24T13:33:06.658079+0000","last_undegraded":"2024-04-24T13:33:06.658079+0000","last_fullsized":"2024-04-24T13:33:06.658079+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:24:47.214366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":155,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761785+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:33:06.761785+0000","last_peered":"2024-04-24T13:33:06.761785+0000","last_clean":"2024-04-24T13:33:06.761785+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:33:06.761785+0000","last_undegraded":"2024-04-24T13:33:06.761785+0000","last_fullsized":"2024-04-24T13:33:06.761785+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":151,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.657525+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:33:06.657525+0000","last_peered":"2024-04-24T13:33:06.657525+0000","last_clean":"2024-04-24T13:33:06.657525+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:33:06.657525+0000","last_undegraded":"2024-04-24T13:33:06.657525+0000","last_fullsized":"2024-04-24T13:33:06.657525+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"82'6","reported_seq":192,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.705565+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:33:06.705565+0000","last_peered":"2024-04-24T13:33:06.705565+0000","last_clean":"2024-04-24T13:33:06.705565+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:33:06.705565+0000","last_undegraded":"2024-04-24T13:33:06.705565+0000","last_fullsized":"2024-04-24T13:33:06.705565+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"101'6","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735446+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:33:06.735446+0000","last_peered":"2024-04-24T13:33:06.735446+0000","last_clean":"2024-04-24T13:33:06.735446+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:33:06.735446+0000","last_undegraded":"2024-04-24T13:33:06.735446+0000","last_fullsized":"2024-04-24T13:33:06.735446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"94'7","reported_seq":197,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704689+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:33:06.704689+0000","last_peered":"2024-04-24T13:33:06.704689+0000","last_clean":"2024-04-24T13:33:06.704689+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:33:06.704689+0000","last_undegraded":"2024-04-24T13:33:06.704689+0000","last_fullsized":"2024-04-24T13:33:06.704689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":34,"num_read_kb":34,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"101'7","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.646095+0000","last_change":"2024-04-24T13:32:00.566015+0000","last_active":"2024-04-24T13:33:06.646095+0000","last_peered":"2024-04-24T13:33:06.646095+0000","last_clean":"2024-04-24T13:33:06.646095+0000","last_became_active":"2024-04-24T13:32:00.552968+0000","last_became_peered":"2024-04-24T13:32:00.552968+0000","last_unstale":"2024-04-24T13:33:06.646095+0000","last_undegraded":"2024-04-24T13:33:06.646095+0000","last_fullsized":"2024-04-24T13:33:06.646095+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:26:58.476605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"82'2","reported_seq":116,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710752+0000","last_change":"2024-04-24T13:32:00.596572+0000","last_active":"2024-04-24T13:33:06.710752+0000","last_peered":"2024-04-24T13:33:06.710752+0000","last_clean":"2024-04-24T13:33:06.710752+0000","last_became_active":"2024-04-24T13:32:00.596100+0000","last_became_peered":"2024-04-24T13:32:00.596100+0000","last_unstale":"2024-04-24T13:33:06.710752+0000","last_undegraded":"2024-04-24T13:33:06.710752+0000","last_fullsized":"2024-04-24T13:33:06.710752+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:34.128346+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"102'11","reported_seq":75,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.947589+0000","last_change":"2024-04-24T13:32:00.592288+0000","last_active":"2024-04-24T13:33:06.947589+0000","last_peered":"2024-04-24T13:33:06.947589+0000","last_clean":"2024-04-24T13:33:06.947589+0000","last_became_active":"2024-04-24T13:32:00.592025+0000","last_became_peered":"2024-04-24T13:32:00.592025+0000","last_unstale":"2024-04-24T13:33:06.947589+0000","last_undegraded":"2024-04-24T13:33:06.947589+0000","last_fullsized":"2024-04-24T13:33:06.947589+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:15.691070+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"94'1","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.704179+0000","last_change":"2024-04-24T13:30:50.918913+0000","last_active":"2024-04-24T13:33:06.704179+0000","last_peered":"2024-04-24T13:33:06.704179+0000","last_clean":"2024-04-24T13:33:06.704179+0000","last_became_active":"2024-04-24T13:30:50.918221+0000","last_became_peered":"2024-04-24T13:30:50.918221+0000","last_unstale":"2024-04-24T13:33:06.704179+0000","last_undegraded":"2024-04-24T13:33:06.704179+0000","last_fullsized":"2024-04-24T13:33:06.704179+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:43.128644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"102'12","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762039+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:33:06.762039+0000","last_peered":"2024-04-24T13:33:06.762039+0000","last_clean":"2024-04-24T13:33:06.762039+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:33:06.762039+0000","last_undegraded":"2024-04-24T13:33:06.762039+0000","last_fullsized":"2024-04-24T13:33:06.762039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"82'2","reported_seq":179,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710774+0000","last_change":"2024-04-24T13:30:50.926509+0000","last_active":"2024-04-24T13:33:06.710774+0000","last_peered":"2024-04-24T13:33:06.710774+0000","last_clean":"2024-04-24T13:33:06.710774+0000","last_became_active":"2024-04-24T13:30:50.925894+0000","last_became_peered":"2024-04-24T13:30:50.925894+0000","last_unstale":"2024-04-24T13:33:06.710774+0000","last_undegraded":"2024-04-24T13:33:06.710774+0000","last_fullsized":"2024-04-24T13:33:06.710774+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"102'7","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.711401+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:33:06.711401+0000","last_peered":"2024-04-24T13:33:06.711401+0000","last_clean":"2024-04-24T13:33:06.711401+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:33:06.711401+0000","last_undegraded":"2024-04-24T13:33:06.711401+0000","last_fullsized":"2024-04-24T13:33:06.711401+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"81'2","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660701+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:33:06.660701+0000","last_peered":"2024-04-24T13:33:06.660701+0000","last_clean":"2024-04-24T13:33:06.660701+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:33:06.660701+0000","last_undegraded":"2024-04-24T13:33:06.660701+0000","last_fullsized":"2024-04-24T13:33:06.660701+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"102'8","reported_seq":180,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761110+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:33:06.761110+0000","last_peered":"2024-04-24T13:33:06.761110+0000","last_clean":"2024-04-24T13:33:06.761110+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:33:06.761110+0000","last_undegraded":"2024-04-24T13:33:06.761110+0000","last_fullsized":"2024-04-24T13:33:06.761110+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"94'9","reported_seq":189,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708335+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:33:06.708335+0000","last_peered":"2024-04-24T13:33:06.708335+0000","last_clean":"2024-04-24T13:33:06.708335+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:33:06.708335+0000","last_undegraded":"2024-04-24T13:33:06.708335+0000","last_fullsized":"2024-04-24T13:33:06.708335+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"102'9","reported_seq":183,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.759891+0000","last_change":"2024-04-24T13:30:50.956474+0000","last_active":"2024-04-24T13:33:06.759891+0000","last_peered":"2024-04-24T13:33:06.759891+0000","last_clean":"2024-04-24T13:33:06.759891+0000","last_became_active":"2024-04-24T13:30:50.955801+0000","last_became_peered":"2024-04-24T13:30:50.955801+0000","last_unstale":"2024-04-24T13:33:06.759891+0000","last_undegraded":"2024-04-24T13:33:06.759891+0000","last_fullsized":"2024-04-24T13:33:06.759891+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:41.114080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":165,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.735360+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:33:06.735360+0000","last_peered":"2024-04-24T13:33:06.735360+0000","last_clean":"2024-04-24T13:33:06.735360+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:33:06.735360+0000","last_undegraded":"2024-04-24T13:33:06.735360+0000","last_fullsized":"2024-04-24T13:33:06.735360+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"102'7","reported_seq":177,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.818346+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:33:06.818346+0000","last_peered":"2024-04-24T13:33:06.818346+0000","last_clean":"2024-04-24T13:33:06.818346+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:33:06.818346+0000","last_undegraded":"2024-04-24T13:33:06.818346+0000","last_fullsized":"2024-04-24T13:33:06.818346+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"94'7","reported_seq":195,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763388+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:33:06.763388+0000","last_peered":"2024-04-24T13:33:06.763388+0000","last_clean":"2024-04-24T13:33:06.763388+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:33:06.763388+0000","last_undegraded":"2024-04-24T13:33:06.763388+0000","last_fullsized":"2024-04-24T13:33:06.763388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"102'9","reported_seq":73,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.952281+0000","last_change":"2024-04-24T13:32:00.572200+0000","last_active":"2024-04-24T13:33:06.952281+0000","last_peered":"2024-04-24T13:33:06.952281+0000","last_clean":"2024-04-24T13:33:06.952281+0000","last_became_active":"2024-04-24T13:32:00.569529+0000","last_became_peered":"2024-04-24T13:32:00.569529+0000","last_unstale":"2024-04-24T13:33:06.952281+0000","last_undegraded":"2024-04-24T13:33:06.952281+0000","last_fullsized":"2024-04-24T13:33:06.952281+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:14:47.372088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":185,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660259+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:33:06.660259+0000","last_peered":"2024-04-24T13:33:06.660259+0000","last_clean":"2024-04-24T13:33:06.660259+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:33:06.660259+0000","last_undegraded":"2024-04-24T13:33:06.660259+0000","last_fullsized":"2024-04-24T13:33:06.660259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"102'12","reported_seq":182,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.403339+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:33:07.403339+0000","last_peered":"2024-04-24T13:33:07.403339+0000","last_clean":"2024-04-24T13:33:07.403339+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:33:07.403339+0000","last_undegraded":"2024-04-24T13:33:07.403339+0000","last_fullsized":"2024-04-24T13:33:07.403339+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":166,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648586+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:33:06.648586+0000","last_peered":"2024-04-24T13:33:06.648586+0000","last_clean":"2024-04-24T13:33:06.648586+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:33:06.648586+0000","last_undegraded":"2024-04-24T13:33:06.648586+0000","last_fullsized":"2024-04-24T13:33:06.648586+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"86'7","reported_seq":120,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.737585+0000","last_change":"2024-04-24T13:32:00.588017+0000","last_active":"2024-04-24T13:33:06.737585+0000","last_peered":"2024-04-24T13:33:06.737585+0000","last_clean":"2024-04-24T13:33:06.737585+0000","last_became_active":"2024-04-24T13:32:00.587160+0000","last_became_peered":"2024-04-24T13:32:00.587160+0000","last_unstale":"2024-04-24T13:33:06.737585+0000","last_undegraded":"2024-04-24T13:33:06.737585+0000","last_fullsized":"2024-04-24T13:33:06.737585+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:43.467082+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":17,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2c","version":"82'6","reported_seq":193,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.660581+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:33:06.660581+0000","last_peered":"2024-04-24T13:33:06.660581+0000","last_clean":"2024-04-24T13:33:06.660581+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:33:06.660581+0000","last_undegraded":"2024-04-24T13:33:06.660581+0000","last_fullsized":"2024-04-24T13:33:06.660581+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"102'12","reported_seq":188,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.243404+0000","last_change":"2024-04-24T13:30:50.920564+0000","last_active":"2024-04-24T13:33:07.243404+0000","last_peered":"2024-04-24T13:33:07.243404+0000","last_clean":"2024-04-24T13:33:07.243404+0000","last_became_active":"2024-04-24T13:30:50.920252+0000","last_became_peered":"2024-04-24T13:30:50.920252+0000","last_unstale":"2024-04-24T13:33:07.243404+0000","last_undegraded":"2024-04-24T13:33:07.243404+0000","last_fullsized":"2024-04-24T13:33:07.243404+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:29.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":48234496,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":47104,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"82'2","reported_seq":143,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.710543+0000","last_change":"2024-04-24T13:32:00.575324+0000","last_active":"2024-04-24T13:33:06.710543+0000","last_peered":"2024-04-24T13:33:06.710543+0000","last_clean":"2024-04-24T13:33:06.710543+0000","last_became_active":"2024-04-24T13:32:00.575008+0000","last_became_peered":"2024-04-24T13:32:00.575008+0000","last_unstale":"2024-04-24T13:33:06.710543+0000","last_undegraded":"2024-04-24T13:33:06.710543+0000","last_fullsized":"2024-04-24T13:33:06.710543+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:53:21.475332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"102'6","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.502501+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:33:07.502501+0000","last_peered":"2024-04-24T13:33:07.502501+0000","last_clean":"2024-04-24T13:33:07.502501+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:33:07.502501+0000","last_undegraded":"2024-04-24T13:33:07.502501+0000","last_fullsized":"2024-04-24T13:33:07.502501+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"82'4","reported_seq":184,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761705+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:33:06.761705+0000","last_peered":"2024-04-24T13:33:06.761705+0000","last_clean":"2024-04-24T13:33:06.761705+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:33:06.761705+0000","last_undegraded":"2024-04-24T13:33:06.761705+0000","last_fullsized":"2024-04-24T13:33:06.761705+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"102'6","reported_seq":138,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.105984+0000","last_change":"2024-04-24T13:30:50.936271+0000","last_active":"2024-04-24T13:33:07.105984+0000","last_peered":"2024-04-24T13:33:07.105984+0000","last_clean":"2024-04-24T13:33:07.105984+0000","last_became_active":"2024-04-24T13:30:50.935833+0000","last_became_peered":"2024-04-24T13:30:50.935833+0000","last_unstale":"2024-04-24T13:33:07.105984+0000","last_undegraded":"2024-04-24T13:33:07.105984+0000","last_fullsized":"2024-04-24T13:33:07.105984+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:04.149889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":23068672,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":22528,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"82'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708238+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:33:06.708238+0000","last_peered":"2024-04-24T13:33:06.708238+0000","last_clean":"2024-04-24T13:33:06.708238+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:33:06.708238+0000","last_undegraded":"2024-04-24T13:33:06.708238+0000","last_fullsized":"2024-04-24T13:33:06.708238+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"102'5","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.648998+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:33:06.648998+0000","last_peered":"2024-04-24T13:33:06.648998+0000","last_clean":"2024-04-24T13:33:06.648998+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:33:06.648998+0000","last_undegraded":"2024-04-24T13:33:06.648998+0000","last_fullsized":"2024-04-24T13:33:06.648998+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":20971520,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":20480,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":130,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.708542+0000","last_change":"2024-04-24T13:30:50.913925+0000","last_active":"2024-04-24T13:33:06.708542+0000","last_peered":"2024-04-24T13:33:06.708542+0000","last_clean":"2024-04-24T13:33:06.708542+0000","last_became_active":"2024-04-24T13:30:50.913630+0000","last_became_peered":"2024-04-24T13:30:50.913630+0000","last_unstale":"2024-04-24T13:33:06.708542+0000","last_undegraded":"2024-04-24T13:33:06.708542+0000","last_fullsized":"2024-04-24T13:33:06.708542+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:45.481646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"86'8","reported_seq":121,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.658654+0000","last_change":"2024-04-24T13:32:00.572908+0000","last_active":"2024-04-24T13:33:06.658654+0000","last_peered":"2024-04-24T13:33:06.658654+0000","last_clean":"2024-04-24T13:33:06.658654+0000","last_became_active":"2024-04-24T13:32:00.572224+0000","last_became_peered":"2024-04-24T13:32:00.572224+0000","last_unstale":"2024-04-24T13:33:06.658654+0000","last_undegraded":"2024-04-24T13:33:06.658654+0000","last_fullsized":"2024-04-24T13:33:06.658654+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:51:09.472596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.30","version":"102'10","reported_seq":75,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.761671+0000","last_change":"2024-04-24T13:32:00.568431+0000","last_active":"2024-04-24T13:33:06.761671+0000","last_peered":"2024-04-24T13:33:06.761671+0000","last_clean":"2024-04-24T13:33:06.761671+0000","last_became_active":"2024-04-24T13:32:00.568125+0000","last_became_peered":"2024-04-24T13:32:00.568125+0000","last_unstale":"2024-04-24T13:33:06.761671+0000","last_undegraded":"2024-04-24T13:33:06.761671+0000","last_fullsized":"2024-04-24T13:33:06.761671+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:45:05.439832+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.37","version":"82'2","reported_seq":175,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.763229+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:33:06.763229+0000","last_peered":"2024-04-24T13:33:06.763229+0000","last_clean":"2024-04-24T13:33:06.763229+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:33:06.763229+0000","last_undegraded":"2024-04-24T13:33:06.763229+0000","last_fullsized":"2024-04-24T13:33:06.763229+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"102'4","reported_seq":176,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:07.261933+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:33:07.261933+0000","last_peered":"2024-04-24T13:33:07.261933+0000","last_clean":"2024-04-24T13:33:07.261933+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:33:07.261933+0000","last_undegraded":"2024-04-24T13:33:07.261933+0000","last_fullsized":"2024-04-24T13:33:07.261933+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":16777216,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":16384,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"82'6","reported_seq":90,"reported_epoch":102,"state":"active+clean","last_fresh":"2024-04-24T13:33:06.762780+0000","last_change":"2024-04-24T13:32:00.595386+0000","last_active":"2024-04-24T13:33:06.762780+0000","last_peered":"2024-04-24T13:33:06.762780+0000","last_clean":"2024-04-24T13:33:06.762780+0000","last_became_active":"2024-04-24T13:32:00.593423+0000","last_became_peered":"2024-04-24T13:32:00.593423+0000","last_unstale":"2024-04-24T13:33:06.762780+0000","last_undegraded":"2024-04-24T13:33:06.762780+0000","last_fullsized":"2024-04-24T13:33:06.762780+0000","mapping_epoch":74,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":75,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:26.912115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1005,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":280,"num_read_kb":264,"num_write":236,"num_write_kb":69,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":2010,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":96,"ondisk_log_size":96,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":835,"ondisk_log_size":835,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":79525,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":800,"num_read_kb":562,"num_write":447,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":91,"num_bytes_recovered":2354,"num_keys_recovered":2,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":479232,"data_stored":128636,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":633,"ondisk_log_size":633,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":341,"num_read_kb":341,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1613,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":73728,"data_stored":4839,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1116,"num_read_kb":1096,"num_write":239,"num_write_kb":15,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":229,"ondisk_log_size":229,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":2046820352,"num_objects":490,"num_object_clones":0,"num_object_copies":980,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":490,"num_whiteouts":0,"num_read":20,"num_read_kb":15,"num_write":550,"num_write_kb":2019328,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":4097835008,"data_stored":4097835008,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":500,"ondisk_log_size":500,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":55834574887,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574887,"num_pgs":85,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":628964,"kb_used_data":597776,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93742876,"statfs":{"total":96636764160,"available":95992705024,"internally_reserved":0,"allocated":612122624,"data_stored":611573397,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574888,"num_pgs":10,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":126600,"kb_used_data":95416,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":94245240,"statfs":{"total":96636764160,"available":96507125760,"internally_reserved":0,"allocated":97705984,"data_stored":97180157,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574888,"num_pgs":87,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":640728,"kb_used_data":609544,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93731112,"statfs":{"total":96636764160,"available":95980658688,"internally_reserved":0,"allocated":624173056,"data_stored":623624255,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":10,"apply_latency_ms":10,"commit_latency_ns":10000000,"apply_latency_ns":10000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574887,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":837380,"kb_used_data":806192,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93534460,"statfs":{"total":96636764160,"available":95779287040,"internally_reserved":0,"allocated":825540608,"data_stored":824953735,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574888,"num_pgs":74,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":521908,"kb_used_data":490720,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93849932,"statfs":{"total":96636764160,"available":96102330368,"internally_reserved":0,"allocated":502497280,"data_stored":501932277,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574889,"num_pgs":82,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":376496,"kb_used_data":345316,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93995344,"statfs":{"total":96636764160,"available":96251232256,"internally_reserved":0,"allocated":353603584,"data_stored":353035785,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574888,"num_pgs":96,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":790760,"kb_used_data":759572,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93581080,"statfs":{"total":96636764160,"available":95827025920,"internally_reserved":0,"allocated":777801728,"data_stored":777249845,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":9,"apply_latency_ms":9,"commit_latency_ns":9000000,"apply_latency_ns":9000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":792723456,"data_stored":792723456,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":465567744,"data_stored":465567744,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":509607936,"data_stored":509607936,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":832569344,"data_stored":832569344,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":723517440,"data_stored":723517440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":100663296,"data_stored":100663296,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":673185792,"data_stored":673185792,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":993,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":436,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1795,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":135168,"data_stored":61573,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":90112,"data_stored":58978,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":578,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":408,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":194,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:33:09.452 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-24T13:33:09.452 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-24T13:33:09.453 INFO:tasks.thrashosds.thrasher:inject_pause on osd.1 2024-04-24T13:33:09.453 INFO:tasks.thrashosds.thrasher:Testing filestore_inject_stall pause injection for duration 3 2024-04-24T13:33:09.453 INFO:tasks.thrashosds.thrasher:Checking after 0, should_be_down=False 2024-04-24T13:33:09.453 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 0 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok config set filestore_inject_stall 3 2024-04-24T13:33:09.454 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:09.454 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:33:09.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:33:09.455 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:33:09.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.455 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:36 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.455 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:33:09.455 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.587052529, 2024-04-24T13:33:09.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012214546, 2024-04-24T13:33:09.455 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.455 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.455 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.455 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.455 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 36 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855815+0000", 2024-04-24T13:33:09.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2399999999999998e-07 2024-04-24T13:33:09.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855820+0000", 2024-04-24T13:33:09.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4429999999999996e-06 2024-04-24T13:33:09.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855825+0000", 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8320000000000002e-06 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855830+0000", 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9599999999999999e-06 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.862836+0000", 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070054569999999997 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863089+0000", 2024-04-24T13:33:09.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025361099999999999 2024-04-24T13:33:09.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.863476+0000", 2024-04-24T13:33:09.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038650000000000002 2024-04-24T13:33:09.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866487+0000", 2024-04-24T13:33:09.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030112839999999999 2024-04-24T13:33:09.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867867+0000", 2024-04-24T13:33:09.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013801989999999999 2024-04-24T13:33:09.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.867957+0000", 2024-04-24T13:33:09.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9872999999999998e-05 2024-04-24T13:33:09.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868029+0000", 2024-04-24T13:33:09.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1863e-05 2024-04-24T13:33:09.461 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.461 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.461 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.461 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:37 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.461 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:33:09.461 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.587029755, 2024-04-24T13:33:09.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012369313999999999, 2024-04-24T13:33:09.461 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.461 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.462 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.462 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 37 2024-04-24T13:33:09.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.462 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:33:09.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855837+0000", 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855838+0000", 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7e-07 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855842+0000", 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8650000000000003e-06 2024-04-24T13:33:09.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855847+0000", 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2950000000000001e-06 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.855852+0000", 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6319999999999999e-06 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864321+0000", 2024-04-24T13:33:09.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084697490000000004 2024-04-24T13:33:09.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864561+0000", 2024-04-24T13:33:09.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024018800000000001 2024-04-24T13:33:09.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.864934+0000", 2024-04-24T13:33:09.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037251299999999999 2024-04-24T13:33:09.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.866789+0000", 2024-04-24T13:33:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0018548729999999999 2024-04-24T13:33:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868045+0000", 2024-04-24T13:33:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012560200000000001 2024-04-24T13:33:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868151+0000", 2024-04-24T13:33:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106539 2024-04-24T13:33:09.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.868207+0000", 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.5269999999999998e-05 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:87 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.489422322, 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012692805, 2024-04-24T13:33:09.467 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.468 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.468 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.468 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.468 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.468 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.468 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 87 2024-04-24T13:33:09.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.468 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:33:09.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953445+0000", 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2500000000000005e-07 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953508+0000", 2024-04-24T13:33:09.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2273000000000005e-05 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953516+0000", 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3270000000000001e-06 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953522+0000", 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8900000000000004e-06 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961771+0000", 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0082495199999999998 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.961995+0000", 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022337799999999999 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.962360+0000", 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000364698 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964719+0000", 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023595880000000001 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965922+0000", 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001202694 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966013+0000", 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1478999999999996e-05 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.473 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.473 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966138+0000", 2024-04-24T13:33:09.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012433299999999999 2024-04-24T13:33:09.473 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.473 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.473 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.473 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:88 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.473 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:33:09.473 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.48933468499999, 2024-04-24T13:33:09.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013935651, 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 88 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953532+0000", 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953533+0000", 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953537+0000", 2024-04-24T13:33:09.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8010000000000001e-06 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953543+0000", 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9519999999999999e-06 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.953547+0000", 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5090000000000004e-06 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.964807+0000", 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011259923 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965007+0000", 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019961600000000001 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.965270+0000", 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263293 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.966555+0000", 2024-04-24T13:33:09.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001285254 2024-04-24T13:33:09.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967273+0000", 2024-04-24T13:33:09.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00071734000000000001 2024-04-24T13:33:09.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967381+0000", 2024-04-24T13:33:09.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108743 2024-04-24T13:33:09.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:08.967468+0000", 2024-04-24T13:33:09.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.6683999999999999e-05 2024-04-24T13:33:09.479 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.479 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.479 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.479 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:106 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 516~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.479 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:33:09.480 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.383680798, 2024-04-24T13:33:09.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012040197000000001, 2024-04-24T13:33:09.480 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.480 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.480 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.480 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.480 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.480 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.480 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 106 2024-04-24T13:33:09.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.480 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:33:09.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059186+0000", 2024-04-24T13:33:09.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059188+0000", 2024-04-24T13:33:09.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.753e-06 2024-04-24T13:33:09.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059313+0000", 2024-04-24T13:33:09.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012477899999999999 2024-04-24T13:33:09.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059336+0000", 2024-04-24T13:33:09.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3572999999999999e-05 2024-04-24T13:33:09.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059358+0000", 2024-04-24T13:33:09.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1725999999999998e-05 2024-04-24T13:33:09.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062318+0000", 2024-04-24T13:33:09.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0029594040000000001 2024-04-24T13:33:09.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062443+0000", 2024-04-24T13:33:09.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124955 2024-04-24T13:33:09.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.062641+0000", 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019803900000000001 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066962+0000", 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043214760000000003 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070950+0000", 2024-04-24T13:33:09.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039874699999999999 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071102+0000", 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015257899999999999 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071227+0000", 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012444299999999999 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.486 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:107 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66052~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.486 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:33:09.486 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.38347628, 2024-04-24T13:33:09.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012089393, 2024-04-24T13:33:09.486 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.486 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.486 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.486 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.486 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.486 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 107 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059391+0000", 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059392+0000", 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5400000000000001e-06 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059403+0000", 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0366e-05 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059422+0000", 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9567000000000001e-05 2024-04-24T13:33:09.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059438+0000", 2024-04-24T13:33:09.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5716999999999999e-05 2024-04-24T13:33:09.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064371+0000", 2024-04-24T13:33:09.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049332639999999997 2024-04-24T13:33:09.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064604+0000", 2024-04-24T13:33:09.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232742 2024-04-24T13:33:09.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.064973+0000", 2024-04-24T13:33:09.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036919699999999998 2024-04-24T13:33:09.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.490 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.490 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067104+0000", 2024-04-24T13:33:09.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0021302700000000001 2024-04-24T13:33:09.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071243+0000", 2024-04-24T13:33:09.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041393189999999998 2024-04-24T13:33:09.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071370+0000", 2024-04-24T13:33:09.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012718899999999999 2024-04-24T13:33:09.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071480+0000", 2024-04-24T13:33:09.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110222 2024-04-24T13:33:09.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.492 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.492 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.492 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:108 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66056~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.492 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:33:09.492 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.383116457, 2024-04-24T13:33:09.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015045177999999999, 2024-04-24T13:33:09.492 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.492 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.492 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.492 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.493 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.493 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 108 2024-04-24T13:33:09.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.493 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:33:09.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059751+0000", 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059753+0000", 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.187e-06 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059780+0000", 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6723000000000001e-05 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059804+0000", 2024-04-24T13:33:09.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4654000000000001e-05 2024-04-24T13:33:09.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059824+0000", 2024-04-24T13:33:09.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9646000000000001e-05 2024-04-24T13:33:09.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.065911+0000", 2024-04-24T13:33:09.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060875089999999996 2024-04-24T13:33:09.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066035+0000", 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000123736 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.066236+0000", 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020114899999999999 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070904+0000", 2024-04-24T13:33:09.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004667287 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074538+0000", 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003634745 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074678+0000", 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014009600000000001 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074796+0000", 2024-04-24T13:33:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117446 2024-04-24T13:33:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:109 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 66060~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:33:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.382948054, 2024-04-24T13:33:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016397116, 2024-04-24T13:33:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.498 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 109 2024-04-24T13:33:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:33:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059919+0000", 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.059921+0000", 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.81e-06 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060041+0000", 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000120005 2024-04-24T13:33:09.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060068+0000", 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6794000000000001e-05 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060086+0000", 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8355999999999998e-05 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067217+0000", 2024-04-24T13:33:09.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071308379999999996 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067446+0000", 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022866799999999999 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.067827+0000", 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038188399999999998 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076022+0000", 2024-04-24T13:33:09.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081946269999999995 2024-04-24T13:33:09.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076067+0000", 2024-04-24T13:33:09.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4932999999999998e-05 2024-04-24T13:33:09.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076201+0000", 2024-04-24T13:33:09.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013367899999999999 2024-04-24T13:33:09.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076316+0000", 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115522 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:110 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131596~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.382739663, 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016803390000000001, 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.504 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.505 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.505 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.505 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.505 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.505 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 110 2024-04-24T13:33:09.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.505 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:33:09.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060127+0000", 2024-04-24T13:33:09.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060129+0000", 2024-04-24T13:33:09.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6700000000000001e-06 2024-04-24T13:33:09.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060141+0000", 2024-04-24T13:33:09.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1926999999999999e-05 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060163+0000", 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2123000000000001e-05 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060195+0000", 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1372999999999999e-05 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.069839+0000", 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096442290000000007 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070029+0000", 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019026899999999999 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.070242+0000", 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021264400000000001 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.508 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076415+0000", 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061733659999999996 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076599+0000", 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018396499999999999 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076776+0000", 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017703900000000001 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076931+0000", 2024-04-24T13:33:09.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154785 2024-04-24T13:33:09.510 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.510 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.510 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.510 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:111 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131600~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.510 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:33:09.510 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.38264181, 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016962004999999999, 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 111 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:33:09.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060225+0000", 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060227+0000", 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5e-06 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060240+0000", 2024-04-24T13:33:09.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3356000000000001e-05 2024-04-24T13:33:09.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060267+0000", 2024-04-24T13:33:09.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6557e-05 2024-04-24T13:33:09.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060287+0000", 2024-04-24T13:33:09.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0556000000000001e-05 2024-04-24T13:33:09.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071582+0000", 2024-04-24T13:33:09.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011294873 2024-04-24T13:33:09.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071707+0000", 2024-04-24T13:33:09.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012475600000000001 2024-04-24T13:33:09.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.071907+0000", 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000199672 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076560+0000", 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046536900000000003 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.076952+0000", 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039190699999999999 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077077+0000", 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012503199999999999 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077187+0000", 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011010600000000001 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:112 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 131604~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.516 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.38254066100001, 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021309475000000001, 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 112 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060326+0000", 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060328+0000", 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4440000000000001e-06 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060479+0000", 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015112200000000001 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060526+0000", 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6665999999999997e-05 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060549+0000", 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3430000000000001e-05 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072655+0000", 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012105407 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.072948+0000", 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029300000000000002 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.073336+0000", 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038849099999999998 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077210+0000", 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038734989999999999 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081361+0000", 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041519549999999997 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081522+0000", 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016027200000000001 2024-04-24T13:33:09.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081636+0000", 2024-04-24T13:33:09.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114189 2024-04-24T13:33:09.522 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.522 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.522 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.522 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.522 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:33:09.522 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.382283949, 2024-04-24T13:33:09.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:33:09.523 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.523 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.523 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.523 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.523 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.523 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.523 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:33:09.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.523 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:33:09.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:33:09.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:33:09.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:33:09.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:33:09.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:33:09.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:33:09.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:33:09.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:33:09.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:33:09.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:33:09.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:33:09.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:33:09.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:33:09.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:33:09.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:33:09.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:33:09.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:33:09.528 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.528 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.528 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.529 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.529 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:33:09.529 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.382174287, 2024-04-24T13:33:09.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:33:09.529 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.529 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.529 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.529 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.529 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.529 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.530 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:33:09.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.530 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:33:09.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.530 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.530 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:33:09.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:33:09.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:33:09.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:33:09.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:33:09.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:33:09.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:33:09.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:33:09.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:33:09.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:33:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:33:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:33:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:33:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:33:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:33:09.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:33:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:33:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:33:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:33:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.535 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.382102258, 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:33:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:33:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:33:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:33:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:33:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:33:09.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:33:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:33:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:33:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:33:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.541 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:33:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.38193122199999, 2024-04-24T13:33:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:33:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:33:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:33:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:33:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:33:09.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:33:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:33:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:33:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:33:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:33:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:33:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:33:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:33:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:33:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:33:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:33:09.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:33:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:33:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:33:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:33:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:33:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:33:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:33:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:33:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:33:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:33:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.547 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.548 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.548 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.548 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:33:09.548 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.38189172899999, 2024-04-24T13:33:09.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:33:09.548 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.548 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.548 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.548 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.548 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.548 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:33:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:33:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:33:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:33:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:33:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:33:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:33:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:33:09.553 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:138 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.12857247299999, 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011290186000000001, 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.554 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 138 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314295+0000", 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.4000000000000001e-07 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314302+0000", 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0759999999999997e-06 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314308+0000", 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8279999999999999e-06 2024-04-24T13:33:09.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314313+0000", 2024-04-24T13:33:09.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.0520000000000001e-06 2024-04-24T13:33:09.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321896+0000", 2024-04-24T13:33:09.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0075827339999999998 2024-04-24T13:33:09.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.321968+0000", 2024-04-24T13:33:09.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2470000000000002e-05 2024-04-24T13:33:09.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322078+0000", 2024-04-24T13:33:09.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109565 2024-04-24T13:33:09.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325067+0000", 2024-04-24T13:33:09.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.002988714 2024-04-24T13:33:09.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325498+0000", 2024-04-24T13:33:09.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116399999999999 2024-04-24T13:33:09.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325542+0000", 2024-04-24T13:33:09.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4242000000000001e-05 2024-04-24T13:33:09.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.559 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325585+0000", 2024-04-24T13:33:09.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2701000000000003e-05 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:139 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.128546425, 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011381377999999999, 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.561 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.561 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 139 2024-04-24T13:33:09.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.561 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:33:09.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:33:09.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314321+0000", 2024-04-24T13:33:09.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.82e-07 2024-04-24T13:33:09.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314325+0000", 2024-04-24T13:33:09.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5140000000000002e-06 2024-04-24T13:33:09.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314335+0000", 2024-04-24T13:33:09.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7939999999999997e-06 2024-04-24T13:33:09.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314339+0000", 2024-04-24T13:33:09.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2860000000000001e-06 2024-04-24T13:33:09.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322459+0000", 2024-04-24T13:33:09.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081202619999999996 2024-04-24T13:33:09.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322571+0000", 2024-04-24T13:33:09.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111488 2024-04-24T13:33:09.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.322749+0000", 2024-04-24T13:33:09.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017867299999999999 2024-04-24T13:33:09.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325073+0000", 2024-04-24T13:33:09.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023232859999999999 2024-04-24T13:33:09.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325629+0000", 2024-04-24T13:33:09.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00055598400000000004 2024-04-24T13:33:09.565 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.565 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.565 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.565 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325669+0000", 2024-04-24T13:33:09.565 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.036e-05 2024-04-24T13:33:09.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325702+0000", 2024-04-24T13:33:09.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3148999999999997e-05 2024-04-24T13:33:09.566 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.566 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.566 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.566 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.566 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:140 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.566 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:33:09.566 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.12852106899999, 2024-04-24T13:33:09.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013774761, 2024-04-24T13:33:09.567 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.567 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.567 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.567 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.567 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.567 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.567 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 140 2024-04-24T13:33:09.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.567 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:33:09.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:33:09.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314346+0000", 2024-04-24T13:33:09.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9000000000000002e-07 2024-04-24T13:33:09.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314415+0000", 2024-04-24T13:33:09.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8532e-05 2024-04-24T13:33:09.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314423+0000", 2024-04-24T13:33:09.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6170000000000001e-06 2024-04-24T13:33:09.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314428+0000", 2024-04-24T13:33:09.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1030000000000001e-06 2024-04-24T13:33:09.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323356+0000", 2024-04-24T13:33:09.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089285159999999992 2024-04-24T13:33:09.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323428+0000", 2024-04-24T13:33:09.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1722000000000002e-05 2024-04-24T13:33:09.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.323537+0000", 2024-04-24T13:33:09.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109119 2024-04-24T13:33:09.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325079+0000", 2024-04-24T13:33:09.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001541623 2024-04-24T13:33:09.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.571 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.571 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.327971+0000", 2024-04-24T13:33:09.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0028925470000000001 2024-04-24T13:33:09.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328052+0000", 2024-04-24T13:33:09.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0328999999999996e-05 2024-04-24T13:33:09.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.328121+0000", 2024-04-24T13:33:09.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.9263000000000004e-05 2024-04-24T13:33:09.572 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.572 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.572 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.573 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:141 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:33:09.573 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:33:09.573 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 180.12843000000001, 2024-04-24T13:33:09.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016360230999999999, 2024-04-24T13:33:09.573 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:09.573 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:09.573 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:09.573 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:09.573 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:33:09.573 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:33:09.573 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 141 2024-04-24T13:33:09.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.574 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:09.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:09.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:33:09.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:09.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314437+0000", 2024-04-24T13:33:09.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:09.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314438+0000", 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3600000000000004e-07 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314441+0000", 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6169999999999998e-06 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314447+0000", 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.4439999999999999e-06 2024-04-24T13:33:09.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.314451+0000", 2024-04-24T13:33:09.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9149999999999998e-06 2024-04-24T13:33:09.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:09.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324146+0000", 2024-04-24T13:33:09.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096953690000000006 2024-04-24T13:33:09.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:09.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324252+0000", 2024-04-24T13:33:09.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010603399999999999 2024-04-24T13:33:09.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:09.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.324376+0000", 2024-04-24T13:33:09.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012353 2024-04-24T13:33:09.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:09.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.325726+0000", 2024-04-24T13:33:09.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001350251 2024-04-24T13:33:09.577 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:09.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330647+0000", 2024-04-24T13:33:09.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049207929999999997 2024-04-24T13:33:09.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:09.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330732+0000", 2024-04-24T13:33:09.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4899000000000001e-05 2024-04-24T13:33:09.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:09.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:09.578 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:09.578 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.330797+0000", 2024-04-24T13:33:09.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5843e-05 2024-04-24T13:33:09.579 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.579 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.579 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.579 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:09.579 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:09.579 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:09.581 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:09.577+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:09.581 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:09.684 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:09.681+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:09.717 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:09.717 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:09.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.717 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5708.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e105)", 2024-04-24T13:33:09.717 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:09.717183+0000", 2024-04-24T13:33:09.717 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.00071006499999999996, 2024-04-24T13:33:09.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00074068799999999998, 2024-04-24T13:33:09.718 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:09.718 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:09.718 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-24T13:33:09.718 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:09.718 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5708", 2024-04-24T13:33:09.718 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1710502049", 2024-04-24T13:33:09.718 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 67 2024-04-24T13:33:09.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.718 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:09.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:09.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717183+0000", 2024-04-24T13:33:09.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717183+0000", 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717184+0000", 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.522e-06 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:09.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717190+0000", 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3430000000000001e-06 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717208+0000", 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7476999999999999e-05 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717217+0000", 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9910000000000008e-06 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:09.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717282+0000", 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5225e-05 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717382+0000", 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9365999999999997e-05 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "MOSDPGPushReply(3.17 105/103 [PushReplyOp(3:e863dfd1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_46:head)])", 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:09.717974+0000", 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4294967295.9999189, 2024-04-24T13:33:09.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5349000000000003e-05, 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "queued for pg", 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717974+0000", 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717974+0000", 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:09.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717975+0000", 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.029e-06 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717980+0000", 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2719999999999997e-06 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717991+0000", 2024-04-24T13:33:09.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0766e-05 2024-04-24T13:33:09.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:09.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:09.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:09.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:09.717998+0000", 2024-04-24T13:33:09.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5780000000000001e-06 2024-04-24T13:33:09.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:09.724 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:09.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:09.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:09.724 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-24T13:33:09.724 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 2 2024-04-24T13:33:09.724 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:09.725 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:09.725 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "filestore_inject_stall = '' (not observed, change may require restart) " 2024-04-24T13:33:09.725 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:09.737 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:09.822 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:09.823+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:09.883 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:09.881+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:09.886 INFO:tasks.workunit.client.0.smithi071.stdout:user qa_user deleted 2024-04-24T13:33:09.887 INFO:tasks.workunit.client.0.smithi071.stdout:bucket delete succeeded 2024-04-24T13:33:09.913 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:09.913 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:09.913 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:09.913 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:09.913 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:09.929 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:09.983 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:09.981+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:10.084 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:10.083+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:10.100 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:10.101 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:10.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:10.101 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:10.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.101 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2206 3.f e85/48 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:10.101 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:10.101 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.803888266000001, 2024-04-24T13:33:10.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022785151, 2024-04-24T13:33:10.101 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.101 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.101 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.102 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:10.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:10.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295567+0000", 2024-04-24T13:33:10.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3939999999999999e-06 2024-04-24T13:33:10.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299770+0000", 2024-04-24T13:33:10.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042038029999999999 2024-04-24T13:33:10.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299808+0000", 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7703000000000001e-05 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299826+0000", 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8142999999999999e-05 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299972+0000", 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000146095 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.300023+0000", 2024-04-24T13:33:10.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0294999999999999e-05 2024-04-24T13:33:10.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318209+0000", 2024-04-24T13:33:10.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018186099000000001 2024-04-24T13:33:10.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318349+0000", 2024-04-24T13:33:10.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140619 2024-04-24T13:33:10.106 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.106 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.106 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.106 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2216 3.3d 3:bf22edaf:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:10.106 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:10.106 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.638135255000002, 2024-04-24T13:33:10.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027972988000000001, 2024-04-24T13:33:10.106 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.106 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.106 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2216 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461320+0000", 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7049999999999999e-06 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462822+0000", 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015018919999999999 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462846+0000", 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4229000000000001e-05 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462856+0000", 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8619999999999998e-06 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462932+0000", 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6126999999999998e-05 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463098+0000", 2024-04-24T13:33:10.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016631400000000001 2024-04-24T13:33:10.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:10.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463231+0000", 2024-04-24T13:33:10.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013278699999999999 2024-04-24T13:33:10.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475573+0000", 2024-04-24T13:33:10.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012342148000000001 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489102+0000", 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013528755 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489210+0000", 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010779400000000001 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489290+0000", 2024-04-24T13:33:10.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0375000000000002e-05 2024-04-24T13:33:10.112 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.112 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.112 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.112 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2217 3.7 e85/41 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:10.112 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:10.112 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.625725912, 2024-04-24T13:33:10.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022815940999999999, 2024-04-24T13:33:10.112 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.112 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.112 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473728+0000", 2024-04-24T13:33:10.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6080000000000001e-06 2024-04-24T13:33:10.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475783+0000", 2024-04-24T13:33:10.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002054349 2024-04-24T13:33:10.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475801+0000", 2024-04-24T13:33:10.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8054e-05 2024-04-24T13:33:10.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475814+0000", 2024-04-24T13:33:10.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3515e-05 2024-04-24T13:33:10.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488934+0000", 2024-04-24T13:33:10.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013119772 2024-04-24T13:33:10.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488977+0000", 2024-04-24T13:33:10.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2922e-05 2024-04-24T13:33:10.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496474+0000", 2024-04-24T13:33:10.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074975320000000003 2024-04-24T13:33:10.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496543+0000", 2024-04-24T13:33:10.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8188999999999994e-05 2024-04-24T13:33:10.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.117 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.117 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2251 3.3a e85/20 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head v 85'3, mlcod=81'1)", 2024-04-24T13:33:10.117 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:10.117 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.258226237000002, 2024-04-24T13:33:10.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024431608, 2024-04-24T13:33:10.117 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.117 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.117 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.117 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:10.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:10.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841228+0000", 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.781e-06 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846614+0000", 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053854419999999998 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846650+0000", 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6133000000000001e-05 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846669+0000", 2024-04-24T13:33:10.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9199e-05 2024-04-24T13:33:10.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846763+0000", 2024-04-24T13:33:10.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4335999999999999e-05 2024-04-24T13:33:10.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846799+0000", 2024-04-24T13:33:10.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5796000000000001e-05 2024-04-24T13:33:10.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865616+0000", 2024-04-24T13:33:10.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018816825999999998 2024-04-24T13:33:10.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865658+0000", 2024-04-24T13:33:10.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2095000000000003e-05 2024-04-24T13:33:10.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.121 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.122 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2667 3.39 3:9ef26513:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:10.122 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:10.122 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.9164281089999999, 2024-04-24T13:33:10.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021597445, 2024-04-24T13:33:10.122 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.122 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.122 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.122 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2667 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:10.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183028+0000", 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.444e-06 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185652+0000", 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026242420000000002 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185674+0000", 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1429000000000001e-05 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185683+0000", 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4069999999999999e-06 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185746+0000", 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2621999999999998e-05 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:10.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185750+0000", 2024-04-24T13:33:10.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7840000000000003e-06 2024-04-24T13:33:10.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188091+0000", 2024-04-24T13:33:10.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023404709999999998 2024-04-24T13:33:10.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188186+0000", 2024-04-24T13:33:10.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5136000000000005e-05 2024-04-24T13:33:10.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:10.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188277+0000", 2024-04-24T13:33:10.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0661000000000005e-05 2024-04-24T13:33:10.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.196753+0000", 2024-04-24T13:33:10.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084765789999999997 2024-04-24T13:33:10.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204495+0000", 2024-04-24T13:33:10.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077418260000000003 2024-04-24T13:33:10.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204569+0000", 2024-04-24T13:33:10.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3906999999999996e-05 2024-04-24T13:33:10.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204622+0000", 2024-04-24T13:33:10.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2936999999999998e-05 2024-04-24T13:33:10.129 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.129 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.129 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.129 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2675 3.20 e100/20 3:04d57de4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_14:head v 100'3, mlcod=85'1)", 2024-04-24T13:33:10.129 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:10.130 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.8295966660000005, 2024-04-24T13:33:10.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027012970000000001, 2024-04-24T13:33:10.130 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.130 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.130 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.130 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:10.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.72e-07 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275705+0000", 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058491849999999998 2024-04-24T13:33:10.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275732+0000", 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6630000000000001e-05 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275747+0000", 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5375000000000001e-05 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275839+0000", 2024-04-24T13:33:10.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1348999999999996e-05 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275873+0000", 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4341999999999997e-05 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296810+0000", 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020937196000000002 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296869+0000", 2024-04-24T13:33:10.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8621e-05 2024-04-24T13:33:10.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.134 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.134 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.134 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2676 3.22 e100/74 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head v 100'6, mlcod=86'4)", 2024-04-24T13:33:10.134 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:10.134 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.8247958229999997, 2024-04-24T13:33:10.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022762185000000001, 2024-04-24T13:33:10.134 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.134 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.135 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:10.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:10.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274658+0000", 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.466e-06 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277453+0000", 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027952799999999998 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277477+0000", 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3533e-05 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277490+0000", 2024-04-24T13:33:10.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2978e-05 2024-04-24T13:33:10.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277588+0000", 2024-04-24T13:33:10.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7796999999999999e-05 2024-04-24T13:33:10.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277617+0000", 2024-04-24T13:33:10.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8878e-05 2024-04-24T13:33:10.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297382+0000", 2024-04-24T13:33:10.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019765373999999999 2024-04-24T13:33:10.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297419+0000", 2024-04-24T13:33:10.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6878999999999997e-05 2024-04-24T13:33:10.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.138 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.139 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2688 3.3a e100/20 3:5c6b1f96:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_27:head v 100'9, mlcod=86'7)", 2024-04-24T13:33:10.139 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:10.139 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.7026302470000001, 2024-04-24T13:33:10.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020500114999999999, 2024-04-24T13:33:10.139 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396823+0000", 2024-04-24T13:33:10.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-07 2024-04-24T13:33:10.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.404984+0000", 2024-04-24T13:33:10.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081613310000000008 2024-04-24T13:33:10.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405002+0000", 2024-04-24T13:33:10.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7550999999999998e-05 2024-04-24T13:33:10.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405012+0000", 2024-04-24T13:33:10.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0039e-05 2024-04-24T13:33:10.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405077+0000", 2024-04-24T13:33:10.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5220000000000002e-05 2024-04-24T13:33:10.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405094+0000", 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7377e-05 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.417271+0000", 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012177248 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.417322+0000", 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0980000000000003e-05 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.143 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.144 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.144 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2689 3.17 3:eb254e54:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:10.144 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:10.144 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.7000751330000003, 2024-04-24T13:33:10.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020838804999999998, 2024-04-24T13:33:10.144 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.144 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.144 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.144 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.144 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.144 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.145 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2689 2024-04-24T13:33:10.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.145 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:10.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:10.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399380+0000", 2024-04-24T13:33:10.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.311e-06 2024-04-24T13:33:10.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401455+0000", 2024-04-24T13:33:10.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020751419999999999 2024-04-24T13:33:10.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401489+0000", 2024-04-24T13:33:10.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4078999999999997e-05 2024-04-24T13:33:10.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401501+0000", 2024-04-24T13:33:10.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2320000000000001e-05 2024-04-24T13:33:10.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401564+0000", 2024-04-24T13:33:10.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2518e-05 2024-04-24T13:33:10.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401673+0000", 2024-04-24T13:33:10.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010889 2024-04-24T13:33:10.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:10.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401787+0000", 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113859 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.416314+0000", 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014527804 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.419649+0000", 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033342049999999998 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.419942+0000", 2024-04-24T13:33:10.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000293477 2024-04-24T13:33:10.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.420216+0000", 2024-04-24T13:33:10.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0002742 2024-04-24T13:33:10.150 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.150 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.150 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2693 3.39 3:9e56554d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.6587561820000003, 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284832, 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2693 2024-04-24T13:33:10.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.152 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:10.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:10.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440699+0000", 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2199999999999999e-06 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441920+0000", 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012213739999999999 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441944+0000", 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4127000000000001e-05 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441963+0000", 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.855e-05 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442027+0000", 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4337000000000004e-05 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442150+0000", 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012347399999999999 2024-04-24T13:33:10.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:10.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442248+0000", 2024-04-24T13:33:10.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7683999999999995e-05 2024-04-24T13:33:10.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.447435+0000", 2024-04-24T13:33:10.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005186955 2024-04-24T13:33:10.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465898+0000", 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018462971000000002 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465947+0000", 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9276000000000001e-05 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465981+0000", 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3864e-05 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.156 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2723 3.37 3:ecde4b94:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4559751839999997, 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023622656999999998, 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.157 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2723 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643480+0000", 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6960000000000001e-06 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645332+0000", 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001851561 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645362+0000", 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0298e-05 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645375+0000", 2024-04-24T13:33:10.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.331e-05 2024-04-24T13:33:10.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645460+0000", 2024-04-24T13:33:10.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4851999999999993e-05 2024-04-24T13:33:10.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645467+0000", 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0140000000000001e-06 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.653874+0000", 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084073340000000007 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654042+0000", 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000167159 2024-04-24T13:33:10.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:10.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654214+0000", 2024-04-24T13:33:10.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017199899999999999 2024-04-24T13:33:10.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666361+0000", 2024-04-24T13:33:10.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012146957999999999 2024-04-24T13:33:10.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666977+0000", 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061606400000000004 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667043+0000", 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667100+0000", 2024-04-24T13:33:10.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7080999999999998e-05 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2746 3.30 3:0ff52a22:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2126722829999999, 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025777590999999999, 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.164 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.165 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.165 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2746 2024-04-24T13:33:10.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.165 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:10.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:10.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886783+0000", 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8930000000000001e-06 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889050+0000", 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002267107 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889078+0000", 2024-04-24T13:33:10.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7623999999999998e-05 2024-04-24T13:33:10.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889091+0000", 2024-04-24T13:33:10.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3101e-05 2024-04-24T13:33:10.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889170+0000", 2024-04-24T13:33:10.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8968999999999996e-05 2024-04-24T13:33:10.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889311+0000", 2024-04-24T13:33:10.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141392 2024-04-24T13:33:10.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:10.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889451+0000", 2024-04-24T13:33:10.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139911 2024-04-24T13:33:10.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.895637+0000", 2024-04-24T13:33:10.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061857290000000001 2024-04-24T13:33:10.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912426+0000", 2024-04-24T13:33:10.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016789347999999999 2024-04-24T13:33:10.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912501+0000", 2024-04-24T13:33:10.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4836e-05 2024-04-24T13:33:10.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912558+0000", 2024-04-24T13:33:10.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6681000000000002e-05 2024-04-24T13:33:10.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.171 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.172 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2754 3.b e101/20 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head v 101'7, mlcod=86'5)", 2024-04-24T13:33:10.172 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:10.172 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.1141115519999998, 2024-04-24T13:33:10.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025167067000000001, 2024-04-24T13:33:10.172 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.172 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.172 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985343+0000", 2024-04-24T13:33:10.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.734e-06 2024-04-24T13:33:10.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987192+0000", 2024-04-24T13:33:10.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018490360000000001 2024-04-24T13:33:10.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987224+0000", 2024-04-24T13:33:10.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2588e-05 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987241+0000", 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6350000000000001e-05 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987338+0000", 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7466000000000005e-05 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987368+0000", 2024-04-24T13:33:10.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0210999999999999e-05 2024-04-24T13:33:10.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010454+0000", 2024-04-24T13:33:10.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02308522 2024-04-24T13:33:10.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010508+0000", 2024-04-24T13:33:10.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4462000000000001e-05 2024-04-24T13:33:10.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.177 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.177 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2755 3.12 3:4bcc7c5c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:10.177 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:10.177 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.1136996640000003, 2024-04-24T13:33:10.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026401981000000001, 2024-04-24T13:33:10.177 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.177 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.177 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.178 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.178 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2755 2024-04-24T13:33:10.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.178 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:10.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985757+0000", 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6370000000000001e-06 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987459+0000", 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017029180000000001 2024-04-24T13:33:10.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987474+0000", 2024-04-24T13:33:10.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4460999999999999e-05 2024-04-24T13:33:10.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987484+0000", 2024-04-24T13:33:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0168e-05 2024-04-24T13:33:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987576+0000", 2024-04-24T13:33:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2020000000000003e-05 2024-04-24T13:33:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987731+0000", 2024-04-24T13:33:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015486499999999999 2024-04-24T13:33:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987818+0000", 2024-04-24T13:33:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:33:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012049+0000", 2024-04-24T13:33:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02423055 2024-04-24T13:33:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012062+0000", 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3054000000000001e-05 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012114+0000", 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1656999999999997e-05 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012155+0000", 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1300000000000001e-05 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2762 3.39 3:9dc3ddb4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.0451859260000003, 2024-04-24T13:33:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02109138, 2024-04-24T13:33:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.184 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2762 2024-04-24T13:33:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054269+0000", 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1859999999999999e-06 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.055994+0000", 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001725196 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056030+0000", 2024-04-24T13:33:10.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5914999999999997e-05 2024-04-24T13:33:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056047+0000", 2024-04-24T13:33:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6693000000000001e-05 2024-04-24T13:33:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056132+0000", 2024-04-24T13:33:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5797000000000005e-05 2024-04-24T13:33:10.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056297+0000", 2024-04-24T13:33:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164265 2024-04-24T13:33:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056460+0000", 2024-04-24T13:33:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016338600000000001 2024-04-24T13:33:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.066355+0000", 2024-04-24T13:33:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0098949050000000007 2024-04-24T13:33:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075280+0000", 2024-04-24T13:33:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089252210000000005 2024-04-24T13:33:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075324+0000", 2024-04-24T13:33:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3939000000000001e-05 2024-04-24T13:33:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075358+0000", 2024-04-24T13:33:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3877000000000001e-05 2024-04-24T13:33:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2764 3.23 3:c46f1960:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.0217093500000001, 2024-04-24T13:33:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020127275, 2024-04-24T13:33:10.190 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2764 2024-04-24T13:33:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077745+0000", 2024-04-24T13:33:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2800000000000002e-06 2024-04-24T13:33:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078808+0000", 2024-04-24T13:33:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001062351 2024-04-24T13:33:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078826+0000", 2024-04-24T13:33:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8045000000000001e-05 2024-04-24T13:33:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078835+0000", 2024-04-24T13:33:10.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5999999999999996e-06 2024-04-24T13:33:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078907+0000", 2024-04-24T13:33:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1068000000000005e-05 2024-04-24T13:33:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.079064+0000", 2024-04-24T13:33:10.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157532 2024-04-24T13:33:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.079221+0000", 2024-04-24T13:33:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015694400000000001 2024-04-24T13:33:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.092808+0000", 2024-04-24T13:33:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013586671999999999 2024-04-24T13:33:10.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097696+0000", 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004887906 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097795+0000", 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9701e-05 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097870+0000", 2024-04-24T13:33:10.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5176e-05 2024-04-24T13:33:10.197 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.197 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.197 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.197 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2770 3.1 3:80489e4c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:10.197 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:10.197 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.9658464150000001, 2024-04-24T13:33:10.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025093718000000001, 2024-04-24T13:33:10.197 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.197 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.197 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.198 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.198 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.198 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2770 2024-04-24T13:33:10.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.198 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:10.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133609+0000", 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0369999999999999e-06 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135153+0000", 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015441229999999999 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135182+0000", 2024-04-24T13:33:10.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8300999999999999e-05 2024-04-24T13:33:10.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135196+0000", 2024-04-24T13:33:10.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4229999999999999e-05 2024-04-24T13:33:10.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135279+0000", 2024-04-24T13:33:10.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3549999999999998e-05 2024-04-24T13:33:10.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135458+0000", 2024-04-24T13:33:10.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017893100000000001 2024-04-24T13:33:10.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:10.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135611+0000", 2024-04-24T13:33:10.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152881 2024-04-24T13:33:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.144283+0000", 2024-04-24T13:33:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086718709999999994 2024-04-24T13:33:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158560+0000", 2024-04-24T13:33:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014277306 2024-04-24T13:33:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158642+0000", 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1435999999999998e-05 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158700+0000", 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8051999999999999e-05 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.203 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2788 3.39 3:9c7af06c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.7839842109999999, 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021514591999999999, 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2788 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315470+0000", 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7680000000000001e-06 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316763+0000", 2024-04-24T13:33:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001292947 2024-04-24T13:33:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316787+0000", 2024-04-24T13:33:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4068999999999999e-05 2024-04-24T13:33:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316799+0000", 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2374999999999999e-05 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316874+0000", 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4133000000000003e-05 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316992+0000", 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117933 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:10.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.317153+0000", 2024-04-24T13:33:10.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000161101 2024-04-24T13:33:10.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.323588+0000", 2024-04-24T13:33:10.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064355749999999998 2024-04-24T13:33:10.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336852+0000", 2024-04-24T13:33:10.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013264233 2024-04-24T13:33:10.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336924+0000", 2024-04-24T13:33:10.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1746000000000001e-05 2024-04-24T13:33:10.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336983+0000", 2024-04-24T13:33:10.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8712000000000003e-05 2024-04-24T13:33:10.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.209 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.210 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2795 3.39 3:9fba68c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:10.210 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:10.210 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.7148352239999998, 2024-04-24T13:33:10.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932186000000001, 2024-04-24T13:33:10.210 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.210 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2795 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384619+0000", 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9939999999999999e-06 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386448+0000", 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001828744 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386484+0000", 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5976000000000002e-05 2024-04-24T13:33:10.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386500+0000", 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5746000000000001e-05 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386604+0000", 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104162 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386806+0000", 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020206400000000001 2024-04-24T13:33:10.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:10.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386995+0000", 2024-04-24T13:33:10.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018851 2024-04-24T13:33:10.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.398238+0000", 2024-04-24T13:33:10.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011243337000000001 2024-04-24T13:33:10.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404473+0000", 2024-04-24T13:33:10.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062350979999999997 2024-04-24T13:33:10.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404514+0000", 2024-04-24T13:33:10.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1418999999999998e-05 2024-04-24T13:33:10.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404550+0000", 2024-04-24T13:33:10.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5135999999999997e-05 2024-04-24T13:33:10.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.216 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.216 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2811 3.7 e101/41 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head v 101'8, mlcod=101'6)", 2024-04-24T13:33:10.216 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:10.216 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.518868436, 2024-04-24T13:33:10.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026659326000000001, 2024-04-24T13:33:10.217 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.217 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.217 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.217 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:10.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:10.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580586+0000", 2024-04-24T13:33:10.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.668e-06 2024-04-24T13:33:10.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582238+0000", 2024-04-24T13:33:10.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016524829999999999 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582266+0000", 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8028e-05 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582282+0000", 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6047999999999999e-05 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582372+0000", 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9642999999999995e-05 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582400+0000", 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7776999999999998e-05 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607184+0000", 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024784418999999999 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607243+0000", 2024-04-24T13:33:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9259999999999998e-05 2024-04-24T13:33:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.221 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:10.223 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:10.227 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:10.223+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:10.324 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:10.323+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:10.406 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:10.406 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:10.406 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:10.425 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:33:10.426 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:10.423+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:10.526 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:10.521+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:10.591 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:10.591 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:10.591 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:10.591 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:10.592 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:10.607 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:33:10.651 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:10.651+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:10.703 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:33:10.727 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:10.725+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:10.736 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1615 3.1a e82/20 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head v 82'1, mlcod=0'0)", 2024-04-24T13:33:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 52.521714295999999, 2024-04-24T13:33:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013622553000000001, 2024-04-24T13:33:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.736 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212985+0000", 2024-04-24T13:33:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1370000000000001e-06 2024-04-24T13:33:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219240+0000", 2024-04-24T13:33:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062543240000000003 2024-04-24T13:33:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219257+0000", 2024-04-24T13:33:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6940999999999999e-05 2024-04-24T13:33:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219267+0000", 2024-04-24T13:33:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0283e-05 2024-04-24T13:33:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219324+0000", 2024-04-24T13:33:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6950999999999997e-05 2024-04-24T13:33:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219343+0000", 2024-04-24T13:33:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8681999999999998e-05 2024-04-24T13:33:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226529+0000", 2024-04-24T13:33:10.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071867169999999996 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226607+0000", 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7517999999999999e-05 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2219 3.0 3:00e6fe99:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.242559901999996, 2024-04-24T13:33:10.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01535366, 2024-04-24T13:33:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2219 2024-04-24T13:33:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:10.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492150+0000", 2024-04-24T13:33:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1046999999999999e-05 2024-04-24T13:33:10.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494106+0000", 2024-04-24T13:33:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019561940000000001 2024-04-24T13:33:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494133+0000", 2024-04-24T13:33:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7617999999999999e-05 2024-04-24T13:33:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494150+0000", 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6096999999999999e-05 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494240+0000", 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0786999999999997e-05 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494435+0000", 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000195021 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:10.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494611+0000", 2024-04-24T13:33:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017601100000000001 2024-04-24T13:33:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507078+0000", 2024-04-24T13:33:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012466395 2024-04-24T13:33:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507374+0000", 2024-04-24T13:33:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029577100000000001 2024-04-24T13:33:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507429+0000", 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5928999999999999e-05 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507492+0000", 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.279e-05 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.747 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2230 3.19 3:99352026:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.126576911999997, 2024-04-24T13:33:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013072217000000001, 2024-04-24T13:33:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2230 2024-04-24T13:33:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.748 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:10.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608124+0000", 2024-04-24T13:33:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6740000000000001e-06 2024-04-24T13:33:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609736+0000", 2024-04-24T13:33:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016116430000000001 2024-04-24T13:33:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609766+0000", 2024-04-24T13:33:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0497e-05 2024-04-24T13:33:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609781+0000", 2024-04-24T13:33:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4810999999999999e-05 2024-04-24T13:33:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609861+0000", 2024-04-24T13:33:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9320999999999995e-05 2024-04-24T13:33:10.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609972+0000", 2024-04-24T13:33:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111116 2024-04-24T13:33:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:10.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.610087+0000", 2024-04-24T13:33:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115161 2024-04-24T13:33:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.620611+0000", 2024-04-24T13:33:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010524554 2024-04-24T13:33:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621126+0000", 2024-04-24T13:33:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051447699999999995 2024-04-24T13:33:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621163+0000", 2024-04-24T13:33:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6838999999999997e-05 2024-04-24T13:33:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621194+0000", 2024-04-24T13:33:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1124000000000002e-05 2024-04-24T13:33:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2252 3.4 3:22834b58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.889119962000002, 2024-04-24T13:33:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932545999999999, 2024-04-24T13:33:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2252 2024-04-24T13:33:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.755 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845581+0000", 2024-04-24T13:33:10.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847834+0000", 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002252843 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847863+0000", 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.904e-05 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847877+0000", 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4126e-05 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847963+0000", 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6162999999999995e-05 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848105+0000", 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014117900000000001 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848252+0000", 2024-04-24T13:33:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014774800000000001 2024-04-24T13:33:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865043+0000", 2024-04-24T13:33:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016790848000000001 2024-04-24T13:33:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865405+0000", 2024-04-24T13:33:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036176900000000001 2024-04-24T13:33:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865460+0000", 2024-04-24T13:33:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5334000000000002e-05 2024-04-24T13:33:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865511+0000", 2024-04-24T13:33:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0784e-05 2024-04-24T13:33:10.760 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2663 3.0 3:01df44a3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.5953459290000005, 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020742727999999998, 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.761 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2663 2024-04-24T13:33:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139355+0000", 2024-04-24T13:33:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2529999999999999e-06 2024-04-24T13:33:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141777+0000", 2024-04-24T13:33:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002422638 2024-04-24T13:33:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141800+0000", 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2949e-05 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141812+0000", 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1551e-05 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141907+0000", 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5296000000000004e-05 2024-04-24T13:33:10.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141917+0000", 2024-04-24T13:33:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.414e-06 2024-04-24T13:33:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144519+0000", 2024-04-24T13:33:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026024220000000001 2024-04-24T13:33:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144684+0000", 2024-04-24T13:33:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164511 2024-04-24T13:33:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144845+0000", 2024-04-24T13:33:10.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016157000000000001 2024-04-24T13:33:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.156972+0000", 2024-04-24T13:33:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012126855000000001 2024-04-24T13:33:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.159989+0000", 2024-04-24T13:33:10.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003016609 2024-04-24T13:33:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160059+0000", 2024-04-24T13:33:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0598000000000004e-05 2024-04-24T13:33:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160095+0000", 2024-04-24T13:33:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6062000000000001e-05 2024-04-24T13:33:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.768 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2664 3.4 3:21467061:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.5818463319999996, 2024-04-24T13:33:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013894336, 2024-04-24T13:33:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.769 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2664 2024-04-24T13:33:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152854+0000", 2024-04-24T13:33:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0109999999999999e-06 2024-04-24T13:33:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154070+0000", 2024-04-24T13:33:10.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012153940000000001 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154096+0000", 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6109e-05 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154110+0000", 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4489e-05 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154184+0000", 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4035000000000005e-05 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154325+0000", 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014115500000000001 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154474+0000", 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000148811 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.165413+0000", 2024-04-24T13:33:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010938333999999999 2024-04-24T13:33:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166625+0000", 2024-04-24T13:33:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001212526 2024-04-24T13:33:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166692+0000", 2024-04-24T13:33:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7013000000000004e-05 2024-04-24T13:33:10.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166747+0000", 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4459000000000002e-05 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2672 3.1c e100/74 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head v 100'4, mlcod=85'2)", 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4972043719999997, 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022091785999999999, 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.775 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237495+0000", 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1500000000000005e-07 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243044+0000", 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055497869999999996 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243082+0000", 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7208e-05 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243097+0000", 2024-04-24T13:33:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5554e-05 2024-04-24T13:33:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243175+0000", 2024-04-24T13:33:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7849999999999995e-05 2024-04-24T13:33:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243194+0000", 2024-04-24T13:33:10.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8822999999999999e-05 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259527+0000", 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016333007 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259586+0000", 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9042000000000002e-05 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2677 3.25 3:a4f04b59:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4523186199999998, 2024-04-24T13:33:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015627926, 2024-04-24T13:33:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2677 2024-04-24T13:33:10.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:10.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282383+0000", 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1499999999999999e-06 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283869+0000", 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014862269999999999 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283897+0000", 2024-04-24T13:33:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7596000000000001e-05 2024-04-24T13:33:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283911+0000", 2024-04-24T13:33:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.367e-05 2024-04-24T13:33:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283981+0000", 2024-04-24T13:33:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0349e-05 2024-04-24T13:33:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284117+0000", 2024-04-24T13:33:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013656000000000001 2024-04-24T13:33:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284214+0000", 2024-04-24T13:33:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6558999999999995e-05 2024-04-24T13:33:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296745+0000", 2024-04-24T13:33:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012530845000000001 2024-04-24T13:33:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297925+0000", 2024-04-24T13:33:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001179706 2024-04-24T13:33:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297961+0000", 2024-04-24T13:33:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6514999999999999e-05 2024-04-24T13:33:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.298008+0000", 2024-04-24T13:33:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6749000000000003e-05 2024-04-24T13:33:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2706 3.1c e100/74 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head v 100'5, mlcod=86'3)", 2024-04-24T13:33:10.786 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.2598986910000001, 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021017514000000001, 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474802+0000", 2024-04-24T13:33:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1399999999999998e-06 2024-04-24T13:33:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480124+0000", 2024-04-24T13:33:10.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053217059999999998 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480147+0000", 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3646e-05 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480159+0000", 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2133999999999999e-05 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480237+0000", 2024-04-24T13:33:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7531e-05 2024-04-24T13:33:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480291+0000", 2024-04-24T13:33:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3851999999999999e-05 2024-04-24T13:33:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495746+0000", 2024-04-24T13:33:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015454684 2024-04-24T13:33:10.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495817+0000", 2024-04-24T13:33:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1821000000000002e-05 2024-04-24T13:33:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.791 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2722 3.25 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1024946809999996, 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035782711000000002, 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2722 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632207+0000", 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.252e-06 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634575+0000", 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023682500000000001 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634606+0000", 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0284999999999999e-05 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634619+0000", 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3491e-05 2024-04-24T13:33:10.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634703+0000", 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4214000000000004e-05 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634711+0000", 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9719999999999992e-06 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639813+0000", 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051013830000000001 2024-04-24T13:33:10.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639969+0000", 2024-04-24T13:33:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015674600000000001 2024-04-24T13:33:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.640112+0000", 2024-04-24T13:33:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142347 2024-04-24T13:33:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647222+0000", 2024-04-24T13:33:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071106520000000003 2024-04-24T13:33:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667844+0000", 2024-04-24T13:33:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020621746999999999 2024-04-24T13:33:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667925+0000", 2024-04-24T13:33:10.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0717999999999995e-05 2024-04-24T13:33:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667987+0000", 2024-04-24T13:33:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1654000000000003e-05 2024-04-24T13:33:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2730 3.19 3:984637ec:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:10.798 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.0108482079999996, 2024-04-24T13:33:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014952841999999999, 2024-04-24T13:33:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2730 2024-04-24T13:33:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723854+0000", 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4180000000000001e-06 2024-04-24T13:33:10.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725292+0000", 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014378870000000001 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725322+0000", 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0596999999999999e-05 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725337+0000", 2024-04-24T13:33:10.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4684999999999999e-05 2024-04-24T13:33:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725423+0000", 2024-04-24T13:33:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5997999999999999e-05 2024-04-24T13:33:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725596+0000", 2024-04-24T13:33:10.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000172654 2024-04-24T13:33:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725755+0000", 2024-04-24T13:33:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015988600000000001 2024-04-24T13:33:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734196+0000", 2024-04-24T13:33:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084404170000000004 2024-04-24T13:33:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738679+0000", 2024-04-24T13:33:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044834189999999998 2024-04-24T13:33:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738747+0000", 2024-04-24T13:33:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7890000000000002e-05 2024-04-24T13:33:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738803+0000", 2024-04-24T13:33:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5991e-05 2024-04-24T13:33:10.804 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2737 3.4 3:23416714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.941562577, 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019181262000000001, 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.805 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2737 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793139+0000", 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795403+0000", 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002264252 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795439+0000", 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5701999999999998e-05 2024-04-24T13:33:10.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795454+0000", 2024-04-24T13:33:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5262999999999999e-05 2024-04-24T13:33:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795541+0000", 2024-04-24T13:33:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6989000000000003e-05 2024-04-24T13:33:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795719+0000", 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000177906 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795875+0000", 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155785 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.808532+0000", 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012657695 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812189+0000", 2024-04-24T13:33:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036562809999999999 2024-04-24T13:33:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812258+0000", 2024-04-24T13:33:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9210999999999999e-05 2024-04-24T13:33:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812317+0000", 2024-04-24T13:33:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9407000000000002e-05 2024-04-24T13:33:10.810 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2752 3.1c e101/74 3:3ae15365:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_81:head v 101'6, mlcod=100'4)", 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.774254419, 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013320523000000001, 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960446+0000", 2024-04-24T13:33:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0590000000000001e-06 2024-04-24T13:33:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.965992+0000", 2024-04-24T13:33:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055462810000000001 2024-04-24T13:33:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966034+0000", 2024-04-24T13:33:10.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1485e-05 2024-04-24T13:33:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966051+0000", 2024-04-24T13:33:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7404000000000001e-05 2024-04-24T13:33:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966178+0000", 2024-04-24T13:33:10.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012681899999999999 2024-04-24T13:33:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966198+0000", 2024-04-24T13:33:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9944000000000001e-05 2024-04-24T13:33:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.973717+0000", 2024-04-24T13:33:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075185299999999998 2024-04-24T13:33:10.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.973765+0000", 2024-04-24T13:33:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8000999999999997e-05 2024-04-24T13:33:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2772 3.1a e101/20 3:589df240:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_101:head v 101'3, mlcod=82'1)", 2024-04-24T13:33:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.5751729719999998, 2024-04-24T13:33:10.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013122586, 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159527+0000", 2024-04-24T13:33:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-04-24T13:33:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165074+0000", 2024-04-24T13:33:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055466129999999997 2024-04-24T13:33:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165100+0000", 2024-04-24T13:33:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5789e-05 2024-04-24T13:33:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165110+0000", 2024-04-24T13:33:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0036e-05 2024-04-24T13:33:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165198+0000", 2024-04-24T13:33:10.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7981999999999999e-05 2024-04-24T13:33:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165229+0000", 2024-04-24T13:33:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1022999999999998e-05 2024-04-24T13:33:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.172572+0000", 2024-04-24T13:33:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073435519999999997 2024-04-24T13:33:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.172648+0000", 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6013000000000006e-05 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2781 3.e e101/41 3:704d2ad1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_110:head v 101'4, mlcod=85'2)", 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.484008072, 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017614365, 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.821 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250692+0000", 2024-04-24T13:33:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3570000000000001e-06 2024-04-24T13:33:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256430+0000", 2024-04-24T13:33:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057381300000000001 2024-04-24T13:33:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256465+0000", 2024-04-24T13:33:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4974000000000001e-05 2024-04-24T13:33:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256480+0000", 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5000999999999999e-05 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256571+0000", 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1008999999999995e-05 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256599+0000", 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7676000000000001e-05 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268237+0000", 2024-04-24T13:33:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011638081 2024-04-24T13:33:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268305+0000", 2024-04-24T13:33:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8137000000000002e-05 2024-04-24T13:33:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2782 3.2b e101/41 3:d5b98152:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_111:head v 101'8, mlcod=86'6)", 2024-04-24T13:33:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.477224037, 2024-04-24T13:33:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013494414, 2024-04-24T13:33:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257476+0000", 2024-04-24T13:33:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.499e-06 2024-04-24T13:33:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259466+0000", 2024-04-24T13:33:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019901609999999998 2024-04-24T13:33:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259489+0000", 2024-04-24T13:33:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3144000000000001e-05 2024-04-24T13:33:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259502+0000", 2024-04-24T13:33:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3046e-05 2024-04-24T13:33:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259580+0000", 2024-04-24T13:33:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7871e-05 2024-04-24T13:33:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259607+0000", 2024-04-24T13:33:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6828000000000001e-05 2024-04-24T13:33:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.270920+0000", 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011312533 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.270969+0000", 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9332000000000001e-05 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2785 3.e e101/41 3:72bc610a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_114:head v 101'5, mlcod=86'3)", 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:10.832 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4422311199999998, 2024-04-24T13:33:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014730050999999999, 2024-04-24T13:33:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292470+0000", 2024-04-24T13:33:10.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2089999999999999e-06 2024-04-24T13:33:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297260+0000", 2024-04-24T13:33:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047903989999999999 2024-04-24T13:33:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297293+0000", 2024-04-24T13:33:10.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3398000000000001e-05 2024-04-24T13:33:10.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297309+0000", 2024-04-24T13:33:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5290000000000001e-05 2024-04-24T13:33:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297386+0000", 2024-04-24T13:33:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7218999999999994e-05 2024-04-24T13:33:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297406+0000", 2024-04-24T13:33:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9936999999999999e-05 2024-04-24T13:33:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.307133+0000", 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097276359999999996 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.307197+0000", 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3962999999999997e-05 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2810 3.16 3:69a6ac6a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:10.840 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.1789923900000003, 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015206692000000001, 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2810 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555709+0000", 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0240000000000002e-06 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557455+0000", 2024-04-24T13:33:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001745763 2024-04-24T13:33:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557482+0000", 2024-04-24T13:33:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6679999999999999e-05 2024-04-24T13:33:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557496+0000", 2024-04-24T13:33:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4185000000000001e-05 2024-04-24T13:33:10.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557575+0000", 2024-04-24T13:33:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9419000000000007e-05 2024-04-24T13:33:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557715+0000", 2024-04-24T13:33:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140264 2024-04-24T13:33:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557805+0000", 2024-04-24T13:33:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9511000000000004e-05 2024-04-24T13:33:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.563323+0000", 2024-04-24T13:33:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055181300000000004 2024-04-24T13:33:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570784+0000", 2024-04-24T13:33:10.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074609350000000001 2024-04-24T13:33:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570856+0000", 2024-04-24T13:33:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1484999999999997e-05 2024-04-24T13:33:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570913+0000", 2024-04-24T13:33:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7296000000000002e-05 2024-04-24T13:33:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.846 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2813 3.6 e101/20 3:63b60245:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_142:head v 101'4, mlcod=86'2)", 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.1422885059999999, 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015409209, 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:10.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:10.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592412+0000", 2024-04-24T13:33:10.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2819999999999999e-06 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594446+0000", 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020333840000000001 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594471+0000", 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5287e-05 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594482+0000", 2024-04-24T13:33:10.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1063999999999999e-05 2024-04-24T13:33:10.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594585+0000", 2024-04-24T13:33:10.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010303500000000001 2024-04-24T13:33:10.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594609+0000", 2024-04-24T13:33:10.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3951000000000002e-05 2024-04-24T13:33:10.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607767+0000", 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013158115999999999 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607819+0000", 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2089999999999998e-05 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.851 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2814 3.8 e101/20 3:11e81300:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_143:head v 101'7, mlcod=101'5)", 2024-04-24T13:33:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.1302521990000001, 2024-04-24T13:33:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013378928999999999, 2024-04-24T13:33:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:10.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604448+0000", 2024-04-24T13:33:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4610000000000001e-06 2024-04-24T13:33:10.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606315+0000", 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001866957 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606338+0000", 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3010000000000002e-05 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606352+0000", 2024-04-24T13:33:10.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4754e-05 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606438+0000", 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5239000000000002e-05 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606466+0000", 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8476999999999999e-05 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:10.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.617758+0000", 2024-04-24T13:33:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011291436 2024-04-24T13:33:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.617825+0000", 2024-04-24T13:33:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7595000000000006e-05 2024-04-24T13:33:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:10.856 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:10.856 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:10.858 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:33:10.858 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:10.855+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:10.959 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:10.957+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:11.020 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:11.020 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:11.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:11.020 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3032 7.e 7.f8c99aee (undecoded) ondisk+write+known_if_redirected+supports_pool_eio e106)", 2024-04-24T13:33:11.020 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:10.692995+0000", 2024-04-24T13:33:11.020 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.327352331, 2024-04-24T13:33:11.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.327390501, 2024-04-24T13:33:11.020 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:11.020 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:11.020 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for peered", 2024-04-24T13:33:11.020 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:11.020 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3032 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:10.692995+0000", 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:10.692995+0000", 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:11.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:11.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:11.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:11.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:10.692998+0000", 2024-04-24T13:33:11.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3259999999999998e-06 2024-04-24T13:33:11.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:11.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:11.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:11.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:10.693008+0000", 2024-04-24T13:33:11.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0457e-05 2024-04-24T13:33:11.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:11.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:11.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:11.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:10.693033+0000", 2024-04-24T13:33:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4901000000000001e-05 2024-04-24T13:33:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:10.693048+0000", 2024-04-24T13:33:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4762e-05 2024-04-24T13:33:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:10.693154+0000", 2024-04-24T13:33:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010615099999999999 2024-04-24T13:33:11.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:10.693166+0000", 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2123000000000001e-05 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:10.701892+0000", 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0087263859999999992 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for peered", 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:10.701901+0000", 2024-04-24T13:33:11.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9369999999999993e-06 2024-04-24T13:33:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-24T13:33:11.025 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 1 2024-04-24T13:33:11.025 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:11.038 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:33:11.083 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:11.083+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:11.122 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:33:11.151 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:11.151 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:11.151 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:11.151 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:11.151 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:11.160 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:11.159+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:11.167 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:33:11.261 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:11.257+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:11.276 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:11.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:11.299 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:11.300 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:11.318 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:11.318 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:11.334 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:11.335 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:11.344 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:11.344 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:11.356 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:11.356 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:11.360 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:33:11.362 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:11.361+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:11.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:11.377 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:11.398 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:11.398 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:11.419 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:11.419 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:11.463 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:11.461+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:11.479 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:11.480 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:11.497 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:33:11.563 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:11.561+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:11.645 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:11.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:33:11.703 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:11.703+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:11.703 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:33:11.766 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:11.761+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:11.780 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:11.780 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:11.794 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:33:11.866 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:11.861+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:11.927 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:11.927 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:11.941 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:33:11.967 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:11.966+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:12.068 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:12.066+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:12.105 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:12.105 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:12.122 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:33:12.169 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:12.166+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:12.246 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:12.247 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:12.260 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:33:12.271 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:12.270+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:12.372 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:12.369+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:12.385 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:12.385 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:12.400 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:33:12.486 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:12.485+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:12.565 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:12.565 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:12.575 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:12.573+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:12.579 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:33:12.678 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:12.674+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:12.740 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:12.741 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:12.755 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:33:12.779 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:12.778+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:12.879 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:12.879 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:12.880 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:12.878+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:12.892 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:33:12.982 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:12.978+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:13.013 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:13.014 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:13.027 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:33:13.082 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:13.078+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:13.151 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:13.151 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:13.165 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:33:13.210 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:13.209+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:13.284 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:13.282+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:13.288 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:13.289 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:13.303 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:13.390 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:13.389+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:13.440 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:33:13.469 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:13.469 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:13.483 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:13.487 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:13.486+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:13.586 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:13.586+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:13.593 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:13.593 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:13.608 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:13.609 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:13.624 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:13.624 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:13.640 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:13.640 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:13.649 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:13.649 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:13.659 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:13.659 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:13.664 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:13.678 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:13.678 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:13.688 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:13.685+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:13.695 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:13.696 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:13.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:13.715 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:13.725 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:33:13.779 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:13.779 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:13.779 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:13.780 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:13.789 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:13.789+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:13.793 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:13.890 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:13.889+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:13.905 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:13.905 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:13.905 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:13.905 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:13.906 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:13.919 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:13.991 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:13.989+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:14.036 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:14.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2206 3.f e85/48 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.737880152000002, 2024-04-24T13:33:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022785151, 2024-04-24T13:33:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295567+0000", 2024-04-24T13:33:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3939999999999999e-06 2024-04-24T13:33:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299770+0000", 2024-04-24T13:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042038029999999999 2024-04-24T13:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299808+0000", 2024-04-24T13:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7703000000000001e-05 2024-04-24T13:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299826+0000", 2024-04-24T13:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8142999999999999e-05 2024-04-24T13:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299972+0000", 2024-04-24T13:33:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000146095 2024-04-24T13:33:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.300023+0000", 2024-04-24T13:33:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0294999999999999e-05 2024-04-24T13:33:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318209+0000", 2024-04-24T13:33:14.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018186099000000001 2024-04-24T13:33:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318349+0000", 2024-04-24T13:33:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140619 2024-04-24T13:33:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2216 3.3d 3:bf22edaf:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:14.041 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.572127141000003, 2024-04-24T13:33:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027972988000000001, 2024-04-24T13:33:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2216 2024-04-24T13:33:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461320+0000", 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7049999999999999e-06 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462822+0000", 2024-04-24T13:33:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015018919999999999 2024-04-24T13:33:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462846+0000", 2024-04-24T13:33:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4229000000000001e-05 2024-04-24T13:33:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462856+0000", 2024-04-24T13:33:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8619999999999998e-06 2024-04-24T13:33:14.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462932+0000", 2024-04-24T13:33:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6126999999999998e-05 2024-04-24T13:33:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463098+0000", 2024-04-24T13:33:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016631400000000001 2024-04-24T13:33:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463231+0000", 2024-04-24T13:33:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013278699999999999 2024-04-24T13:33:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475573+0000", 2024-04-24T13:33:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012342148000000001 2024-04-24T13:33:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489102+0000", 2024-04-24T13:33:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013528755 2024-04-24T13:33:14.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489210+0000", 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010779400000000001 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489290+0000", 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0375000000000002e-05 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2217 3.7 e85/41 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.559717798000001, 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022815940999999999, 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473728+0000", 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6080000000000001e-06 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475783+0000", 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002054349 2024-04-24T13:33:14.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475801+0000", 2024-04-24T13:33:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8054e-05 2024-04-24T13:33:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475814+0000", 2024-04-24T13:33:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3515e-05 2024-04-24T13:33:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488934+0000", 2024-04-24T13:33:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013119772 2024-04-24T13:33:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488977+0000", 2024-04-24T13:33:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2922e-05 2024-04-24T13:33:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496474+0000", 2024-04-24T13:33:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074975320000000003 2024-04-24T13:33:14.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496543+0000", 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8188999999999994e-05 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2251 3.3a e85/20 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head v 85'3, mlcod=81'1)", 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.192218123000004, 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024431608, 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.052 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841228+0000", 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.781e-06 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846614+0000", 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053854419999999998 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846650+0000", 2024-04-24T13:33:14.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6133000000000001e-05 2024-04-24T13:33:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846669+0000", 2024-04-24T13:33:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9199e-05 2024-04-24T13:33:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846763+0000", 2024-04-24T13:33:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4335999999999999e-05 2024-04-24T13:33:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846799+0000", 2024-04-24T13:33:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5796000000000001e-05 2024-04-24T13:33:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865616+0000", 2024-04-24T13:33:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018816825999999998 2024-04-24T13:33:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865658+0000", 2024-04-24T13:33:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2095000000000003e-05 2024-04-24T13:33:14.056 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2667 3.39 3:9ef26513:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8504199949999993, 2024-04-24T13:33:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021597445, 2024-04-24T13:33:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.057 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2667 2024-04-24T13:33:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:14.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183028+0000", 2024-04-24T13:33:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.444e-06 2024-04-24T13:33:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185652+0000", 2024-04-24T13:33:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026242420000000002 2024-04-24T13:33:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185674+0000", 2024-04-24T13:33:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1429000000000001e-05 2024-04-24T13:33:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185683+0000", 2024-04-24T13:33:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4069999999999999e-06 2024-04-24T13:33:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185746+0000", 2024-04-24T13:33:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2621999999999998e-05 2024-04-24T13:33:14.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185750+0000", 2024-04-24T13:33:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7840000000000003e-06 2024-04-24T13:33:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188091+0000", 2024-04-24T13:33:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023404709999999998 2024-04-24T13:33:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188186+0000", 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5136000000000005e-05 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188277+0000", 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0661000000000005e-05 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.196753+0000", 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084765789999999997 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204495+0000", 2024-04-24T13:33:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077418260000000003 2024-04-24T13:33:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204569+0000", 2024-04-24T13:33:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3906999999999996e-05 2024-04-24T13:33:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204622+0000", 2024-04-24T13:33:14.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2936999999999998e-05 2024-04-24T13:33:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2675 3.20 e100/20 3:04d57de4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_14:head v 100'3, mlcod=85'1)", 2024-04-24T13:33:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.7635885519999999, 2024-04-24T13:33:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027012970000000001, 2024-04-24T13:33:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.064 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:14.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.72e-07 2024-04-24T13:33:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275705+0000", 2024-04-24T13:33:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058491849999999998 2024-04-24T13:33:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275732+0000", 2024-04-24T13:33:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6630000000000001e-05 2024-04-24T13:33:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275747+0000", 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5375000000000001e-05 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275839+0000", 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1348999999999996e-05 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275873+0000", 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4341999999999997e-05 2024-04-24T13:33:14.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296810+0000", 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020937196000000002 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296869+0000", 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8621e-05 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2676 3.22 e100/74 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head v 100'6, mlcod=86'4)", 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.7587877089999999, 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022762185000000001, 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274658+0000", 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.466e-06 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277453+0000", 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027952799999999998 2024-04-24T13:33:14.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277477+0000", 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3533e-05 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277490+0000", 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2978e-05 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277588+0000", 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7796999999999999e-05 2024-04-24T13:33:14.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277617+0000", 2024-04-24T13:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8878e-05 2024-04-24T13:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297382+0000", 2024-04-24T13:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019765373999999999 2024-04-24T13:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297419+0000", 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6878999999999997e-05 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2688 3.3a e100/20 3:5c6b1f96:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_27:head v 100'9, mlcod=86'7)", 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.6366221329999995, 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020500114999999999, 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.073 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396823+0000", 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-07 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.404984+0000", 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081613310000000008 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405002+0000", 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7550999999999998e-05 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405012+0000", 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0039e-05 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405077+0000", 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5220000000000002e-05 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405094+0000", 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7377e-05 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.417271+0000", 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012177248 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.417322+0000", 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0980000000000003e-05 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2689 3.17 3:eb254e54:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:14.077 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.6340670189999997, 2024-04-24T13:33:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020838804999999998, 2024-04-24T13:33:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2689 2024-04-24T13:33:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399380+0000", 2024-04-24T13:33:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.311e-06 2024-04-24T13:33:14.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401455+0000", 2024-04-24T13:33:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020751419999999999 2024-04-24T13:33:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401489+0000", 2024-04-24T13:33:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4078999999999997e-05 2024-04-24T13:33:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401501+0000", 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2320000000000001e-05 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401564+0000", 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2518e-05 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401673+0000", 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010889 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401787+0000", 2024-04-24T13:33:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113859 2024-04-24T13:33:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.416314+0000", 2024-04-24T13:33:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014527804 2024-04-24T13:33:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.419649+0000", 2024-04-24T13:33:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033342049999999998 2024-04-24T13:33:14.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.419942+0000", 2024-04-24T13:33:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000293477 2024-04-24T13:33:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.420216+0000", 2024-04-24T13:33:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0002742 2024-04-24T13:33:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2693 3.39 3:9e56554d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.5927480680000006, 2024-04-24T13:33:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284832, 2024-04-24T13:33:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2693 2024-04-24T13:33:14.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440699+0000", 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2199999999999999e-06 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441920+0000", 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012213739999999999 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441944+0000", 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4127000000000001e-05 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441963+0000", 2024-04-24T13:33:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.855e-05 2024-04-24T13:33:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442027+0000", 2024-04-24T13:33:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4337000000000004e-05 2024-04-24T13:33:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442150+0000", 2024-04-24T13:33:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012347399999999999 2024-04-24T13:33:14.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442248+0000", 2024-04-24T13:33:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7683999999999995e-05 2024-04-24T13:33:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.447435+0000", 2024-04-24T13:33:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005186955 2024-04-24T13:33:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465898+0000", 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018462971000000002 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465947+0000", 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9276000000000001e-05 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465981+0000", 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3864e-05 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.089 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2723 3.37 3:ecde4b94:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.3899670700000009, 2024-04-24T13:33:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023622656999999998, 2024-04-24T13:33:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.090 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2723 2024-04-24T13:33:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:14.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643480+0000", 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6960000000000001e-06 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645332+0000", 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001851561 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645362+0000", 2024-04-24T13:33:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0298e-05 2024-04-24T13:33:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645375+0000", 2024-04-24T13:33:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.331e-05 2024-04-24T13:33:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645460+0000", 2024-04-24T13:33:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4851999999999993e-05 2024-04-24T13:33:14.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645467+0000", 2024-04-24T13:33:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0140000000000001e-06 2024-04-24T13:33:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.653874+0000", 2024-04-24T13:33:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084073340000000007 2024-04-24T13:33:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654042+0000", 2024-04-24T13:33:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000167159 2024-04-24T13:33:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654214+0000", 2024-04-24T13:33:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017199899999999999 2024-04-24T13:33:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666361+0000", 2024-04-24T13:33:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012146957999999999 2024-04-24T13:33:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666977+0000", 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061606400000000004 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667043+0000", 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667100+0000", 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7080999999999998e-05 2024-04-24T13:33:14.096 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2746 3.30 3:0ff52a22:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.1466641689999992, 2024-04-24T13:33:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025777590999999999, 2024-04-24T13:33:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.097 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2746 2024-04-24T13:33:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:14.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886783+0000", 2024-04-24T13:33:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8930000000000001e-06 2024-04-24T13:33:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889050+0000", 2024-04-24T13:33:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002267107 2024-04-24T13:33:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889078+0000", 2024-04-24T13:33:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7623999999999998e-05 2024-04-24T13:33:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889091+0000", 2024-04-24T13:33:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3101e-05 2024-04-24T13:33:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889170+0000", 2024-04-24T13:33:14.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8968999999999996e-05 2024-04-24T13:33:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889311+0000", 2024-04-24T13:33:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141392 2024-04-24T13:33:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889451+0000", 2024-04-24T13:33:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139911 2024-04-24T13:33:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.895637+0000", 2024-04-24T13:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061857290000000001 2024-04-24T13:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912426+0000", 2024-04-24T13:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016789347999999999 2024-04-24T13:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912501+0000", 2024-04-24T13:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4836e-05 2024-04-24T13:33:14.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912558+0000", 2024-04-24T13:33:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6681000000000002e-05 2024-04-24T13:33:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2754 3.b e101/20 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head v 101'7, mlcod=86'5)", 2024-04-24T13:33:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.0481034380000001, 2024-04-24T13:33:14.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025167067000000001, 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985343+0000", 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.734e-06 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987192+0000", 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018490360000000001 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987224+0000", 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2588e-05 2024-04-24T13:33:14.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987241+0000", 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6350000000000001e-05 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987338+0000", 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7466000000000005e-05 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987368+0000", 2024-04-24T13:33:14.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0210999999999999e-05 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010454+0000", 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02308522 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010508+0000", 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4462000000000001e-05 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2755 3.12 3:4bcc7c5c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.0476915499999997, 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026401981000000001, 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2755 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985757+0000", 2024-04-24T13:33:14.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6370000000000001e-06 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987459+0000", 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017029180000000001 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987474+0000", 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4460999999999999e-05 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987484+0000", 2024-04-24T13:33:14.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0168e-05 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987576+0000", 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2020000000000003e-05 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987731+0000", 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015486499999999999 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987818+0000", 2024-04-24T13:33:14.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012049+0000", 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02423055 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012062+0000", 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3054000000000001e-05 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012114+0000", 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1656999999999997e-05 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012155+0000", 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1300000000000001e-05 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2762 3.39 3:9dc3ddb4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.9791778119999996, 2024-04-24T13:33:14.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02109138, 2024-04-24T13:33:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2762 2024-04-24T13:33:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054269+0000", 2024-04-24T13:33:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1859999999999999e-06 2024-04-24T13:33:14.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.055994+0000", 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001725196 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056030+0000", 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5914999999999997e-05 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056047+0000", 2024-04-24T13:33:14.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6693000000000001e-05 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056132+0000", 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5797000000000005e-05 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056297+0000", 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164265 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:14.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056460+0000", 2024-04-24T13:33:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016338600000000001 2024-04-24T13:33:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.066355+0000", 2024-04-24T13:33:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0098949050000000007 2024-04-24T13:33:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075280+0000", 2024-04-24T13:33:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089252210000000005 2024-04-24T13:33:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075324+0000", 2024-04-24T13:33:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3939000000000001e-05 2024-04-24T13:33:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075358+0000", 2024-04-24T13:33:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3877000000000001e-05 2024-04-24T13:33:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2764 3.23 3:c46f1960:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.9557012360000003, 2024-04-24T13:33:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020127275, 2024-04-24T13:33:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2764 2024-04-24T13:33:14.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077745+0000", 2024-04-24T13:33:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2800000000000002e-06 2024-04-24T13:33:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078808+0000", 2024-04-24T13:33:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001062351 2024-04-24T13:33:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078826+0000", 2024-04-24T13:33:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8045000000000001e-05 2024-04-24T13:33:14.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078835+0000", 2024-04-24T13:33:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5999999999999996e-06 2024-04-24T13:33:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078907+0000", 2024-04-24T13:33:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1068000000000005e-05 2024-04-24T13:33:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.079064+0000", 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157532 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.079221+0000", 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015694400000000001 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.092808+0000", 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013586671999999999 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097696+0000", 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004887906 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097795+0000", 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9701e-05 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097870+0000", 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5176e-05 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.125 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2770 3.1 3:80489e4c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.899838301, 2024-04-24T13:33:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025093718000000001, 2024-04-24T13:33:14.126 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2770 2024-04-24T13:33:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133609+0000", 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0369999999999999e-06 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135153+0000", 2024-04-24T13:33:14.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015441229999999999 2024-04-24T13:33:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135182+0000", 2024-04-24T13:33:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8300999999999999e-05 2024-04-24T13:33:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135196+0000", 2024-04-24T13:33:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4229999999999999e-05 2024-04-24T13:33:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135279+0000", 2024-04-24T13:33:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3549999999999998e-05 2024-04-24T13:33:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135458+0000", 2024-04-24T13:33:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017893100000000001 2024-04-24T13:33:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135611+0000", 2024-04-24T13:33:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152881 2024-04-24T13:33:14.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.144283+0000", 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086718709999999994 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158560+0000", 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014277306 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158642+0000", 2024-04-24T13:33:14.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1435999999999998e-05 2024-04-24T13:33:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158700+0000", 2024-04-24T13:33:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8051999999999999e-05 2024-04-24T13:33:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2788 3.39 3:9c7af06c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:14.132 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.7179760970000002, 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021514591999999999, 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2788 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:14.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315470+0000", 2024-04-24T13:33:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7680000000000001e-06 2024-04-24T13:33:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316763+0000", 2024-04-24T13:33:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001292947 2024-04-24T13:33:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316787+0000", 2024-04-24T13:33:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4068999999999999e-05 2024-04-24T13:33:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316799+0000", 2024-04-24T13:33:14.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2374999999999999e-05 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316874+0000", 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4133000000000003e-05 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316992+0000", 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117933 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:14.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.317153+0000", 2024-04-24T13:33:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000161101 2024-04-24T13:33:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.323588+0000", 2024-04-24T13:33:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064355749999999998 2024-04-24T13:33:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336852+0000", 2024-04-24T13:33:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013264233 2024-04-24T13:33:14.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336924+0000", 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1746000000000001e-05 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336983+0000", 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8712000000000003e-05 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2795 3.39 3:9fba68c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.64882711, 2024-04-24T13:33:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932186000000001, 2024-04-24T13:33:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2795 2024-04-24T13:33:14.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384619+0000", 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9939999999999999e-06 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386448+0000", 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001828744 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386484+0000", 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5976000000000002e-05 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386500+0000", 2024-04-24T13:33:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5746000000000001e-05 2024-04-24T13:33:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386604+0000", 2024-04-24T13:33:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104162 2024-04-24T13:33:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386806+0000", 2024-04-24T13:33:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020206400000000001 2024-04-24T13:33:14.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386995+0000", 2024-04-24T13:33:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018851 2024-04-24T13:33:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.398238+0000", 2024-04-24T13:33:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011243337000000001 2024-04-24T13:33:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404473+0000", 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062350979999999997 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404514+0000", 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1418999999999998e-05 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404550+0000", 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5135999999999997e-05 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.144 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2811 3.7 e101/41 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head v 101'8, mlcod=101'6)", 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.4528603220000003, 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026659326000000001, 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580586+0000", 2024-04-24T13:33:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.668e-06 2024-04-24T13:33:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582238+0000", 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016524829999999999 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582266+0000", 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8028e-05 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582282+0000", 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6047999999999999e-05 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582372+0000", 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9642999999999995e-05 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582400+0000", 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7776999999999998e-05 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607184+0000", 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024784418999999999 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607243+0000", 2024-04-24T13:33:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9259999999999998e-05 2024-04-24T13:33:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.149 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.149 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:14.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:14.151 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:14.149+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:14.251 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:14.250+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:14.271 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:14.272 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:14.272 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:14.272 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:14.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:33:14.371 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:14.370+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:14.443 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:14.444 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:14.444 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:14.444 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:14.444 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:14.453 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:14.450+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:14.456 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:33:14.555 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:14.554+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:14.630 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:14.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1615 3.1a e82/20 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head v 82'1, mlcod=0'0)", 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.414478527, 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013622553000000001, 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:14.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212985+0000", 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1370000000000001e-06 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219240+0000", 2024-04-24T13:33:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062543240000000003 2024-04-24T13:33:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219257+0000", 2024-04-24T13:33:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6940999999999999e-05 2024-04-24T13:33:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219267+0000", 2024-04-24T13:33:14.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0283e-05 2024-04-24T13:33:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219324+0000", 2024-04-24T13:33:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6950999999999997e-05 2024-04-24T13:33:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219343+0000", 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8681999999999998e-05 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226529+0000", 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071867169999999996 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226607+0000", 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7517999999999999e-05 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.635 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2219 3.0 3:00e6fe99:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.135324132999997, 2024-04-24T13:33:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01535366, 2024-04-24T13:33:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.636 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2219 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492150+0000", 2024-04-24T13:33:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1046999999999999e-05 2024-04-24T13:33:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494106+0000", 2024-04-24T13:33:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019561940000000001 2024-04-24T13:33:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494133+0000", 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7617999999999999e-05 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494150+0000", 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6096999999999999e-05 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494240+0000", 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0786999999999997e-05 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494435+0000", 2024-04-24T13:33:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000195021 2024-04-24T13:33:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494611+0000", 2024-04-24T13:33:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017601100000000001 2024-04-24T13:33:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507078+0000", 2024-04-24T13:33:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012466395 2024-04-24T13:33:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507374+0000", 2024-04-24T13:33:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029577100000000001 2024-04-24T13:33:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507429+0000", 2024-04-24T13:33:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5928999999999999e-05 2024-04-24T13:33:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507492+0000", 2024-04-24T13:33:14.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.279e-05 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2230 3.19 3:99352026:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.019341142999998, 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013072217000000001, 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2230 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608124+0000", 2024-04-24T13:33:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6740000000000001e-06 2024-04-24T13:33:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609736+0000", 2024-04-24T13:33:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016116430000000001 2024-04-24T13:33:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609766+0000", 2024-04-24T13:33:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0497e-05 2024-04-24T13:33:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609781+0000", 2024-04-24T13:33:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4810999999999999e-05 2024-04-24T13:33:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609861+0000", 2024-04-24T13:33:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9320999999999995e-05 2024-04-24T13:33:14.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609972+0000", 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111116 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.610087+0000", 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115161 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.620611+0000", 2024-04-24T13:33:14.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010524554 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621126+0000", 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051447699999999995 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621163+0000", 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6838999999999997e-05 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621194+0000", 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1124000000000002e-05 2024-04-24T13:33:14.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2252 3.4 3:22834b58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.781884193000003, 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932545999999999, 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.649 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2252 2024-04-24T13:33:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845581+0000", 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847834+0000", 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002252843 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847863+0000", 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.904e-05 2024-04-24T13:33:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847877+0000", 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4126e-05 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847963+0000", 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6162999999999995e-05 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848105+0000", 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014117900000000001 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848252+0000", 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014774800000000001 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865043+0000", 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016790848000000001 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865405+0000", 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036176900000000001 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865460+0000", 2024-04-24T13:33:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5334000000000002e-05 2024-04-24T13:33:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865511+0000", 2024-04-24T13:33:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0784e-05 2024-04-24T13:33:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.654 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2663 3.0 3:01df44a3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.4881101599999997, 2024-04-24T13:33:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020742727999999998, 2024-04-24T13:33:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2663 2024-04-24T13:33:14.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139355+0000", 2024-04-24T13:33:14.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2529999999999999e-06 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141777+0000", 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002422638 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141800+0000", 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2949e-05 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141812+0000", 2024-04-24T13:33:14.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1551e-05 2024-04-24T13:33:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141907+0000", 2024-04-24T13:33:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5296000000000004e-05 2024-04-24T13:33:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141917+0000", 2024-04-24T13:33:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.414e-06 2024-04-24T13:33:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144519+0000", 2024-04-24T13:33:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026024220000000001 2024-04-24T13:33:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144684+0000", 2024-04-24T13:33:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164511 2024-04-24T13:33:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144845+0000", 2024-04-24T13:33:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016157000000000001 2024-04-24T13:33:14.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.156972+0000", 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012126855000000001 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.159989+0000", 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003016609 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160059+0000", 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0598000000000004e-05 2024-04-24T13:33:14.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160095+0000", 2024-04-24T13:33:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6062000000000001e-05 2024-04-24T13:33:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2664 3.4 3:21467061:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.4746105630000006, 2024-04-24T13:33:14.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013894336, 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2664 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152854+0000", 2024-04-24T13:33:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0109999999999999e-06 2024-04-24T13:33:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154070+0000", 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012153940000000001 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154096+0000", 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6109e-05 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154110+0000", 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4489e-05 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154184+0000", 2024-04-24T13:33:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4035000000000005e-05 2024-04-24T13:33:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154325+0000", 2024-04-24T13:33:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014115500000000001 2024-04-24T13:33:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154474+0000", 2024-04-24T13:33:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000148811 2024-04-24T13:33:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.165413+0000", 2024-04-24T13:33:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010938333999999999 2024-04-24T13:33:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166625+0000", 2024-04-24T13:33:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001212526 2024-04-24T13:33:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166692+0000", 2024-04-24T13:33:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7013000000000004e-05 2024-04-24T13:33:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166747+0000", 2024-04-24T13:33:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4459000000000002e-05 2024-04-24T13:33:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2672 3.1c e100/74 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head v 100'4, mlcod=85'2)", 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.3899686029999998, 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022091785999999999, 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237495+0000", 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1500000000000005e-07 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243044+0000", 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055497869999999996 2024-04-24T13:33:14.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243082+0000", 2024-04-24T13:33:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7208e-05 2024-04-24T13:33:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243097+0000", 2024-04-24T13:33:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5554e-05 2024-04-24T13:33:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243175+0000", 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7849999999999995e-05 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243194+0000", 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8822999999999999e-05 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259527+0000", 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016333007 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259586+0000", 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9042000000000002e-05 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2677 3.25 3:a4f04b59:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.3450828510000008, 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015627926, 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.672 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2677 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:14.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282383+0000", 2024-04-24T13:33:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1499999999999999e-06 2024-04-24T13:33:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283869+0000", 2024-04-24T13:33:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014862269999999999 2024-04-24T13:33:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283897+0000", 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7596000000000001e-05 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283911+0000", 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.367e-05 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283981+0000", 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0349e-05 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284117+0000", 2024-04-24T13:33:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013656000000000001 2024-04-24T13:33:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284214+0000", 2024-04-24T13:33:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6558999999999995e-05 2024-04-24T13:33:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296745+0000", 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012530845000000001 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297925+0000", 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001179706 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297961+0000", 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6514999999999999e-05 2024-04-24T13:33:14.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.298008+0000", 2024-04-24T13:33:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6749000000000003e-05 2024-04-24T13:33:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.678 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2706 3.1c e100/74 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head v 100'5, mlcod=86'3)", 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.1526629219999993, 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021017514000000001, 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474802+0000", 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1399999999999998e-06 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480124+0000", 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053217059999999998 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480147+0000", 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3646e-05 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480159+0000", 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2133999999999999e-05 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480237+0000", 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7531e-05 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480291+0000", 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3851999999999999e-05 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495746+0000", 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015454684 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495817+0000", 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1821000000000002e-05 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2722 3.25 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.9952589120000006, 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035782711000000002, 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2722 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.683 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632207+0000", 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.252e-06 2024-04-24T13:33:14.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634575+0000", 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023682500000000001 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634606+0000", 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0284999999999999e-05 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634619+0000", 2024-04-24T13:33:14.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3491e-05 2024-04-24T13:33:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634703+0000", 2024-04-24T13:33:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4214000000000004e-05 2024-04-24T13:33:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634711+0000", 2024-04-24T13:33:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9719999999999992e-06 2024-04-24T13:33:14.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639813+0000", 2024-04-24T13:33:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051013830000000001 2024-04-24T13:33:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639969+0000", 2024-04-24T13:33:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015674600000000001 2024-04-24T13:33:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:14.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.640112+0000", 2024-04-24T13:33:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142347 2024-04-24T13:33:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647222+0000", 2024-04-24T13:33:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071106520000000003 2024-04-24T13:33:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667844+0000", 2024-04-24T13:33:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020621746999999999 2024-04-24T13:33:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667925+0000", 2024-04-24T13:33:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0717999999999995e-05 2024-04-24T13:33:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667987+0000", 2024-04-24T13:33:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1654000000000003e-05 2024-04-24T13:33:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2730 3.19 3:984637ec:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.9036124389999998, 2024-04-24T13:33:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014952841999999999, 2024-04-24T13:33:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2730 2024-04-24T13:33:14.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723854+0000", 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4180000000000001e-06 2024-04-24T13:33:14.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725292+0000", 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014378870000000001 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725322+0000", 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0596999999999999e-05 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725337+0000", 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4684999999999999e-05 2024-04-24T13:33:14.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725423+0000", 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5997999999999999e-05 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725596+0000", 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000172654 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725755+0000", 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015988600000000001 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734196+0000", 2024-04-24T13:33:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084404170000000004 2024-04-24T13:33:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738679+0000", 2024-04-24T13:33:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044834189999999998 2024-04-24T13:33:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738747+0000", 2024-04-24T13:33:14.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7890000000000002e-05 2024-04-24T13:33:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738803+0000", 2024-04-24T13:33:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5991e-05 2024-04-24T13:33:14.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2737 3.4 3:23416714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8343268080000001, 2024-04-24T13:33:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019181262000000001, 2024-04-24T13:33:14.696 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2737 2024-04-24T13:33:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793139+0000", 2024-04-24T13:33:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-04-24T13:33:14.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795403+0000", 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002264252 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795439+0000", 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5701999999999998e-05 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795454+0000", 2024-04-24T13:33:14.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5262999999999999e-05 2024-04-24T13:33:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795541+0000", 2024-04-24T13:33:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6989000000000003e-05 2024-04-24T13:33:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795719+0000", 2024-04-24T13:33:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000177906 2024-04-24T13:33:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795875+0000", 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155785 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.808532+0000", 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012657695 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812189+0000", 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036562809999999999 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812258+0000", 2024-04-24T13:33:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9210999999999999e-05 2024-04-24T13:33:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812317+0000", 2024-04-24T13:33:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9407000000000002e-05 2024-04-24T13:33:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2752 3.1c e101/74 3:3ae15365:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_81:head v 101'6, mlcod=100'4)", 2024-04-24T13:33:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.6670186499999993, 2024-04-24T13:33:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013320523000000001, 2024-04-24T13:33:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:14.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960446+0000", 2024-04-24T13:33:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0590000000000001e-06 2024-04-24T13:33:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.965992+0000", 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055462810000000001 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966034+0000", 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1485e-05 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966051+0000", 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7404000000000001e-05 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966178+0000", 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012681899999999999 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966198+0000", 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9944000000000001e-05 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.973717+0000", 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075185299999999998 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.973765+0000", 2024-04-24T13:33:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8000999999999997e-05 2024-04-24T13:33:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2772 3.1a e101/20 3:589df240:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_101:head v 101'3, mlcod=82'1)", 2024-04-24T13:33:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.467937203, 2024-04-24T13:33:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013122586, 2024-04-24T13:33:14.707 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159527+0000", 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165074+0000", 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055466129999999997 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165100+0000", 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5789e-05 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165110+0000", 2024-04-24T13:33:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0036e-05 2024-04-24T13:33:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165198+0000", 2024-04-24T13:33:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7981999999999999e-05 2024-04-24T13:33:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165229+0000", 2024-04-24T13:33:14.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1022999999999998e-05 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.172572+0000", 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073435519999999997 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.172648+0000", 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6013000000000006e-05 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2781 3.e e101/41 3:704d2ad1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_110:head v 101'4, mlcod=85'2)", 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.3767723029999992, 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017614365, 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250692+0000", 2024-04-24T13:33:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3570000000000001e-06 2024-04-24T13:33:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256430+0000", 2024-04-24T13:33:14.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057381300000000001 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256465+0000", 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4974000000000001e-05 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256480+0000", 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5000999999999999e-05 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256571+0000", 2024-04-24T13:33:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1008999999999995e-05 2024-04-24T13:33:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256599+0000", 2024-04-24T13:33:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7676000000000001e-05 2024-04-24T13:33:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268237+0000", 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011638081 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268305+0000", 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8137000000000002e-05 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2782 3.2b e101/41 3:d5b98152:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_111:head v 101'8, mlcod=86'6)", 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:14.716 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.3699882680000002, 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013494414, 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257476+0000", 2024-04-24T13:33:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.499e-06 2024-04-24T13:33:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259466+0000", 2024-04-24T13:33:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019901609999999998 2024-04-24T13:33:14.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259489+0000", 2024-04-24T13:33:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3144000000000001e-05 2024-04-24T13:33:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259502+0000", 2024-04-24T13:33:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3046e-05 2024-04-24T13:33:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259580+0000", 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7871e-05 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259607+0000", 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6828000000000001e-05 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.270920+0000", 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011312533 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.270969+0000", 2024-04-24T13:33:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9332000000000001e-05 2024-04-24T13:33:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2785 3.e e101/41 3:72bc610a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_114:head v 101'5, mlcod=86'3)", 2024-04-24T13:33:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.3349953509999999, 2024-04-24T13:33:14.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014730050999999999, 2024-04-24T13:33:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292470+0000", 2024-04-24T13:33:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2089999999999999e-06 2024-04-24T13:33:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297260+0000", 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047903989999999999 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297293+0000", 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3398000000000001e-05 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297309+0000", 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5290000000000001e-05 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297386+0000", 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7218999999999994e-05 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297406+0000", 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9936999999999999e-05 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.307133+0000", 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097276359999999996 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.307197+0000", 2024-04-24T13:33:14.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3962999999999997e-05 2024-04-24T13:33:14.726 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.726 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.726 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.726 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2810 3.16 3:69a6ac6a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:14.726 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:14.726 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.0717566210000005, 2024-04-24T13:33:14.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015206692000000001, 2024-04-24T13:33:14.726 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2810 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:14.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555709+0000", 2024-04-24T13:33:14.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0240000000000002e-06 2024-04-24T13:33:14.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557455+0000", 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001745763 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557482+0000", 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6679999999999999e-05 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557496+0000", 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4185000000000001e-05 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557575+0000", 2024-04-24T13:33:14.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9419000000000007e-05 2024-04-24T13:33:14.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557715+0000", 2024-04-24T13:33:14.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140264 2024-04-24T13:33:14.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:14.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557805+0000", 2024-04-24T13:33:14.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9511000000000004e-05 2024-04-24T13:33:14.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:14.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.563323+0000", 2024-04-24T13:33:14.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055181300000000004 2024-04-24T13:33:14.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:14.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570784+0000", 2024-04-24T13:33:14.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074609350000000001 2024-04-24T13:33:14.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570856+0000", 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1484999999999997e-05 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570913+0000", 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7296000000000002e-05 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2813 3.6 e101/20 3:63b60245:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_142:head v 101'4, mlcod=86'2)", 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.0350527370000009, 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015409209, 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592412+0000", 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2819999999999999e-06 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594446+0000", 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020333840000000001 2024-04-24T13:33:14.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594471+0000", 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5287e-05 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594482+0000", 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1063999999999999e-05 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594585+0000", 2024-04-24T13:33:14.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010303500000000001 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594609+0000", 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3951000000000002e-05 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607767+0000", 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013158115999999999 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607819+0000", 2024-04-24T13:33:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2089999999999998e-05 2024-04-24T13:33:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2814 3.8 e101/20 3:11e81300:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_143:head v 101'7, mlcod=101'5)", 2024-04-24T13:33:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.0230164300000002, 2024-04-24T13:33:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013378928999999999, 2024-04-24T13:33:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:14.737 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:14.738 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:14.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:14.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:14.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:14.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:14.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:14.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:14.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604448+0000", 2024-04-24T13:33:14.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4610000000000001e-06 2024-04-24T13:33:14.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:14.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606315+0000", 2024-04-24T13:33:14.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001866957 2024-04-24T13:33:14.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606338+0000", 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3010000000000002e-05 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606352+0000", 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4754e-05 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606438+0000", 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5239000000000002e-05 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606466+0000", 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8476999999999999e-05 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.617758+0000", 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011291436 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.617825+0000", 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7595000000000006e-05 2024-04-24T13:33:14.741 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.742 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:14.742 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:14.742 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:14.744 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:33:14.745 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:33:14.745 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:14.742+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:14.845 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:14.845+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:14.918 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:14.918 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:14.918 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:14.918 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:14.934 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:33:14.946 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:14.941+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:15.046 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:15.045+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:15.064 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:15.064 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:15.065 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:15.079 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:33:15.148 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:15.146+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:15.204 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:15.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2206 3.f 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.910560932000003, 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028291495999999999, 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2206 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290398+0000", 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000001e-06 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294671+0000", 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042724390000000003 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294711+0000", 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0376000000000001e-05 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294730+0000", 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8607e-05 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294856+0000", 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126651 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295125+0000", 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026840700000000002 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295349+0000", 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022454699999999999 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307240+0000", 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011891048 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318593+0000", 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011352777999999999 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318652+0000", 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8677000000000001e-05 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318686+0000", 2024-04-24T13:33:15.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4616000000000002e-05 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2209 3.14 3:287cf44b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.865256772000002, 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020682494999999999, 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2209 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335702+0000", 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339081+0000", 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003378664 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339119+0000", 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8355999999999997e-05 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339138+0000", 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8546000000000002e-05 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339268+0000", 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013028599999999999 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339503+0000", 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023542699999999999 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339734+0000", 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023122 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.348300+0000", 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085659870000000006 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356108+0000", 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078075109999999996 2024-04-24T13:33:15.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356259+0000", 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015104800000000001 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356381+0000", 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012243599999999999 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2227 3.14 3:28702767:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.623958139999999, 2024-04-24T13:33:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017797177000000001, 2024-04-24T13:33:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2227 2024-04-24T13:33:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.216 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:15.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.577000+0000", 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8760000000000001e-06 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579496+0000", 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024951740000000002 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579521+0000", 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5361e-05 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579533+0000", 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2377e-05 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579602+0000", 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8325999999999996e-05 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579799+0000", 2024-04-24T13:33:15.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019773800000000001 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579997+0000", 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019725299999999999 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.586752+0000", 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006755179 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594712+0000", 2024-04-24T13:33:15.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079597049999999992 2024-04-24T13:33:15.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594757+0000", 2024-04-24T13:33:15.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4956000000000001e-05 2024-04-24T13:33:15.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594795+0000", 2024-04-24T13:33:15.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8232000000000003e-05 2024-04-24T13:33:15.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2244 3.3b 3:ddfbb493:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.43555929, 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020329852999999998, 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2244 2024-04-24T13:33:15.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.223 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:15.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:15.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765398+0000", 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.291e-06 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766959+0000", 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015617680000000001 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766985+0000", 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5899999999999999e-05 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766996+0000", 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0642000000000001e-05 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767076+0000", 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9542999999999994e-05 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767184+0000", 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107964 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:15.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767269+0000", 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5798999999999996e-05 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.772877+0000", 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056080560000000002 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785554+0000", 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012676642 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785639+0000", 2024-04-24T13:33:15.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4938999999999994e-05 2024-04-24T13:33:15.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785726+0000", 2024-04-24T13:33:15.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7309e-05 2024-04-24T13:33:15.227 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.227 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.227 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.227 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2265 3.14 3:2a53907b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.205520823000001, 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016926096000000002, 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2265 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:15.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995438+0000", 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1080000000000001e-06 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997447+0000", 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002008625 2024-04-24T13:33:15.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997484+0000", 2024-04-24T13:33:15.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7070999999999998e-05 2024-04-24T13:33:15.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997508+0000", 2024-04-24T13:33:15.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4324999999999998e-05 2024-04-24T13:33:15.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997617+0000", 2024-04-24T13:33:15.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010898799999999999 2024-04-24T13:33:15.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997787+0000", 2024-04-24T13:33:15.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000169956 2024-04-24T13:33:15.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997949+0000", 2024-04-24T13:33:15.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016190599999999999 2024-04-24T13:33:15.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.005098+0000", 2024-04-24T13:33:15.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071488300000000001 2024-04-24T13:33:15.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012231+0000", 2024-04-24T13:33:15.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071334040000000003 2024-04-24T13:33:15.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012305+0000", 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4017000000000006e-05 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012361+0000", 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2669 3.21 3:86a0e0c3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.9986302729999998, 2024-04-24T13:33:15.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020962138000000002, 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2669 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202328+0000", 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-06 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204239+0000", 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019104409999999999 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204265+0000", 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6054000000000002e-05 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204279+0000", 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3654e-05 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204361+0000", 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2522999999999996e-05 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204523+0000", 2024-04-24T13:33:15.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000162332 2024-04-24T13:33:15.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204661+0000", 2024-04-24T13:33:15.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013798200000000001 2024-04-24T13:33:15.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.210336+0000", 2024-04-24T13:33:15.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056743339999999996 2024-04-24T13:33:15.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223107+0000", 2024-04-24T13:33:15.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012771714999999999 2024-04-24T13:33:15.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223228+0000", 2024-04-24T13:33:15.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012061300000000001 2024-04-24T13:33:15.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223288+0000", 2024-04-24T13:33:15.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9537999999999998e-05 2024-04-24T13:33:15.239 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.239 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.239 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.239 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2670 3.14 3:2b621d8a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:15.240 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:15.240 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.9892242390000003, 2024-04-24T13:33:15.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018441043000000001, 2024-04-24T13:33:15.240 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.240 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.240 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.241 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.241 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.241 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.241 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2670 2024-04-24T13:33:15.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.241 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:15.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211734+0000", 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3429999999999998e-06 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213786+0000", 2024-04-24T13:33:15.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002052637 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213813+0000", 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6193000000000001e-05 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213825+0000", 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1905999999999999e-05 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213906+0000", 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1075999999999994e-05 2024-04-24T13:33:15.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.214023+0000", 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117738 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.214134+0000", 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011082900000000001 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.220138+0000", 2024-04-24T13:33:15.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060042059999999998 2024-04-24T13:33:15.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230042+0000", 2024-04-24T13:33:15.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099037559999999997 2024-04-24T13:33:15.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230116+0000", 2024-04-24T13:33:15.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3742e-05 2024-04-24T13:33:15.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230173+0000", 2024-04-24T13:33:15.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6616999999999997e-05 2024-04-24T13:33:15.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.246 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.246 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.246 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2710 3.3b 3:ddce91ac:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:15.247 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:15.247 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6888278650000004, 2024-04-24T13:33:15.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026438756000000001, 2024-04-24T13:33:15.247 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.247 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.247 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2710 2024-04-24T13:33:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512131+0000", 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0130000000000002e-06 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514363+0000", 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022325940000000001 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514394+0000", 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0144000000000001e-05 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514409+0000", 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5786000000000001e-05 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514497+0000", 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7876999999999999e-05 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514670+0000", 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000173096 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514768+0000", 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8089000000000002e-05 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.523354+0000", 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085854190000000004 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.251 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538483+0000", 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015128922 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538527+0000", 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3835999999999998e-05 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538567+0000", 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.998e-05 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.252 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2711 3.13 e100/41 3:c9a0442c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_40:head v 100'9, mlcod=86'7)", 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6734854489999993, 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016831724999999999, 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:15.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527472+0000", 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6619999999999999e-06 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533965+0000", 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064927159999999999 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533980+0000", 2024-04-24T13:33:15.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5192e-05 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533989+0000", 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3950000000000007e-06 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.534040+0000", 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0822000000000002e-05 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.534066+0000", 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6341000000000001e-05 2024-04-24T13:33:15.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.544246+0000", 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010179354 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.544302+0000", 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6242999999999997e-05 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2712 3.2e 3:74e2d347:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.532098+0000", 2024-04-24T13:33:15.256 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6688578520000004, 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016599603000000001, 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2712 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.532098+0000", 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.532098+0000", 2024-04-24T13:33:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.532101+0000", 2024-04-24T13:33:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1860000000000001e-06 2024-04-24T13:33:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533278+0000", 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001177188 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533313+0000", 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5212000000000001e-05 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533329+0000", 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5866e-05 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533406+0000", 2024-04-24T13:33:15.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6520000000000006e-05 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533570+0000", 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016464100000000001 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533729+0000", 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015817199999999999 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.541495+0000", 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077664429999999996 2024-04-24T13:33:15.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.548603+0000", 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071077240000000002 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.548642+0000", 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8838999999999999e-05 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.548697+0000", 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5812e-05 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.261 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2716 3.13 e100/41 3:c8fec211:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_45:head v 100'10, mlcod=86'8)", 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6238149689999997, 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017185506, 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:15.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577143+0000", 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.824e-06 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581297+0000", 2024-04-24T13:33:15.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041541770000000002 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581333+0000", 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6559e-05 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581349+0000", 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6036999999999999e-05 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581429+0000", 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9404000000000001e-05 2024-04-24T13:33:15.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581449+0000", 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9949000000000002e-05 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.594260+0000", 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012811207999999999 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.594326+0000", 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6347999999999996e-05 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.265 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2728 3.21 3:8520d077:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.4936160940000001, 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019867991000000002, 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.266 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2728 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707342+0000", 2024-04-24T13:33:15.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8480000000000001e-06 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709741+0000", 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002398346 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709770+0000", 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9522e-05 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709786+0000", 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5373e-05 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709865+0000", 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9024999999999996e-05 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709984+0000", 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011908000000000001 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.710086+0000", 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102656 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.719183+0000", 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.009096491 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727080+0000", 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078969309999999994 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727152+0000", 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1816999999999994e-05 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727208+0000", 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5902000000000001e-05 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2738 3.2d 3:b6fa79b0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.3982173610000004, 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016982181999999998, 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.271 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2738 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802741+0000", 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1739999999999999e-06 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804165+0000", 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014248780000000001 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804188+0000", 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989e-05 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804199+0000", 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0179e-05 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804281+0000", 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2139999999999996e-05 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804456+0000", 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000175074 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804566+0000", 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109931 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.811275+0000", 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067095560000000002 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819557+0000", 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0082818370000000002 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819644+0000", 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6885000000000006e-05 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819721+0000", 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6538999999999993e-05 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2750 3.2e 3:76c7df3c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:15.276 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.2676592729999996, 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019169064, 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2750 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933299+0000", 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.751e-06 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935078+0000", 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017788420000000001 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935120+0000", 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1875999999999997e-05 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935138+0000", 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7784000000000001e-05 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935244+0000", 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106041 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935426+0000", 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018206299999999999 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935583+0000", 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000156754 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.944883+0000", 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093004400000000001 2024-04-24T13:33:15.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952389+0000", 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075064149999999998 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952431+0000", 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1801999999999997e-05 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952466+0000", 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4295999999999998e-05 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.281 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.282 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.282 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2751 3.2e 3:7757132e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.282 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:15.282 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.2579217410000005, 2024-04-24T13:33:15.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019504242000000001, 2024-04-24T13:33:15.282 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.283 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.283 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.283 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.283 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2751 2024-04-24T13:33:15.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.283 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943037+0000", 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9189999999999999e-06 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946091+0000", 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030545709999999998 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946117+0000", 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5666000000000001e-05 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946131+0000", 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4243999999999999e-05 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946202+0000", 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0798999999999998e-05 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946357+0000", 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154785 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946465+0000", 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107675 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952338+0000", 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058734720000000002 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962433+0000", 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010094462 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962484+0000", 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1913999999999998e-05 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962538+0000", 2024-04-24T13:33:15.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3735e-05 2024-04-24T13:33:15.288 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.288 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.288 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.288 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2789 3.14 3:283784b4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.288 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:15.288 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.8763970410000006, 2024-04-24T13:33:15.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017567818999999998, 2024-04-24T13:33:15.288 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.288 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.288 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.288 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.289 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.289 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.289 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2789 2024-04-24T13:33:15.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.289 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:15.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:15.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324561+0000", 2024-04-24T13:33:15.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5780000000000001e-06 2024-04-24T13:33:15.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325957+0000", 2024-04-24T13:33:15.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013953640000000001 2024-04-24T13:33:15.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325979+0000", 2024-04-24T13:33:15.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2724000000000001e-05 2024-04-24T13:33:15.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325989+0000", 2024-04-24T13:33:15.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0135999999999999e-05 2024-04-24T13:33:15.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326053+0000", 2024-04-24T13:33:15.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3554999999999997e-05 2024-04-24T13:33:15.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326175+0000", 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121558 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326275+0000", 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100512 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.332109+0000", 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058341080000000002 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342050+0000", 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099405489999999999 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342093+0000", 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3472e-05 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342127+0000", 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3263000000000003e-05 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2798 3.3b 3:de5094ab:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.7795221219999995, 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019231912, 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2798 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.296 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421436+0000", 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7300000000000001e-06 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423782+0000", 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023461250000000001 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423810+0000", 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7937e-05 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423823+0000", 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.279e-05 2024-04-24T13:33:15.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423938+0000", 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011457 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.424090+0000", 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015250600000000001 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.424183+0000", 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2351999999999999e-05 2024-04-24T13:33:15.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.429881+0000", 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056981360000000003 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440513+0000", 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010632354 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440598+0000", 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4860999999999999e-05 2024-04-24T13:33:15.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440666+0000", 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7551000000000004e-05 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2806 3.2d 3:b44f16d5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.6937486069999999, 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017054071000000001, 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.301 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.302 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.302 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.302 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.302 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.302 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2806 2024-04-24T13:33:15.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.302 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:15.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507209+0000", 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2620000000000001e-06 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508811+0000", 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016020940000000001 2024-04-24T13:33:15.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508837+0000", 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5207000000000001e-05 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508849+0000", 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2571999999999999e-05 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508927+0000", 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7448999999999997e-05 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.509058+0000", 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013080599999999999 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.509198+0000", 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014016500000000001 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.514234+0000", 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050359230000000003 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524162+0000", 2024-04-24T13:33:15.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099284430000000003 2024-04-24T13:33:15.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524207+0000", 2024-04-24T13:33:15.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126000000000001e-05 2024-04-24T13:33:15.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524261+0000", 2024-04-24T13:33:15.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4024000000000003e-05 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2808 3.2e 3:7441f999:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.6695931640000001, 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021413788, 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.307 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2808 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531366+0000", 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1089999999999998e-06 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533059+0000", 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001693186 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533088+0000", 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9470000000000001e-05 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533100+0000", 2024-04-24T13:33:15.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1979e-05 2024-04-24T13:33:15.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533176+0000", 2024-04-24T13:33:15.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5691000000000004e-05 2024-04-24T13:33:15.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533334+0000", 2024-04-24T13:33:15.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015822199999999999 2024-04-24T13:33:15.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533513+0000", 2024-04-24T13:33:15.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178846 2024-04-24T13:33:15.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.546303+0000", 2024-04-24T13:33:15.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012790331 2024-04-24T13:33:15.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552696+0000", 2024-04-24T13:33:15.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063923169999999998 2024-04-24T13:33:15.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552741+0000", 2024-04-24T13:33:15.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126999999999997e-05 2024-04-24T13:33:15.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552776+0000", 2024-04-24T13:33:15.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5509999999999997e-05 2024-04-24T13:33:15.314 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.314 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.314 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.314 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2817 3.13 e101/41 3:c886ce92:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_146:head v 101'13, mlcod=101'11)", 2024-04-24T13:33:15.314 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.644060+0000", 2024-04-24T13:33:15.315 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.5568952500000002, 2024-04-24T13:33:15.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018239697999999999, 2024-04-24T13:33:15.315 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.315 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.315 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.315 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.644060+0000", 2024-04-24T13:33:15.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.644060+0000", 2024-04-24T13:33:15.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.644062+0000", 2024-04-24T13:33:15.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.172e-06 2024-04-24T13:33:15.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.650858+0000", 2024-04-24T13:33:15.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067958610000000003 2024-04-24T13:33:15.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.650875+0000", 2024-04-24T13:33:15.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7226000000000001e-05 2024-04-24T13:33:15.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.650885+0000", 2024-04-24T13:33:15.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0183999999999999e-05 2024-04-24T13:33:15.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.651082+0000", 2024-04-24T13:33:15.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019680399999999999 2024-04-24T13:33:15.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.651109+0000", 2024-04-24T13:33:15.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7322999999999999e-05 2024-04-24T13:33:15.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.662226+0000", 2024-04-24T13:33:15.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011116737999999999 2024-04-24T13:33:15.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.662300+0000", 2024-04-24T13:33:15.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4389999999999998e-05 2024-04-24T13:33:15.321 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.322 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.322 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.322 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.322 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.322 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:15.323 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:33:15.324 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:15.321+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:15.424 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:15.422+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:15.497 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:15.498 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:15.498 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:15.512 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:33:15.525 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:15.521+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:15.626 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:15.625+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:15.680 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:15.680 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:15.681 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:15.681 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:15.681 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:15.694 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:33:15.733 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:33:15.739 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:15.738+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:15.819 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:15.819 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:15.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:15.819 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:15.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.819 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2207 3.38 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:15.819 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:15.819 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.514721835000003, 2024-04-24T13:33:15.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022686873999999999, 2024-04-24T13:33:15.819 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.819 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.819 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2207 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:15.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302499+0000", 2024-04-24T13:33:15.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-04-24T13:33:15.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307861+0000", 2024-04-24T13:33:15.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053622089999999997 2024-04-24T13:33:15.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307899+0000", 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978999999999997e-05 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307917+0000", 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8576999999999998e-05 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308018+0000", 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010080499999999999 2024-04-24T13:33:15.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308202+0000", 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000183628 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308352+0000", 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149806 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318520+0000", 2024-04-24T13:33:15.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010168744 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.324908+0000", 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063874739999999998 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325063+0000", 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155131 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325182+0000", 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011915499999999999 2024-04-24T13:33:15.824 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.491127122000002, 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.825 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:15.830 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.346071268000003, 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:33:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:33:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:33:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:33:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:33:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:33:15.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:33:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:33:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:33:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:33:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:15.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:33:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:33:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:33:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:33:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:33:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:33:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.836 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2242 3.b 3:d16b554f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 47.077572336000003, 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022940439, 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2242 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739648+0000", 2024-04-24T13:33:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.785e-06 2024-04-24T13:33:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741765+0000", 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002117655 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741781+0000", 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6062e-05 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741792+0000", 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0937999999999999e-05 2024-04-24T13:33:15.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741918+0000", 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623199999999999 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742189+0000", 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027047300000000002 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742430+0000", 2024-04-24T13:33:15.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024077699999999999 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752990+0000", 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010559875 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762422+0000", 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094325120000000005 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762510+0000", 2024-04-24T13:33:15.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7879000000000003e-05 2024-04-24T13:33:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762585+0000", 2024-04-24T13:33:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5251000000000002e-05 2024-04-24T13:33:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2662 3.33 3:ce195145:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:15.842 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.688654029, 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028670389000000001, 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2662 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128567+0000", 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4640000000000002e-06 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130845+0000", 2024-04-24T13:33:15.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002278389 2024-04-24T13:33:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130869+0000", 2024-04-24T13:33:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4394999999999999e-05 2024-04-24T13:33:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130879+0000", 2024-04-24T13:33:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0000000000000001e-05 2024-04-24T13:33:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130957+0000", 2024-04-24T13:33:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7968999999999998e-05 2024-04-24T13:33:15.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130963+0000", 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2499999999999997e-06 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137507+0000", 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065442900000000003 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137607+0000", 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010002599999999999 2024-04-24T13:33:15.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137727+0000", 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120142 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152307+0000", 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01458017 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157112+0000", 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048051350000000003 2024-04-24T13:33:15.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157181+0000", 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9051e-05 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157233+0000", 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2108000000000003e-05 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2673 3.18 3:1a01061c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:15.849 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.241832+0000", 2024-04-24T13:33:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.57538461, 2024-04-24T13:33:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020587687, 2024-04-24T13:33:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2673 2024-04-24T13:33:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.241832+0000", 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.241832+0000", 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.241835+0000", 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.238e-06 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243821+0000", 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019861620000000001 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243846+0000", 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4861000000000001e-05 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243867+0000", 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1535e-05 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243970+0000", 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102564 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.244131+0000", 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016069000000000001 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.244283+0000", 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152149 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259574+0000", 2024-04-24T13:33:15.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015291310000000001 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.262266+0000", 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002691588 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.262342+0000", 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5957000000000005e-05 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.262420+0000", 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8633000000000004e-05 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2676 3.22 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.545452121, 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025889562000000001, 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.855 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2676 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271767+0000", 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.273986+0000", 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022195560000000001 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274011+0000", 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4953e-05 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274023+0000", 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1856e-05 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274116+0000", 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3168e-05 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274377+0000", 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026071500000000001 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274531+0000", 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015427299999999999 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297124+0000", 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022592476 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297544+0000", 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000420691 2024-04-24T13:33:15.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297605+0000", 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0888999999999999e-05 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297655+0000", 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9119999999999997e-05 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2680 3.29 3:9533dbeb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.313354+0000", 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.503863338, 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019941483999999999, 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2680 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.313354+0000", 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.313354+0000", 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.313356+0000", 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6240000000000002e-06 2024-04-24T13:33:15.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315045+0000", 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016891370000000001 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315060+0000", 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315067+0000", 2024-04-24T13:33:15.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1849999999999998e-06 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315143+0000", 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5777000000000003e-05 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315282+0000", 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013928500000000001 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315392+0000", 2024-04-24T13:33:15.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010989699999999999 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.326123+0000", 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010730669 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.333171+0000", 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070476039999999998 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.333245+0000", 2024-04-24T13:33:15.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4709000000000006e-05 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.333295+0000", 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9861000000000003e-05 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2722 3.25 e101/20 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head v 101'6, mlcod=86'4)", 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.173706839999999, 2024-04-24T13:33:15.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023380372, 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643511+0000", 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4400000000000001e-07 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647450+0000", 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039389259999999997 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647470+0000", 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0534e-05 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647484+0000", 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3370000000000001e-05 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647599+0000", 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115513 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647629+0000", 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0145e-05 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666761+0000", 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019132303999999999 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666891+0000", 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012913599999999999 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.870 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2726 3.3c e101/20 3:3c53550d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_55:head v 101'5, mlcod=86'3)", 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.124826200999999, 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021010132000000001, 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:15.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9999999999999999e-07 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701201+0000", 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088100639999999994 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701230+0000", 2024-04-24T13:33:15.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8428e-05 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701243+0000", 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3635000000000001e-05 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701333+0000", 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9765999999999994e-05 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701362+0000", 2024-04-24T13:33:15.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8810999999999999e-05 2024-04-24T13:33:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713347+0000", 2024-04-24T13:33:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011985657 2024-04-24T13:33:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713401+0000", 2024-04-24T13:33:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3570999999999999e-05 2024-04-24T13:33:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.874 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2729 3.7 3:e1d3d801:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.713957+0000", 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.103260375, 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020212523, 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2729 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.875 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713957+0000", 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713957+0000", 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713959+0000", 2024-04-24T13:33:15.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2929999999999999e-06 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716255+0000", 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022955900000000001 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716282+0000", 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7682e-05 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716309+0000", 2024-04-24T13:33:15.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7138999999999999e-05 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716389+0000", 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9653000000000005e-05 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716534+0000", 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145103 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:15.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716647+0000", 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112545 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.732778+0000", 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016131555999999998 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734055+0000", 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012767130000000001 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734120+0000", 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4781000000000002e-05 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734169+0000", 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9468000000000001e-05 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2740 3.15 3:abd27dc3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.823008+0000", 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.9942088610000006, 2024-04-24T13:33:15.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021456604000000001, 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2740 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.823008+0000", 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.823008+0000", 2024-04-24T13:33:15.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.823011+0000", 2024-04-24T13:33:15.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.813e-06 2024-04-24T13:33:15.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824873+0000", 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001861693 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824895+0000", 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2067000000000001e-05 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824905+0000", 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7329999999999998e-06 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824974+0000", 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9072000000000005e-05 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.825139+0000", 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016501299999999999 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.825236+0000", 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7441000000000004e-05 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.831503+0000", 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062670470000000004 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.844370+0000", 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012867197 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.844428+0000", 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7750000000000001e-05 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.844465+0000", 2024-04-24T13:33:15.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6777999999999999e-05 2024-04-24T13:33:15.886 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.886 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.886 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.886 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2742 3.7 3:e2cb8889:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.886 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.843817+0000", 2024-04-24T13:33:15.886 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.9734001639999992, 2024-04-24T13:33:15.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020067055, 2024-04-24T13:33:15.886 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.886 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.886 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2742 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.843817+0000", 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.843817+0000", 2024-04-24T13:33:15.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.843820+0000", 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6299999999999998e-06 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845621+0000", 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001801469 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845648+0000", 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6754000000000002e-05 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845664+0000", 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5988999999999999e-05 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845732+0000", 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8178999999999999e-05 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845893+0000", 2024-04-24T13:33:15.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000160586 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845988+0000", 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5445000000000005e-05 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.859957+0000", 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013968993000000001 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.863761+0000", 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038042699999999998 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.863831+0000", 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9663e-05 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.863884+0000", 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3077e-05 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2747 3.24 3:2754d069:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.9191569780000002, 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024857536999999999, 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2747 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898063+0000", 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5289999999999998e-06 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899956+0000", 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932759999999999 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899984+0000", 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7801999999999999e-05 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899997+0000", 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3127e-05 2024-04-24T13:33:15.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900063+0000", 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900200+0000", 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000137324 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900302+0000", 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010168 2024-04-24T13:33:15.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.908151+0000", 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078489579999999996 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922784+0000", 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014633116 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922860+0000", 2024-04-24T13:33:15.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5708000000000001e-05 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922918+0000", 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7686000000000003e-05 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2753 3.24 3:261ef004:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.964749+0000", 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.8524680880000002, 2024-04-24T13:33:15.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021608380999999999, 2024-04-24T13:33:15.898 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.898 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.898 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.898 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.898 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.898 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.898 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2753 2024-04-24T13:33:15.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.898 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.964749+0000", 2024-04-24T13:33:15.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.964749+0000", 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.964752+0000", 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2090000000000001e-06 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966363+0000", 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016103560000000001 2024-04-24T13:33:15.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966388+0000", 2024-04-24T13:33:15.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-05 2024-04-24T13:33:15.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966401+0000", 2024-04-24T13:33:15.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.376e-05 2024-04-24T13:33:15.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966476+0000", 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4657e-05 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966638+0000", 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016182699999999999 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966730+0000", 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2169999999999993e-05 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.976261+0000", 2024-04-24T13:33:15.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095310770000000006 2024-04-24T13:33:15.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.986217+0000", 2024-04-24T13:33:15.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099560849999999999 2024-04-24T13:33:15.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.986298+0000", 2024-04-24T13:33:15.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.119e-05 2024-04-24T13:33:15.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.986357+0000", 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8909999999999997e-05 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2754 3.b 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.8386874780000007, 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.032358206, 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.903 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2754 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978532+0000", 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6079999999999998e-06 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979768+0000", 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012357869999999999 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979791+0000", 2024-04-24T13:33:15.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3224e-05 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979804+0000", 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.274e-05 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979889+0000", 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5483999999999997e-05 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980063+0000", 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017384599999999999 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980227+0000", 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163764 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987774+0000", 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075472029999999997 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010776+0000", 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023001886999999999 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010838+0000", 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1527999999999998e-05 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010888+0000", 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0135e-05 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.908 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2755 3.12 e101/41 3:4bcc7c5c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_84:head v 101'8, mlcod=100'6)", 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.987913+0000", 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.8293036459999996, 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020118325999999999, 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987913+0000", 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987913+0000", 2024-04-24T13:33:15.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987915+0000", 2024-04-24T13:33:15.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.491e-06 2024-04-24T13:33:15.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.989911+0000", 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019958509999999999 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.989936+0000", 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5216e-05 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.989951+0000", 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4705000000000001e-05 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.990053+0000", 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102717 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.990083+0000", 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.919e-05 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.007955+0000", 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017872308 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.008032+0000", 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6847999999999993e-05 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2811 3.7 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.2470486459999996, 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044582597000000002, 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.913 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2811 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570171+0000", 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9100000000000001e-06 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580122+0000", 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099505930000000006 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580150+0000", 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7827e-05 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580164+0000", 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4547e-05 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580245+0000", 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0810999999999996e-05 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580355+0000", 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109656 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580475+0000", 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120278 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607433+0000", 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026957894 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614636+0000", 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072028359999999998 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614703+0000", 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7645999999999996e-05 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614751+0000", 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7599000000000003e-05 2024-04-24T13:33:15.918 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2812 3.1e 3:7bd62ca6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.2370047660000001, 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.038041177000000002, 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.919 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2812 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580214+0000", 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.708e-06 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582574+0000", 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023601799999999999 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582591+0000", 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6648999999999999e-05 2024-04-24T13:33:15.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582598+0000", 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.391e-06 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583731+0000", 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011332029999999999 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583843+0000", 2024-04-24T13:33:15.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111889 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583936+0000", 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2968999999999997e-05 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.599363+0000", 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015427186000000001 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618143+0000", 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018779051000000001 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618200+0000", 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7151999999999998e-05 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618253+0000", 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3798999999999998e-05 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2814 3.8 3:11e81300:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.601840+0000", 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.2153766929999996, 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020012404000000001, 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2814 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:15.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.601840+0000", 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.601840+0000", 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.601843+0000", 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5150000000000001e-06 2024-04-24T13:33:15.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.603850+0000", 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020069179999999999 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.603879+0000", 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9251000000000002e-05 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.603893+0000", 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3529e-05 2024-04-24T13:33:15.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.603979+0000", 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6737000000000007e-05 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604155+0000", 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017538499999999999 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604323+0000", 2024-04-24T13:33:15.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016819599999999999 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618337+0000", 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014014037 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.621551+0000", 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032136420000000001 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.621704+0000", 2024-04-24T13:33:15.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153036 2024-04-24T13:33:15.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:15.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:15.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:15.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.621853+0000", 2024-04-24T13:33:15.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014915800000000001 2024-04-24T13:33:15.930 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.930 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.930 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.930 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:15.930 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:15.930 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:15.932 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:33:15.932 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:15.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:15.933 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:15.933 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:15.933 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:15.934 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:15.934 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:15.929+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:15.937 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:15.937 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:15.957 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:15.958 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:15.976 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:15.976 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:15.995 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:15.995 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:16.013 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:16.013 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:16.065 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:16.065 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:16.075 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:16.074+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:16.079 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:33:16.133 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:16.129+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:16.202 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:16.202 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:16.216 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:33:16.234 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:16.230+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:16.334 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:16.330+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:16.378 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:16.378 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:16.392 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:33:16.435 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:16.434+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:16.514 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:16.515 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:16.529 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:33:16.536 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:16.534+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:16.638 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:16.634+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:16.649 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:16.649 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:16.663 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:33:16.738 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:16.737+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:16.746 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:33:16.790 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:16.791 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:16.805 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:33:16.846 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:16.845+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:16.941 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:16.938+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:16.969 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:16.970 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:16.983 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:33:17.042 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:17.038+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:17.106 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:17.106 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:17.120 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:33:17.143 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:17.142+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:17.245 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:17.242+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:17.245 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:17.245 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:17.259 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:33:17.345 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:17.341+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:17.383 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:17.383 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:17.397 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:17.482 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:17.481+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:17.548 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:17.545+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:17.560 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:17.561 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:17.575 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:17.648 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:17.646+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:17.743 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:17.743 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:17.749 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:17.746+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:17.756 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:33:17.760 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:17.852 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:17.850+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:17.883 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:17.884 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:17.898 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:17.987 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:17.986+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:18.032 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:33:18.065 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:18.065 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:18.066 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:18.062+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:18.081 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:18.152 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:18.149+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:18.170 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:18.170 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:18.187 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:18.187 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:18.205 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:18.205 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:18.222 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:18.222 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:18.243 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:18.243 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:18.253 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:18.250+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:18.256 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:18.257 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:18.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:18.257 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:18.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.257 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2206 3.f e85/48 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:18.257 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:18.257 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 49.959793005000002, 2024-04-24T13:33:18.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022785151, 2024-04-24T13:33:18.257 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.257 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.257 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.257 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:18.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:18.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295567+0000", 2024-04-24T13:33:18.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3939999999999999e-06 2024-04-24T13:33:18.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299770+0000", 2024-04-24T13:33:18.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042038029999999999 2024-04-24T13:33:18.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299808+0000", 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7703000000000001e-05 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299826+0000", 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8142999999999999e-05 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299972+0000", 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000146095 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.300023+0000", 2024-04-24T13:33:18.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0294999999999999e-05 2024-04-24T13:33:18.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318209+0000", 2024-04-24T13:33:18.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018186099000000001 2024-04-24T13:33:18.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318349+0000", 2024-04-24T13:33:18.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140619 2024-04-24T13:33:18.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.262 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.262 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.262 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2216 3.3d 3:bf22edaf:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:18.262 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:18.262 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 49.794039994000002, 2024-04-24T13:33:18.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027972988000000001, 2024-04-24T13:33:18.262 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.262 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.262 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2216 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461320+0000", 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7049999999999999e-06 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462822+0000", 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015018919999999999 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462846+0000", 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4229000000000001e-05 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462856+0000", 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8619999999999998e-06 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462932+0000", 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6126999999999998e-05 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463098+0000", 2024-04-24T13:33:18.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016631400000000001 2024-04-24T13:33:18.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:18.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463231+0000", 2024-04-24T13:33:18.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013278699999999999 2024-04-24T13:33:18.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475573+0000", 2024-04-24T13:33:18.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012342148000000001 2024-04-24T13:33:18.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489102+0000", 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013528755 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489210+0000", 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010779400000000001 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489290+0000", 2024-04-24T13:33:18.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0375000000000002e-05 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2217 3.7 e85/41 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 49.781630651, 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022815940999999999, 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473728+0000", 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6080000000000001e-06 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475783+0000", 2024-04-24T13:33:18.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002054349 2024-04-24T13:33:18.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475801+0000", 2024-04-24T13:33:18.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8054e-05 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475814+0000", 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3515e-05 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488934+0000", 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013119772 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488977+0000", 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2922e-05 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496474+0000", 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074975320000000003 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496543+0000", 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8188999999999994e-05 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.272 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2251 3.3a e85/20 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head v 85'3, mlcod=81'1)", 2024-04-24T13:33:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 49.414130976000003, 2024-04-24T13:33:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024431608, 2024-04-24T13:33:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:18.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:18.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841228+0000", 2024-04-24T13:33:18.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.781e-06 2024-04-24T13:33:18.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846614+0000", 2024-04-24T13:33:18.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053854419999999998 2024-04-24T13:33:18.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846650+0000", 2024-04-24T13:33:18.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6133000000000001e-05 2024-04-24T13:33:18.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846669+0000", 2024-04-24T13:33:18.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9199e-05 2024-04-24T13:33:18.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846763+0000", 2024-04-24T13:33:18.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4335999999999999e-05 2024-04-24T13:33:18.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846799+0000", 2024-04-24T13:33:18.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5796000000000001e-05 2024-04-24T13:33:18.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865616+0000", 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018816825999999998 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865658+0000", 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2095000000000003e-05 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.278 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2667 3.39 3:9ef26513:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:18.278 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:18.278 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.072332848, 2024-04-24T13:33:18.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021597445, 2024-04-24T13:33:18.278 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.278 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.278 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2667 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183028+0000", 2024-04-24T13:33:18.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.444e-06 2024-04-24T13:33:18.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185652+0000", 2024-04-24T13:33:18.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026242420000000002 2024-04-24T13:33:18.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185674+0000", 2024-04-24T13:33:18.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1429000000000001e-05 2024-04-24T13:33:18.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185683+0000", 2024-04-24T13:33:18.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4069999999999999e-06 2024-04-24T13:33:18.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185746+0000", 2024-04-24T13:33:18.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2621999999999998e-05 2024-04-24T13:33:18.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185750+0000", 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7840000000000003e-06 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188091+0000", 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023404709999999998 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188186+0000", 2024-04-24T13:33:18.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5136000000000005e-05 2024-04-24T13:33:18.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:18.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188277+0000", 2024-04-24T13:33:18.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0661000000000005e-05 2024-04-24T13:33:18.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.196753+0000", 2024-04-24T13:33:18.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084765789999999997 2024-04-24T13:33:18.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204495+0000", 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077418260000000003 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204569+0000", 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3906999999999996e-05 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204622+0000", 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2936999999999998e-05 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.284 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2675 3.20 e100/20 3:04d57de4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_14:head v 100'3, mlcod=85'1)", 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.985501405000001, 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027012970000000001, 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:18.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:18.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:18.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.72e-07 2024-04-24T13:33:18.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275705+0000", 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058491849999999998 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275732+0000", 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6630000000000001e-05 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275747+0000", 2024-04-24T13:33:18.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5375000000000001e-05 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275839+0000", 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1348999999999996e-05 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275873+0000", 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4341999999999997e-05 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296810+0000", 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020937196000000002 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296869+0000", 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8621e-05 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2676 3.22 e100/74 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head v 100'6, mlcod=86'4)", 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:18.289 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.980700561999999, 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022762185000000001, 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:18.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274658+0000", 2024-04-24T13:33:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.466e-06 2024-04-24T13:33:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277453+0000", 2024-04-24T13:33:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027952799999999998 2024-04-24T13:33:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277477+0000", 2024-04-24T13:33:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3533e-05 2024-04-24T13:33:18.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277490+0000", 2024-04-24T13:33:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2978e-05 2024-04-24T13:33:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277588+0000", 2024-04-24T13:33:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7796999999999999e-05 2024-04-24T13:33:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277617+0000", 2024-04-24T13:33:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8878e-05 2024-04-24T13:33:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297382+0000", 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019765373999999999 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297419+0000", 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6878999999999997e-05 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2688 3.3a e100/20 3:5c6b1f96:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_27:head v 100'9, mlcod=86'7)", 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:18.295 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.858534986, 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020500114999999999, 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:18.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396823+0000", 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-07 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.404984+0000", 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081613310000000008 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405002+0000", 2024-04-24T13:33:18.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7550999999999998e-05 2024-04-24T13:33:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405012+0000", 2024-04-24T13:33:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0039e-05 2024-04-24T13:33:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405077+0000", 2024-04-24T13:33:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5220000000000002e-05 2024-04-24T13:33:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405094+0000", 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7377e-05 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.417271+0000", 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012177248 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.417322+0000", 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0980000000000003e-05 2024-04-24T13:33:18.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2689 3.17 3:eb254e54:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.855979872000001, 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020838804999999998, 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.300 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2689 2024-04-24T13:33:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399380+0000", 2024-04-24T13:33:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.311e-06 2024-04-24T13:33:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401455+0000", 2024-04-24T13:33:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020751419999999999 2024-04-24T13:33:18.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401489+0000", 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4078999999999997e-05 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401501+0000", 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2320000000000001e-05 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401564+0000", 2024-04-24T13:33:18.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2518e-05 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401673+0000", 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010889 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401787+0000", 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113859 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.416314+0000", 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014527804 2024-04-24T13:33:18.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.419649+0000", 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033342049999999998 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.419942+0000", 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000293477 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.420216+0000", 2024-04-24T13:33:18.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0002742 2024-04-24T13:33:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2693 3.39 3:9e56554d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.814660921, 2024-04-24T13:33:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284832, 2024-04-24T13:33:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.306 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2693 2024-04-24T13:33:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440699+0000", 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2199999999999999e-06 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441920+0000", 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012213739999999999 2024-04-24T13:33:18.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441944+0000", 2024-04-24T13:33:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4127000000000001e-05 2024-04-24T13:33:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441963+0000", 2024-04-24T13:33:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.855e-05 2024-04-24T13:33:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442027+0000", 2024-04-24T13:33:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4337000000000004e-05 2024-04-24T13:33:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442150+0000", 2024-04-24T13:33:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012347399999999999 2024-04-24T13:33:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442248+0000", 2024-04-24T13:33:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7683999999999995e-05 2024-04-24T13:33:18.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.447435+0000", 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005186955 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465898+0000", 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018462971000000002 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465947+0000", 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9276000000000001e-05 2024-04-24T13:33:18.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465981+0000", 2024-04-24T13:33:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3864e-05 2024-04-24T13:33:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2723 3.37 3:ecde4b94:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.611879923, 2024-04-24T13:33:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023622656999999998, 2024-04-24T13:33:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2723 2024-04-24T13:33:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.313 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643480+0000", 2024-04-24T13:33:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6960000000000001e-06 2024-04-24T13:33:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645332+0000", 2024-04-24T13:33:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001851561 2024-04-24T13:33:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645362+0000", 2024-04-24T13:33:18.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0298e-05 2024-04-24T13:33:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645375+0000", 2024-04-24T13:33:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.331e-05 2024-04-24T13:33:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645460+0000", 2024-04-24T13:33:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4851999999999993e-05 2024-04-24T13:33:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645467+0000", 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0140000000000001e-06 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.653874+0000", 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084073340000000007 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654042+0000", 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000167159 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654214+0000", 2024-04-24T13:33:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017199899999999999 2024-04-24T13:33:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666361+0000", 2024-04-24T13:33:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012146957999999999 2024-04-24T13:33:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666977+0000", 2024-04-24T13:33:18.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061606400000000004 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667043+0000", 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667100+0000", 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7080999999999998e-05 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2746 3.30 3:0ff52a22:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.368577022, 2024-04-24T13:33:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025777590999999999, 2024-04-24T13:33:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.320 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2746 2024-04-24T13:33:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886783+0000", 2024-04-24T13:33:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8930000000000001e-06 2024-04-24T13:33:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889050+0000", 2024-04-24T13:33:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002267107 2024-04-24T13:33:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889078+0000", 2024-04-24T13:33:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7623999999999998e-05 2024-04-24T13:33:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889091+0000", 2024-04-24T13:33:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3101e-05 2024-04-24T13:33:18.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889170+0000", 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8968999999999996e-05 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889311+0000", 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141392 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889451+0000", 2024-04-24T13:33:18.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139911 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.895637+0000", 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061857290000000001 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912426+0000", 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016789347999999999 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912501+0000", 2024-04-24T13:33:18.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4836e-05 2024-04-24T13:33:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912558+0000", 2024-04-24T13:33:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6681000000000002e-05 2024-04-24T13:33:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2754 3.b e101/20 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head v 101'7, mlcod=86'5)", 2024-04-24T13:33:18.326 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.270016290999999, 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025167067000000001, 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:18.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985343+0000", 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.734e-06 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987192+0000", 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018490360000000001 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987224+0000", 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2588e-05 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987241+0000", 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6350000000000001e-05 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987338+0000", 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7466000000000005e-05 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987368+0000", 2024-04-24T13:33:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0210999999999999e-05 2024-04-24T13:33:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010454+0000", 2024-04-24T13:33:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02308522 2024-04-24T13:33:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010508+0000", 2024-04-24T13:33:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4462000000000001e-05 2024-04-24T13:33:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2755 3.12 3:4bcc7c5c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.269604403000001, 2024-04-24T13:33:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026401981000000001, 2024-04-24T13:33:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.331 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2755 2024-04-24T13:33:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:18.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985757+0000", 2024-04-24T13:33:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6370000000000001e-06 2024-04-24T13:33:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987459+0000", 2024-04-24T13:33:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017029180000000001 2024-04-24T13:33:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987474+0000", 2024-04-24T13:33:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4460999999999999e-05 2024-04-24T13:33:18.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987484+0000", 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0168e-05 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987576+0000", 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2020000000000003e-05 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987731+0000", 2024-04-24T13:33:18.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015486499999999999 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987818+0000", 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012049+0000", 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02423055 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012062+0000", 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3054000000000001e-05 2024-04-24T13:33:18.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012114+0000", 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1656999999999997e-05 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012155+0000", 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1300000000000001e-05 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2762 3.39 3:9dc3ddb4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.201090665000001, 2024-04-24T13:33:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02109138, 2024-04-24T13:33:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.338 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2762 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054269+0000", 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1859999999999999e-06 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.055994+0000", 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001725196 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056030+0000", 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5914999999999997e-05 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056047+0000", 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6693000000000001e-05 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056132+0000", 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5797000000000005e-05 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056297+0000", 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164265 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056460+0000", 2024-04-24T13:33:18.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016338600000000001 2024-04-24T13:33:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.066355+0000", 2024-04-24T13:33:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0098949050000000007 2024-04-24T13:33:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075280+0000", 2024-04-24T13:33:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089252210000000005 2024-04-24T13:33:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075324+0000", 2024-04-24T13:33:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3939000000000001e-05 2024-04-24T13:33:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075358+0000", 2024-04-24T13:33:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3877000000000001e-05 2024-04-24T13:33:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2764 3.23 3:c46f1960:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.177614089, 2024-04-24T13:33:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020127275, 2024-04-24T13:33:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2764 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077745+0000", 2024-04-24T13:33:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2800000000000002e-06 2024-04-24T13:33:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078808+0000", 2024-04-24T13:33:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001062351 2024-04-24T13:33:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078826+0000", 2024-04-24T13:33:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8045000000000001e-05 2024-04-24T13:33:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078835+0000", 2024-04-24T13:33:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5999999999999996e-06 2024-04-24T13:33:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078907+0000", 2024-04-24T13:33:18.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1068000000000005e-05 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.079064+0000", 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157532 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.079221+0000", 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015694400000000001 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.092808+0000", 2024-04-24T13:33:18.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013586671999999999 2024-04-24T13:33:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097696+0000", 2024-04-24T13:33:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004887906 2024-04-24T13:33:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097795+0000", 2024-04-24T13:33:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9701e-05 2024-04-24T13:33:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097870+0000", 2024-04-24T13:33:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5176e-05 2024-04-24T13:33:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2770 3.1 3:80489e4c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.121751154, 2024-04-24T13:33:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025093718000000001, 2024-04-24T13:33:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2770 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133609+0000", 2024-04-24T13:33:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0369999999999999e-06 2024-04-24T13:33:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135153+0000", 2024-04-24T13:33:18.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015441229999999999 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135182+0000", 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8300999999999999e-05 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135196+0000", 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4229999999999999e-05 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135279+0000", 2024-04-24T13:33:18.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3549999999999998e-05 2024-04-24T13:33:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135458+0000", 2024-04-24T13:33:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017893100000000001 2024-04-24T13:33:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:18.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135611+0000", 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152881 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.144283+0000", 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086718709999999994 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158560+0000", 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014277306 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158642+0000", 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1435999999999998e-05 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158700+0000", 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8051999999999999e-05 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2788 3.39 3:9c7af06c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:18.356 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.93988895, 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021514591999999999, 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2788 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:18.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315470+0000", 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7680000000000001e-06 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316763+0000", 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001292947 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316787+0000", 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4068999999999999e-05 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316799+0000", 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2374999999999999e-05 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316874+0000", 2024-04-24T13:33:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4133000000000003e-05 2024-04-24T13:33:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316992+0000", 2024-04-24T13:33:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117933 2024-04-24T13:33:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.317153+0000", 2024-04-24T13:33:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000161101 2024-04-24T13:33:18.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.323588+0000", 2024-04-24T13:33:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064355749999999998 2024-04-24T13:33:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336852+0000", 2024-04-24T13:33:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013264233 2024-04-24T13:33:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336924+0000", 2024-04-24T13:33:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1746000000000001e-05 2024-04-24T13:33:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336983+0000", 2024-04-24T13:33:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8712000000000003e-05 2024-04-24T13:33:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.362 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2795 3.39 3:9fba68c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.870739963, 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932186000000001, 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2795 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384619+0000", 2024-04-24T13:33:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9939999999999999e-06 2024-04-24T13:33:18.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386448+0000", 2024-04-24T13:33:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001828744 2024-04-24T13:33:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386484+0000", 2024-04-24T13:33:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5976000000000002e-05 2024-04-24T13:33:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386500+0000", 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5746000000000001e-05 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386604+0000", 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104162 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386806+0000", 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020206400000000001 2024-04-24T13:33:18.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386995+0000", 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018851 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.398238+0000", 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011243337000000001 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404473+0000", 2024-04-24T13:33:18.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062350979999999997 2024-04-24T13:33:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404514+0000", 2024-04-24T13:33:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1418999999999998e-05 2024-04-24T13:33:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404550+0000", 2024-04-24T13:33:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5135999999999997e-05 2024-04-24T13:33:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.368 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2811 3.7 e101/41 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head v 101'8, mlcod=101'6)", 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 11.674773175, 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026659326000000001, 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580586+0000", 2024-04-24T13:33:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.668e-06 2024-04-24T13:33:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582238+0000", 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016524829999999999 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582266+0000", 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8028e-05 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582282+0000", 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6047999999999999e-05 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582372+0000", 2024-04-24T13:33:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9642999999999995e-05 2024-04-24T13:33:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582400+0000", 2024-04-24T13:33:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7776999999999998e-05 2024-04-24T13:33:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607184+0000", 2024-04-24T13:33:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024784418999999999 2024-04-24T13:33:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607243+0000", 2024-04-24T13:33:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9259999999999998e-05 2024-04-24T13:33:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.373 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:18.374 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:18.374 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:18.376 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:18.376 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:18.376 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:18.377 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:18.377 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:18.378 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:18.373+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:18.476 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:18.473+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:18.548 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:18.548 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:18.549 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:18.549 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:18.563 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:33:18.577 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:18.573+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:18.678 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:18.673+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:18.683 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:18.684 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:18.684 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:18.684 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:18.684 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:18.698 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:33:18.778 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:18.777+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:18.823 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:18.823 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:18.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:18.823 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:18.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.823 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1615 3.1a e82/20 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head v 82'1, mlcod=0'0)", 2024-04-24T13:33:18.824 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:18.824 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 60.608915644, 2024-04-24T13:33:18.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013622553000000001, 2024-04-24T13:33:18.824 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.824 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.824 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.824 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:18.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212985+0000", 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1370000000000001e-06 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219240+0000", 2024-04-24T13:33:18.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062543240000000003 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219257+0000", 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6940999999999999e-05 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219267+0000", 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0283e-05 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219324+0000", 2024-04-24T13:33:18.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6950999999999997e-05 2024-04-24T13:33:18.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219343+0000", 2024-04-24T13:33:18.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8681999999999998e-05 2024-04-24T13:33:18.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226529+0000", 2024-04-24T13:33:18.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071867169999999996 2024-04-24T13:33:18.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226607+0000", 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7517999999999999e-05 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2219 3.0 3:00e6fe99:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.329761249999997, 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01535366, 2024-04-24T13:33:18.828 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2219 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492150+0000", 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1046999999999999e-05 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494106+0000", 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019561940000000001 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494133+0000", 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7617999999999999e-05 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494150+0000", 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6096999999999999e-05 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494240+0000", 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0786999999999997e-05 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494435+0000", 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000195021 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494611+0000", 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017601100000000001 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507078+0000", 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012466395 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507374+0000", 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029577100000000001 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507429+0000", 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5928999999999999e-05 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507492+0000", 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.279e-05 2024-04-24T13:33:18.833 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2230 3.19 3:99352026:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.213778259999998, 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013072217000000001, 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.834 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2230 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608124+0000", 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6740000000000001e-06 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609736+0000", 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016116430000000001 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609766+0000", 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0497e-05 2024-04-24T13:33:18.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609781+0000", 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4810999999999999e-05 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609861+0000", 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9320999999999995e-05 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609972+0000", 2024-04-24T13:33:18.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111116 2024-04-24T13:33:18.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:18.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.610087+0000", 2024-04-24T13:33:18.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115161 2024-04-24T13:33:18.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.620611+0000", 2024-04-24T13:33:18.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010524554 2024-04-24T13:33:18.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621126+0000", 2024-04-24T13:33:18.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051447699999999995 2024-04-24T13:33:18.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621163+0000", 2024-04-24T13:33:18.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6838999999999997e-05 2024-04-24T13:33:18.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621194+0000", 2024-04-24T13:33:18.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1124000000000002e-05 2024-04-24T13:33:18.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.840 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.840 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.840 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2252 3.4 3:22834b58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:18.840 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:18.840 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 49.976321310000003, 2024-04-24T13:33:18.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932545999999999, 2024-04-24T13:33:18.840 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.840 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.840 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.840 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.841 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.841 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2252 2024-04-24T13:33:18.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.841 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:18.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845581+0000", 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847834+0000", 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002252843 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847863+0000", 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.904e-05 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847877+0000", 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4126e-05 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847963+0000", 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6162999999999995e-05 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848105+0000", 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014117900000000001 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848252+0000", 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014774800000000001 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865043+0000", 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016790848000000001 2024-04-24T13:33:18.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865405+0000", 2024-04-24T13:33:18.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036176900000000001 2024-04-24T13:33:18.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865460+0000", 2024-04-24T13:33:18.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5334000000000002e-05 2024-04-24T13:33:18.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865511+0000", 2024-04-24T13:33:18.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0784e-05 2024-04-24T13:33:18.846 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.846 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.846 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.846 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2663 3.0 3:01df44a3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:18.846 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:18.846 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.682547276999999, 2024-04-24T13:33:18.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020742727999999998, 2024-04-24T13:33:18.846 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.846 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.846 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.847 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.847 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.847 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.847 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2663 2024-04-24T13:33:18.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.847 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:18.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139355+0000", 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2529999999999999e-06 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141777+0000", 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002422638 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141800+0000", 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2949e-05 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141812+0000", 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1551e-05 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141907+0000", 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5296000000000004e-05 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141917+0000", 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.414e-06 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144519+0000", 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026024220000000001 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144684+0000", 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164511 2024-04-24T13:33:18.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:18.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144845+0000", 2024-04-24T13:33:18.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016157000000000001 2024-04-24T13:33:18.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.156972+0000", 2024-04-24T13:33:18.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012126855000000001 2024-04-24T13:33:18.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.159989+0000", 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003016609 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160059+0000", 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0598000000000004e-05 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160095+0000", 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6062000000000001e-05 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.852 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.853 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2664 3.4 3:21467061:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:18.853 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:18.853 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.66904768, 2024-04-24T13:33:18.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013894336, 2024-04-24T13:33:18.853 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.853 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.853 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.853 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.853 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.854 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2664 2024-04-24T13:33:18.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.854 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:18.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:18.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152854+0000", 2024-04-24T13:33:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0109999999999999e-06 2024-04-24T13:33:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154070+0000", 2024-04-24T13:33:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012153940000000001 2024-04-24T13:33:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154096+0000", 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6109e-05 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154110+0000", 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4489e-05 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154184+0000", 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4035000000000005e-05 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154325+0000", 2024-04-24T13:33:18.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014115500000000001 2024-04-24T13:33:18.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:18.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154474+0000", 2024-04-24T13:33:18.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000148811 2024-04-24T13:33:18.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.165413+0000", 2024-04-24T13:33:18.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010938333999999999 2024-04-24T13:33:18.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166625+0000", 2024-04-24T13:33:18.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001212526 2024-04-24T13:33:18.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166692+0000", 2024-04-24T13:33:18.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7013000000000004e-05 2024-04-24T13:33:18.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166747+0000", 2024-04-24T13:33:18.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4459000000000002e-05 2024-04-24T13:33:18.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.860 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.860 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.860 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2672 3.1c e100/74 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head v 100'4, mlcod=85'2)", 2024-04-24T13:33:18.861 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:18.861 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.584405719999999, 2024-04-24T13:33:18.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022091785999999999, 2024-04-24T13:33:18.861 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.861 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.861 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.861 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:18.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:18.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237495+0000", 2024-04-24T13:33:18.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1500000000000005e-07 2024-04-24T13:33:18.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243044+0000", 2024-04-24T13:33:18.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055497869999999996 2024-04-24T13:33:18.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243082+0000", 2024-04-24T13:33:18.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7208e-05 2024-04-24T13:33:18.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243097+0000", 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5554e-05 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243175+0000", 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7849999999999995e-05 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243194+0000", 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8822999999999999e-05 2024-04-24T13:33:18.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259527+0000", 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016333007 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259586+0000", 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9042000000000002e-05 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2677 3.25 3:a4f04b59:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.539519968, 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015627926, 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2677 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:18.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:18.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282383+0000", 2024-04-24T13:33:18.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1499999999999999e-06 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283869+0000", 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014862269999999999 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283897+0000", 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7596000000000001e-05 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283911+0000", 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.367e-05 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283981+0000", 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0349e-05 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284117+0000", 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013656000000000001 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:18.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284214+0000", 2024-04-24T13:33:18.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6558999999999995e-05 2024-04-24T13:33:18.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296745+0000", 2024-04-24T13:33:18.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012530845000000001 2024-04-24T13:33:18.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297925+0000", 2024-04-24T13:33:18.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001179706 2024-04-24T13:33:18.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297961+0000", 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6514999999999999e-05 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.298008+0000", 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6749000000000003e-05 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2706 3.1c e100/74 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head v 100'5, mlcod=86'3)", 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.347100039000001, 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021017514000000001, 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474802+0000", 2024-04-24T13:33:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1399999999999998e-06 2024-04-24T13:33:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480124+0000", 2024-04-24T13:33:18.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053217059999999998 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480147+0000", 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3646e-05 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480159+0000", 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2133999999999999e-05 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480237+0000", 2024-04-24T13:33:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7531e-05 2024-04-24T13:33:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480291+0000", 2024-04-24T13:33:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3851999999999999e-05 2024-04-24T13:33:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495746+0000", 2024-04-24T13:33:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015454684 2024-04-24T13:33:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495817+0000", 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1821000000000002e-05 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2722 3.25 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.189696029, 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035782711000000002, 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.878 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.878 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.878 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.878 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.878 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2722 2024-04-24T13:33:18.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.878 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:18.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632207+0000", 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.252e-06 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634575+0000", 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023682500000000001 2024-04-24T13:33:18.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634606+0000", 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0284999999999999e-05 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634619+0000", 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3491e-05 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634703+0000", 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4214000000000004e-05 2024-04-24T13:33:18.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:18.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634711+0000", 2024-04-24T13:33:18.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9719999999999992e-06 2024-04-24T13:33:18.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639813+0000", 2024-04-24T13:33:18.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051013830000000001 2024-04-24T13:33:18.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639969+0000", 2024-04-24T13:33:18.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015674600000000001 2024-04-24T13:33:18.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:18.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.640112+0000", 2024-04-24T13:33:18.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142347 2024-04-24T13:33:18.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647222+0000", 2024-04-24T13:33:18.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071106520000000003 2024-04-24T13:33:18.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667844+0000", 2024-04-24T13:33:18.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020621746999999999 2024-04-24T13:33:18.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667925+0000", 2024-04-24T13:33:18.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0717999999999995e-05 2024-04-24T13:33:18.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667987+0000", 2024-04-24T13:33:18.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1654000000000003e-05 2024-04-24T13:33:18.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.884 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.884 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2730 3.19 3:984637ec:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:18.884 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:18.884 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.098049555999999, 2024-04-24T13:33:18.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014952841999999999, 2024-04-24T13:33:18.884 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.884 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.885 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.885 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2730 2024-04-24T13:33:18.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.885 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:18.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:18.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723854+0000", 2024-04-24T13:33:18.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4180000000000001e-06 2024-04-24T13:33:18.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725292+0000", 2024-04-24T13:33:18.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014378870000000001 2024-04-24T13:33:18.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725322+0000", 2024-04-24T13:33:18.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0596999999999999e-05 2024-04-24T13:33:18.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725337+0000", 2024-04-24T13:33:18.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4684999999999999e-05 2024-04-24T13:33:18.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725423+0000", 2024-04-24T13:33:18.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5997999999999999e-05 2024-04-24T13:33:18.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725596+0000", 2024-04-24T13:33:18.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000172654 2024-04-24T13:33:18.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:18.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725755+0000", 2024-04-24T13:33:18.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015988600000000001 2024-04-24T13:33:18.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734196+0000", 2024-04-24T13:33:18.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084404170000000004 2024-04-24T13:33:18.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738679+0000", 2024-04-24T13:33:18.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044834189999999998 2024-04-24T13:33:18.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738747+0000", 2024-04-24T13:33:18.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7890000000000002e-05 2024-04-24T13:33:18.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738803+0000", 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5991e-05 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2737 3.4 3:23416714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.028763925, 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019181262000000001, 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.891 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2737 2024-04-24T13:33:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793139+0000", 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795403+0000", 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002264252 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795439+0000", 2024-04-24T13:33:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5701999999999998e-05 2024-04-24T13:33:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795454+0000", 2024-04-24T13:33:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5262999999999999e-05 2024-04-24T13:33:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795541+0000", 2024-04-24T13:33:18.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6989000000000003e-05 2024-04-24T13:33:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795719+0000", 2024-04-24T13:33:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000177906 2024-04-24T13:33:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795875+0000", 2024-04-24T13:33:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155785 2024-04-24T13:33:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.808532+0000", 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012657695 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812189+0000", 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036562809999999999 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812258+0000", 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9210999999999999e-05 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812317+0000", 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9407000000000002e-05 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2752 3.1c e101/74 3:3ae15365:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_81:head v 101'6, mlcod=100'4)", 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.861455767000001, 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013320523000000001, 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.897 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.898 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.898 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:18.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:18.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960446+0000", 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0590000000000001e-06 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.965992+0000", 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055462810000000001 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966034+0000", 2024-04-24T13:33:18.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1485e-05 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966051+0000", 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7404000000000001e-05 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966178+0000", 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012681899999999999 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966198+0000", 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9944000000000001e-05 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.973717+0000", 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075185299999999998 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.973765+0000", 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8000999999999997e-05 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2772 3.1a e101/20 3:589df240:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_101:head v 101'3, mlcod=82'1)", 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.66237432, 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013122586, 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159527+0000", 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165074+0000", 2024-04-24T13:33:18.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055466129999999997 2024-04-24T13:33:18.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165100+0000", 2024-04-24T13:33:18.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5789e-05 2024-04-24T13:33:18.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165110+0000", 2024-04-24T13:33:18.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0036e-05 2024-04-24T13:33:18.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165198+0000", 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7981999999999999e-05 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165229+0000", 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1022999999999998e-05 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.172572+0000", 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073435519999999997 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.172648+0000", 2024-04-24T13:33:18.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6013000000000006e-05 2024-04-24T13:33:18.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.906 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2781 3.e e101/41 3:704d2ad1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_110:head v 101'4, mlcod=85'2)", 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.571209420000001, 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017614365, 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:18.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250692+0000", 2024-04-24T13:33:18.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3570000000000001e-06 2024-04-24T13:33:18.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256430+0000", 2024-04-24T13:33:18.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057381300000000001 2024-04-24T13:33:18.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256465+0000", 2024-04-24T13:33:18.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4974000000000001e-05 2024-04-24T13:33:18.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256480+0000", 2024-04-24T13:33:18.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5000999999999999e-05 2024-04-24T13:33:18.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256571+0000", 2024-04-24T13:33:18.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1008999999999995e-05 2024-04-24T13:33:18.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256599+0000", 2024-04-24T13:33:18.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7676000000000001e-05 2024-04-24T13:33:18.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268237+0000", 2024-04-24T13:33:18.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011638081 2024-04-24T13:33:18.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268305+0000", 2024-04-24T13:33:18.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8137000000000002e-05 2024-04-24T13:33:18.911 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.911 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.911 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.912 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2782 3.2b e101/41 3:d5b98152:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_111:head v 101'8, mlcod=86'6)", 2024-04-24T13:33:18.912 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:18.912 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.564425385, 2024-04-24T13:33:18.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013494414, 2024-04-24T13:33:18.912 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.912 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.912 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.912 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:18.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:18.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257476+0000", 2024-04-24T13:33:18.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.499e-06 2024-04-24T13:33:18.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259466+0000", 2024-04-24T13:33:18.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019901609999999998 2024-04-24T13:33:18.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259489+0000", 2024-04-24T13:33:18.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3144000000000001e-05 2024-04-24T13:33:18.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259502+0000", 2024-04-24T13:33:18.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3046e-05 2024-04-24T13:33:18.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259580+0000", 2024-04-24T13:33:18.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7871e-05 2024-04-24T13:33:18.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259607+0000", 2024-04-24T13:33:18.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6828000000000001e-05 2024-04-24T13:33:18.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.270920+0000", 2024-04-24T13:33:18.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011312533 2024-04-24T13:33:18.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.270969+0000", 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9332000000000001e-05 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2785 3.e e101/41 3:72bc610a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_114:head v 101'5, mlcod=86'3)", 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.529432468, 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014730050999999999, 2024-04-24T13:33:18.917 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292470+0000", 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2089999999999999e-06 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297260+0000", 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047903989999999999 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297293+0000", 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3398000000000001e-05 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297309+0000", 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5290000000000001e-05 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297386+0000", 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7218999999999994e-05 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297406+0000", 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9936999999999999e-05 2024-04-24T13:33:18.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.307133+0000", 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097276359999999996 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.307197+0000", 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3962999999999997e-05 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2810 3.16 3:69a6ac6a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.266193738, 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015206692000000001, 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2810 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555709+0000", 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0240000000000002e-06 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557455+0000", 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001745763 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557482+0000", 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6679999999999999e-05 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557496+0000", 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4185000000000001e-05 2024-04-24T13:33:18.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557575+0000", 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9419000000000007e-05 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557715+0000", 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140264 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557805+0000", 2024-04-24T13:33:18.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9511000000000004e-05 2024-04-24T13:33:18.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:18.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.563323+0000", 2024-04-24T13:33:18.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055181300000000004 2024-04-24T13:33:18.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:18.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570784+0000", 2024-04-24T13:33:18.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074609350000000001 2024-04-24T13:33:18.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570856+0000", 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1484999999999997e-05 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570913+0000", 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7296000000000002e-05 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.927 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2813 3.6 e101/20 3:63b60245:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_142:head v 101'4, mlcod=86'2)", 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.229489854000001, 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015409209, 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592412+0000", 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2819999999999999e-06 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594446+0000", 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020333840000000001 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594471+0000", 2024-04-24T13:33:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5287e-05 2024-04-24T13:33:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594482+0000", 2024-04-24T13:33:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1063999999999999e-05 2024-04-24T13:33:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594585+0000", 2024-04-24T13:33:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010303500000000001 2024-04-24T13:33:18.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594609+0000", 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3951000000000002e-05 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607767+0000", 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013158115999999999 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607819+0000", 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2089999999999998e-05 2024-04-24T13:33:18.931 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2814 3.8 e101/20 3:11e81300:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_143:head v 101'7, mlcod=101'5)", 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.217453547, 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013378928999999999, 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604448+0000", 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4610000000000001e-06 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606315+0000", 2024-04-24T13:33:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001866957 2024-04-24T13:33:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606338+0000", 2024-04-24T13:33:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3010000000000002e-05 2024-04-24T13:33:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606352+0000", 2024-04-24T13:33:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4754e-05 2024-04-24T13:33:18.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606438+0000", 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5239000000000002e-05 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606466+0000", 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8476999999999999e-05 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.617758+0000", 2024-04-24T13:33:18.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011291436 2024-04-24T13:33:18.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:18.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:18.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:18.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.617825+0000", 2024-04-24T13:33:18.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7595000000000006e-05 2024-04-24T13:33:18.936 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.936 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.936 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.936 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:18.936 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:18.936 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:18.938 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:33:18.938 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:18.937+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:19.039 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:19.037+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:19.068 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:19.068 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:19.068 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:19.069 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:19.083 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:33:19.141 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:19.137+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:19.207 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:19.207 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:19.207 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:19.207 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:19.207 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:19.222 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:33:19.241 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:19.237+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:19.342 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:19.341+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:19.351 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:19.352 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:19.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:19.352 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:19.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.352 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2206 3.f 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:19.352 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:19.352 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.057815505999997, 2024-04-24T13:33:19.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028291495999999999, 2024-04-24T13:33:19.352 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.352 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.352 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.353 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2206 2024-04-24T13:33:19.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.353 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:19.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:19.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290398+0000", 2024-04-24T13:33:19.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000001e-06 2024-04-24T13:33:19.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294671+0000", 2024-04-24T13:33:19.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042724390000000003 2024-04-24T13:33:19.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294711+0000", 2024-04-24T13:33:19.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0376000000000001e-05 2024-04-24T13:33:19.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294730+0000", 2024-04-24T13:33:19.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8607e-05 2024-04-24T13:33:19.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294856+0000", 2024-04-24T13:33:19.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126651 2024-04-24T13:33:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295125+0000", 2024-04-24T13:33:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026840700000000002 2024-04-24T13:33:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295349+0000", 2024-04-24T13:33:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022454699999999999 2024-04-24T13:33:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307240+0000", 2024-04-24T13:33:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011891048 2024-04-24T13:33:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318593+0000", 2024-04-24T13:33:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011352777999999999 2024-04-24T13:33:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318652+0000", 2024-04-24T13:33:19.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8677000000000001e-05 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318686+0000", 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4616000000000002e-05 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2209 3.14 3:287cf44b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.012511345999997, 2024-04-24T13:33:19.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020682494999999999, 2024-04-24T13:33:19.360 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.360 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.360 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.360 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.360 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2209 2024-04-24T13:33:19.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.360 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335702+0000", 2024-04-24T13:33:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-04-24T13:33:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339081+0000", 2024-04-24T13:33:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003378664 2024-04-24T13:33:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339119+0000", 2024-04-24T13:33:19.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8355999999999997e-05 2024-04-24T13:33:19.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339138+0000", 2024-04-24T13:33:19.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8546000000000002e-05 2024-04-24T13:33:19.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339268+0000", 2024-04-24T13:33:19.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013028599999999999 2024-04-24T13:33:19.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339503+0000", 2024-04-24T13:33:19.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023542699999999999 2024-04-24T13:33:19.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339734+0000", 2024-04-24T13:33:19.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023122 2024-04-24T13:33:19.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.348300+0000", 2024-04-24T13:33:19.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085659870000000006 2024-04-24T13:33:19.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356108+0000", 2024-04-24T13:33:19.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078075109999999996 2024-04-24T13:33:19.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356259+0000", 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015104800000000001 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356381+0000", 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012243599999999999 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2227 3.14 3:28702767:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:19.366 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:19.367 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.771212714000001, 2024-04-24T13:33:19.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017797177000000001, 2024-04-24T13:33:19.367 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.367 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.367 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.367 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.367 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.367 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2227 2024-04-24T13:33:19.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.367 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:19.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:19.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.577000+0000", 2024-04-24T13:33:19.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8760000000000001e-06 2024-04-24T13:33:19.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579496+0000", 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024951740000000002 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579521+0000", 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5361e-05 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579533+0000", 2024-04-24T13:33:19.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2377e-05 2024-04-24T13:33:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579602+0000", 2024-04-24T13:33:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8325999999999996e-05 2024-04-24T13:33:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579799+0000", 2024-04-24T13:33:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019773800000000001 2024-04-24T13:33:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579997+0000", 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019725299999999999 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.586752+0000", 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006755179 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594712+0000", 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079597049999999992 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594757+0000", 2024-04-24T13:33:19.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4956000000000001e-05 2024-04-24T13:33:19.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594795+0000", 2024-04-24T13:33:19.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8232000000000003e-05 2024-04-24T13:33:19.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.372 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.372 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.372 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2244 3.3b 3:ddfbb493:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.582813864000002, 2024-04-24T13:33:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020329852999999998, 2024-04-24T13:33:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2244 2024-04-24T13:33:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:19.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:19.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765398+0000", 2024-04-24T13:33:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.291e-06 2024-04-24T13:33:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766959+0000", 2024-04-24T13:33:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015617680000000001 2024-04-24T13:33:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766985+0000", 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5899999999999999e-05 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766996+0000", 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0642000000000001e-05 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767076+0000", 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9542999999999994e-05 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767184+0000", 2024-04-24T13:33:19.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107964 2024-04-24T13:33:19.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:19.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767269+0000", 2024-04-24T13:33:19.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5798999999999996e-05 2024-04-24T13:33:19.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.772877+0000", 2024-04-24T13:33:19.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056080560000000002 2024-04-24T13:33:19.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785554+0000", 2024-04-24T13:33:19.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012676642 2024-04-24T13:33:19.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785639+0000", 2024-04-24T13:33:19.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4938999999999994e-05 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785726+0000", 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7309e-05 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2265 3.14 3:2a53907b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.352775397000002, 2024-04-24T13:33:19.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016926096000000002, 2024-04-24T13:33:19.380 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.380 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.380 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.380 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2265 2024-04-24T13:33:19.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.380 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995438+0000", 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1080000000000001e-06 2024-04-24T13:33:19.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997447+0000", 2024-04-24T13:33:19.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002008625 2024-04-24T13:33:19.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997484+0000", 2024-04-24T13:33:19.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7070999999999998e-05 2024-04-24T13:33:19.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997508+0000", 2024-04-24T13:33:19.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4324999999999998e-05 2024-04-24T13:33:19.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997617+0000", 2024-04-24T13:33:19.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010898799999999999 2024-04-24T13:33:19.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997787+0000", 2024-04-24T13:33:19.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000169956 2024-04-24T13:33:19.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997949+0000", 2024-04-24T13:33:19.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016190599999999999 2024-04-24T13:33:19.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.005098+0000", 2024-04-24T13:33:19.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071488300000000001 2024-04-24T13:33:19.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012231+0000", 2024-04-24T13:33:19.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071334040000000003 2024-04-24T13:33:19.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012305+0000", 2024-04-24T13:33:19.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4017000000000006e-05 2024-04-24T13:33:19.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012361+0000", 2024-04-24T13:33:19.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-04-24T13:33:19.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.386 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.386 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2669 3.21 3:86a0e0c3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:19.386 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:19.386 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.145884847, 2024-04-24T13:33:19.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020962138000000002, 2024-04-24T13:33:19.387 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.387 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.387 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.387 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2669 2024-04-24T13:33:19.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.388 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:19.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:19.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202328+0000", 2024-04-24T13:33:19.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-06 2024-04-24T13:33:19.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204239+0000", 2024-04-24T13:33:19.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019104409999999999 2024-04-24T13:33:19.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204265+0000", 2024-04-24T13:33:19.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6054000000000002e-05 2024-04-24T13:33:19.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204279+0000", 2024-04-24T13:33:19.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3654e-05 2024-04-24T13:33:19.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204361+0000", 2024-04-24T13:33:19.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2522999999999996e-05 2024-04-24T13:33:19.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204523+0000", 2024-04-24T13:33:19.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000162332 2024-04-24T13:33:19.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204661+0000", 2024-04-24T13:33:19.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013798200000000001 2024-04-24T13:33:19.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.210336+0000", 2024-04-24T13:33:19.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056743339999999996 2024-04-24T13:33:19.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223107+0000", 2024-04-24T13:33:19.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012771714999999999 2024-04-24T13:33:19.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223228+0000", 2024-04-24T13:33:19.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012061300000000001 2024-04-24T13:33:19.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223288+0000", 2024-04-24T13:33:19.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9537999999999998e-05 2024-04-24T13:33:19.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.395 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.395 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2670 3.14 3:2b621d8a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:19.395 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:19.395 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.136478813, 2024-04-24T13:33:19.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018441043000000001, 2024-04-24T13:33:19.396 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.396 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.396 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.396 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2670 2024-04-24T13:33:19.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.396 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:19.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:19.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211734+0000", 2024-04-24T13:33:19.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3429999999999998e-06 2024-04-24T13:33:19.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213786+0000", 2024-04-24T13:33:19.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002052637 2024-04-24T13:33:19.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213813+0000", 2024-04-24T13:33:19.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6193000000000001e-05 2024-04-24T13:33:19.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213825+0000", 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1905999999999999e-05 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213906+0000", 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1075999999999994e-05 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.214023+0000", 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117738 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.214134+0000", 2024-04-24T13:33:19.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011082900000000001 2024-04-24T13:33:19.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.220138+0000", 2024-04-24T13:33:19.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060042059999999998 2024-04-24T13:33:19.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230042+0000", 2024-04-24T13:33:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099037559999999997 2024-04-24T13:33:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230116+0000", 2024-04-24T13:33:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3742e-05 2024-04-24T13:33:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230173+0000", 2024-04-24T13:33:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6616999999999997e-05 2024-04-24T13:33:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.402 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.402 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2710 3.3b 3:ddce91ac:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:19.402 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:19.402 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.836082439, 2024-04-24T13:33:19.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026438756000000001, 2024-04-24T13:33:19.402 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.402 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.402 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.403 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2710 2024-04-24T13:33:19.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.403 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:19.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:19.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512131+0000", 2024-04-24T13:33:19.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0130000000000002e-06 2024-04-24T13:33:19.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514363+0000", 2024-04-24T13:33:19.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022325940000000001 2024-04-24T13:33:19.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514394+0000", 2024-04-24T13:33:19.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0144000000000001e-05 2024-04-24T13:33:19.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514409+0000", 2024-04-24T13:33:19.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5786000000000001e-05 2024-04-24T13:33:19.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514497+0000", 2024-04-24T13:33:19.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7876999999999999e-05 2024-04-24T13:33:19.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514670+0000", 2024-04-24T13:33:19.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000173096 2024-04-24T13:33:19.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:19.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514768+0000", 2024-04-24T13:33:19.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8089000000000002e-05 2024-04-24T13:33:19.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.523354+0000", 2024-04-24T13:33:19.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085854190000000004 2024-04-24T13:33:19.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538483+0000", 2024-04-24T13:33:19.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015128922 2024-04-24T13:33:19.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538527+0000", 2024-04-24T13:33:19.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3835999999999998e-05 2024-04-24T13:33:19.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538567+0000", 2024-04-24T13:33:19.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.998e-05 2024-04-24T13:33:19.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.408 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.408 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.408 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2711 3.13 e100/41 3:c9a0442c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_40:head v 100'9, mlcod=86'7)", 2024-04-24T13:33:19.408 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:19.408 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.820740023000001, 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016831724999999999, 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:19.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527472+0000", 2024-04-24T13:33:19.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6619999999999999e-06 2024-04-24T13:33:19.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533965+0000", 2024-04-24T13:33:19.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064927159999999999 2024-04-24T13:33:19.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533980+0000", 2024-04-24T13:33:19.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5192e-05 2024-04-24T13:33:19.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533989+0000", 2024-04-24T13:33:19.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3950000000000007e-06 2024-04-24T13:33:19.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.534040+0000", 2024-04-24T13:33:19.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0822000000000002e-05 2024-04-24T13:33:19.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.534066+0000", 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6341000000000001e-05 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.544246+0000", 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010179354 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.544302+0000", 2024-04-24T13:33:19.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6242999999999997e-05 2024-04-24T13:33:19.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.413 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.413 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.413 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2712 3.2e 3:74e2d347:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:19.413 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.532098+0000", 2024-04-24T13:33:19.413 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.816112426, 2024-04-24T13:33:19.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016599603000000001, 2024-04-24T13:33:19.413 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.413 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.413 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.413 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2712 2024-04-24T13:33:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.532098+0000", 2024-04-24T13:33:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.532098+0000", 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.532101+0000", 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1860000000000001e-06 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533278+0000", 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001177188 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533313+0000", 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5212000000000001e-05 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533329+0000", 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5866e-05 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533406+0000", 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6520000000000006e-05 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533570+0000", 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016464100000000001 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533729+0000", 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015817199999999999 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.541495+0000", 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077664429999999996 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.548603+0000", 2024-04-24T13:33:19.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071077240000000002 2024-04-24T13:33:19.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.548642+0000", 2024-04-24T13:33:19.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8838999999999999e-05 2024-04-24T13:33:19.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.548697+0000", 2024-04-24T13:33:19.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5812e-05 2024-04-24T13:33:19.418 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.418 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2716 3.13 e100/41 3:c8fec211:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_45:head v 100'10, mlcod=86'8)", 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.771069542999999, 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017185506, 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:19.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:19.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577143+0000", 2024-04-24T13:33:19.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.824e-06 2024-04-24T13:33:19.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581297+0000", 2024-04-24T13:33:19.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041541770000000002 2024-04-24T13:33:19.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581333+0000", 2024-04-24T13:33:19.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6559e-05 2024-04-24T13:33:19.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581349+0000", 2024-04-24T13:33:19.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6036999999999999e-05 2024-04-24T13:33:19.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581429+0000", 2024-04-24T13:33:19.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9404000000000001e-05 2024-04-24T13:33:19.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581449+0000", 2024-04-24T13:33:19.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9949000000000002e-05 2024-04-24T13:33:19.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.594260+0000", 2024-04-24T13:33:19.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012811207999999999 2024-04-24T13:33:19.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.594326+0000", 2024-04-24T13:33:19.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6347999999999996e-05 2024-04-24T13:33:19.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.424 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.424 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.424 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2728 3.21 3:8520d077:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:19.425 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:19.425 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.640870668, 2024-04-24T13:33:19.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019867991000000002, 2024-04-24T13:33:19.425 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.425 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.425 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.425 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.425 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2728 2024-04-24T13:33:19.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.426 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:19.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:19.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707342+0000", 2024-04-24T13:33:19.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8480000000000001e-06 2024-04-24T13:33:19.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709741+0000", 2024-04-24T13:33:19.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002398346 2024-04-24T13:33:19.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709770+0000", 2024-04-24T13:33:19.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9522e-05 2024-04-24T13:33:19.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.428 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709786+0000", 2024-04-24T13:33:19.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5373e-05 2024-04-24T13:33:19.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709865+0000", 2024-04-24T13:33:19.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9024999999999996e-05 2024-04-24T13:33:19.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709984+0000", 2024-04-24T13:33:19.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011908000000000001 2024-04-24T13:33:19.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.710086+0000", 2024-04-24T13:33:19.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102656 2024-04-24T13:33:19.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.719183+0000", 2024-04-24T13:33:19.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.009096491 2024-04-24T13:33:19.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727080+0000", 2024-04-24T13:33:19.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078969309999999994 2024-04-24T13:33:19.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727152+0000", 2024-04-24T13:33:19.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1816999999999994e-05 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727208+0000", 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5902000000000001e-05 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2738 3.2d 3:b6fa79b0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.545471935, 2024-04-24T13:33:19.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016982181999999998, 2024-04-24T13:33:19.433 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.433 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.433 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.433 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.433 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.433 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.433 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2738 2024-04-24T13:33:19.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.433 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:19.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:19.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.434 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802741+0000", 2024-04-24T13:33:19.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1739999999999999e-06 2024-04-24T13:33:19.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804165+0000", 2024-04-24T13:33:19.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014248780000000001 2024-04-24T13:33:19.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804188+0000", 2024-04-24T13:33:19.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989e-05 2024-04-24T13:33:19.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804199+0000", 2024-04-24T13:33:19.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0179e-05 2024-04-24T13:33:19.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804281+0000", 2024-04-24T13:33:19.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2139999999999996e-05 2024-04-24T13:33:19.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804456+0000", 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000175074 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804566+0000", 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109931 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.811275+0000", 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067095560000000002 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819557+0000", 2024-04-24T13:33:19.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0082818370000000002 2024-04-24T13:33:19.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819644+0000", 2024-04-24T13:33:19.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6885000000000006e-05 2024-04-24T13:33:19.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819721+0000", 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6538999999999993e-05 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2750 3.2e 3:76c7df3c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.414913846999999, 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019169064, 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.439 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.440 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.440 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.440 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.440 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2750 2024-04-24T13:33:19.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.440 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:19.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933299+0000", 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.751e-06 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935078+0000", 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017788420000000001 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935120+0000", 2024-04-24T13:33:19.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1875999999999997e-05 2024-04-24T13:33:19.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935138+0000", 2024-04-24T13:33:19.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7784000000000001e-05 2024-04-24T13:33:19.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935244+0000", 2024-04-24T13:33:19.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106041 2024-04-24T13:33:19.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935426+0000", 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018206299999999999 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935583+0000", 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000156754 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.944883+0000", 2024-04-24T13:33:19.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093004400000000001 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952389+0000", 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075064149999999998 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952431+0000", 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1801999999999997e-05 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952466+0000", 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4295999999999998e-05 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2751 3.2e 3:7757132e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.405176315, 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019504242000000001, 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.445 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.446 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.446 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.446 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2751 2024-04-24T13:33:19.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.446 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:19.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943037+0000", 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9189999999999999e-06 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946091+0000", 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030545709999999998 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946117+0000", 2024-04-24T13:33:19.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5666000000000001e-05 2024-04-24T13:33:19.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946131+0000", 2024-04-24T13:33:19.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4243999999999999e-05 2024-04-24T13:33:19.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946202+0000", 2024-04-24T13:33:19.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0798999999999998e-05 2024-04-24T13:33:19.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946357+0000", 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154785 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946465+0000", 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107675 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952338+0000", 2024-04-24T13:33:19.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058734720000000002 2024-04-24T13:33:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962433+0000", 2024-04-24T13:33:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010094462 2024-04-24T13:33:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962484+0000", 2024-04-24T13:33:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1913999999999998e-05 2024-04-24T13:33:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.450 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962538+0000", 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3735e-05 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2789 3.14 3:283784b4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.023651615, 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017567818999999998, 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.451 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.452 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.452 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.452 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.452 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2789 2024-04-24T13:33:19.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.452 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.452 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:19.452 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324561+0000", 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5780000000000001e-06 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325957+0000", 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013953640000000001 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325979+0000", 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2724000000000001e-05 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325989+0000", 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0135999999999999e-05 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326053+0000", 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3554999999999997e-05 2024-04-24T13:33:19.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326175+0000", 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121558 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326275+0000", 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100512 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.332109+0000", 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058341080000000002 2024-04-24T13:33:19.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342050+0000", 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099405489999999999 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342093+0000", 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3472e-05 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342127+0000", 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3263000000000003e-05 2024-04-24T13:33:19.456 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.457 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.457 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.457 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2798 3.3b 3:de5094ab:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:19.457 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:19.457 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.926776695999999, 2024-04-24T13:33:19.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019231912, 2024-04-24T13:33:19.457 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.457 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.457 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.458 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.458 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.458 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.458 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2798 2024-04-24T13:33:19.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.458 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:19.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:19.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421436+0000", 2024-04-24T13:33:19.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7300000000000001e-06 2024-04-24T13:33:19.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423782+0000", 2024-04-24T13:33:19.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023461250000000001 2024-04-24T13:33:19.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423810+0000", 2024-04-24T13:33:19.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7937e-05 2024-04-24T13:33:19.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423823+0000", 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.279e-05 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423938+0000", 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011457 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.424090+0000", 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015250600000000001 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:19.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.424183+0000", 2024-04-24T13:33:19.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2351999999999999e-05 2024-04-24T13:33:19.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.429881+0000", 2024-04-24T13:33:19.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056981360000000003 2024-04-24T13:33:19.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440513+0000", 2024-04-24T13:33:19.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010632354 2024-04-24T13:33:19.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440598+0000", 2024-04-24T13:33:19.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4860999999999999e-05 2024-04-24T13:33:19.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440666+0000", 2024-04-24T13:33:19.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7551000000000004e-05 2024-04-24T13:33:19.464 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.464 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.464 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.464 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2806 3.2d 3:b44f16d5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:19.464 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:19.464 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.841003181, 2024-04-24T13:33:19.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017054071000000001, 2024-04-24T13:33:19.464 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.465 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.465 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.465 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.465 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2806 2024-04-24T13:33:19.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.465 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:19.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:19.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507209+0000", 2024-04-24T13:33:19.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2620000000000001e-06 2024-04-24T13:33:19.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508811+0000", 2024-04-24T13:33:19.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016020940000000001 2024-04-24T13:33:19.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508837+0000", 2024-04-24T13:33:19.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5207000000000001e-05 2024-04-24T13:33:19.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508849+0000", 2024-04-24T13:33:19.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2571999999999999e-05 2024-04-24T13:33:19.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508927+0000", 2024-04-24T13:33:19.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7448999999999997e-05 2024-04-24T13:33:19.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.509058+0000", 2024-04-24T13:33:19.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013080599999999999 2024-04-24T13:33:19.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.509198+0000", 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014016500000000001 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.514234+0000", 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050359230000000003 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524162+0000", 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099284430000000003 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524207+0000", 2024-04-24T13:33:19.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126000000000001e-05 2024-04-24T13:33:19.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524261+0000", 2024-04-24T13:33:19.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4024000000000003e-05 2024-04-24T13:33:19.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.471 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2808 3.2e 3:7441f999:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.816847738, 2024-04-24T13:33:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021413788, 2024-04-24T13:33:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2808 2024-04-24T13:33:19.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531366+0000", 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1089999999999998e-06 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533059+0000", 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001693186 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533088+0000", 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9470000000000001e-05 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533100+0000", 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1979e-05 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533176+0000", 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5691000000000004e-05 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533334+0000", 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015822199999999999 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533513+0000", 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178846 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.546303+0000", 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012790331 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552696+0000", 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063923169999999998 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552741+0000", 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126999999999997e-05 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552776+0000", 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5509999999999997e-05 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.477 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2817 3.13 e101/41 3:c886ce92:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_146:head v 101'13, mlcod=101'11)", 2024-04-24T13:33:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.644060+0000", 2024-04-24T13:33:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.704149824, 2024-04-24T13:33:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018239697999999999, 2024-04-24T13:33:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.644060+0000", 2024-04-24T13:33:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.644060+0000", 2024-04-24T13:33:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.644062+0000", 2024-04-24T13:33:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.172e-06 2024-04-24T13:33:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.650858+0000", 2024-04-24T13:33:19.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067958610000000003 2024-04-24T13:33:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.650875+0000", 2024-04-24T13:33:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7226000000000001e-05 2024-04-24T13:33:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.650885+0000", 2024-04-24T13:33:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0183999999999999e-05 2024-04-24T13:33:19.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.651082+0000", 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019680399999999999 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.651109+0000", 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7322999999999999e-05 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.662226+0000", 2024-04-24T13:33:19.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011116737999999999 2024-04-24T13:33:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.662300+0000", 2024-04-24T13:33:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4389999999999998e-05 2024-04-24T13:33:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.482 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.482 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:19.484 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:33:19.484 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:19.482+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:19.585 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:19.581+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:19.657 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:19.657 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:19.657 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:19.657 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:19.673 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:33:19.719 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:19.718+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:19.782 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:33:19.788 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:19.785+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:19.798 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:19.798 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:19.798 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:19.799 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:19.799 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:19.813 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:33:19.889 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:19.885+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:19.984 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:19.984 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:19.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:19.984 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:19.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.984 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2207 3.38 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:19.984 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:19.984 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.678128721999997, 2024-04-24T13:33:19.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022686873999999999, 2024-04-24T13:33:19.984 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2207 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302499+0000", 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307861+0000", 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053622089999999997 2024-04-24T13:33:19.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307899+0000", 2024-04-24T13:33:19.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978999999999997e-05 2024-04-24T13:33:19.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307917+0000", 2024-04-24T13:33:19.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8576999999999998e-05 2024-04-24T13:33:19.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308018+0000", 2024-04-24T13:33:19.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010080499999999999 2024-04-24T13:33:19.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308202+0000", 2024-04-24T13:33:19.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000183628 2024-04-24T13:33:19.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308352+0000", 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149806 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318520+0000", 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010168744 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.324908+0000", 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063874739999999998 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325063+0000", 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155131 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325182+0000", 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011915499999999999 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.990 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:19.991 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:19.991 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.654534009000002, 2024-04-24T13:33:19.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:33:19.991 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.991 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.991 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.991 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.991 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:33:19.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:19.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:33:19.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:33:19.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:19.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:33:19.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:33:19.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:19.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:33:19.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:33:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:33:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:33:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:33:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:33:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:19.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:33:19.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:33:19.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:19.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:33:19.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:33:19.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.509478154999996, 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:19.997 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:19.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:19.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:19.998 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:19.998 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:33:19.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.998 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:19.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:19.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:19.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:19.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:19.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:19.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:19.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:20.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:33:20.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:33:20.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:33:20.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:33:20.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:33:20.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:33:20.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:33:20.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:33:20.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:33:20.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:33:20.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:33:20.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:33:20.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:33:20.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:33:20.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:33:20.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:33:20.005 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.005 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.005 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.005 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2242 3.b 3:d16b554f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:20.005 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:20.005 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.240979222999997, 2024-04-24T13:33:20.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022940439, 2024-04-24T13:33:20.005 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.005 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.005 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.005 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.006 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.006 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.006 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2242 2024-04-24T13:33:20.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.006 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739648+0000", 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.785e-06 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741765+0000", 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002117655 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741781+0000", 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6062e-05 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741792+0000", 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0937999999999999e-05 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741918+0000", 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623199999999999 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742189+0000", 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027047300000000002 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742430+0000", 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024077699999999999 2024-04-24T13:33:20.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752990+0000", 2024-04-24T13:33:20.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010559875 2024-04-24T13:33:20.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762422+0000", 2024-04-24T13:33:20.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094325120000000005 2024-04-24T13:33:20.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762510+0000", 2024-04-24T13:33:20.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7879000000000003e-05 2024-04-24T13:33:20.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762585+0000", 2024-04-24T13:33:20.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5251000000000002e-05 2024-04-24T13:33:20.011 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.011 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2662 3.33 3:ce195145:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.852060915999999, 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028670389000000001, 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2662 2024-04-24T13:33:20.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128567+0000", 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4640000000000002e-06 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130845+0000", 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002278389 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130869+0000", 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4394999999999999e-05 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130879+0000", 2024-04-24T13:33:20.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0000000000000001e-05 2024-04-24T13:33:20.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130957+0000", 2024-04-24T13:33:20.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7968999999999998e-05 2024-04-24T13:33:20.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:20.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130963+0000", 2024-04-24T13:33:20.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2499999999999997e-06 2024-04-24T13:33:20.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137507+0000", 2024-04-24T13:33:20.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065442900000000003 2024-04-24T13:33:20.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137607+0000", 2024-04-24T13:33:20.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010002599999999999 2024-04-24T13:33:20.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:20.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137727+0000", 2024-04-24T13:33:20.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120142 2024-04-24T13:33:20.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152307+0000", 2024-04-24T13:33:20.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01458017 2024-04-24T13:33:20.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157112+0000", 2024-04-24T13:33:20.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048051350000000003 2024-04-24T13:33:20.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157181+0000", 2024-04-24T13:33:20.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9051e-05 2024-04-24T13:33:20.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157233+0000", 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2108000000000003e-05 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2673 3.18 3:1a01061c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.241832+0000", 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.738791496999999, 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020587687, 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.019 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2673 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.241832+0000", 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.241832+0000", 2024-04-24T13:33:20.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.241835+0000", 2024-04-24T13:33:20.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.238e-06 2024-04-24T13:33:20.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243821+0000", 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019861620000000001 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243846+0000", 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4861000000000001e-05 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243867+0000", 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1535e-05 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243970+0000", 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102564 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.244131+0000", 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016069000000000001 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.244283+0000", 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152149 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259574+0000", 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015291310000000001 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.262266+0000", 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002691588 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.262342+0000", 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5957000000000005e-05 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.262420+0000", 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8633000000000004e-05 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2676 3.22 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.708859007999999, 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025889562000000001, 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.026 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.026 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.026 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.026 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.026 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2676 2024-04-24T13:33:20.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.027 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:20.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:20.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271767+0000", 2024-04-24T13:33:20.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-04-24T13:33:20.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.273986+0000", 2024-04-24T13:33:20.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022195560000000001 2024-04-24T13:33:20.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274011+0000", 2024-04-24T13:33:20.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4953e-05 2024-04-24T13:33:20.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274023+0000", 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1856e-05 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274116+0000", 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3168e-05 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274377+0000", 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026071500000000001 2024-04-24T13:33:20.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274531+0000", 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015427299999999999 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297124+0000", 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022592476 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297544+0000", 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000420691 2024-04-24T13:33:20.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297605+0000", 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0888999999999999e-05 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297655+0000", 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9119999999999997e-05 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.034 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2680 3.29 3:9533dbeb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:20.034 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.313354+0000", 2024-04-24T13:33:20.034 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.667270224999999, 2024-04-24T13:33:20.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019941483999999999, 2024-04-24T13:33:20.034 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.034 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.034 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.034 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.034 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2680 2024-04-24T13:33:20.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.035 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.313354+0000", 2024-04-24T13:33:20.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.036 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.313354+0000", 2024-04-24T13:33:20.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.313356+0000", 2024-04-24T13:33:20.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6240000000000002e-06 2024-04-24T13:33:20.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315045+0000", 2024-04-24T13:33:20.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016891370000000001 2024-04-24T13:33:20.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315060+0000", 2024-04-24T13:33:20.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:33:20.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315067+0000", 2024-04-24T13:33:20.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1849999999999998e-06 2024-04-24T13:33:20.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315143+0000", 2024-04-24T13:33:20.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5777000000000003e-05 2024-04-24T13:33:20.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315282+0000", 2024-04-24T13:33:20.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013928500000000001 2024-04-24T13:33:20.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:20.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315392+0000", 2024-04-24T13:33:20.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010989699999999999 2024-04-24T13:33:20.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.326123+0000", 2024-04-24T13:33:20.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010730669 2024-04-24T13:33:20.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.333171+0000", 2024-04-24T13:33:20.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070476039999999998 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.333245+0000", 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4709000000000006e-05 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.333295+0000", 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9861000000000003e-05 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2722 3.25 e101/20 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head v 101'6, mlcod=86'4)", 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.337113727, 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023380372, 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643511+0000", 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4400000000000001e-07 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647450+0000", 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039389259999999997 2024-04-24T13:33:20.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647470+0000", 2024-04-24T13:33:20.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0534e-05 2024-04-24T13:33:20.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647484+0000", 2024-04-24T13:33:20.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3370000000000001e-05 2024-04-24T13:33:20.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647599+0000", 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115513 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647629+0000", 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0145e-05 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666761+0000", 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019132303999999999 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666891+0000", 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012913599999999999 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2726 3.3c e101/20 3:3c53550d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_55:head v 101'5, mlcod=86'3)", 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.288233088, 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021010132000000001, 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.048 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.049 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:20.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:20.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:20.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9999999999999999e-07 2024-04-24T13:33:20.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701201+0000", 2024-04-24T13:33:20.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088100639999999994 2024-04-24T13:33:20.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701230+0000", 2024-04-24T13:33:20.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8428e-05 2024-04-24T13:33:20.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701243+0000", 2024-04-24T13:33:20.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3635000000000001e-05 2024-04-24T13:33:20.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701333+0000", 2024-04-24T13:33:20.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9765999999999994e-05 2024-04-24T13:33:20.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701362+0000", 2024-04-24T13:33:20.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8810999999999999e-05 2024-04-24T13:33:20.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713347+0000", 2024-04-24T13:33:20.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011985657 2024-04-24T13:33:20.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713401+0000", 2024-04-24T13:33:20.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3570999999999999e-05 2024-04-24T13:33:20.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.054 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.054 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.054 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2729 3.7 3:e1d3d801:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:20.054 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.713957+0000", 2024-04-24T13:33:20.054 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.266667262, 2024-04-24T13:33:20.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020212523, 2024-04-24T13:33:20.055 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.055 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.055 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.055 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.055 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2729 2024-04-24T13:33:20.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.055 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.055 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713957+0000", 2024-04-24T13:33:20.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713957+0000", 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713959+0000", 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2929999999999999e-06 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716255+0000", 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022955900000000001 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716282+0000", 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7682e-05 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716309+0000", 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7138999999999999e-05 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716389+0000", 2024-04-24T13:33:20.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9653000000000005e-05 2024-04-24T13:33:20.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716534+0000", 2024-04-24T13:33:20.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145103 2024-04-24T13:33:20.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:20.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716647+0000", 2024-04-24T13:33:20.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112545 2024-04-24T13:33:20.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.732778+0000", 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016131555999999998 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734055+0000", 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012767130000000001 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734120+0000", 2024-04-24T13:33:20.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4781000000000002e-05 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734169+0000", 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9468000000000001e-05 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2740 3.15 3:abd27dc3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.823008+0000", 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.157615748, 2024-04-24T13:33:20.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021456604000000001, 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2740 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.823008+0000", 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.823008+0000", 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.823011+0000", 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.813e-06 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824873+0000", 2024-04-24T13:33:20.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001861693 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824895+0000", 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2067000000000001e-05 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824905+0000", 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7329999999999998e-06 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824974+0000", 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9072000000000005e-05 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.825139+0000", 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016501299999999999 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.825236+0000", 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7441000000000004e-05 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.831503+0000", 2024-04-24T13:33:20.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062670470000000004 2024-04-24T13:33:20.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.844370+0000", 2024-04-24T13:33:20.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012867197 2024-04-24T13:33:20.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.844428+0000", 2024-04-24T13:33:20.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7750000000000001e-05 2024-04-24T13:33:20.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.844465+0000", 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6777999999999999e-05 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2742 3.7 3:e2cb8889:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.843817+0000", 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.136807051, 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020067055, 2024-04-24T13:33:20.066 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2742 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.843817+0000", 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.843817+0000", 2024-04-24T13:33:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.843820+0000", 2024-04-24T13:33:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6299999999999998e-06 2024-04-24T13:33:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845621+0000", 2024-04-24T13:33:20.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001801469 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845648+0000", 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6754000000000002e-05 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845664+0000", 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5988999999999999e-05 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845732+0000", 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8178999999999999e-05 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845893+0000", 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000160586 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845988+0000", 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5445000000000005e-05 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.859957+0000", 2024-04-24T13:33:20.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013968993000000001 2024-04-24T13:33:20.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.863761+0000", 2024-04-24T13:33:20.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038042699999999998 2024-04-24T13:33:20.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.863831+0000", 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9663e-05 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.863884+0000", 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3077e-05 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2747 3.24 3:2754d069:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:20.072 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.082563864999999, 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024857536999999999, 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2747 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:20.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:20.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898063+0000", 2024-04-24T13:33:20.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5289999999999998e-06 2024-04-24T13:33:20.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899956+0000", 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932759999999999 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899984+0000", 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7801999999999999e-05 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899997+0000", 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3127e-05 2024-04-24T13:33:20.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900063+0000", 2024-04-24T13:33:20.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:20.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900200+0000", 2024-04-24T13:33:20.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000137324 2024-04-24T13:33:20.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:20.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900302+0000", 2024-04-24T13:33:20.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010168 2024-04-24T13:33:20.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.908151+0000", 2024-04-24T13:33:20.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078489579999999996 2024-04-24T13:33:20.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922784+0000", 2024-04-24T13:33:20.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014633116 2024-04-24T13:33:20.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922860+0000", 2024-04-24T13:33:20.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5708000000000001e-05 2024-04-24T13:33:20.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922918+0000", 2024-04-24T13:33:20.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7686000000000003e-05 2024-04-24T13:33:20.080 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.080 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.080 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.081 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2753 3.24 3:261ef004:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:20.081 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.964749+0000", 2024-04-24T13:33:20.081 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.015874974999999, 2024-04-24T13:33:20.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021608380999999999, 2024-04-24T13:33:20.082 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.082 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.082 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.082 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.082 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.083 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.083 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2753 2024-04-24T13:33:20.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.083 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.964749+0000", 2024-04-24T13:33:20.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.964749+0000", 2024-04-24T13:33:20.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.964752+0000", 2024-04-24T13:33:20.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2090000000000001e-06 2024-04-24T13:33:20.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966363+0000", 2024-04-24T13:33:20.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016103560000000001 2024-04-24T13:33:20.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966388+0000", 2024-04-24T13:33:20.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-05 2024-04-24T13:33:20.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966401+0000", 2024-04-24T13:33:20.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.376e-05 2024-04-24T13:33:20.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966476+0000", 2024-04-24T13:33:20.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4657e-05 2024-04-24T13:33:20.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966638+0000", 2024-04-24T13:33:20.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016182699999999999 2024-04-24T13:33:20.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:20.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966730+0000", 2024-04-24T13:33:20.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2169999999999993e-05 2024-04-24T13:33:20.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.976261+0000", 2024-04-24T13:33:20.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095310770000000006 2024-04-24T13:33:20.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.986217+0000", 2024-04-24T13:33:20.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099560849999999999 2024-04-24T13:33:20.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.986298+0000", 2024-04-24T13:33:20.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.119e-05 2024-04-24T13:33:20.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.986357+0000", 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8909999999999997e-05 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2754 3.b 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.002094365, 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.032358206, 2024-04-24T13:33:20.092 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.093 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.093 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.093 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.093 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.093 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.093 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2754 2024-04-24T13:33:20.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.093 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:20.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978532+0000", 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6079999999999998e-06 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979768+0000", 2024-04-24T13:33:20.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012357869999999999 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979791+0000", 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3224e-05 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979804+0000", 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.274e-05 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979889+0000", 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5483999999999997e-05 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980063+0000", 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017384599999999999 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980227+0000", 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163764 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987774+0000", 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075472029999999997 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010776+0000", 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023001886999999999 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010838+0000", 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1527999999999998e-05 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010888+0000", 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0135e-05 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2755 3.12 e101/41 3:4bcc7c5c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_84:head v 101'8, mlcod=100'6)", 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.987913+0000", 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.992710533, 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020118325999999999, 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.098 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987913+0000", 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987913+0000", 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987915+0000", 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.491e-06 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.989911+0000", 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019958509999999999 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.989936+0000", 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5216e-05 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.989951+0000", 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4705000000000001e-05 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.990053+0000", 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102717 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.990083+0000", 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.919e-05 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.007955+0000", 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017872308 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.008032+0000", 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6847999999999993e-05 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.102 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2811 3.7 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.410455533, 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044582597000000002, 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2811 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570171+0000", 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9100000000000001e-06 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580122+0000", 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099505930000000006 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580150+0000", 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7827e-05 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580164+0000", 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4547e-05 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580245+0000", 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0810999999999996e-05 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580355+0000", 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109656 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580475+0000", 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120278 2024-04-24T13:33:20.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607433+0000", 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026957894 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614636+0000", 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072028359999999998 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614703+0000", 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7645999999999996e-05 2024-04-24T13:33:20.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614751+0000", 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7599000000000003e-05 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2812 3.1e 3:7bd62ca6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.400411653000001, 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.038041177000000002, 2024-04-24T13:33:20.108 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2812 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580214+0000", 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.708e-06 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582574+0000", 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023601799999999999 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582591+0000", 2024-04-24T13:33:20.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6648999999999999e-05 2024-04-24T13:33:20.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582598+0000", 2024-04-24T13:33:20.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.391e-06 2024-04-24T13:33:20.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583731+0000", 2024-04-24T13:33:20.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011332029999999999 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583843+0000", 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111889 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583936+0000", 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2968999999999997e-05 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.599363+0000", 2024-04-24T13:33:20.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015427186000000001 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618143+0000", 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018779051000000001 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618200+0000", 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7151999999999998e-05 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618253+0000", 2024-04-24T13:33:20.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3798999999999998e-05 2024-04-24T13:33:20.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.114 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.114 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.114 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2814 3.8 3:11e81300:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:20.114 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.601840+0000", 2024-04-24T13:33:20.114 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.37878358, 2024-04-24T13:33:20.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020012404000000001, 2024-04-24T13:33:20.114 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:20.114 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:20.114 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2814 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.601840+0000", 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.601840+0000", 2024-04-24T13:33:20.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.601843+0000", 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5150000000000001e-06 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.603850+0000", 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020069179999999999 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:20.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.603879+0000", 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9251000000000002e-05 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.603893+0000", 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3529e-05 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.603979+0000", 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6737000000000007e-05 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:20.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604155+0000", 2024-04-24T13:33:20.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017538499999999999 2024-04-24T13:33:20.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:20.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604323+0000", 2024-04-24T13:33:20.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016819599999999999 2024-04-24T13:33:20.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:20.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618337+0000", 2024-04-24T13:33:20.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014014037 2024-04-24T13:33:20.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.621551+0000", 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032136420000000001 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.621704+0000", 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153036 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.621853+0000", 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014915800000000001 2024-04-24T13:33:20.119 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.120 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.120 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.120 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:20.120 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:20.120 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:20.121 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:33:20.122 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:20.118+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:20.222 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:20.221+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:20.253 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:20.253 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:20.254 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:33:20.254 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:20.269 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:33:20.354 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:20.353+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:20.378 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:33:20.424 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:20.422+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:20.435 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:33:20.435 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:33:20.435 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:20.449 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:33:20.531 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:20.531 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:20.538 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:20.537+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:20.547 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:20.548 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:20.564 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:20.564 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:20.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:20.580 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:20.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:20.600 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:20.618 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:20.619 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:20.621 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:20.621 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:20.625 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:20.622+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:20.633 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:33:20.640 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:20.641 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:20.658 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:20.659 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:20.727 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:20.726+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:20.762 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:33:20.806 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:20.806 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:20.821 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:33:20.840 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:20.830+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:20.929 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:20.926+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:20.939 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:20.940 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:20.954 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:33:21.030 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:21.026+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:21.077 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:21.863 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:21.865 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:33:21.866 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:21.862+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:21.965 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:21.961+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:21.992 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:21.992 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:22.006 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:33:22.066 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:22.062+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:22.167 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:22.165+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:22.170 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:22.170 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:22.185 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:33:22.268 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:22.266+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:22.348 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:22.349 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:22.363 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:33:22.368 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:22.366+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:22.469 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:22.466+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:22.486 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:22.486 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:22.500 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:22.570 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:22.569+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:22.623 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:22.623 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:22.637 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:22.677 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:33:22.678 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:22.677+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:22.772 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:22.769+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:22.788 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:33:22.799 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:22.799 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:22.814 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:22.830 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:22.830 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:22.848 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:22.848 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:22.865 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:22.865 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:22.873 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:22.870+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:22.884 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:22.884 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:22.904 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:22.905 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:22.940 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:22.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:22.969 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:22.970 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:22.970 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:22.974 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:22.974 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:22.974 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:22.973+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:22.985 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:22.997 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:22.997 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:23.075 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:23.074+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:23.102 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:23.102 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:23.102 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:23.102 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:23.102 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:23.115 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:23.203 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:23.202+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:23.276 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:23.273+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:23.280 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:23.280 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:23.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:23.280 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:23.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.280 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2206 3.f e85/48 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:23.280 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:23.280 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.983158013000001, 2024-04-24T13:33:23.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022785151, 2024-04-24T13:33:23.281 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.281 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.281 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.281 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:23.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:23.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295567+0000", 2024-04-24T13:33:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3939999999999999e-06 2024-04-24T13:33:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299770+0000", 2024-04-24T13:33:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042038029999999999 2024-04-24T13:33:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299808+0000", 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7703000000000001e-05 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299826+0000", 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8142999999999999e-05 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299972+0000", 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000146095 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.300023+0000", 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0294999999999999e-05 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318209+0000", 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018186099000000001 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318349+0000", 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140619 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.284 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2216 3.3d 3:bf22edaf:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.817405002000001, 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027972988000000001, 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2216 2024-04-24T13:33:23.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461320+0000", 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7049999999999999e-06 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462822+0000", 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015018919999999999 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462846+0000", 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4229000000000001e-05 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462856+0000", 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8619999999999998e-06 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462932+0000", 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6126999999999998e-05 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463098+0000", 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016631400000000001 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463231+0000", 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013278699999999999 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475573+0000", 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012342148000000001 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489102+0000", 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013528755 2024-04-24T13:33:23.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489210+0000", 2024-04-24T13:33:23.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010779400000000001 2024-04-24T13:33:23.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489290+0000", 2024-04-24T13:33:23.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0375000000000002e-05 2024-04-24T13:33:23.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.290 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2217 3.7 e85/41 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.804995658999999, 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022815940999999999, 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473728+0000", 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6080000000000001e-06 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475783+0000", 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002054349 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475801+0000", 2024-04-24T13:33:23.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8054e-05 2024-04-24T13:33:23.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475814+0000", 2024-04-24T13:33:23.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3515e-05 2024-04-24T13:33:23.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488934+0000", 2024-04-24T13:33:23.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013119772 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488977+0000", 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2922e-05 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496474+0000", 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074975320000000003 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496543+0000", 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8188999999999994e-05 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2251 3.3a e85/20 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head v 85'3, mlcod=81'1)", 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 54.437495984000002, 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024431608, 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.295 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:23.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:23.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841228+0000", 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.781e-06 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846614+0000", 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053854419999999998 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846650+0000", 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6133000000000001e-05 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846669+0000", 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9199e-05 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846763+0000", 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4335999999999999e-05 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846799+0000", 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5796000000000001e-05 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865616+0000", 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018816825999999998 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865658+0000", 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2095000000000003e-05 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2667 3.39 3:9ef26513:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:23.299 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:23.300 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.095697856000001, 2024-04-24T13:33:23.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021597445, 2024-04-24T13:33:23.300 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.300 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.300 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.300 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.300 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2667 2024-04-24T13:33:23.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.300 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183028+0000", 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.444e-06 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185652+0000", 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026242420000000002 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185674+0000", 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1429000000000001e-05 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185683+0000", 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4069999999999999e-06 2024-04-24T13:33:23.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185746+0000", 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2621999999999998e-05 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185750+0000", 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7840000000000003e-06 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188091+0000", 2024-04-24T13:33:23.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023404709999999998 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188186+0000", 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5136000000000005e-05 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188277+0000", 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0661000000000005e-05 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.196753+0000", 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084765789999999997 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204495+0000", 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077418260000000003 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204569+0000", 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3906999999999996e-05 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204622+0000", 2024-04-24T13:33:23.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2936999999999998e-05 2024-04-24T13:33:23.306 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.306 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.306 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.306 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2675 3.20 e100/20 3:04d57de4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_14:head v 100'3, mlcod=85'1)", 2024-04-24T13:33:23.306 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:23.306 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.008866413, 2024-04-24T13:33:23.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027012970000000001, 2024-04-24T13:33:23.306 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.306 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.306 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.72e-07 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275705+0000", 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058491849999999998 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275732+0000", 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6630000000000001e-05 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275747+0000", 2024-04-24T13:33:23.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5375000000000001e-05 2024-04-24T13:33:23.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275839+0000", 2024-04-24T13:33:23.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1348999999999996e-05 2024-04-24T13:33:23.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275873+0000", 2024-04-24T13:33:23.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4341999999999997e-05 2024-04-24T13:33:23.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296810+0000", 2024-04-24T13:33:23.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020937196000000002 2024-04-24T13:33:23.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296869+0000", 2024-04-24T13:33:23.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8621e-05 2024-04-24T13:33:23.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.310 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.310 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2676 3.22 e100/74 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head v 100'6, mlcod=86'4)", 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.004065570000002, 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022762185000000001, 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274658+0000", 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.466e-06 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277453+0000", 2024-04-24T13:33:23.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027952799999999998 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277477+0000", 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3533e-05 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277490+0000", 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2978e-05 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277588+0000", 2024-04-24T13:33:23.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7796999999999999e-05 2024-04-24T13:33:23.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277617+0000", 2024-04-24T13:33:23.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8878e-05 2024-04-24T13:33:23.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297382+0000", 2024-04-24T13:33:23.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019765373999999999 2024-04-24T13:33:23.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297419+0000", 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6878999999999997e-05 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2688 3.3a e100/20 3:5c6b1f96:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_27:head v 100'9, mlcod=86'7)", 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.881899994000001, 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020500114999999999, 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.315 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.316 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:23.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:23.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396823+0000", 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-07 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.404984+0000", 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081613310000000008 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405002+0000", 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7550999999999998e-05 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405012+0000", 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0039e-05 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405077+0000", 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5220000000000002e-05 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405094+0000", 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7377e-05 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.417271+0000", 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012177248 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.417322+0000", 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0980000000000003e-05 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2689 3.17 3:eb254e54:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.879344880000001, 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020838804999999998, 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2689 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.321 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:23.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:23.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399380+0000", 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.311e-06 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401455+0000", 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020751419999999999 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401489+0000", 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4078999999999997e-05 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401501+0000", 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2320000000000001e-05 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401564+0000", 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2518e-05 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401673+0000", 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010889 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401787+0000", 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113859 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.416314+0000", 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014527804 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.419649+0000", 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033342049999999998 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.419942+0000", 2024-04-24T13:33:23.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000293477 2024-04-24T13:33:23.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.420216+0000", 2024-04-24T13:33:23.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0002742 2024-04-24T13:33:23.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.326 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2693 3.39 3:9e56554d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.838025929000001, 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284832, 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2693 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440699+0000", 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2199999999999999e-06 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441920+0000", 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012213739999999999 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441944+0000", 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4127000000000001e-05 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441963+0000", 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.855e-05 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442027+0000", 2024-04-24T13:33:23.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4337000000000004e-05 2024-04-24T13:33:23.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442150+0000", 2024-04-24T13:33:23.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012347399999999999 2024-04-24T13:33:23.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:23.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442248+0000", 2024-04-24T13:33:23.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7683999999999995e-05 2024-04-24T13:33:23.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.447435+0000", 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005186955 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465898+0000", 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018462971000000002 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465947+0000", 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9276000000000001e-05 2024-04-24T13:33:23.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465981+0000", 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3864e-05 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2723 3.37 3:ecde4b94:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.635244930999999, 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023622656999999998, 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.332 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2723 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643480+0000", 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6960000000000001e-06 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645332+0000", 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001851561 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645362+0000", 2024-04-24T13:33:23.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0298e-05 2024-04-24T13:33:23.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645375+0000", 2024-04-24T13:33:23.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.331e-05 2024-04-24T13:33:23.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645460+0000", 2024-04-24T13:33:23.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4851999999999993e-05 2024-04-24T13:33:23.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:23.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645467+0000", 2024-04-24T13:33:23.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0140000000000001e-06 2024-04-24T13:33:23.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.653874+0000", 2024-04-24T13:33:23.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084073340000000007 2024-04-24T13:33:23.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654042+0000", 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000167159 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654214+0000", 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017199899999999999 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666361+0000", 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012146957999999999 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666977+0000", 2024-04-24T13:33:23.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061606400000000004 2024-04-24T13:33:23.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667043+0000", 2024-04-24T13:33:23.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:23.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667100+0000", 2024-04-24T13:33:23.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7080999999999998e-05 2024-04-24T13:33:23.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.339 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.339 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.339 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2746 3.30 3:0ff52a22:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:23.339 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:23.339 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.391942029999999, 2024-04-24T13:33:23.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025777590999999999, 2024-04-24T13:33:23.339 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.339 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.339 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2746 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886783+0000", 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8930000000000001e-06 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889050+0000", 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002267107 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889078+0000", 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7623999999999998e-05 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889091+0000", 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3101e-05 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889170+0000", 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8968999999999996e-05 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889311+0000", 2024-04-24T13:33:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141392 2024-04-24T13:33:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889451+0000", 2024-04-24T13:33:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139911 2024-04-24T13:33:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.895637+0000", 2024-04-24T13:33:23.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061857290000000001 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912426+0000", 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016789347999999999 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912501+0000", 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4836e-05 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912558+0000", 2024-04-24T13:33:23.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6681000000000002e-05 2024-04-24T13:33:23.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.345 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.345 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.345 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2754 3.b e101/20 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head v 101'7, mlcod=86'5)", 2024-04-24T13:33:23.345 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:23.345 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.293381299, 2024-04-24T13:33:23.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025167067000000001, 2024-04-24T13:33:23.345 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.345 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.345 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.345 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:23.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:23.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985343+0000", 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.734e-06 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987192+0000", 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018490360000000001 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987224+0000", 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2588e-05 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987241+0000", 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6350000000000001e-05 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987338+0000", 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7466000000000005e-05 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987368+0000", 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0210999999999999e-05 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010454+0000", 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02308522 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010508+0000", 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4462000000000001e-05 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2755 3.12 3:4bcc7c5c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:23.349 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:23.350 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.292969411000001, 2024-04-24T13:33:23.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026401981000000001, 2024-04-24T13:33:23.350 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.350 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.350 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2755 2024-04-24T13:33:23.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.350 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985757+0000", 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6370000000000001e-06 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987459+0000", 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017029180000000001 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987474+0000", 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4460999999999999e-05 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987484+0000", 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0168e-05 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987576+0000", 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2020000000000003e-05 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987731+0000", 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015486499999999999 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987818+0000", 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012049+0000", 2024-04-24T13:33:23.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02423055 2024-04-24T13:33:23.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012062+0000", 2024-04-24T13:33:23.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3054000000000001e-05 2024-04-24T13:33:23.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012114+0000", 2024-04-24T13:33:23.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1656999999999997e-05 2024-04-24T13:33:23.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012155+0000", 2024-04-24T13:33:23.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1300000000000001e-05 2024-04-24T13:33:23.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.355 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.355 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2762 3.39 3:9dc3ddb4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:23.355 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.224455673000001, 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02109138, 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2762 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054269+0000", 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1859999999999999e-06 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.055994+0000", 2024-04-24T13:33:23.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001725196 2024-04-24T13:33:23.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056030+0000", 2024-04-24T13:33:23.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5914999999999997e-05 2024-04-24T13:33:23.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056047+0000", 2024-04-24T13:33:23.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6693000000000001e-05 2024-04-24T13:33:23.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056132+0000", 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5797000000000005e-05 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056297+0000", 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164265 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056460+0000", 2024-04-24T13:33:23.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016338600000000001 2024-04-24T13:33:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.066355+0000", 2024-04-24T13:33:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0098949050000000007 2024-04-24T13:33:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075280+0000", 2024-04-24T13:33:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089252210000000005 2024-04-24T13:33:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075324+0000", 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3939000000000001e-05 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075358+0000", 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3877000000000001e-05 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2764 3.23 3:c46f1960:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:23.361 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.200979097000001, 2024-04-24T13:33:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020127275, 2024-04-24T13:33:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2764 2024-04-24T13:33:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077745+0000", 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2800000000000002e-06 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078808+0000", 2024-04-24T13:33:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001062351 2024-04-24T13:33:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078826+0000", 2024-04-24T13:33:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8045000000000001e-05 2024-04-24T13:33:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078835+0000", 2024-04-24T13:33:23.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5999999999999996e-06 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078907+0000", 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1068000000000005e-05 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.079064+0000", 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157532 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.079221+0000", 2024-04-24T13:33:23.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015694400000000001 2024-04-24T13:33:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.092808+0000", 2024-04-24T13:33:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013586671999999999 2024-04-24T13:33:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097696+0000", 2024-04-24T13:33:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004887906 2024-04-24T13:33:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097795+0000", 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9701e-05 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097870+0000", 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5176e-05 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2770 3.1 3:80489e4c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:23.367 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.145116162000001, 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025093718000000001, 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2770 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:23.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133609+0000", 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0369999999999999e-06 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135153+0000", 2024-04-24T13:33:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015441229999999999 2024-04-24T13:33:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135182+0000", 2024-04-24T13:33:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8300999999999999e-05 2024-04-24T13:33:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135196+0000", 2024-04-24T13:33:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4229999999999999e-05 2024-04-24T13:33:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135279+0000", 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3549999999999998e-05 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135458+0000", 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017893100000000001 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135611+0000", 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152881 2024-04-24T13:33:23.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.144283+0000", 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086718709999999994 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158560+0000", 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014277306 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158642+0000", 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1435999999999998e-05 2024-04-24T13:33:23.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158700+0000", 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8051999999999999e-05 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2788 3.39 3:9c7af06c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.963253957999999, 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021514591999999999, 2024-04-24T13:33:23.373 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2788 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315470+0000", 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7680000000000001e-06 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316763+0000", 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001292947 2024-04-24T13:33:23.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316787+0000", 2024-04-24T13:33:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4068999999999999e-05 2024-04-24T13:33:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316799+0000", 2024-04-24T13:33:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2374999999999999e-05 2024-04-24T13:33:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316874+0000", 2024-04-24T13:33:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4133000000000003e-05 2024-04-24T13:33:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316992+0000", 2024-04-24T13:33:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117933 2024-04-24T13:33:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.317153+0000", 2024-04-24T13:33:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000161101 2024-04-24T13:33:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.323588+0000", 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064355749999999998 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336852+0000", 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013264233 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336924+0000", 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1746000000000001e-05 2024-04-24T13:33:23.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336983+0000", 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8712000000000003e-05 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2795 3.39 3:9fba68c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.894104971000001, 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932186000000001, 2024-04-24T13:33:23.379 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2795 2024-04-24T13:33:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384619+0000", 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9939999999999999e-06 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386448+0000", 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001828744 2024-04-24T13:33:23.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386484+0000", 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5976000000000002e-05 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386500+0000", 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5746000000000001e-05 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386604+0000", 2024-04-24T13:33:23.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104162 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386806+0000", 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020206400000000001 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386995+0000", 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018851 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.398238+0000", 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011243337000000001 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404473+0000", 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062350979999999997 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404514+0000", 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1418999999999998e-05 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404550+0000", 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5135999999999997e-05 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2811 3.7 e101/41 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head v 101'8, mlcod=101'6)", 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.698138183000001, 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026659326000000001, 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.385 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580586+0000", 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.668e-06 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582238+0000", 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016524829999999999 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582266+0000", 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8028e-05 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582282+0000", 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6047999999999999e-05 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582372+0000", 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9642999999999995e-05 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582400+0000", 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7776999999999998e-05 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607184+0000", 2024-04-24T13:33:23.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024784418999999999 2024-04-24T13:33:23.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607243+0000", 2024-04-24T13:33:23.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9259999999999998e-05 2024-04-24T13:33:23.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.389 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.389 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.389 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:23.391 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:23.391 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:23.390+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:23.492 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:23.489+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:23.558 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:23.559 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:23.559 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:23.559 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:23.572 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:33:23.619 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:23.618+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:23.688 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:23.688 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:23.688 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:23.688 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:23.688 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:23.694 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:23.693+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:23.701 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:33:23.795 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:23.793+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:23.864 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1615 3.1a e82/20 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head v 82'1, mlcod=0'0)", 2024-04-24T13:33:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 65.648808020000004, 2024-04-24T13:33:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013622553000000001, 2024-04-24T13:33:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.865 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212985+0000", 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1370000000000001e-06 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219240+0000", 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062543240000000003 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219257+0000", 2024-04-24T13:33:23.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6940999999999999e-05 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219267+0000", 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0283e-05 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219324+0000", 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6950999999999997e-05 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219343+0000", 2024-04-24T13:33:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8681999999999998e-05 2024-04-24T13:33:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226529+0000", 2024-04-24T13:33:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071867169999999996 2024-04-24T13:33:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226607+0000", 2024-04-24T13:33:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7517999999999999e-05 2024-04-24T13:33:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.869 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2219 3.0 3:00e6fe99:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.369653626000002, 2024-04-24T13:33:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01535366, 2024-04-24T13:33:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.870 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2219 2024-04-24T13:33:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:23.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492150+0000", 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1046999999999999e-05 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494106+0000", 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019561940000000001 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494133+0000", 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7617999999999999e-05 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494150+0000", 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6096999999999999e-05 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494240+0000", 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0786999999999997e-05 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494435+0000", 2024-04-24T13:33:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000195021 2024-04-24T13:33:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494611+0000", 2024-04-24T13:33:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017601100000000001 2024-04-24T13:33:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507078+0000", 2024-04-24T13:33:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012466395 2024-04-24T13:33:23.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507374+0000", 2024-04-24T13:33:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029577100000000001 2024-04-24T13:33:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507429+0000", 2024-04-24T13:33:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5928999999999999e-05 2024-04-24T13:33:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507492+0000", 2024-04-24T13:33:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.279e-05 2024-04-24T13:33:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2230 3.19 3:99352026:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:23.876 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.253670636000003, 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013072217000000001, 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2230 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:23.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:23.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608124+0000", 2024-04-24T13:33:23.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6740000000000001e-06 2024-04-24T13:33:23.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609736+0000", 2024-04-24T13:33:23.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016116430000000001 2024-04-24T13:33:23.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609766+0000", 2024-04-24T13:33:23.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0497e-05 2024-04-24T13:33:23.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609781+0000", 2024-04-24T13:33:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4810999999999999e-05 2024-04-24T13:33:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609861+0000", 2024-04-24T13:33:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9320999999999995e-05 2024-04-24T13:33:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609972+0000", 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111116 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.610087+0000", 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115161 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.620611+0000", 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010524554 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621126+0000", 2024-04-24T13:33:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051447699999999995 2024-04-24T13:33:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621163+0000", 2024-04-24T13:33:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6838999999999997e-05 2024-04-24T13:33:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621194+0000", 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1124000000000002e-05 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2252 3.4 3:22834b58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.016213686, 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932545999999999, 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.883 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2252 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845581+0000", 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847834+0000", 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002252843 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847863+0000", 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.904e-05 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847877+0000", 2024-04-24T13:33:23.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4126e-05 2024-04-24T13:33:23.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847963+0000", 2024-04-24T13:33:23.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6162999999999995e-05 2024-04-24T13:33:23.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848105+0000", 2024-04-24T13:33:23.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014117900000000001 2024-04-24T13:33:23.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:23.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848252+0000", 2024-04-24T13:33:23.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014774800000000001 2024-04-24T13:33:23.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865043+0000", 2024-04-24T13:33:23.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016790848000000001 2024-04-24T13:33:23.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865405+0000", 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036176900000000001 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865460+0000", 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5334000000000002e-05 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865511+0000", 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0784e-05 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.888 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2663 3.0 3:01df44a3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.722439652999999, 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020742727999999998, 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.889 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2663 2024-04-24T13:33:23.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.890 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:23.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139355+0000", 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2529999999999999e-06 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141777+0000", 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002422638 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141800+0000", 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2949e-05 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141812+0000", 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1551e-05 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141907+0000", 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5296000000000004e-05 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141917+0000", 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.414e-06 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144519+0000", 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026024220000000001 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144684+0000", 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164511 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:23.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144845+0000", 2024-04-24T13:33:23.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016157000000000001 2024-04-24T13:33:23.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.156972+0000", 2024-04-24T13:33:23.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012126855000000001 2024-04-24T13:33:23.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.159989+0000", 2024-04-24T13:33:23.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003016609 2024-04-24T13:33:23.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160059+0000", 2024-04-24T13:33:23.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0598000000000004e-05 2024-04-24T13:33:23.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160095+0000", 2024-04-24T13:33:23.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6062000000000001e-05 2024-04-24T13:33:23.895 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.895 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.895 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2664 3.4 3:21467061:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.708940055999999, 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013894336, 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2664 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152854+0000", 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0109999999999999e-06 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154070+0000", 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012153940000000001 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154096+0000", 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6109e-05 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154110+0000", 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4489e-05 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154184+0000", 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4035000000000005e-05 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154325+0000", 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014115500000000001 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154474+0000", 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000148811 2024-04-24T13:33:23.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.165413+0000", 2024-04-24T13:33:23.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010938333999999999 2024-04-24T13:33:23.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166625+0000", 2024-04-24T13:33:23.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001212526 2024-04-24T13:33:23.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166692+0000", 2024-04-24T13:33:23.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7013000000000004e-05 2024-04-24T13:33:23.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166747+0000", 2024-04-24T13:33:23.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4459000000000002e-05 2024-04-24T13:33:23.901 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.901 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.901 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.902 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2672 3.1c e100/74 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head v 100'4, mlcod=85'2)", 2024-04-24T13:33:23.902 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:23.902 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.624298096, 2024-04-24T13:33:23.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022091785999999999, 2024-04-24T13:33:23.902 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.902 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.902 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.902 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:23.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237495+0000", 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1500000000000005e-07 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243044+0000", 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055497869999999996 2024-04-24T13:33:23.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243082+0000", 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7208e-05 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243097+0000", 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5554e-05 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243175+0000", 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7849999999999995e-05 2024-04-24T13:33:23.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243194+0000", 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8822999999999999e-05 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259527+0000", 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016333007 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259586+0000", 2024-04-24T13:33:23.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9042000000000002e-05 2024-04-24T13:33:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2677 3.25 3:a4f04b59:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.579412344000001, 2024-04-24T13:33:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015627926, 2024-04-24T13:33:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.906 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2677 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:23.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282383+0000", 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1499999999999999e-06 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283869+0000", 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014862269999999999 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283897+0000", 2024-04-24T13:33:23.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7596000000000001e-05 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283911+0000", 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.367e-05 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283981+0000", 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0349e-05 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284117+0000", 2024-04-24T13:33:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013656000000000001 2024-04-24T13:33:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284214+0000", 2024-04-24T13:33:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6558999999999995e-05 2024-04-24T13:33:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296745+0000", 2024-04-24T13:33:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012530845000000001 2024-04-24T13:33:23.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297925+0000", 2024-04-24T13:33:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001179706 2024-04-24T13:33:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297961+0000", 2024-04-24T13:33:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6514999999999999e-05 2024-04-24T13:33:23.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.298008+0000", 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6749000000000003e-05 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2706 3.1c e100/74 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head v 100'5, mlcod=86'3)", 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.386992415000002, 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021017514000000001, 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.912 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474802+0000", 2024-04-24T13:33:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1399999999999998e-06 2024-04-24T13:33:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480124+0000", 2024-04-24T13:33:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053217059999999998 2024-04-24T13:33:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480147+0000", 2024-04-24T13:33:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3646e-05 2024-04-24T13:33:23.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480159+0000", 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2133999999999999e-05 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480237+0000", 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7531e-05 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480291+0000", 2024-04-24T13:33:23.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3851999999999999e-05 2024-04-24T13:33:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495746+0000", 2024-04-24T13:33:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015454684 2024-04-24T13:33:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495817+0000", 2024-04-24T13:33:23.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1821000000000002e-05 2024-04-24T13:33:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.917 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2722 3.25 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.229588405000001, 2024-04-24T13:33:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035782711000000002, 2024-04-24T13:33:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2722 2024-04-24T13:33:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632207+0000", 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.252e-06 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634575+0000", 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023682500000000001 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634606+0000", 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0284999999999999e-05 2024-04-24T13:33:23.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634619+0000", 2024-04-24T13:33:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3491e-05 2024-04-24T13:33:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634703+0000", 2024-04-24T13:33:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4214000000000004e-05 2024-04-24T13:33:23.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634711+0000", 2024-04-24T13:33:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9719999999999992e-06 2024-04-24T13:33:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639813+0000", 2024-04-24T13:33:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051013830000000001 2024-04-24T13:33:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639969+0000", 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015674600000000001 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.640112+0000", 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142347 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647222+0000", 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071106520000000003 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667844+0000", 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020621746999999999 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667925+0000", 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0717999999999995e-05 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667987+0000", 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1654000000000003e-05 2024-04-24T13:33:23.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2730 3.19 3:984637ec:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.137941932, 2024-04-24T13:33:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014952841999999999, 2024-04-24T13:33:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.925 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2730 2024-04-24T13:33:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723854+0000", 2024-04-24T13:33:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4180000000000001e-06 2024-04-24T13:33:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725292+0000", 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014378870000000001 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725322+0000", 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0596999999999999e-05 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725337+0000", 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4684999999999999e-05 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725423+0000", 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5997999999999999e-05 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725596+0000", 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000172654 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725755+0000", 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015988600000000001 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734196+0000", 2024-04-24T13:33:23.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084404170000000004 2024-04-24T13:33:23.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738679+0000", 2024-04-24T13:33:23.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044834189999999998 2024-04-24T13:33:23.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738747+0000", 2024-04-24T13:33:23.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7890000000000002e-05 2024-04-24T13:33:23.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738803+0000", 2024-04-24T13:33:23.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5991e-05 2024-04-24T13:33:23.931 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.931 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.931 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.931 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2737 3.4 3:23416714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:23.931 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:23.931 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.068656301000001, 2024-04-24T13:33:23.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019181262000000001, 2024-04-24T13:33:23.932 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.932 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.932 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.932 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2737 2024-04-24T13:33:23.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793139+0000", 2024-04-24T13:33:23.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-04-24T13:33:23.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795403+0000", 2024-04-24T13:33:23.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002264252 2024-04-24T13:33:23.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795439+0000", 2024-04-24T13:33:23.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5701999999999998e-05 2024-04-24T13:33:23.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795454+0000", 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5262999999999999e-05 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795541+0000", 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6989000000000003e-05 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795719+0000", 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000177906 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795875+0000", 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155785 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.808532+0000", 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012657695 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812189+0000", 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036562809999999999 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812258+0000", 2024-04-24T13:33:23.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9210999999999999e-05 2024-04-24T13:33:23.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812317+0000", 2024-04-24T13:33:23.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9407000000000002e-05 2024-04-24T13:33:23.937 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.937 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.937 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.938 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2752 3.1c e101/74 3:3ae15365:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_81:head v 101'6, mlcod=100'4)", 2024-04-24T13:33:23.938 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:23.938 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.901348143, 2024-04-24T13:33:23.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013320523000000001, 2024-04-24T13:33:23.938 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.938 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.938 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.938 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:23.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:23.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960446+0000", 2024-04-24T13:33:23.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0590000000000001e-06 2024-04-24T13:33:23.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.965992+0000", 2024-04-24T13:33:23.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055462810000000001 2024-04-24T13:33:23.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966034+0000", 2024-04-24T13:33:23.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1485e-05 2024-04-24T13:33:23.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966051+0000", 2024-04-24T13:33:23.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7404000000000001e-05 2024-04-24T13:33:23.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966178+0000", 2024-04-24T13:33:23.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012681899999999999 2024-04-24T13:33:23.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966198+0000", 2024-04-24T13:33:23.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9944000000000001e-05 2024-04-24T13:33:23.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.973717+0000", 2024-04-24T13:33:23.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075185299999999998 2024-04-24T13:33:23.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.973765+0000", 2024-04-24T13:33:23.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8000999999999997e-05 2024-04-24T13:33:23.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.946 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.947 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2772 3.1a e101/20 3:589df240:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_101:head v 101'3, mlcod=82'1)", 2024-04-24T13:33:23.947 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:23.947 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.702266695999999, 2024-04-24T13:33:23.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013122586, 2024-04-24T13:33:23.947 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.947 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.947 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.948 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:23.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:23.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159527+0000", 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165074+0000", 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055466129999999997 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165100+0000", 2024-04-24T13:33:23.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5789e-05 2024-04-24T13:33:23.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165110+0000", 2024-04-24T13:33:23.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0036e-05 2024-04-24T13:33:23.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165198+0000", 2024-04-24T13:33:23.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7981999999999999e-05 2024-04-24T13:33:23.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165229+0000", 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1022999999999998e-05 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.172572+0000", 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073435519999999997 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.172648+0000", 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6013000000000006e-05 2024-04-24T13:33:23.951 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2781 3.e e101/41 3:704d2ad1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_110:head v 101'4, mlcod=85'2)", 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.611101796, 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017614365, 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:23.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:23.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250692+0000", 2024-04-24T13:33:23.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3570000000000001e-06 2024-04-24T13:33:23.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256430+0000", 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057381300000000001 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256465+0000", 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4974000000000001e-05 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256480+0000", 2024-04-24T13:33:23.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5000999999999999e-05 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256571+0000", 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1008999999999995e-05 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256599+0000", 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7676000000000001e-05 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268237+0000", 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011638081 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268305+0000", 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8137000000000002e-05 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2782 3.2b e101/41 3:d5b98152:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_111:head v 101'8, mlcod=86'6)", 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:23.956 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.604317761000001, 2024-04-24T13:33:23.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013494414, 2024-04-24T13:33:23.957 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.957 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.957 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.957 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:23.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257476+0000", 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.499e-06 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259466+0000", 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019901609999999998 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259489+0000", 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3144000000000001e-05 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259502+0000", 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3046e-05 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259580+0000", 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7871e-05 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259607+0000", 2024-04-24T13:33:23.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6828000000000001e-05 2024-04-24T13:33:23.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.270920+0000", 2024-04-24T13:33:23.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011312533 2024-04-24T13:33:23.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.270969+0000", 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9332000000000001e-05 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2785 3.e e101/41 3:72bc610a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_114:head v 101'5, mlcod=86'3)", 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.569324844, 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014730050999999999, 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.961 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.962 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:23.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:23.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292470+0000", 2024-04-24T13:33:23.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2089999999999999e-06 2024-04-24T13:33:23.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297260+0000", 2024-04-24T13:33:23.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047903989999999999 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297293+0000", 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3398000000000001e-05 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297309+0000", 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5290000000000001e-05 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297386+0000", 2024-04-24T13:33:23.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7218999999999994e-05 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297406+0000", 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9936999999999999e-05 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.307133+0000", 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097276359999999996 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.307197+0000", 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3962999999999997e-05 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2810 3.16 3:69a6ac6a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.306086113999999, 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015206692000000001, 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.966 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2810 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:23.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555709+0000", 2024-04-24T13:33:23.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0240000000000002e-06 2024-04-24T13:33:23.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557455+0000", 2024-04-24T13:33:23.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001745763 2024-04-24T13:33:23.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557482+0000", 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6679999999999999e-05 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557496+0000", 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4185000000000001e-05 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557575+0000", 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9419000000000007e-05 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557715+0000", 2024-04-24T13:33:23.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140264 2024-04-24T13:33:23.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:23.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557805+0000", 2024-04-24T13:33:23.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9511000000000004e-05 2024-04-24T13:33:23.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:23.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.563323+0000", 2024-04-24T13:33:23.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055181300000000004 2024-04-24T13:33:23.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570784+0000", 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074609350000000001 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570856+0000", 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1484999999999997e-05 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570913+0000", 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7296000000000002e-05 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.972 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.973 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2813 3.6 e101/20 3:63b60245:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_142:head v 101'4, mlcod=86'2)", 2024-04-24T13:33:23.973 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:23.973 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.269382230000001, 2024-04-24T13:33:23.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015409209, 2024-04-24T13:33:23.973 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.973 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.973 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.973 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:23.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:23.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592412+0000", 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2819999999999999e-06 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594446+0000", 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020333840000000001 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594471+0000", 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5287e-05 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594482+0000", 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1063999999999999e-05 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594585+0000", 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010303500000000001 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594609+0000", 2024-04-24T13:33:23.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3951000000000002e-05 2024-04-24T13:33:23.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607767+0000", 2024-04-24T13:33:23.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013158115999999999 2024-04-24T13:33:23.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607819+0000", 2024-04-24T13:33:23.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2089999999999998e-05 2024-04-24T13:33:23.978 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.978 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.978 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.978 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2814 3.8 e101/20 3:11e81300:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_143:head v 101'7, mlcod=101'5)", 2024-04-24T13:33:23.978 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:23.978 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.257345922999999, 2024-04-24T13:33:23.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013378928999999999, 2024-04-24T13:33:23.978 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:23.978 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:23.978 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604448+0000", 2024-04-24T13:33:23.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4610000000000001e-06 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606315+0000", 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001866957 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606338+0000", 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3010000000000002e-05 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:23.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606352+0000", 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4754e-05 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606438+0000", 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5239000000000002e-05 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606466+0000", 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8476999999999999e-05 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:23.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.617758+0000", 2024-04-24T13:33:23.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011291436 2024-04-24T13:33:23.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:23.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:23.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:23.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.617825+0000", 2024-04-24T13:33:23.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7595000000000006e-05 2024-04-24T13:33:23.982 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.982 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.982 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.982 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:23.983 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:23.983 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:23.984 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:33:23.985 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:33:23.986 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:23.982+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:24.017 INFO:tasks.workunit.client.0.smithi071.stderr:200+0 records in 2024-04-24T13:33:24.017 INFO:tasks.workunit.client.0.smithi071.stderr:200+0 records out 2024-04-24T13:33:24.017 INFO:tasks.workunit.client.0.smithi071.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.9026 s, 151 MB/s 2024-04-24T13:33:24.085 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:24.082+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:24.150 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:24.150 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:24.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.150 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.5789.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93911530600144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e111)", 2024-04-24T13:33:24.150 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:24.149568+0000", 2024-04-24T13:33:24.150 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.00092211799999999998, 2024-04-24T13:33:24.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00094200200000000005, 2024-04-24T13:33:24.150 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.150 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.150 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "waiting for sub ops", 2024-04-24T13:33:24.150 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.151 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.5789", 2024-04-24T13:33:24.151 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/4112481629", 2024-04-24T13:33:24.151 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 51 2024-04-24T13:33:24.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.151 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:24.149568+0000", 2024-04-24T13:33:24.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:24.149568+0000", 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:24.149569+0000", 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.124e-06 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:24.149573+0000", 2024-04-24T13:33:24.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2459999999999999e-06 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:24.149582+0000", 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4040000000000001e-06 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:24.149587+0000", 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4489999999999998e-06 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:24.149625+0000", 2024-04-24T13:33:24.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7784999999999998e-05 2024-04-24T13:33:24.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:24.149681+0000", 2024-04-24T13:33:24.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5550000000000002e-05 2024-04-24T13:33:24.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:24.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:24.149782+0000", 2024-04-24T13:33:24.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101402 2024-04-24T13:33:24.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:24.150205+0000", 2024-04-24T13:33:24.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00042260099999999999 2024-04-24T13:33:24.155 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.155 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.155 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.155 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.155 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-24T13:33:24.155 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 1 2024-04-24T13:33:24.155 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:24.165 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:33:24.206 INFO:tasks.workunit.client.0.smithi071.stdout:Bucket Created: buck_2024_03_24_13_33_24 2024-04-24T13:33:24.207 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:24.206+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:24.286 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:24.285+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:24.323 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:24.323 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:24.324 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:24.338 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:33:24.347 INFO:tasks.workunit.client.0.smithi071.stdout:quota set for the bucket: buck_2024_03_24_13_33_24 2024-04-24T13:33:24.387 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:24.386+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:24.460 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2206 3.f 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:24.460 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.168456329999998, 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028291495999999999, 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2206 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:24.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290398+0000", 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000001e-06 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294671+0000", 2024-04-24T13:33:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042724390000000003 2024-04-24T13:33:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294711+0000", 2024-04-24T13:33:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0376000000000001e-05 2024-04-24T13:33:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294730+0000", 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8607e-05 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294856+0000", 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126651 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295125+0000", 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026840700000000002 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295349+0000", 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022454699999999999 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307240+0000", 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011891048 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318593+0000", 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011352777999999999 2024-04-24T13:33:24.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318652+0000", 2024-04-24T13:33:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8677000000000001e-05 2024-04-24T13:33:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318686+0000", 2024-04-24T13:33:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4616000000000002e-05 2024-04-24T13:33:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2209 3.14 3:287cf44b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.123152169999997, 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020682494999999999, 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2209 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.467 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335702+0000", 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339081+0000", 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003378664 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339119+0000", 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8355999999999997e-05 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339138+0000", 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8546000000000002e-05 2024-04-24T13:33:24.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339268+0000", 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013028599999999999 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339503+0000", 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023542699999999999 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339734+0000", 2024-04-24T13:33:24.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023122 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.348300+0000", 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085659870000000006 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356108+0000", 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078075109999999996 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356259+0000", 2024-04-24T13:33:24.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015104800000000001 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356381+0000", 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012243599999999999 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2227 3.14 3:28702767:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.881853538000001, 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017797177000000001, 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.472 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2227 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.577000+0000", 2024-04-24T13:33:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8760000000000001e-06 2024-04-24T13:33:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579496+0000", 2024-04-24T13:33:24.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024951740000000002 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579521+0000", 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5361e-05 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579533+0000", 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2377e-05 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579602+0000", 2024-04-24T13:33:24.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8325999999999996e-05 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579799+0000", 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019773800000000001 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579997+0000", 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019725299999999999 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.586752+0000", 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006755179 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594712+0000", 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079597049999999992 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594757+0000", 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4956000000000001e-05 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594795+0000", 2024-04-24T13:33:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8232000000000003e-05 2024-04-24T13:33:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2244 3.3b 3:ddfbb493:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.693454688000003, 2024-04-24T13:33:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020329852999999998, 2024-04-24T13:33:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.478 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2244 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765398+0000", 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.291e-06 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766959+0000", 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015617680000000001 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766985+0000", 2024-04-24T13:33:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5899999999999999e-05 2024-04-24T13:33:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766996+0000", 2024-04-24T13:33:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0642000000000001e-05 2024-04-24T13:33:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767076+0000", 2024-04-24T13:33:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9542999999999994e-05 2024-04-24T13:33:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767184+0000", 2024-04-24T13:33:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107964 2024-04-24T13:33:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767269+0000", 2024-04-24T13:33:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5798999999999996e-05 2024-04-24T13:33:24.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.772877+0000", 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056080560000000002 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785554+0000", 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012676642 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785639+0000", 2024-04-24T13:33:24.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4938999999999994e-05 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785726+0000", 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7309e-05 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2265 3.14 3:2a53907b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.463416221000003, 2024-04-24T13:33:24.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016926096000000002, 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2265 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995438+0000", 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1080000000000001e-06 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997447+0000", 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002008625 2024-04-24T13:33:24.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997484+0000", 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7070999999999998e-05 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997508+0000", 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4324999999999998e-05 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997617+0000", 2024-04-24T13:33:24.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010898799999999999 2024-04-24T13:33:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997787+0000", 2024-04-24T13:33:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000169956 2024-04-24T13:33:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997949+0000", 2024-04-24T13:33:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016190599999999999 2024-04-24T13:33:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.005098+0000", 2024-04-24T13:33:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071488300000000001 2024-04-24T13:33:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012231+0000", 2024-04-24T13:33:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071334040000000003 2024-04-24T13:33:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012305+0000", 2024-04-24T13:33:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4017000000000006e-05 2024-04-24T13:33:24.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012361+0000", 2024-04-24T13:33:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-04-24T13:33:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2669 3.21 3:86a0e0c3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.256525670999999, 2024-04-24T13:33:24.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020962138000000002, 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2669 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202328+0000", 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-06 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204239+0000", 2024-04-24T13:33:24.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019104409999999999 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204265+0000", 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6054000000000002e-05 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204279+0000", 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3654e-05 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204361+0000", 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2522999999999996e-05 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204523+0000", 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000162332 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204661+0000", 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013798200000000001 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.210336+0000", 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056743339999999996 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223107+0000", 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012771714999999999 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223228+0000", 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012061300000000001 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223288+0000", 2024-04-24T13:33:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9537999999999998e-05 2024-04-24T13:33:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2670 3.14 3:2b621d8a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.247119637000001, 2024-04-24T13:33:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018441043000000001, 2024-04-24T13:33:24.496 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2670 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211734+0000", 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3429999999999998e-06 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213786+0000", 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002052637 2024-04-24T13:33:24.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213813+0000", 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6193000000000001e-05 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213825+0000", 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1905999999999999e-05 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213906+0000", 2024-04-24T13:33:24.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1075999999999994e-05 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.214023+0000", 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117738 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.214134+0000", 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011082900000000001 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.220138+0000", 2024-04-24T13:33:24.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060042059999999998 2024-04-24T13:33:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230042+0000", 2024-04-24T13:33:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099037559999999997 2024-04-24T13:33:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230116+0000", 2024-04-24T13:33:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3742e-05 2024-04-24T13:33:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230173+0000", 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6616999999999997e-05 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2710 3.3b 3:ddce91ac:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.946723262999999, 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026438756000000001, 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.502 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2710 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512131+0000", 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0130000000000002e-06 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514363+0000", 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022325940000000001 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514394+0000", 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0144000000000001e-05 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514409+0000", 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5786000000000001e-05 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514497+0000", 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7876999999999999e-05 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514670+0000", 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000173096 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514768+0000", 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8089000000000002e-05 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.523354+0000", 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085854190000000004 2024-04-24T13:33:24.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538483+0000", 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015128922 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538527+0000", 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3835999999999998e-05 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538567+0000", 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.998e-05 2024-04-24T13:33:24.507 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2711 3.13 e100/41 3:c9a0442c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_40:head v 100'9, mlcod=86'7)", 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.931380847, 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016831724999999999, 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527472+0000", 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6619999999999999e-06 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533965+0000", 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064927159999999999 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533980+0000", 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5192e-05 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533989+0000", 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3950000000000007e-06 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.534040+0000", 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0822000000000002e-05 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.534066+0000", 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6341000000000001e-05 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.544246+0000", 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010179354 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.544302+0000", 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6242999999999997e-05 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2712 3.2e 3:74e2d347:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_41:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.532098+0000", 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.926753250000001, 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016599603000000001, 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2712 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.532098+0000", 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.532098+0000", 2024-04-24T13:33:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.532101+0000", 2024-04-24T13:33:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1860000000000001e-06 2024-04-24T13:33:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533278+0000", 2024-04-24T13:33:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001177188 2024-04-24T13:33:24.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533313+0000", 2024-04-24T13:33:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5212000000000001e-05 2024-04-24T13:33:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533329+0000", 2024-04-24T13:33:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5866e-05 2024-04-24T13:33:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533406+0000", 2024-04-24T13:33:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6520000000000006e-05 2024-04-24T13:33:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533570+0000", 2024-04-24T13:33:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016464100000000001 2024-04-24T13:33:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533729+0000", 2024-04-24T13:33:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015817199999999999 2024-04-24T13:33:24.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.541495+0000", 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077664429999999996 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.548603+0000", 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071077240000000002 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.548642+0000", 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8838999999999999e-05 2024-04-24T13:33:24.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.548697+0000", 2024-04-24T13:33:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5812e-05 2024-04-24T13:33:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2716 3.13 e100/41 3:c8fec211:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_45:head v 100'10, mlcod=86'8)", 2024-04-24T13:33:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.881710367, 2024-04-24T13:33:24.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017185506, 2024-04-24T13:33:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:24.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577143+0000", 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.824e-06 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581297+0000", 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041541770000000002 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581333+0000", 2024-04-24T13:33:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6559e-05 2024-04-24T13:33:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581349+0000", 2024-04-24T13:33:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6036999999999999e-05 2024-04-24T13:33:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581429+0000", 2024-04-24T13:33:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9404000000000001e-05 2024-04-24T13:33:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581449+0000", 2024-04-24T13:33:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9949000000000002e-05 2024-04-24T13:33:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.594260+0000", 2024-04-24T13:33:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012811207999999999 2024-04-24T13:33:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.594326+0000", 2024-04-24T13:33:24.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6347999999999996e-05 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2728 3.21 3:8520d077:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.751511491999999, 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019867991000000002, 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2728 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707342+0000", 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8480000000000001e-06 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709741+0000", 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002398346 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709770+0000", 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9522e-05 2024-04-24T13:33:24.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709786+0000", 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5373e-05 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709865+0000", 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9024999999999996e-05 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709984+0000", 2024-04-24T13:33:24.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011908000000000001 2024-04-24T13:33:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.710086+0000", 2024-04-24T13:33:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102656 2024-04-24T13:33:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.719183+0000", 2024-04-24T13:33:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.009096491 2024-04-24T13:33:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727080+0000", 2024-04-24T13:33:24.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078969309999999994 2024-04-24T13:33:24.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727152+0000", 2024-04-24T13:33:24.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1816999999999994e-05 2024-04-24T13:33:24.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727208+0000", 2024-04-24T13:33:24.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5902000000000001e-05 2024-04-24T13:33:24.528 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2738 3.2d 3:b6fa79b0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.656112758999999, 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016982181999999998, 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.529 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2738 2024-04-24T13:33:24.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.530 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:24.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:24.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802741+0000", 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1739999999999999e-06 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804165+0000", 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014248780000000001 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804188+0000", 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989e-05 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804199+0000", 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0179e-05 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804281+0000", 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2139999999999996e-05 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804456+0000", 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000175074 2024-04-24T13:33:24.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804566+0000", 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109931 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.811275+0000", 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067095560000000002 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819557+0000", 2024-04-24T13:33:24.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0082818370000000002 2024-04-24T13:33:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819644+0000", 2024-04-24T13:33:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6885000000000006e-05 2024-04-24T13:33:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819721+0000", 2024-04-24T13:33:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6538999999999993e-05 2024-04-24T13:33:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2750 3.2e 3:76c7df3c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.525554670999998, 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019169064, 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2750 2024-04-24T13:33:24.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933299+0000", 2024-04-24T13:33:24.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.751e-06 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935078+0000", 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017788420000000001 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935120+0000", 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1875999999999997e-05 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935138+0000", 2024-04-24T13:33:24.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7784000000000001e-05 2024-04-24T13:33:24.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935244+0000", 2024-04-24T13:33:24.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106041 2024-04-24T13:33:24.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935426+0000", 2024-04-24T13:33:24.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018206299999999999 2024-04-24T13:33:24.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935583+0000", 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000156754 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.944883+0000", 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093004400000000001 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952389+0000", 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075064149999999998 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952431+0000", 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1801999999999997e-05 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952466+0000", 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4295999999999998e-05 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2751 3.2e 3:7757132e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:24.540 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:24.541 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.515817138999999, 2024-04-24T13:33:24.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019504242000000001, 2024-04-24T13:33:24.541 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.541 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.541 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.541 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.541 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2751 2024-04-24T13:33:24.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.541 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:24.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:24.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943037+0000", 2024-04-24T13:33:24.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9189999999999999e-06 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946091+0000", 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030545709999999998 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946117+0000", 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5666000000000001e-05 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946131+0000", 2024-04-24T13:33:24.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4243999999999999e-05 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946202+0000", 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0798999999999998e-05 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946357+0000", 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154785 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946465+0000", 2024-04-24T13:33:24.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107675 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952338+0000", 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058734720000000002 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962433+0000", 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010094462 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962484+0000", 2024-04-24T13:33:24.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1913999999999998e-05 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962538+0000", 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3735e-05 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2789 3.14 3:283784b4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.134292438999999, 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017567818999999998, 2024-04-24T13:33:24.546 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2789 2024-04-24T13:33:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324561+0000", 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5780000000000001e-06 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325957+0000", 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013953640000000001 2024-04-24T13:33:24.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325979+0000", 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2724000000000001e-05 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325989+0000", 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0135999999999999e-05 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326053+0000", 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3554999999999997e-05 2024-04-24T13:33:24.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326175+0000", 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121558 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326275+0000", 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100512 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.332109+0000", 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058341080000000002 2024-04-24T13:33:24.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342050+0000", 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099405489999999999 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342093+0000", 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3472e-05 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342127+0000", 2024-04-24T13:33:24.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3263000000000003e-05 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2798 3.3b 3:de5094ab:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.037417520000002, 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019231912, 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.552 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2798 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421436+0000", 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7300000000000001e-06 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423782+0000", 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023461250000000001 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423810+0000", 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7937e-05 2024-04-24T13:33:24.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423823+0000", 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.279e-05 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423938+0000", 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011457 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.424090+0000", 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015250600000000001 2024-04-24T13:33:24.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.424183+0000", 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2351999999999999e-05 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.429881+0000", 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056981360000000003 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440513+0000", 2024-04-24T13:33:24.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010632354 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440598+0000", 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4860999999999999e-05 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440666+0000", 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7551000000000004e-05 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2806 3.2d 3:b44f16d5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.951644004999999, 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017054071000000001, 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2806 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.558 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507209+0000", 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2620000000000001e-06 2024-04-24T13:33:24.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508811+0000", 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016020940000000001 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508837+0000", 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5207000000000001e-05 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508849+0000", 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2571999999999999e-05 2024-04-24T13:33:24.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508927+0000", 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7448999999999997e-05 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.509058+0000", 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013080599999999999 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.509198+0000", 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014016500000000001 2024-04-24T13:33:24.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.514234+0000", 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050359230000000003 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524162+0000", 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099284430000000003 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524207+0000", 2024-04-24T13:33:24.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126000000000001e-05 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524261+0000", 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4024000000000003e-05 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2808 3.2e 3:7441f999:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.927488562000001, 2024-04-24T13:33:24.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021413788, 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2808 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531366+0000", 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1089999999999998e-06 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533059+0000", 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001693186 2024-04-24T13:33:24.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533088+0000", 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9470000000000001e-05 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533100+0000", 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1979e-05 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533176+0000", 2024-04-24T13:33:24.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5691000000000004e-05 2024-04-24T13:33:24.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533334+0000", 2024-04-24T13:33:24.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015822199999999999 2024-04-24T13:33:24.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:24.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533513+0000", 2024-04-24T13:33:24.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178846 2024-04-24T13:33:24.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.546303+0000", 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012790331 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552696+0000", 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063923169999999998 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552741+0000", 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126999999999997e-05 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552776+0000", 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5509999999999997e-05 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2817 3.13 e101/41 3:c886ce92:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_146:head v 101'13, mlcod=101'11)", 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.644060+0000", 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.814790647999999, 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018239697999999999, 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:24.569 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.644060+0000", 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.644060+0000", 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:24.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.644062+0000", 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.172e-06 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.650858+0000", 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067958610000000003 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.650875+0000", 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7226000000000001e-05 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:24.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.650885+0000", 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0183999999999999e-05 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.651082+0000", 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019680399999999999 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.651109+0000", 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7322999999999999e-05 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:24.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.662226+0000", 2024-04-24T13:33:24.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011116737999999999 2024-04-24T13:33:24.573 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:24.573 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:24.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:24.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.662300+0000", 2024-04-24T13:33:24.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4389999999999998e-05 2024-04-24T13:33:24.573 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.573 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.573 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.573 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:24.573 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:24.573 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:24.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:33:24.575 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:24.574+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:24.676 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:24.673+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:24.741 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:24.741 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:24.741 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:24.755 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:33:24.799 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:24.798+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:24.873 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:24.873 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:24.874 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:24.874 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:24.874 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:24.877 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:24.873+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:24.887 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:33:24.978 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:24.977+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:25.022 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:33:25.048 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:25.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2207 3.38 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.743517861000001, 2024-04-24T13:33:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022686873999999999, 2024-04-24T13:33:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.049 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2207 2024-04-24T13:33:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.050 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302499+0000", 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307861+0000", 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053622089999999997 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.051 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307899+0000", 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978999999999997e-05 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307917+0000", 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8576999999999998e-05 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308018+0000", 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010080499999999999 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.052 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308202+0000", 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000183628 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308352+0000", 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149806 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318520+0000", 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010168744 2024-04-24T13:33:25.053 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.324908+0000", 2024-04-24T13:33:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063874739999999998 2024-04-24T13:33:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325063+0000", 2024-04-24T13:33:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155131 2024-04-24T13:33:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.054 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325182+0000", 2024-04-24T13:33:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011915499999999999 2024-04-24T13:33:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.719923147999999, 2024-04-24T13:33:25.055 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:33:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:33:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:25.056 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.057 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:33:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:33:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:33:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:33:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:33:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:33:25.058 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:33:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:33:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:33:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:33:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.059 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.060 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.061 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.574867294000001, 2024-04-24T13:33:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:33:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:33:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.062 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:33:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:33:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:33:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:33:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:33:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:33:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:33:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:33:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:33:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:33:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:33:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:33:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:33:25.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:33:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:33:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:33:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2242 3.b 3:d16b554f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:25.068 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.306368362000001, 2024-04-24T13:33:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022940439, 2024-04-24T13:33:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2242 2024-04-24T13:33:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739648+0000", 2024-04-24T13:33:25.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.785e-06 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741765+0000", 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002117655 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741781+0000", 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6062e-05 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741792+0000", 2024-04-24T13:33:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0937999999999999e-05 2024-04-24T13:33:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741918+0000", 2024-04-24T13:33:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623199999999999 2024-04-24T13:33:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742189+0000", 2024-04-24T13:33:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027047300000000002 2024-04-24T13:33:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742430+0000", 2024-04-24T13:33:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024077699999999999 2024-04-24T13:33:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752990+0000", 2024-04-24T13:33:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010559875 2024-04-24T13:33:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762422+0000", 2024-04-24T13:33:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094325120000000005 2024-04-24T13:33:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762510+0000", 2024-04-24T13:33:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7879000000000003e-05 2024-04-24T13:33:25.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762585+0000", 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5251000000000002e-05 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2662 3.33 3:ce195145:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.917450055, 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028670389000000001, 2024-04-24T13:33:25.075 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2662 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128567+0000", 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4640000000000002e-06 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130845+0000", 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002278389 2024-04-24T13:33:25.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130869+0000", 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4394999999999999e-05 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130879+0000", 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0000000000000001e-05 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130957+0000", 2024-04-24T13:33:25.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7968999999999998e-05 2024-04-24T13:33:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130963+0000", 2024-04-24T13:33:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2499999999999997e-06 2024-04-24T13:33:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137507+0000", 2024-04-24T13:33:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065442900000000003 2024-04-24T13:33:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137607+0000", 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010002599999999999 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137727+0000", 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120142 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152307+0000", 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01458017 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157112+0000", 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048051350000000003 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157181+0000", 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9051e-05 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157233+0000", 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2108000000000003e-05 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.081 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2673 3.18 3:1a01061c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.241832+0000", 2024-04-24T13:33:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.804180636000002, 2024-04-24T13:33:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020587687, 2024-04-24T13:33:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.082 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2673 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.241832+0000", 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.241832+0000", 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.241835+0000", 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.238e-06 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243821+0000", 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019861620000000001 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243846+0000", 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4861000000000001e-05 2024-04-24T13:33:25.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243867+0000", 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1535e-05 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243970+0000", 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102564 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.244131+0000", 2024-04-24T13:33:25.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016069000000000001 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.244283+0000", 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152149 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259574+0000", 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015291310000000001 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.262266+0000", 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002691588 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.262342+0000", 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5957000000000005e-05 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.262420+0000", 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8633000000000004e-05 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.087 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2676 3.22 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.774248147000002, 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025889562000000001, 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2676 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.088 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271767+0000", 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-04-24T13:33:25.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.273986+0000", 2024-04-24T13:33:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022195560000000001 2024-04-24T13:33:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274011+0000", 2024-04-24T13:33:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4953e-05 2024-04-24T13:33:25.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274023+0000", 2024-04-24T13:33:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1856e-05 2024-04-24T13:33:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274116+0000", 2024-04-24T13:33:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3168e-05 2024-04-24T13:33:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274377+0000", 2024-04-24T13:33:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026071500000000001 2024-04-24T13:33:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274531+0000", 2024-04-24T13:33:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015427299999999999 2024-04-24T13:33:25.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297124+0000", 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022592476 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297544+0000", 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000420691 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297605+0000", 2024-04-24T13:33:25.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0888999999999999e-05 2024-04-24T13:33:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297655+0000", 2024-04-24T13:33:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9119999999999997e-05 2024-04-24T13:33:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2680 3.29 3:9533dbeb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_19:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.313354+0000", 2024-04-24T13:33:25.094 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.732659364, 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019941483999999999, 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2680 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.313354+0000", 2024-04-24T13:33:25.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.313354+0000", 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.313356+0000", 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6240000000000002e-06 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315045+0000", 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016891370000000001 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315060+0000", 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4735999999999999e-05 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315067+0000", 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1849999999999998e-06 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315143+0000", 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5777000000000003e-05 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315282+0000", 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013928500000000001 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.315392+0000", 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010989699999999999 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.326123+0000", 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010730669 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.333171+0000", 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070476039999999998 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.333245+0000", 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4709000000000006e-05 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.333295+0000", 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9861000000000003e-05 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2722 3.25 e101/20 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head v 101'6, mlcod=86'4)", 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.402502865999999, 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023380372, 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.100 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643511+0000", 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4400000000000001e-07 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647450+0000", 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039389259999999997 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647470+0000", 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0534e-05 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647484+0000", 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3370000000000001e-05 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647599+0000", 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115513 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647629+0000", 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0145e-05 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666761+0000", 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019132303999999999 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666891+0000", 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012913599999999999 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2726 3.3c e101/20 3:3c53550d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_55:head v 101'5, mlcod=86'3)", 2024-04-24T13:33:25.104 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.353622226999999, 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021010132000000001, 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9999999999999999e-07 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701201+0000", 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088100639999999994 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701230+0000", 2024-04-24T13:33:25.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8428e-05 2024-04-24T13:33:25.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701243+0000", 2024-04-24T13:33:25.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3635000000000001e-05 2024-04-24T13:33:25.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701333+0000", 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9765999999999994e-05 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701362+0000", 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8810999999999999e-05 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713347+0000", 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011985657 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713401+0000", 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3570999999999999e-05 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2729 3.7 3:e1d3d801:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_58:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.713957+0000", 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.332056400999999, 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020212523, 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.109 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2729 2024-04-24T13:33:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713957+0000", 2024-04-24T13:33:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713957+0000", 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713959+0000", 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2929999999999999e-06 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716255+0000", 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022955900000000001 2024-04-24T13:33:25.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716282+0000", 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7682e-05 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716309+0000", 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7138999999999999e-05 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716389+0000", 2024-04-24T13:33:25.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9653000000000005e-05 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716534+0000", 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000145103 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.716647+0000", 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112545 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.732778+0000", 2024-04-24T13:33:25.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016131555999999998 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734055+0000", 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012767130000000001 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734120+0000", 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4781000000000002e-05 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734169+0000", 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9468000000000001e-05 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2740 3.15 3:abd27dc3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.823008+0000", 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.223004886999998, 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021456604000000001, 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.115 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2740 2024-04-24T13:33:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.823008+0000", 2024-04-24T13:33:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.823008+0000", 2024-04-24T13:33:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.823011+0000", 2024-04-24T13:33:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.813e-06 2024-04-24T13:33:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824873+0000", 2024-04-24T13:33:25.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001861693 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824895+0000", 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2067000000000001e-05 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824905+0000", 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7329999999999998e-06 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824974+0000", 2024-04-24T13:33:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9072000000000005e-05 2024-04-24T13:33:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.825139+0000", 2024-04-24T13:33:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016501299999999999 2024-04-24T13:33:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.825236+0000", 2024-04-24T13:33:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7441000000000004e-05 2024-04-24T13:33:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.831503+0000", 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062670470000000004 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.844370+0000", 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012867197 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.844428+0000", 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7750000000000001e-05 2024-04-24T13:33:25.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.844465+0000", 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6777999999999999e-05 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2742 3.7 3:e2cb8889:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_71:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.843817+0000", 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.202196189999999, 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020067055, 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.121 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2742 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.843817+0000", 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.843817+0000", 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.843820+0000", 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6299999999999998e-06 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845621+0000", 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001801469 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845648+0000", 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6754000000000002e-05 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845664+0000", 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5988999999999999e-05 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845732+0000", 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8178999999999999e-05 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845893+0000", 2024-04-24T13:33:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000160586 2024-04-24T13:33:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.845988+0000", 2024-04-24T13:33:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5445000000000005e-05 2024-04-24T13:33:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.859957+0000", 2024-04-24T13:33:25.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013968993000000001 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.863761+0000", 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0038042699999999998 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.863831+0000", 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9663e-05 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.863884+0000", 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3077e-05 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2747 3.24 3:2754d069:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.147953004000001, 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024857536999999999, 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.127 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2747 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898063+0000", 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5289999999999998e-06 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899956+0000", 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932759999999999 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899984+0000", 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7801999999999999e-05 2024-04-24T13:33:25.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899997+0000", 2024-04-24T13:33:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3127e-05 2024-04-24T13:33:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900063+0000", 2024-04-24T13:33:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900200+0000", 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000137324 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900302+0000", 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010168 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.908151+0000", 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078489579999999996 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922784+0000", 2024-04-24T13:33:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014633116 2024-04-24T13:33:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922860+0000", 2024-04-24T13:33:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5708000000000001e-05 2024-04-24T13:33:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922918+0000", 2024-04-24T13:33:25.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7686000000000003e-05 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2753 3.24 3:261ef004:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.964749+0000", 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.081264114, 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021608380999999999, 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.133 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2753 2024-04-24T13:33:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.964749+0000", 2024-04-24T13:33:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.964749+0000", 2024-04-24T13:33:25.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.964752+0000", 2024-04-24T13:33:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2090000000000001e-06 2024-04-24T13:33:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966363+0000", 2024-04-24T13:33:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016103560000000001 2024-04-24T13:33:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966388+0000", 2024-04-24T13:33:25.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-05 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966401+0000", 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.376e-05 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966476+0000", 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4657e-05 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966638+0000", 2024-04-24T13:33:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016182699999999999 2024-04-24T13:33:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966730+0000", 2024-04-24T13:33:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2169999999999993e-05 2024-04-24T13:33:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.976261+0000", 2024-04-24T13:33:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095310770000000006 2024-04-24T13:33:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.986217+0000", 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099560849999999999 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.986298+0000", 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.119e-05 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.986357+0000", 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8909999999999997e-05 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.140 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2754 3.b 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:25.140 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:25.140 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.067483503999998, 2024-04-24T13:33:25.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.032358206, 2024-04-24T13:33:25.140 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.140 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.140 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.140 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.140 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2754 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978532+0000", 2024-04-24T13:33:25.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6079999999999998e-06 2024-04-24T13:33:25.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979768+0000", 2024-04-24T13:33:25.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012357869999999999 2024-04-24T13:33:25.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979791+0000", 2024-04-24T13:33:25.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3224e-05 2024-04-24T13:33:25.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979804+0000", 2024-04-24T13:33:25.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.274e-05 2024-04-24T13:33:25.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979889+0000", 2024-04-24T13:33:25.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5483999999999997e-05 2024-04-24T13:33:25.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980063+0000", 2024-04-24T13:33:25.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017384599999999999 2024-04-24T13:33:25.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:25.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980227+0000", 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163764 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987774+0000", 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075472029999999997 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010776+0000", 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023001886999999999 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010838+0000", 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1527999999999998e-05 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010888+0000", 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0135e-05 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2755 3.12 e101/41 3:4bcc7c5c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_84:head v 101'8, mlcod=100'6)", 2024-04-24T13:33:25.146 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.987913+0000", 2024-04-24T13:33:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.058099672000001, 2024-04-24T13:33:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020118325999999999, 2024-04-24T13:33:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987913+0000", 2024-04-24T13:33:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987913+0000", 2024-04-24T13:33:25.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987915+0000", 2024-04-24T13:33:25.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.491e-06 2024-04-24T13:33:25.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.989911+0000", 2024-04-24T13:33:25.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019958509999999999 2024-04-24T13:33:25.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.989936+0000", 2024-04-24T13:33:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5216e-05 2024-04-24T13:33:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.989951+0000", 2024-04-24T13:33:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4705000000000001e-05 2024-04-24T13:33:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.990053+0000", 2024-04-24T13:33:25.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102717 2024-04-24T13:33:25.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.990083+0000", 2024-04-24T13:33:25.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.919e-05 2024-04-24T13:33:25.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.007955+0000", 2024-04-24T13:33:25.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017872308 2024-04-24T13:33:25.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.008032+0000", 2024-04-24T13:33:25.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6847999999999993e-05 2024-04-24T13:33:25.151 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.151 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.151 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.151 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2811 3.7 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:25.151 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.475844672000001, 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044582597000000002, 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2811 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:25.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570171+0000", 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9100000000000001e-06 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580122+0000", 2024-04-24T13:33:25.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099505930000000006 2024-04-24T13:33:25.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580150+0000", 2024-04-24T13:33:25.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7827e-05 2024-04-24T13:33:25.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580164+0000", 2024-04-24T13:33:25.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4547e-05 2024-04-24T13:33:25.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580245+0000", 2024-04-24T13:33:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0810999999999996e-05 2024-04-24T13:33:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580355+0000", 2024-04-24T13:33:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109656 2024-04-24T13:33:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580475+0000", 2024-04-24T13:33:25.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120278 2024-04-24T13:33:25.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607433+0000", 2024-04-24T13:33:25.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026957894 2024-04-24T13:33:25.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614636+0000", 2024-04-24T13:33:25.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072028359999999998 2024-04-24T13:33:25.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614703+0000", 2024-04-24T13:33:25.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7645999999999996e-05 2024-04-24T13:33:25.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614751+0000", 2024-04-24T13:33:25.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7599000000000003e-05 2024-04-24T13:33:25.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.157 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2812 3.1e 3:7bd62ca6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.465800792, 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.038041177000000002, 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2812 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:25.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:25.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580214+0000", 2024-04-24T13:33:25.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.708e-06 2024-04-24T13:33:25.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582574+0000", 2024-04-24T13:33:25.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023601799999999999 2024-04-24T13:33:25.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582591+0000", 2024-04-24T13:33:25.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6648999999999999e-05 2024-04-24T13:33:25.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582598+0000", 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.391e-06 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583731+0000", 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011332029999999999 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583843+0000", 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111889 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583936+0000", 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2968999999999997e-05 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.599363+0000", 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015427186000000001 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618143+0000", 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018779051000000001 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618200+0000", 2024-04-24T13:33:25.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7151999999999998e-05 2024-04-24T13:33:25.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618253+0000", 2024-04-24T13:33:25.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3798999999999998e-05 2024-04-24T13:33:25.165 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.165 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.165 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2814 3.8 3:11e81300:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_143:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.601840+0000", 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.444172719000001, 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020012404000000001, 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2814 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.166 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:25.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:25.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.601840+0000", 2024-04-24T13:33:25.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.601840+0000", 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.601843+0000", 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5150000000000001e-06 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.603850+0000", 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020069179999999999 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:25.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.603879+0000", 2024-04-24T13:33:25.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9251000000000002e-05 2024-04-24T13:33:25.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:25.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.603893+0000", 2024-04-24T13:33:25.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3529e-05 2024-04-24T13:33:25.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:25.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.603979+0000", 2024-04-24T13:33:25.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6737000000000007e-05 2024-04-24T13:33:25.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:25.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604155+0000", 2024-04-24T13:33:25.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017538499999999999 2024-04-24T13:33:25.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:25.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604323+0000", 2024-04-24T13:33:25.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016819599999999999 2024-04-24T13:33:25.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618337+0000", 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014014037 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.621551+0000", 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0032136420000000001 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.621704+0000", 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000153036 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:25.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:25.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:25.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.621853+0000", 2024-04-24T13:33:25.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014915800000000001 2024-04-24T13:33:25.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.172 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.172 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:25.172 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:25.172 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:25.174 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:33:25.174 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:25.175 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:25.175 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:25.173+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:25.179 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:25.179 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:25.195 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:25.195 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:25.211 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:25.212 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:25.231 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:25.231 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:25.249 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:25.250 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:25.267 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:25.268 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:25.274 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:25.273+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:25.288 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:25.288 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:25.310 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:25.310 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:25.325 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:33:25.418 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:25.417+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:25.476 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:25.474+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:25.489 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:25.489 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:25.503 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:33:25.590 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:25.589+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:25.663 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:25.663 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:25.677 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:33:25.718 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:25.717+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:25.779 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:25.778+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:25.835 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:25.835 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:25.849 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:33:25.898 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:25.897+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:25.974 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:25.974 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:25.983 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:25.982+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:25.986 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:33:25.988 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:33:26.084 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:26.081+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:26.155 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:26.155 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:26.169 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:33:26.186 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:26.182+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:26.287 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:26.285+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:26.327 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:26.328 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:26.342 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:33:26.390 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:26.389+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:26.489 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:26.485+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:26.516 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:26.517 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:26.531 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:33:26.590 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:26.586+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:26.691 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:26.689+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:26.697 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:26.697 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:26.712 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:33:26.792 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:26.790+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:26.879 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:26.879 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:26.890 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:33:26.893 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:26.889+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:26.894 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:26.994 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:26.993+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:27.062 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:27.063 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:27.076 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:27.095 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:27.094+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:27.196 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:27.193+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:27.242 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:27.242 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:27.257 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:27.298 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:27.297+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:27.304 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:33:27.377 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:27.377 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:27.392 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:27.435 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:27.434+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:27.438 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:27.438 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:27.455 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:27.455 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:27.471 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:27.471 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:27.488 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:27.488 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:27.498 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:27.494+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:27.506 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:27.507 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:27.507 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:27.508 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:27.508 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:27.520 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:27.529 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:27.529 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:27.550 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:27.550 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:27.570 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:27.570 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:27.599 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:27.597+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:27.644 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2206 3.f e85/48 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.347036000999999, 2024-04-24T13:33:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022785151, 2024-04-24T13:33:27.644 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295567+0000", 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3939999999999999e-06 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299770+0000", 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042038029999999999 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299808+0000", 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7703000000000001e-05 2024-04-24T13:33:27.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299826+0000", 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8142999999999999e-05 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299972+0000", 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000146095 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.300023+0000", 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0294999999999999e-05 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318209+0000", 2024-04-24T13:33:27.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018186099000000001 2024-04-24T13:33:27.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318349+0000", 2024-04-24T13:33:27.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140619 2024-04-24T13:33:27.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.648 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2216 3.3d 3:bf22edaf:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.18128299, 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027972988000000001, 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2216 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461320+0000", 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7049999999999999e-06 2024-04-24T13:33:27.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462822+0000", 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015018919999999999 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462846+0000", 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4229000000000001e-05 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462856+0000", 2024-04-24T13:33:27.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8619999999999998e-06 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462932+0000", 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6126999999999998e-05 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463098+0000", 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016631400000000001 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463231+0000", 2024-04-24T13:33:27.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013278699999999999 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475573+0000", 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012342148000000001 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489102+0000", 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013528755 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489210+0000", 2024-04-24T13:33:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010779400000000001 2024-04-24T13:33:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489290+0000", 2024-04-24T13:33:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0375000000000002e-05 2024-04-24T13:33:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.654 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2217 3.7 e85/41 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.168873646999998, 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022815940999999999, 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473728+0000", 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6080000000000001e-06 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475783+0000", 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002054349 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475801+0000", 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8054e-05 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475814+0000", 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3515e-05 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488934+0000", 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013119772 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488977+0000", 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2922e-05 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496474+0000", 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074975320000000003 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496543+0000", 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8188999999999994e-05 2024-04-24T13:33:27.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2251 3.3a e85/20 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head v 85'3, mlcod=81'1)", 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 58.801373972, 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024431608, 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841228+0000", 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.781e-06 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846614+0000", 2024-04-24T13:33:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053854419999999998 2024-04-24T13:33:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846650+0000", 2024-04-24T13:33:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6133000000000001e-05 2024-04-24T13:33:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846669+0000", 2024-04-24T13:33:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9199e-05 2024-04-24T13:33:27.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846763+0000", 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4335999999999999e-05 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846799+0000", 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5796000000000001e-05 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865616+0000", 2024-04-24T13:33:27.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018816825999999998 2024-04-24T13:33:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865658+0000", 2024-04-24T13:33:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2095000000000003e-05 2024-04-24T13:33:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2667 3.39 3:9ef26513:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:27.663 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.459575844, 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021597445, 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2667 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183028+0000", 2024-04-24T13:33:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.444e-06 2024-04-24T13:33:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185652+0000", 2024-04-24T13:33:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026242420000000002 2024-04-24T13:33:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185674+0000", 2024-04-24T13:33:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1429000000000001e-05 2024-04-24T13:33:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185683+0000", 2024-04-24T13:33:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4069999999999999e-06 2024-04-24T13:33:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185746+0000", 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2621999999999998e-05 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185750+0000", 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7840000000000003e-06 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188091+0000", 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023404709999999998 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188186+0000", 2024-04-24T13:33:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5136000000000005e-05 2024-04-24T13:33:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188277+0000", 2024-04-24T13:33:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0661000000000005e-05 2024-04-24T13:33:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.196753+0000", 2024-04-24T13:33:27.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084765789999999997 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204495+0000", 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077418260000000003 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204569+0000", 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3906999999999996e-05 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204622+0000", 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2936999999999998e-05 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2675 3.20 e100/20 3:04d57de4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_14:head v 100'3, mlcod=85'1)", 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.372744400999999, 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027012970000000001, 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.670 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.72e-07 2024-04-24T13:33:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275705+0000", 2024-04-24T13:33:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058491849999999998 2024-04-24T13:33:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275732+0000", 2024-04-24T13:33:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6630000000000001e-05 2024-04-24T13:33:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275747+0000", 2024-04-24T13:33:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5375000000000001e-05 2024-04-24T13:33:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275839+0000", 2024-04-24T13:33:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1348999999999996e-05 2024-04-24T13:33:27.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275873+0000", 2024-04-24T13:33:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4341999999999997e-05 2024-04-24T13:33:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296810+0000", 2024-04-24T13:33:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020937196000000002 2024-04-24T13:33:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296869+0000", 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8621e-05 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2676 3.22 e100/74 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head v 100'6, mlcod=86'4)", 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.367943558, 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022762185000000001, 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.675 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274658+0000", 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.466e-06 2024-04-24T13:33:27.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277453+0000", 2024-04-24T13:33:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027952799999999998 2024-04-24T13:33:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277477+0000", 2024-04-24T13:33:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3533e-05 2024-04-24T13:33:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277490+0000", 2024-04-24T13:33:27.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2978e-05 2024-04-24T13:33:27.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277588+0000", 2024-04-24T13:33:27.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7796999999999999e-05 2024-04-24T13:33:27.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277617+0000", 2024-04-24T13:33:27.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8878e-05 2024-04-24T13:33:27.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297382+0000", 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019765373999999999 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297419+0000", 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6878999999999997e-05 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.679 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2688 3.3a e100/20 3:5c6b1f96:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_27:head v 100'9, mlcod=86'7)", 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.245777982, 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020500114999999999, 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396822+0000", 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.396823+0000", 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6899999999999998e-07 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.404984+0000", 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0081613310000000008 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405002+0000", 2024-04-24T13:33:27.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7550999999999998e-05 2024-04-24T13:33:27.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405012+0000", 2024-04-24T13:33:27.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0039e-05 2024-04-24T13:33:27.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405077+0000", 2024-04-24T13:33:27.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5220000000000002e-05 2024-04-24T13:33:27.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.405094+0000", 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7377e-05 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.417271+0000", 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012177248 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.417322+0000", 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0980000000000003e-05 2024-04-24T13:33:27.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2689 3.17 3:eb254e54:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_28:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.243222868, 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020838804999999998, 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:27.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2689 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399377+0000", 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.399380+0000", 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.311e-06 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401455+0000", 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020751419999999999 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401489+0000", 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4078999999999997e-05 2024-04-24T13:33:27.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401501+0000", 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2320000000000001e-05 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401564+0000", 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2518e-05 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401673+0000", 2024-04-24T13:33:27.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010889 2024-04-24T13:33:27.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:27.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.401787+0000", 2024-04-24T13:33:27.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000113859 2024-04-24T13:33:27.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:27.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.416314+0000", 2024-04-24T13:33:27.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014527804 2024-04-24T13:33:27.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.419649+0000", 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0033342049999999998 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.419942+0000", 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000293477 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.420216+0000", 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0002742 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.689 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.690 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2693 3.39 3:9e56554d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:27.690 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:27.690 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.201903916999999, 2024-04-24T13:33:27.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284832, 2024-04-24T13:33:27.690 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.690 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.690 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.690 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:27.690 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:27.690 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2693 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440699+0000", 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2199999999999999e-06 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441920+0000", 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012213739999999999 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441944+0000", 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4127000000000001e-05 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441963+0000", 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.855e-05 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442027+0000", 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4337000000000004e-05 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442150+0000", 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012347399999999999 2024-04-24T13:33:27.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442248+0000", 2024-04-24T13:33:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7683999999999995e-05 2024-04-24T13:33:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.447435+0000", 2024-04-24T13:33:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005186955 2024-04-24T13:33:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:27.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465898+0000", 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018462971000000002 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465947+0000", 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9276000000000001e-05 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465981+0000", 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3864e-05 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2723 3.37 3:ecde4b94:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.999122919000001, 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023622656999999998, 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2723 2024-04-24T13:33:27.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643480+0000", 2024-04-24T13:33:27.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6960000000000001e-06 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645332+0000", 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001851561 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645362+0000", 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0298e-05 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645375+0000", 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.331e-05 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645460+0000", 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4851999999999993e-05 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645467+0000", 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0140000000000001e-06 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.653874+0000", 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084073340000000007 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654042+0000", 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000167159 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654214+0000", 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017199899999999999 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:27.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666361+0000", 2024-04-24T13:33:27.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012146957999999999 2024-04-24T13:33:27.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:27.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666977+0000", 2024-04-24T13:33:27.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061606400000000004 2024-04-24T13:33:27.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667043+0000", 2024-04-24T13:33:27.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:27.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667100+0000", 2024-04-24T13:33:27.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7080999999999998e-05 2024-04-24T13:33:27.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.702 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.702 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.702 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2746 3.30 3:0ff52a22:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:27.702 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:27.702 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.755820018000001, 2024-04-24T13:33:27.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025777590999999999, 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2746 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:27.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886783+0000", 2024-04-24T13:33:27.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8930000000000001e-06 2024-04-24T13:33:27.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889050+0000", 2024-04-24T13:33:27.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002267107 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889078+0000", 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7623999999999998e-05 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889091+0000", 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3101e-05 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889170+0000", 2024-04-24T13:33:27.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8968999999999996e-05 2024-04-24T13:33:27.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889311+0000", 2024-04-24T13:33:27.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141392 2024-04-24T13:33:27.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:27.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889451+0000", 2024-04-24T13:33:27.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139911 2024-04-24T13:33:27.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.895637+0000", 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061857290000000001 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912426+0000", 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016789347999999999 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912501+0000", 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4836e-05 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912558+0000", 2024-04-24T13:33:27.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6681000000000002e-05 2024-04-24T13:33:27.708 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.708 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.708 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.708 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2754 3.b e101/20 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head v 101'7, mlcod=86'5)", 2024-04-24T13:33:27.708 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:27.708 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.657259286999999, 2024-04-24T13:33:27.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025167067000000001, 2024-04-24T13:33:27.708 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.709 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.709 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.709 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:27.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:27.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985343+0000", 2024-04-24T13:33:27.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.734e-06 2024-04-24T13:33:27.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987192+0000", 2024-04-24T13:33:27.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018490360000000001 2024-04-24T13:33:27.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987224+0000", 2024-04-24T13:33:27.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2588e-05 2024-04-24T13:33:27.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987241+0000", 2024-04-24T13:33:27.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6350000000000001e-05 2024-04-24T13:33:27.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987338+0000", 2024-04-24T13:33:27.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7466000000000005e-05 2024-04-24T13:33:27.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987368+0000", 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0210999999999999e-05 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010454+0000", 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02308522 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010508+0000", 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4462000000000001e-05 2024-04-24T13:33:27.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.713 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.713 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2755 3.12 3:4bcc7c5c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:27.713 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:27.713 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.656847399, 2024-04-24T13:33:27.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026401981000000001, 2024-04-24T13:33:27.713 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.713 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:27.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2755 2024-04-24T13:33:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:27.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985757+0000", 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6370000000000001e-06 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987459+0000", 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017029180000000001 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987474+0000", 2024-04-24T13:33:27.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4460999999999999e-05 2024-04-24T13:33:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987484+0000", 2024-04-24T13:33:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0168e-05 2024-04-24T13:33:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987576+0000", 2024-04-24T13:33:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2020000000000003e-05 2024-04-24T13:33:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987731+0000", 2024-04-24T13:33:27.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015486499999999999 2024-04-24T13:33:27.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:27.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987818+0000", 2024-04-24T13:33:27.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:33:27.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:27.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012049+0000", 2024-04-24T13:33:27.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02423055 2024-04-24T13:33:27.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:27.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012062+0000", 2024-04-24T13:33:27.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3054000000000001e-05 2024-04-24T13:33:27.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012114+0000", 2024-04-24T13:33:27.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1656999999999997e-05 2024-04-24T13:33:27.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012155+0000", 2024-04-24T13:33:27.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1300000000000001e-05 2024-04-24T13:33:27.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.719 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.719 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.719 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2762 3.39 3:9dc3ddb4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:27.719 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:27.719 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.588333661, 2024-04-24T13:33:27.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02109138, 2024-04-24T13:33:27.719 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.719 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.719 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.720 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:27.720 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:27.720 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:27.720 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2762 2024-04-24T13:33:27.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.720 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:27.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054267+0000", 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.054269+0000", 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1859999999999999e-06 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.055994+0000", 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001725196 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056030+0000", 2024-04-24T13:33:27.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5914999999999997e-05 2024-04-24T13:33:27.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056047+0000", 2024-04-24T13:33:27.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6693000000000001e-05 2024-04-24T13:33:27.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056132+0000", 2024-04-24T13:33:27.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5797000000000005e-05 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056297+0000", 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164265 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.056460+0000", 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016338600000000001 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.066355+0000", 2024-04-24T13:33:27.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0098949050000000007 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075280+0000", 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0089252210000000005 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075324+0000", 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3939000000000001e-05 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.075358+0000", 2024-04-24T13:33:27.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3877000000000001e-05 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2764 3.23 3:c46f1960:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_93:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.564857085, 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020127275, 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:27.725 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:27.726 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:27.726 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2764 2024-04-24T13:33:27.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.726 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:27.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077743+0000", 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.077745+0000", 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2800000000000002e-06 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078808+0000", 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001062351 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078826+0000", 2024-04-24T13:33:27.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8045000000000001e-05 2024-04-24T13:33:27.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078835+0000", 2024-04-24T13:33:27.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5999999999999996e-06 2024-04-24T13:33:27.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.078907+0000", 2024-04-24T13:33:27.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1068000000000005e-05 2024-04-24T13:33:27.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.079064+0000", 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000157532 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.079221+0000", 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015694400000000001 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.092808+0000", 2024-04-24T13:33:27.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013586671999999999 2024-04-24T13:33:27.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:27.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097696+0000", 2024-04-24T13:33:27.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004887906 2024-04-24T13:33:27.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097795+0000", 2024-04-24T13:33:27.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9701e-05 2024-04-24T13:33:27.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.097870+0000", 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5176e-05 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2770 3.1 3:80489e4c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.508994149999999, 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025093718000000001, 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.731 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2770 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133609+0000", 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0369999999999999e-06 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135153+0000", 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015441229999999999 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135182+0000", 2024-04-24T13:33:27.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8300999999999999e-05 2024-04-24T13:33:27.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135196+0000", 2024-04-24T13:33:27.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4229999999999999e-05 2024-04-24T13:33:27.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135279+0000", 2024-04-24T13:33:27.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3549999999999998e-05 2024-04-24T13:33:27.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135458+0000", 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017893100000000001 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135611+0000", 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152881 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.144283+0000", 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086718709999999994 2024-04-24T13:33:27.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158560+0000", 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014277306 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158642+0000", 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1435999999999998e-05 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158700+0000", 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8051999999999999e-05 2024-04-24T13:33:27.736 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2788 3.39 3:9c7af06c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_117:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.327131946000002, 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021514591999999999, 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:27.737 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2788 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315468+0000", 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.315470+0000", 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7680000000000001e-06 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316763+0000", 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001292947 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316787+0000", 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4068999999999999e-05 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316799+0000", 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2374999999999999e-05 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316874+0000", 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4133000000000003e-05 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.316992+0000", 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117933 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.317153+0000", 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000161101 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.323588+0000", 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064355749999999998 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336852+0000", 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013264233 2024-04-24T13:33:27.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336924+0000", 2024-04-24T13:33:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1746000000000001e-05 2024-04-24T13:33:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.336983+0000", 2024-04-24T13:33:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8712000000000003e-05 2024-04-24T13:33:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2795 3.39 3:9fba68c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_124:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.257982959, 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932186000000001, 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2795 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384617+0000", 2024-04-24T13:33:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.384619+0000", 2024-04-24T13:33:27.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9939999999999999e-06 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386448+0000", 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001828744 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386484+0000", 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5976000000000002e-05 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386500+0000", 2024-04-24T13:33:27.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5746000000000001e-05 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386604+0000", 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104162 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386806+0000", 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020206400000000001 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:27.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.386995+0000", 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018851 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.398238+0000", 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011243337000000001 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404473+0000", 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062350979999999997 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404514+0000", 2024-04-24T13:33:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1418999999999998e-05 2024-04-24T13:33:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.404550+0000", 2024-04-24T13:33:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5135999999999997e-05 2024-04-24T13:33:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.748 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2811 3.7 e101/41 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head v 101'8, mlcod=101'6)", 2024-04-24T13:33:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.062016171, 2024-04-24T13:33:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026659326000000001, 2024-04-24T13:33:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580586+0000", 2024-04-24T13:33:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.668e-06 2024-04-24T13:33:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582238+0000", 2024-04-24T13:33:27.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016524829999999999 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582266+0000", 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8028e-05 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582282+0000", 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6047999999999999e-05 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:27.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582372+0000", 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9642999999999995e-05 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582400+0000", 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7776999999999998e-05 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607184+0000", 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024784418999999999 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:27.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607243+0000", 2024-04-24T13:33:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9259999999999998e-05 2024-04-24T13:33:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:27.753 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:27.753 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:27.754 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:27.755 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:27.753+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:27.855 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:27.854+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:27.869 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:27.869 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:27.869 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:27.883 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:33:27.956 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:27.953+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:28.044 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:28.044 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:28.044 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:28.044 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:28.044 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:28.057 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:33:28.057 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:28.054+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:28.157 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:28.153+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:28.221 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:28.221 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:28.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:28.221 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:28.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.221 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:1615 3.1a e82/20 3:5beebbe2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.4__shadow_.XaUUd18cS1Mk7MNhbeqM1oZRCaCKFip_1:head v 82'1, mlcod=0'0)", 2024-04-24T13:33:28.221 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:28.222 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 70.005298479000004, 2024-04-24T13:33:28.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013622553000000001, 2024-04-24T13:33:28.222 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.222 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.222 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:28.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212984+0000", 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.212985+0000", 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1370000000000001e-06 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219240+0000", 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062543240000000003 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219257+0000", 2024-04-24T13:33:28.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6940999999999999e-05 2024-04-24T13:33:28.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219267+0000", 2024-04-24T13:33:28.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0283e-05 2024-04-24T13:33:28.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219324+0000", 2024-04-24T13:33:28.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6950999999999997e-05 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.219343+0000", 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8681999999999998e-05 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226529+0000", 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071867169999999996 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:18.226607+0000", 2024-04-24T13:33:28.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7517999999999999e-05 2024-04-24T13:33:28.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.226 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.226 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.226 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2219 3.0 3:00e6fe99:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:28.226 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:28.226 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.726144085000001, 2024-04-24T13:33:28.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01535366, 2024-04-24T13:33:28.226 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.226 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.226 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.226 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.227 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.227 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.227 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2219 2024-04-24T13:33:28.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.227 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:28.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492139+0000", 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.492150+0000", 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1046999999999999e-05 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494106+0000", 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019561940000000001 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494133+0000", 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7617999999999999e-05 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494150+0000", 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6096999999999999e-05 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494240+0000", 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0786999999999997e-05 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494435+0000", 2024-04-24T13:33:28.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000195021 2024-04-24T13:33:28.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:28.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.494611+0000", 2024-04-24T13:33:28.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017601100000000001 2024-04-24T13:33:28.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507078+0000", 2024-04-24T13:33:28.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012466395 2024-04-24T13:33:28.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507374+0000", 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00029577100000000001 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507429+0000", 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5928999999999999e-05 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.507492+0000", 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.279e-05 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.231 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.232 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.232 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2230 3.19 3:99352026:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:28.232 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:28.232 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.610161095000002, 2024-04-24T13:33:28.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013072217000000001, 2024-04-24T13:33:28.232 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.232 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.232 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.232 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.232 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.232 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2230 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608122+0000", 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.608124+0000", 2024-04-24T13:33:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6740000000000001e-06 2024-04-24T13:33:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609736+0000", 2024-04-24T13:33:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016116430000000001 2024-04-24T13:33:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609766+0000", 2024-04-24T13:33:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0497e-05 2024-04-24T13:33:28.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609781+0000", 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4810999999999999e-05 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609861+0000", 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9320999999999995e-05 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.609972+0000", 2024-04-24T13:33:28.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111116 2024-04-24T13:33:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.610087+0000", 2024-04-24T13:33:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115161 2024-04-24T13:33:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.620611+0000", 2024-04-24T13:33:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010524554 2024-04-24T13:33:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621126+0000", 2024-04-24T13:33:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00051447699999999995 2024-04-24T13:33:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621163+0000", 2024-04-24T13:33:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6838999999999997e-05 2024-04-24T13:33:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.621194+0000", 2024-04-24T13:33:28.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1124000000000002e-05 2024-04-24T13:33:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2252 3.4 3:22834b58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.372704145, 2024-04-24T13:33:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932545999999999, 2024-04-24T13:33:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.238 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2252 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845581+0000", 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847834+0000", 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002252843 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847863+0000", 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.904e-05 2024-04-24T13:33:28.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847877+0000", 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4126e-05 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847963+0000", 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6162999999999995e-05 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848105+0000", 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014117900000000001 2024-04-24T13:33:28.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848252+0000", 2024-04-24T13:33:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014774800000000001 2024-04-24T13:33:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865043+0000", 2024-04-24T13:33:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016790848000000001 2024-04-24T13:33:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865405+0000", 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036176900000000001 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865460+0000", 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5334000000000002e-05 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865511+0000", 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0784e-05 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2663 3.0 3:01df44a3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.078930111999998, 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020742727999999998, 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2663 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.244 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139355+0000", 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2529999999999999e-06 2024-04-24T13:33:28.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141777+0000", 2024-04-24T13:33:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002422638 2024-04-24T13:33:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141800+0000", 2024-04-24T13:33:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2949e-05 2024-04-24T13:33:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141812+0000", 2024-04-24T13:33:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1551e-05 2024-04-24T13:33:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141907+0000", 2024-04-24T13:33:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5296000000000004e-05 2024-04-24T13:33:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141917+0000", 2024-04-24T13:33:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.414e-06 2024-04-24T13:33:28.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144519+0000", 2024-04-24T13:33:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026024220000000001 2024-04-24T13:33:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144684+0000", 2024-04-24T13:33:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164511 2024-04-24T13:33:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:28.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144845+0000", 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016157000000000001 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.156972+0000", 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012126855000000001 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.159989+0000", 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003016609 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160059+0000", 2024-04-24T13:33:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0598000000000004e-05 2024-04-24T13:33:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160095+0000", 2024-04-24T13:33:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6062000000000001e-05 2024-04-24T13:33:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2664 3.4 3:21467061:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:28.250 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.065430514999999, 2024-04-24T13:33:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013894336, 2024-04-24T13:33:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2664 2024-04-24T13:33:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152852+0000", 2024-04-24T13:33:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152854+0000", 2024-04-24T13:33:28.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0109999999999999e-06 2024-04-24T13:33:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154070+0000", 2024-04-24T13:33:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012153940000000001 2024-04-24T13:33:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154096+0000", 2024-04-24T13:33:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6109e-05 2024-04-24T13:33:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154110+0000", 2024-04-24T13:33:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4489e-05 2024-04-24T13:33:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154184+0000", 2024-04-24T13:33:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4035000000000005e-05 2024-04-24T13:33:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154325+0000", 2024-04-24T13:33:28.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014115500000000001 2024-04-24T13:33:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.154474+0000", 2024-04-24T13:33:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000148811 2024-04-24T13:33:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.165413+0000", 2024-04-24T13:33:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010938333999999999 2024-04-24T13:33:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166625+0000", 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001212526 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166692+0000", 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7013000000000004e-05 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.166747+0000", 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4459000000000002e-05 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2672 3.1c e100/74 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head v 100'4, mlcod=85'2)", 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.980788555, 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022091785999999999, 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237495+0000", 2024-04-24T13:33:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1500000000000005e-07 2024-04-24T13:33:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243044+0000", 2024-04-24T13:33:28.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055497869999999996 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243082+0000", 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7208e-05 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243097+0000", 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5554e-05 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243175+0000", 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7849999999999995e-05 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243194+0000", 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8822999999999999e-05 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259527+0000", 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016333007 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259586+0000", 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9042000000000002e-05 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2677 3.25 3:a4f04b59:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.935902803000001, 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015627926, 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.261 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2677 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282383+0000", 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1499999999999999e-06 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283869+0000", 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014862269999999999 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283897+0000", 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7596000000000001e-05 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283911+0000", 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.367e-05 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283981+0000", 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0349e-05 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284117+0000", 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013656000000000001 2024-04-24T13:33:28.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:28.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284214+0000", 2024-04-24T13:33:28.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6558999999999995e-05 2024-04-24T13:33:28.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296745+0000", 2024-04-24T13:33:28.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012530845000000001 2024-04-24T13:33:28.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297925+0000", 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001179706 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297961+0000", 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6514999999999999e-05 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.298008+0000", 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6749000000000003e-05 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.266 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2706 3.1c e100/74 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head v 100'5, mlcod=86'3)", 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.743482874000001, 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021017514000000001, 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:28.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474802+0000", 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1399999999999998e-06 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480124+0000", 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053217059999999998 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480147+0000", 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3646e-05 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480159+0000", 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2133999999999999e-05 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.269 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480237+0000", 2024-04-24T13:33:28.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7531e-05 2024-04-24T13:33:28.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480291+0000", 2024-04-24T13:33:28.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3851999999999999e-05 2024-04-24T13:33:28.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.270 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495746+0000", 2024-04-24T13:33:28.270 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015454684 2024-04-24T13:33:28.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495817+0000", 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1821000000000002e-05 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2722 3.25 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.586078864000001, 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035782711000000002, 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.271 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2722 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632207+0000", 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.252e-06 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634575+0000", 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023682500000000001 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634606+0000", 2024-04-24T13:33:28.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0284999999999999e-05 2024-04-24T13:33:28.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634619+0000", 2024-04-24T13:33:28.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3491e-05 2024-04-24T13:33:28.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634703+0000", 2024-04-24T13:33:28.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4214000000000004e-05 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634711+0000", 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9719999999999992e-06 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639813+0000", 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051013830000000001 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639969+0000", 2024-04-24T13:33:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015674600000000001 2024-04-24T13:33:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.640112+0000", 2024-04-24T13:33:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142347 2024-04-24T13:33:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647222+0000", 2024-04-24T13:33:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071106520000000003 2024-04-24T13:33:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667844+0000", 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020621746999999999 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667925+0000", 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0717999999999995e-05 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667987+0000", 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1654000000000003e-05 2024-04-24T13:33:28.277 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.278 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.278 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.278 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2730 3.19 3:984637ec:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_59:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:28.278 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:28.278 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.494432391, 2024-04-24T13:33:28.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014952841999999999, 2024-04-24T13:33:28.278 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.278 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.278 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.278 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2730 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723850+0000", 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.723854+0000", 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4180000000000001e-06 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725292+0000", 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014378870000000001 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725322+0000", 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0596999999999999e-05 2024-04-24T13:33:28.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725337+0000", 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4684999999999999e-05 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725423+0000", 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5997999999999999e-05 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725596+0000", 2024-04-24T13:33:28.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000172654 2024-04-24T13:33:28.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:28.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.725755+0000", 2024-04-24T13:33:28.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015988600000000001 2024-04-24T13:33:28.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.734196+0000", 2024-04-24T13:33:28.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084404170000000004 2024-04-24T13:33:28.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738679+0000", 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044834189999999998 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738747+0000", 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7890000000000002e-05 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.738803+0000", 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5991e-05 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.283 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2737 3.4 3:23416714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.425146760000001, 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019181262000000001, 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.284 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2737 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793139+0000", 2024-04-24T13:33:28.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-04-24T13:33:28.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795403+0000", 2024-04-24T13:33:28.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002264252 2024-04-24T13:33:28.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795439+0000", 2024-04-24T13:33:28.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5701999999999998e-05 2024-04-24T13:33:28.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795454+0000", 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5262999999999999e-05 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795541+0000", 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6989000000000003e-05 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795719+0000", 2024-04-24T13:33:28.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000177906 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795875+0000", 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155785 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.808532+0000", 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012657695 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812189+0000", 2024-04-24T13:33:28.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036562809999999999 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812258+0000", 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9210999999999999e-05 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812317+0000", 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9407000000000002e-05 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.290 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2752 3.1c e101/74 3:3ae15365:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_81:head v 101'6, mlcod=100'4)", 2024-04-24T13:33:28.290 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:28.290 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.257838602, 2024-04-24T13:33:28.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013320523000000001, 2024-04-24T13:33:28.290 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.290 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.290 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.290 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:28.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960444+0000", 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.960446+0000", 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0590000000000001e-06 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.965992+0000", 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055462810000000001 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966034+0000", 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1485e-05 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966051+0000", 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7404000000000001e-05 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966178+0000", 2024-04-24T13:33:28.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012681899999999999 2024-04-24T13:33:28.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966198+0000", 2024-04-24T13:33:28.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9944000000000001e-05 2024-04-24T13:33:28.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.973717+0000", 2024-04-24T13:33:28.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075185299999999998 2024-04-24T13:33:28.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.973765+0000", 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.8000999999999997e-05 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2772 3.1a e101/20 3:589df240:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_101:head v 101'3, mlcod=82'1)", 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.058757154999999, 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013122586, 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.294 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.295 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.295 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:28.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159526+0000", 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.159527+0000", 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.578e-06 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165074+0000", 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055466129999999997 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165100+0000", 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5789e-05 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165110+0000", 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0036e-05 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165198+0000", 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7981999999999999e-05 2024-04-24T13:33:28.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.165229+0000", 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1022999999999998e-05 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.172572+0000", 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073435519999999997 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.172648+0000", 2024-04-24T13:33:28.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6013000000000006e-05 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2781 3.e e101/41 3:704d2ad1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_110:head v 101'4, mlcod=85'2)", 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.967592255, 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017614365, 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250692+0000", 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3570000000000001e-06 2024-04-24T13:33:28.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256430+0000", 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057381300000000001 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256465+0000", 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4974000000000001e-05 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256480+0000", 2024-04-24T13:33:28.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5000999999999999e-05 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256571+0000", 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1008999999999995e-05 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256599+0000", 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7676000000000001e-05 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268237+0000", 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011638081 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268305+0000", 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8137000000000002e-05 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2782 3.2b e101/41 3:d5b98152:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_111:head v 101'8, mlcod=86'6)", 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:28.303 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.960808220000001, 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013494414, 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257474+0000", 2024-04-24T13:33:28.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.257476+0000", 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.499e-06 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259466+0000", 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019901609999999998 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259489+0000", 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3144000000000001e-05 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259502+0000", 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3046e-05 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259580+0000", 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7871e-05 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.259607+0000", 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6828000000000001e-05 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.270920+0000", 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011312533 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.270969+0000", 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9332000000000001e-05 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.307 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2785 3.e e101/41 3:72bc610a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_114:head v 101'5, mlcod=86'3)", 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.925815303, 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014730050999999999, 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292467+0000", 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.292470+0000", 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2089999999999999e-06 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297260+0000", 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047903989999999999 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297293+0000", 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3398000000000001e-05 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297309+0000", 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5290000000000001e-05 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297386+0000", 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7218999999999994e-05 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.297406+0000", 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9936999999999999e-05 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.307133+0000", 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0097276359999999996 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.307197+0000", 2024-04-24T13:33:28.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3962999999999997e-05 2024-04-24T13:33:28.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.312 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.312 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.312 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2810 3.16 3:69a6ac6a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_139:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:28.312 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:28.312 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.662576572999999, 2024-04-24T13:33:28.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015206692000000001, 2024-04-24T13:33:28.312 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.313 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.313 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.313 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2810 2024-04-24T13:33:28.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.313 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:28.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555706+0000", 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.555709+0000", 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0240000000000002e-06 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557455+0000", 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001745763 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557482+0000", 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6679999999999999e-05 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557496+0000", 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4185000000000001e-05 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557575+0000", 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9419000000000007e-05 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557715+0000", 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140264 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.557805+0000", 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9511000000000004e-05 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.563323+0000", 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055181300000000004 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570784+0000", 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074609350000000001 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570856+0000", 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1484999999999997e-05 2024-04-24T13:33:28.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570913+0000", 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7296000000000002e-05 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2813 3.6 e101/20 3:63b60245:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_142:head v 101'4, mlcod=86'2)", 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.625872689000001, 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015409209, 2024-04-24T13:33:28.318 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.319 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.319 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.319 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:28.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592410+0000", 2024-04-24T13:33:28.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.592412+0000", 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2819999999999999e-06 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594446+0000", 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0020333840000000001 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594471+0000", 2024-04-24T13:33:28.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5287e-05 2024-04-24T13:33:28.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594482+0000", 2024-04-24T13:33:28.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1063999999999999e-05 2024-04-24T13:33:28.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594585+0000", 2024-04-24T13:33:28.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010303500000000001 2024-04-24T13:33:28.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.594609+0000", 2024-04-24T13:33:28.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3951000000000002e-05 2024-04-24T13:33:28.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607767+0000", 2024-04-24T13:33:28.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013158115999999999 2024-04-24T13:33:28.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607819+0000", 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2089999999999998e-05 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2814 3.8 e101/20 3:11e81300:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_143:head v 101'7, mlcod=101'5)", 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.613836381999999, 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013378928999999999, 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.323 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604446+0000", 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.604448+0000", 2024-04-24T13:33:28.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4610000000000001e-06 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606315+0000", 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001866957 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606338+0000", 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3010000000000002e-05 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606352+0000", 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4754e-05 2024-04-24T13:33:28.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606438+0000", 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5239000000000002e-05 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.606466+0000", 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8476999999999999e-05 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.617758+0000", 2024-04-24T13:33:28.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011291436 2024-04-24T13:33:28.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.617825+0000", 2024-04-24T13:33:28.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7595000000000006e-05 2024-04-24T13:33:28.327 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.327 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.327 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.327 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.327 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.327 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:28.329 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:33:28.329 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:28.326+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:28.430 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:28.429+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:28.489 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:28.489 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:28.489 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:28.490 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:28.506 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:33:28.551 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:28.550+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:28.631 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:28.629+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:28.643 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:28.643 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:28.643 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:28.643 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:28.643 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:28.658 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:33:28.744 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:28.742+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:28.833 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:28.829+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:28.846 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:28.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2206 3.f 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 60.554951156999998, 2024-04-24T13:33:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028291495999999999, 2024-04-24T13:33:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2206 2024-04-24T13:33:28.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290398+0000", 2024-04-24T13:33:28.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000001e-06 2024-04-24T13:33:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294671+0000", 2024-04-24T13:33:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042724390000000003 2024-04-24T13:33:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294711+0000", 2024-04-24T13:33:28.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0376000000000001e-05 2024-04-24T13:33:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294730+0000", 2024-04-24T13:33:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8607e-05 2024-04-24T13:33:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294856+0000", 2024-04-24T13:33:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126651 2024-04-24T13:33:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295125+0000", 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026840700000000002 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295349+0000", 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022454699999999999 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307240+0000", 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011891048 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318593+0000", 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011352777999999999 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318652+0000", 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8677000000000001e-05 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318686+0000", 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4616000000000002e-05 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2209 3.14 3:287cf44b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 60.509646996999997, 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020682494999999999, 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2209 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.853 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335702+0000", 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-04-24T13:33:28.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339081+0000", 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003378664 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339119+0000", 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8355999999999997e-05 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339138+0000", 2024-04-24T13:33:28.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8546000000000002e-05 2024-04-24T13:33:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339268+0000", 2024-04-24T13:33:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013028599999999999 2024-04-24T13:33:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339503+0000", 2024-04-24T13:33:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023542699999999999 2024-04-24T13:33:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339734+0000", 2024-04-24T13:33:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023122 2024-04-24T13:33:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.348300+0000", 2024-04-24T13:33:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085659870000000006 2024-04-24T13:33:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356108+0000", 2024-04-24T13:33:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078075109999999996 2024-04-24T13:33:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356259+0000", 2024-04-24T13:33:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015104800000000001 2024-04-24T13:33:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356381+0000", 2024-04-24T13:33:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012243599999999999 2024-04-24T13:33:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.858 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2227 3.14 3:28702767:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 60.268348365000001, 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017797177000000001, 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.859 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2227 2024-04-24T13:33:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.576998+0000", 2024-04-24T13:33:28.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.577000+0000", 2024-04-24T13:33:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8760000000000001e-06 2024-04-24T13:33:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579496+0000", 2024-04-24T13:33:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0024951740000000002 2024-04-24T13:33:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579521+0000", 2024-04-24T13:33:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5361e-05 2024-04-24T13:33:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579533+0000", 2024-04-24T13:33:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2377e-05 2024-04-24T13:33:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579602+0000", 2024-04-24T13:33:28.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8325999999999996e-05 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579799+0000", 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019773800000000001 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.579997+0000", 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019725299999999999 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.586752+0000", 2024-04-24T13:33:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.006755179 2024-04-24T13:33:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594712+0000", 2024-04-24T13:33:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0079597049999999992 2024-04-24T13:33:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594757+0000", 2024-04-24T13:33:28.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4956000000000001e-05 2024-04-24T13:33:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.594795+0000", 2024-04-24T13:33:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8232000000000003e-05 2024-04-24T13:33:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.865 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2244 3.3b 3:ddfbb493:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 60.079949515000003, 2024-04-24T13:33:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020329852999999998, 2024-04-24T13:33:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.866 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2244 2024-04-24T13:33:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765396+0000", 2024-04-24T13:33:28.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.765398+0000", 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.291e-06 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766959+0000", 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015617680000000001 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766985+0000", 2024-04-24T13:33:28.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5899999999999999e-05 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.766996+0000", 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0642000000000001e-05 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767076+0000", 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9542999999999994e-05 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767184+0000", 2024-04-24T13:33:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107964 2024-04-24T13:33:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.767269+0000", 2024-04-24T13:33:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5798999999999996e-05 2024-04-24T13:33:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.772877+0000", 2024-04-24T13:33:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056080560000000002 2024-04-24T13:33:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785554+0000", 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012676642 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785639+0000", 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4938999999999994e-05 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.785726+0000", 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7309e-05 2024-04-24T13:33:28.871 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2265 3.14 3:2a53907b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_60:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 59.849911048000003, 2024-04-24T13:33:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016926096000000002, 2024-04-24T13:33:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.872 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2265 2024-04-24T13:33:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:28.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995435+0000", 2024-04-24T13:33:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.995438+0000", 2024-04-24T13:33:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1080000000000001e-06 2024-04-24T13:33:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997447+0000", 2024-04-24T13:33:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002008625 2024-04-24T13:33:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997484+0000", 2024-04-24T13:33:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7070999999999998e-05 2024-04-24T13:33:28.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997508+0000", 2024-04-24T13:33:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4324999999999998e-05 2024-04-24T13:33:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997617+0000", 2024-04-24T13:33:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010898799999999999 2024-04-24T13:33:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997787+0000", 2024-04-24T13:33:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000169956 2024-04-24T13:33:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.997949+0000", 2024-04-24T13:33:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016190599999999999 2024-04-24T13:33:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.005098+0000", 2024-04-24T13:33:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071488300000000001 2024-04-24T13:33:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012231+0000", 2024-04-24T13:33:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071334040000000003 2024-04-24T13:33:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012305+0000", 2024-04-24T13:33:28.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4017000000000006e-05 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:29.012361+0000", 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5865999999999997e-05 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2669 3.21 3:86a0e0c3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.643020497999998, 2024-04-24T13:33:28.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020962138000000002, 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2669 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202328+0000", 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-06 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204239+0000", 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019104409999999999 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204265+0000", 2024-04-24T13:33:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6054000000000002e-05 2024-04-24T13:33:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204279+0000", 2024-04-24T13:33:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3654e-05 2024-04-24T13:33:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204361+0000", 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2522999999999996e-05 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204523+0000", 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000162332 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204661+0000", 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013798200000000001 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.210336+0000", 2024-04-24T13:33:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056743339999999996 2024-04-24T13:33:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223107+0000", 2024-04-24T13:33:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012771714999999999 2024-04-24T13:33:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223228+0000", 2024-04-24T13:33:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012061300000000001 2024-04-24T13:33:28.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223288+0000", 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9537999999999998e-05 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2670 3.14 3:2b621d8a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.633614464000001, 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018441043000000001, 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.885 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2670 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211731+0000", 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.211734+0000", 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3429999999999998e-06 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213786+0000", 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002052637 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213813+0000", 2024-04-24T13:33:28.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6193000000000001e-05 2024-04-24T13:33:28.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213825+0000", 2024-04-24T13:33:28.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1905999999999999e-05 2024-04-24T13:33:28.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.213906+0000", 2024-04-24T13:33:28.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1075999999999994e-05 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.214023+0000", 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000117738 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.214134+0000", 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011082900000000001 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.220138+0000", 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060042059999999998 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230042+0000", 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099037559999999997 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230116+0000", 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3742e-05 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.230173+0000", 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6616999999999997e-05 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2710 3.3b 3:ddce91ac:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.333218089999999, 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026438756000000001, 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.891 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2710 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:28.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512131+0000", 2024-04-24T13:33:28.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0130000000000002e-06 2024-04-24T13:33:28.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514363+0000", 2024-04-24T13:33:28.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022325940000000001 2024-04-24T13:33:28.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514394+0000", 2024-04-24T13:33:28.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0144000000000001e-05 2024-04-24T13:33:28.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514409+0000", 2024-04-24T13:33:28.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5786000000000001e-05 2024-04-24T13:33:28.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514497+0000", 2024-04-24T13:33:28.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7876999999999999e-05 2024-04-24T13:33:28.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514670+0000", 2024-04-24T13:33:28.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000173096 2024-04-24T13:33:28.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:28.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514768+0000", 2024-04-24T13:33:28.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8089000000000002e-05 2024-04-24T13:33:28.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.523354+0000", 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085854190000000004 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538483+0000", 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015128922 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538527+0000", 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3835999999999998e-05 2024-04-24T13:33:28.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538567+0000", 2024-04-24T13:33:28.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.998e-05 2024-04-24T13:33:28.897 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.897 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.897 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.897 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2711 3.13 e100/41 3:c9a0442c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_40:head v 100'9, mlcod=86'7)", 2024-04-24T13:33:28.897 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:28.897 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.317875674, 2024-04-24T13:33:28.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016831724999999999, 2024-04-24T13:33:28.898 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.898 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.898 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.898 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:28.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527470+0000", 2024-04-24T13:33:28.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.527472+0000", 2024-04-24T13:33:28.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6619999999999999e-06 2024-04-24T13:33:28.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533965+0000", 2024-04-24T13:33:28.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064927159999999999 2024-04-24T13:33:28.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533980+0000", 2024-04-24T13:33:28.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5192e-05 2024-04-24T13:33:28.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.533989+0000", 2024-04-24T13:33:28.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3950000000000007e-06 2024-04-24T13:33:28.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.534040+0000", 2024-04-24T13:33:28.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0822000000000002e-05 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.534066+0000", 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6341000000000001e-05 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.544246+0000", 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010179354 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.544302+0000", 2024-04-24T13:33:28.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6242999999999997e-05 2024-04-24T13:33:28.902 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.902 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.902 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.902 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2716 3.13 e100/41 3:c8fec211:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_45:head v 100'10, mlcod=86'8)", 2024-04-24T13:33:28.902 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:28.902 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.268205194, 2024-04-24T13:33:28.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017185506, 2024-04-24T13:33:28.902 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.902 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.902 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.903 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:28.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577141+0000", 2024-04-24T13:33:28.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.577143+0000", 2024-04-24T13:33:28.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.824e-06 2024-04-24T13:33:28.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581297+0000", 2024-04-24T13:33:28.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0041541770000000002 2024-04-24T13:33:28.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581333+0000", 2024-04-24T13:33:28.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6559e-05 2024-04-24T13:33:28.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581349+0000", 2024-04-24T13:33:28.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6036999999999999e-05 2024-04-24T13:33:28.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581429+0000", 2024-04-24T13:33:28.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9404000000000001e-05 2024-04-24T13:33:28.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.581449+0000", 2024-04-24T13:33:28.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9949000000000002e-05 2024-04-24T13:33:28.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.594260+0000", 2024-04-24T13:33:28.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012811207999999999 2024-04-24T13:33:28.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.594326+0000", 2024-04-24T13:33:28.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6347999999999996e-05 2024-04-24T13:33:28.906 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2728 3.21 3:8520d077:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_57:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.138006318999999, 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019867991000000002, 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.907 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2728 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707340+0000", 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.707342+0000", 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8480000000000001e-06 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709741+0000", 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002398346 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709770+0000", 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9522e-05 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709786+0000", 2024-04-24T13:33:28.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5373e-05 2024-04-24T13:33:28.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709865+0000", 2024-04-24T13:33:28.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9024999999999996e-05 2024-04-24T13:33:28.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.709984+0000", 2024-04-24T13:33:28.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011908000000000001 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.710086+0000", 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102656 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.719183+0000", 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.009096491 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727080+0000", 2024-04-24T13:33:28.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078969309999999994 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727152+0000", 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1816999999999994e-05 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.727208+0000", 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5902000000000001e-05 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2738 3.2d 3:b6fa79b0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_67:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.042607585999999, 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016982181999999998, 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2738 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.913 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802738+0000", 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.802741+0000", 2024-04-24T13:33:28.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1739999999999999e-06 2024-04-24T13:33:28.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804165+0000", 2024-04-24T13:33:28.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014248780000000001 2024-04-24T13:33:28.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804188+0000", 2024-04-24T13:33:28.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2989e-05 2024-04-24T13:33:28.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804199+0000", 2024-04-24T13:33:28.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0179e-05 2024-04-24T13:33:28.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804281+0000", 2024-04-24T13:33:28.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2139999999999996e-05 2024-04-24T13:33:28.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804456+0000", 2024-04-24T13:33:28.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000175074 2024-04-24T13:33:28.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.804566+0000", 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109931 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.811275+0000", 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067095560000000002 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819557+0000", 2024-04-24T13:33:28.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0082818370000000002 2024-04-24T13:33:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819644+0000", 2024-04-24T13:33:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6885000000000006e-05 2024-04-24T13:33:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.819721+0000", 2024-04-24T13:33:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6538999999999993e-05 2024-04-24T13:33:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.919 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2750 3.2e 3:76c7df3c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_79:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.912049498000002, 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019169064, 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2750 2024-04-24T13:33:28.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933296+0000", 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.933299+0000", 2024-04-24T13:33:28.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.751e-06 2024-04-24T13:33:28.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935078+0000", 2024-04-24T13:33:28.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017788420000000001 2024-04-24T13:33:28.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935120+0000", 2024-04-24T13:33:28.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1875999999999997e-05 2024-04-24T13:33:28.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935138+0000", 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7784000000000001e-05 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935244+0000", 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000106041 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935426+0000", 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018206299999999999 2024-04-24T13:33:28.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.935583+0000", 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000156754 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.944883+0000", 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093004400000000001 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952389+0000", 2024-04-24T13:33:28.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075064149999999998 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952431+0000", 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1801999999999997e-05 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952466+0000", 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4295999999999998e-05 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2751 3.2e 3:7757132e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_80:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.902311965999999, 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019504242000000001, 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2751 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.926 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943034+0000", 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.943037+0000", 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9189999999999999e-06 2024-04-24T13:33:28.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946091+0000", 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030545709999999998 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946117+0000", 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5666000000000001e-05 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946131+0000", 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4243999999999999e-05 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946202+0000", 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0798999999999998e-05 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946357+0000", 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154785 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.946465+0000", 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107675 2024-04-24T13:33:28.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.952338+0000", 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058734720000000002 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962433+0000", 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010094462 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962484+0000", 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1913999999999998e-05 2024-04-24T13:33:28.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.962538+0000", 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3735e-05 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2789 3.14 3:283784b4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_118:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.520787265999999, 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017567818999999998, 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.931 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.932 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.932 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2789 2024-04-24T13:33:28.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.932 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:28.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324559+0000", 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.324561+0000", 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5780000000000001e-06 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325957+0000", 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0013953640000000001 2024-04-24T13:33:28.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325979+0000", 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2724000000000001e-05 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.325989+0000", 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0135999999999999e-05 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326053+0000", 2024-04-24T13:33:28.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.3554999999999997e-05 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326175+0000", 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000121558 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.326275+0000", 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000100512 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.332109+0000", 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058341080000000002 2024-04-24T13:33:28.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342050+0000", 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099405489999999999 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342093+0000", 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3472e-05 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.342127+0000", 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3263000000000003e-05 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.936 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.937 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.937 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2798 3.3b 3:de5094ab:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_127:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:28.937 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:28.937 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.423912347000002, 2024-04-24T13:33:28.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019231912, 2024-04-24T13:33:28.937 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.937 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.937 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.937 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.937 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.937 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.938 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2798 2024-04-24T13:33:28.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.938 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:28.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421434+0000", 2024-04-24T13:33:28.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.421436+0000", 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7300000000000001e-06 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423782+0000", 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023461250000000001 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423810+0000", 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7937e-05 2024-04-24T13:33:28.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423823+0000", 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.279e-05 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.423938+0000", 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011457 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.424090+0000", 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015250600000000001 2024-04-24T13:33:28.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.424183+0000", 2024-04-24T13:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2351999999999999e-05 2024-04-24T13:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.429881+0000", 2024-04-24T13:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056981360000000003 2024-04-24T13:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440513+0000", 2024-04-24T13:33:28.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010632354 2024-04-24T13:33:28.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440598+0000", 2024-04-24T13:33:28.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4860999999999999e-05 2024-04-24T13:33:28.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.440666+0000", 2024-04-24T13:33:28.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7551000000000004e-05 2024-04-24T13:33:28.942 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.942 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.943 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.943 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2806 3.2d 3:b44f16d5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_135:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:28.943 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:28.943 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.338138831999999, 2024-04-24T13:33:28.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017054071000000001, 2024-04-24T13:33:28.943 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.943 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.943 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.943 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.943 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.943 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2806 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507207+0000", 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.507209+0000", 2024-04-24T13:33:28.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2620000000000001e-06 2024-04-24T13:33:28.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508811+0000", 2024-04-24T13:33:28.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016020940000000001 2024-04-24T13:33:28.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508837+0000", 2024-04-24T13:33:28.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5207000000000001e-05 2024-04-24T13:33:28.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508849+0000", 2024-04-24T13:33:28.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2571999999999999e-05 2024-04-24T13:33:28.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.508927+0000", 2024-04-24T13:33:28.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7448999999999997e-05 2024-04-24T13:33:28.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.509058+0000", 2024-04-24T13:33:28.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013080599999999999 2024-04-24T13:33:28.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:28.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.509198+0000", 2024-04-24T13:33:28.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014016500000000001 2024-04-24T13:33:28.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.514234+0000", 2024-04-24T13:33:28.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0050359230000000003 2024-04-24T13:33:28.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524162+0000", 2024-04-24T13:33:28.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099284430000000003 2024-04-24T13:33:28.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524207+0000", 2024-04-24T13:33:28.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126000000000001e-05 2024-04-24T13:33:28.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.524261+0000", 2024-04-24T13:33:28.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4024000000000003e-05 2024-04-24T13:33:28.949 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.949 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.949 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.949 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2808 3.2e 3:7441f999:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:28.949 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:28.949 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.313983389000001, 2024-04-24T13:33:28.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021413788, 2024-04-24T13:33:28.950 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.950 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.950 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.950 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.950 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.950 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.950 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2808 2024-04-24T13:33:28.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.950 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531366+0000", 2024-04-24T13:33:28.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1089999999999998e-06 2024-04-24T13:33:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533059+0000", 2024-04-24T13:33:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001693186 2024-04-24T13:33:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533088+0000", 2024-04-24T13:33:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9470000000000001e-05 2024-04-24T13:33:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533100+0000", 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1979e-05 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533176+0000", 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5691000000000004e-05 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533334+0000", 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015822199999999999 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533513+0000", 2024-04-24T13:33:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178846 2024-04-24T13:33:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.546303+0000", 2024-04-24T13:33:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012790331 2024-04-24T13:33:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552696+0000", 2024-04-24T13:33:28.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063923169999999998 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552741+0000", 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126999999999997e-05 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552776+0000", 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5509999999999997e-05 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2817 3.13 e101/41 3:c886ce92:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_146:head v 101'13, mlcod=101'11)", 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.644060+0000", 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.201285474999999, 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018239697999999999, 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.644060+0000", 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.644060+0000", 2024-04-24T13:33:28.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.644062+0000", 2024-04-24T13:33:28.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.172e-06 2024-04-24T13:33:28.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.650858+0000", 2024-04-24T13:33:28.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0067958610000000003 2024-04-24T13:33:28.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.650875+0000", 2024-04-24T13:33:28.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7226000000000001e-05 2024-04-24T13:33:28.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.650885+0000", 2024-04-24T13:33:28.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0183999999999999e-05 2024-04-24T13:33:28.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.651082+0000", 2024-04-24T13:33:28.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019680399999999999 2024-04-24T13:33:28.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.651109+0000", 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7322999999999999e-05 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.662226+0000", 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011116737999999999 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.662300+0000", 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4389999999999998e-05 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.960 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.961 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3094 3.14 3:29338048:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:28.961 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:28.961 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.24899091700000001, 2024-04-24T13:33:28.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022112211, 2024-04-24T13:33:28.961 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:28.961 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:28.961 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:28.961 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:28.961 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:28.961 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:28.962 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3094 2024-04-24T13:33:28.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.962 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:28.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:28.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:28.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:28.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:28.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:28.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596358+0000", 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6560000000000001e-06 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598612+0000", 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022539050000000001 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598639+0000", 2024-04-24T13:33:28.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7767e-05 2024-04-24T13:33:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598651+0000", 2024-04-24T13:33:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:33:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598735+0000", 2024-04-24T13:33:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4176000000000002e-05 2024-04-24T13:33:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:28.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598928+0000", 2024-04-24T13:33:28.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019318199999999999 2024-04-24T13:33:28.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:28.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.599089+0000", 2024-04-24T13:33:28.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016078899999999999 2024-04-24T13:33:28.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:28.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.612538+0000", 2024-04-24T13:33:28.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013449081999999999 2024-04-24T13:33:28.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:28.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618346+0000", 2024-04-24T13:33:28.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058079799999999999 2024-04-24T13:33:28.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:28.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618413+0000", 2024-04-24T13:33:28.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7101999999999996e-05 2024-04-24T13:33:28.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:28.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:28.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:28.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618467+0000", 2024-04-24T13:33:28.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4295000000000001e-05 2024-04-24T13:33:28.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.968 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:28.968 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:28.968 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:28.969 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:33:28.971 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:33:28.972 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:28.969+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:29.071 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:29.070+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:29.172 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:29.169+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:29.175 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:29.175 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:29.175 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:29.175 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:29.195 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:33:29.273 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:29.269+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:29.374 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:29.370+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:29.389 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:29.389 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:29.389 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:29.407 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:33:29.495 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:29.494+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:29.575 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:29.573+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:29.588 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:33:29.594 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:29.594 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:29.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:29.594 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:29.594 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.594 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2207 3.38 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:29.594 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:29.594 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.289322699000003, 2024-04-24T13:33:29.594 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022686873999999999, 2024-04-24T13:33:29.595 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.595 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.595 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.595 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.595 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.595 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.595 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2207 2024-04-24T13:33:29.595 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.595 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.595 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.595 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.595 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:29.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:29.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.596 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.596 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302499+0000", 2024-04-24T13:33:29.596 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-04-24T13:33:29.596 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.596 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307861+0000", 2024-04-24T13:33:29.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053622089999999997 2024-04-24T13:33:29.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307899+0000", 2024-04-24T13:33:29.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978999999999997e-05 2024-04-24T13:33:29.597 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.597 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.597 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.597 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307917+0000", 2024-04-24T13:33:29.597 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8576999999999998e-05 2024-04-24T13:33:29.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308018+0000", 2024-04-24T13:33:29.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010080499999999999 2024-04-24T13:33:29.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.598 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.598 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308202+0000", 2024-04-24T13:33:29.598 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000183628 2024-04-24T13:33:29.598 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.598 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308352+0000", 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149806 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318520+0000", 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010168744 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.324908+0000", 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063874739999999998 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.599 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325063+0000", 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155131 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325182+0000", 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011915499999999999 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:29.600 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.265727986000002, 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:29.601 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:29.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.602 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.602 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:33:29.602 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:33:29.602 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.602 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:33:29.603 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.604 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:33:29.605 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.606 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.606 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:33:29.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:33:29.606 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.606 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.606 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.606 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.606 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.606 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:29.606 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:29.606 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 61.120672132000003, 2024-04-24T13:33:29.606 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.607 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:33:29.608 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:33:29.609 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:33:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:33:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:33:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:33:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.610 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.611 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2242 3.b 3:d16b554f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 60.852173200000003, 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022940439, 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.612 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2242 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:29.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739648+0000", 2024-04-24T13:33:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.785e-06 2024-04-24T13:33:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741765+0000", 2024-04-24T13:33:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002117655 2024-04-24T13:33:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741781+0000", 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6062e-05 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741792+0000", 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0937999999999999e-05 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741918+0000", 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623199999999999 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742189+0000", 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027047300000000002 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742430+0000", 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024077699999999999 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752990+0000", 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010559875 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762422+0000", 2024-04-24T13:33:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094325120000000005 2024-04-24T13:33:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762510+0000", 2024-04-24T13:33:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7879000000000003e-05 2024-04-24T13:33:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762585+0000", 2024-04-24T13:33:29.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5251000000000002e-05 2024-04-24T13:33:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2662 3.33 3:ce195145:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.463254892999998, 2024-04-24T13:33:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028670389000000001, 2024-04-24T13:33:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.618 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2662 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:29.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128567+0000", 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4640000000000002e-06 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130845+0000", 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002278389 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130869+0000", 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4394999999999999e-05 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130879+0000", 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0000000000000001e-05 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130957+0000", 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7968999999999998e-05 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130963+0000", 2024-04-24T13:33:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2499999999999997e-06 2024-04-24T13:33:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137507+0000", 2024-04-24T13:33:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065442900000000003 2024-04-24T13:33:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137607+0000", 2024-04-24T13:33:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010002599999999999 2024-04-24T13:33:29.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137727+0000", 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120142 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152307+0000", 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01458017 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157112+0000", 2024-04-24T13:33:29.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048051350000000003 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157181+0000", 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9051e-05 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157233+0000", 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2108000000000003e-05 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2673 3.18 3:1a01061c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.241832+0000", 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.349985474, 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020587687, 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2673 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.625 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.241832+0000", 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.241832+0000", 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.241835+0000", 2024-04-24T13:33:29.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.238e-06 2024-04-24T13:33:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243821+0000", 2024-04-24T13:33:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019861620000000001 2024-04-24T13:33:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243846+0000", 2024-04-24T13:33:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4861000000000001e-05 2024-04-24T13:33:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243867+0000", 2024-04-24T13:33:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1535e-05 2024-04-24T13:33:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243970+0000", 2024-04-24T13:33:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000102564 2024-04-24T13:33:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.244131+0000", 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016069000000000001 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.244283+0000", 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152149 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259574+0000", 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015291310000000001 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.262266+0000", 2024-04-24T13:33:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002691588 2024-04-24T13:33:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.262342+0000", 2024-04-24T13:33:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5957000000000005e-05 2024-04-24T13:33:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.262420+0000", 2024-04-24T13:33:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8633000000000004e-05 2024-04-24T13:33:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.630 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2676 3.22 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.320052985, 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025889562000000001, 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2676 2024-04-24T13:33:29.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271767+0000", 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-04-24T13:33:29.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.273986+0000", 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022195560000000001 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274011+0000", 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4953e-05 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274023+0000", 2024-04-24T13:33:29.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1856e-05 2024-04-24T13:33:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274116+0000", 2024-04-24T13:33:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3168e-05 2024-04-24T13:33:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274377+0000", 2024-04-24T13:33:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026071500000000001 2024-04-24T13:33:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274531+0000", 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015427299999999999 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297124+0000", 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022592476 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297544+0000", 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000420691 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297605+0000", 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0888999999999999e-05 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297655+0000", 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9119999999999997e-05 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.636 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2722 3.25 e101/20 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head v 101'6, mlcod=86'4)", 2024-04-24T13:33:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.948307704000001, 2024-04-24T13:33:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023380372, 2024-04-24T13:33:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643511+0000", 2024-04-24T13:33:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4400000000000001e-07 2024-04-24T13:33:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647450+0000", 2024-04-24T13:33:29.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039389259999999997 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647470+0000", 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0534e-05 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647484+0000", 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3370000000000001e-05 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647599+0000", 2024-04-24T13:33:29.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115513 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647629+0000", 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0145e-05 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666761+0000", 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019132303999999999 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666891+0000", 2024-04-24T13:33:29.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012913599999999999 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2726 3.3c e101/20 3:3c53550d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_55:head v 101'5, mlcod=86'3)", 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.899427065000001, 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021010132000000001, 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.692391+0000", 2024-04-24T13:33:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9999999999999999e-07 2024-04-24T13:33:29.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701201+0000", 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088100639999999994 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701230+0000", 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8428e-05 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701243+0000", 2024-04-24T13:33:29.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3635000000000001e-05 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701333+0000", 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9765999999999994e-05 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.701362+0000", 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8810999999999999e-05 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713347+0000", 2024-04-24T13:33:29.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011985657 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.713401+0000", 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3570999999999999e-05 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2740 3.15 3:abd27dc3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.823008+0000", 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.768809725000001, 2024-04-24T13:33:29.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021456604000000001, 2024-04-24T13:33:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2740 2024-04-24T13:33:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.823008+0000", 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.823008+0000", 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.823011+0000", 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.813e-06 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824873+0000", 2024-04-24T13:33:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001861693 2024-04-24T13:33:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824895+0000", 2024-04-24T13:33:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2067000000000001e-05 2024-04-24T13:33:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824905+0000", 2024-04-24T13:33:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7329999999999998e-06 2024-04-24T13:33:29.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.824974+0000", 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9072000000000005e-05 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.825139+0000", 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016501299999999999 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.825236+0000", 2024-04-24T13:33:29.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7441000000000004e-05 2024-04-24T13:33:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.831503+0000", 2024-04-24T13:33:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062670470000000004 2024-04-24T13:33:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.844370+0000", 2024-04-24T13:33:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012867197 2024-04-24T13:33:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.844428+0000", 2024-04-24T13:33:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7750000000000001e-05 2024-04-24T13:33:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.844465+0000", 2024-04-24T13:33:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6777999999999999e-05 2024-04-24T13:33:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.651 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2747 3.24 3:2754d069:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.693757842, 2024-04-24T13:33:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024857536999999999, 2024-04-24T13:33:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2747 2024-04-24T13:33:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898063+0000", 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5289999999999998e-06 2024-04-24T13:33:29.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899956+0000", 2024-04-24T13:33:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932759999999999 2024-04-24T13:33:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899984+0000", 2024-04-24T13:33:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7801999999999999e-05 2024-04-24T13:33:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899997+0000", 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3127e-05 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900063+0000", 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900200+0000", 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000137324 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900302+0000", 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010168 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.908151+0000", 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078489579999999996 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922784+0000", 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014633116 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922860+0000", 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5708000000000001e-05 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922918+0000", 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7686000000000003e-05 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.657 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2753 3.24 3:261ef004:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.964749+0000", 2024-04-24T13:33:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.627068951999998, 2024-04-24T13:33:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021608380999999999, 2024-04-24T13:33:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2753 2024-04-24T13:33:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.964749+0000", 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.964749+0000", 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.964752+0000", 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2090000000000001e-06 2024-04-24T13:33:29.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966363+0000", 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016103560000000001 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966388+0000", 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.514e-05 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966401+0000", 2024-04-24T13:33:29.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.376e-05 2024-04-24T13:33:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966476+0000", 2024-04-24T13:33:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4657e-05 2024-04-24T13:33:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966638+0000", 2024-04-24T13:33:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016182699999999999 2024-04-24T13:33:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.966730+0000", 2024-04-24T13:33:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2169999999999993e-05 2024-04-24T13:33:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.976261+0000", 2024-04-24T13:33:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0095310770000000006 2024-04-24T13:33:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.986217+0000", 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099560849999999999 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.986298+0000", 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.119e-05 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.986357+0000", 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8909999999999997e-05 2024-04-24T13:33:29.663 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.664 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2754 3.b 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.613288342000001, 2024-04-24T13:33:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.032358206, 2024-04-24T13:33:29.666 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2754 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978532+0000", 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6079999999999998e-06 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979768+0000", 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012357869999999999 2024-04-24T13:33:29.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979791+0000", 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3224e-05 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979804+0000", 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.274e-05 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979889+0000", 2024-04-24T13:33:29.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5483999999999997e-05 2024-04-24T13:33:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980063+0000", 2024-04-24T13:33:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017384599999999999 2024-04-24T13:33:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980227+0000", 2024-04-24T13:33:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163764 2024-04-24T13:33:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987774+0000", 2024-04-24T13:33:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075472029999999997 2024-04-24T13:33:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010776+0000", 2024-04-24T13:33:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023001886999999999 2024-04-24T13:33:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010838+0000", 2024-04-24T13:33:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1527999999999998e-05 2024-04-24T13:33:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010888+0000", 2024-04-24T13:33:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0135e-05 2024-04-24T13:33:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.673 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2811 3.7 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.02164951, 2024-04-24T13:33:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044582597000000002, 2024-04-24T13:33:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.674 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2811 2024-04-24T13:33:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.675 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570171+0000", 2024-04-24T13:33:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9100000000000001e-06 2024-04-24T13:33:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580122+0000", 2024-04-24T13:33:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099505930000000006 2024-04-24T13:33:29.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580150+0000", 2024-04-24T13:33:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7827e-05 2024-04-24T13:33:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580164+0000", 2024-04-24T13:33:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4547e-05 2024-04-24T13:33:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580245+0000", 2024-04-24T13:33:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0810999999999996e-05 2024-04-24T13:33:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580355+0000", 2024-04-24T13:33:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109656 2024-04-24T13:33:29.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580475+0000", 2024-04-24T13:33:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120278 2024-04-24T13:33:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607433+0000", 2024-04-24T13:33:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026957894 2024-04-24T13:33:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614636+0000", 2024-04-24T13:33:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072028359999999998 2024-04-24T13:33:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614703+0000", 2024-04-24T13:33:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7645999999999996e-05 2024-04-24T13:33:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614751+0000", 2024-04-24T13:33:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7599000000000003e-05 2024-04-24T13:33:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2812 3.1e 3:7bd62ca6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:29.684 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.011605629999998, 2024-04-24T13:33:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.038041177000000002, 2024-04-24T13:33:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2812 2024-04-24T13:33:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580214+0000", 2024-04-24T13:33:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.708e-06 2024-04-24T13:33:29.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582574+0000", 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023601799999999999 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582591+0000", 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6648999999999999e-05 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582598+0000", 2024-04-24T13:33:29.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.391e-06 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583731+0000", 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011332029999999999 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583843+0000", 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111889 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:29.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583936+0000", 2024-04-24T13:33:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2968999999999997e-05 2024-04-24T13:33:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.599363+0000", 2024-04-24T13:33:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015427186000000001 2024-04-24T13:33:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618143+0000", 2024-04-24T13:33:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018779051000000001 2024-04-24T13:33:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618200+0000", 2024-04-24T13:33:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7151999999999998e-05 2024-04-24T13:33:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618253+0000", 2024-04-24T13:33:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3798999999999998e-05 2024-04-24T13:33:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3096 3.38 3:1e1cc6c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.630661+0000", 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.96115721899999995, 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021029941999999999, 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3096 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.630661+0000", 2024-04-24T13:33:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.630661+0000", 2024-04-24T13:33:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.630664+0000", 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9950000000000001e-06 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.633258+0000", 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025943260000000001 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.633299+0000", 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1196999999999999e-05 2024-04-24T13:33:29.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.633316+0000", 2024-04-24T13:33:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6370000000000001e-05 2024-04-24T13:33:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.633403+0000", 2024-04-24T13:33:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7200000000000005e-05 2024-04-24T13:33:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.633569+0000", 2024-04-24T13:33:29.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016628899999999999 2024-04-24T13:33:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.633731+0000", 2024-04-24T13:33:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016187999999999999 2024-04-24T13:33:29.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.640664+0000", 2024-04-24T13:33:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0069327440000000002 2024-04-24T13:33:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.651552+0000", 2024-04-24T13:33:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010888033 2024-04-24T13:33:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.651622+0000", 2024-04-24T13:33:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0628000000000002e-05 2024-04-24T13:33:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.651691+0000", 2024-04-24T13:33:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8280000000000004e-05 2024-04-24T13:33:29.698 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3110 3.1e 3:79ca4af0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:29.699 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.79254743000000005, 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022894164000000002, 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3110 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:29.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799272+0000", 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9470000000000002e-06 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800698+0000", 2024-04-24T13:33:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001425204 2024-04-24T13:33:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800721+0000", 2024-04-24T13:33:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3577000000000001e-05 2024-04-24T13:33:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800731+0000", 2024-04-24T13:33:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9969999999999993e-06 2024-04-24T13:33:29.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800797+0000", 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6087999999999995e-05 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800954+0000", 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015699 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.801064+0000", 2024-04-24T13:33:29.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109715 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.807584+0000", 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065197479999999997 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822063+0000", 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014479156999999999 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822122+0000", 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9095000000000003e-05 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822165+0000", 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2645999999999998e-05 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3117 3.27 3:e455931d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:29.705 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.72118939999999998, 2024-04-24T13:33:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02353235, 2024-04-24T13:33:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3117 2024-04-24T13:33:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870631+0000", 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.075e-06 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872287+0000", 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016561449999999999 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872316+0000", 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9543000000000002e-05 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872333+0000", 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6806000000000001e-05 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872403+0000", 2024-04-24T13:33:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9917000000000002e-05 2024-04-24T13:33:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872540+0000", 2024-04-24T13:33:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013735200000000001 2024-04-24T13:33:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872686+0000", 2024-04-24T13:33:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014519899999999999 2024-04-24T13:33:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.878440+0000", 2024-04-24T13:33:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057539490000000004 2024-04-24T13:33:29.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894072+0000", 2024-04-24T13:33:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015632801000000002 2024-04-24T13:33:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894106+0000", 2024-04-24T13:33:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3933999999999997e-05 2024-04-24T13:33:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894161+0000", 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4629000000000002e-05 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3127 3.15 3:a9239ffa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.61646222399999995, 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023707346000000001, 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.712 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3127 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975357+0000", 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.418e-06 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976868+0000", 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015108719999999999 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976894+0000", 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5885e-05 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976905+0000", 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1076e-05 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976983+0000", 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8532e-05 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977149+0000", 2024-04-24T13:33:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016571500000000001 2024-04-24T13:33:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977313+0000", 2024-04-24T13:33:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163719 2024-04-24T13:33:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.984588+0000", 2024-04-24T13:33:29.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072751600000000001 2024-04-24T13:33:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998908+0000", 2024-04-24T13:33:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014319705 2024-04-24T13:33:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998988+0000", 2024-04-24T13:33:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9839000000000006e-05 2024-04-24T13:33:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.999063+0000", 2024-04-24T13:33:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5425000000000004e-05 2024-04-24T13:33:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3136 3.25 e112/20 3:a4e0a0f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_51:head v 112'10, mlcod=102'8)", 2024-04-24T13:33:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.51540255499999998, 2024-04-24T13:33:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026701701000000001, 2024-04-24T13:33:29.718 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:29.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076417+0000", 2024-04-24T13:33:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.779e-06 2024-04-24T13:33:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077651+0000", 2024-04-24T13:33:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233428 2024-04-24T13:33:29.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077679+0000", 2024-04-24T13:33:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8535e-05 2024-04-24T13:33:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077694+0000", 2024-04-24T13:33:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:33:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:29.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077775+0000", 2024-04-24T13:33:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0927000000000006e-05 2024-04-24T13:33:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077801+0000", 2024-04-24T13:33:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5933999999999999e-05 2024-04-24T13:33:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103085+0000", 2024-04-24T13:33:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284238000000001 2024-04-24T13:33:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:29.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:29.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:29.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103117+0000", 2024-04-24T13:33:29.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1917e-05 2024-04-24T13:33:29.723 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.723 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.723 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.723 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:29.723 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:29.723 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:29.725 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:33:29.725 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:29.721+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:29.749 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:29.749 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:29.769 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:29.769 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:29.794 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:29.794 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:29.816 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:29.816 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:29.825 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:29.821+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:29.835 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:29.835 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:29.864 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:29.867 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:29.868 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:29.868 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:29.886 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:33:29.886 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:29.887 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:29.909 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:29.909 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:29.925 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:29.922+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:30.027 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:30.025+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:30.065 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:30.066 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:30.086 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:33:30.130 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:30.129+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:30.229 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:30.226+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:30.270 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:30.270 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:30.291 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:33:30.330 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:30.326+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:30.361 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:33:30.424 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:30.424 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:30.430 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:30.429+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:30.438 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:33:30.531 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:30.529+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:30.620 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:30.620 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:30.631 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:30.630+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:30.637 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:33:30.733 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:30.729+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:30.811 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:30.812 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:30.829 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:33:30.834 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:30.830+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:30.936 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:30.934+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:31.011 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:31.011 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:31.026 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:33:31.037 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:31.034+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:31.137 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:31.134+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:31.158 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:31.158 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:31.177 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:33:31.238 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:31.237+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:31.302 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:31.302 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:31.321 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:33:31.339 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:31.338+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:31.440 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:31.437+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:31.494 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:31.494 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:31.510 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:31.554 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:31.553+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:31.642 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:31.641+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:31.674 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:31.674 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:31.693 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:31.743 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:31.742+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:31.844 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:31.841+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:31.860 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:31.860 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:31.877 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:31.931 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:33:31.979 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:31.978+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:32.032 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:32.032 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:32.046 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:32.042+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:32.054 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:32.147 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:32.146+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:32.164 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:32.164 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:32.186 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:32.186 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:32.208 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:32.208 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:32.234 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:32.234 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:32.249 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:32.245+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:32.265 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:32.265 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:32.266 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:32.266 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:32.266 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:32.271 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:32.271 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:32.288 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:32.296 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:32.296 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:32.326 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:32.326 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:32.349 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:32.345+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:32.354 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:32.354 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:32.390 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:33:32.450 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:32.449+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:32.460 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:32.461 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:32.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:32.461 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:32.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.461 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2206 3.f e85/48 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:32.461 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:32.461 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 64.162532853000002, 2024-04-24T13:33:32.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022785151, 2024-04-24T13:33:32.461 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.461 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.461 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.461 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:32.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295564+0000", 2024-04-24T13:33:32.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.462 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.462 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295567+0000", 2024-04-24T13:33:32.462 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3939999999999999e-06 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299770+0000", 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042038029999999999 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299808+0000", 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7703000000000001e-05 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299826+0000", 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8142999999999999e-05 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.299972+0000", 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000146095 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.300023+0000", 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0294999999999999e-05 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318209+0000", 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018186099000000001 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318349+0000", 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000140619 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2216 3.3d 3:bf22edaf:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:32.465 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 63.996779842000002, 2024-04-24T13:33:32.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027972988000000001, 2024-04-24T13:33:32.466 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.466 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.466 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.466 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:32.466 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:32.466 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:32.466 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2216 2024-04-24T13:33:32.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.466 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:32.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:32.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461320+0000", 2024-04-24T13:33:32.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7049999999999999e-06 2024-04-24T13:33:32.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462822+0000", 2024-04-24T13:33:32.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015018919999999999 2024-04-24T13:33:32.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462846+0000", 2024-04-24T13:33:32.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4229000000000001e-05 2024-04-24T13:33:32.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462856+0000", 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8619999999999998e-06 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462932+0000", 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6126999999999998e-05 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463098+0000", 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016631400000000001 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463231+0000", 2024-04-24T13:33:32.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013278699999999999 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475573+0000", 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012342148000000001 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489102+0000", 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013528755 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489210+0000", 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010779400000000001 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489290+0000", 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0375000000000002e-05 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2217 3.7 e85/41 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 63.984370499000001, 2024-04-24T13:33:32.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022815940999999999, 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473728+0000", 2024-04-24T13:33:32.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6080000000000001e-06 2024-04-24T13:33:32.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475783+0000", 2024-04-24T13:33:32.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002054349 2024-04-24T13:33:32.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475801+0000", 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8054e-05 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475814+0000", 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3515e-05 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488934+0000", 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013119772 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488977+0000", 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2922e-05 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496474+0000", 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074975320000000003 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496543+0000", 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8188999999999994e-05 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.475 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.476 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.476 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2251 3.3a e85/20 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head v 85'3, mlcod=81'1)", 2024-04-24T13:33:32.476 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:32.476 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 63.616870824000003, 2024-04-24T13:33:32.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024431608, 2024-04-24T13:33:32.476 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.476 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.476 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.476 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:32.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:32.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841228+0000", 2024-04-24T13:33:32.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.781e-06 2024-04-24T13:33:32.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846614+0000", 2024-04-24T13:33:32.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053854419999999998 2024-04-24T13:33:32.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846650+0000", 2024-04-24T13:33:32.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6133000000000001e-05 2024-04-24T13:33:32.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846669+0000", 2024-04-24T13:33:32.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9199e-05 2024-04-24T13:33:32.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846763+0000", 2024-04-24T13:33:32.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4335999999999999e-05 2024-04-24T13:33:32.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846799+0000", 2024-04-24T13:33:32.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5796000000000001e-05 2024-04-24T13:33:32.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865616+0000", 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018816825999999998 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865658+0000", 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2095000000000003e-05 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.480 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2667 3.39 3:9ef26513:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:32.481 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:32.481 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.275072695999999, 2024-04-24T13:33:32.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021597445, 2024-04-24T13:33:32.481 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.481 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.481 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:32.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:32.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:32.481 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2667 2024-04-24T13:33:32.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.481 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:32.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183024+0000", 2024-04-24T13:33:32.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.183028+0000", 2024-04-24T13:33:32.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.444e-06 2024-04-24T13:33:32.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185652+0000", 2024-04-24T13:33:32.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026242420000000002 2024-04-24T13:33:32.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185674+0000", 2024-04-24T13:33:32.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1429000000000001e-05 2024-04-24T13:33:32.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185683+0000", 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4069999999999999e-06 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185746+0000", 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2621999999999998e-05 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.185750+0000", 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7840000000000003e-06 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188091+0000", 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023404709999999998 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188186+0000", 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5136000000000005e-05 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.188277+0000", 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0661000000000005e-05 2024-04-24T13:33:32.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:32.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.196753+0000", 2024-04-24T13:33:32.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084765789999999997 2024-04-24T13:33:32.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:32.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204495+0000", 2024-04-24T13:33:32.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0077418260000000003 2024-04-24T13:33:32.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204569+0000", 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3906999999999996e-05 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204622+0000", 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2936999999999998e-05 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2675 3.20 e100/20 3:04d57de4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_14:head v 100'3, mlcod=85'1)", 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:32.487 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.188241253000001, 2024-04-24T13:33:32.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027012970000000001, 2024-04-24T13:33:32.488 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.488 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.488 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.488 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:32.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:32.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:32.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.72e-07 2024-04-24T13:33:32.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275705+0000", 2024-04-24T13:33:32.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058491849999999998 2024-04-24T13:33:32.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275732+0000", 2024-04-24T13:33:32.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6630000000000001e-05 2024-04-24T13:33:32.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275747+0000", 2024-04-24T13:33:32.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5375000000000001e-05 2024-04-24T13:33:32.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275839+0000", 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1348999999999996e-05 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275873+0000", 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4341999999999997e-05 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296810+0000", 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020937196000000002 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296869+0000", 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8621e-05 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2676 3.22 e100/74 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head v 100'6, mlcod=86'4)", 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.183440409999999, 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022762185000000001, 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.492 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.493 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:32.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.493 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.493 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274657+0000", 2024-04-24T13:33:32.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274658+0000", 2024-04-24T13:33:32.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.466e-06 2024-04-24T13:33:32.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277453+0000", 2024-04-24T13:33:32.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027952799999999998 2024-04-24T13:33:32.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277477+0000", 2024-04-24T13:33:32.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3533e-05 2024-04-24T13:33:32.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277490+0000", 2024-04-24T13:33:32.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2978e-05 2024-04-24T13:33:32.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277588+0000", 2024-04-24T13:33:32.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7796999999999999e-05 2024-04-24T13:33:32.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.277617+0000", 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8878e-05 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297382+0000", 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019765373999999999 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297419+0000", 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6878999999999997e-05 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.496 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2693 3.39 3:9e56554d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.017400769000002, 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284832, 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2693 2024-04-24T13:33:32.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.498 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:32.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:32.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440699+0000", 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2199999999999999e-06 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441920+0000", 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012213739999999999 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441944+0000", 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4127000000000001e-05 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.499 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441963+0000", 2024-04-24T13:33:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.855e-05 2024-04-24T13:33:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442027+0000", 2024-04-24T13:33:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4337000000000004e-05 2024-04-24T13:33:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442150+0000", 2024-04-24T13:33:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012347399999999999 2024-04-24T13:33:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442248+0000", 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7683999999999995e-05 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.447435+0000", 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005186955 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465898+0000", 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018462971000000002 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465947+0000", 2024-04-24T13:33:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9276000000000001e-05 2024-04-24T13:33:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465981+0000", 2024-04-24T13:33:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3864e-05 2024-04-24T13:33:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.502 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2723 3.37 3:ecde4b94:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.814619771, 2024-04-24T13:33:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023622656999999998, 2024-04-24T13:33:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2723 2024-04-24T13:33:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643480+0000", 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6960000000000001e-06 2024-04-24T13:33:32.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645332+0000", 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001851561 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645362+0000", 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0298e-05 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645375+0000", 2024-04-24T13:33:32.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.331e-05 2024-04-24T13:33:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645460+0000", 2024-04-24T13:33:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4851999999999993e-05 2024-04-24T13:33:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645467+0000", 2024-04-24T13:33:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0140000000000001e-06 2024-04-24T13:33:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.653874+0000", 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084073340000000007 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654042+0000", 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000167159 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654214+0000", 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017199899999999999 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666361+0000", 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012146957999999999 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666977+0000", 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061606400000000004 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667043+0000", 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:32.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667100+0000", 2024-04-24T13:33:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7080999999999998e-05 2024-04-24T13:33:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2746 3.30 3:0ff52a22:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.57131687, 2024-04-24T13:33:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025777590999999999, 2024-04-24T13:33:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2746 2024-04-24T13:33:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.510 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886783+0000", 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8930000000000001e-06 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889050+0000", 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002267107 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889078+0000", 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7623999999999998e-05 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889091+0000", 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3101e-05 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889170+0000", 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8968999999999996e-05 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889311+0000", 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141392 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889451+0000", 2024-04-24T13:33:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139911 2024-04-24T13:33:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.895637+0000", 2024-04-24T13:33:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061857290000000001 2024-04-24T13:33:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912426+0000", 2024-04-24T13:33:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016789347999999999 2024-04-24T13:33:32.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912501+0000", 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4836e-05 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912558+0000", 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6681000000000002e-05 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2754 3.b e101/20 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head v 101'7, mlcod=86'5)", 2024-04-24T13:33:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.472756139000001, 2024-04-24T13:33:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025167067000000001, 2024-04-24T13:33:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985343+0000", 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.734e-06 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987192+0000", 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018490360000000001 2024-04-24T13:33:32.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987224+0000", 2024-04-24T13:33:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2588e-05 2024-04-24T13:33:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987241+0000", 2024-04-24T13:33:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6350000000000001e-05 2024-04-24T13:33:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987338+0000", 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7466000000000005e-05 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987368+0000", 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0210999999999999e-05 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010454+0000", 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02308522 2024-04-24T13:33:32.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010508+0000", 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4462000000000001e-05 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2755 3.12 3:4bcc7c5c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.472344250999999, 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026401981000000001, 2024-04-24T13:33:32.520 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2755 2024-04-24T13:33:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985757+0000", 2024-04-24T13:33:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6370000000000001e-06 2024-04-24T13:33:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.522 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987459+0000", 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017029180000000001 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987474+0000", 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4460999999999999e-05 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987484+0000", 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0168e-05 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987576+0000", 2024-04-24T13:33:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2020000000000003e-05 2024-04-24T13:33:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987731+0000", 2024-04-24T13:33:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015486499999999999 2024-04-24T13:33:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987818+0000", 2024-04-24T13:33:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:33:32.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012049+0000", 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02423055 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012062+0000", 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3054000000000001e-05 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012114+0000", 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1656999999999997e-05 2024-04-24T13:33:32.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012155+0000", 2024-04-24T13:33:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1300000000000001e-05 2024-04-24T13:33:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2770 3.1 3:80489e4c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:32.526 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.324491001999998, 2024-04-24T13:33:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025093718000000001, 2024-04-24T13:33:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2770 2024-04-24T13:33:32.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133609+0000", 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0369999999999999e-06 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135153+0000", 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015441229999999999 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135182+0000", 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8300999999999999e-05 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135196+0000", 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4229999999999999e-05 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135279+0000", 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3549999999999998e-05 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135458+0000", 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017893100000000001 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135611+0000", 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152881 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.144283+0000", 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086718709999999994 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158560+0000", 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014277306 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158642+0000", 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1435999999999998e-05 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158700+0000", 2024-04-24T13:33:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8051999999999999e-05 2024-04-24T13:33:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2811 3.7 e101/41 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head v 101'8, mlcod=101'6)", 2024-04-24T13:33:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 25.877513022999999, 2024-04-24T13:33:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026659326000000001, 2024-04-24T13:33:32.534 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580586+0000", 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.668e-06 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582238+0000", 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016524829999999999 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582266+0000", 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8028e-05 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582282+0000", 2024-04-24T13:33:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6047999999999999e-05 2024-04-24T13:33:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582372+0000", 2024-04-24T13:33:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9642999999999995e-05 2024-04-24T13:33:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582400+0000", 2024-04-24T13:33:32.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7776999999999998e-05 2024-04-24T13:33:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607184+0000", 2024-04-24T13:33:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024784418999999999 2024-04-24T13:33:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607243+0000", 2024-04-24T13:33:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9259999999999998e-05 2024-04-24T13:33:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.538 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3089 3.17 3:e81f13af:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.547320+0000", 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.9107768620000001, 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029439633, 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3089 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.539 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.547320+0000", 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.547320+0000", 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.547323+0000", 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.056e-06 2024-04-24T13:33:32.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.549747+0000", 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002424102 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.549781+0000", 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.549798+0000", 2024-04-24T13:33:32.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6575999999999999e-05 2024-04-24T13:33:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.549871+0000", 2024-04-24T13:33:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3402e-05 2024-04-24T13:33:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.550024+0000", 2024-04-24T13:33:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015292699999999999 2024-04-24T13:33:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.550144+0000", 2024-04-24T13:33:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120164 2024-04-24T13:33:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.556328+0000", 2024-04-24T13:33:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061837530000000002 2024-04-24T13:33:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.576617+0000", 2024-04-24T13:33:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020289629 2024-04-24T13:33:32.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.576698+0000", 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0599999999999994e-05 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.576760+0000", 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1860999999999996e-05 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.544 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3176 3.1 3:8341baec:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_91:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.525082+0000", 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.9330146429999999, 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022445849, 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3176 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.525082+0000", 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.525082+0000", 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.525085+0000", 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7999999999999999e-06 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.532266+0000", 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071807729999999997 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.532293+0000", 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6514000000000001e-05 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.532306+0000", 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3291e-05 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.532376+0000", 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0233000000000003e-05 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.532493+0000", 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011699100000000001 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.532600+0000", 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010697299999999999 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.538070+0000", 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0054701230000000003 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.547451+0000", 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093806010000000006 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.547493+0000", 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2054000000000001e-05 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.547528+0000", 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5496e-05 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3179 3.6 3:61c16905:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.554088+0000", 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 2.9040087300000001, 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024689096000000001, 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.550 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3179 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.554088+0000", 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.551 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.554088+0000", 2024-04-24T13:33:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.554091+0000", 2024-04-24T13:33:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7609999999999999e-06 2024-04-24T13:33:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.555729+0000", 2024-04-24T13:33:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001638016 2024-04-24T13:33:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.555762+0000", 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2490999999999998e-05 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.555777+0000", 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4961e-05 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.555866+0000", 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9411000000000002e-05 2024-04-24T13:33:32.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.556002+0000", 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013555699999999999 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.556128+0000", 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126685 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578483+0000", 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022354272000000001 2024-04-24T13:33:32.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578705+0000", 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022231099999999999 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578743+0000", 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8572000000000003e-05 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578777+0000", 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4059e-05 2024-04-24T13:33:32.555 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3366 3.1 3:80d4803f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_271:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.193981+0000", 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.26411570699999998, 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027172661000000001, 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:32.556 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3366 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.193981+0000", 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.193981+0000", 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.193984+0000", 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9330000000000001e-06 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.196365+0000", 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023805300000000001 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.196400+0000", 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5200999999999997e-05 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.196416+0000", 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5461999999999999e-05 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.196510+0000", 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4736999999999998e-05 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.196719+0000", 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020873199999999999 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.196899+0000", 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017970900000000001 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.202924+0000", 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060257289999999996 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.221018+0000", 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018093827999999999 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.221094+0000", 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5506999999999994e-05 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.221154+0000", 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0293e-05 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3373 3.30 e113/103 3:0ff7ebd9:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_278:head v 113'14, mlcod=112'12)", 2024-04-24T13:33:32.561 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.277223+0000", 2024-04-24T13:33:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.180873751, 2024-04-24T13:33:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028996096999999998, 2024-04-24T13:33:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.277223+0000", 2024-04-24T13:33:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.277223+0000", 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.277226+0000", 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3779999999999999e-06 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.290128+0000", 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012902462 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.290144+0000", 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6138999999999999e-05 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.290153+0000", 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7839999999999992e-06 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.290233+0000", 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9660000000000006e-05 2024-04-24T13:33:32.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.290267+0000", 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4434999999999998e-05 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.306148+0000", 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015880307 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.306219+0000", 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1932000000000002e-05 2024-04-24T13:33:32.565 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3380 3.3a e113/20 3:5cb232f4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_285:head v 113'18, mlcod=113'16)", 2024-04-24T13:33:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.351752+0000", 2024-04-24T13:33:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.106345206, 2024-04-24T13:33:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026120022, 2024-04-24T13:33:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:32.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.351752+0000", 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.351752+0000", 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.351754+0000", 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0990000000000001e-06 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.357096+0000", 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053424329999999997 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.357113+0000", 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.628e-05 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.357126+0000", 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2916e-05 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.357208+0000", 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1924999999999999e-05 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.357238+0000", 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0099000000000001e-05 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.377805+0000", 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020567483000000001 2024-04-24T13:33:32.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.377872+0000", 2024-04-24T13:33:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6786999999999996e-05 2024-04-24T13:33:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:32.570 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:32.570 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:32.572 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:32.572 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:32.570+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:32.672 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:32.670+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:32.773 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:32.769+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:32.816 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:32.816 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:32.816 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:32.816 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:32.844 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:33:32.874 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:32.873+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:32.974 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:32.973+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:33.036 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:33.036 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:33.036 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:33.036 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:33.036 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:33.056 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:33:33.075 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:33.073+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:33.176 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:33.174+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:33.196 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:33.196 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:33.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:33.196 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:33.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.197 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2252 3.4 3:22834b58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:33.197 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:33.197 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 64.347726897000001, 2024-04-24T13:33:33.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932545999999999, 2024-04-24T13:33:33.197 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.197 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.197 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.197 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.198 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.198 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.198 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2252 2024-04-24T13:33:33.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.198 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:33.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:33.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845581+0000", 2024-04-24T13:33:33.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:33:33.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847834+0000", 2024-04-24T13:33:33.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002252843 2024-04-24T13:33:33.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847863+0000", 2024-04-24T13:33:33.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.904e-05 2024-04-24T13:33:33.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847877+0000", 2024-04-24T13:33:33.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4126e-05 2024-04-24T13:33:33.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847963+0000", 2024-04-24T13:33:33.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6162999999999995e-05 2024-04-24T13:33:33.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848105+0000", 2024-04-24T13:33:33.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014117900000000001 2024-04-24T13:33:33.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:33.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848252+0000", 2024-04-24T13:33:33.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014774800000000001 2024-04-24T13:33:33.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865043+0000", 2024-04-24T13:33:33.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016790848000000001 2024-04-24T13:33:33.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865405+0000", 2024-04-24T13:33:33.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036176900000000001 2024-04-24T13:33:33.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865460+0000", 2024-04-24T13:33:33.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5334000000000002e-05 2024-04-24T13:33:33.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865511+0000", 2024-04-24T13:33:33.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0784e-05 2024-04-24T13:33:33.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.204 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.204 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2663 3.0 3:01df44a3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:33.204 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:33.204 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.053952863999999, 2024-04-24T13:33:33.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020742727999999998, 2024-04-24T13:33:33.205 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.205 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.205 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.205 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.205 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.205 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.205 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2663 2024-04-24T13:33:33.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.205 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:33.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:33.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139355+0000", 2024-04-24T13:33:33.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2529999999999999e-06 2024-04-24T13:33:33.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141777+0000", 2024-04-24T13:33:33.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002422638 2024-04-24T13:33:33.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141800+0000", 2024-04-24T13:33:33.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2949e-05 2024-04-24T13:33:33.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141812+0000", 2024-04-24T13:33:33.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1551e-05 2024-04-24T13:33:33.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141907+0000", 2024-04-24T13:33:33.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5296000000000004e-05 2024-04-24T13:33:33.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:33.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141917+0000", 2024-04-24T13:33:33.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.414e-06 2024-04-24T13:33:33.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144519+0000", 2024-04-24T13:33:33.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026024220000000001 2024-04-24T13:33:33.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144684+0000", 2024-04-24T13:33:33.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164511 2024-04-24T13:33:33.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:33.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144845+0000", 2024-04-24T13:33:33.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016157000000000001 2024-04-24T13:33:33.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.156972+0000", 2024-04-24T13:33:33.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012126855000000001 2024-04-24T13:33:33.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.159989+0000", 2024-04-24T13:33:33.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003016609 2024-04-24T13:33:33.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160059+0000", 2024-04-24T13:33:33.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0598000000000004e-05 2024-04-24T13:33:33.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160095+0000", 2024-04-24T13:33:33.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6062000000000001e-05 2024-04-24T13:33:33.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.213 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.213 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.213 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2672 3.1c e100/74 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head v 100'4, mlcod=85'2)", 2024-04-24T13:33:33.213 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:33.213 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.955811307000001, 2024-04-24T13:33:33.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022091785999999999, 2024-04-24T13:33:33.214 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.214 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.214 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.214 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:33.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:33.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237495+0000", 2024-04-24T13:33:33.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1500000000000005e-07 2024-04-24T13:33:33.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243044+0000", 2024-04-24T13:33:33.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055497869999999996 2024-04-24T13:33:33.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243082+0000", 2024-04-24T13:33:33.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7208e-05 2024-04-24T13:33:33.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243097+0000", 2024-04-24T13:33:33.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5554e-05 2024-04-24T13:33:33.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243175+0000", 2024-04-24T13:33:33.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7849999999999995e-05 2024-04-24T13:33:33.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243194+0000", 2024-04-24T13:33:33.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8822999999999999e-05 2024-04-24T13:33:33.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259527+0000", 2024-04-24T13:33:33.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016333007 2024-04-24T13:33:33.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259586+0000", 2024-04-24T13:33:33.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9042000000000002e-05 2024-04-24T13:33:33.218 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.218 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.218 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.218 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2677 3.25 3:a4f04b59:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_16:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:33.218 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:33.219 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.910925554999999, 2024-04-24T13:33:33.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015627926, 2024-04-24T13:33:33.219 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.219 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.219 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.219 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.219 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.219 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.219 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2677 2024-04-24T13:33:33.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.219 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:33.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282380+0000", 2024-04-24T13:33:33.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.282383+0000", 2024-04-24T13:33:33.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1499999999999999e-06 2024-04-24T13:33:33.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283869+0000", 2024-04-24T13:33:33.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014862269999999999 2024-04-24T13:33:33.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283897+0000", 2024-04-24T13:33:33.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7596000000000001e-05 2024-04-24T13:33:33.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283911+0000", 2024-04-24T13:33:33.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.367e-05 2024-04-24T13:33:33.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.283981+0000", 2024-04-24T13:33:33.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0349e-05 2024-04-24T13:33:33.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284117+0000", 2024-04-24T13:33:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013656000000000001 2024-04-24T13:33:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.284214+0000", 2024-04-24T13:33:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6558999999999995e-05 2024-04-24T13:33:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296745+0000", 2024-04-24T13:33:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012530845000000001 2024-04-24T13:33:33.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297925+0000", 2024-04-24T13:33:33.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001179706 2024-04-24T13:33:33.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297961+0000", 2024-04-24T13:33:33.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6514999999999999e-05 2024-04-24T13:33:33.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.298008+0000", 2024-04-24T13:33:33.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6749000000000003e-05 2024-04-24T13:33:33.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.225 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.225 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.225 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2706 3.1c e100/74 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head v 100'5, mlcod=86'3)", 2024-04-24T13:33:33.225 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:33.225 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.718505625999999, 2024-04-24T13:33:33.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021017514000000001, 2024-04-24T13:33:33.225 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.226 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.226 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.226 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:33.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:33.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474802+0000", 2024-04-24T13:33:33.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1399999999999998e-06 2024-04-24T13:33:33.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480124+0000", 2024-04-24T13:33:33.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053217059999999998 2024-04-24T13:33:33.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480147+0000", 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3646e-05 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480159+0000", 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2133999999999999e-05 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480237+0000", 2024-04-24T13:33:33.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7531e-05 2024-04-24T13:33:33.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480291+0000", 2024-04-24T13:33:33.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3851999999999999e-05 2024-04-24T13:33:33.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495746+0000", 2024-04-24T13:33:33.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015454684 2024-04-24T13:33:33.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495817+0000", 2024-04-24T13:33:33.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1821000000000002e-05 2024-04-24T13:33:33.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.230 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.230 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.231 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2722 3.25 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:33.231 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:33.231 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.561101615999998, 2024-04-24T13:33:33.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035782711000000002, 2024-04-24T13:33:33.231 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.231 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.231 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.231 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.231 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2722 2024-04-24T13:33:33.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.232 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:33.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:33.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632207+0000", 2024-04-24T13:33:33.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.252e-06 2024-04-24T13:33:33.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634575+0000", 2024-04-24T13:33:33.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023682500000000001 2024-04-24T13:33:33.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634606+0000", 2024-04-24T13:33:33.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0284999999999999e-05 2024-04-24T13:33:33.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634619+0000", 2024-04-24T13:33:33.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3491e-05 2024-04-24T13:33:33.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634703+0000", 2024-04-24T13:33:33.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4214000000000004e-05 2024-04-24T13:33:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634711+0000", 2024-04-24T13:33:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9719999999999992e-06 2024-04-24T13:33:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639813+0000", 2024-04-24T13:33:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051013830000000001 2024-04-24T13:33:33.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639969+0000", 2024-04-24T13:33:33.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015674600000000001 2024-04-24T13:33:33.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:33.236 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.640112+0000", 2024-04-24T13:33:33.236 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142347 2024-04-24T13:33:33.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.236 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647222+0000", 2024-04-24T13:33:33.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071106520000000003 2024-04-24T13:33:33.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667844+0000", 2024-04-24T13:33:33.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020621746999999999 2024-04-24T13:33:33.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.237 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.237 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.237 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667925+0000", 2024-04-24T13:33:33.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0717999999999995e-05 2024-04-24T13:33:33.237 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667987+0000", 2024-04-24T13:33:33.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1654000000000003e-05 2024-04-24T13:33:33.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.238 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.238 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.238 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2737 3.4 3:23416714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:33.238 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:33.239 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.400169512000002, 2024-04-24T13:33:33.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019181262000000001, 2024-04-24T13:33:33.239 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.239 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.239 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.239 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.239 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2737 2024-04-24T13:33:33.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.239 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:33.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:33.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793139+0000", 2024-04-24T13:33:33.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-04-24T13:33:33.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795403+0000", 2024-04-24T13:33:33.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002264252 2024-04-24T13:33:33.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795439+0000", 2024-04-24T13:33:33.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5701999999999998e-05 2024-04-24T13:33:33.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795454+0000", 2024-04-24T13:33:33.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5262999999999999e-05 2024-04-24T13:33:33.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795541+0000", 2024-04-24T13:33:33.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6989000000000003e-05 2024-04-24T13:33:33.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795719+0000", 2024-04-24T13:33:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000177906 2024-04-24T13:33:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795875+0000", 2024-04-24T13:33:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155785 2024-04-24T13:33:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.808532+0000", 2024-04-24T13:33:33.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012657695 2024-04-24T13:33:33.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812189+0000", 2024-04-24T13:33:33.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036562809999999999 2024-04-24T13:33:33.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812258+0000", 2024-04-24T13:33:33.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9210999999999999e-05 2024-04-24T13:33:33.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812317+0000", 2024-04-24T13:33:33.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9407000000000002e-05 2024-04-24T13:33:33.245 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.245 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.245 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.245 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2781 3.e e101/41 3:704d2ad1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_110:head v 101'4, mlcod=85'2)", 2024-04-24T13:33:33.245 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:33.246 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 26.942615007000001, 2024-04-24T13:33:33.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017614365, 2024-04-24T13:33:33.246 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.246 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.246 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.246 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:33.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:33.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250692+0000", 2024-04-24T13:33:33.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3570000000000001e-06 2024-04-24T13:33:33.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256430+0000", 2024-04-24T13:33:33.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057381300000000001 2024-04-24T13:33:33.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.248 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.248 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256465+0000", 2024-04-24T13:33:33.248 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4974000000000001e-05 2024-04-24T13:33:33.248 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.248 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256480+0000", 2024-04-24T13:33:33.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5000999999999999e-05 2024-04-24T13:33:33.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256571+0000", 2024-04-24T13:33:33.249 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1008999999999995e-05 2024-04-24T13:33:33.249 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.249 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.249 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.249 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256599+0000", 2024-04-24T13:33:33.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7676000000000001e-05 2024-04-24T13:33:33.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268237+0000", 2024-04-24T13:33:33.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011638081 2024-04-24T13:33:33.250 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.250 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.250 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.250 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268305+0000", 2024-04-24T13:33:33.250 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8137000000000002e-05 2024-04-24T13:33:33.251 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.251 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.251 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.251 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.251 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.251 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3106 3.31 3:8f25e7ba:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:33.251 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.755576+0000", 2024-04-24T13:33:33.251 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4377294100000002, 2024-04-24T13:33:33.251 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021214703000000001, 2024-04-24T13:33:33.251 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.251 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.251 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.252 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.252 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3106 2024-04-24T13:33:33.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.252 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.252 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.252 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.755576+0000", 2024-04-24T13:33:33.252 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.252 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.252 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.755576+0000", 2024-04-24T13:33:33.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.253 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.755579+0000", 2024-04-24T13:33:33.253 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8389999999999998e-06 2024-04-24T13:33:33.253 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.253 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.253 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.757952+0000", 2024-04-24T13:33:33.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002372683 2024-04-24T13:33:33.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.757980+0000", 2024-04-24T13:33:33.254 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8708e-05 2024-04-24T13:33:33.254 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.254 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.254 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.254 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.757995+0000", 2024-04-24T13:33:33.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4911e-05 2024-04-24T13:33:33.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.758094+0000", 2024-04-24T13:33:33.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8492000000000005e-05 2024-04-24T13:33:33.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.255 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.255 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.758270+0000", 2024-04-24T13:33:33.255 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017639399999999999 2024-04-24T13:33:33.255 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.255 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:33.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.758454+0000", 2024-04-24T13:33:33.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018373599999999999 2024-04-24T13:33:33.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.762442+0000", 2024-04-24T13:33:33.256 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039878429999999996 2024-04-24T13:33:33.256 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.256 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.256 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.256 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.776653+0000", 2024-04-24T13:33:33.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014211457 2024-04-24T13:33:33.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.776731+0000", 2024-04-24T13:33:33.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7625000000000003e-05 2024-04-24T13:33:33.257 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.257 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.257 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.257 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.776791+0000", 2024-04-24T13:33:33.257 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0015000000000001e-05 2024-04-24T13:33:33.258 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.258 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.258 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.258 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.258 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.258 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3107 3.16 e112/103 3:6bf97696:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_22:head v 112'6, mlcod=0'0)", 2024-04-24T13:33:33.258 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.772636+0000", 2024-04-24T13:33:33.258 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4206695409999996, 2024-04-24T13:33:33.258 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025533699999999999, 2024-04-24T13:33:33.258 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.259 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.259 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.259 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.772636+0000", 2024-04-24T13:33:33.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.259 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.259 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.259 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.772636+0000", 2024-04-24T13:33:33.259 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.259 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.772637+0000", 2024-04-24T13:33:33.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5799999999999998e-07 2024-04-24T13:33:33.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.260 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.260 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787782+0000", 2024-04-24T13:33:33.260 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015145608 2024-04-24T13:33:33.260 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.260 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787807+0000", 2024-04-24T13:33:33.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5091000000000001e-05 2024-04-24T13:33:33.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787822+0000", 2024-04-24T13:33:33.261 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4627000000000001e-05 2024-04-24T13:33:33.261 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.261 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.261 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.261 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787900+0000", 2024-04-24T13:33:33.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8496000000000002e-05 2024-04-24T13:33:33.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787921+0000", 2024-04-24T13:33:33.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0718999999999999e-05 2024-04-24T13:33:33.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.262 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.262 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.262 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.798124+0000", 2024-04-24T13:33:33.262 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010203067 2024-04-24T13:33:33.262 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.263 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.263 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.798170+0000", 2024-04-24T13:33:33.263 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5334000000000003e-05 2024-04-24T13:33:33.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.263 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.263 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.263 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.263 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.263 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3121 3.e e112/41 3:70900501:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_36:head v 112'6, mlcod=101'4)", 2024-04-24T13:33:33.263 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.915485+0000", 2024-04-24T13:33:33.263 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.2778206260000005, 2024-04-24T13:33:33.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020805437, 2024-04-24T13:33:33.264 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.264 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.264 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.264 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.264 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.264 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.915485+0000", 2024-04-24T13:33:33.264 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.264 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.264 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.915485+0000", 2024-04-24T13:33:33.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.265 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.265 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.915489+0000", 2024-04-24T13:33:33.265 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.498e-06 2024-04-24T13:33:33.265 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.265 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921279+0000", 2024-04-24T13:33:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057893729999999996 2024-04-24T13:33:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921299+0000", 2024-04-24T13:33:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0117000000000001e-05 2024-04-24T13:33:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.266 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921309+0000", 2024-04-24T13:33:33.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8060000000000006e-06 2024-04-24T13:33:33.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921374+0000", 2024-04-24T13:33:33.267 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5617999999999994e-05 2024-04-24T13:33:33.267 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.267 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.267 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.267 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921400+0000", 2024-04-24T13:33:33.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5479000000000001e-05 2024-04-24T13:33:33.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.936231+0000", 2024-04-24T13:33:33.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014831372000000001 2024-04-24T13:33:33.268 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.268 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.268 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.268 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.936290+0000", 2024-04-24T13:33:33.268 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9174e-05 2024-04-24T13:33:33.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.269 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.269 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.269 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.269 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.269 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3136 3.25 3:a4e0a0f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:33.269 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.073986+0000", 2024-04-24T13:33:33.269 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.1193196900000002, 2024-04-24T13:33:33.269 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029412311, 2024-04-24T13:33:33.270 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.270 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.270 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.270 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.270 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3136 2024-04-24T13:33:33.270 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.270 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.270 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.270 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.073986+0000", 2024-04-24T13:33:33.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.073986+0000", 2024-04-24T13:33:33.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.271 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.271 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.271 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.073988+0000", 2024-04-24T13:33:33.271 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.678e-06 2024-04-24T13:33:33.271 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.075773+0000", 2024-04-24T13:33:33.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017841829999999999 2024-04-24T13:33:33.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.272 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.075797+0000", 2024-04-24T13:33:33.272 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4671000000000001e-05 2024-04-24T13:33:33.272 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.272 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.272 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.075810+0000", 2024-04-24T13:33:33.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2531000000000001e-05 2024-04-24T13:33:33.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.075901+0000", 2024-04-24T13:33:33.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0815000000000004e-05 2024-04-24T13:33:33.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.273 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.273 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.273 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076115+0000", 2024-04-24T13:33:33.273 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000214353 2024-04-24T13:33:33.273 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:33.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076303+0000", 2024-04-24T13:33:33.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187756 2024-04-24T13:33:33.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.274 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.274 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.093042+0000", 2024-04-24T13:33:33.274 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016738940000000001 2024-04-24T13:33:33.274 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.274 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103280+0000", 2024-04-24T13:33:33.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010238515 2024-04-24T13:33:33.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103347+0000", 2024-04-24T13:33:33.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6884999999999994e-05 2024-04-24T13:33:33.275 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.275 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.275 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.275 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103398+0000", 2024-04-24T13:33:33.275 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0983999999999998e-05 2024-04-24T13:33:33.276 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.276 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.276 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.276 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.276 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.276 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3154 3.4 3:21aa15b3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_69:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:33.276 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.268115+0000", 2024-04-24T13:33:33.276 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.9251905460000001, 2024-04-24T13:33:33.276 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016161281999999999, 2024-04-24T13:33:33.276 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.276 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.277 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.277 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.277 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.277 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.277 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3154 2024-04-24T13:33:33.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.277 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.277 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.277 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.277 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.268115+0000", 2024-04-24T13:33:33.277 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.277 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.268115+0000", 2024-04-24T13:33:33.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.278 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.268118+0000", 2024-04-24T13:33:33.278 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9660000000000001e-06 2024-04-24T13:33:33.278 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.278 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.278 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.269997+0000", 2024-04-24T13:33:33.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001879356 2024-04-24T13:33:33.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.270014+0000", 2024-04-24T13:33:33.279 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6872999999999999e-05 2024-04-24T13:33:33.279 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.279 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.279 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.279 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.270022+0000", 2024-04-24T13:33:33.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9880000000000004e-06 2024-04-24T13:33:33.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.270093+0000", 2024-04-24T13:33:33.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0660000000000004e-05 2024-04-24T13:33:33.280 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.280 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.280 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.280 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.270254+0000", 2024-04-24T13:33:33.280 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016106599999999999 2024-04-24T13:33:33.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:33.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.270391+0000", 2024-04-24T13:33:33.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013749500000000001 2024-04-24T13:33:33.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.281 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.281 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.283535+0000", 2024-04-24T13:33:33.281 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013144062 2024-04-24T13:33:33.281 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.281 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.284156+0000", 2024-04-24T13:33:33.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00062105999999999999 2024-04-24T13:33:33.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.282 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.282 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.284223+0000", 2024-04-24T13:33:33.282 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6437000000000001e-05 2024-04-24T13:33:33.282 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.282 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.283 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.283 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.284276+0000", 2024-04-24T13:33:33.283 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3319000000000002e-05 2024-04-24T13:33:33.283 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.283 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.283 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.283 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.283 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.283 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3167 3.0 3:00fbb35f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:33.283 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.423455+0000", 2024-04-24T13:33:33.283 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.769850023, 2024-04-24T13:33:33.284 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021052969000000001, 2024-04-24T13:33:33.284 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.284 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.284 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.284 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.284 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.284 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.284 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3167 2024-04-24T13:33:33.284 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.284 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.284 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.284 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.423455+0000", 2024-04-24T13:33:33.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.423455+0000", 2024-04-24T13:33:33.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.285 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.285 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.285 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.285 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.423458+0000", 2024-04-24T13:33:33.285 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5979999999999999e-06 2024-04-24T13:33:33.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425102+0000", 2024-04-24T13:33:33.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016442900000000001 2024-04-24T13:33:33.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.286 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.286 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425133+0000", 2024-04-24T13:33:33.286 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0815000000000002e-05 2024-04-24T13:33:33.286 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.286 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425147+0000", 2024-04-24T13:33:33.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4071e-05 2024-04-24T13:33:33.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425222+0000", 2024-04-24T13:33:33.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5030000000000005e-05 2024-04-24T13:33:33.287 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.287 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.287 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.287 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425347+0000", 2024-04-24T13:33:33.287 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012445699999999999 2024-04-24T13:33:33.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:33.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425458+0000", 2024-04-24T13:33:33.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011173199999999999 2024-04-24T13:33:33.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.288 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.288 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.288 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.439935+0000", 2024-04-24T13:33:33.288 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01447708 2024-04-24T13:33:33.288 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.444421+0000", 2024-04-24T13:33:33.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044855349999999997 2024-04-24T13:33:33.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.289 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.289 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.289 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.444458+0000", 2024-04-24T13:33:33.289 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7419999999999997e-05 2024-04-24T13:33:33.289 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.290 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.290 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.444508+0000", 2024-04-24T13:33:33.290 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9941000000000002e-05 2024-04-24T13:33:33.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.290 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.290 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.290 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.290 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.290 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3170 3.32 e112/20 3:4d8ff7c2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_85:head v 112'8, mlcod=112'6)", 2024-04-24T13:33:33.290 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.461995+0000", 2024-04-24T13:33:33.291 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.7313105169999998, 2024-04-24T13:33:33.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016352252000000001, 2024-04-24T13:33:33.291 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.291 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.291 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.291 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.291 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.291 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.291 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.461995+0000", 2024-04-24T13:33:33.291 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.461995+0000", 2024-04-24T13:33:33.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.292 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.292 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.292 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.461997+0000", 2024-04-24T13:33:33.292 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.486e-06 2024-04-24T13:33:33.292 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.463704+0000", 2024-04-24T13:33:33.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017070469999999999 2024-04-24T13:33:33.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.293 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.293 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.293 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.463728+0000", 2024-04-24T13:33:33.293 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3147e-05 2024-04-24T13:33:33.293 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.463741+0000", 2024-04-24T13:33:33.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3141e-05 2024-04-24T13:33:33.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.294 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.294 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.463846+0000", 2024-04-24T13:33:33.294 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000105598 2024-04-24T13:33:33.294 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.294 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.463874+0000", 2024-04-24T13:33:33.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7860000000000001e-05 2024-04-24T13:33:33.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.478297+0000", 2024-04-24T13:33:33.295 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014422571 2024-04-24T13:33:33.295 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.295 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.295 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.295 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.478347+0000", 2024-04-24T13:33:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0402000000000003e-05 2024-04-24T13:33:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3171 3.3e 3:7fb57046:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_86:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.470791+0000", 2024-04-24T13:33:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.7225147830000003, 2024-04-24T13:33:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015773964000000001, 2024-04-24T13:33:33.296 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.297 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.297 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.297 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.297 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.297 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.297 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3171 2024-04-24T13:33:33.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.297 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.470791+0000", 2024-04-24T13:33:33.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.470791+0000", 2024-04-24T13:33:33.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.470794+0000", 2024-04-24T13:33:33.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.151e-06 2024-04-24T13:33:33.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.472566+0000", 2024-04-24T13:33:33.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017719540000000001 2024-04-24T13:33:33.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.472597+0000", 2024-04-24T13:33:33.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1418999999999999e-05 2024-04-24T13:33:33.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.472607+0000", 2024-04-24T13:33:33.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7210000000000006e-06 2024-04-24T13:33:33.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.472688+0000", 2024-04-24T13:33:33.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0971999999999997e-05 2024-04-24T13:33:33.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.472870+0000", 2024-04-24T13:33:33.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018249600000000001 2024-04-24T13:33:33.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:33.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.473026+0000", 2024-04-24T13:33:33.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015569800000000001 2024-04-24T13:33:33.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.483718+0000", 2024-04-24T13:33:33.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010692043 2024-04-24T13:33:33.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.486471+0000", 2024-04-24T13:33:33.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0027533359999999999 2024-04-24T13:33:33.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.486526+0000", 2024-04-24T13:33:33.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4367000000000003e-05 2024-04-24T13:33:33.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.303 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.303 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.486565+0000", 2024-04-24T13:33:33.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8807000000000003e-05 2024-04-24T13:33:33.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.303 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.303 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.303 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3179 3.6 e112/20 3:61c16905:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_94:head v 112'13, mlcod=112'11)", 2024-04-24T13:33:33.303 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.556235+0000", 2024-04-24T13:33:33.304 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.6370702179999999, 2024-04-24T13:33:33.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022311758000000001, 2024-04-24T13:33:33.304 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.304 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.304 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.304 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.556235+0000", 2024-04-24T13:33:33.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.556235+0000", 2024-04-24T13:33:33.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.556237+0000", 2024-04-24T13:33:33.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.193e-06 2024-04-24T13:33:33.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557730+0000", 2024-04-24T13:33:33.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001492192 2024-04-24T13:33:33.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557756+0000", 2024-04-24T13:33:33.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6295000000000002e-05 2024-04-24T13:33:33.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557767+0000", 2024-04-24T13:33:33.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1554e-05 2024-04-24T13:33:33.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557843+0000", 2024-04-24T13:33:33.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5180999999999997e-05 2024-04-24T13:33:33.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557870+0000", 2024-04-24T13:33:33.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7158e-05 2024-04-24T13:33:33.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578507+0000", 2024-04-24T13:33:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020637061000000002 2024-04-24T13:33:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578547+0000", 2024-04-24T13:33:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0123999999999997e-05 2024-04-24T13:33:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3180 3.19 3:9b7f2cf0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_95:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.563827+0000", 2024-04-24T13:33:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.629477981, 2024-04-24T13:33:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016523392000000001, 2024-04-24T13:33:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.309 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3180 2024-04-24T13:33:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.563827+0000", 2024-04-24T13:33:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.563827+0000", 2024-04-24T13:33:33.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.563830+0000", 2024-04-24T13:33:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.835e-06 2024-04-24T13:33:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.565493+0000", 2024-04-24T13:33:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001662445 2024-04-24T13:33:33.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.565526+0000", 2024-04-24T13:33:33.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3577000000000001e-05 2024-04-24T13:33:33.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.565542+0000", 2024-04-24T13:33:33.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5243e-05 2024-04-24T13:33:33.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.565636+0000", 2024-04-24T13:33:33.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4934999999999998e-05 2024-04-24T13:33:33.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.565816+0000", 2024-04-24T13:33:33.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017938200000000001 2024-04-24T13:33:33.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:33.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.565944+0000", 2024-04-24T13:33:33.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000128563 2024-04-24T13:33:33.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.579592+0000", 2024-04-24T13:33:33.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013647533 2024-04-24T13:33:33.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.580248+0000", 2024-04-24T13:33:33.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00065608799999999998 2024-04-24T13:33:33.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.580310+0000", 2024-04-24T13:33:33.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.2429999999999997e-05 2024-04-24T13:33:33.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.580351+0000", 2024-04-24T13:33:33.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0361000000000002e-05 2024-04-24T13:33:33.315 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.315 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.316 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.316 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3395 3.31 3:8fcdf07d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_293:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:33.316 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.439317+0000", 2024-04-24T13:33:33.316 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.75398809499999997, 2024-04-24T13:33:33.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025892121000000001, 2024-04-24T13:33:33.316 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.316 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.316 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.316 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.316 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.316 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.317 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3395 2024-04-24T13:33:33.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.317 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.439317+0000", 2024-04-24T13:33:33.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.439317+0000", 2024-04-24T13:33:33.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.439320+0000", 2024-04-24T13:33:33.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.655e-06 2024-04-24T13:33:33.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441558+0000", 2024-04-24T13:33:33.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022384409999999999 2024-04-24T13:33:33.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441583+0000", 2024-04-24T13:33:33.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4207e-05 2024-04-24T13:33:33.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441594+0000", 2024-04-24T13:33:33.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1066e-05 2024-04-24T13:33:33.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441680+0000", 2024-04-24T13:33:33.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6247000000000003e-05 2024-04-24T13:33:33.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441875+0000", 2024-04-24T13:33:33.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019484600000000001 2024-04-24T13:33:33.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:33.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.442055+0000", 2024-04-24T13:33:33.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000180578 2024-04-24T13:33:33.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.449452+0000", 2024-04-24T13:33:33.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073968510000000003 2024-04-24T13:33:33.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.465053+0000", 2024-04-24T13:33:33.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015601014999999999 2024-04-24T13:33:33.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.465148+0000", 2024-04-24T13:33:33.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4537000000000006e-05 2024-04-24T13:33:33.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.465209+0000", 2024-04-24T13:33:33.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1678000000000001e-05 2024-04-24T13:33:33.322 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.323 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.323 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.323 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3409 3.0 3:029e382b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_307:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:33.323 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.587209+0000", 2024-04-24T13:33:33.323 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.60609656099999998, 2024-04-24T13:33:33.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016477601000000001, 2024-04-24T13:33:33.323 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.323 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.324 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.324 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.324 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.324 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.324 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3409 2024-04-24T13:33:33.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.324 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.587209+0000", 2024-04-24T13:33:33.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.587209+0000", 2024-04-24T13:33:33.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.587212+0000", 2024-04-24T13:33:33.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.056e-06 2024-04-24T13:33:33.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.589447+0000", 2024-04-24T13:33:33.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022355370000000001 2024-04-24T13:33:33.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.589469+0000", 2024-04-24T13:33:33.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1058000000000001e-05 2024-04-24T13:33:33.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.589482+0000", 2024-04-24T13:33:33.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3451999999999999e-05 2024-04-24T13:33:33.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.589570+0000", 2024-04-24T13:33:33.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7788999999999996e-05 2024-04-24T13:33:33.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.589723+0000", 2024-04-24T13:33:33.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152838 2024-04-24T13:33:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.589841+0000", 2024-04-24T13:33:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011812200000000001 2024-04-24T13:33:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.602686+0000", 2024-04-24T13:33:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012845427 2024-04-24T13:33:33.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.603551+0000", 2024-04-24T13:33:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00086487499999999998 2024-04-24T13:33:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.603618+0000", 2024-04-24T13:33:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7327000000000001e-05 2024-04-24T13:33:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.603686+0000", 2024-04-24T13:33:33.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8120000000000005e-05 2024-04-24T13:33:33.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.330 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.330 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.330 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:33.332 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:33:33.332 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:33.329+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:33.372 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:33:33.451 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:33.450+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:33.527 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:33.527 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:33.527 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:33.527 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:33.534 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:33.533+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:33.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:33:33.635 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:33.633+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:33.736 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:33.733+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:33.739 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:33.740 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:33.740 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:33.740 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:33.740 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:33.759 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:33:33.836 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:33.833+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:33.901 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:33.901 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:33.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:33.902 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:33.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.902 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2206 3.f 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:33.902 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:33.902 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 65.608242172000004, 2024-04-24T13:33:33.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028291495999999999, 2024-04-24T13:33:33.902 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.902 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.902 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.902 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.902 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.902 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.902 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2206 2024-04-24T13:33:33.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.903 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:33.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:33.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290398+0000", 2024-04-24T13:33:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000001e-06 2024-04-24T13:33:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294671+0000", 2024-04-24T13:33:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042724390000000003 2024-04-24T13:33:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294711+0000", 2024-04-24T13:33:33.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0376000000000001e-05 2024-04-24T13:33:33.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294730+0000", 2024-04-24T13:33:33.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8607e-05 2024-04-24T13:33:33.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294856+0000", 2024-04-24T13:33:33.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126651 2024-04-24T13:33:33.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295125+0000", 2024-04-24T13:33:33.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026840700000000002 2024-04-24T13:33:33.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:33.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295349+0000", 2024-04-24T13:33:33.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022454699999999999 2024-04-24T13:33:33.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307240+0000", 2024-04-24T13:33:33.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011891048 2024-04-24T13:33:33.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318593+0000", 2024-04-24T13:33:33.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011352777999999999 2024-04-24T13:33:33.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318652+0000", 2024-04-24T13:33:33.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8677000000000001e-05 2024-04-24T13:33:33.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318686+0000", 2024-04-24T13:33:33.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4616000000000002e-05 2024-04-24T13:33:33.909 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.909 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.909 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.909 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2209 3.14 3:287cf44b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:33.909 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:33.909 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 65.562938012000004, 2024-04-24T13:33:33.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020682494999999999, 2024-04-24T13:33:33.909 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.910 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.910 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.910 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2209 2024-04-24T13:33:33.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.910 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:33.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335699+0000", 2024-04-24T13:33:33.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.335702+0000", 2024-04-24T13:33:33.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0139999999999999e-06 2024-04-24T13:33:33.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339081+0000", 2024-04-24T13:33:33.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003378664 2024-04-24T13:33:33.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339119+0000", 2024-04-24T13:33:33.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8355999999999997e-05 2024-04-24T13:33:33.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339138+0000", 2024-04-24T13:33:33.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8546000000000002e-05 2024-04-24T13:33:33.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339268+0000", 2024-04-24T13:33:33.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013028599999999999 2024-04-24T13:33:33.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339503+0000", 2024-04-24T13:33:33.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023542699999999999 2024-04-24T13:33:33.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:33.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.339734+0000", 2024-04-24T13:33:33.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00023122 2024-04-24T13:33:33.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.348300+0000", 2024-04-24T13:33:33.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085659870000000006 2024-04-24T13:33:33.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356108+0000", 2024-04-24T13:33:33.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078075109999999996 2024-04-24T13:33:33.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356259+0000", 2024-04-24T13:33:33.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015104800000000001 2024-04-24T13:33:33.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356381+0000", 2024-04-24T13:33:33.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012243599999999999 2024-04-24T13:33:33.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.916 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.916 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2669 3.21 3:86a0e0c3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:33.916 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:33.916 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.696311513000001, 2024-04-24T13:33:33.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020962138000000002, 2024-04-24T13:33:33.916 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.917 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.917 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2669 2024-04-24T13:33:33.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.917 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:33.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:33.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202328+0000", 2024-04-24T13:33:33.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-06 2024-04-24T13:33:33.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204239+0000", 2024-04-24T13:33:33.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019104409999999999 2024-04-24T13:33:33.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204265+0000", 2024-04-24T13:33:33.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6054000000000002e-05 2024-04-24T13:33:33.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204279+0000", 2024-04-24T13:33:33.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3654e-05 2024-04-24T13:33:33.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204361+0000", 2024-04-24T13:33:33.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2522999999999996e-05 2024-04-24T13:33:33.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204523+0000", 2024-04-24T13:33:33.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000162332 2024-04-24T13:33:33.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:33.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204661+0000", 2024-04-24T13:33:33.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013798200000000001 2024-04-24T13:33:33.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.210336+0000", 2024-04-24T13:33:33.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056743339999999996 2024-04-24T13:33:33.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223107+0000", 2024-04-24T13:33:33.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012771714999999999 2024-04-24T13:33:33.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223228+0000", 2024-04-24T13:33:33.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012061300000000001 2024-04-24T13:33:33.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223288+0000", 2024-04-24T13:33:33.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9537999999999998e-05 2024-04-24T13:33:33.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.924 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.924 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.924 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2710 3.3b 3:ddce91ac:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:33.924 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:33.924 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.386509105000002, 2024-04-24T13:33:33.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026438756000000001, 2024-04-24T13:33:33.924 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.924 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.925 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.925 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.925 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.925 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.925 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2710 2024-04-24T13:33:33.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.925 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:33.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:33.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512131+0000", 2024-04-24T13:33:33.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0130000000000002e-06 2024-04-24T13:33:33.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514363+0000", 2024-04-24T13:33:33.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022325940000000001 2024-04-24T13:33:33.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514394+0000", 2024-04-24T13:33:33.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0144000000000001e-05 2024-04-24T13:33:33.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514409+0000", 2024-04-24T13:33:33.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5786000000000001e-05 2024-04-24T13:33:33.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514497+0000", 2024-04-24T13:33:33.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7876999999999999e-05 2024-04-24T13:33:33.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514670+0000", 2024-04-24T13:33:33.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000173096 2024-04-24T13:33:33.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:33.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514768+0000", 2024-04-24T13:33:33.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8089000000000002e-05 2024-04-24T13:33:33.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.523354+0000", 2024-04-24T13:33:33.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085854190000000004 2024-04-24T13:33:33.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538483+0000", 2024-04-24T13:33:33.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015128922 2024-04-24T13:33:33.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538527+0000", 2024-04-24T13:33:33.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3835999999999998e-05 2024-04-24T13:33:33.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538567+0000", 2024-04-24T13:33:33.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.998e-05 2024-04-24T13:33:33.931 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.931 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.931 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.931 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2808 3.2e 3:7441f999:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:33.931 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:33.931 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.367274404, 2024-04-24T13:33:33.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021413788, 2024-04-24T13:33:33.932 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.932 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.932 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.932 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.932 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2808 2024-04-24T13:33:33.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.932 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:33.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:33.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531366+0000", 2024-04-24T13:33:33.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1089999999999998e-06 2024-04-24T13:33:33.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533059+0000", 2024-04-24T13:33:33.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001693186 2024-04-24T13:33:33.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533088+0000", 2024-04-24T13:33:33.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9470000000000001e-05 2024-04-24T13:33:33.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533100+0000", 2024-04-24T13:33:33.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1979e-05 2024-04-24T13:33:33.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533176+0000", 2024-04-24T13:33:33.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5691000000000004e-05 2024-04-24T13:33:33.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533334+0000", 2024-04-24T13:33:33.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015822199999999999 2024-04-24T13:33:33.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:33.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533513+0000", 2024-04-24T13:33:33.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178846 2024-04-24T13:33:33.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.546303+0000", 2024-04-24T13:33:33.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012790331 2024-04-24T13:33:33.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552696+0000", 2024-04-24T13:33:33.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063923169999999998 2024-04-24T13:33:33.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552741+0000", 2024-04-24T13:33:33.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126999999999997e-05 2024-04-24T13:33:33.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552776+0000", 2024-04-24T13:33:33.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5509999999999997e-05 2024-04-24T13:33:33.939 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.939 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.939 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.940 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3094 3.14 3:29338048:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:33.940 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:33.940 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.3022819319999996, 2024-04-24T13:33:33.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022112211, 2024-04-24T13:33:33.940 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.940 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.940 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.940 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3094 2024-04-24T13:33:33.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.941 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:33.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:33.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596358+0000", 2024-04-24T13:33:33.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6560000000000001e-06 2024-04-24T13:33:33.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598612+0000", 2024-04-24T13:33:33.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022539050000000001 2024-04-24T13:33:33.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598639+0000", 2024-04-24T13:33:33.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7767e-05 2024-04-24T13:33:33.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598651+0000", 2024-04-24T13:33:33.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:33:33.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598735+0000", 2024-04-24T13:33:33.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4176000000000002e-05 2024-04-24T13:33:33.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598928+0000", 2024-04-24T13:33:33.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019318199999999999 2024-04-24T13:33:33.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:33.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.599089+0000", 2024-04-24T13:33:33.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016078899999999999 2024-04-24T13:33:33.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.612538+0000", 2024-04-24T13:33:33.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013449081999999999 2024-04-24T13:33:33.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618346+0000", 2024-04-24T13:33:33.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058079799999999999 2024-04-24T13:33:33.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618413+0000", 2024-04-24T13:33:33.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7101999999999996e-05 2024-04-24T13:33:33.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618467+0000", 2024-04-24T13:33:33.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4295000000000001e-05 2024-04-24T13:33:33.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.946 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.947 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3128 3.1f 3:f8849f48:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:33.947 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:33.947 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.911897948, 2024-04-24T13:33:33.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027867126999999998, 2024-04-24T13:33:33.947 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.947 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.947 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.947 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.947 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3128 2024-04-24T13:33:33.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.948 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:33.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:33.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986743+0000", 2024-04-24T13:33:33.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.495e-06 2024-04-24T13:33:33.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988482+0000", 2024-04-24T13:33:33.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001739237 2024-04-24T13:33:33.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988510+0000", 2024-04-24T13:33:33.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8343999999999998e-05 2024-04-24T13:33:33.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988525+0000", 2024-04-24T13:33:33.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5384999999999999e-05 2024-04-24T13:33:33.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988630+0000", 2024-04-24T13:33:33.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010412 2024-04-24T13:33:33.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988808+0000", 2024-04-24T13:33:33.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178123 2024-04-24T13:33:33.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:33.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988956+0000", 2024-04-24T13:33:33.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014802399999999999 2024-04-24T13:33:33.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.995102+0000", 2024-04-24T13:33:33.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061461179999999999 2024-04-24T13:33:33.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014480+0000", 2024-04-24T13:33:33.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019378581999999998 2024-04-24T13:33:33.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014541+0000", 2024-04-24T13:33:33.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1007000000000001e-05 2024-04-24T13:33:33.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014606+0000", 2024-04-24T13:33:33.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4691999999999997e-05 2024-04-24T13:33:33.954 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.954 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.954 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.955 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3130 3.f 3:f22fdcf5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:33.955 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:33.955 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.8887164930000004, 2024-04-24T13:33:33.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021419780999999999, 2024-04-24T13:33:33.955 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.955 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.955 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.955 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.955 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.955 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3130 2024-04-24T13:33:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009923+0000", 2024-04-24T13:33:33.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5890000000000001e-06 2024-04-24T13:33:33.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011652+0000", 2024-04-24T13:33:33.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017287419999999999 2024-04-24T13:33:33.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011692+0000", 2024-04-24T13:33:33.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0346000000000003e-05 2024-04-24T13:33:33.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011707+0000", 2024-04-24T13:33:33.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5068e-05 2024-04-24T13:33:33.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011805+0000", 2024-04-24T13:33:33.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7935000000000003e-05 2024-04-24T13:33:33.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011984+0000", 2024-04-24T13:33:33.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178629 2024-04-24T13:33:33.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:33.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.012159+0000", 2024-04-24T13:33:33.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017566500000000001 2024-04-24T13:33:33.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.025987+0000", 2024-04-24T13:33:33.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013827409000000001 2024-04-24T13:33:33.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031173+0000", 2024-04-24T13:33:33.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051865590000000003 2024-04-24T13:33:33.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031263+0000", 2024-04-24T13:33:33.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9598000000000005e-05 2024-04-24T13:33:33.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031340+0000", 2024-04-24T13:33:33.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7241000000000001e-05 2024-04-24T13:33:33.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.961 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.962 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3406 3.3b 3:dffc7604:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:33.962 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:33.962 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.3432710839999999, 2024-04-24T13:33:33.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020810539999999999, 2024-04-24T13:33:33.962 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.962 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.962 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.962 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.962 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.962 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.963 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3406 2024-04-24T13:33:33.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.963 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:33.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:33.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555369+0000", 2024-04-24T13:33:33.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.672e-06 2024-04-24T13:33:33.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557249+0000", 2024-04-24T13:33:33.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001880086 2024-04-24T13:33:33.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557282+0000", 2024-04-24T13:33:33.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3065000000000003e-05 2024-04-24T13:33:33.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557297+0000", 2024-04-24T13:33:33.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4990999999999999e-05 2024-04-24T13:33:33.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557389+0000", 2024-04-24T13:33:33.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2447000000000004e-05 2024-04-24T13:33:33.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557525+0000", 2024-04-24T13:33:33.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135821 2024-04-24T13:33:33.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:33.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557677+0000", 2024-04-24T13:33:33.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015188699999999999 2024-04-24T13:33:33.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.564715+0000", 2024-04-24T13:33:33.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070385329999999996 2024-04-24T13:33:33.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576037+0000", 2024-04-24T13:33:33.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011321721999999999 2024-04-24T13:33:33.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576112+0000", 2024-04-24T13:33:33.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4924000000000003e-05 2024-04-24T13:33:33.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576176+0000", 2024-04-24T13:33:33.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4392000000000003e-05 2024-04-24T13:33:33.969 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.969 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.969 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.969 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3426 3.f 3:f3517f93:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_324:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:33.970 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:33.970 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.1047844609999999, 2024-04-24T13:33:33.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024699635000000001, 2024-04-24T13:33:33.970 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.970 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.970 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.970 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.970 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.970 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.970 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3426 2024-04-24T13:33:33.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.971 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:33.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:33.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793855+0000", 2024-04-24T13:33:33.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4669999999999998e-06 2024-04-24T13:33:33.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796548+0000", 2024-04-24T13:33:33.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026926369999999999 2024-04-24T13:33:33.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796572+0000", 2024-04-24T13:33:33.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4456000000000001e-05 2024-04-24T13:33:33.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796586+0000", 2024-04-24T13:33:33.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3937000000000001e-05 2024-04-24T13:33:33.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796690+0000", 2024-04-24T13:33:33.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104226 2024-04-24T13:33:33.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796877+0000", 2024-04-24T13:33:33.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018668299999999999 2024-04-24T13:33:33.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:33.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.797048+0000", 2024-04-24T13:33:33.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017070599999999999 2024-04-24T13:33:33.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.817921+0000", 2024-04-24T13:33:33.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020873198999999999 2024-04-24T13:33:33.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818393+0000", 2024-04-24T13:33:33.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000472459 2024-04-24T13:33:33.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818475+0000", 2024-04-24T13:33:33.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1403999999999995e-05 2024-04-24T13:33:33.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818552+0000", 2024-04-24T13:33:33.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7460999999999996e-05 2024-04-24T13:33:33.976 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.977 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.977 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.977 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3427 3.21 3:854a3dc6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_325:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:33.977 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:33.977 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.094152322, 2024-04-24T13:33:33.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023613657999999999, 2024-04-24T13:33:33.977 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.977 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.978 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.978 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.978 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.978 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.978 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3427 2024-04-24T13:33:33.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.978 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:33.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:33.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804488+0000", 2024-04-24T13:33:33.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.23e-06 2024-04-24T13:33:33.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807535+0000", 2024-04-24T13:33:33.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030472709999999998 2024-04-24T13:33:33.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807563+0000", 2024-04-24T13:33:33.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8087999999999999e-05 2024-04-24T13:33:33.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807579+0000", 2024-04-24T13:33:33.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5732000000000001e-05 2024-04-24T13:33:33.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807691+0000", 2024-04-24T13:33:33.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111894 2024-04-24T13:33:33.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807850+0000", 2024-04-24T13:33:33.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015951999999999999 2024-04-24T13:33:33.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:33.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.808005+0000", 2024-04-24T13:33:33.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154487 2024-04-24T13:33:33.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.823418+0000", 2024-04-24T13:33:33.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015413526 2024-04-24T13:33:33.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828003+0000", 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045842299999999999 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828048+0000", 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5504999999999999e-05 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828098+0000", 2024-04-24T13:33:33.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0175e-05 2024-04-24T13:33:33.988 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.988 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.988 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.988 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3430 3.3b 3:de51c163:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:33.988 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:33.988 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0609274740000001, 2024-04-24T13:33:33.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025624112000000001, 2024-04-24T13:33:33.988 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.988 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.988 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.989 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:33.989 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:33.989 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:33.989 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3430 2024-04-24T13:33:33.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.989 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:33.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:33.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837713+0000", 2024-04-24T13:33:33.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6509999999999999e-06 2024-04-24T13:33:33.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839548+0000", 2024-04-24T13:33:33.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001834521 2024-04-24T13:33:33.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839577+0000", 2024-04-24T13:33:33.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8850999999999999e-05 2024-04-24T13:33:33.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839611+0000", 2024-04-24T13:33:33.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4140000000000002e-05 2024-04-24T13:33:33.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839718+0000", 2024-04-24T13:33:33.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107534 2024-04-24T13:33:33.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:33.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839883+0000", 2024-04-24T13:33:33.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016485999999999999 2024-04-24T13:33:33.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:33.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.840056+0000", 2024-04-24T13:33:33.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017321200000000001 2024-04-24T13:33:33.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:33.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849455+0000", 2024-04-24T13:33:33.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093988590000000007 2024-04-24T13:33:33.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.993 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:33.993 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863165+0000", 2024-04-24T13:33:33.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013710178 2024-04-24T13:33:33.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:33.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863263+0000", 2024-04-24T13:33:33.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7559000000000006e-05 2024-04-24T13:33:33.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:33.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863334+0000", 2024-04-24T13:33:33.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0747000000000006e-05 2024-04-24T13:33:33.994 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.995 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:33.995 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:33.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.995 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3443 3.a e113/48 3:53aaab58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_341:head v 113'18, mlcod=113'16)", 2024-04-24T13:33:33.995 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:33.995 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.92298038900000001, 2024-04-24T13:33:33.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022399639999999998, 2024-04-24T13:33:33.995 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:33.995 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:33.995 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:33.995 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:33.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:33.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:33.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:33.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:33.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:33.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:33.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975668+0000", 2024-04-24T13:33:33.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.113e-05 2024-04-24T13:33:33.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:33.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979725+0000", 2024-04-24T13:33:33.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040574219999999998 2024-04-24T13:33:33.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:33.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979759+0000", 2024-04-24T13:33:33.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4362000000000001e-05 2024-04-24T13:33:33.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:33.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979774+0000", 2024-04-24T13:33:33.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4935e-05 2024-04-24T13:33:33.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:33.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:33.999 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979871+0000", 2024-04-24T13:33:33.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.658e-05 2024-04-24T13:33:33.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:33.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979901+0000", 2024-04-24T13:33:34.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-05 2024-04-24T13:33:34.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.997990+0000", 2024-04-24T13:33:34.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018089483 2024-04-24T13:33:34.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.998056+0000", 2024-04-24T13:33:34.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6208e-05 2024-04-24T13:33:34.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.001 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.001 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.001 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3458 3.f 3:f34a4471:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:34.001 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:34.002 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.77846405600000002, 2024-04-24T13:33:34.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026075494000000001, 2024-04-24T13:33:34.002 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.002 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.002 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.002 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.002 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.002 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.002 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3458 2024-04-24T13:33:34.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.002 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:34.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:34.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120175+0000", 2024-04-24T13:33:34.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5220000000000002e-06 2024-04-24T13:33:34.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121620+0000", 2024-04-24T13:33:34.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014442280000000001 2024-04-24T13:33:34.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121646+0000", 2024-04-24T13:33:34.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6424999999999999e-05 2024-04-24T13:33:34.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121659+0000", 2024-04-24T13:33:34.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:33:34.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121754+0000", 2024-04-24T13:33:34.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4388999999999994e-05 2024-04-24T13:33:34.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121968+0000", 2024-04-24T13:33:34.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021460199999999999 2024-04-24T13:33:34.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:34.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.122165+0000", 2024-04-24T13:33:34.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019710999999999999 2024-04-24T13:33:34.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.141554+0000", 2024-04-24T13:33:34.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019388847000000001 2024-04-24T13:33:34.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146083+0000", 2024-04-24T13:33:34.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045284469999999997 2024-04-24T13:33:34.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146129+0000", 2024-04-24T13:33:34.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6257000000000001e-05 2024-04-24T13:33:34.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146248+0000", 2024-04-24T13:33:34.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011958100000000001 2024-04-24T13:33:34.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.009 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.009 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3460 3.a e113/48 3:5102140b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_358:head v 113'19, mlcod=113'17)", 2024-04-24T13:33:34.009 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:34.009 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.75245003300000002, 2024-04-24T13:33:34.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025573478, 2024-04-24T13:33:34.009 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.009 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.010 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:34.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:34.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146188+0000", 2024-04-24T13:33:34.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.02e-07 2024-04-24T13:33:34.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150270+0000", 2024-04-24T13:33:34.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004082011 2024-04-24T13:33:34.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150302+0000", 2024-04-24T13:33:34.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2570999999999997e-05 2024-04-24T13:33:34.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150319+0000", 2024-04-24T13:33:34.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6843000000000001e-05 2024-04-24T13:33:34.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150404+0000", 2024-04-24T13:33:34.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4538999999999998e-05 2024-04-24T13:33:34.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150432+0000", 2024-04-24T13:33:34.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8098000000000001e-05 2024-04-24T13:33:34.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.170266+0000", 2024-04-24T13:33:34.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019834497 2024-04-24T13:33:34.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171760+0000", 2024-04-24T13:33:34.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001494017 2024-04-24T13:33:34.014 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.014 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.014 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.014 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3461 3.3b 3:dfe1b3a0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_359:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:34.014 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:34.014 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.74974212699999998, 2024-04-24T13:33:34.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024256994, 2024-04-24T13:33:34.015 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.015 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.015 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.015 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.015 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.015 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.015 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3461 2024-04-24T13:33:34.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.015 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.015 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.015 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:34.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:34.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148898+0000", 2024-04-24T13:33:34.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6970000000000002e-06 2024-04-24T13:33:34.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150603+0000", 2024-04-24T13:33:34.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017049809999999999 2024-04-24T13:33:34.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150615+0000", 2024-04-24T13:33:34.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2368000000000001e-05 2024-04-24T13:33:34.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150620+0000", 2024-04-24T13:33:34.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5210000000000002e-06 2024-04-24T13:33:34.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150671+0000", 2024-04-24T13:33:34.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0315000000000002e-05 2024-04-24T13:33:34.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150844+0000", 2024-04-24T13:33:34.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017304399999999999 2024-04-24T13:33:34.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:34.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.151009+0000", 2024-04-24T13:33:34.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016544800000000001 2024-04-24T13:33:34.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171479+0000", 2024-04-24T13:33:34.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020469355000000002 2024-04-24T13:33:34.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173035+0000", 2024-04-24T13:33:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001556857 2024-04-24T13:33:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173096+0000", 2024-04-24T13:33:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0285999999999998e-05 2024-04-24T13:33:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173152+0000", 2024-04-24T13:33:34.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6122000000000002e-05 2024-04-24T13:33:34.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.022 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.022 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.022 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3491 3.14 3:2a9aeaa0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_389:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:34.022 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:34.022 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.43599022300000001, 2024-04-24T13:33:34.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029663012999999998, 2024-04-24T13:33:34.022 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.022 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.023 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.023 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.023 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3491 2024-04-24T13:33:34.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.023 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:34.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:34.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462649+0000", 2024-04-24T13:33:34.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.65e-06 2024-04-24T13:33:34.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464539+0000", 2024-04-24T13:33:34.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001889527 2024-04-24T13:33:34.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464565+0000", 2024-04-24T13:33:34.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6061999999999999e-05 2024-04-24T13:33:34.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.025 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.025 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464580+0000", 2024-04-24T13:33:34.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5273000000000001e-05 2024-04-24T13:33:34.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464678+0000", 2024-04-24T13:33:34.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7639000000000005e-05 2024-04-24T13:33:34.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464899+0000", 2024-04-24T13:33:34.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000220638 2024-04-24T13:33:34.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:34.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.465088+0000", 2024-04-24T13:33:34.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018922700000000001 2024-04-24T13:33:34.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.478519+0000", 2024-04-24T13:33:34.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013430884000000001 2024-04-24T13:33:34.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492184+0000", 2024-04-24T13:33:34.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013665797 2024-04-24T13:33:34.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492260+0000", 2024-04-24T13:33:34.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6038999999999995e-05 2024-04-24T13:33:34.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492310+0000", 2024-04-24T13:33:34.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9277000000000003e-05 2024-04-24T13:33:34.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.029 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.029 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.029 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3514 3.a e114/48 3:5344e333:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_412:head v 114'23, mlcod=114'21)", 2024-04-24T13:33:34.029 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:34.029 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.19691850799999999, 2024-04-24T13:33:34.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021739380999999999, 2024-04-24T13:33:34.029 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:34.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701734+0000", 2024-04-24T13:33:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5807999999999998e-05 2024-04-24T13:33:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705769+0000", 2024-04-24T13:33:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040343660000000002 2024-04-24T13:33:34.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705801+0000", 2024-04-24T13:33:34.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2406000000000001e-05 2024-04-24T13:33:34.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705816+0000", 2024-04-24T13:33:34.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4537e-05 2024-04-24T13:33:34.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705925+0000", 2024-04-24T13:33:34.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109114 2024-04-24T13:33:34.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705959+0000", 2024-04-24T13:33:34.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4239999999999997e-05 2024-04-24T13:33:34.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723399+0000", 2024-04-24T13:33:34.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017439748000000001 2024-04-24T13:33:34.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723458+0000", 2024-04-24T13:33:34.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9162e-05 2024-04-24T13:33:34.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.035 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.035 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.035 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3525 3.f 3:f35962b2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_423:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:34.035 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:34.035 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.091419621000000006, 2024-04-24T13:33:34.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028712260999999999, 2024-04-24T13:33:34.035 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.036 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.036 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.036 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.036 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.036 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.036 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3525 2024-04-24T13:33:34.036 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.036 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:34.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.037 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.037 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.037 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.037 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:34.037 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807221+0000", 2024-04-24T13:33:34.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7529999999999999e-06 2024-04-24T13:33:34.038 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.038 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.038 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.038 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813425+0000", 2024-04-24T13:33:34.038 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062037280000000004 2024-04-24T13:33:34.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813449+0000", 2024-04-24T13:33:34.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:33:34.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.039 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.039 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.039 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813462+0000", 2024-04-24T13:33:34.039 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200999999999999e-05 2024-04-24T13:33:34.039 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813554+0000", 2024-04-24T13:33:34.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2369999999999998e-05 2024-04-24T13:33:34.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.040 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813730+0000", 2024-04-24T13:33:34.040 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017569800000000001 2024-04-24T13:33:34.040 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.040 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.040 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:34.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813908+0000", 2024-04-24T13:33:34.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178219 2024-04-24T13:33:34.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.826992+0000", 2024-04-24T13:33:34.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013083567000000001 2024-04-24T13:33:34.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.041 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.041 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.041 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835795+0000", 2024-04-24T13:33:34.041 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088026630000000005 2024-04-24T13:33:34.041 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835870+0000", 2024-04-24T13:33:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5649999999999996e-05 2024-04-24T13:33:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835930+0000", 2024-04-24T13:33:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9318999999999999e-05 2024-04-24T13:33:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.042 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.043 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.043 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.043 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3528 3.3b 3:dc395008:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_426:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:34.043 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:34.043 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.063075555000000005, 2024-04-24T13:33:34.043 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024383452999999999, 2024-04-24T13:33:34.043 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.043 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.043 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.043 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.044 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3528 2024-04-24T13:33:34.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.044 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:34.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.044 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.044 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.044 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:34.044 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.044 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835564+0000", 2024-04-24T13:33:34.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7369999999999998e-06 2024-04-24T13:33:34.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.045 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837236+0000", 2024-04-24T13:33:34.045 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001671964 2024-04-24T13:33:34.045 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.045 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.045 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837275+0000", 2024-04-24T13:33:34.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8760000000000002e-05 2024-04-24T13:33:34.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837292+0000", 2024-04-24T13:33:34.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6884999999999998e-05 2024-04-24T13:33:34.046 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.046 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.046 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.046 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837382+0000", 2024-04-24T13:33:34.046 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9809999999999996e-05 2024-04-24T13:33:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837556+0000", 2024-04-24T13:33:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174103 2024-04-24T13:33:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837728+0000", 2024-04-24T13:33:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017202600000000001 2024-04-24T13:33:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.047 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859492+0000", 2024-04-24T13:33:34.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021764644999999999 2024-04-24T13:33:34.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859714+0000", 2024-04-24T13:33:34.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221809 2024-04-24T13:33:34.048 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.048 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.048 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.048 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859857+0000", 2024-04-24T13:33:34.048 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142738 2024-04-24T13:33:34.049 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.049 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.049 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.049 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859945+0000", 2024-04-24T13:33:34.049 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7975999999999999e-05 2024-04-24T13:33:34.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.049 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.049 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.049 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.049 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:34.051 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:33:34.052 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:34.049+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:34.152 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:34.149+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:34.190 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:34.190 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:34.190 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:34.190 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:34.209 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:33:34.255 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:34.254+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:34.353 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:34.349+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:34.360 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:34.360 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:34.360 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:34.360 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:34.360 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:34.379 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:33:34.388 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:33:34.455 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:34.453+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:34.555 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:34.554+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:34.580 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:34.580 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:34.600 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:34.600 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:34.611 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:34.611 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:34.611 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:34.611 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:34.611 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.611 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2207 3.38 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:34.611 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:34.611 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 66.306909860999994, 2024-04-24T13:33:34.612 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022686873999999999, 2024-04-24T13:33:34.612 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.612 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.612 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.612 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.612 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.612 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.612 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2207 2024-04-24T13:33:34.612 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.612 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.612 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.612 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.612 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:34.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:34.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.613 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.613 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302499+0000", 2024-04-24T13:33:34.613 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-04-24T13:33:34.613 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.613 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307861+0000", 2024-04-24T13:33:34.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053622089999999997 2024-04-24T13:33:34.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307899+0000", 2024-04-24T13:33:34.614 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978999999999997e-05 2024-04-24T13:33:34.614 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.614 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.614 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.614 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307917+0000", 2024-04-24T13:33:34.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8576999999999998e-05 2024-04-24T13:33:34.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308018+0000", 2024-04-24T13:33:34.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010080499999999999 2024-04-24T13:33:34.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.615 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.615 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308202+0000", 2024-04-24T13:33:34.615 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000183628 2024-04-24T13:33:34.615 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.615 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:34.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308352+0000", 2024-04-24T13:33:34.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149806 2024-04-24T13:33:34.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318520+0000", 2024-04-24T13:33:34.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010168744 2024-04-24T13:33:34.616 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.616 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.616 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.616 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.324908+0000", 2024-04-24T13:33:34.616 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063874739999999998 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325063+0000", 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155131 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325182+0000", 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011915499999999999 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.617 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 66.283315148, 2024-04-24T13:33:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:33:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:33:34.618 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:33:34.619 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.620 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:33:34.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:33:34.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:33:34.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:33:34.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.621 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.621 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:33:34.621 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:33:34.621 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.621 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:33:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:33:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:33:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:33:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:33:34.622 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:33:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:33:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:33:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:33:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:33:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.623 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.624 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.624 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.624 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:34.624 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:34.624 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 66.138259293999994, 2024-04-24T13:33:34.624 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:33:34.624 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.624 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.624 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.624 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.624 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.624 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.624 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:33:34.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.625 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:34.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.625 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.625 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:34.625 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.625 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.625 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:33:34.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:33:34.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:33:34.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:33:34.626 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.626 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.626 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.626 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:33:34.626 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.627 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:33:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:33:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:33:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:33:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:33:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:33:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.628 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.629 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.630 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.630 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.630 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.630 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2242 3.b 3:d16b554f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:34.630 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:34.630 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 65.869760361999994, 2024-04-24T13:33:34.630 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022940439, 2024-04-24T13:33:34.630 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.630 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.630 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.630 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.630 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.630 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2242 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.631 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739648+0000", 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.785e-06 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741765+0000", 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002117655 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741781+0000", 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6062e-05 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.632 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741792+0000", 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0937999999999999e-05 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741918+0000", 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623199999999999 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742189+0000", 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027047300000000002 2024-04-24T13:33:34.633 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742430+0000", 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024077699999999999 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752990+0000", 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010559875 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762422+0000", 2024-04-24T13:33:34.634 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094325120000000005 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762510+0000", 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7879000000000003e-05 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762585+0000", 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5251000000000002e-05 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.635 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2662 3.33 3:ce195145:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.480842055, 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028670389000000001, 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2662 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.636 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:34.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:34.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.637 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.637 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.637 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.637 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128567+0000", 2024-04-24T13:33:34.637 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4640000000000002e-06 2024-04-24T13:33:34.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130845+0000", 2024-04-24T13:33:34.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002278389 2024-04-24T13:33:34.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.638 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130869+0000", 2024-04-24T13:33:34.638 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4394999999999999e-05 2024-04-24T13:33:34.638 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.638 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.638 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130879+0000", 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0000000000000001e-05 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130957+0000", 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7968999999999998e-05 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130963+0000", 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2499999999999997e-06 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.639 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137507+0000", 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065442900000000003 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137607+0000", 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010002599999999999 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137727+0000", 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120142 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.640 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152307+0000", 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01458017 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157112+0000", 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048051350000000003 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157181+0000", 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9051e-05 2024-04-24T13:33:34.641 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.642 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.642 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157233+0000", 2024-04-24T13:33:34.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2108000000000003e-05 2024-04-24T13:33:34.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.642 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.642 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.642 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.642 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.642 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2676 3.22 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:34.642 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:34.642 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 29.337640146999998, 2024-04-24T13:33:34.642 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025889562000000001, 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2676 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.643 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271767+0000", 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.273986+0000", 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022195560000000001 2024-04-24T13:33:34.644 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274011+0000", 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4953e-05 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274023+0000", 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1856e-05 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274116+0000", 2024-04-24T13:33:34.645 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3168e-05 2024-04-24T13:33:34.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274377+0000", 2024-04-24T13:33:34.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026071500000000001 2024-04-24T13:33:34.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.646 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:34.646 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274531+0000", 2024-04-24T13:33:34.646 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015427299999999999 2024-04-24T13:33:34.646 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.646 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297124+0000", 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022592476 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297544+0000", 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000420691 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297605+0000", 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0888999999999999e-05 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.647 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297655+0000", 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9119999999999997e-05 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2722 3.25 e101/20 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head v 101'6, mlcod=86'4)", 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.965894865999999, 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023380372, 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.648 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.649 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:34.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.649 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.649 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:34.649 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.649 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.649 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643511+0000", 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4400000000000001e-07 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647450+0000", 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039389259999999997 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647470+0000", 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0534e-05 2024-04-24T13:33:34.650 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647484+0000", 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3370000000000001e-05 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647599+0000", 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115513 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647629+0000", 2024-04-24T13:33:34.651 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0145e-05 2024-04-24T13:33:34.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666761+0000", 2024-04-24T13:33:34.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019132303999999999 2024-04-24T13:33:34.652 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.652 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.652 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.652 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666891+0000", 2024-04-24T13:33:34.652 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012913599999999999 2024-04-24T13:33:34.652 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.652 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2747 3.24 3:2754d069:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.711345004000002, 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024857536999999999, 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.653 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2747 2024-04-24T13:33:34.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.654 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:34.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.654 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.654 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:34.654 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.654 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.654 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898063+0000", 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5289999999999998e-06 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899956+0000", 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932759999999999 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899984+0000", 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7801999999999999e-05 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.655 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899997+0000", 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3127e-05 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900063+0000", 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900200+0000", 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000137324 2024-04-24T13:33:34.656 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900302+0000", 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010168 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.908151+0000", 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078489579999999996 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922784+0000", 2024-04-24T13:33:34.657 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014633116 2024-04-24T13:33:34.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922860+0000", 2024-04-24T13:33:34.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5708000000000001e-05 2024-04-24T13:33:34.658 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.658 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.658 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.658 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922918+0000", 2024-04-24T13:33:34.658 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7686000000000003e-05 2024-04-24T13:33:34.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.658 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.658 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.659 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.659 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.659 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2754 3.b 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:34.659 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:34.659 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.630875503999999, 2024-04-24T13:33:34.659 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.032358206, 2024-04-24T13:33:34.659 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.659 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.659 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.659 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.660 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.660 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2754 2024-04-24T13:33:34.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.660 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:34.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.660 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.660 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.660 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.660 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:34.660 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978532+0000", 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6079999999999998e-06 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979768+0000", 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012357869999999999 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.661 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979791+0000", 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3224e-05 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979804+0000", 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.274e-05 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979889+0000", 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5483999999999997e-05 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.662 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980063+0000", 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017384599999999999 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980227+0000", 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163764 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987774+0000", 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075472029999999997 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.663 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010776+0000", 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023001886999999999 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010838+0000", 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1527999999999998e-05 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010888+0000", 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0135e-05 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.664 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2811 3.7 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.039236672000001, 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044582597000000002, 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.665 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2811 2024-04-24T13:33:34.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.666 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:34.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:34.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570171+0000", 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9100000000000001e-06 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580122+0000", 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099505930000000006 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580150+0000", 2024-04-24T13:33:34.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7827e-05 2024-04-24T13:33:34.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580164+0000", 2024-04-24T13:33:34.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4547e-05 2024-04-24T13:33:34.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580245+0000", 2024-04-24T13:33:34.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0810999999999996e-05 2024-04-24T13:33:34.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580355+0000", 2024-04-24T13:33:34.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109656 2024-04-24T13:33:34.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:34.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580475+0000", 2024-04-24T13:33:34.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120278 2024-04-24T13:33:34.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607433+0000", 2024-04-24T13:33:34.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026957894 2024-04-24T13:33:34.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614636+0000", 2024-04-24T13:33:34.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072028359999999998 2024-04-24T13:33:34.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614703+0000", 2024-04-24T13:33:34.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7645999999999996e-05 2024-04-24T13:33:34.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614751+0000", 2024-04-24T13:33:34.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7599000000000003e-05 2024-04-24T13:33:34.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.671 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.671 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.671 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2812 3.1e 3:7bd62ca6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:34.671 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:34.671 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.029192792, 2024-04-24T13:33:34.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.038041177000000002, 2024-04-24T13:33:34.671 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.671 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.672 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.672 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.672 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.672 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.672 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2812 2024-04-24T13:33:34.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.672 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:34.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:34.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580214+0000", 2024-04-24T13:33:34.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.708e-06 2024-04-24T13:33:34.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582574+0000", 2024-04-24T13:33:34.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023601799999999999 2024-04-24T13:33:34.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582591+0000", 2024-04-24T13:33:34.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6648999999999999e-05 2024-04-24T13:33:34.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582598+0000", 2024-04-24T13:33:34.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.391e-06 2024-04-24T13:33:34.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583731+0000", 2024-04-24T13:33:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011332029999999999 2024-04-24T13:33:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583843+0000", 2024-04-24T13:33:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111889 2024-04-24T13:33:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583936+0000", 2024-04-24T13:33:34.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2968999999999997e-05 2024-04-24T13:33:34.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.599363+0000", 2024-04-24T13:33:34.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015427186000000001 2024-04-24T13:33:34.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.676 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618143+0000", 2024-04-24T13:33:34.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018779051000000001 2024-04-24T13:33:34.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.676 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618200+0000", 2024-04-24T13:33:34.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7151999999999998e-05 2024-04-24T13:33:34.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618253+0000", 2024-04-24T13:33:34.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3798999999999998e-05 2024-04-24T13:33:34.677 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.677 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.677 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.678 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3110 3.1e 3:79ca4af0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:34.678 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:34.678 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.8101345919999998, 2024-04-24T13:33:34.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022894164000000002, 2024-04-24T13:33:34.678 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.678 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.678 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.678 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.678 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.678 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.678 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3110 2024-04-24T13:33:34.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.679 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:34.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:34.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799272+0000", 2024-04-24T13:33:34.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9470000000000002e-06 2024-04-24T13:33:34.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800698+0000", 2024-04-24T13:33:34.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001425204 2024-04-24T13:33:34.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800721+0000", 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3577000000000001e-05 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800731+0000", 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9969999999999993e-06 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800797+0000", 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6087999999999995e-05 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800954+0000", 2024-04-24T13:33:34.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015699 2024-04-24T13:33:34.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:34.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.801064+0000", 2024-04-24T13:33:34.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109715 2024-04-24T13:33:34.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.807584+0000", 2024-04-24T13:33:34.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065197479999999997 2024-04-24T13:33:34.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822063+0000", 2024-04-24T13:33:34.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014479156999999999 2024-04-24T13:33:34.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822122+0000", 2024-04-24T13:33:34.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9095000000000003e-05 2024-04-24T13:33:34.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822165+0000", 2024-04-24T13:33:34.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2645999999999998e-05 2024-04-24T13:33:34.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.684 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.684 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3117 3.27 3:e455931d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:34.684 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:34.684 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.738776562, 2024-04-24T13:33:34.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02353235, 2024-04-24T13:33:34.684 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.685 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.685 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.685 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3117 2024-04-24T13:33:34.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.685 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:34.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:34.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870631+0000", 2024-04-24T13:33:34.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.075e-06 2024-04-24T13:33:34.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872287+0000", 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016561449999999999 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872316+0000", 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9543000000000002e-05 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872333+0000", 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6806000000000001e-05 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872403+0000", 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9917000000000002e-05 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872540+0000", 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013735200000000001 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872686+0000", 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014519899999999999 2024-04-24T13:33:34.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.878440+0000", 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057539490000000004 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894072+0000", 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015632801000000002 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894106+0000", 2024-04-24T13:33:34.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3933999999999997e-05 2024-04-24T13:33:34.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894161+0000", 2024-04-24T13:33:34.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4629000000000002e-05 2024-04-24T13:33:34.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.690 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.690 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.690 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3127 3.15 3:a9239ffa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:34.690 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:34.690 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.634049386, 2024-04-24T13:33:34.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023707346000000001, 2024-04-24T13:33:34.691 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.691 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.691 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.691 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.691 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3127 2024-04-24T13:33:34.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.691 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975357+0000", 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.418e-06 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976868+0000", 2024-04-24T13:33:34.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015108719999999999 2024-04-24T13:33:34.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976894+0000", 2024-04-24T13:33:34.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5885e-05 2024-04-24T13:33:34.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976905+0000", 2024-04-24T13:33:34.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1076e-05 2024-04-24T13:33:34.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976983+0000", 2024-04-24T13:33:34.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8532e-05 2024-04-24T13:33:34.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977149+0000", 2024-04-24T13:33:34.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016571500000000001 2024-04-24T13:33:34.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:34.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977313+0000", 2024-04-24T13:33:34.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163719 2024-04-24T13:33:34.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.984588+0000", 2024-04-24T13:33:34.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072751600000000001 2024-04-24T13:33:34.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998908+0000", 2024-04-24T13:33:34.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014319705 2024-04-24T13:33:34.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998988+0000", 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9839000000000006e-05 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.999063+0000", 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5425000000000004e-05 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.697 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3136 3.25 e112/20 3:a4e0a0f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_51:head v 112'10, mlcod=102'8)", 2024-04-24T13:33:34.697 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:34.697 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.5329897169999995, 2024-04-24T13:33:34.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026701701000000001, 2024-04-24T13:33:34.697 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.697 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.697 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.697 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:34.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:34.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076417+0000", 2024-04-24T13:33:34.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.779e-06 2024-04-24T13:33:34.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077651+0000", 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233428 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077679+0000", 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8535e-05 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077694+0000", 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077775+0000", 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0927000000000006e-05 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077801+0000", 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5933999999999999e-05 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103085+0000", 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284238000000001 2024-04-24T13:33:34.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103117+0000", 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1917e-05 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3429 3.7 3:e226ff6b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_327:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.7828204109999999, 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023122228000000002, 2024-04-24T13:33:34.701 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.702 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.702 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.702 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.702 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.702 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.702 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3429 2024-04-24T13:33:34.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.702 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:34.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:34.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826588+0000", 2024-04-24T13:33:34.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.942e-06 2024-04-24T13:33:34.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829078+0000", 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002489982 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829098+0000", 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0747999999999999e-05 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829110+0000", 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1569000000000001e-05 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829206+0000", 2024-04-24T13:33:34.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6303000000000003e-05 2024-04-24T13:33:34.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829419+0000", 2024-04-24T13:33:34.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021229300000000001 2024-04-24T13:33:34.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:34.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829606+0000", 2024-04-24T13:33:34.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187219 2024-04-24T13:33:34.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.835770+0000", 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061641819999999998 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849620+0000", 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013849889000000001 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849663+0000", 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2725999999999997e-05 2024-04-24T13:33:34.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849707+0000", 2024-04-24T13:33:34.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4375000000000001e-05 2024-04-24T13:33:34.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.707 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.707 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3484 3.18 3:1a64f732:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_382:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:34.707 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:34.707 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.227825232, 2024-04-24T13:33:34.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029616456999999999, 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3484 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381583+0000", 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6510000000000001e-06 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382670+0000", 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010878870000000001 2024-04-24T13:33:34.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382689+0000", 2024-04-24T13:33:34.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8723999999999999e-05 2024-04-24T13:33:34.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382700+0000", 2024-04-24T13:33:34.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0908e-05 2024-04-24T13:33:34.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385156+0000", 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002456176 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385287+0000", 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013060400000000001 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385402+0000", 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115658 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.406717+0000", 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021314317999999999 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411063+0000", 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043465719999999999 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411141+0000", 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7193000000000004e-05 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411196+0000", 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5766000000000001e-05 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3483 3.c e114/103 3:3033c1b6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_381:head v 114'16, mlcod=113'14)", 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.225640021, 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028448153, 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.713 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383766+0000", 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0130000000000001e-06 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387173+0000", 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034066330000000001 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387201+0000", 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8705999999999999e-05 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387216+0000", 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5019e-05 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387369+0000", 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015276299999999999 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387397+0000", 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7559000000000002e-05 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412160+0000", 2024-04-24T13:33:34.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024763314000000002 2024-04-24T13:33:34.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412213+0000", 2024-04-24T13:33:34.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3146000000000002e-05 2024-04-24T13:33:34.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.717 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.718 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3501 3.24 3:27356806:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_399:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:34.718 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:34.718 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 1.0487525449999999, 2024-04-24T13:33:34.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029132884000000001, 2024-04-24T13:33:34.718 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.718 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.718 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.718 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.718 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.718 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.718 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3501 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560656+0000", 2024-04-24T13:33:34.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.066e-06 2024-04-24T13:33:34.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562392+0000", 2024-04-24T13:33:34.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017359980000000001 2024-04-24T13:33:34.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562431+0000", 2024-04-24T13:33:34.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9325e-05 2024-04-24T13:33:34.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562453+0000", 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2476e-05 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562541+0000", 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7678999999999999e-05 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562688+0000", 2024-04-24T13:33:34.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014673600000000001 2024-04-24T13:33:34.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:34.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562785+0000", 2024-04-24T13:33:34.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6903000000000004e-05 2024-04-24T13:33:34.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.571188+0000", 2024-04-24T13:33:34.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084030449999999996 2024-04-24T13:33:34.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589689+0000", 2024-04-24T13:33:34.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018500876999999999 2024-04-24T13:33:34.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589735+0000", 2024-04-24T13:33:34.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-04-24T13:33:34.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589785+0000", 2024-04-24T13:33:34.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0290999999999997e-05 2024-04-24T13:33:34.723 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.724 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.724 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3521 3.1e 3:7803006f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_419:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:34.724 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:34.724 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.84180069899999999, 2024-04-24T13:33:34.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024446572999999999, 2024-04-24T13:33:34.724 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:34.724 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:34.724 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:34.724 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:34.724 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3521 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:34.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:34.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767608+0000", 2024-04-24T13:33:34.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3239999999999999e-06 2024-04-24T13:33:34.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:34.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770197+0000", 2024-04-24T13:33:34.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025895129999999999 2024-04-24T13:33:34.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:34.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770220+0000", 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2605000000000001e-05 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770233+0000", 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3159999999999999e-05 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770329+0000", 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5995999999999994e-05 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:34.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770543+0000", 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000214348 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770732+0000", 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000188975 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.779877+0000", 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0091449860000000008 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.791883+0000", 2024-04-24T13:33:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012005266000000001 2024-04-24T13:33:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792002+0000", 2024-04-24T13:33:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119351 2024-04-24T13:33:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792051+0000", 2024-04-24T13:33:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9048999999999997e-05 2024-04-24T13:33:34.729 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.730 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.730 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.730 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:34.730 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:34.730 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:34.731 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:34.731 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:34.732 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:33:34.732 INFO:tasks.workunit.client.0.smithi071.stdout:quota disabled for the bucket: buck_2024_03_24_13_33_24 2024-04-24T13:33:34.733 INFO:tasks.workunit.client.0.smithi071.stdout:adding file to bucket: 2Gb. 2024-04-24T13:33:34.733 INFO:tasks.workunit.client.0.smithi071.stdout:upload file successful 2024-04-24T13:33:34.733 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:33:34.733 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - bucket quota size doesnt take effect when quota is disabled 2024-04-24T13:33:34.733 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:33:34.733 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:34.734 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:34.734 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:34.734 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:34.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:34.735 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:34.735 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:34.735 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:34.736 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:34.736 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:34.736 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:34.730+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:34.832 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:34.830+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:34.856 INFO:tasks.workunit.client.0.smithi071.stdout:user qa_user deleted 2024-04-24T13:33:34.856 INFO:tasks.workunit.client.0.smithi071.stdout:bucket delete succeeded 2024-04-24T13:33:34.875 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:34.875 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:34.889 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:33:34.934 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:34.933+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:35.008 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:35.008 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:35.022 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:33:35.067 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:35.065+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:35.135 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:35.133+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:35.186 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:35.186 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:35.201 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:33:35.242 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:35.241+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:35.337 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:35.334+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:35.361 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:35.361 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:35.375 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:33:35.409 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:33:35.438 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:35.437+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:35.492 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:35.492 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:35.506 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:33:35.550 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:35.549+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:35.639 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:35.637+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:35.673 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:35.673 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:35.687 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:33:35.739 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:35.738+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:35.840 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:35.837+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:35.854 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:35.854 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:35.868 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:33:35.941 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:35.938+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:36.036 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:36.036 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:36.042 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:36.038+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:36.050 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:33:36.143 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:36.142+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:36.173 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:36.173 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:36.187 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:33:36.244 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:36.242+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:36.310 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:36.310 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:36.324 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:36.345 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:36.342+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:36.399 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:33:36.443 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:36.443 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:36.445 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:36.441+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:36.457 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:36.546 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:36.546+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:36.622 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:36.622 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:36.636 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:36.683 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:36.682+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:36.737 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:33:36.760 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:36.761 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:36.761 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:36.758+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:36.775 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:36.849 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:36.845+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:36.882 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:36.883 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:36.899 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:36.899 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:36.915 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:36.915 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:36.931 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:36.931 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:36.938 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:36.938 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:36.938 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:36.938 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:36.939 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:36.950 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:36.946+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:36.951 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:36.952 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:36.952 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:36.972 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:36.973 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:36.993 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:36.993 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:37.014 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:37.014 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:37.051 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:37.049+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:37.066 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:37.066 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:37.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:37.066 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:37.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.066 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2216 3.3d 3:bf22edaf:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:37.066 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:37.066 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.603362755000006, 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027972988000000001, 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2216 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:37.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461317+0000", 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.461320+0000", 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7049999999999999e-06 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462822+0000", 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015018919999999999 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462846+0000", 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4229000000000001e-05 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462856+0000", 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8619999999999998e-06 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.462932+0000", 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6126999999999998e-05 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463098+0000", 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016631400000000001 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.463231+0000", 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013278699999999999 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475573+0000", 2024-04-24T13:33:37.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012342148000000001 2024-04-24T13:33:37.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489102+0000", 2024-04-24T13:33:37.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013528755 2024-04-24T13:33:37.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489210+0000", 2024-04-24T13:33:37.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010779400000000001 2024-04-24T13:33:37.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.489290+0000", 2024-04-24T13:33:37.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0375000000000002e-05 2024-04-24T13:33:37.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.072 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.072 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2217 3.7 e85/41 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head v 85'2, mlcod=0'0)", 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.590953412000005, 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022815940999999999, 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473727+0000", 2024-04-24T13:33:37.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473728+0000", 2024-04-24T13:33:37.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6080000000000001e-06 2024-04-24T13:33:37.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.074 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475783+0000", 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002054349 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475801+0000", 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8054e-05 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.475814+0000", 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3515e-05 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488934+0000", 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013119772 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.488977+0000", 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2922e-05 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496474+0000", 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0074975320000000003 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496543+0000", 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8188999999999994e-05 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2251 3.3a e85/20 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head v 85'3, mlcod=81'1)", 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.223453737, 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024431608, 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.077 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841226+0000", 2024-04-24T13:33:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.841228+0000", 2024-04-24T13:33:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.781e-06 2024-04-24T13:33:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846614+0000", 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053854419999999998 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846650+0000", 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6133000000000001e-05 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846669+0000", 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9199e-05 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846763+0000", 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4335999999999999e-05 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.846799+0000", 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5796000000000001e-05 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865616+0000", 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018816825999999998 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865658+0000", 2024-04-24T13:33:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2095000000000003e-05 2024-04-24T13:33:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2675 3.20 e100/20 3:04d57de4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_14:head v 100'3, mlcod=85'1)", 2024-04-24T13:33:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.794824166000001, 2024-04-24T13:33:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027012970000000001, 2024-04-24T13:33:37.082 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.269856+0000", 2024-04-24T13:33:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.72e-07 2024-04-24T13:33:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275705+0000", 2024-04-24T13:33:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058491849999999998 2024-04-24T13:33:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275732+0000", 2024-04-24T13:33:37.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6630000000000001e-05 2024-04-24T13:33:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275747+0000", 2024-04-24T13:33:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5375000000000001e-05 2024-04-24T13:33:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275839+0000", 2024-04-24T13:33:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1348999999999996e-05 2024-04-24T13:33:37.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.275873+0000", 2024-04-24T13:33:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4341999999999997e-05 2024-04-24T13:33:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296810+0000", 2024-04-24T13:33:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020937196000000002 2024-04-24T13:33:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.086 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.296869+0000", 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8621e-05 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2693 3.39 3:9e56554d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.623983681999999, 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284832, 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.087 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2693 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440696+0000", 2024-04-24T13:33:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.440699+0000", 2024-04-24T13:33:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2199999999999999e-06 2024-04-24T13:33:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441920+0000", 2024-04-24T13:33:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012213739999999999 2024-04-24T13:33:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441944+0000", 2024-04-24T13:33:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4127000000000001e-05 2024-04-24T13:33:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.441963+0000", 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.855e-05 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442027+0000", 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4337000000000004e-05 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442150+0000", 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012347399999999999 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.442248+0000", 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7683999999999995e-05 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.447435+0000", 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005186955 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465898+0000", 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018462971000000002 2024-04-24T13:33:37.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465947+0000", 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9276000000000001e-05 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.465981+0000", 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3864e-05 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2723 3.37 3:ecde4b94:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_52:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.421202684000001, 2024-04-24T13:33:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023622656999999998, 2024-04-24T13:33:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2723 2024-04-24T13:33:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.094 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643477+0000", 2024-04-24T13:33:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643480+0000", 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6960000000000001e-06 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645332+0000", 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001851561 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645362+0000", 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0298e-05 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645375+0000", 2024-04-24T13:33:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.331e-05 2024-04-24T13:33:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645460+0000", 2024-04-24T13:33:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4851999999999993e-05 2024-04-24T13:33:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.645467+0000", 2024-04-24T13:33:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0140000000000001e-06 2024-04-24T13:33:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.653874+0000", 2024-04-24T13:33:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084073340000000007 2024-04-24T13:33:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654042+0000", 2024-04-24T13:33:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000167159 2024-04-24T13:33:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.654214+0000", 2024-04-24T13:33:37.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017199899999999999 2024-04-24T13:33:37.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666361+0000", 2024-04-24T13:33:37.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012146957999999999 2024-04-24T13:33:37.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666977+0000", 2024-04-24T13:33:37.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00061606400000000004 2024-04-24T13:33:37.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667043+0000", 2024-04-24T13:33:37.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:37.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667100+0000", 2024-04-24T13:33:37.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7080999999999998e-05 2024-04-24T13:33:37.100 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.100 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2746 3.30 3:0ff52a22:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_75:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.177899783000001, 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025777590999999999, 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.101 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2746 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886780+0000", 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.886783+0000", 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8930000000000001e-06 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889050+0000", 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002267107 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889078+0000", 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7623999999999998e-05 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889091+0000", 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3101e-05 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889170+0000", 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8968999999999996e-05 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889311+0000", 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000141392 2024-04-24T13:33:37.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.889451+0000", 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000139911 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.895637+0000", 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061857290000000001 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912426+0000", 2024-04-24T13:33:37.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016789347999999999 2024-04-24T13:33:37.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912501+0000", 2024-04-24T13:33:37.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4836e-05 2024-04-24T13:33:37.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.912558+0000", 2024-04-24T13:33:37.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6681000000000002e-05 2024-04-24T13:33:37.106 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.106 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.106 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.107 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2754 3.b e101/20 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head v 101'7, mlcod=86'5)", 2024-04-24T13:33:37.107 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:37.107 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.079339052000002, 2024-04-24T13:33:37.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025167067000000001, 2024-04-24T13:33:37.107 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.107 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.107 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.107 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985341+0000", 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985343+0000", 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.734e-06 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987192+0000", 2024-04-24T13:33:37.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018490360000000001 2024-04-24T13:33:37.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987224+0000", 2024-04-24T13:33:37.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2588e-05 2024-04-24T13:33:37.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987241+0000", 2024-04-24T13:33:37.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6350000000000001e-05 2024-04-24T13:33:37.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987338+0000", 2024-04-24T13:33:37.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7466000000000005e-05 2024-04-24T13:33:37.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987368+0000", 2024-04-24T13:33:37.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0210999999999999e-05 2024-04-24T13:33:37.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010454+0000", 2024-04-24T13:33:37.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02308522 2024-04-24T13:33:37.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.111 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.111 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010508+0000", 2024-04-24T13:33:37.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4462000000000001e-05 2024-04-24T13:33:37.111 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.111 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.111 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2755 3.12 3:4bcc7c5c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_84:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.078927164, 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026401981000000001, 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2755 2024-04-24T13:33:37.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.113 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:37.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985753+0000", 2024-04-24T13:33:37.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.985757+0000", 2024-04-24T13:33:37.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6370000000000001e-06 2024-04-24T13:33:37.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987459+0000", 2024-04-24T13:33:37.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017029180000000001 2024-04-24T13:33:37.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987474+0000", 2024-04-24T13:33:37.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4460999999999999e-05 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987484+0000", 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0168e-05 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987576+0000", 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2020000000000003e-05 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987731+0000", 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015486499999999999 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987818+0000", 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7350999999999998e-05 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012049+0000", 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02423055 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012062+0000", 2024-04-24T13:33:37.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3054000000000001e-05 2024-04-24T13:33:37.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012114+0000", 2024-04-24T13:33:37.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1656999999999997e-05 2024-04-24T13:33:37.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.012155+0000", 2024-04-24T13:33:37.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1300000000000001e-05 2024-04-24T13:33:37.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2770 3.1 3:80489e4c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_99:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.931073914999999, 2024-04-24T13:33:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025093718000000001, 2024-04-24T13:33:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.118 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.119 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.119 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2770 2024-04-24T13:33:37.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.119 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:37.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133606+0000", 2024-04-24T13:33:37.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.133609+0000", 2024-04-24T13:33:37.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0369999999999999e-06 2024-04-24T13:33:37.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135153+0000", 2024-04-24T13:33:37.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015441229999999999 2024-04-24T13:33:37.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135182+0000", 2024-04-24T13:33:37.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8300999999999999e-05 2024-04-24T13:33:37.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135196+0000", 2024-04-24T13:33:37.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4229999999999999e-05 2024-04-24T13:33:37.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135279+0000", 2024-04-24T13:33:37.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.3549999999999998e-05 2024-04-24T13:33:37.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135458+0000", 2024-04-24T13:33:37.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017893100000000001 2024-04-24T13:33:37.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.135611+0000", 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000152881 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.144283+0000", 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0086718709999999994 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158560+0000", 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014277306 2024-04-24T13:33:37.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158642+0000", 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1435999999999998e-05 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.158700+0000", 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8051999999999999e-05 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.125 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2811 3.7 e101/41 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head v 101'8, mlcod=101'6)", 2024-04-24T13:33:37.125 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:37.125 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 30.484095935999999, 2024-04-24T13:33:37.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026659326000000001, 2024-04-24T13:33:37.125 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.125 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.125 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:37.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580584+0000", 2024-04-24T13:33:37.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580586+0000", 2024-04-24T13:33:37.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.668e-06 2024-04-24T13:33:37.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582238+0000", 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016524829999999999 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582266+0000", 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8028e-05 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582282+0000", 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6047999999999999e-05 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582372+0000", 2024-04-24T13:33:37.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9642999999999995e-05 2024-04-24T13:33:37.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582400+0000", 2024-04-24T13:33:37.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7776999999999998e-05 2024-04-24T13:33:37.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607184+0000", 2024-04-24T13:33:37.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024784418999999999 2024-04-24T13:33:37.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607243+0000", 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9259999999999998e-05 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3089 3.17 3:e81f13af:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.547320+0000", 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.5173597749999992, 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029439633, 2024-04-24T13:33:37.129 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.130 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.130 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.130 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.130 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.130 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.130 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3089 2024-04-24T13:33:37.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.130 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.547320+0000", 2024-04-24T13:33:37.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.547320+0000", 2024-04-24T13:33:37.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.547323+0000", 2024-04-24T13:33:37.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.056e-06 2024-04-24T13:33:37.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.549747+0000", 2024-04-24T13:33:37.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002424102 2024-04-24T13:33:37.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.549781+0000", 2024-04-24T13:33:37.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3562999999999997e-05 2024-04-24T13:33:37.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.549798+0000", 2024-04-24T13:33:37.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6575999999999999e-05 2024-04-24T13:33:37.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.549871+0000", 2024-04-24T13:33:37.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3402e-05 2024-04-24T13:33:37.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.550024+0000", 2024-04-24T13:33:37.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015292699999999999 2024-04-24T13:33:37.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:37.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.550144+0000", 2024-04-24T13:33:37.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120164 2024-04-24T13:33:37.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.556328+0000", 2024-04-24T13:33:37.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061837530000000002 2024-04-24T13:33:37.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.576617+0000", 2024-04-24T13:33:37.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020289629 2024-04-24T13:33:37.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.576698+0000", 2024-04-24T13:33:37.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0599999999999994e-05 2024-04-24T13:33:37.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.576760+0000", 2024-04-24T13:33:37.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1860999999999996e-05 2024-04-24T13:33:37.140 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.140 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.140 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.141 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3179 3.6 3:61c16905:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_94:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:37.141 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.554088+0000", 2024-04-24T13:33:37.141 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.5105916429999997, 2024-04-24T13:33:37.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024689096000000001, 2024-04-24T13:33:37.141 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.141 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.141 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.141 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.141 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.141 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.142 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3179 2024-04-24T13:33:37.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.142 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.554088+0000", 2024-04-24T13:33:37.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.554088+0000", 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.554091+0000", 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7609999999999999e-06 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.555729+0000", 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001638016 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.555762+0000", 2024-04-24T13:33:37.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2490999999999998e-05 2024-04-24T13:33:37.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.555777+0000", 2024-04-24T13:33:37.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4961e-05 2024-04-24T13:33:37.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.555866+0000", 2024-04-24T13:33:37.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9411000000000002e-05 2024-04-24T13:33:37.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.556002+0000", 2024-04-24T13:33:37.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013555699999999999 2024-04-24T13:33:37.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:37.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.556128+0000", 2024-04-24T13:33:37.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126685 2024-04-24T13:33:37.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578483+0000", 2024-04-24T13:33:37.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022354272000000001 2024-04-24T13:33:37.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578705+0000", 2024-04-24T13:33:37.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022231099999999999 2024-04-24T13:33:37.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578743+0000", 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8572000000000003e-05 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578777+0000", 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4059e-05 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3366 3.1 3:80d4803f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_271:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:37.147 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.193981+0000", 2024-04-24T13:33:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.8706986199999998, 2024-04-24T13:33:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027172661000000001, 2024-04-24T13:33:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3366 2024-04-24T13:33:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.193981+0000", 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.193981+0000", 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.193984+0000", 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9330000000000001e-06 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.196365+0000", 2024-04-24T13:33:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023805300000000001 2024-04-24T13:33:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.196400+0000", 2024-04-24T13:33:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5200999999999997e-05 2024-04-24T13:33:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.196416+0000", 2024-04-24T13:33:37.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5461999999999999e-05 2024-04-24T13:33:37.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.196510+0000", 2024-04-24T13:33:37.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4736999999999998e-05 2024-04-24T13:33:37.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.196719+0000", 2024-04-24T13:33:37.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020873199999999999 2024-04-24T13:33:37.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:37.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.196899+0000", 2024-04-24T13:33:37.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017970900000000001 2024-04-24T13:33:37.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.202924+0000", 2024-04-24T13:33:37.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0060257289999999996 2024-04-24T13:33:37.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.221018+0000", 2024-04-24T13:33:37.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018093827999999999 2024-04-24T13:33:37.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.221094+0000", 2024-04-24T13:33:37.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5506999999999994e-05 2024-04-24T13:33:37.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.221154+0000", 2024-04-24T13:33:37.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0293e-05 2024-04-24T13:33:37.154 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.154 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.154 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.154 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3373 3.30 e113/103 3:0ff7ebd9:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_278:head v 113'14, mlcod=112'12)", 2024-04-24T13:33:37.154 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.277223+0000", 2024-04-24T13:33:37.154 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.7874566640000005, 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028996096999999998, 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.277223+0000", 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.277223+0000", 2024-04-24T13:33:37.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.277226+0000", 2024-04-24T13:33:37.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3779999999999999e-06 2024-04-24T13:33:37.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.290128+0000", 2024-04-24T13:33:37.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012902462 2024-04-24T13:33:37.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.290144+0000", 2024-04-24T13:33:37.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6138999999999999e-05 2024-04-24T13:33:37.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.290153+0000", 2024-04-24T13:33:37.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7839999999999992e-06 2024-04-24T13:33:37.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.290233+0000", 2024-04-24T13:33:37.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9660000000000006e-05 2024-04-24T13:33:37.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.290267+0000", 2024-04-24T13:33:37.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4434999999999998e-05 2024-04-24T13:33:37.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.306148+0000", 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015880307 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.306219+0000", 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1932000000000002e-05 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3380 3.3a e113/20 3:5cb232f4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_285:head v 113'18, mlcod=113'16)", 2024-04-24T13:33:37.159 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.351752+0000", 2024-04-24T13:33:37.160 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.7129281189999999, 2024-04-24T13:33:37.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026120022, 2024-04-24T13:33:37.160 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.160 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.160 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.160 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.351752+0000", 2024-04-24T13:33:37.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.351752+0000", 2024-04-24T13:33:37.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.351754+0000", 2024-04-24T13:33:37.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0990000000000001e-06 2024-04-24T13:33:37.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.357096+0000", 2024-04-24T13:33:37.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053424329999999997 2024-04-24T13:33:37.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.357113+0000", 2024-04-24T13:33:37.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.628e-05 2024-04-24T13:33:37.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.357126+0000", 2024-04-24T13:33:37.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2916e-05 2024-04-24T13:33:37.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.357208+0000", 2024-04-24T13:33:37.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1924999999999999e-05 2024-04-24T13:33:37.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.357238+0000", 2024-04-24T13:33:37.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0099000000000001e-05 2024-04-24T13:33:37.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.377805+0000", 2024-04-24T13:33:37.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020567483000000001 2024-04-24T13:33:37.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.377872+0000", 2024-04-24T13:33:37.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6786999999999996e-05 2024-04-24T13:33:37.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.164 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.164 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.165 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3421 3.1 3:80863c87:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_319:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:37.165 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.731775+0000", 2024-04-24T13:33:37.165 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3329054429999996, 2024-04-24T13:33:37.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025877013000000001, 2024-04-24T13:33:37.165 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.165 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.165 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.165 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.165 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.165 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.165 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3421 2024-04-24T13:33:37.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.166 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.731775+0000", 2024-04-24T13:33:37.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.731775+0000", 2024-04-24T13:33:37.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.731777+0000", 2024-04-24T13:33:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4499999999999998e-06 2024-04-24T13:33:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.734278+0000", 2024-04-24T13:33:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025011109999999999 2024-04-24T13:33:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.734317+0000", 2024-04-24T13:33:37.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8748999999999998e-05 2024-04-24T13:33:37.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.734333+0000", 2024-04-24T13:33:37.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5800000000000001e-05 2024-04-24T13:33:37.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.734426+0000", 2024-04-24T13:33:37.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3720000000000004e-05 2024-04-24T13:33:37.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.734541+0000", 2024-04-24T13:33:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000114654 2024-04-24T13:33:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.734654+0000", 2024-04-24T13:33:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000112607 2024-04-24T13:33:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.741207+0000", 2024-04-24T13:33:37.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065532910000000002 2024-04-24T13:33:37.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.757485+0000", 2024-04-24T13:33:37.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016277900000000001 2024-04-24T13:33:37.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.757576+0000", 2024-04-24T13:33:37.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1416999999999996e-05 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.757652+0000", 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5314000000000004e-05 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3458 3.f e113/48 3:f34a4471:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_356:head v 113'12, mlcod=113'10)", 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.122284+0000", 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.9423958180000001, 2024-04-24T13:33:37.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023621407000000001, 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.122284+0000", 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.122284+0000", 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.122286+0000", 2024-04-24T13:33:37.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.454e-06 2024-04-24T13:33:37.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.123745+0000", 2024-04-24T13:33:37.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014597799999999999 2024-04-24T13:33:37.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.123768+0000", 2024-04-24T13:33:37.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2104999999999999e-05 2024-04-24T13:33:37.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.123782+0000", 2024-04-24T13:33:37.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4511e-05 2024-04-24T13:33:37.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.123851+0000", 2024-04-24T13:33:37.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8736000000000001e-05 2024-04-24T13:33:37.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.123877+0000", 2024-04-24T13:33:37.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5942e-05 2024-04-24T13:33:37.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.145847+0000", 2024-04-24T13:33:37.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021970136000000001 2024-04-24T13:33:37.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.145906+0000", 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8743000000000003e-05 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3463 3.39 3:9e84137f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_361:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.170207+0000", 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.8944729709999999, 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028885754999999999, 2024-04-24T13:33:37.176 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3463 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.170207+0000", 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.170207+0000", 2024-04-24T13:33:37.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.170210+0000", 2024-04-24T13:33:37.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.57e-06 2024-04-24T13:33:37.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171881+0000", 2024-04-24T13:33:37.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016709419999999999 2024-04-24T13:33:37.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171903+0000", 2024-04-24T13:33:37.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2243999999999999e-05 2024-04-24T13:33:37.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171914+0000", 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1439e-05 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171986+0000", 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1713999999999998e-05 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.172101+0000", 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115116 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:37.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.172254+0000", 2024-04-24T13:33:37.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015266699999999999 2024-04-24T13:33:37.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.179611+0000", 2024-04-24T13:33:37.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073571110000000004 2024-04-24T13:33:37.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.198952+0000", 2024-04-24T13:33:37.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019341550999999998 2024-04-24T13:33:37.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.199032+0000", 2024-04-24T13:33:37.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9612999999999998e-05 2024-04-24T13:33:37.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.199093+0000", 2024-04-24T13:33:37.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0788000000000001e-05 2024-04-24T13:33:37.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.183 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.183 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.183 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3509 3.39 3:9cf0e09a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_407:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:37.183 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.646809+0000", 2024-04-24T13:33:37.183 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.4178709970000001, 2024-04-24T13:33:37.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.031380918000000001, 2024-04-24T13:33:37.183 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.184 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.184 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.184 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.184 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.184 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.184 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3509 2024-04-24T13:33:37.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.184 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.646809+0000", 2024-04-24T13:33:37.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.646809+0000", 2024-04-24T13:33:37.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.646812+0000", 2024-04-24T13:33:37.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3519999999999998e-06 2024-04-24T13:33:37.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.651528+0000", 2024-04-24T13:33:37.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0047152210000000003 2024-04-24T13:33:37.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.651552+0000", 2024-04-24T13:33:37.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4406e-05 2024-04-24T13:33:37.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.651562+0000", 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6299999999999993e-06 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.651644+0000", 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2634999999999997e-05 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.651850+0000", 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020535099999999999 2024-04-24T13:33:37.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:37.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.652028+0000", 2024-04-24T13:33:37.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178844 2024-04-24T13:33:37.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.657799+0000", 2024-04-24T13:33:37.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057703249999999998 2024-04-24T13:33:37.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.678080+0000", 2024-04-24T13:33:37.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020281265999999999 2024-04-24T13:33:37.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.678140+0000", 2024-04-24T13:33:37.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0170999999999997e-05 2024-04-24T13:33:37.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.678190+0000", 2024-04-24T13:33:37.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9716999999999998e-05 2024-04-24T13:33:37.190 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.191 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.191 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.191 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.191 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:37.192 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:37.193 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:37.189+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:37.293 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:37.290+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:37.361 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:37.361 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:37.361 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:37.361 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:37.375 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:33:37.423 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:37.422+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:37.494 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:37.490+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:37.537 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:37.537 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:37.537 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:37.537 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:37.537 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:37.549 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:33:37.595 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:37.593+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:37.696 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:37.693+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:37.716 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:37.716 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:37.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:37.716 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:37.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.716 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2252 3.4 3:22834b58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:37.716 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:37.716 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 68.867560529000002, 2024-04-24T13:33:37.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932545999999999, 2024-04-24T13:33:37.717 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.717 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.717 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.717 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.717 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.717 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.717 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2252 2024-04-24T13:33:37.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.717 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:37.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845581+0000", 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.718 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847834+0000", 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002252843 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847863+0000", 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.904e-05 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847877+0000", 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4126e-05 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847963+0000", 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6162999999999995e-05 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848105+0000", 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014117900000000001 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848252+0000", 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014774800000000001 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865043+0000", 2024-04-24T13:33:37.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016790848000000001 2024-04-24T13:33:37.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865405+0000", 2024-04-24T13:33:37.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036176900000000001 2024-04-24T13:33:37.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865460+0000", 2024-04-24T13:33:37.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5334000000000002e-05 2024-04-24T13:33:37.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865511+0000", 2024-04-24T13:33:37.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0784e-05 2024-04-24T13:33:37.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.722 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.722 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2663 3.0 3:01df44a3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.573786495999997, 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020742727999999998, 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2663 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:37.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:37.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.724 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.724 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139355+0000", 2024-04-24T13:33:37.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2529999999999999e-06 2024-04-24T13:33:37.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141777+0000", 2024-04-24T13:33:37.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002422638 2024-04-24T13:33:37.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141800+0000", 2024-04-24T13:33:37.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2949e-05 2024-04-24T13:33:37.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141812+0000", 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1551e-05 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141907+0000", 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5296000000000004e-05 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141917+0000", 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.414e-06 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144519+0000", 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026024220000000001 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144684+0000", 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164511 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144845+0000", 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016157000000000001 2024-04-24T13:33:37.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.156972+0000", 2024-04-24T13:33:37.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012126855000000001 2024-04-24T13:33:37.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.159989+0000", 2024-04-24T13:33:37.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003016609 2024-04-24T13:33:37.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160059+0000", 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0598000000000004e-05 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160095+0000", 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6062000000000001e-05 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2672 3.1c e100/74 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head v 100'4, mlcod=85'2)", 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:37.729 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.475644938999999, 2024-04-24T13:33:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022091785999999999, 2024-04-24T13:33:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237495+0000", 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1500000000000005e-07 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243044+0000", 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055497869999999996 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243082+0000", 2024-04-24T13:33:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7208e-05 2024-04-24T13:33:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243097+0000", 2024-04-24T13:33:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5554e-05 2024-04-24T13:33:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243175+0000", 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7849999999999995e-05 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243194+0000", 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8822999999999999e-05 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259527+0000", 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016333007 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259586+0000", 2024-04-24T13:33:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9042000000000002e-05 2024-04-24T13:33:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2706 3.1c e100/74 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head v 100'5, mlcod=86'3)", 2024-04-24T13:33:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.238339258000003, 2024-04-24T13:33:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021017514000000001, 2024-04-24T13:33:37.734 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474802+0000", 2024-04-24T13:33:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1399999999999998e-06 2024-04-24T13:33:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480124+0000", 2024-04-24T13:33:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053217059999999998 2024-04-24T13:33:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480147+0000", 2024-04-24T13:33:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3646e-05 2024-04-24T13:33:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480159+0000", 2024-04-24T13:33:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2133999999999999e-05 2024-04-24T13:33:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480237+0000", 2024-04-24T13:33:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7531e-05 2024-04-24T13:33:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480291+0000", 2024-04-24T13:33:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3851999999999999e-05 2024-04-24T13:33:37.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495746+0000", 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015454684 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495817+0000", 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1821000000000002e-05 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2722 3.25 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.080935248000003, 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035782711000000002, 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2722 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632207+0000", 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.252e-06 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634575+0000", 2024-04-24T13:33:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023682500000000001 2024-04-24T13:33:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634606+0000", 2024-04-24T13:33:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0284999999999999e-05 2024-04-24T13:33:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634619+0000", 2024-04-24T13:33:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3491e-05 2024-04-24T13:33:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634703+0000", 2024-04-24T13:33:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4214000000000004e-05 2024-04-24T13:33:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634711+0000", 2024-04-24T13:33:37.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9719999999999992e-06 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639813+0000", 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051013830000000001 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639969+0000", 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015674600000000001 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:37.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.640112+0000", 2024-04-24T13:33:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142347 2024-04-24T13:33:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647222+0000", 2024-04-24T13:33:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071106520000000003 2024-04-24T13:33:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667844+0000", 2024-04-24T13:33:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020621746999999999 2024-04-24T13:33:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667925+0000", 2024-04-24T13:33:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0717999999999995e-05 2024-04-24T13:33:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667987+0000", 2024-04-24T13:33:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1654000000000003e-05 2024-04-24T13:33:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2737 3.4 3:23416714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.920003143999999, 2024-04-24T13:33:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019181262000000001, 2024-04-24T13:33:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.747 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2737 2024-04-24T13:33:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.748 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793139+0000", 2024-04-24T13:33:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-04-24T13:33:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795403+0000", 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002264252 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795439+0000", 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5701999999999998e-05 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795454+0000", 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5262999999999999e-05 2024-04-24T13:33:37.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795541+0000", 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6989000000000003e-05 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795719+0000", 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000177906 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795875+0000", 2024-04-24T13:33:37.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155785 2024-04-24T13:33:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.808532+0000", 2024-04-24T13:33:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012657695 2024-04-24T13:33:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812189+0000", 2024-04-24T13:33:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036562809999999999 2024-04-24T13:33:37.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812258+0000", 2024-04-24T13:33:37.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9210999999999999e-05 2024-04-24T13:33:37.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812317+0000", 2024-04-24T13:33:37.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9407000000000002e-05 2024-04-24T13:33:37.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.754 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2781 3.e e101/41 3:704d2ad1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_110:head v 101'4, mlcod=85'2)", 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.462448639000002, 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017614365, 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250692+0000", 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3570000000000001e-06 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256430+0000", 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057381300000000001 2024-04-24T13:33:37.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256465+0000", 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4974000000000001e-05 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256480+0000", 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5000999999999999e-05 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256571+0000", 2024-04-24T13:33:37.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1008999999999995e-05 2024-04-24T13:33:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256599+0000", 2024-04-24T13:33:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7676000000000001e-05 2024-04-24T13:33:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268237+0000", 2024-04-24T13:33:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011638081 2024-04-24T13:33:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268305+0000", 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8137000000000002e-05 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3106 3.31 3:8f25e7ba:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.755576+0000", 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.9575630420000003, 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021214703000000001, 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.759 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3106 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.755576+0000", 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.755576+0000", 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.755579+0000", 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8389999999999998e-06 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.757952+0000", 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002372683 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.757980+0000", 2024-04-24T13:33:37.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8708e-05 2024-04-24T13:33:37.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.757995+0000", 2024-04-24T13:33:37.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4911e-05 2024-04-24T13:33:37.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.758094+0000", 2024-04-24T13:33:37.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8492000000000005e-05 2024-04-24T13:33:37.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.758270+0000", 2024-04-24T13:33:37.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017639399999999999 2024-04-24T13:33:37.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:37.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.758454+0000", 2024-04-24T13:33:37.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018373599999999999 2024-04-24T13:33:37.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.762442+0000", 2024-04-24T13:33:37.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039878429999999996 2024-04-24T13:33:37.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.776653+0000", 2024-04-24T13:33:37.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014211457 2024-04-24T13:33:37.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.776731+0000", 2024-04-24T13:33:37.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7625000000000003e-05 2024-04-24T13:33:37.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.776791+0000", 2024-04-24T13:33:37.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0015000000000001e-05 2024-04-24T13:33:37.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.765 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.765 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3107 3.16 e112/103 3:6bf97696:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_22:head v 112'6, mlcod=0'0)", 2024-04-24T13:33:37.765 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.772636+0000", 2024-04-24T13:33:37.765 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.9405031729999997, 2024-04-24T13:33:37.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025533699999999999, 2024-04-24T13:33:37.766 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.766 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.766 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.766 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.772636+0000", 2024-04-24T13:33:37.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.772636+0000", 2024-04-24T13:33:37.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.772637+0000", 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5799999999999998e-07 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787782+0000", 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015145608 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787807+0000", 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5091000000000001e-05 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787822+0000", 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4627000000000001e-05 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787900+0000", 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8496000000000002e-05 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787921+0000", 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0718999999999999e-05 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.798124+0000", 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010203067 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.798170+0000", 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5334000000000003e-05 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.770 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3121 3.e e112/41 3:70900501:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_36:head v 112'6, mlcod=101'4)", 2024-04-24T13:33:37.770 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.915485+0000", 2024-04-24T13:33:37.770 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.7976542579999997, 2024-04-24T13:33:37.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020805437, 2024-04-24T13:33:37.770 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.770 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.770 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.770 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.915485+0000", 2024-04-24T13:33:37.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.915485+0000", 2024-04-24T13:33:37.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.915489+0000", 2024-04-24T13:33:37.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.498e-06 2024-04-24T13:33:37.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921279+0000", 2024-04-24T13:33:37.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057893729999999996 2024-04-24T13:33:37.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921299+0000", 2024-04-24T13:33:37.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0117000000000001e-05 2024-04-24T13:33:37.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921309+0000", 2024-04-24T13:33:37.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8060000000000006e-06 2024-04-24T13:33:37.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921374+0000", 2024-04-24T13:33:37.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5617999999999994e-05 2024-04-24T13:33:37.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921400+0000", 2024-04-24T13:33:37.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5479000000000001e-05 2024-04-24T13:33:37.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.936231+0000", 2024-04-24T13:33:37.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014831372000000001 2024-04-24T13:33:37.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.936290+0000", 2024-04-24T13:33:37.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9174e-05 2024-04-24T13:33:37.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.775 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.775 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3136 3.25 3:a4e0a0f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:37.775 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.073986+0000", 2024-04-24T13:33:37.775 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.6391533220000003, 2024-04-24T13:33:37.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029412311, 2024-04-24T13:33:37.775 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.775 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.775 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3136 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.073986+0000", 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.073986+0000", 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.073988+0000", 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.678e-06 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.075773+0000", 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017841829999999999 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.075797+0000", 2024-04-24T13:33:37.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4671000000000001e-05 2024-04-24T13:33:37.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.075810+0000", 2024-04-24T13:33:37.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2531000000000001e-05 2024-04-24T13:33:37.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.075901+0000", 2024-04-24T13:33:37.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0815000000000004e-05 2024-04-24T13:33:37.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076115+0000", 2024-04-24T13:33:37.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000214353 2024-04-24T13:33:37.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076303+0000", 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187756 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.093042+0000", 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016738940000000001 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103280+0000", 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010238515 2024-04-24T13:33:37.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103347+0000", 2024-04-24T13:33:37.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6884999999999994e-05 2024-04-24T13:33:37.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103398+0000", 2024-04-24T13:33:37.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0983999999999998e-05 2024-04-24T13:33:37.781 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.781 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.781 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3167 3.0 3:00fbb35f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.423455+0000", 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.2896836549999993, 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021052969000000001, 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3167 2024-04-24T13:33:37.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.423455+0000", 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.423455+0000", 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.423458+0000", 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5979999999999999e-06 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425102+0000", 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016442900000000001 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425133+0000", 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0815000000000002e-05 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425147+0000", 2024-04-24T13:33:37.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4071e-05 2024-04-24T13:33:37.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425222+0000", 2024-04-24T13:33:37.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5030000000000005e-05 2024-04-24T13:33:37.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425347+0000", 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012445699999999999 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425458+0000", 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011173199999999999 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.439935+0000", 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01447708 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.786 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.444421+0000", 2024-04-24T13:33:37.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044855349999999997 2024-04-24T13:33:37.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.444458+0000", 2024-04-24T13:33:37.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7419999999999997e-05 2024-04-24T13:33:37.787 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.787 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.787 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.787 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.444508+0000", 2024-04-24T13:33:37.787 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9941000000000002e-05 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3179 3.6 e112/20 3:61c16905:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_94:head v 112'13, mlcod=112'11)", 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.556235+0000", 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.1569038500000008, 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022311758000000001, 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.788 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.556235+0000", 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.556235+0000", 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.556237+0000", 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.193e-06 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.789 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557730+0000", 2024-04-24T13:33:37.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001492192 2024-04-24T13:33:37.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557756+0000", 2024-04-24T13:33:37.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6295000000000002e-05 2024-04-24T13:33:37.790 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.790 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.790 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.790 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557767+0000", 2024-04-24T13:33:37.790 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1554e-05 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557843+0000", 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5180999999999997e-05 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557870+0000", 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7158e-05 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.791 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578507+0000", 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020637061000000002 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578547+0000", 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0123999999999997e-05 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3395 3.31 3:8fcdf07d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_293:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.439317+0000", 2024-04-24T13:33:37.792 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.2738217269999996, 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025892121000000001, 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3395 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.439317+0000", 2024-04-24T13:33:37.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.439317+0000", 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.439320+0000", 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.655e-06 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.794 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441558+0000", 2024-04-24T13:33:37.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022384409999999999 2024-04-24T13:33:37.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441583+0000", 2024-04-24T13:33:37.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4207e-05 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441594+0000", 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1066e-05 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441680+0000", 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6247000000000003e-05 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441875+0000", 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019484600000000001 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.442055+0000", 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000180578 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.449452+0000", 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073968510000000003 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.465053+0000", 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015601014999999999 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.465148+0000", 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4537000000000006e-05 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.465209+0000", 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1678000000000001e-05 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.798 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.799 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.799 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3469 3.3 e113/48 3:c2771714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_367:head v 113'13, mlcod=113'11)", 2024-04-24T13:33:37.799 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.238614+0000", 2024-04-24T13:33:37.799 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4745254709999998, 2024-04-24T13:33:37.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019069234000000001, 2024-04-24T13:33:37.799 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.799 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.799 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.799 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.238614+0000", 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.238614+0000", 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.238614+0000", 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9899999999999999e-07 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.242830+0000", 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042153030000000001 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.242867+0000", 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7605999999999999e-05 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.242884+0000", 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6928000000000001e-05 2024-04-24T13:33:37.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.242972+0000", 2024-04-24T13:33:37.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7824999999999993e-05 2024-04-24T13:33:37.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243002+0000", 2024-04-24T13:33:37.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9737999999999999e-05 2024-04-24T13:33:37.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.257615+0000", 2024-04-24T13:33:37.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014613311 2024-04-24T13:33:37.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.257683+0000", 2024-04-24T13:33:37.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7724000000000004e-05 2024-04-24T13:33:37.803 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.803 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.803 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.804 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3470 3.19 3:9981181e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_368:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:37.804 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.241358+0000", 2024-04-24T13:33:37.804 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4717808610000001, 2024-04-24T13:33:37.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01671419, 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3470 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.241358+0000", 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.241358+0000", 2024-04-24T13:33:37.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.241360+0000", 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8700000000000001e-06 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243053+0000", 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001692984 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243070+0000", 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6537000000000001e-05 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243079+0000", 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7499999999999998e-06 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243173+0000", 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4077000000000001e-05 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243403+0000", 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022924100000000001 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243532+0000", 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012967999999999999 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.257963+0000", 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014431138 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.257975+0000", 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1336e-05 2024-04-24T13:33:37.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.258015+0000", 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9700000000000003e-05 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.258072+0000", 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7877000000000002e-05 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3486 3.0 3:011a9dab:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_384:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.404443+0000", 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.3086963000000003, 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020430555, 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3486 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.404443+0000", 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.404443+0000", 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.404446+0000", 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9739999999999998e-06 2024-04-24T13:33:37.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.405836+0000", 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001390636 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.405859+0000", 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2901e-05 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.405874+0000", 2024-04-24T13:33:37.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4632e-05 2024-04-24T13:33:37.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.405993+0000", 2024-04-24T13:33:37.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011942099999999999 2024-04-24T13:33:37.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:37.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.406041+0000", 2024-04-24T13:33:37.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7673999999999998e-05 2024-04-24T13:33:37.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412918+0000", 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068771609999999997 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.413078+0000", 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015979300000000001 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.413240+0000", 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000162201 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.423857+0000", 2024-04-24T13:33:37.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010616926 2024-04-24T13:33:37.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.424802+0000", 2024-04-24T13:33:37.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000944567 2024-04-24T13:33:37.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.816 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.424841+0000", 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8863999999999999e-05 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.424873+0000", 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2805000000000002e-05 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3545 3.0 3:02affb45:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_443:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:37.817 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:34.006777+0000", 2024-04-24T13:33:37.818 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.706362071, 2024-04-24T13:33:37.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017537812999999999, 2024-04-24T13:33:37.818 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.818 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.818 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.818 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.818 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3545 2024-04-24T13:33:37.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.818 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.006777+0000", 2024-04-24T13:33:37.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.006777+0000", 2024-04-24T13:33:37.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.006781+0000", 2024-04-24T13:33:37.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6399999999999999e-06 2024-04-24T13:33:37.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.009869+0000", 2024-04-24T13:33:37.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003087939 2024-04-24T13:33:37.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.009894+0000", 2024-04-24T13:33:37.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5890000000000001e-05 2024-04-24T13:33:37.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.009909+0000", 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4827000000000001e-05 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.010002+0000", 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2664000000000006e-05 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.010198+0000", 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019567200000000001 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:37.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.010382+0000", 2024-04-24T13:33:37.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018480699999999999 2024-04-24T13:33:37.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.023835+0000", 2024-04-24T13:33:37.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013452988000000001 2024-04-24T13:33:37.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.024238+0000", 2024-04-24T13:33:37.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040287400000000001 2024-04-24T13:33:37.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.024281+0000", 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2868999999999999e-05 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.024315+0000", 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3643000000000003e-05 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.824 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3564 3.16 e114/103 3:6a4ca1e3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_461:head v 114'16, mlcod=113'14)", 2024-04-24T13:33:37.824 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:34.192192+0000", 2024-04-24T13:33:37.824 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.520947171, 2024-04-24T13:33:37.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018585483, 2024-04-24T13:33:37.824 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.824 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.824 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.824 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.192192+0000", 2024-04-24T13:33:37.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.192192+0000", 2024-04-24T13:33:37.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.192194+0000", 2024-04-24T13:33:37.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1909999999999999e-06 2024-04-24T13:33:37.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.197791+0000", 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055966310000000003 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.197814+0000", 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3448999999999999e-05 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.197825+0000", 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1127999999999999e-05 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.826 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.197909+0000", 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4087999999999999e-05 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.197948+0000", 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8322999999999999e-05 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.210635+0000", 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012687240000000001 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.210777+0000", 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142433 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3570 3.31 3:8fcffbc7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_467:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:34.249614+0000", 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.4635249309999998, 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018296537000000002, 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:37.828 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3570 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.249614+0000", 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:37.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.249614+0000", 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.249617+0000", 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.251442+0000", 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001825026 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.251474+0000", 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1838999999999998e-05 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.251486+0000", 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.172e-05 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.251567+0000", 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1605000000000002e-05 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.251749+0000", 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018141000000000001 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.251905+0000", 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015668799999999999 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.256250+0000", 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043446400000000003 2024-04-24T13:33:37.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.267835+0000", 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011585168 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.267877+0000", 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1999999999999998e-05 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.267911+0000", 2024-04-24T13:33:37.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3624000000000002e-05 2024-04-24T13:33:37.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.834 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.834 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:37.834 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:37.834 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:37.836 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:33:37.836 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:37.834+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:37.936 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:37.933+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:38.014 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:38.014 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:38.014 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:38.014 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:38.029 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:33:38.075 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:38.074+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:38.139 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:38.138+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:38.146 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:38.146 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:38.147 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:38.147 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:38.147 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:38.160 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:33:38.239 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:38.237+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:38.325 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:38.325 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:38.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:38.325 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:38.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.325 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2206 3.f 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:38.325 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:38.325 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 70.033133304000003, 2024-04-24T13:33:38.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028291495999999999, 2024-04-24T13:33:38.326 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.326 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.326 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.326 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.326 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2206 2024-04-24T13:33:38.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.326 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290398+0000", 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000001e-06 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294671+0000", 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042724390000000003 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294711+0000", 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0376000000000001e-05 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294730+0000", 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8607e-05 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294856+0000", 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126651 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295125+0000", 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026840700000000002 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295349+0000", 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022454699999999999 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307240+0000", 2024-04-24T13:33:38.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011891048 2024-04-24T13:33:38.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318593+0000", 2024-04-24T13:33:38.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011352777999999999 2024-04-24T13:33:38.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318652+0000", 2024-04-24T13:33:38.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8677000000000001e-05 2024-04-24T13:33:38.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318686+0000", 2024-04-24T13:33:38.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4616000000000002e-05 2024-04-24T13:33:38.331 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.332 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.332 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2669 3.21 3:86a0e0c3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:38.332 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:38.332 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.121202644999997, 2024-04-24T13:33:38.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020962138000000002, 2024-04-24T13:33:38.332 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.332 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2669 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:38.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202328+0000", 2024-04-24T13:33:38.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-06 2024-04-24T13:33:38.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204239+0000", 2024-04-24T13:33:38.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019104409999999999 2024-04-24T13:33:38.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204265+0000", 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6054000000000002e-05 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204279+0000", 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3654e-05 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204361+0000", 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2522999999999996e-05 2024-04-24T13:33:38.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204523+0000", 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000162332 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204661+0000", 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013798200000000001 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.210336+0000", 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056743339999999996 2024-04-24T13:33:38.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223107+0000", 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012771714999999999 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223228+0000", 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012061300000000001 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223288+0000", 2024-04-24T13:33:38.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9537999999999998e-05 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2710 3.3b 3:ddce91ac:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.811400237000001, 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026438756000000001, 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.338 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2710 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512131+0000", 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0130000000000002e-06 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514363+0000", 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022325940000000001 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514394+0000", 2024-04-24T13:33:38.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0144000000000001e-05 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514409+0000", 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5786000000000001e-05 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514497+0000", 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7876999999999999e-05 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514670+0000", 2024-04-24T13:33:38.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000173096 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514768+0000", 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8089000000000002e-05 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.523354+0000", 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085854190000000004 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538483+0000", 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015128922 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538527+0000", 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3835999999999998e-05 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538567+0000", 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.998e-05 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.343 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2808 3.2e 3:7441f999:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 31.792165535999999, 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021413788, 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2808 2024-04-24T13:33:38.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531366+0000", 2024-04-24T13:33:38.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1089999999999998e-06 2024-04-24T13:33:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533059+0000", 2024-04-24T13:33:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001693186 2024-04-24T13:33:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533088+0000", 2024-04-24T13:33:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9470000000000001e-05 2024-04-24T13:33:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533100+0000", 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1979e-05 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533176+0000", 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5691000000000004e-05 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533334+0000", 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015822199999999999 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533513+0000", 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178846 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.546303+0000", 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012790331 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552696+0000", 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063923169999999998 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552741+0000", 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126999999999997e-05 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552776+0000", 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5509999999999997e-05 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3094 3.14 3:29338048:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:38.349 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.7271730640000005, 2024-04-24T13:33:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022112211, 2024-04-24T13:33:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3094 2024-04-24T13:33:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596358+0000", 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6560000000000001e-06 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598612+0000", 2024-04-24T13:33:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022539050000000001 2024-04-24T13:33:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598639+0000", 2024-04-24T13:33:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7767e-05 2024-04-24T13:33:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598651+0000", 2024-04-24T13:33:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:33:38.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598735+0000", 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4176000000000002e-05 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598928+0000", 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019318199999999999 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.599089+0000", 2024-04-24T13:33:38.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016078899999999999 2024-04-24T13:33:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.612538+0000", 2024-04-24T13:33:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013449081999999999 2024-04-24T13:33:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618346+0000", 2024-04-24T13:33:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058079799999999999 2024-04-24T13:33:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618413+0000", 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7101999999999996e-05 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618467+0000", 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4295000000000001e-05 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3128 3.1f 3:f8849f48:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:38.355 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.3367890800000009, 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027867126999999998, 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3128 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:38.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986743+0000", 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.495e-06 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988482+0000", 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001739237 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988510+0000", 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8343999999999998e-05 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988525+0000", 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5384999999999999e-05 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988630+0000", 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010412 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988808+0000", 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178123 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988956+0000", 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014802399999999999 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.995102+0000", 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061461179999999999 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014480+0000", 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019378581999999998 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014541+0000", 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1007000000000001e-05 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014606+0000", 2024-04-24T13:33:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4691999999999997e-05 2024-04-24T13:33:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3130 3.f 3:f22fdcf5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:38.361 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.3136076249999995, 2024-04-24T13:33:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021419780999999999, 2024-04-24T13:33:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3130 2024-04-24T13:33:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009923+0000", 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5890000000000001e-06 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011652+0000", 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017287419999999999 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011692+0000", 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0346000000000003e-05 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011707+0000", 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5068e-05 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011805+0000", 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7935000000000003e-05 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011984+0000", 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178629 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.012159+0000", 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017566500000000001 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.025987+0000", 2024-04-24T13:33:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013827409000000001 2024-04-24T13:33:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031173+0000", 2024-04-24T13:33:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051865590000000003 2024-04-24T13:33:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031263+0000", 2024-04-24T13:33:38.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9598000000000005e-05 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031340+0000", 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7241000000000001e-05 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3406 3.3b 3:dffc7604:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.7681622160000003, 2024-04-24T13:33:38.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020810539999999999, 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3406 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555369+0000", 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.672e-06 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557249+0000", 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001880086 2024-04-24T13:33:38.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557282+0000", 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3065000000000003e-05 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557297+0000", 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4990999999999999e-05 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557389+0000", 2024-04-24T13:33:38.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2447000000000004e-05 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557525+0000", 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135821 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557677+0000", 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015188699999999999 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.564715+0000", 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070385329999999996 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576037+0000", 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011321721999999999 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576112+0000", 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4924000000000003e-05 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576176+0000", 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4392000000000003e-05 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3426 3.f 3:f3517f93:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_324:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.5296755930000003, 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024699635000000001, 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.373 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3426 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:38.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793855+0000", 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4669999999999998e-06 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796548+0000", 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026926369999999999 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796572+0000", 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4456000000000001e-05 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796586+0000", 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3937000000000001e-05 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796690+0000", 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104226 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796877+0000", 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018668299999999999 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.797048+0000", 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017070599999999999 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.817921+0000", 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020873198999999999 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818393+0000", 2024-04-24T13:33:38.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000472459 2024-04-24T13:33:38.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818475+0000", 2024-04-24T13:33:38.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1403999999999995e-05 2024-04-24T13:33:38.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818552+0000", 2024-04-24T13:33:38.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7460999999999996e-05 2024-04-24T13:33:38.378 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.378 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3427 3.21 3:854a3dc6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_325:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.5190434540000002, 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023613657999999999, 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.379 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3427 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804488+0000", 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.23e-06 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807535+0000", 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030472709999999998 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807563+0000", 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8087999999999999e-05 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807579+0000", 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5732000000000001e-05 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807691+0000", 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111894 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807850+0000", 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015951999999999999 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:38.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.808005+0000", 2024-04-24T13:33:38.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154487 2024-04-24T13:33:38.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.823418+0000", 2024-04-24T13:33:38.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015413526 2024-04-24T13:33:38.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828003+0000", 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045842299999999999 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828048+0000", 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5504999999999999e-05 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828098+0000", 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0175e-05 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.384 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3430 3.3b 3:de51c163:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.4858186059999996, 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025624112000000001, 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.385 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3430 2024-04-24T13:33:38.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.386 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:38.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:38.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837713+0000", 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6509999999999999e-06 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839548+0000", 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001834521 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839577+0000", 2024-04-24T13:33:38.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8850999999999999e-05 2024-04-24T13:33:38.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839611+0000", 2024-04-24T13:33:38.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4140000000000002e-05 2024-04-24T13:33:38.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839718+0000", 2024-04-24T13:33:38.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107534 2024-04-24T13:33:38.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839883+0000", 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016485999999999999 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.840056+0000", 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017321200000000001 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849455+0000", 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093988590000000007 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863165+0000", 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013710178 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863263+0000", 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7559000000000006e-05 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863334+0000", 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0747000000000006e-05 2024-04-24T13:33:38.390 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3443 3.a e113/48 3:53aaab58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_341:head v 113'18, mlcod=113'16)", 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.3478715210000001, 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022399639999999998, 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975668+0000", 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.113e-05 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979725+0000", 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040574219999999998 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979759+0000", 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4362000000000001e-05 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979774+0000", 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4935e-05 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979871+0000", 2024-04-24T13:33:38.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.658e-05 2024-04-24T13:33:38.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979901+0000", 2024-04-24T13:33:38.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-05 2024-04-24T13:33:38.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.997990+0000", 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018089483 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.998056+0000", 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6208e-05 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3458 3.f 3:f34a4471:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:38.395 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.2033551879999997, 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026075494000000001, 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3458 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:38.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120175+0000", 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5220000000000002e-06 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121620+0000", 2024-04-24T13:33:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014442280000000001 2024-04-24T13:33:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121646+0000", 2024-04-24T13:33:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6424999999999999e-05 2024-04-24T13:33:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121659+0000", 2024-04-24T13:33:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:33:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121754+0000", 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4388999999999994e-05 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121968+0000", 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021460199999999999 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.122165+0000", 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019710999999999999 2024-04-24T13:33:38.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.141554+0000", 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019388847000000001 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146083+0000", 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045284469999999997 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146129+0000", 2024-04-24T13:33:38.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6257000000000001e-05 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146248+0000", 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011958100000000001 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3460 3.a e113/48 3:5102140b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_358:head v 113'19, mlcod=113'17)", 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1773411649999996, 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025573478, 2024-04-24T13:33:38.401 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.402 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.402 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.402 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:38.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:38.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146188+0000", 2024-04-24T13:33:38.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.02e-07 2024-04-24T13:33:38.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150270+0000", 2024-04-24T13:33:38.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004082011 2024-04-24T13:33:38.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150302+0000", 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2570999999999997e-05 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150319+0000", 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6843000000000001e-05 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150404+0000", 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4538999999999998e-05 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150432+0000", 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8098000000000001e-05 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.170266+0000", 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019834497 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171760+0000", 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001494017 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.406 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3461 3.3b 3:dfe1b3a0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_359:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:38.406 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:38.406 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1746332590000002, 2024-04-24T13:33:38.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024256994, 2024-04-24T13:33:38.406 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.406 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.406 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.406 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.406 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3461 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148898+0000", 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6970000000000002e-06 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150603+0000", 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017049809999999999 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150615+0000", 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2368000000000001e-05 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150620+0000", 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5210000000000002e-06 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150671+0000", 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0315000000000002e-05 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150844+0000", 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017304399999999999 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.151009+0000", 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016544800000000001 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171479+0000", 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020469355000000002 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173035+0000", 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001556857 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173096+0000", 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0285999999999998e-05 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173152+0000", 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6122000000000002e-05 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3491 3.14 3:2a9aeaa0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_389:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:38.411 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.8608813550000001, 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029663012999999998, 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3491 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462649+0000", 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.65e-06 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464539+0000", 2024-04-24T13:33:38.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001889527 2024-04-24T13:33:38.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464565+0000", 2024-04-24T13:33:38.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6061999999999999e-05 2024-04-24T13:33:38.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464580+0000", 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5273000000000001e-05 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464678+0000", 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7639000000000005e-05 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464899+0000", 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000220638 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:38.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.465088+0000", 2024-04-24T13:33:38.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018922700000000001 2024-04-24T13:33:38.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.478519+0000", 2024-04-24T13:33:38.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013430884000000001 2024-04-24T13:33:38.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492184+0000", 2024-04-24T13:33:38.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013665797 2024-04-24T13:33:38.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492260+0000", 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6038999999999995e-05 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492310+0000", 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9277000000000003e-05 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.418 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3514 3.a e114/48 3:5344e333:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_412:head v 114'23, mlcod=114'21)", 2024-04-24T13:33:38.418 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:38.418 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.6218096400000004, 2024-04-24T13:33:38.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021739380999999999, 2024-04-24T13:33:38.418 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.418 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.418 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.418 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:38.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:38.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701734+0000", 2024-04-24T13:33:38.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5807999999999998e-05 2024-04-24T13:33:38.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705769+0000", 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040343660000000002 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705801+0000", 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2406000000000001e-05 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705816+0000", 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4537e-05 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705925+0000", 2024-04-24T13:33:38.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109114 2024-04-24T13:33:38.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705959+0000", 2024-04-24T13:33:38.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4239999999999997e-05 2024-04-24T13:33:38.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723399+0000", 2024-04-24T13:33:38.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017439748000000001 2024-04-24T13:33:38.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.422 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723458+0000", 2024-04-24T13:33:38.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9162e-05 2024-04-24T13:33:38.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.422 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.422 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.422 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.422 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3525 3.f 3:f35962b2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_423:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:38.422 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:38.422 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.516310753, 2024-04-24T13:33:38.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028712260999999999, 2024-04-24T13:33:38.423 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.423 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.423 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.423 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.423 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.423 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.423 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3525 2024-04-24T13:33:38.423 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.423 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.423 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.423 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.423 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:38.423 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807221+0000", 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7529999999999999e-06 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.424 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813425+0000", 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062037280000000004 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813449+0000", 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813462+0000", 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200999999999999e-05 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.425 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813554+0000", 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2369999999999998e-05 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813730+0000", 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017569800000000001 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813908+0000", 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178219 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.426 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.826992+0000", 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013083567000000001 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835795+0000", 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088026630000000005 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835870+0000", 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5649999999999996e-05 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.427 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835930+0000", 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9318999999999999e-05 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3528 3.3b 3:dc395008:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_426:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.4879666870000001, 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024383452999999999, 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.428 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3528 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:38.429 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835564+0000", 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7369999999999998e-06 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837236+0000", 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001671964 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.430 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837275+0000", 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8760000000000002e-05 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837292+0000", 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6884999999999998e-05 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837382+0000", 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9809999999999996e-05 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837556+0000", 2024-04-24T13:33:38.431 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174103 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837728+0000", 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017202600000000001 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859492+0000", 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021764644999999999 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859714+0000", 2024-04-24T13:33:38.432 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221809 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859857+0000", 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142738 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859945+0000", 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7975999999999999e-05 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.433 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3596 3.3b 3:dcf4b716:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_493:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 3.8009415300000002, 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021336183000000002, 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3596 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.434 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522589+0000", 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.853e-06 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.435 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524412+0000", 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018229559999999999 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524440+0000", 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7489999999999999e-05 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524454+0000", 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4565e-05 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.436 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524556+0000", 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101166 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524666+0000", 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109918 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524816+0000", 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015030800000000001 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.437 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.531231+0000", 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064155159999999996 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543790+0000", 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012558565000000001 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543865+0000", 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4999999999999993e-05 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.438 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543923+0000", 2024-04-24T13:33:38.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7846000000000001e-05 2024-04-24T13:33:38.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.439 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.439 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.439 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.439 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:38.440 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:33:38.441 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:38.437+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:38.441 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:33:38.542 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:38.538+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:38.608 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:38.608 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:38.608 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:38.608 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:38.623 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:33:38.667 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:38.666+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:38.743 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:38.741+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:38.781 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:38.781 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:38.781 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:38.781 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:38.781 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:38.795 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:33:38.844 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:38.841+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:38.918 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:38.919 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:38.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:38.919 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:38.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.919 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2207 3.38 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:38.919 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:38.919 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 70.612268079000003, 2024-04-24T13:33:38.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022686873999999999, 2024-04-24T13:33:38.919 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.919 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.919 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.919 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2207 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:38.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302499+0000", 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307861+0000", 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053622089999999997 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307899+0000", 2024-04-24T13:33:38.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978999999999997e-05 2024-04-24T13:33:38.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307917+0000", 2024-04-24T13:33:38.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8576999999999998e-05 2024-04-24T13:33:38.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308018+0000", 2024-04-24T13:33:38.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010080499999999999 2024-04-24T13:33:38.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308202+0000", 2024-04-24T13:33:38.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000183628 2024-04-24T13:33:38.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:38.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308352+0000", 2024-04-24T13:33:38.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149806 2024-04-24T13:33:38.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318520+0000", 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010168744 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.324908+0000", 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063874739999999998 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325063+0000", 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155131 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325182+0000", 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011915499999999999 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 70.588673365999995, 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.928 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:33:38.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:33:38.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:33:38.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:33:38.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.933 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.934 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:38.934 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:38.934 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 70.443617512000003, 2024-04-24T13:33:38.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:33:38.934 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.934 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.934 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.935 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:33:38.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.935 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:38.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:38.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:33:38.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:33:38.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.939 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2242 3.b 3:d16b554f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 70.175118580000003, 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022940439, 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2242 2024-04-24T13:33:38.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739648+0000", 2024-04-24T13:33:38.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.785e-06 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741765+0000", 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002117655 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741781+0000", 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6062e-05 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741792+0000", 2024-04-24T13:33:38.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0937999999999999e-05 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741918+0000", 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623199999999999 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742189+0000", 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027047300000000002 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:38.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742430+0000", 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024077699999999999 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752990+0000", 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010559875 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762422+0000", 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094325120000000005 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762510+0000", 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7879000000000003e-05 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762585+0000", 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5251000000000002e-05 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2662 3.33 3:ce195145:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:38.945 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.786200272999999, 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028670389000000001, 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2662 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:38.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128567+0000", 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4640000000000002e-06 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130845+0000", 2024-04-24T13:33:38.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002278389 2024-04-24T13:33:38.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130869+0000", 2024-04-24T13:33:38.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4394999999999999e-05 2024-04-24T13:33:38.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130879+0000", 2024-04-24T13:33:38.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0000000000000001e-05 2024-04-24T13:33:38.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130957+0000", 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7968999999999998e-05 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130963+0000", 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2499999999999997e-06 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137507+0000", 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065442900000000003 2024-04-24T13:33:38.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137607+0000", 2024-04-24T13:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010002599999999999 2024-04-24T13:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137727+0000", 2024-04-24T13:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120142 2024-04-24T13:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152307+0000", 2024-04-24T13:33:38.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01458017 2024-04-24T13:33:38.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157112+0000", 2024-04-24T13:33:38.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048051350000000003 2024-04-24T13:33:38.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157181+0000", 2024-04-24T13:33:38.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9051e-05 2024-04-24T13:33:38.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157233+0000", 2024-04-24T13:33:38.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2108000000000003e-05 2024-04-24T13:33:38.952 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.952 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.952 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.952 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2676 3.22 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:38.952 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:38.952 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.642998364999997, 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025889562000000001, 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2676 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:38.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271767+0000", 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.273986+0000", 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022195560000000001 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274011+0000", 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4953e-05 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274023+0000", 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1856e-05 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274116+0000", 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3168e-05 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274377+0000", 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026071500000000001 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274531+0000", 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015427299999999999 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297124+0000", 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022592476 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297544+0000", 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000420691 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297605+0000", 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0888999999999999e-05 2024-04-24T13:33:38.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297655+0000", 2024-04-24T13:33:38.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9119999999999997e-05 2024-04-24T13:33:38.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.958 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.958 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.958 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2722 3.25 e101/20 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head v 101'6, mlcod=86'4)", 2024-04-24T13:33:38.958 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:38.959 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.271253084000001, 2024-04-24T13:33:38.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023380372, 2024-04-24T13:33:38.959 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.959 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.959 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.959 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:38.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643511+0000", 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4400000000000001e-07 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647450+0000", 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039389259999999997 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647470+0000", 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0534e-05 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647484+0000", 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3370000000000001e-05 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647599+0000", 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115513 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647629+0000", 2024-04-24T13:33:38.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0145e-05 2024-04-24T13:33:38.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666761+0000", 2024-04-24T13:33:38.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019132303999999999 2024-04-24T13:33:38.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666891+0000", 2024-04-24T13:33:38.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012913599999999999 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2747 3.24 3:2754d069:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 33.016703221999997, 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024857536999999999, 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.963 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2747 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898063+0000", 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5289999999999998e-06 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899956+0000", 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932759999999999 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899984+0000", 2024-04-24T13:33:38.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7801999999999999e-05 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899997+0000", 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3127e-05 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900063+0000", 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900200+0000", 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000137324 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900302+0000", 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010168 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.908151+0000", 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078489579999999996 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922784+0000", 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014633116 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922860+0000", 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5708000000000001e-05 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922918+0000", 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7686000000000003e-05 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2754 3.b 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.936233721999997, 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.032358206, 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2754 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.969 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:38.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:38.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978532+0000", 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6079999999999998e-06 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979768+0000", 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012357869999999999 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979791+0000", 2024-04-24T13:33:38.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3224e-05 2024-04-24T13:33:38.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979804+0000", 2024-04-24T13:33:38.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.274e-05 2024-04-24T13:33:38.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979889+0000", 2024-04-24T13:33:38.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5483999999999997e-05 2024-04-24T13:33:38.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980063+0000", 2024-04-24T13:33:38.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017384599999999999 2024-04-24T13:33:38.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:38.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980227+0000", 2024-04-24T13:33:38.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163764 2024-04-24T13:33:38.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987774+0000", 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075472029999999997 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010776+0000", 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023001886999999999 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010838+0000", 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1527999999999998e-05 2024-04-24T13:33:38.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010888+0000", 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0135e-05 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2811 3.7 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.344594890000003, 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044582597000000002, 2024-04-24T13:33:38.975 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2811 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570171+0000", 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9100000000000001e-06 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580122+0000", 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099505930000000006 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580150+0000", 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7827e-05 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580164+0000", 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4547e-05 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580245+0000", 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0810999999999996e-05 2024-04-24T13:33:38.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580355+0000", 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109656 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580475+0000", 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120278 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607433+0000", 2024-04-24T13:33:38.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026957894 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614636+0000", 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072028359999999998 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614703+0000", 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7645999999999996e-05 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.980 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614751+0000", 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7599000000000003e-05 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2812 3.1e 3:7bd62ca6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.334551009999998, 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.038041177000000002, 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.981 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.982 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.982 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2812 2024-04-24T13:33:38.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.982 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:38.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580214+0000", 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.708e-06 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582574+0000", 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023601799999999999 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582591+0000", 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6648999999999999e-05 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582598+0000", 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.391e-06 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583731+0000", 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011332029999999999 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583843+0000", 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111889 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583936+0000", 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2968999999999997e-05 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.599363+0000", 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015427186000000001 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618143+0000", 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018779051000000001 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618200+0000", 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7151999999999998e-05 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618253+0000", 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3798999999999998e-05 2024-04-24T13:33:38.986 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3110 3.1e 3:79ca4af0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.115492809999999, 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022894164000000002, 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.987 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3110 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.988 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799272+0000", 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9470000000000002e-06 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800698+0000", 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001425204 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800721+0000", 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3577000000000001e-05 2024-04-24T13:33:38.989 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800731+0000", 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9969999999999993e-06 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800797+0000", 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6087999999999995e-05 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800954+0000", 2024-04-24T13:33:38.990 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015699 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.801064+0000", 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109715 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.807584+0000", 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065197479999999997 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.991 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822063+0000", 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014479156999999999 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822122+0000", 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9095000000000003e-05 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822165+0000", 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2645999999999998e-05 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.992 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3117 3.27 3:e455931d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.04413478, 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02353235, 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3117 2024-04-24T13:33:38.993 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:38.994 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870631+0000", 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.075e-06 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872287+0000", 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016561449999999999 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872316+0000", 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9543000000000002e-05 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.995 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872333+0000", 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6806000000000001e-05 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872403+0000", 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9917000000000002e-05 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872540+0000", 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013735200000000001 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.996 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872686+0000", 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014519899999999999 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.878440+0000", 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057539490000000004 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894072+0000", 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015632801000000002 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.997 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894106+0000", 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3933999999999997e-05 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894161+0000", 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4629000000000002e-05 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.998 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3127 3.15 3:a9239ffa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.9394076039999995, 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023707346000000001, 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3127 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:38.999 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:39.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:39.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:39.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:39.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.000 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.000 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:39.000 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975357+0000", 2024-04-24T13:33:39.000 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.418e-06 2024-04-24T13:33:39.000 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:39.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976868+0000", 2024-04-24T13:33:39.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015108719999999999 2024-04-24T13:33:39.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:39.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976894+0000", 2024-04-24T13:33:39.001 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5885e-05 2024-04-24T13:33:39.001 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.001 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.001 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:39.001 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976905+0000", 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1076e-05 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976983+0000", 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8532e-05 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977149+0000", 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016571500000000001 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.002 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977313+0000", 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163719 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.984588+0000", 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072751600000000001 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998908+0000", 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014319705 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.003 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:39.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998988+0000", 2024-04-24T13:33:39.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9839000000000006e-05 2024-04-24T13:33:39.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.004 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:39.004 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.999063+0000", 2024-04-24T13:33:39.004 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5425000000000004e-05 2024-04-24T13:33:39.004 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.004 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:39.004 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.004 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.004 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3136 3.25 e112/20 3:a4e0a0f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_51:head v 112'10, mlcod=102'8)", 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.8383479349999998, 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026701701000000001, 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.005 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076417+0000", 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.779e-06 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077651+0000", 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233428 2024-04-24T13:33:39.006 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077679+0000", 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8535e-05 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077694+0000", 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077775+0000", 2024-04-24T13:33:39.007 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0927000000000006e-05 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077801+0000", 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5933999999999999e-05 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103085+0000", 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284238000000001 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103117+0000", 2024-04-24T13:33:39.008 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1917e-05 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3429 3.7 3:e226ff6b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_327:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 6.0881786289999997, 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023122228000000002, 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:39.009 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3429 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.010 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826588+0000", 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.942e-06 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829078+0000", 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002489982 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829098+0000", 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0747999999999999e-05 2024-04-24T13:33:39.011 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829110+0000", 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1569000000000001e-05 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829206+0000", 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6303000000000003e-05 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829419+0000", 2024-04-24T13:33:39.012 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021229300000000001 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829606+0000", 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187219 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.835770+0000", 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061641819999999998 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849620+0000", 2024-04-24T13:33:39.013 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013849889000000001 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849663+0000", 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2725999999999997e-05 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849707+0000", 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4375000000000001e-05 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.014 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3484 3.18 3:1a64f732:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_382:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.5331834500000001, 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029616456999999999, 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3484 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.015 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381583+0000", 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6510000000000001e-06 2024-04-24T13:33:39.016 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382670+0000", 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010878870000000001 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382689+0000", 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8723999999999999e-05 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382700+0000", 2024-04-24T13:33:39.017 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0908e-05 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385156+0000", 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002456176 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385287+0000", 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013060400000000001 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:39.018 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385402+0000", 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115658 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.406717+0000", 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021314317999999999 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411063+0000", 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043465719999999999 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:39.019 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411141+0000", 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7193000000000004e-05 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411196+0000", 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5766000000000001e-05 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3483 3.c e114/103 3:3033c1b6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_381:head v 114'16, mlcod=113'14)", 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:39.020 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.5309982389999996, 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028448153, 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:39.021 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383766+0000", 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0130000000000001e-06 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387173+0000", 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034066330000000001 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:39.022 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387201+0000", 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8705999999999999e-05 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387216+0000", 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5019e-05 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387369+0000", 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015276299999999999 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:39.023 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387397+0000", 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7559000000000002e-05 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412160+0000", 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024763314000000002 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412213+0000", 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3146000000000002e-05 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:39.024 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3501 3.24 3:27356806:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_399:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.3541107629999996, 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029132884000000001, 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3501 2024-04-24T13:33:39.025 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560656+0000", 2024-04-24T13:33:39.026 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.066e-06 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562392+0000", 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017359980000000001 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562431+0000", 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9325e-05 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:39.027 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562453+0000", 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2476e-05 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562541+0000", 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7678999999999999e-05 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562688+0000", 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014673600000000001 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:39.028 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562785+0000", 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6903000000000004e-05 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.571188+0000", 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084030449999999996 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589689+0000", 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018500876999999999 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.029 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589735+0000", 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589785+0000", 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0290999999999997e-05 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3521 3.1e 3:7803006f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_419:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:39.030 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1471589169999996, 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024446572999999999, 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3521 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:39.031 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767608+0000", 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3239999999999999e-06 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:39.032 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770197+0000", 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025895129999999999 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770220+0000", 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2605000000000001e-05 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770233+0000", 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3159999999999999e-05 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.033 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770329+0000", 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5995999999999994e-05 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770543+0000", 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000214348 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770732+0000", 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000188975 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.034 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.779877+0000", 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0091449860000000008 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.791883+0000", 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012005266000000001 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792002+0000", 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119351 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:39.035 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792051+0000", 2024-04-24T13:33:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9048999999999997e-05 2024-04-24T13:33:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:39.036 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:39.036 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:39.037 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:33:39.038 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:39.037+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:39.039 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:33:39.138 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:39.134+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:39.171 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:39.172 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:39.172 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:33:39.172 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:39.187 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:33:39.229 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:39.229 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:39.239 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:39.237+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:39.244 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:39.245 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:39.261 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:39.261 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:39.277 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:39.277 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:39.297 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:39.297 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:39.312 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:39.312 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:39.316 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:39.317 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:39.326 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:33:39.335 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:39.335 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:39.340 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:39.338+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:39.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:39.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:39.421 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:33:39.440 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:39.437+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:39.498 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:39.498 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:39.510 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:33:39.554 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:39.553+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:39.642 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:39.641+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:39.673 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:39.674 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:39.687 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:33:39.739 INFO:tasks.thrashosds.thrasher:in_osds: [0, 1, 2, 3, 4, 5, 6] out_osds: [7] dead_osds: [] live_osds: [0, 1, 2, 3, 4, 5, 6, 7] 2024-04-24T13:33:39.739 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-24T13:33:39.742 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:39.742+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:39.843 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:39.842+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:39.854 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:39.855 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:39.871 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:33:39.944 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:39.942+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:39.996 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:39.996 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:40.010 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:33:40.045 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:40.042+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:40.134 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:40.134 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:40.146 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:40.142+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:40.148 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:33:40.247 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:40.245+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:40.270 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:40.270 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:40.284 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:33:40.349 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:40.346+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:40.429 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.0 to 1 (10000) 2024-04-24T13:33:40.449 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:40.446+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:40.450 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:40.450 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:40.455 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-24T13:33:40.464 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:33:40.550 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:40.550+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:40.587 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:40.587 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:40.601 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:40.651 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:40.650+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:40.723 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:40.724 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:40.739 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:40.751 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:40.750+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:40.852 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:40.850+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:40.860 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:40.860 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:40.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:40.953 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:40.949+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:40.997 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:40.997 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:41.010 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:41.054 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:41.053+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:41.129 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:41.129 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:41.144 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:41.191 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:41.190+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:41.256 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:41.253+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:41.267 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:41.267 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:41.282 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:41.357 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:41.353+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:41.370 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:33:41.432 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.1 to 1 (10000) 2024-04-24T13:33:41.440 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:33:41.457 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-24T13:33:41.458 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:41.453+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:41.478 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:41.479 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:41.502 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:33:41.537 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:41.538 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:41.556 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:41.556 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:41.558 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:41.557+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:41.576 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:41.576 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:41.606 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:41.606 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:41.626 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:41.627 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:41.655 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:41.655 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:41.655 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:41.655 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:41.655 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:41.659 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:41.657+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:41.660 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:41.660 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:41.669 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:33:41.681 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:41.681 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:41.701 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:41.702 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:41.763 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:41.762+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:41.793 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:41.793 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:41.793 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:41.794 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:41.794 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.794 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2252 3.4 3:22834b58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_47:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:41.794 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:41.794 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 72.946771436999995, 2024-04-24T13:33:41.794 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019932545999999999, 2024-04-24T13:33:41.794 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.794 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.794 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.794 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:41.794 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:41.794 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:41.794 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2252 2024-04-24T13:33:41.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.795 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:41.795 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.795 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.795 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.795 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.795 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845579+0000", 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.845581+0000", 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.712e-06 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847834+0000", 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002252843 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.796 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847863+0000", 2024-04-24T13:33:41.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.904e-05 2024-04-24T13:33:41.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.797 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.797 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847877+0000", 2024-04-24T13:33:41.797 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4126e-05 2024-04-24T13:33:41.797 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.797 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.847963+0000", 2024-04-24T13:33:41.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6162999999999995e-05 2024-04-24T13:33:41.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848105+0000", 2024-04-24T13:33:41.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014117900000000001 2024-04-24T13:33:41.798 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.798 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.798 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:41.798 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.848252+0000", 2024-04-24T13:33:41.798 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014774800000000001 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865043+0000", 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016790848000000001 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865405+0000", 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00036176900000000001 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.799 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865460+0000", 2024-04-24T13:33:41.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5334000000000002e-05 2024-04-24T13:33:41.800 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.800 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.800 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.800 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.865511+0000", 2024-04-24T13:33:41.800 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0784e-05 2024-04-24T13:33:41.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.800 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.800 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.801 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.801 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.801 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2663 3.0 3:01df44a3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:41.801 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:41.801 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.652997403999997, 2024-04-24T13:33:41.801 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020742727999999998, 2024-04-24T13:33:41.801 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.801 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.801 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.801 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:41.801 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:41.801 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:41.801 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2663 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139353+0000", 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.802 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.139355+0000", 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2529999999999999e-06 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141777+0000", 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002422638 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141800+0000", 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2949e-05 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.803 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141812+0000", 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1551e-05 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141907+0000", 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5296000000000004e-05 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.141917+0000", 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.414e-06 2024-04-24T13:33:41.804 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144519+0000", 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026024220000000001 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144684+0000", 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000164511 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.144845+0000", 2024-04-24T13:33:41.805 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016157000000000001 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.156972+0000", 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012126855000000001 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.159989+0000", 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003016609 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.806 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160059+0000", 2024-04-24T13:33:41.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0598000000000004e-05 2024-04-24T13:33:41.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.807 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.807 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.160095+0000", 2024-04-24T13:33:41.807 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6062000000000001e-05 2024-04-24T13:33:41.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.807 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.807 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.807 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.807 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.807 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2672 3.1c e100/74 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head v 100'4, mlcod=85'2)", 2024-04-24T13:33:41.807 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:41.808 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.554855846999999, 2024-04-24T13:33:41.808 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022091785999999999, 2024-04-24T13:33:41.808 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.808 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.808 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.808 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.808 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.808 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.808 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237494+0000", 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.237495+0000", 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.1500000000000005e-07 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.809 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.810 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243044+0000", 2024-04-24T13:33:41.810 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055497869999999996 2024-04-24T13:33:41.810 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.810 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.810 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243082+0000", 2024-04-24T13:33:41.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7208e-05 2024-04-24T13:33:41.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.811 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.811 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243097+0000", 2024-04-24T13:33:41.811 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5554e-05 2024-04-24T13:33:41.811 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.811 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243175+0000", 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7849999999999995e-05 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.243194+0000", 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8822999999999999e-05 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259527+0000", 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016333007 2024-04-24T13:33:41.812 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.813 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.813 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.259586+0000", 2024-04-24T13:33:41.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9042000000000002e-05 2024-04-24T13:33:41.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.813 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.813 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.813 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.813 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.813 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2706 3.1c e100/74 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head v 100'5, mlcod=86'3)", 2024-04-24T13:33:41.813 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:41.813 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.317550165999997, 2024-04-24T13:33:41.813 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021017514000000001, 2024-04-24T13:33:41.814 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.814 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.814 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.814 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.814 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:41.814 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.814 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.814 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.814 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474800+0000", 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.474802+0000", 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1399999999999998e-06 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480124+0000", 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053217059999999998 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.815 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.816 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.816 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480147+0000", 2024-04-24T13:33:41.816 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3646e-05 2024-04-24T13:33:41.816 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480159+0000", 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2133999999999999e-05 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480237+0000", 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7531e-05 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.480291+0000", 2024-04-24T13:33:41.817 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3851999999999999e-05 2024-04-24T13:33:41.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.818 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.818 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495746+0000", 2024-04-24T13:33:41.818 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015454684 2024-04-24T13:33:41.818 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.818 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.495817+0000", 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.1821000000000002e-05 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2722 3.25 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.160146156000003, 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.035782711000000002, 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.819 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2722 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.820 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632204+0000", 2024-04-24T13:33:41.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.821 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.632207+0000", 2024-04-24T13:33:41.821 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.252e-06 2024-04-24T13:33:41.821 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.821 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.821 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634575+0000", 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023682500000000001 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634606+0000", 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0284999999999999e-05 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634619+0000", 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3491e-05 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.822 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634703+0000", 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4214000000000004e-05 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.634711+0000", 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9719999999999992e-06 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639813+0000", 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051013830000000001 2024-04-24T13:33:41.823 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.639969+0000", 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015674600000000001 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.640112+0000", 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142347 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647222+0000", 2024-04-24T13:33:41.824 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0071106520000000003 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667844+0000", 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020621746999999999 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667925+0000", 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0717999999999995e-05 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.825 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.667987+0000", 2024-04-24T13:33:41.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1654000000000003e-05 2024-04-24T13:33:41.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.826 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.826 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.826 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.826 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.826 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2737 3.4 3:23416714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_66:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:41.826 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:41.826 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.999214051999999, 2024-04-24T13:33:41.826 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019181262000000001, 2024-04-24T13:33:41.826 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.826 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.826 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2737 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.827 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793136+0000", 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.793139+0000", 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7709999999999998e-06 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795403+0000", 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002264252 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.828 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795439+0000", 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5701999999999998e-05 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795454+0000", 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5262999999999999e-05 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795541+0000", 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6989000000000003e-05 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.829 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795719+0000", 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000177906 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.795875+0000", 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155785 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.808532+0000", 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012657695 2024-04-24T13:33:41.830 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812189+0000", 2024-04-24T13:33:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036562809999999999 2024-04-24T13:33:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812258+0000", 2024-04-24T13:33:41.831 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9210999999999999e-05 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.812317+0000", 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9407000000000002e-05 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2781 3.e e101/41 3:704d2ad1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_110:head v 101'4, mlcod=85'2)", 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.541659547000002, 2024-04-24T13:33:41.832 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017614365, 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250690+0000", 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.833 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.250692+0000", 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3570000000000001e-06 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256430+0000", 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057381300000000001 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256465+0000", 2024-04-24T13:33:41.834 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4974000000000001e-05 2024-04-24T13:33:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256480+0000", 2024-04-24T13:33:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5000999999999999e-05 2024-04-24T13:33:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256571+0000", 2024-04-24T13:33:41.835 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.1008999999999995e-05 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.256599+0000", 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7676000000000001e-05 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268237+0000", 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011638081 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.836 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.268305+0000", 2024-04-24T13:33:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.8137000000000002e-05 2024-04-24T13:33:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3106 3.31 3:8f25e7ba:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.755576+0000", 2024-04-24T13:33:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.036773950000001, 2024-04-24T13:33:41.837 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021214703000000001, 2024-04-24T13:33:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3106 2024-04-24T13:33:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.755576+0000", 2024-04-24T13:33:41.838 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.755576+0000", 2024-04-24T13:33:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.755579+0000", 2024-04-24T13:33:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8389999999999998e-06 2024-04-24T13:33:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.839 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.757952+0000", 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002372683 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.757980+0000", 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8708e-05 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.757995+0000", 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4911e-05 2024-04-24T13:33:41.840 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.758094+0000", 2024-04-24T13:33:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8492000000000005e-05 2024-04-24T13:33:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.841 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.758270+0000", 2024-04-24T13:33:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017639399999999999 2024-04-24T13:33:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.758454+0000", 2024-04-24T13:33:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018373599999999999 2024-04-24T13:33:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.762442+0000", 2024-04-24T13:33:41.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039878429999999996 2024-04-24T13:33:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.776653+0000", 2024-04-24T13:33:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014211457 2024-04-24T13:33:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.776731+0000", 2024-04-24T13:33:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7625000000000003e-05 2024-04-24T13:33:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.776791+0000", 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0015000000000001e-05 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3107 3.16 e112/103 3:6bf97696:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_22:head v 112'6, mlcod=0'0)", 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.772636+0000", 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.019714081, 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025533699999999999, 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.844 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.772636+0000", 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.772636+0000", 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.772637+0000", 2024-04-24T13:33:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5799999999999998e-07 2024-04-24T13:33:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787782+0000", 2024-04-24T13:33:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015145608 2024-04-24T13:33:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787807+0000", 2024-04-24T13:33:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5091000000000001e-05 2024-04-24T13:33:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787822+0000", 2024-04-24T13:33:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4627000000000001e-05 2024-04-24T13:33:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787900+0000", 2024-04-24T13:33:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8496000000000002e-05 2024-04-24T13:33:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.787921+0000", 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0718999999999999e-05 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.798124+0000", 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010203067 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.798170+0000", 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5334000000000003e-05 2024-04-24T13:33:41.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3121 3.e e112/41 3:70900501:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_36:head v 112'6, mlcod=101'4)", 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.915485+0000", 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.876865166, 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020805437, 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.915485+0000", 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.915485+0000", 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.915489+0000", 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.498e-06 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921279+0000", 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057893729999999996 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921299+0000", 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0117000000000001e-05 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921309+0000", 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8060000000000006e-06 2024-04-24T13:33:41.851 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921374+0000", 2024-04-24T13:33:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.5617999999999994e-05 2024-04-24T13:33:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.921400+0000", 2024-04-24T13:33:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5479000000000001e-05 2024-04-24T13:33:41.852 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.936231+0000", 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014831372000000001 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.936290+0000", 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9174e-05 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.853 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3136 3.25 3:a4e0a0f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_51:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.073986+0000", 2024-04-24T13:33:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.718364230000001, 2024-04-24T13:33:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029412311, 2024-04-24T13:33:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3136 2024-04-24T13:33:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.854 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.073986+0000", 2024-04-24T13:33:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.073986+0000", 2024-04-24T13:33:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.073988+0000", 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.678e-06 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.075773+0000", 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017841829999999999 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.075797+0000", 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4671000000000001e-05 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.075810+0000", 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2531000000000001e-05 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.075901+0000", 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0815000000000004e-05 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076115+0000", 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000214353 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:41.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076303+0000", 2024-04-24T13:33:41.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187756 2024-04-24T13:33:41.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:41.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.093042+0000", 2024-04-24T13:33:41.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.016738940000000001 2024-04-24T13:33:41.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:41.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103280+0000", 2024-04-24T13:33:41.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010238515 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103347+0000", 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6884999999999994e-05 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103398+0000", 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0983999999999998e-05 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3167 3.0 3:00fbb35f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.423455+0000", 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.368894563, 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021052969000000001, 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3167 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.423455+0000", 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.423455+0000", 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.423458+0000", 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5979999999999999e-06 2024-04-24T13:33:41.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425102+0000", 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016442900000000001 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425133+0000", 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0815000000000002e-05 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425147+0000", 2024-04-24T13:33:41.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4071e-05 2024-04-24T13:33:41.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425222+0000", 2024-04-24T13:33:41.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5030000000000005e-05 2024-04-24T13:33:41.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425347+0000", 2024-04-24T13:33:41.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012445699999999999 2024-04-24T13:33:41.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:41.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.425458+0000", 2024-04-24T13:33:41.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011173199999999999 2024-04-24T13:33:41.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:41.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.439935+0000", 2024-04-24T13:33:41.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01447708 2024-04-24T13:33:41.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:41.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.444421+0000", 2024-04-24T13:33:41.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0044855349999999997 2024-04-24T13:33:41.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.444458+0000", 2024-04-24T13:33:41.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7419999999999997e-05 2024-04-24T13:33:41.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.444508+0000", 2024-04-24T13:33:41.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9941000000000002e-05 2024-04-24T13:33:41.874 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.874 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.874 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.874 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3179 3.6 e112/20 3:61c16905:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_94:head v 112'13, mlcod=112'11)", 2024-04-24T13:33:41.875 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.556235+0000", 2024-04-24T13:33:41.875 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.236114757999999, 2024-04-24T13:33:41.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022311758000000001, 2024-04-24T13:33:41.875 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.875 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.875 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.875 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.556235+0000", 2024-04-24T13:33:41.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.556235+0000", 2024-04-24T13:33:41.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.556237+0000", 2024-04-24T13:33:41.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.193e-06 2024-04-24T13:33:41.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557730+0000", 2024-04-24T13:33:41.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001492192 2024-04-24T13:33:41.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557756+0000", 2024-04-24T13:33:41.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6295000000000002e-05 2024-04-24T13:33:41.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557767+0000", 2024-04-24T13:33:41.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1554e-05 2024-04-24T13:33:41.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557843+0000", 2024-04-24T13:33:41.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5180999999999997e-05 2024-04-24T13:33:41.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.557870+0000", 2024-04-24T13:33:41.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7158e-05 2024-04-24T13:33:41.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578507+0000", 2024-04-24T13:33:41.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020637061000000002 2024-04-24T13:33:41.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.578547+0000", 2024-04-24T13:33:41.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0123999999999997e-05 2024-04-24T13:33:41.883 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.884 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.884 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.884 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3395 3.31 3:8fcdf07d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_293:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:41.884 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.439317+0000", 2024-04-24T13:33:41.884 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.3530326349999999, 2024-04-24T13:33:41.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025892121000000001, 2024-04-24T13:33:41.885 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.885 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.885 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:41.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:41.885 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:41.886 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3395 2024-04-24T13:33:41.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.886 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.439317+0000", 2024-04-24T13:33:41.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.439317+0000", 2024-04-24T13:33:41.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.439320+0000", 2024-04-24T13:33:41.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.655e-06 2024-04-24T13:33:41.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441558+0000", 2024-04-24T13:33:41.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022384409999999999 2024-04-24T13:33:41.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441583+0000", 2024-04-24T13:33:41.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4207e-05 2024-04-24T13:33:41.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441594+0000", 2024-04-24T13:33:41.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1066e-05 2024-04-24T13:33:41.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441680+0000", 2024-04-24T13:33:41.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6247000000000003e-05 2024-04-24T13:33:41.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.441875+0000", 2024-04-24T13:33:41.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019484600000000001 2024-04-24T13:33:41.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:41.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.442055+0000", 2024-04-24T13:33:41.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000180578 2024-04-24T13:33:41.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:41.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.449452+0000", 2024-04-24T13:33:41.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073968510000000003 2024-04-24T13:33:41.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:41.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.465053+0000", 2024-04-24T13:33:41.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015601014999999999 2024-04-24T13:33:41.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.465148+0000", 2024-04-24T13:33:41.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4537000000000006e-05 2024-04-24T13:33:41.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.465209+0000", 2024-04-24T13:33:41.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1678000000000001e-05 2024-04-24T13:33:41.894 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3469 3.3 e113/48 3:c2771714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_367:head v 113'13, mlcod=113'11)", 2024-04-24T13:33:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.238614+0000", 2024-04-24T13:33:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.5537363790000001, 2024-04-24T13:33:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019069234000000001, 2024-04-24T13:33:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.895 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.238614+0000", 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.238614+0000", 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.238614+0000", 2024-04-24T13:33:41.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9899999999999999e-07 2024-04-24T13:33:41.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.242830+0000", 2024-04-24T13:33:41.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042153030000000001 2024-04-24T13:33:41.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.242867+0000", 2024-04-24T13:33:41.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7605999999999999e-05 2024-04-24T13:33:41.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.242884+0000", 2024-04-24T13:33:41.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6928000000000001e-05 2024-04-24T13:33:41.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.242972+0000", 2024-04-24T13:33:41.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7824999999999993e-05 2024-04-24T13:33:41.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243002+0000", 2024-04-24T13:33:41.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9737999999999999e-05 2024-04-24T13:33:41.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.257615+0000", 2024-04-24T13:33:41.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014613311 2024-04-24T13:33:41.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.257683+0000", 2024-04-24T13:33:41.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7724000000000004e-05 2024-04-24T13:33:41.900 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.900 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.900 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.900 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3470 3.19 3:9981181e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_368:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:41.900 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.241358+0000", 2024-04-24T13:33:41.900 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.5509917689999995, 2024-04-24T13:33:41.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01671419, 2024-04-24T13:33:41.900 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.901 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.901 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:41.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:41.901 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:41.901 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3470 2024-04-24T13:33:41.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.901 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.241358+0000", 2024-04-24T13:33:41.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.241358+0000", 2024-04-24T13:33:41.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.241360+0000", 2024-04-24T13:33:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8700000000000001e-06 2024-04-24T13:33:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243053+0000", 2024-04-24T13:33:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001692984 2024-04-24T13:33:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243070+0000", 2024-04-24T13:33:41.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6537000000000001e-05 2024-04-24T13:33:41.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243079+0000", 2024-04-24T13:33:41.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7499999999999998e-06 2024-04-24T13:33:41.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243173+0000", 2024-04-24T13:33:41.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4077000000000001e-05 2024-04-24T13:33:41.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243403+0000", 2024-04-24T13:33:41.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022924100000000001 2024-04-24T13:33:41.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:41.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.243532+0000", 2024-04-24T13:33:41.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012967999999999999 2024-04-24T13:33:41.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:41.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.257963+0000", 2024-04-24T13:33:41.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014431138 2024-04-24T13:33:41.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:41.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.257975+0000", 2024-04-24T13:33:41.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1336e-05 2024-04-24T13:33:41.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.258015+0000", 2024-04-24T13:33:41.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9700000000000003e-05 2024-04-24T13:33:41.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.258072+0000", 2024-04-24T13:33:41.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7877000000000002e-05 2024-04-24T13:33:41.907 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.907 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.907 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3486 3.0 3:011a9dab:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_384:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.404443+0000", 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.3879072079999997, 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020430555, 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3486 2024-04-24T13:33:41.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.909 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.404443+0000", 2024-04-24T13:33:41.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.404443+0000", 2024-04-24T13:33:41.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.404446+0000", 2024-04-24T13:33:41.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9739999999999998e-06 2024-04-24T13:33:41.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.405836+0000", 2024-04-24T13:33:41.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001390636 2024-04-24T13:33:41.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.405859+0000", 2024-04-24T13:33:41.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2901e-05 2024-04-24T13:33:41.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.405874+0000", 2024-04-24T13:33:41.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4632e-05 2024-04-24T13:33:41.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.405993+0000", 2024-04-24T13:33:41.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011942099999999999 2024-04-24T13:33:41.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:41.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.406041+0000", 2024-04-24T13:33:41.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7673999999999998e-05 2024-04-24T13:33:41.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412918+0000", 2024-04-24T13:33:41.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068771609999999997 2024-04-24T13:33:41.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.413078+0000", 2024-04-24T13:33:41.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015979300000000001 2024-04-24T13:33:41.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:41.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.413240+0000", 2024-04-24T13:33:41.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000162201 2024-04-24T13:33:41.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:41.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.423857+0000", 2024-04-24T13:33:41.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010616926 2024-04-24T13:33:41.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:41.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.424802+0000", 2024-04-24T13:33:41.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000944567 2024-04-24T13:33:41.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.424841+0000", 2024-04-24T13:33:41.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8863999999999999e-05 2024-04-24T13:33:41.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.424873+0000", 2024-04-24T13:33:41.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2805000000000002e-05 2024-04-24T13:33:41.915 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.915 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.916 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3545 3.0 3:02affb45:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_443:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:41.916 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:34.006777+0000", 2024-04-24T13:33:41.916 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.7855729790000003, 2024-04-24T13:33:41.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017537812999999999, 2024-04-24T13:33:41.916 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.916 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.916 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.916 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:41.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:41.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:41.917 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3545 2024-04-24T13:33:41.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.917 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.006777+0000", 2024-04-24T13:33:41.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.006777+0000", 2024-04-24T13:33:41.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.006781+0000", 2024-04-24T13:33:41.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6399999999999999e-06 2024-04-24T13:33:41.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.009869+0000", 2024-04-24T13:33:41.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.003087939 2024-04-24T13:33:41.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.009894+0000", 2024-04-24T13:33:41.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5890000000000001e-05 2024-04-24T13:33:41.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.009909+0000", 2024-04-24T13:33:41.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4827000000000001e-05 2024-04-24T13:33:41.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.010002+0000", 2024-04-24T13:33:41.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2664000000000006e-05 2024-04-24T13:33:41.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.010198+0000", 2024-04-24T13:33:41.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019567200000000001 2024-04-24T13:33:41.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:41.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.010382+0000", 2024-04-24T13:33:41.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018480699999999999 2024-04-24T13:33:41.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:41.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.023835+0000", 2024-04-24T13:33:41.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013452988000000001 2024-04-24T13:33:41.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:41.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.024238+0000", 2024-04-24T13:33:41.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00040287400000000001 2024-04-24T13:33:41.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.024281+0000", 2024-04-24T13:33:41.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2868999999999999e-05 2024-04-24T13:33:41.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.024315+0000", 2024-04-24T13:33:41.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3643000000000003e-05 2024-04-24T13:33:41.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.922 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3564 3.16 e114/103 3:6a4ca1e3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_461:head v 114'16, mlcod=113'14)", 2024-04-24T13:33:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:34.192192+0000", 2024-04-24T13:33:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.6001580789999998, 2024-04-24T13:33:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018585483, 2024-04-24T13:33:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.923 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.192192+0000", 2024-04-24T13:33:41.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.192192+0000", 2024-04-24T13:33:41.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.192194+0000", 2024-04-24T13:33:41.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.1909999999999999e-06 2024-04-24T13:33:41.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.197791+0000", 2024-04-24T13:33:41.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0055966310000000003 2024-04-24T13:33:41.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.197814+0000", 2024-04-24T13:33:41.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3448999999999999e-05 2024-04-24T13:33:41.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.197825+0000", 2024-04-24T13:33:41.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1127999999999999e-05 2024-04-24T13:33:41.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.197909+0000", 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4087999999999999e-05 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.197948+0000", 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8322999999999999e-05 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.210635+0000", 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012687240000000001 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.210777+0000", 2024-04-24T13:33:41.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142433 2024-04-24T13:33:41.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.928 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.928 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3570 3.31 3:8fcffbc7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_467:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:41.928 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:34.249614+0000", 2024-04-24T13:33:41.928 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.5427358389999997, 2024-04-24T13:33:41.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018296537000000002, 2024-04-24T13:33:41.928 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3570 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.249614+0000", 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:41.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.249614+0000", 2024-04-24T13:33:41.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:41.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:41.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.249617+0000", 2024-04-24T13:33:41.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8169999999999999e-06 2024-04-24T13:33:41.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:41.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.251442+0000", 2024-04-24T13:33:41.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001825026 2024-04-24T13:33:41.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:41.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.251474+0000", 2024-04-24T13:33:41.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1838999999999998e-05 2024-04-24T13:33:41.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:41.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.251486+0000", 2024-04-24T13:33:41.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.172e-05 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.251567+0000", 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1605000000000002e-05 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.251749+0000", 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018141000000000001 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:41.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.251905+0000", 2024-04-24T13:33:41.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015668799999999999 2024-04-24T13:33:41.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:41.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.256250+0000", 2024-04-24T13:33:41.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043446400000000003 2024-04-24T13:33:41.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:41.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.267835+0000", 2024-04-24T13:33:41.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011585168 2024-04-24T13:33:41.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:41.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.267877+0000", 2024-04-24T13:33:41.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1999999999999998e-05 2024-04-24T13:33:41.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:41.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:41.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:41.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.267911+0000", 2024-04-24T13:33:41.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3624000000000002e-05 2024-04-24T13:33:41.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.935 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:41.935 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:41.935 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:41.937 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:33:41.937 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:41.933+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:42.037 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:42.037+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:42.115 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:42.115 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:42.115 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:42.115 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:42.129 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:33:42.176 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:42.174+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:42.238 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:42.238+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:42.248 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:42.248 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:42.248 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:42.249 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:42.249 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:42.262 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:33:42.339 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:42.337+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:42.435 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:42.436 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:42.436 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:42.436 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:42.436 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.436 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2206 3.f 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:42.437 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:42.437 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 74.141677764999997, 2024-04-24T13:33:42.437 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028291495999999999, 2024-04-24T13:33:42.437 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.437 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.437 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.438 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.438 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.438 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.438 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2206 2024-04-24T13:33:42.438 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.438 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.439 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.439 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:42.439 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.439 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.439 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.440 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:42.440 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.440 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.440 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.440 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290398+0000", 2024-04-24T13:33:42.441 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000001e-06 2024-04-24T13:33:42.441 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.441 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.441 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.441 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294671+0000", 2024-04-24T13:33:42.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042724390000000003 2024-04-24T13:33:42.442 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.442 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.442 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.442 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294711+0000", 2024-04-24T13:33:42.442 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0376000000000001e-05 2024-04-24T13:33:42.443 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.443 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.443 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.443 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294730+0000", 2024-04-24T13:33:42.443 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8607e-05 2024-04-24T13:33:42.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.444 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.444 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294856+0000", 2024-04-24T13:33:42.444 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126651 2024-04-24T13:33:42.444 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.444 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.445 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295125+0000", 2024-04-24T13:33:42.445 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026840700000000002 2024-04-24T13:33:42.445 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.445 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.445 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:42.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295349+0000", 2024-04-24T13:33:42.446 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022454699999999999 2024-04-24T13:33:42.446 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.446 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.446 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.446 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307240+0000", 2024-04-24T13:33:42.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011891048 2024-04-24T13:33:42.447 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.447 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.447 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.447 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318593+0000", 2024-04-24T13:33:42.447 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011352777999999999 2024-04-24T13:33:42.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.448 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.448 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.448 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318652+0000", 2024-04-24T13:33:42.448 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8677000000000001e-05 2024-04-24T13:33:42.448 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.449 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.449 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.449 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318686+0000", 2024-04-24T13:33:42.449 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4616000000000002e-05 2024-04-24T13:33:42.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.449 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.449 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.450 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.450 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.450 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2669 3.21 3:86a0e0c3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:42.450 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:42.450 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.229747105999998, 2024-04-24T13:33:42.451 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020962138000000002, 2024-04-24T13:33:42.451 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.451 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.451 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.451 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.451 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.452 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.452 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2669 2024-04-24T13:33:42.452 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.452 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.452 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.452 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:42.453 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.453 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.453 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.453 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.453 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:42.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.454 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.454 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.454 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.454 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202328+0000", 2024-04-24T13:33:42.454 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-06 2024-04-24T13:33:42.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.455 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.455 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.455 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204239+0000", 2024-04-24T13:33:42.455 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019104409999999999 2024-04-24T13:33:42.455 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.456 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204265+0000", 2024-04-24T13:33:42.456 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6054000000000002e-05 2024-04-24T13:33:42.456 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.456 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.456 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204279+0000", 2024-04-24T13:33:42.457 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3654e-05 2024-04-24T13:33:42.457 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.457 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.457 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.457 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204361+0000", 2024-04-24T13:33:42.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2522999999999996e-05 2024-04-24T13:33:42.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.458 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.458 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.458 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204523+0000", 2024-04-24T13:33:42.458 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000162332 2024-04-24T13:33:42.458 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:42.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204661+0000", 2024-04-24T13:33:42.459 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013798200000000001 2024-04-24T13:33:42.459 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.459 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.459 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.459 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.210336+0000", 2024-04-24T13:33:42.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056743339999999996 2024-04-24T13:33:42.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.460 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223107+0000", 2024-04-24T13:33:42.460 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012771714999999999 2024-04-24T13:33:42.460 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.460 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.460 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223228+0000", 2024-04-24T13:33:42.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012061300000000001 2024-04-24T13:33:42.461 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.461 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.461 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.461 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223288+0000", 2024-04-24T13:33:42.461 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9537999999999998e-05 2024-04-24T13:33:42.461 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.462 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.462 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.462 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.462 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.462 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2710 3.3b 3:ddce91ac:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:42.462 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:42.462 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.919944698000002, 2024-04-24T13:33:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026438756000000001, 2024-04-24T13:33:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2710 2024-04-24T13:33:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.463 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512131+0000", 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0130000000000002e-06 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.464 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514363+0000", 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022325940000000001 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514394+0000", 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0144000000000001e-05 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514409+0000", 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5786000000000001e-05 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.465 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514497+0000", 2024-04-24T13:33:42.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7876999999999999e-05 2024-04-24T13:33:42.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514670+0000", 2024-04-24T13:33:42.466 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000173096 2024-04-24T13:33:42.466 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.466 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.466 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:42.466 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514768+0000", 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8089000000000002e-05 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.523354+0000", 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085854190000000004 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538483+0000", 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015128922 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.467 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538527+0000", 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3835999999999998e-05 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538567+0000", 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.998e-05 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2808 3.2e 3:7441f999:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:42.468 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:42.469 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 35.900709997, 2024-04-24T13:33:42.469 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021413788, 2024-04-24T13:33:42.469 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.469 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.469 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.469 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.469 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.469 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.469 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2808 2024-04-24T13:33:42.469 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.469 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:42.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:42.470 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.470 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.470 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.470 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.470 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531366+0000", 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1089999999999998e-06 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533059+0000", 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001693186 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533088+0000", 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9470000000000001e-05 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.471 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533100+0000", 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1979e-05 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533176+0000", 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5691000000000004e-05 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533334+0000", 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015822199999999999 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.472 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533513+0000", 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178846 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.546303+0000", 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012790331 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552696+0000", 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063923169999999998 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.473 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552741+0000", 2024-04-24T13:33:42.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126999999999997e-05 2024-04-24T13:33:42.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.474 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.474 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552776+0000", 2024-04-24T13:33:42.474 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5509999999999997e-05 2024-04-24T13:33:42.474 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.474 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.474 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.474 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.474 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.474 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3094 3.14 3:29338048:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.835717525, 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022112211, 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3094 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.475 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596358+0000", 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6560000000000001e-06 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.476 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598612+0000", 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022539050000000001 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598639+0000", 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7767e-05 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598651+0000", 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.477 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598735+0000", 2024-04-24T13:33:42.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4176000000000002e-05 2024-04-24T13:33:42.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598928+0000", 2024-04-24T13:33:42.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019318199999999999 2024-04-24T13:33:42.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.478 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.478 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:42.478 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.599089+0000", 2024-04-24T13:33:42.478 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016078899999999999 2024-04-24T13:33:42.478 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.612538+0000", 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013449081999999999 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618346+0000", 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058079799999999999 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618413+0000", 2024-04-24T13:33:42.479 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7101999999999996e-05 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618467+0000", 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4295000000000001e-05 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3128 3.1f 3:f8849f48:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.445333541, 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027867126999999998, 2024-04-24T13:33:42.480 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3128 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.481 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:42.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.482 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986743+0000", 2024-04-24T13:33:42.482 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.495e-06 2024-04-24T13:33:42.482 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.482 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.482 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988482+0000", 2024-04-24T13:33:42.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001739237 2024-04-24T13:33:42.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988510+0000", 2024-04-24T13:33:42.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8343999999999998e-05 2024-04-24T13:33:42.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.483 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.483 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.483 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988525+0000", 2024-04-24T13:33:42.483 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5384999999999999e-05 2024-04-24T13:33:42.483 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988630+0000", 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010412 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988808+0000", 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178123 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988956+0000", 2024-04-24T13:33:42.484 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014802399999999999 2024-04-24T13:33:42.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.995102+0000", 2024-04-24T13:33:42.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061461179999999999 2024-04-24T13:33:42.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.485 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.485 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.485 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014480+0000", 2024-04-24T13:33:42.485 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019378581999999998 2024-04-24T13:33:42.485 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014541+0000", 2024-04-24T13:33:42.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1007000000000001e-05 2024-04-24T13:33:42.486 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.486 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.486 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.486 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014606+0000", 2024-04-24T13:33:42.486 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4691999999999997e-05 2024-04-24T13:33:42.486 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.486 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.487 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.487 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.487 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.487 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3130 3.f 3:f22fdcf5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:42.487 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:42.487 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.422152086000001, 2024-04-24T13:33:42.487 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021419780999999999, 2024-04-24T13:33:42.487 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.487 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.487 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.487 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.487 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.487 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3130 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.488 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009923+0000", 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5890000000000001e-06 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011652+0000", 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017287419999999999 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011692+0000", 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0346000000000003e-05 2024-04-24T13:33:42.489 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011707+0000", 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5068e-05 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011805+0000", 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7935000000000003e-05 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011984+0000", 2024-04-24T13:33:42.490 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178629 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.012159+0000", 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017566500000000001 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.025987+0000", 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013827409000000001 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.491 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031173+0000", 2024-04-24T13:33:42.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051865590000000003 2024-04-24T13:33:42.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031263+0000", 2024-04-24T13:33:42.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9598000000000005e-05 2024-04-24T13:33:42.492 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.492 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.492 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.492 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031340+0000", 2024-04-24T13:33:42.492 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7241000000000001e-05 2024-04-24T13:33:42.492 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.492 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3406 3.3b 3:dffc7604:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.8767066769999996, 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020810539999999999, 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.493 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3406 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.494 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555369+0000", 2024-04-24T13:33:42.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.672e-06 2024-04-24T13:33:42.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557249+0000", 2024-04-24T13:33:42.495 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001880086 2024-04-24T13:33:42.495 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.495 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.495 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.495 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557282+0000", 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3065000000000003e-05 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557297+0000", 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4990999999999999e-05 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557389+0000", 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2447000000000004e-05 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.496 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557525+0000", 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135821 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557677+0000", 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015188699999999999 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.564715+0000", 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070385329999999996 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.497 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576037+0000", 2024-04-24T13:33:42.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011321721999999999 2024-04-24T13:33:42.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576112+0000", 2024-04-24T13:33:42.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4924000000000003e-05 2024-04-24T13:33:42.498 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.498 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.498 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.498 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576176+0000", 2024-04-24T13:33:42.498 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4392000000000003e-05 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3426 3.f 3:f3517f93:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_324:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6382200539999996, 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024699635000000001, 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.499 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3426 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.500 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793855+0000", 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4669999999999998e-06 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796548+0000", 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026926369999999999 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796572+0000", 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4456000000000001e-05 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.501 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796586+0000", 2024-04-24T13:33:42.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3937000000000001e-05 2024-04-24T13:33:42.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796690+0000", 2024-04-24T13:33:42.502 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104226 2024-04-24T13:33:42.502 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.502 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.502 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.502 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796877+0000", 2024-04-24T13:33:42.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018668299999999999 2024-04-24T13:33:42.503 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.503 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.503 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:42.503 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.797048+0000", 2024-04-24T13:33:42.503 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017070599999999999 2024-04-24T13:33:42.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.817921+0000", 2024-04-24T13:33:42.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020873198999999999 2024-04-24T13:33:42.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.504 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.504 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818393+0000", 2024-04-24T13:33:42.504 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000472459 2024-04-24T13:33:42.504 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.504 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818475+0000", 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1403999999999995e-05 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818552+0000", 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7460999999999996e-05 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3427 3.21 3:854a3dc6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_325:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:42.505 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.6275879149999994, 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023613657999999999, 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3427 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.506 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804488+0000", 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.23e-06 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.507 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807535+0000", 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030472709999999998 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807563+0000", 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8087999999999999e-05 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807579+0000", 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5732000000000001e-05 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.508 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807691+0000", 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111894 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807850+0000", 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015951999999999999 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.808005+0000", 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154487 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.509 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.823418+0000", 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015413526 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828003+0000", 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045842299999999999 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828048+0000", 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5504999999999999e-05 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.510 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828098+0000", 2024-04-24T13:33:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0175e-05 2024-04-24T13:33:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3430 3.3b 3:de51c163:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.5943630669999997, 2024-04-24T13:33:42.511 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025624112000000001, 2024-04-24T13:33:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3430 2024-04-24T13:33:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.512 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837713+0000", 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6509999999999999e-06 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.513 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839548+0000", 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001834521 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839577+0000", 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8850999999999999e-05 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839611+0000", 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4140000000000002e-05 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.514 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839718+0000", 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107534 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839883+0000", 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016485999999999999 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.840056+0000", 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017321200000000001 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.515 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849455+0000", 2024-04-24T13:33:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093988590000000007 2024-04-24T13:33:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863165+0000", 2024-04-24T13:33:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013710178 2024-04-24T13:33:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.516 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863263+0000", 2024-04-24T13:33:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7559000000000006e-05 2024-04-24T13:33:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863334+0000", 2024-04-24T13:33:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0747000000000006e-05 2024-04-24T13:33:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3443 3.a e113/48 3:53aaab58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_341:head v 113'18, mlcod=113'16)", 2024-04-24T13:33:42.517 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.4564159819999993, 2024-04-24T13:33:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022399639999999998, 2024-04-24T13:33:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.518 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975668+0000", 2024-04-24T13:33:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.113e-05 2024-04-24T13:33:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979725+0000", 2024-04-24T13:33:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040574219999999998 2024-04-24T13:33:42.519 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979759+0000", 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4362000000000001e-05 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979774+0000", 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4935e-05 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979871+0000", 2024-04-24T13:33:42.520 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.658e-05 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979901+0000", 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-05 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.997990+0000", 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018089483 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.998056+0000", 2024-04-24T13:33:42.521 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6208e-05 2024-04-24T13:33:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3458 3.f 3:f34a4471:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.3118996490000008, 2024-04-24T13:33:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026075494000000001, 2024-04-24T13:33:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.522 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3458 2024-04-24T13:33:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.523 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120175+0000", 2024-04-24T13:33:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5220000000000002e-06 2024-04-24T13:33:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121620+0000", 2024-04-24T13:33:42.524 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014442280000000001 2024-04-24T13:33:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121646+0000", 2024-04-24T13:33:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6424999999999999e-05 2024-04-24T13:33:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121659+0000", 2024-04-24T13:33:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:33:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.525 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121754+0000", 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4388999999999994e-05 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121968+0000", 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021460199999999999 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.122165+0000", 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019710999999999999 2024-04-24T13:33:42.526 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.141554+0000", 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019388847000000001 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146083+0000", 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045284469999999997 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146129+0000", 2024-04-24T13:33:42.527 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6257000000000001e-05 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146248+0000", 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011958100000000001 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3460 3.a e113/48 3:5102140b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_358:head v 113'19, mlcod=113'17)", 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.2858856260000007, 2024-04-24T13:33:42.528 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025573478, 2024-04-24T13:33:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:42.529 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146188+0000", 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.02e-07 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.530 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150270+0000", 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004082011 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150302+0000", 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2570999999999997e-05 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150319+0000", 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6843000000000001e-05 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.531 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150404+0000", 2024-04-24T13:33:42.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4538999999999998e-05 2024-04-24T13:33:42.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150432+0000", 2024-04-24T13:33:42.532 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8098000000000001e-05 2024-04-24T13:33:42.532 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.532 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.532 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.532 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.170266+0000", 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019834497 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171760+0000", 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001494017 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3461 3.3b 3:dfe1b3a0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_359:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:42.533 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.2831777199999994, 2024-04-24T13:33:42.534 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024256994, 2024-04-24T13:33:42.534 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.534 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.534 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.534 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.534 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3461 2024-04-24T13:33:42.534 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.534 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.534 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.534 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.534 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148898+0000", 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6970000000000002e-06 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.535 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150603+0000", 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017049809999999999 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150615+0000", 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2368000000000001e-05 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150620+0000", 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5210000000000002e-06 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.536 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150671+0000", 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0315000000000002e-05 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150844+0000", 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017304399999999999 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.151009+0000", 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016544800000000001 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.537 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171479+0000", 2024-04-24T13:33:42.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020469355000000002 2024-04-24T13:33:42.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173035+0000", 2024-04-24T13:33:42.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001556857 2024-04-24T13:33:42.538 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.538 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.538 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.538 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173096+0000", 2024-04-24T13:33:42.538 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0285999999999998e-05 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173152+0000", 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6122000000000002e-05 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3491 3.14 3:2a9aeaa0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_389:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.9694258159999993, 2024-04-24T13:33:42.539 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029663012999999998, 2024-04-24T13:33:42.540 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.540 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.540 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.540 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.540 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3491 2024-04-24T13:33:42.540 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.540 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.540 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462649+0000", 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.65e-06 2024-04-24T13:33:42.541 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464539+0000", 2024-04-24T13:33:42.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001889527 2024-04-24T13:33:42.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464565+0000", 2024-04-24T13:33:42.542 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6061999999999999e-05 2024-04-24T13:33:42.542 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.542 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.542 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.542 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464580+0000", 2024-04-24T13:33:42.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5273000000000001e-05 2024-04-24T13:33:42.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464678+0000", 2024-04-24T13:33:42.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7639000000000005e-05 2024-04-24T13:33:42.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.543 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.543 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.543 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464899+0000", 2024-04-24T13:33:42.543 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000220638 2024-04-24T13:33:42.543 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:42.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.465088+0000", 2024-04-24T13:33:42.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018922700000000001 2024-04-24T13:33:42.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.544 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.544 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.478519+0000", 2024-04-24T13:33:42.544 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013430884000000001 2024-04-24T13:33:42.544 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.544 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492184+0000", 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013665797 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492260+0000", 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6038999999999995e-05 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492310+0000", 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9277000000000003e-05 2024-04-24T13:33:42.545 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.546 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.546 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.546 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.546 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3514 3.a e114/48 3:5344e333:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_412:head v 114'23, mlcod=114'21)", 2024-04-24T13:33:42.546 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:42.546 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.7303541009999996, 2024-04-24T13:33:42.546 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021739380999999999, 2024-04-24T13:33:42.546 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.546 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.546 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.546 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.546 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701734+0000", 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5807999999999998e-05 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.547 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705769+0000", 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040343660000000002 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705801+0000", 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2406000000000001e-05 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705816+0000", 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4537e-05 2024-04-24T13:33:42.548 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705925+0000", 2024-04-24T13:33:42.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109114 2024-04-24T13:33:42.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705959+0000", 2024-04-24T13:33:42.549 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4239999999999997e-05 2024-04-24T13:33:42.549 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.549 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.549 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.549 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723399+0000", 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017439748000000001 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723458+0000", 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9162e-05 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3525 3.f 3:f35962b2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_423:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:42.550 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.6248552140000001, 2024-04-24T13:33:42.551 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028712260999999999, 2024-04-24T13:33:42.551 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.551 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.551 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.551 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.551 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.551 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.551 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3525 2024-04-24T13:33:42.551 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.551 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.551 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.551 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807221+0000", 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7529999999999999e-06 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.552 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813425+0000", 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062037280000000004 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813449+0000", 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813462+0000", 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200999999999999e-05 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.553 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813554+0000", 2024-04-24T13:33:42.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2369999999999998e-05 2024-04-24T13:33:42.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813730+0000", 2024-04-24T13:33:42.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017569800000000001 2024-04-24T13:33:42.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.554 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.554 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:42.554 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813908+0000", 2024-04-24T13:33:42.554 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178219 2024-04-24T13:33:42.554 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.826992+0000", 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013083567000000001 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835795+0000", 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088026630000000005 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835870+0000", 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5649999999999996e-05 2024-04-24T13:33:42.555 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835930+0000", 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9318999999999999e-05 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3528 3.3b 3:dc395008:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_426:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 8.5965111479999994, 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024383452999999999, 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.556 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3528 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.557 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:42.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.558 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835564+0000", 2024-04-24T13:33:42.558 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7369999999999998e-06 2024-04-24T13:33:42.558 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.558 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.558 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837236+0000", 2024-04-24T13:33:42.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001671964 2024-04-24T13:33:42.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.559 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837275+0000", 2024-04-24T13:33:42.559 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8760000000000002e-05 2024-04-24T13:33:42.559 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.559 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.559 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837292+0000", 2024-04-24T13:33:42.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6884999999999998e-05 2024-04-24T13:33:42.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.560 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.560 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.560 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837382+0000", 2024-04-24T13:33:42.560 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9809999999999996e-05 2024-04-24T13:33:42.560 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837556+0000", 2024-04-24T13:33:42.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174103 2024-04-24T13:33:42.561 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.561 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.561 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:42.561 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837728+0000", 2024-04-24T13:33:42.561 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017202600000000001 2024-04-24T13:33:42.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.562 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859492+0000", 2024-04-24T13:33:42.562 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021764644999999999 2024-04-24T13:33:42.562 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.562 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.562 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859714+0000", 2024-04-24T13:33:42.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221809 2024-04-24T13:33:42.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.563 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.563 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859857+0000", 2024-04-24T13:33:42.563 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142738 2024-04-24T13:33:42.563 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.563 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.564 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.564 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859945+0000", 2024-04-24T13:33:42.564 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7975999999999999e-05 2024-04-24T13:33:42.564 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.564 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.564 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.564 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.564 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.564 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3596 3.3b 3:dcf4b716:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_493:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:42.565 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:42.565 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 7.9094859910000004, 2024-04-24T13:33:42.565 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021336183000000002, 2024-04-24T13:33:42.565 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:42.565 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:42.565 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:42.565 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:42.565 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:42.566 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:42.566 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3596 2024-04-24T13:33:42.566 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.566 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:42.566 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.566 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:42.566 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:42.566 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:42.567 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:42.567 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:42.567 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.567 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.567 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:42.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522589+0000", 2024-04-24T13:33:42.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.853e-06 2024-04-24T13:33:42.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.568 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:42.568 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524412+0000", 2024-04-24T13:33:42.568 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018229559999999999 2024-04-24T13:33:42.568 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.568 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:42.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524440+0000", 2024-04-24T13:33:42.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7489999999999999e-05 2024-04-24T13:33:42.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.569 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.569 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:42.569 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524454+0000", 2024-04-24T13:33:42.569 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4565e-05 2024-04-24T13:33:42.569 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:42.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524556+0000", 2024-04-24T13:33:42.570 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101166 2024-04-24T13:33:42.570 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.570 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.570 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:42.570 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524666+0000", 2024-04-24T13:33:42.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109918 2024-04-24T13:33:42.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:42.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524816+0000", 2024-04-24T13:33:42.571 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015030800000000001 2024-04-24T13:33:42.571 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.571 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.571 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:42.571 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.531231+0000", 2024-04-24T13:33:42.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064155159999999996 2024-04-24T13:33:42.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:42.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543790+0000", 2024-04-24T13:33:42.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012558565000000001 2024-04-24T13:33:42.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.572 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:42.572 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543865+0000", 2024-04-24T13:33:42.572 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4999999999999993e-05 2024-04-24T13:33:42.572 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:42.572 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:42.573 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:42.573 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543923+0000", 2024-04-24T13:33:42.573 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7846000000000001e-05 2024-04-24T13:33:42.573 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.573 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.573 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.573 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:42.573 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:42.573 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:42.574 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:33:42.574 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.2 to 1 (10000) 2024-04-24T13:33:42.575 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:33:42.577 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-24T13:33:42.577 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:42.574+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:42.675 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:42.674+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:42.751 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:42.752 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:42.752 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:42.752 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:42.768 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:33:42.775 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:42.773+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:42.876 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:42.874+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:42.933 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:42.933 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:42.933 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:42.933 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:42.933 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:42.947 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:33:42.991 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:42.990+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:43.078 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:43.074+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:43.118 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:43.118 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:43.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:43.118 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:43.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.118 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2207 3.38 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:43.118 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:43.118 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 74.811939960999993, 2024-04-24T13:33:43.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022686873999999999, 2024-04-24T13:33:43.118 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.119 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.119 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.119 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.119 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.119 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.119 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2207 2024-04-24T13:33:43.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.119 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:43.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:43.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302499+0000", 2024-04-24T13:33:43.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-04-24T13:33:43.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307861+0000", 2024-04-24T13:33:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053622089999999997 2024-04-24T13:33:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307899+0000", 2024-04-24T13:33:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978999999999997e-05 2024-04-24T13:33:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307917+0000", 2024-04-24T13:33:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8576999999999998e-05 2024-04-24T13:33:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308018+0000", 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010080499999999999 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308202+0000", 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000183628 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308352+0000", 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149806 2024-04-24T13:33:43.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318520+0000", 2024-04-24T13:33:43.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010168744 2024-04-24T13:33:43.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.324908+0000", 2024-04-24T13:33:43.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063874739999999998 2024-04-24T13:33:43.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325063+0000", 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155131 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325182+0000", 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011915499999999999 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:43.124 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 74.788345247999999, 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:43.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:33:43.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:33:43.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:33:43.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:33:43.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:33:43.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:33:43.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:33:43.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:33:43.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:33:43.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:33:43.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:33:43.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:33:43.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:43.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:33:43.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:33:43.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:33:43.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:33:43.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:33:43.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:33:43.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:33:43.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:33:43.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:33:43.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:33:43.131 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 74.643289393999993, 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.132 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.133 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:33:43.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.133 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:43.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:43.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:33:43.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:33:43.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:33:43.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:33:43.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:33:43.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:33:43.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:33:43.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:33:43.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:33:43.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:33:43.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.138 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.138 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.138 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2242 3.b 3:d16b554f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:43.138 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:43.138 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 74.374790461999993, 2024-04-24T13:33:43.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022940439, 2024-04-24T13:33:43.138 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2242 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739648+0000", 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.785e-06 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741765+0000", 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002117655 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741781+0000", 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6062e-05 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741792+0000", 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0937999999999999e-05 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741918+0000", 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623199999999999 2024-04-24T13:33:43.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742189+0000", 2024-04-24T13:33:43.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027047300000000002 2024-04-24T13:33:43.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:43.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742430+0000", 2024-04-24T13:33:43.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024077699999999999 2024-04-24T13:33:43.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752990+0000", 2024-04-24T13:33:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010559875 2024-04-24T13:33:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762422+0000", 2024-04-24T13:33:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094325120000000005 2024-04-24T13:33:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762510+0000", 2024-04-24T13:33:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7879000000000003e-05 2024-04-24T13:33:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762585+0000", 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5251000000000002e-05 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2662 3.33 3:ce195145:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.985872155000003, 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028670389000000001, 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.144 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.145 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.145 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.145 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.145 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2662 2024-04-24T13:33:43.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.145 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:43.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:43.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128567+0000", 2024-04-24T13:33:43.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4640000000000002e-06 2024-04-24T13:33:43.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130845+0000", 2024-04-24T13:33:43.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002278389 2024-04-24T13:33:43.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130869+0000", 2024-04-24T13:33:43.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4394999999999999e-05 2024-04-24T13:33:43.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130879+0000", 2024-04-24T13:33:43.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0000000000000001e-05 2024-04-24T13:33:43.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130957+0000", 2024-04-24T13:33:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7968999999999998e-05 2024-04-24T13:33:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130963+0000", 2024-04-24T13:33:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2499999999999997e-06 2024-04-24T13:33:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137507+0000", 2024-04-24T13:33:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065442900000000003 2024-04-24T13:33:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137607+0000", 2024-04-24T13:33:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010002599999999999 2024-04-24T13:33:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137727+0000", 2024-04-24T13:33:43.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120142 2024-04-24T13:33:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152307+0000", 2024-04-24T13:33:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01458017 2024-04-24T13:33:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157112+0000", 2024-04-24T13:33:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048051350000000003 2024-04-24T13:33:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157181+0000", 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9051e-05 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157233+0000", 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2108000000000003e-05 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.151 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2676 3.22 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.842670247000001, 2024-04-24T13:33:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025889562000000001, 2024-04-24T13:33:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2676 2024-04-24T13:33:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271767+0000", 2024-04-24T13:33:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-04-24T13:33:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.273986+0000", 2024-04-24T13:33:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022195560000000001 2024-04-24T13:33:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274011+0000", 2024-04-24T13:33:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4953e-05 2024-04-24T13:33:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274023+0000", 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1856e-05 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274116+0000", 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3168e-05 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274377+0000", 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026071500000000001 2024-04-24T13:33:43.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274531+0000", 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015427299999999999 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297124+0000", 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022592476 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297544+0000", 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000420691 2024-04-24T13:33:43.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297605+0000", 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0888999999999999e-05 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297655+0000", 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9119999999999997e-05 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2722 3.25 e101/20 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head v 101'6, mlcod=86'4)", 2024-04-24T13:33:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.470924965999998, 2024-04-24T13:33:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023380372, 2024-04-24T13:33:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.158 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643511+0000", 2024-04-24T13:33:43.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4400000000000001e-07 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647450+0000", 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039389259999999997 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647470+0000", 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0534e-05 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647484+0000", 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3370000000000001e-05 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647599+0000", 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115513 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647629+0000", 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0145e-05 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666761+0000", 2024-04-24T13:33:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019132303999999999 2024-04-24T13:33:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666891+0000", 2024-04-24T13:33:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012913599999999999 2024-04-24T13:33:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2747 3.24 3:2754d069:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:43.162 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.216375104000001, 2024-04-24T13:33:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024857536999999999, 2024-04-24T13:33:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2747 2024-04-24T13:33:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898063+0000", 2024-04-24T13:33:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5289999999999998e-06 2024-04-24T13:33:43.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899956+0000", 2024-04-24T13:33:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932759999999999 2024-04-24T13:33:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899984+0000", 2024-04-24T13:33:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7801999999999999e-05 2024-04-24T13:33:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899997+0000", 2024-04-24T13:33:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3127e-05 2024-04-24T13:33:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900063+0000", 2024-04-24T13:33:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900200+0000", 2024-04-24T13:33:43.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000137324 2024-04-24T13:33:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900302+0000", 2024-04-24T13:33:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010168 2024-04-24T13:33:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.908151+0000", 2024-04-24T13:33:43.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078489579999999996 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922784+0000", 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014633116 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922860+0000", 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5708000000000001e-05 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922918+0000", 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7686000000000003e-05 2024-04-24T13:33:43.168 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2754 3.b 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 37.135905604000001, 2024-04-24T13:33:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.032358206, 2024-04-24T13:33:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.169 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2754 2024-04-24T13:33:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978532+0000", 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6079999999999998e-06 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979768+0000", 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012357869999999999 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979791+0000", 2024-04-24T13:33:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3224e-05 2024-04-24T13:33:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979804+0000", 2024-04-24T13:33:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.274e-05 2024-04-24T13:33:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979889+0000", 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5483999999999997e-05 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980063+0000", 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017384599999999999 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980227+0000", 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163764 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987774+0000", 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075472029999999997 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010776+0000", 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023001886999999999 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010838+0000", 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1527999999999998e-05 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010888+0000", 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0135e-05 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2811 3.7 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.544266772, 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044582597000000002, 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.175 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2811 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570171+0000", 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9100000000000001e-06 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580122+0000", 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099505930000000006 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580150+0000", 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7827e-05 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580164+0000", 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4547e-05 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580245+0000", 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0810999999999996e-05 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580355+0000", 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109656 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580475+0000", 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120278 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607433+0000", 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026957894 2024-04-24T13:33:43.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614636+0000", 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072028359999999998 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614703+0000", 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7645999999999996e-05 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614751+0000", 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7599000000000003e-05 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.180 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2812 3.1e 3:7bd62ca6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 36.534222892000003, 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.038041177000000002, 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2812 2024-04-24T13:33:43.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.182 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580214+0000", 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.708e-06 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582574+0000", 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023601799999999999 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582591+0000", 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6648999999999999e-05 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582598+0000", 2024-04-24T13:33:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.391e-06 2024-04-24T13:33:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583731+0000", 2024-04-24T13:33:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011332029999999999 2024-04-24T13:33:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583843+0000", 2024-04-24T13:33:43.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111889 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583936+0000", 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2968999999999997e-05 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.599363+0000", 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015427186000000001 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618143+0000", 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018779051000000001 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618200+0000", 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7151999999999998e-05 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618253+0000", 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3798999999999998e-05 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.186 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3110 3.1e 3:79ca4af0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.315164692, 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022894164000000002, 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3110 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.187 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.188 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799272+0000", 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9470000000000002e-06 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800698+0000", 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001425204 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800721+0000", 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3577000000000001e-05 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800731+0000", 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9969999999999993e-06 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800797+0000", 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6087999999999995e-05 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800954+0000", 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015699 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.801064+0000", 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109715 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.807584+0000", 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065197479999999997 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822063+0000", 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014479156999999999 2024-04-24T13:33:43.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822122+0000", 2024-04-24T13:33:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9095000000000003e-05 2024-04-24T13:33:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822165+0000", 2024-04-24T13:33:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2645999999999998e-05 2024-04-24T13:33:43.192 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3117 3.27 3:e455931d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.243806662000001, 2024-04-24T13:33:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02353235, 2024-04-24T13:33:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.193 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3117 2024-04-24T13:33:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870631+0000", 2024-04-24T13:33:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.075e-06 2024-04-24T13:33:43.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872287+0000", 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016561449999999999 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872316+0000", 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9543000000000002e-05 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872333+0000", 2024-04-24T13:33:43.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6806000000000001e-05 2024-04-24T13:33:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872403+0000", 2024-04-24T13:33:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9917000000000002e-05 2024-04-24T13:33:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872540+0000", 2024-04-24T13:33:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013735200000000001 2024-04-24T13:33:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872686+0000", 2024-04-24T13:33:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014519899999999999 2024-04-24T13:33:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.198 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.878440+0000", 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057539490000000004 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894072+0000", 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015632801000000002 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894106+0000", 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3933999999999997e-05 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894161+0000", 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4629000000000002e-05 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3127 3.15 3:a9239ffa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.139079486, 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023707346000000001, 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.200 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3127 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:43.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975357+0000", 2024-04-24T13:33:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.418e-06 2024-04-24T13:33:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976868+0000", 2024-04-24T13:33:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015108719999999999 2024-04-24T13:33:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976894+0000", 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5885e-05 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976905+0000", 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1076e-05 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976983+0000", 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8532e-05 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977149+0000", 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016571500000000001 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977313+0000", 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163719 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.984588+0000", 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072751600000000001 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.204 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998908+0000", 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014319705 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998988+0000", 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9839000000000006e-05 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.999063+0000", 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5425000000000004e-05 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.205 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3136 3.25 e112/20 3:a4e0a0f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_51:head v 112'10, mlcod=102'8)", 2024-04-24T13:33:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.038019817, 2024-04-24T13:33:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026701701000000001, 2024-04-24T13:33:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076417+0000", 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.779e-06 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077651+0000", 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233428 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077679+0000", 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8535e-05 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077694+0000", 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077775+0000", 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0927000000000006e-05 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077801+0000", 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5933999999999999e-05 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103085+0000", 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284238000000001 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103117+0000", 2024-04-24T13:33:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1917e-05 2024-04-24T13:33:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3429 3.7 3:e226ff6b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_327:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:43.210 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 10.287850511, 2024-04-24T13:33:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023122228000000002, 2024-04-24T13:33:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3429 2024-04-24T13:33:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.211 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826588+0000", 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.942e-06 2024-04-24T13:33:43.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829078+0000", 2024-04-24T13:33:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002489982 2024-04-24T13:33:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829098+0000", 2024-04-24T13:33:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0747999999999999e-05 2024-04-24T13:33:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829110+0000", 2024-04-24T13:33:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1569000000000001e-05 2024-04-24T13:33:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829206+0000", 2024-04-24T13:33:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6303000000000003e-05 2024-04-24T13:33:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829419+0000", 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021229300000000001 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829606+0000", 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187219 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.835770+0000", 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061641819999999998 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849620+0000", 2024-04-24T13:33:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013849889000000001 2024-04-24T13:33:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849663+0000", 2024-04-24T13:33:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2725999999999997e-05 2024-04-24T13:33:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849707+0000", 2024-04-24T13:33:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4375000000000001e-05 2024-04-24T13:33:43.216 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3484 3.18 3:1a64f732:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_382:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.7328553319999997, 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029616456999999999, 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.217 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3484 2024-04-24T13:33:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381583+0000", 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6510000000000001e-06 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382670+0000", 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010878870000000001 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382689+0000", 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8723999999999999e-05 2024-04-24T13:33:43.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382700+0000", 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0908e-05 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385156+0000", 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002456176 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385287+0000", 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013060400000000001 2024-04-24T13:33:43.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385402+0000", 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115658 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.406717+0000", 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021314317999999999 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411063+0000", 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043465719999999999 2024-04-24T13:33:43.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411141+0000", 2024-04-24T13:33:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7193000000000004e-05 2024-04-24T13:33:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411196+0000", 2024-04-24T13:33:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5766000000000001e-05 2024-04-24T13:33:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3483 3.c e114/103 3:3033c1b6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_381:head v 114'16, mlcod=113'14)", 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.7306701209999993, 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028448153, 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383766+0000", 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0130000000000001e-06 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387173+0000", 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034066330000000001 2024-04-24T13:33:43.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387201+0000", 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8705999999999999e-05 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387216+0000", 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5019e-05 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387369+0000", 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015276299999999999 2024-04-24T13:33:43.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387397+0000", 2024-04-24T13:33:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7559000000000002e-05 2024-04-24T13:33:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412160+0000", 2024-04-24T13:33:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024763314000000002 2024-04-24T13:33:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412213+0000", 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3146000000000002e-05 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3501 3.24 3:27356806:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_399:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.5537826450000001, 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029132884000000001, 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.227 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3501 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:43.228 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560656+0000", 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.066e-06 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562392+0000", 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017359980000000001 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.229 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562431+0000", 2024-04-24T13:33:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9325e-05 2024-04-24T13:33:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562453+0000", 2024-04-24T13:33:43.230 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2476e-05 2024-04-24T13:33:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562541+0000", 2024-04-24T13:33:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7678999999999999e-05 2024-04-24T13:33:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.231 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562688+0000", 2024-04-24T13:33:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014673600000000001 2024-04-24T13:33:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562785+0000", 2024-04-24T13:33:43.232 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6903000000000004e-05 2024-04-24T13:33:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.571188+0000", 2024-04-24T13:33:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084030449999999996 2024-04-24T13:33:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.233 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589689+0000", 2024-04-24T13:33:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018500876999999999 2024-04-24T13:33:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.234 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589735+0000", 2024-04-24T13:33:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-04-24T13:33:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589785+0000", 2024-04-24T13:33:43.235 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0290999999999997e-05 2024-04-24T13:33:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3521 3.1e 3:7803006f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_419:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:43.236 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 9.3468307989999992, 2024-04-24T13:33:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024446572999999999, 2024-04-24T13:33:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.237 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3521 2024-04-24T13:33:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:43.238 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.239 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:43.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767608+0000", 2024-04-24T13:33:43.240 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3239999999999999e-06 2024-04-24T13:33:43.240 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.240 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.240 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:43.240 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770197+0000", 2024-04-24T13:33:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025895129999999999 2024-04-24T13:33:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770220+0000", 2024-04-24T13:33:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2605000000000001e-05 2024-04-24T13:33:43.241 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770233+0000", 2024-04-24T13:33:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3159999999999999e-05 2024-04-24T13:33:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.242 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770329+0000", 2024-04-24T13:33:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5995999999999994e-05 2024-04-24T13:33:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770543+0000", 2024-04-24T13:33:43.243 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000214348 2024-04-24T13:33:43.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.244 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:43.244 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770732+0000", 2024-04-24T13:33:43.244 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000188975 2024-04-24T13:33:43.244 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.244 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:43.245 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.779877+0000", 2024-04-24T13:33:43.245 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0091449860000000008 2024-04-24T13:33:43.245 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.245 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.245 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.791883+0000", 2024-04-24T13:33:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012005266000000001 2024-04-24T13:33:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792002+0000", 2024-04-24T13:33:43.246 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119351 2024-04-24T13:33:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792051+0000", 2024-04-24T13:33:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9048999999999997e-05 2024-04-24T13:33:43.247 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:43.248 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:43.248 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:43.250 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:33:43.251 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:43.249+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:43.351 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:43.349+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:43.386 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:43.386 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:43.386 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:33:43.386 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:43.400 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:33:43.452 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.3 to 1 (10000) 2024-04-24T13:33:43.456 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:43.450+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:43.477 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-24T13:33:43.563 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:43.562+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:43.574 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:43.574 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:33:43.575 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:33:43.575 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:43.588 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:33:43.654 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:43.650+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:43.710 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:43.710 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:33:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:33:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:33:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2208 3.29 e85/20 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:33:43.711 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 75.378482062000003, 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026370000000000001, 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:33:43.712 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328650+0000", 2024-04-24T13:33:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.413e-06 2024-04-24T13:33:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335219+0000", 2024-04-24T13:33:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006569788 2024-04-24T13:33:43.713 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335258+0000", 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9062e-05 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335277+0000", 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.836e-05 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335422+0000", 2024-04-24T13:33:43.714 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014537 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335481+0000", 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9259000000000003e-05 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354858+0000", 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019376757000000001 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.715 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.355017+0000", 2024-04-24T13:33:43.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015899100000000001 2024-04-24T13:33:43.716 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.716 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.716 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.716 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.716 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.716 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2672 3.1c 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:43.716 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:33:43.716 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 38.475674126000001, 2024-04-24T13:33:43.716 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028612909999999998, 2024-04-24T13:33:43.716 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.716 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.716 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2672 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.717 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231458+0000", 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.977e-06 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236408+0000", 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049496929999999998 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.718 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236444+0000", 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5713000000000002e-05 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236461+0000", 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.789e-05 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236562+0000", 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100352 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.719 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236842+0000", 2024-04-24T13:33:43.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027979399999999998 2024-04-24T13:33:43.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:43.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.237091+0000", 2024-04-24T13:33:43.720 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024988499999999998 2024-04-24T13:33:43.720 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.720 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.720 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.720 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.246295+0000", 2024-04-24T13:33:43.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0092031279999999997 2024-04-24T13:33:43.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.259775+0000", 2024-04-24T13:33:43.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013480634 2024-04-24T13:33:43.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.721 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.721 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.259922+0000", 2024-04-24T13:33:43.721 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146565 2024-04-24T13:33:43.721 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.721 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.722 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.722 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.260068+0000", 2024-04-24T13:33:43.722 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146279 2024-04-24T13:33:43.722 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.722 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.722 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.722 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.722 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.722 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2706 3.1c 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:43.722 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 38.238047299000002, 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027254180999999999, 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.723 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469086+0000", 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6100000000000002e-06 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.724 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473145+0000", 2024-04-24T13:33:43.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040598769999999999 2024-04-24T13:33:43.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473180+0000", 2024-04-24T13:33:43.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4345999999999999e-05 2024-04-24T13:33:43.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.725 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.725 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.725 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473197+0000", 2024-04-24T13:33:43.725 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.721e-05 2024-04-24T13:33:43.725 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473377+0000", 2024-04-24T13:33:43.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000179805 2024-04-24T13:33:43.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.726 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.726 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473830+0000", 2024-04-24T13:33:43.726 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045276700000000002 2024-04-24T13:33:43.726 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.726 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.474315+0000", 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000485842 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.485841+0000", 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011525822 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496030+0000", 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010188401 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.727 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496205+0000", 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000175632 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496336+0000", 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013086900000000001 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.728 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2752 3.1c 3:3ae15365:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:43.729 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:33:43.729 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 37.7528243, 2024-04-24T13:33:43.729 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027425952, 2024-04-24T13:33:43.729 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.729 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.729 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.729 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.729 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.729 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.729 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2752 2024-04-24T13:33:43.729 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.729 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.729 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:33:43.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:33:43.730 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.730 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.730 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.730 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.730 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954308+0000", 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3100000000000001e-06 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959305+0000", 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049969649999999999 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959349+0000", 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3590000000000001e-05 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.731 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959375+0000", 2024-04-24T13:33:43.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6268999999999999e-05 2024-04-24T13:33:43.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.732 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959561+0000", 2024-04-24T13:33:43.732 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018558600000000001 2024-04-24T13:33:43.732 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.732 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.732 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959821+0000", 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000260704 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.960063+0000", 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024149499999999999 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.974409+0000", 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014345689999999999 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.733 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981424+0000", 2024-04-24T13:33:43.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070159250000000001 2024-04-24T13:33:43.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981651+0000", 2024-04-24T13:33:43.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022641499999999999 2024-04-24T13:33:43.734 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.734 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.734 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.734 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981731+0000", 2024-04-24T13:33:43.734 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0003e-05 2024-04-24T13:33:43.734 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.734 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2772 3.1a 3:589df240:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:06.151960+0000", 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 37.555169464000002, 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024913555, 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2772 2024-04-24T13:33:43.735 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.151960+0000", 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.151960+0000", 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.736 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.151963+0000", 2024-04-24T13:33:43.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8729999999999999e-06 2024-04-24T13:33:43.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.157999+0000", 2024-04-24T13:33:43.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060360609999999997 2024-04-24T13:33:43.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.737 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.737 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158051+0000", 2024-04-24T13:33:43.737 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2283000000000001e-05 2024-04-24T13:33:43.737 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.737 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158078+0000", 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7163000000000001e-05 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158261+0000", 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182342 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158680+0000", 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041904000000000003 2024-04-24T13:33:43.738 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.159122+0000", 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044224599999999998 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.172894+0000", 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013771782 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.176730+0000", 2024-04-24T13:33:43.739 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038359940000000001 2024-04-24T13:33:43.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.176810+0000", 2024-04-24T13:33:43.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9985000000000001e-05 2024-04-24T13:33:43.740 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.740 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.740 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.740 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.176873+0000", 2024-04-24T13:33:43.740 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3786000000000002e-05 2024-04-24T13:33:43.740 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2817 3.13 3:c886ce92:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:06.637721+0000", 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 37.069408066000001, 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024927993999999998, 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.741 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2817 2024-04-24T13:33:43.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.742 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.637721+0000", 2024-04-24T13:33:43.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.742 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.742 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.742 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.637721+0000", 2024-04-24T13:33:43.742 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.742 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.743 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.637725+0000", 2024-04-24T13:33:43.743 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8229999999999997e-06 2024-04-24T13:33:43.743 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.743 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.743 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642579+0000", 2024-04-24T13:33:43.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048544010000000004 2024-04-24T13:33:43.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642615+0000", 2024-04-24T13:33:43.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5392999999999998e-05 2024-04-24T13:33:43.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.744 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.744 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.744 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642634+0000", 2024-04-24T13:33:43.744 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8933e-05 2024-04-24T13:33:43.744 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642774+0000", 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014001199999999999 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.643201+0000", 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042696999999999999 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.643553+0000", 2024-04-24T13:33:43.745 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035225099999999999 2024-04-24T13:33:43.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.660632+0000", 2024-04-24T13:33:43.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017079436999999999 2024-04-24T13:33:43.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.746 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.746 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.662499+0000", 2024-04-24T13:33:43.746 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001866611 2024-04-24T13:33:43.746 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.746 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.662591+0000", 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1762999999999995e-05 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.662649+0000", 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8400000000000003e-05 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.747 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3091 3.9 3:91019aa3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.139892353, 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026195184999999999, 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3091 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.748 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567241+0000", 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7570000000000002e-06 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.749 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575380+0000", 2024-04-24T13:33:43.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081391740000000008 2024-04-24T13:33:43.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575427+0000", 2024-04-24T13:33:43.750 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6839999999999999e-05 2024-04-24T13:33:43.750 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.750 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.750 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.750 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575451+0000", 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4329999999999999e-05 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575651+0000", 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020028400000000001 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576089+0000", 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043775699999999999 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.751 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576498+0000", 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040853999999999999 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.592857+0000", 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016359097 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593257+0000", 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000400553 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.752 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593358+0000", 2024-04-24T13:33:43.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010064 2024-04-24T13:33:43.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.753 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.753 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.753 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593432+0000", 2024-04-24T13:33:43.753 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4213000000000002e-05 2024-04-24T13:33:43.753 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.753 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.753 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.753 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.754 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.754 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3093 3.9 3:918af506:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:43.754 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.586455+0000", 2024-04-24T13:33:43.754 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.120674068, 2024-04-24T13:33:43.754 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024560463000000001, 2024-04-24T13:33:43.754 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.754 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.754 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.754 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.754 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.754 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3093 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.586455+0000", 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.586455+0000", 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.755 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.586459+0000", 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4400000000000001e-06 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593639+0000", 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071801740000000001 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593670+0000", 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1186999999999998e-05 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593685+0000", 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5302999999999999e-05 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593801+0000", 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115949 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.594038+0000", 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000237078 2024-04-24T13:33:43.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:43.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.594259+0000", 2024-04-24T13:33:43.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022082800000000001 2024-04-24T13:33:43.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.607515+0000", 2024-04-24T13:33:43.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013255829 2024-04-24T13:33:43.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.610697+0000", 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031818879999999999 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.610884+0000", 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018670199999999999 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.611016+0000", 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013208499999999999 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.759 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3121 3.e 3:70900501:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.796488913999999, 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026429009, 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.760 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3121 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.761 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910644+0000", 2024-04-24T13:33:43.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2270000000000002e-06 2024-04-24T13:33:43.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914662+0000", 2024-04-24T13:33:43.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040188539999999997 2024-04-24T13:33:43.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914705+0000", 2024-04-24T13:33:43.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2562999999999999e-05 2024-04-24T13:33:43.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914726+0000", 2024-04-24T13:33:43.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0996e-05 2024-04-24T13:33:43.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914911+0000", 2024-04-24T13:33:43.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018524500000000001 2024-04-24T13:33:43.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.915177+0000", 2024-04-24T13:33:43.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026601100000000003 2024-04-24T13:33:43.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:43.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.915402+0000", 2024-04-24T13:33:43.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224928 2024-04-24T13:33:43.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.925683+0000", 2024-04-24T13:33:43.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010280821000000001 2024-04-24T13:33:43.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.936831+0000", 2024-04-24T13:33:43.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011148362 2024-04-24T13:33:43.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.936987+0000", 2024-04-24T13:33:43.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155749 2024-04-24T13:33:43.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.767 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.937069+0000", 2024-04-24T13:33:43.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2253e-05 2024-04-24T13:33:43.767 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.767 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.767 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.767 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3123 3.13 3:ca3e100b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:43.767 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:33:43.767 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.777227128, 2024-04-24T13:33:43.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029312213, 2024-04-24T13:33:43.767 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.768 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.768 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.768 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.768 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.768 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.768 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3123 2024-04-24T13:33:43.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.768 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:33:43.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929905+0000", 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6970000000000002e-06 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933842+0000", 2024-04-24T13:33:43.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039367320000000001 2024-04-24T13:33:43.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933877+0000", 2024-04-24T13:33:43.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.561e-05 2024-04-24T13:33:43.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933894+0000", 2024-04-24T13:33:43.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7212999999999999e-05 2024-04-24T13:33:43.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934030+0000", 2024-04-24T13:33:43.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013565199999999999 2024-04-24T13:33:43.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934295+0000", 2024-04-24T13:33:43.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000265235 2024-04-24T13:33:43.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:43.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934540+0000", 2024-04-24T13:33:43.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024482399999999999 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.957909+0000", 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023368684000000001 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959004+0000", 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010949709999999999 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959124+0000", 2024-04-24T13:33:43.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012061900000000001 2024-04-24T13:33:43.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959214+0000", 2024-04-24T13:33:43.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9975999999999994e-05 2024-04-24T13:33:43.773 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.773 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.773 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.773 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3140 3.13 3:cb1b51c5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:43.774 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:29.122081+0000", 2024-04-24T13:33:43.774 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.585048549, 2024-04-24T13:33:43.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024992602999999999, 2024-04-24T13:33:43.774 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.774 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.774 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.774 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.775 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.775 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.775 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3140 2024-04-24T13:33:43.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.775 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.122081+0000", 2024-04-24T13:33:43.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.122081+0000", 2024-04-24T13:33:43.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.122084+0000", 2024-04-24T13:33:43.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0029999999999999e-06 2024-04-24T13:33:43.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126170+0000", 2024-04-24T13:33:43.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040860200000000001 2024-04-24T13:33:43.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126206+0000", 2024-04-24T13:33:43.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6672999999999999e-05 2024-04-24T13:33:43.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126225+0000", 2024-04-24T13:33:43.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8114e-05 2024-04-24T13:33:43.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126363+0000", 2024-04-24T13:33:43.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013847800000000001 2024-04-24T13:33:43.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126618+0000", 2024-04-24T13:33:43.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025469499999999999 2024-04-24T13:33:43.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:43.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126861+0000", 2024-04-24T13:33:43.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000243408 2024-04-24T13:33:43.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.779 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.136738+0000", 2024-04-24T13:33:43.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098770560000000004 2024-04-24T13:33:43.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.146717+0000", 2024-04-24T13:33:43.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099784629999999999 2024-04-24T13:33:43.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.146923+0000", 2024-04-24T13:33:43.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020675199999999999 2024-04-24T13:33:43.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.147073+0000", 2024-04-24T13:33:43.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014994100000000001 2024-04-24T13:33:43.781 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.781 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.781 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.781 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3431 3.9 3:910e1c92:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_329:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:43.781 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.851638+0000", 2024-04-24T13:33:43.781 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.855491146, 2024-04-24T13:33:43.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024517051000000002, 2024-04-24T13:33:43.782 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.782 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.782 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.782 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.782 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.782 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.782 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3431 2024-04-24T13:33:43.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.782 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.851638+0000", 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.851638+0000", 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.851642+0000", 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6799999999999999e-06 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857208+0000", 2024-04-24T13:33:43.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055657950000000001 2024-04-24T13:33:43.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857250+0000", 2024-04-24T13:33:43.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2530000000000001e-05 2024-04-24T13:33:43.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.784 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.784 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857272+0000", 2024-04-24T13:33:43.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2042999999999999e-05 2024-04-24T13:33:43.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857440+0000", 2024-04-24T13:33:43.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016773499999999999 2024-04-24T13:33:43.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857796+0000", 2024-04-24T13:33:43.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035583700000000002 2024-04-24T13:33:43.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:43.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.858038+0000", 2024-04-24T13:33:43.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000242138 2024-04-24T13:33:43.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.873499+0000", 2024-04-24T13:33:43.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015461228 2024-04-24T13:33:43.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.875780+0000", 2024-04-24T13:33:43.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022812610000000001 2024-04-24T13:33:43.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.875972+0000", 2024-04-24T13:33:43.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019177899999999999 2024-04-24T13:33:43.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876155+0000", 2024-04-24T13:33:43.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018302499999999999 2024-04-24T13:33:43.788 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.788 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.788 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.788 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3433 3.34 3:2ce81ea4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_331:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:43.788 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:33:43.788 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.836817100999999, 2024-04-24T13:33:43.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026583214000000001, 2024-04-24T13:33:43.788 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.788 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.788 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3433 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:33:43.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870316+0000", 2024-04-24T13:33:43.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.16e-06 2024-04-24T13:33:43.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.790 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.790 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876622+0000", 2024-04-24T13:33:43.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063053919999999999 2024-04-24T13:33:43.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876650+0000", 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8007000000000001e-05 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876669+0000", 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8972999999999999e-05 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876789+0000", 2024-04-24T13:33:43.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119849 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.877065+0000", 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276407 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.877304+0000", 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023901799999999999 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.890409+0000", 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013105047 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896721+0000", 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063118360000000004 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896819+0000", 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7728999999999999e-05 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896895+0000", 2024-04-24T13:33:43.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6796000000000001e-05 2024-04-24T13:33:43.794 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.794 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.794 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.794 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3463 3.39 e113/41 3:9e84137f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_361:head v 113'19, mlcod=113'17)", 2024-04-24T13:33:43.794 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:33:43.794 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.534320288, 2024-04-24T13:33:43.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025926719000000001, 2024-04-24T13:33:43.794 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.794 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.795 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.795 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:33:43.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:33:43.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172811+0000", 2024-04-24T13:33:43.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1160000000000002e-06 2024-04-24T13:33:43.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.796 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.796 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177659+0000", 2024-04-24T13:33:43.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048481549999999998 2024-04-24T13:33:43.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177694+0000", 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4473e-05 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177717+0000", 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3750000000000001e-05 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177886+0000", 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000168405 2024-04-24T13:33:43.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177925+0000", 2024-04-24T13:33:43.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9555999999999999e-05 2024-04-24T13:33:43.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.198662+0000", 2024-04-24T13:33:43.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020736167999999999 2024-04-24T13:33:43.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.198736+0000", 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4096000000000003e-05 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3469 3.3 3:c2771714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_367:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.475084743, 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028440263, 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.799 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3469 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:33:43.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232047+0000", 2024-04-24T13:33:43.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4669999999999998e-06 2024-04-24T13:33:43.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.237943+0000", 2024-04-24T13:33:43.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058964320000000001 2024-04-24T13:33:43.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.237979+0000", 2024-04-24T13:33:43.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5907e-05 2024-04-24T13:33:43.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238000+0000", 2024-04-24T13:33:43.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0536000000000001e-05 2024-04-24T13:33:43.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238104+0000", 2024-04-24T13:33:43.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010404300000000001 2024-04-24T13:33:43.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238355+0000", 2024-04-24T13:33:43.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000250881 2024-04-24T13:33:43.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:43.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238590+0000", 2024-04-24T13:33:43.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000235388 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.248777+0000", 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010187244 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260299+0000", 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011521933 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260403+0000", 2024-04-24T13:33:43.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010400600000000001 2024-04-24T13:33:43.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260485+0000", 2024-04-24T13:33:43.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1426000000000003e-05 2024-04-24T13:33:43.805 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.805 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.805 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.805 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3501 3.24 e114/20 3:27356806:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_399:head v 114'14, mlcod=113'12)", 2024-04-24T13:33:43.806 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:33:43.806 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.143881114999999, 2024-04-24T13:33:43.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026449908000000001, 2024-04-24T13:33:43.806 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.806 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.806 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.806 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:33:43.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:33:43.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563249+0000", 2024-04-24T13:33:43.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9299999999999998e-07 2024-04-24T13:33:43.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568259+0000", 2024-04-24T13:33:43.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050107759999999998 2024-04-24T13:33:43.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568292+0000", 2024-04-24T13:33:43.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2892999999999998e-05 2024-04-24T13:33:43.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.808 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568310+0000", 2024-04-24T13:33:43.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7819e-05 2024-04-24T13:33:43.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568429+0000", 2024-04-24T13:33:43.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011896999999999999 2024-04-24T13:33:43.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568469+0000", 2024-04-24T13:33:43.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9739e-05 2024-04-24T13:33:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.589582+0000", 2024-04-24T13:33:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021113072 2024-04-24T13:33:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.589698+0000", 2024-04-24T13:33:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116146 2024-04-24T13:33:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.810 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3509 3.39 e114/41 3:9cf0e09a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_407:head v 114'21, mlcod=113'19)", 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.652439+0000", 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 10.05468991, 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025495436, 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.652439+0000", 2024-04-24T13:33:43.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.652439+0000", 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.652441+0000", 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.03e-06 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656544+0000", 2024-04-24T13:33:43.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041031030000000003 2024-04-24T13:33:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656570+0000", 2024-04-24T13:33:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5996999999999999e-05 2024-04-24T13:33:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656583+0000", 2024-04-24T13:33:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2935999999999999e-05 2024-04-24T13:33:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656723+0000", 2024-04-24T13:33:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139226 2024-04-24T13:33:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656763+0000", 2024-04-24T13:33:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0655999999999998e-05 2024-04-24T13:33:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.814 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.677805+0000", 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021042079000000002 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.677935+0000", 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012940900000000001 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3534 3.34 3:2c938e61:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_432:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.899747+0000", 2024-04-24T13:33:43.815 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.8073822180000008, 2024-04-24T13:33:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025402460000000002, 2024-04-24T13:33:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3534 2024-04-24T13:33:43.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.899747+0000", 2024-04-24T13:33:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.899747+0000", 2024-04-24T13:33:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.899751+0000", 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9269999999999998e-06 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.905900+0000", 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061494890000000002 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.905936+0000", 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5196e-05 2024-04-24T13:33:43.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.905955+0000", 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8913999999999999e-05 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.906122+0000", 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000167715 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.906540+0000", 2024-04-24T13:33:43.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041803599999999999 2024-04-24T13:33:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.906963+0000", 2024-04-24T13:33:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042224 2024-04-24T13:33:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.924057+0000", 2024-04-24T13:33:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017094272000000001 2024-04-24T13:33:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.820 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.924812+0000", 2024-04-24T13:33:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075491399999999998 2024-04-24T13:33:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.925002+0000", 2024-04-24T13:33:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190101 2024-04-24T13:33:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.925149+0000", 2024-04-24T13:33:43.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147656 2024-04-24T13:33:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3585 3.11 3:88ded408:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_482:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:33:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.3068070459999994, 2024-04-24T13:33:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034777737000000003, 2024-04-24T13:33:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.822 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3585 2024-04-24T13:33:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:33:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:33:43.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400326+0000", 2024-04-24T13:33:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9330000000000003e-06 2024-04-24T13:33:43.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404462+0000", 2024-04-24T13:33:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041354130000000001 2024-04-24T13:33:43.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404537+0000", 2024-04-24T13:33:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5282000000000002e-05 2024-04-24T13:33:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404565+0000", 2024-04-24T13:33:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7797000000000002e-05 2024-04-24T13:33:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404716+0000", 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015126500000000001 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.405051+0000", 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033540099999999998 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.405296+0000", 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024506099999999998 2024-04-24T13:33:43.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.429261+0000", 2024-04-24T13:33:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023964485000000001 2024-04-24T13:33:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.434796+0000", 2024-04-24T13:33:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055355559999999996 2024-04-24T13:33:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.434949+0000", 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015286499999999999 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.435100+0000", 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000150679 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3586 3.11 3:89fac597:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_483:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:33:43.830 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 9.2955208650000003, 2024-04-24T13:33:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028873106999999999, 2024-04-24T13:33:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3586 2024-04-24T13:33:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:43.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:33:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:33:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411611+0000", 2024-04-24T13:33:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7930000000000002e-06 2024-04-24T13:33:43.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415739+0000", 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00412751 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415776+0000", 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7082999999999997e-05 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415795+0000", 2024-04-24T13:33:43.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9539999999999999e-05 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418234+0000", 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024391310000000002 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418476+0000", 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000242026 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:43.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418697+0000", 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000220564 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.432206+0000", 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013508922 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440330+0000", 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081238649999999992 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440414+0000", 2024-04-24T13:33:43.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4270999999999993e-05 2024-04-24T13:33:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440481+0000", 2024-04-24T13:33:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7402000000000003e-05 2024-04-24T13:33:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:43.836 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:43.836 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:43.836 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:33:43.839 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:33:43.840 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:43.837+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:43.939 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:43.937+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:43.990 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:43.990 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:44.006 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:44.007 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:44.010 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:44.011 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:44.011 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:33:44.011 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:44.023 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:44.023 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:44.025 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:33:44.040 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:44.041 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:44.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:44.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:44.066 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:44.065+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:44.081 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:44.081 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:44.099 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:44.100 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:44.120 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:44.120 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:44.140 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:44.138+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:44.190 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:44.191 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:44.202 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:33:44.241 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:44.238+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:44.322 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:44.322 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:44.336 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:33:44.342 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:44.338+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:44.443 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:44.442+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:44.453 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:44.453 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:44.466 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.4 to 1 (10000) 2024-04-24T13:33:44.470 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:33:44.490 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-24T13:33:44.576 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:33:44.583 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:44.582+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:44.592 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:44.592 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:44.607 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:33:44.645 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:44.642+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:44.732 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:44.732 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:44.746 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:44.745+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:44.748 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:33:44.846 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:44.846+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:44.908 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:44.908 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:44.922 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:44.970 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:44.969+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:45.043 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:45.043 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:45.047 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:45.045+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:45.057 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:45.148 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:45.145+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:45.218 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:45.219 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:45.233 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:45.279 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:45.278+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:45.350 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:45.346+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:45.365 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:45.365 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:45.379 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:45.451 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:45.449+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:45.460 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.5 to 1 (10000) 2024-04-24T13:33:45.460 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:33:45.490 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-24T13:33:45.553 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:45.553 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:45.553 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:45.550+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:45.568 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:45.655 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:45.654+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:45.726 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:45.726 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:45.740 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:45.753 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:45.753+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:45.854 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:45.853+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:45.905 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:45.905 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:45.919 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:33:45.955 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:45.953+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:46.039 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:46.040 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:46.054 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:33:46.055 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:46.053+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:46.138 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:33:46.173 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:46.173 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:46.174 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:46.170+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:46.188 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:33:46.257 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:46.253+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:46.280 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:46.280 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:46.297 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:46.297 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:46.314 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:46.314 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:46.332 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:46.332 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:46.353 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:46.353 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:46.357 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:46.357 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:46.357 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:46.357 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:46.357 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:46.354+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:46.371 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:33:46.375 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:46.375 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:46.396 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:46.396 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:46.417 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:46.417 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:46.458 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:46.457+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:46.474 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.6 to 1 (10000) 2024-04-24T13:33:46.495 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-24T13:33:46.495 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:33:46.497 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:46.497 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:46.498 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:46.498 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:46.498 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:46.512 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:33:46.559 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:46.558+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:46.660 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:46.658+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:46.678 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:46.678 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:46.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:46.678 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:46.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.678 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2206 3.f 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:46.678 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:46.678 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 78.385360241000001, 2024-04-24T13:33:46.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028291495999999999, 2024-04-24T13:33:46.678 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.678 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.678 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2206 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:46.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290398+0000", 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000001e-06 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294671+0000", 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042724390000000003 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294711+0000", 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0376000000000001e-05 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294730+0000", 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8607e-05 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294856+0000", 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126651 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295125+0000", 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026840700000000002 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295349+0000", 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022454699999999999 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307240+0000", 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011891048 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318593+0000", 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011352777999999999 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318652+0000", 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8677000000000001e-05 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318686+0000", 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4616000000000002e-05 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.683 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2669 3.21 3:86a0e0c3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.473429582000001, 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020962138000000002, 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.684 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2669 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202328+0000", 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-06 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204239+0000", 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019104409999999999 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204265+0000", 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6054000000000002e-05 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204279+0000", 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3654e-05 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204361+0000", 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2522999999999996e-05 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204523+0000", 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000162332 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204661+0000", 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013798200000000001 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.210336+0000", 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056743339999999996 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223107+0000", 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012771714999999999 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223228+0000", 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012061300000000001 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223288+0000", 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9537999999999998e-05 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2710 3.3b 3:ddce91ac:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:46.689 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:46.690 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.163627173999998, 2024-04-24T13:33:46.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026438756000000001, 2024-04-24T13:33:46.690 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.690 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.690 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.690 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.690 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.690 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.690 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2710 2024-04-24T13:33:46.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.690 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512131+0000", 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0130000000000002e-06 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514363+0000", 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022325940000000001 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514394+0000", 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0144000000000001e-05 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514409+0000", 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5786000000000001e-05 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514497+0000", 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7876999999999999e-05 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514670+0000", 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000173096 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514768+0000", 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8089000000000002e-05 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.523354+0000", 2024-04-24T13:33:46.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085854190000000004 2024-04-24T13:33:46.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538483+0000", 2024-04-24T13:33:46.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015128922 2024-04-24T13:33:46.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538527+0000", 2024-04-24T13:33:46.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3835999999999998e-05 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538567+0000", 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.998e-05 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2808 3.2e 3:7441f999:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.144392473000003, 2024-04-24T13:33:46.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021413788, 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2808 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531366+0000", 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1089999999999998e-06 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533059+0000", 2024-04-24T13:33:46.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001693186 2024-04-24T13:33:46.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533088+0000", 2024-04-24T13:33:46.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9470000000000001e-05 2024-04-24T13:33:46.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533100+0000", 2024-04-24T13:33:46.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1979e-05 2024-04-24T13:33:46.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533176+0000", 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5691000000000004e-05 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533334+0000", 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015822199999999999 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533513+0000", 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178846 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.546303+0000", 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012790331 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552696+0000", 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063923169999999998 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552741+0000", 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126999999999997e-05 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.700 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552776+0000", 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5509999999999997e-05 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3094 3.14 3:29338048:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.079400001, 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022112211, 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.701 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3094 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:46.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596358+0000", 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6560000000000001e-06 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598612+0000", 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022539050000000001 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598639+0000", 2024-04-24T13:33:46.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7767e-05 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598651+0000", 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598735+0000", 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4176000000000002e-05 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598928+0000", 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019318199999999999 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.599089+0000", 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016078899999999999 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.612538+0000", 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013449081999999999 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618346+0000", 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058079799999999999 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618413+0000", 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7101999999999996e-05 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618467+0000", 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4295000000000001e-05 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.706 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3128 3.1f 3:f8849f48:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.689016017, 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027867126999999998, 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.707 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3128 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986743+0000", 2024-04-24T13:33:46.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.495e-06 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988482+0000", 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001739237 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988510+0000", 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8343999999999998e-05 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988525+0000", 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5384999999999999e-05 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988630+0000", 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010412 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988808+0000", 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178123 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988956+0000", 2024-04-24T13:33:46.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014802399999999999 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.995102+0000", 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061461179999999999 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014480+0000", 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019378581999999998 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014541+0000", 2024-04-24T13:33:46.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1007000000000001e-05 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014606+0000", 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4691999999999997e-05 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3130 3.f 3:f22fdcf5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.665834562000001, 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021419780999999999, 2024-04-24T13:33:46.712 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3130 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009923+0000", 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5890000000000001e-06 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011652+0000", 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017287419999999999 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011692+0000", 2024-04-24T13:33:46.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0346000000000003e-05 2024-04-24T13:33:46.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011707+0000", 2024-04-24T13:33:46.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5068e-05 2024-04-24T13:33:46.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011805+0000", 2024-04-24T13:33:46.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7935000000000003e-05 2024-04-24T13:33:46.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011984+0000", 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178629 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.012159+0000", 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017566500000000001 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.025987+0000", 2024-04-24T13:33:46.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013827409000000001 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031173+0000", 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051865590000000003 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031263+0000", 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9598000000000005e-05 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031340+0000", 2024-04-24T13:33:46.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7241000000000001e-05 2024-04-24T13:33:46.718 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.718 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.718 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.718 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3406 3.3b 3:dffc7604:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:46.718 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:46.718 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.120389153, 2024-04-24T13:33:46.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020810539999999999, 2024-04-24T13:33:46.718 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.718 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.718 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3406 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555369+0000", 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.672e-06 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557249+0000", 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001880086 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557282+0000", 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3065000000000003e-05 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557297+0000", 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4990999999999999e-05 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557389+0000", 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2447000000000004e-05 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557525+0000", 2024-04-24T13:33:46.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135821 2024-04-24T13:33:46.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:46.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557677+0000", 2024-04-24T13:33:46.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015188699999999999 2024-04-24T13:33:46.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.564715+0000", 2024-04-24T13:33:46.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070385329999999996 2024-04-24T13:33:46.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576037+0000", 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011321721999999999 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576112+0000", 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4924000000000003e-05 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576176+0000", 2024-04-24T13:33:46.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4392000000000003e-05 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3426 3.f 3:f3517f93:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_324:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.88190253, 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024699635000000001, 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.724 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3426 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793855+0000", 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4669999999999998e-06 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796548+0000", 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026926369999999999 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796572+0000", 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4456000000000001e-05 2024-04-24T13:33:46.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796586+0000", 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3937000000000001e-05 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796690+0000", 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104226 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796877+0000", 2024-04-24T13:33:46.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018668299999999999 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.797048+0000", 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017070599999999999 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.817921+0000", 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020873198999999999 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818393+0000", 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000472459 2024-04-24T13:33:46.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818475+0000", 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1403999999999995e-05 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818552+0000", 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7460999999999996e-05 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3427 3.21 3:854a3dc6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_325:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.871270390999999, 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023613657999999999, 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3427 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804488+0000", 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.23e-06 2024-04-24T13:33:46.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807535+0000", 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030472709999999998 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807563+0000", 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8087999999999999e-05 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807579+0000", 2024-04-24T13:33:46.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5732000000000001e-05 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807691+0000", 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111894 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807850+0000", 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015951999999999999 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.808005+0000", 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154487 2024-04-24T13:33:46.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.823418+0000", 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015413526 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828003+0000", 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045842299999999999 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828048+0000", 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5504999999999999e-05 2024-04-24T13:33:46.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828098+0000", 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0175e-05 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3430 3.3b 3:de51c163:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.838045543, 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025624112000000001, 2024-04-24T13:33:46.735 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3430 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837713+0000", 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6509999999999999e-06 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839548+0000", 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001834521 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839577+0000", 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8850999999999999e-05 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839611+0000", 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4140000000000002e-05 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839718+0000", 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107534 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839883+0000", 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016485999999999999 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.840056+0000", 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017321200000000001 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849455+0000", 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093988590000000007 2024-04-24T13:33:46.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863165+0000", 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013710178 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863263+0000", 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7559000000000006e-05 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863334+0000", 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0747000000000006e-05 2024-04-24T13:33:46.740 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3443 3.a e113/48 3:53aaab58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_341:head v 113'18, mlcod=113'16)", 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.700098457999999, 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022399639999999998, 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:46.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975668+0000", 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.113e-05 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979725+0000", 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040574219999999998 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979759+0000", 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4362000000000001e-05 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979774+0000", 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4935e-05 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979871+0000", 2024-04-24T13:33:46.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.658e-05 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979901+0000", 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-05 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.997990+0000", 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018089483 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.998056+0000", 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6208e-05 2024-04-24T13:33:46.744 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3458 3.f 3:f34a4471:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.555582125000001, 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026075494000000001, 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3458 2024-04-24T13:33:46.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.746 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:46.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.746 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:46.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.746 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.746 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.746 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120175+0000", 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5220000000000002e-06 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121620+0000", 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014442280000000001 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121646+0000", 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6424999999999999e-05 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121659+0000", 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121754+0000", 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4388999999999994e-05 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121968+0000", 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021460199999999999 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:46.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.122165+0000", 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019710999999999999 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.141554+0000", 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019388847000000001 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146083+0000", 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045284469999999997 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146129+0000", 2024-04-24T13:33:46.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6257000000000001e-05 2024-04-24T13:33:46.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146248+0000", 2024-04-24T13:33:46.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011958100000000001 2024-04-24T13:33:46.750 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.750 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.750 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.750 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3460 3.a e113/48 3:5102140b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_358:head v 113'19, mlcod=113'17)", 2024-04-24T13:33:46.750 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:46.750 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.529568102000001, 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025573478, 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:46.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146188+0000", 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.02e-07 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150270+0000", 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004082011 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150302+0000", 2024-04-24T13:33:46.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2570999999999997e-05 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150319+0000", 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6843000000000001e-05 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150404+0000", 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4538999999999998e-05 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150432+0000", 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8098000000000001e-05 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.170266+0000", 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019834497 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171760+0000", 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001494017 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.754 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.755 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3461 3.3b 3:dfe1b3a0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_359:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:46.755 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:46.755 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.526860195999999, 2024-04-24T13:33:46.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024256994, 2024-04-24T13:33:46.755 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.755 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.755 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.755 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.755 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.755 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.755 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3461 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148898+0000", 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6970000000000002e-06 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150603+0000", 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017049809999999999 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150615+0000", 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2368000000000001e-05 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150620+0000", 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5210000000000002e-06 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150671+0000", 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0315000000000002e-05 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150844+0000", 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017304399999999999 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.151009+0000", 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016544800000000001 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171479+0000", 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020469355000000002 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173035+0000", 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001556857 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173096+0000", 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0285999999999998e-05 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173152+0000", 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6122000000000002e-05 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3491 3.14 3:2a9aeaa0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_389:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.213108291999999, 2024-04-24T13:33:46.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029663012999999998, 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3491 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462649+0000", 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.65e-06 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464539+0000", 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001889527 2024-04-24T13:33:46.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464565+0000", 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6061999999999999e-05 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464580+0000", 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5273000000000001e-05 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464678+0000", 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7639000000000005e-05 2024-04-24T13:33:46.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464899+0000", 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000220638 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.465088+0000", 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018922700000000001 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.478519+0000", 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013430884000000001 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492184+0000", 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013665797 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492260+0000", 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6038999999999995e-05 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492310+0000", 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9277000000000003e-05 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.765 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3514 3.a e114/48 3:5344e333:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_412:head v 114'23, mlcod=114'21)", 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.974036577, 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021739380999999999, 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:46.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701734+0000", 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5807999999999998e-05 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705769+0000", 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040343660000000002 2024-04-24T13:33:46.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705801+0000", 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2406000000000001e-05 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705816+0000", 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4537e-05 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705925+0000", 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109114 2024-04-24T13:33:46.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705959+0000", 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4239999999999997e-05 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723399+0000", 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017439748000000001 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723458+0000", 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9162e-05 2024-04-24T13:33:46.769 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3525 3.f 3:f35962b2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_423:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.86853769, 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028712260999999999, 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.770 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3525 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807221+0000", 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7529999999999999e-06 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813425+0000", 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062037280000000004 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813449+0000", 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813462+0000", 2024-04-24T13:33:46.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200999999999999e-05 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813554+0000", 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2369999999999998e-05 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813730+0000", 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017569800000000001 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813908+0000", 2024-04-24T13:33:46.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178219 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.826992+0000", 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013083567000000001 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835795+0000", 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088026630000000005 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835870+0000", 2024-04-24T13:33:46.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5649999999999996e-05 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835930+0000", 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9318999999999999e-05 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3528 3.3b 3:dc395008:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_426:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.840193623999999, 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024383452999999999, 2024-04-24T13:33:46.775 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3528 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835564+0000", 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7369999999999998e-06 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837236+0000", 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001671964 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837275+0000", 2024-04-24T13:33:46.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8760000000000002e-05 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837292+0000", 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6884999999999998e-05 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837382+0000", 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9809999999999996e-05 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837556+0000", 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174103 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837728+0000", 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017202600000000001 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859492+0000", 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021764644999999999 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.779 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859714+0000", 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221809 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859857+0000", 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142738 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859945+0000", 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7975999999999999e-05 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.780 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3596 3.3b 3:dcf4b716:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_493:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 12.153168467, 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021336183000000002, 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3596 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:46.781 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522589+0000", 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.853e-06 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.782 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524412+0000", 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018229559999999999 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524440+0000", 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7489999999999999e-05 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524454+0000", 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4565e-05 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.783 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524556+0000", 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101166 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524666+0000", 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109918 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524816+0000", 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015030800000000001 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.784 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.531231+0000", 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064155159999999996 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543790+0000", 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012558565000000001 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543865+0000", 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4999999999999993e-05 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:46.785 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543923+0000", 2024-04-24T13:33:46.786 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7846000000000001e-05 2024-04-24T13:33:46.786 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.786 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.786 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.786 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:46.786 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:46.786 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:46.787 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:33:46.788 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:46.785+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:46.831 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:33:46.841 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:33:46.864 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-04-24T13:33:46.473843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4207741594,"num_objects":1203,"num_object_clones":0,"num_object_copies":2406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1203,"num_whiteouts":0,"num_read":2924,"num_read_kb":2617,"num_write":2270,"num_write_kb":4139780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":543816942,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3195,"ondisk_log_size":3195,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":8454760,"kb_used_data":8228164,"kb_used_omap":10,"kb_used_meta":226485,"kb_avail":652148120,"statfs":{"total":676457349120,"available":667799674880,"internally_reserved":0,"allocated":8425639936,"data_stored":8421287875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11161,"internal_metadata":231920743},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.028462"},"pg_stats":[{"pgid":"3.3f","version":"114'15","reported_seq":184,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451511+0000","last_change":"2024-04-24T13:31:00.989667+0000","last_active":"2024-04-24T13:33:42.451511+0000","last_peered":"2024-04-24T13:33:42.451511+0000","last_clean":"2024-04-24T13:33:42.451511+0000","last_became_active":"2024-04-24T13:31:00.989365+0000","last_became_peered":"2024-04-24T13:31:00.989365+0000","last_unstale":"2024-04-24T13:33:42.451511+0000","last_undegraded":"2024-04-24T13:33:42.451511+0000","last_fullsized":"2024-04-24T13:33:42.451511+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:00:51.108396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.38","version":"82'14","reported_seq":245,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433668+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:33:41.433668+0000","last_peered":"2024-04-24T13:33:41.433668+0000","last_clean":"2024-04-24T13:33:41.433668+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:33:41.433668+0000","last_undegraded":"2024-04-24T13:33:41.433668+0000","last_fullsized":"2024-04-24T13:33:41.433668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"114'8","reported_seq":212,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096949+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:33:42.096949+0000","last_peered":"2024-04-24T13:33:42.096949+0000","last_clean":"2024-04-24T13:33:42.096949+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:33:42.096949+0000","last_undegraded":"2024-04-24T13:33:42.096949+0000","last_fullsized":"2024-04-24T13:33:42.096949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"82'4","reported_seq":182,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091651+0000","last_change":"2024-04-24T13:30:50.941589+0000","last_active":"2024-04-24T13:33:42.091651+0000","last_peered":"2024-04-24T13:33:42.091651+0000","last_clean":"2024-04-24T13:33:42.091651+0000","last_became_active":"2024-04-24T13:30:50.941305+0000","last_became_peered":"2024-04-24T13:30:50.941305+0000","last_unstale":"2024-04-24T13:33:42.091651+0000","last_undegraded":"2024-04-24T13:33:42.091651+0000","last_fullsized":"2024-04-24T13:33:42.091651+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:23.793119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"114'13","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099594+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:33:42.099594+0000","last_peered":"2024-04-24T13:33:42.099594+0000","last_clean":"2024-04-24T13:33:42.099594+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:33:42.099594+0000","last_undegraded":"2024-04-24T13:33:42.099594+0000","last_fullsized":"2024-04-24T13:33:42.099594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":199,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093291+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:33:42.093291+0000","last_peered":"2024-04-24T13:33:42.093291+0000","last_clean":"2024-04-24T13:33:42.093291+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:33:42.093291+0000","last_undegraded":"2024-04-24T13:33:42.093291+0000","last_fullsized":"2024-04-24T13:33:42.093291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"114'11","reported_seq":215,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434764+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:33:41.434764+0000","last_peered":"2024-04-24T13:33:41.434764+0000","last_clean":"2024-04-24T13:33:41.434764+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:33:41.434764+0000","last_undegraded":"2024-04-24T13:33:41.434764+0000","last_fullsized":"2024-04-24T13:33:41.434764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"86'4","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089753+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:33:42.089753+0000","last_peered":"2024-04-24T13:33:42.089753+0000","last_clean":"2024-04-24T13:33:42.089753+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:33:42.089753+0000","last_undegraded":"2024-04-24T13:33:42.089753+0000","last_fullsized":"2024-04-24T13:33:42.089753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"114'24","reported_seq":190,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448094+0000","last_change":"2024-04-24T13:30:50.941360+0000","last_active":"2024-04-24T13:33:42.448094+0000","last_peered":"2024-04-24T13:33:42.448094+0000","last_clean":"2024-04-24T13:33:42.448094+0000","last_became_active":"2024-04-24T13:30:50.940816+0000","last_became_peered":"2024-04-24T13:30:50.940816+0000","last_unstale":"2024-04-24T13:33:42.448094+0000","last_undegraded":"2024-04-24T13:33:42.448094+0000","last_fullsized":"2024-04-24T13:33:42.448094+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:04.247947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"82'2","reported_seq":207,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450471+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:33:42.450471+0000","last_peered":"2024-04-24T13:33:42.450471+0000","last_clean":"2024-04-24T13:33:42.450471+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:33:42.450471+0000","last_undegraded":"2024-04-24T13:33:42.450471+0000","last_fullsized":"2024-04-24T13:33:42.450471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"114'23","reported_seq":227,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434186+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:33:41.434186+0000","last_peered":"2024-04-24T13:33:41.434186+0000","last_clean":"2024-04-24T13:33:41.434186+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:33:41.434186+0000","last_undegraded":"2024-04-24T13:33:41.434186+0000","last_fullsized":"2024-04-24T13:33:41.434186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"82'4","reported_seq":216,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093203+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:33:42.093203+0000","last_peered":"2024-04-24T13:33:42.093203+0000","last_clean":"2024-04-24T13:33:42.093203+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:33:42.093203+0000","last_undegraded":"2024-04-24T13:33:42.093203+0000","last_fullsized":"2024-04-24T13:33:42.093203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"114'21","reported_seq":185,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090469+0000","last_change":"2024-04-24T13:30:50.911441+0000","last_active":"2024-04-24T13:33:42.090469+0000","last_peered":"2024-04-24T13:33:42.090469+0000","last_clean":"2024-04-24T13:33:42.090469+0000","last_became_active":"2024-04-24T13:30:50.911096+0000","last_became_peered":"2024-04-24T13:30:50.911096+0000","last_unstale":"2024-04-24T13:33:42.090469+0000","last_undegraded":"2024-04-24T13:33:42.090469+0000","last_fullsized":"2024-04-24T13:33:42.090469+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:12.878818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"82'2","reported_seq":42,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435364+0000","last_change":"2024-04-24T13:33:09.792748+0000","last_active":"2024-04-24T13:33:41.435364+0000","last_peered":"2024-04-24T13:33:41.435364+0000","last_clean":"2024-04-24T13:33:41.435364+0000","last_became_active":"2024-04-24T13:33:08.725324+0000","last_became_peered":"2024-04-24T13:33:08.725324+0000","last_unstale":"2024-04-24T13:33:41.435364+0000","last_undegraded":"2024-04-24T13:33:41.435364+0000","last_fullsized":"2024-04-24T13:33:41.435364+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:20.696769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"114'12","reported_seq":232,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091824+0000","last_change":"2024-04-24T13:33:08.836525+0000","last_active":"2024-04-24T13:33:42.091824+0000","last_peered":"2024-04-24T13:33:42.091824+0000","last_clean":"2024-04-24T13:33:42.091824+0000","last_became_active":"2024-04-24T13:33:08.720200+0000","last_became_peered":"2024-04-24T13:33:08.720200+0000","last_unstale":"2024-04-24T13:33:42.091824+0000","last_undegraded":"2024-04-24T13:33:42.091824+0000","last_fullsized":"2024-04-24T13:33:42.091824+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:31.093323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"82'6","reported_seq":225,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449445+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:33:42.449445+0000","last_peered":"2024-04-24T13:33:42.449445+0000","last_clean":"2024-04-24T13:33:42.449445+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:33:42.449445+0000","last_undegraded":"2024-04-24T13:33:42.449445+0000","last_fullsized":"2024-04-24T13:33:42.449445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"86'4","reported_seq":216,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091673+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:33:42.091673+0000","last_peered":"2024-04-24T13:33:42.091673+0000","last_clean":"2024-04-24T13:33:42.091673+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:33:42.091673+0000","last_undegraded":"2024-04-24T13:33:42.091673+0000","last_fullsized":"2024-04-24T13:33:42.091673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"114'18","reported_seq":65,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434935+0000","last_change":"2024-04-24T13:33:08.903178+0000","last_active":"2024-04-24T13:33:41.434935+0000","last_peered":"2024-04-24T13:33:41.434935+0000","last_clean":"2024-04-24T13:33:41.434935+0000","last_became_active":"2024-04-24T13:33:08.706032+0000","last_became_peered":"2024-04-24T13:33:08.706032+0000","last_unstale":"2024-04-24T13:33:41.434935+0000","last_undegraded":"2024-04-24T13:33:41.434935+0000","last_fullsized":"2024-04-24T13:33:41.434935+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:05:00.168247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"82'4","reported_seq":181,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091158+0000","last_change":"2024-04-24T13:30:50.937742+0000","last_active":"2024-04-24T13:33:42.091158+0000","last_peered":"2024-04-24T13:33:42.091158+0000","last_clean":"2024-04-24T13:33:42.091158+0000","last_became_active":"2024-04-24T13:30:50.937395+0000","last_became_peered":"2024-04-24T13:30:50.937395+0000","last_unstale":"2024-04-24T13:33:42.091158+0000","last_undegraded":"2024-04-24T13:33:42.091158+0000","last_fullsized":"2024-04-24T13:33:42.091158+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:43.335130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"114'16","reported_seq":248,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450843+0000","last_change":"2024-04-24T13:33:08.998015+0000","last_active":"2024-04-24T13:33:42.450843+0000","last_peered":"2024-04-24T13:33:42.450843+0000","last_clean":"2024-04-24T13:33:42.450843+0000","last_became_active":"2024-04-24T13:33:08.726581+0000","last_became_peered":"2024-04-24T13:33:08.726581+0000","last_unstale":"2024-04-24T13:33:42.450843+0000","last_undegraded":"2024-04-24T13:33:42.450843+0000","last_fullsized":"2024-04-24T13:33:42.450843+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:03:25.814262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":26,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"86'6","reported_seq":46,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433266+0000","last_change":"2024-04-24T13:33:09.293808+0000","last_active":"2024-04-24T13:33:41.433266+0000","last_peered":"2024-04-24T13:33:41.433266+0000","last_clean":"2024-04-24T13:33:41.433266+0000","last_became_active":"2024-04-24T13:33:08.719391+0000","last_became_peered":"2024-04-24T13:33:08.719391+0000","last_unstale":"2024-04-24T13:33:41.433266+0000","last_undegraded":"2024-04-24T13:33:41.433266+0000","last_fullsized":"2024-04-24T13:33:41.433266+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:10.422756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"114'13","reported_seq":238,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.452441+0000","last_change":"2024-04-24T13:33:09.199641+0000","last_active":"2024-04-24T13:33:42.452441+0000","last_peered":"2024-04-24T13:33:42.452441+0000","last_clean":"2024-04-24T13:33:42.452441+0000","last_became_active":"2024-04-24T13:33:08.737789+0000","last_became_peered":"2024-04-24T13:33:08.737789+0000","last_unstale":"2024-04-24T13:33:42.452441+0000","last_undegraded":"2024-04-24T13:33:42.452441+0000","last_fullsized":"2024-04-24T13:33:42.452441+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:41.648006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":200,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448125+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:33:42.448125+0000","last_peered":"2024-04-24T13:33:42.448125+0000","last_clean":"2024-04-24T13:33:42.448125+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:33:42.448125+0000","last_undegraded":"2024-04-24T13:33:42.448125+0000","last_fullsized":"2024-04-24T13:33:42.448125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"114'16","reported_seq":219,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092838+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:33:42.092838+0000","last_peered":"2024-04-24T13:33:42.092838+0000","last_clean":"2024-04-24T13:33:42.092838+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:33:42.092838+0000","last_undegraded":"2024-04-24T13:33:42.092838+0000","last_fullsized":"2024-04-24T13:33:42.092838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"86'4","reported_seq":218,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448689+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:33:42.448689+0000","last_peered":"2024-04-24T13:33:42.448689+0000","last_clean":"2024-04-24T13:33:42.448689+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:33:42.448689+0000","last_undegraded":"2024-04-24T13:33:42.448689+0000","last_fullsized":"2024-04-24T13:33:42.448689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"113'16","reported_seq":218,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092757+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:33:42.092757+0000","last_peered":"2024-04-24T13:33:42.092757+0000","last_clean":"2024-04-24T13:33:42.092757+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:33:42.092757+0000","last_undegraded":"2024-04-24T13:33:42.092757+0000","last_fullsized":"2024-04-24T13:33:42.092757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"82'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093527+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:33:42.093527+0000","last_peered":"2024-04-24T13:33:42.093527+0000","last_clean":"2024-04-24T13:33:42.093527+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:33:42.093527+0000","last_undegraded":"2024-04-24T13:33:42.093527+0000","last_fullsized":"2024-04-24T13:33:42.093527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"114'14","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094116+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:33:42.094116+0000","last_peered":"2024-04-24T13:33:42.094116+0000","last_clean":"2024-04-24T13:33:42.094116+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:33:42.094116+0000","last_undegraded":"2024-04-24T13:33:42.094116+0000","last_fullsized":"2024-04-24T13:33:42.094116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":183,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091120+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:33:42.091120+0000","last_peered":"2024-04-24T13:33:42.091120+0000","last_clean":"2024-04-24T13:33:42.091120+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:33:42.091120+0000","last_undegraded":"2024-04-24T13:33:42.091120+0000","last_fullsized":"2024-04-24T13:33:42.091120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"82'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096120+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:33:42.096120+0000","last_peered":"2024-04-24T13:33:42.096120+0000","last_clean":"2024-04-24T13:33:42.096120+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:33:42.096120+0000","last_undegraded":"2024-04-24T13:33:42.096120+0000","last_fullsized":"2024-04-24T13:33:42.096120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"114'21","reported_seq":185,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093147+0000","last_change":"2024-04-24T13:30:50.929479+0000","last_active":"2024-04-24T13:33:42.093147+0000","last_peered":"2024-04-24T13:33:42.093147+0000","last_clean":"2024-04-24T13:33:42.093147+0000","last_became_active":"2024-04-24T13:30:50.928545+0000","last_became_peered":"2024-04-24T13:30:50.928545+0000","last_unstale":"2024-04-24T13:33:42.093147+0000","last_undegraded":"2024-04-24T13:33:42.093147+0000","last_fullsized":"2024-04-24T13:33:42.093147+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:26:58.476605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":31,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":52,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434691+0000","last_change":"2024-04-24T13:33:10.797093+0000","last_active":"2024-04-24T13:33:41.434691+0000","last_peered":"2024-04-24T13:33:41.434691+0000","last_clean":"2024-04-24T13:33:41.434691+0000","last_became_active":"2024-04-24T13:33:08.736087+0000","last_became_peered":"2024-04-24T13:33:08.736087+0000","last_unstale":"2024-04-24T13:33:41.434691+0000","last_undegraded":"2024-04-24T13:33:41.434691+0000","last_fullsized":"2024-04-24T13:33:41.434691+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:49:31.056251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"114'16","reported_seq":229,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100291+0000","last_change":"2024-04-24T13:30:50.953480+0000","last_active":"2024-04-24T13:33:42.100291+0000","last_peered":"2024-04-24T13:33:42.100291+0000","last_clean":"2024-04-24T13:33:42.100291+0000","last_became_active":"2024-04-24T13:30:50.917577+0000","last_became_peered":"2024-04-24T13:30:50.917577+0000","last_unstale":"2024-04-24T13:33:42.100291+0000","last_undegraded":"2024-04-24T13:33:42.100291+0000","last_fullsized":"2024-04-24T13:33:42.100291+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:41.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434816+0000","last_change":"2024-04-24T13:33:08.716116+0000","last_active":"2024-04-24T13:33:41.434816+0000","last_peered":"2024-04-24T13:33:41.434816+0000","last_clean":"2024-04-24T13:33:41.434816+0000","last_became_active":"2024-04-24T13:33:08.714157+0000","last_became_peered":"2024-04-24T13:33:08.714157+0000","last_unstale":"2024-04-24T13:33:41.434816+0000","last_undegraded":"2024-04-24T13:33:41.434816+0000","last_fullsized":"2024-04-24T13:33:41.434816+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:28.341076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"114'44","reported_seq":52,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433332+0000","last_change":"2024-04-24T13:33:08.911162+0000","last_active":"2024-04-24T13:33:41.433332+0000","last_peered":"2024-04-24T13:33:41.433332+0000","last_clean":"2024-04-24T13:33:41.433332+0000","last_became_active":"2024-04-24T13:33:08.709158+0000","last_became_peered":"2024-04-24T13:33:08.709158+0000","last_unstale":"2024-04-24T13:33:41.433332+0000","last_undegraded":"2024-04-24T13:33:41.433332+0000","last_fullsized":"2024-04-24T13:33:41.433332+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:56.162767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":88,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"82'4","reported_seq":44,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435372+0000","last_change":"2024-04-24T13:33:10.792268+0000","last_active":"2024-04-24T13:33:41.435372+0000","last_peered":"2024-04-24T13:33:41.435372+0000","last_clean":"2024-04-24T13:33:41.435372+0000","last_became_active":"2024-04-24T13:33:08.735563+0000","last_became_peered":"2024-04-24T13:33:08.735563+0000","last_unstale":"2024-04-24T13:33:41.435372+0000","last_undegraded":"2024-04-24T13:33:41.435372+0000","last_fullsized":"2024-04-24T13:33:41.435372+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:09.560179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"113'14","reported_seq":222,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094380+0000","last_change":"2024-04-24T13:30:50.915215+0000","last_active":"2024-04-24T13:33:42.094380+0000","last_peered":"2024-04-24T13:33:42.094380+0000","last_clean":"2024-04-24T13:33:42.094380+0000","last_became_active":"2024-04-24T13:30:50.913930+0000","last_became_peered":"2024-04-24T13:30:50.913930+0000","last_unstale":"2024-04-24T13:33:42.094380+0000","last_undegraded":"2024-04-24T13:33:42.094380+0000","last_fullsized":"2024-04-24T13:33:42.094380+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:53.839067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":199,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095891+0000","last_change":"2024-04-24T13:30:50.926673+0000","last_active":"2024-04-24T13:33:42.095891+0000","last_peered":"2024-04-24T13:33:42.095891+0000","last_clean":"2024-04-24T13:33:42.095891+0000","last_became_active":"2024-04-24T13:30:50.926286+0000","last_became_peered":"2024-04-24T13:30:50.926286+0000","last_unstale":"2024-04-24T13:33:42.095891+0000","last_undegraded":"2024-04-24T13:33:42.095891+0000","last_fullsized":"2024-04-24T13:33:42.095891+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:21:21.951639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":200,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093848+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:33:42.093848+0000","last_peered":"2024-04-24T13:33:42.093848+0000","last_clean":"2024-04-24T13:33:42.093848+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:33:42.093848+0000","last_undegraded":"2024-04-24T13:33:42.093848+0000","last_fullsized":"2024-04-24T13:33:42.093848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092856+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:33:42.092856+0000","last_peered":"2024-04-24T13:33:42.092856+0000","last_clean":"2024-04-24T13:33:42.092856+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:33:42.092856+0000","last_undegraded":"2024-04-24T13:33:42.092856+0000","last_fullsized":"2024-04-24T13:33:42.092856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":183,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091366+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:33:42.091366+0000","last_peered":"2024-04-24T13:33:42.091366+0000","last_clean":"2024-04-24T13:33:42.091366+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:33:42.091366+0000","last_undegraded":"2024-04-24T13:33:42.091366+0000","last_fullsized":"2024-04-24T13:33:42.091366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"86'10","reported_seq":230,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099730+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:33:42.099730+0000","last_peered":"2024-04-24T13:33:42.099730+0000","last_clean":"2024-04-24T13:33:42.099730+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:33:42.099730+0000","last_undegraded":"2024-04-24T13:33:42.099730+0000","last_fullsized":"2024-04-24T13:33:42.099730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"114'19","reported_seq":182,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092328+0000","last_change":"2024-04-24T13:30:50.946908+0000","last_active":"2024-04-24T13:33:42.092328+0000","last_peered":"2024-04-24T13:33:42.092328+0000","last_clean":"2024-04-24T13:33:42.092328+0000","last_became_active":"2024-04-24T13:30:50.932201+0000","last_became_peered":"2024-04-24T13:30:50.932201+0000","last_unstale":"2024-04-24T13:33:42.092328+0000","last_undegraded":"2024-04-24T13:33:42.092328+0000","last_fullsized":"2024-04-24T13:33:42.092328+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:41.874257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":194,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096973+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:33:42.096973+0000","last_peered":"2024-04-24T13:33:42.096973+0000","last_clean":"2024-04-24T13:33:42.096973+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:33:42.096973+0000","last_undegraded":"2024-04-24T13:33:42.096973+0000","last_fullsized":"2024-04-24T13:33:42.096973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":207,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448394+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:33:42.448394+0000","last_peered":"2024-04-24T13:33:42.448394+0000","last_clean":"2024-04-24T13:33:42.448394+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:33:42.448394+0000","last_undegraded":"2024-04-24T13:33:42.448394+0000","last_fullsized":"2024-04-24T13:33:42.448394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"114'120","reported_seq":328,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.097364+0000","last_change":"2024-04-24T13:30:50.933595+0000","last_active":"2024-04-24T13:33:42.097364+0000","last_peered":"2024-04-24T13:33:42.097364+0000","last_clean":"2024-04-24T13:33:42.097364+0000","last_became_active":"2024-04-24T13:30:50.926963+0000","last_became_peered":"2024-04-24T13:30:50.926963+0000","last_unstale":"2024-04-24T13:33:42.097364+0000","last_undegraded":"2024-04-24T13:33:42.097364+0000","last_fullsized":"2024-04-24T13:33:42.097364+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"105'8","reported_seq":195,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092213+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:33:42.092213+0000","last_peered":"2024-04-24T13:33:42.092213+0000","last_clean":"2024-04-24T13:33:42.092213+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:33:42.092213+0000","last_undegraded":"2024-04-24T13:33:42.092213+0000","last_fullsized":"2024-04-24T13:33:42.092213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"86'2","reported_seq":212,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091098+0000","last_change":"2024-04-24T13:30:50.921336+0000","last_active":"2024-04-24T13:33:42.091098+0000","last_peered":"2024-04-24T13:33:42.091098+0000","last_clean":"2024-04-24T13:33:42.091098+0000","last_became_active":"2024-04-24T13:30:50.920829+0000","last_became_peered":"2024-04-24T13:30:50.920829+0000","last_unstale":"2024-04-24T13:33:42.091098+0000","last_undegraded":"2024-04-24T13:33:42.091098+0000","last_fullsized":"2024-04-24T13:33:42.091098+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:37.250085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"114'16","reported_seq":219,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449391+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:33:42.449391+0000","last_peered":"2024-04-24T13:33:42.449391+0000","last_clean":"2024-04-24T13:33:42.449391+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:33:42.449391+0000","last_undegraded":"2024-04-24T13:33:42.449391+0000","last_fullsized":"2024-04-24T13:33:42.449391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435521+0000","last_change":"2024-04-24T13:33:08.718010+0000","last_active":"2024-04-24T13:33:41.435521+0000","last_peered":"2024-04-24T13:33:41.435521+0000","last_clean":"2024-04-24T13:33:41.435521+0000","last_became_active":"2024-04-24T13:33:08.716072+0000","last_became_peered":"2024-04-24T13:33:08.716072+0000","last_unstale":"2024-04-24T13:33:41.435521+0000","last_undegraded":"2024-04-24T13:33:41.435521+0000","last_fullsized":"2024-04-24T13:33:41.435521+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:26.626730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"114'16","reported_seq":215,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451659+0000","last_change":"2024-04-24T13:30:51.001114+0000","last_active":"2024-04-24T13:33:42.451659+0000","last_peered":"2024-04-24T13:33:42.451659+0000","last_clean":"2024-04-24T13:33:42.451659+0000","last_became_active":"2024-04-24T13:30:50.954422+0000","last_became_peered":"2024-04-24T13:30:50.954422+0000","last_unstale":"2024-04-24T13:33:42.451659+0000","last_undegraded":"2024-04-24T13:33:42.451659+0000","last_fullsized":"2024-04-24T13:33:42.451659+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:44.516492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"114'119","reported_seq":364,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095251+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:33:42.095251+0000","last_peered":"2024-04-24T13:33:42.095251+0000","last_clean":"2024-04-24T13:33:42.095251+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:33:42.095251+0000","last_undegraded":"2024-04-24T13:33:42.095251+0000","last_fullsized":"2024-04-24T13:33:42.095251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"82'2","reported_seq":42,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434097+0000","last_change":"2024-04-24T13:33:08.913939+0000","last_active":"2024-04-24T13:33:41.434097+0000","last_peered":"2024-04-24T13:33:41.434097+0000","last_clean":"2024-04-24T13:33:41.434097+0000","last_became_active":"2024-04-24T13:33:08.708842+0000","last_became_peered":"2024-04-24T13:33:08.708842+0000","last_unstale":"2024-04-24T13:33:41.434097+0000","last_undegraded":"2024-04-24T13:33:41.434097+0000","last_fullsized":"2024-04-24T13:33:41.434097+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:47.448716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"114'13","reported_seq":164,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449173+0000","last_change":"2024-04-24T13:31:01.035289+0000","last_active":"2024-04-24T13:33:42.449173+0000","last_peered":"2024-04-24T13:33:42.449173+0000","last_clean":"2024-04-24T13:33:42.449173+0000","last_became_active":"2024-04-24T13:31:01.034325+0000","last_became_peered":"2024-04-24T13:31:01.034325+0000","last_unstale":"2024-04-24T13:33:42.449173+0000","last_undegraded":"2024-04-24T13:33:42.449173+0000","last_fullsized":"2024-04-24T13:33:42.449173+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:08.322191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":164,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449456+0000","last_change":"2024-04-24T13:30:50.948387+0000","last_active":"2024-04-24T13:33:42.449456+0000","last_peered":"2024-04-24T13:33:42.449456+0000","last_clean":"2024-04-24T13:33:42.449456+0000","last_became_active":"2024-04-24T13:30:50.947644+0000","last_became_peered":"2024-04-24T13:30:50.947644+0000","last_unstale":"2024-04-24T13:33:42.449456+0000","last_undegraded":"2024-04-24T13:33:42.449456+0000","last_fullsized":"2024-04-24T13:33:42.449456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:03.622375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"114'26","reported_seq":60,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434126+0000","last_change":"2024-04-24T13:33:10.421787+0000","last_active":"2024-04-24T13:33:41.434126+0000","last_peered":"2024-04-24T13:33:41.434126+0000","last_clean":"2024-04-24T13:33:41.434126+0000","last_became_active":"2024-04-24T13:33:08.733302+0000","last_became_peered":"2024-04-24T13:33:08.733302+0000","last_unstale":"2024-04-24T13:33:41.434126+0000","last_undegraded":"2024-04-24T13:33:41.434126+0000","last_fullsized":"2024-04-24T13:33:41.434126+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:10:16.339117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":198,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094459+0000","last_change":"2024-04-24T13:33:08.727357+0000","last_active":"2024-04-24T13:33:42.094459+0000","last_peered":"2024-04-24T13:33:42.094459+0000","last_clean":"2024-04-24T13:33:42.094459+0000","last_became_active":"2024-04-24T13:33:08.726787+0000","last_became_peered":"2024-04-24T13:33:08.726787+0000","last_unstale":"2024-04-24T13:33:42.094459+0000","last_undegraded":"2024-04-24T13:33:42.094459+0000","last_fullsized":"2024-04-24T13:33:42.094459+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:49.701435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"86'7","reported_seq":194,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434480+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:33:41.434480+0000","last_peered":"2024-04-24T13:33:41.434480+0000","last_clean":"2024-04-24T13:33:41.434480+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:33:41.434480+0000","last_undegraded":"2024-04-24T13:33:41.434480+0000","last_fullsized":"2024-04-24T13:33:41.434480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"114'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093124+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:33:42.093124+0000","last_peered":"2024-04-24T13:33:42.093124+0000","last_clean":"2024-04-24T13:33:42.093124+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:33:42.093124+0000","last_undegraded":"2024-04-24T13:33:42.093124+0000","last_fullsized":"2024-04-24T13:33:42.093124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"114'10","reported_seq":173,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094894+0000","last_change":"2024-04-24T13:30:50.930041+0000","last_active":"2024-04-24T13:33:42.094894+0000","last_peered":"2024-04-24T13:33:42.094894+0000","last_clean":"2024-04-24T13:33:42.094894+0000","last_became_active":"2024-04-24T13:30:50.929179+0000","last_became_peered":"2024-04-24T13:30:50.929179+0000","last_unstale":"2024-04-24T13:33:42.094894+0000","last_undegraded":"2024-04-24T13:33:42.094894+0000","last_fullsized":"2024-04-24T13:33:42.094894+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:46.987972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":196,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.446997+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:33:42.446997+0000","last_peered":"2024-04-24T13:33:42.446997+0000","last_clean":"2024-04-24T13:33:42.446997+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:33:42.446997+0000","last_undegraded":"2024-04-24T13:33:42.446997+0000","last_fullsized":"2024-04-24T13:33:42.446997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"114'17","reported_seq":229,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093833+0000","last_change":"2024-04-24T13:30:50.948850+0000","last_active":"2024-04-24T13:33:42.093833+0000","last_peered":"2024-04-24T13:33:42.093833+0000","last_clean":"2024-04-24T13:33:42.093833+0000","last_became_active":"2024-04-24T13:30:50.921374+0000","last_became_peered":"2024-04-24T13:30:50.921374+0000","last_unstale":"2024-04-24T13:33:42.093833+0000","last_undegraded":"2024-04-24T13:33:42.093833+0000","last_fullsized":"2024-04-24T13:33:42.093833+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:22:03.728196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":186,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090221+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:33:42.090221+0000","last_peered":"2024-04-24T13:33:42.090221+0000","last_clean":"2024-04-24T13:33:42.090221+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:33:42.090221+0000","last_undegraded":"2024-04-24T13:33:42.090221+0000","last_fullsized":"2024-04-24T13:33:42.090221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":183,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450477+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:33:42.450477+0000","last_peered":"2024-04-24T13:33:42.450477+0000","last_clean":"2024-04-24T13:33:42.450477+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:33:42.450477+0000","last_undegraded":"2024-04-24T13:33:42.450477+0000","last_fullsized":"2024-04-24T13:33:42.450477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"82'4","reported_seq":222,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449056+0000","last_change":"2024-04-24T13:32:01.548738+0000","last_active":"2024-04-24T13:33:42.449056+0000","last_peered":"2024-04-24T13:33:42.449056+0000","last_clean":"2024-04-24T13:33:42.449056+0000","last_became_active":"2024-04-24T13:32:01.548259+0000","last_became_peered":"2024-04-24T13:32:01.548259+0000","last_unstale":"2024-04-24T13:33:42.449056+0000","last_undegraded":"2024-04-24T13:33:42.449056+0000","last_fullsized":"2024-04-24T13:33:42.449056+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"114'19","reported_seq":69,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435003+0000","last_change":"2024-04-24T13:33:11.062433+0000","last_active":"2024-04-24T13:33:41.435003+0000","last_peered":"2024-04-24T13:33:41.435003+0000","last_clean":"2024-04-24T13:33:41.435003+0000","last_became_active":"2024-04-24T13:33:08.736638+0000","last_became_peered":"2024-04-24T13:33:08.736638+0000","last_unstale":"2024-04-24T13:33:41.435003+0000","last_undegraded":"2024-04-24T13:33:41.435003+0000","last_fullsized":"2024-04-24T13:33:41.435003+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:11.066693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":196,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.447119+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:33:42.447119+0000","last_peered":"2024-04-24T13:33:42.447119+0000","last_clean":"2024-04-24T13:33:42.447119+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:33:42.447119+0000","last_undegraded":"2024-04-24T13:33:42.447119+0000","last_fullsized":"2024-04-24T13:33:42.447119+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"114'22","reported_seq":232,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.447061+0000","last_change":"2024-04-24T13:30:50.970163+0000","last_active":"2024-04-24T13:33:42.447061+0000","last_peered":"2024-04-24T13:33:42.447061+0000","last_clean":"2024-04-24T13:33:42.447061+0000","last_became_active":"2024-04-24T13:30:50.920182+0000","last_became_peered":"2024-04-24T13:30:50.920182+0000","last_unstale":"2024-04-24T13:33:42.447061+0000","last_undegraded":"2024-04-24T13:33:42.447061+0000","last_fullsized":"2024-04-24T13:33:42.447061+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:29.765956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"114'119","reported_seq":426,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089879+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:33:42.089879+0000","last_peered":"2024-04-24T13:33:42.089879+0000","last_clean":"2024-04-24T13:33:42.089879+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:33:42.089879+0000","last_undegraded":"2024-04-24T13:33:42.089879+0000","last_fullsized":"2024-04-24T13:33:42.089879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"82'3","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100229+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:33:42.100229+0000","last_peered":"2024-04-24T13:33:42.100229+0000","last_clean":"2024-04-24T13:33:42.100229+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:33:42.100229+0000","last_undegraded":"2024-04-24T13:33:42.100229+0000","last_fullsized":"2024-04-24T13:33:42.100229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"105'8","reported_seq":233,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092067+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:33:42.092067+0000","last_peered":"2024-04-24T13:33:42.092067+0000","last_clean":"2024-04-24T13:33:42.092067+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:33:42.092067+0000","last_undegraded":"2024-04-24T13:33:42.092067+0000","last_fullsized":"2024-04-24T13:33:42.092067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"114'17","reported_seq":65,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434781+0000","last_change":"2024-04-24T13:33:10.787412+0000","last_active":"2024-04-24T13:33:41.434781+0000","last_peered":"2024-04-24T13:33:41.434781+0000","last_clean":"2024-04-24T13:33:41.434781+0000","last_became_active":"2024-04-24T13:33:08.718332+0000","last_became_peered":"2024-04-24T13:33:08.718332+0000","last_unstale":"2024-04-24T13:33:41.434781+0000","last_undegraded":"2024-04-24T13:33:41.434781+0000","last_fullsized":"2024-04-24T13:33:41.434781+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:11.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":196,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.447470+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:33:42.447470+0000","last_peered":"2024-04-24T13:33:42.447470+0000","last_clean":"2024-04-24T13:33:42.447470+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:33:42.447470+0000","last_undegraded":"2024-04-24T13:33:42.447470+0000","last_fullsized":"2024-04-24T13:33:42.447470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"114'26","reported_seq":245,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090734+0000","last_change":"2024-04-24T13:30:51.000083+0000","last_active":"2024-04-24T13:33:42.090734+0000","last_peered":"2024-04-24T13:33:42.090734+0000","last_clean":"2024-04-24T13:33:42.090734+0000","last_became_active":"2024-04-24T13:30:50.934568+0000","last_became_peered":"2024-04-24T13:30:50.934568+0000","last_unstale":"2024-04-24T13:33:42.090734+0000","last_undegraded":"2024-04-24T13:33:42.090734+0000","last_fullsized":"2024-04-24T13:33:42.090734+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:10.436000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":193,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.446900+0000","last_change":"2024-04-24T13:30:50.908390+0000","last_active":"2024-04-24T13:33:42.446900+0000","last_peered":"2024-04-24T13:33:42.446900+0000","last_clean":"2024-04-24T13:33:42.446900+0000","last_became_active":"2024-04-24T13:30:50.908013+0000","last_became_peered":"2024-04-24T13:30:50.908013+0000","last_unstale":"2024-04-24T13:33:42.446900+0000","last_undegraded":"2024-04-24T13:33:42.446900+0000","last_fullsized":"2024-04-24T13:33:42.446900+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'10","reported_seq":220,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095905+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:33:42.095905+0000","last_peered":"2024-04-24T13:33:42.095905+0000","last_clean":"2024-04-24T13:33:42.095905+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:33:42.095905+0000","last_undegraded":"2024-04-24T13:33:42.095905+0000","last_fullsized":"2024-04-24T13:33:42.095905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"82'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093634+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:33:42.093634+0000","last_peered":"2024-04-24T13:33:42.093634+0000","last_clean":"2024-04-24T13:33:42.093634+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:33:42.093634+0000","last_undegraded":"2024-04-24T13:33:42.093634+0000","last_fullsized":"2024-04-24T13:33:42.093634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"114'20","reported_seq":222,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091996+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:33:42.091996+0000","last_peered":"2024-04-24T13:33:42.091996+0000","last_clean":"2024-04-24T13:33:42.091996+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:33:42.091996+0000","last_undegraded":"2024-04-24T13:33:42.091996+0000","last_fullsized":"2024-04-24T13:33:42.091996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":211,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448304+0000","last_change":"2024-04-24T13:33:08.738006+0000","last_active":"2024-04-24T13:33:42.448304+0000","last_peered":"2024-04-24T13:33:42.448304+0000","last_clean":"2024-04-24T13:33:42.448304+0000","last_became_active":"2024-04-24T13:33:08.737341+0000","last_became_peered":"2024-04-24T13:33:08.737341+0000","last_unstale":"2024-04-24T13:33:42.448304+0000","last_undegraded":"2024-04-24T13:33:42.448304+0000","last_fullsized":"2024-04-24T13:33:42.448304+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:51.796840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"114'18","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092988+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:33:42.092988+0000","last_peered":"2024-04-24T13:33:42.092988+0000","last_clean":"2024-04-24T13:33:42.092988+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:33:42.092988+0000","last_undegraded":"2024-04-24T13:33:42.092988+0000","last_fullsized":"2024-04-24T13:33:42.092988+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100240+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:33:42.100240+0000","last_peered":"2024-04-24T13:33:42.100240+0000","last_clean":"2024-04-24T13:33:42.100240+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:33:42.100240+0000","last_undegraded":"2024-04-24T13:33:42.100240+0000","last_fullsized":"2024-04-24T13:33:42.100240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":192,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093255+0000","last_change":"2024-04-24T13:33:08.720576+0000","last_active":"2024-04-24T13:33:42.093255+0000","last_peered":"2024-04-24T13:33:42.093255+0000","last_clean":"2024-04-24T13:33:42.093255+0000","last_became_active":"2024-04-24T13:33:08.720133+0000","last_became_peered":"2024-04-24T13:33:08.720133+0000","last_unstale":"2024-04-24T13:33:42.093255+0000","last_undegraded":"2024-04-24T13:33:42.093255+0000","last_fullsized":"2024-04-24T13:33:42.093255+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:16.254173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":199,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094028+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:33:42.094028+0000","last_peered":"2024-04-24T13:33:42.094028+0000","last_clean":"2024-04-24T13:33:42.094028+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:33:42.094028+0000","last_undegraded":"2024-04-24T13:33:42.094028+0000","last_fullsized":"2024-04-24T13:33:42.094028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"114'24","reported_seq":232,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449403+0000","last_change":"2024-04-24T13:31:00.986244+0000","last_active":"2024-04-24T13:33:42.449403+0000","last_peered":"2024-04-24T13:33:42.449403+0000","last_clean":"2024-04-24T13:33:42.449403+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:33:42.449403+0000","last_undegraded":"2024-04-24T13:33:42.449403+0000","last_fullsized":"2024-04-24T13:33:42.449403+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:23.355231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":196,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093188+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:33:42.093188+0000","last_peered":"2024-04-24T13:33:42.093188+0000","last_clean":"2024-04-24T13:33:42.093188+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:33:42.093188+0000","last_undegraded":"2024-04-24T13:33:42.093188+0000","last_fullsized":"2024-04-24T13:33:42.093188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"114'24","reported_seq":226,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449359+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:33:42.449359+0000","last_peered":"2024-04-24T13:33:42.449359+0000","last_clean":"2024-04-24T13:33:42.449359+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:33:42.449359+0000","last_undegraded":"2024-04-24T13:33:42.449359+0000","last_fullsized":"2024-04-24T13:33:42.449359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"114'123","reported_seq":381,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448617+0000","last_change":"2024-04-24T13:33:11.710852+0000","last_active":"2024-04-24T13:33:42.448617+0000","last_peered":"2024-04-24T13:33:42.448617+0000","last_clean":"2024-04-24T13:33:42.448617+0000","last_became_active":"2024-04-24T13:33:11.709412+0000","last_became_peered":"2024-04-24T13:33:11.709412+0000","last_unstale":"2024-04-24T13:33:42.448617+0000","last_undegraded":"2024-04-24T13:33:42.448617+0000","last_fullsized":"2024-04-24T13:33:42.448617+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:22:40.670445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":184,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091405+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:33:42.091405+0000","last_peered":"2024-04-24T13:33:42.091405+0000","last_clean":"2024-04-24T13:33:42.091405+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:33:42.091405+0000","last_undegraded":"2024-04-24T13:33:42.091405+0000","last_fullsized":"2024-04-24T13:33:42.091405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"114'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094680+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:33:42.094680+0000","last_peered":"2024-04-24T13:33:42.094680+0000","last_clean":"2024-04-24T13:33:42.094680+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:33:42.094680+0000","last_undegraded":"2024-04-24T13:33:42.094680+0000","last_fullsized":"2024-04-24T13:33:42.094680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"113'21","reported_seq":224,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091808+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:33:42.091808+0000","last_peered":"2024-04-24T13:33:42.091808+0000","last_clean":"2024-04-24T13:33:42.091808+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:33:42.091808+0000","last_undegraded":"2024-04-24T13:33:42.091808+0000","last_fullsized":"2024-04-24T13:33:42.091808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":64,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435518+0000","last_change":"2024-04-24T13:33:09.912410+0000","last_active":"2024-04-24T13:33:41.435518+0000","last_peered":"2024-04-24T13:33:41.435518+0000","last_clean":"2024-04-24T13:33:41.435518+0000","last_became_active":"2024-04-24T13:33:08.724858+0000","last_became_peered":"2024-04-24T13:33:08.724858+0000","last_unstale":"2024-04-24T13:33:41.435518+0000","last_undegraded":"2024-04-24T13:33:41.435518+0000","last_fullsized":"2024-04-24T13:33:41.435518+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:26.760043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":156,"num_read_kb":156,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"82'11","reported_seq":206,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095482+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:33:42.095482+0000","last_peered":"2024-04-24T13:33:42.095482+0000","last_clean":"2024-04-24T13:33:42.095482+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:33:42.095482+0000","last_undegraded":"2024-04-24T13:33:42.095482+0000","last_fullsized":"2024-04-24T13:33:42.095482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"114'119","reported_seq":389,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450901+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:33:42.450901+0000","last_peered":"2024-04-24T13:33:42.450901+0000","last_clean":"2024-04-24T13:33:42.450901+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:33:42.450901+0000","last_undegraded":"2024-04-24T13:33:42.450901+0000","last_fullsized":"2024-04-24T13:33:42.450901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":183,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093027+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:33:42.093027+0000","last_peered":"2024-04-24T13:33:42.093027+0000","last_clean":"2024-04-24T13:33:42.093027+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:33:42.093027+0000","last_undegraded":"2024-04-24T13:33:42.093027+0000","last_fullsized":"2024-04-24T13:33:42.093027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"86'4","reported_seq":218,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096183+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:33:42.096183+0000","last_peered":"2024-04-24T13:33:42.096183+0000","last_clean":"2024-04-24T13:33:42.096183+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:33:42.096183+0000","last_undegraded":"2024-04-24T13:33:42.096183+0000","last_fullsized":"2024-04-24T13:33:42.096183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"114'22","reported_seq":224,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091266+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:33:42.091266+0000","last_peered":"2024-04-24T13:33:42.091266+0000","last_clean":"2024-04-24T13:33:42.091266+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:33:42.091266+0000","last_undegraded":"2024-04-24T13:33:42.091266+0000","last_fullsized":"2024-04-24T13:33:42.091266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":205,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094403+0000","last_change":"2024-04-24T13:33:08.716879+0000","last_active":"2024-04-24T13:33:42.094403+0000","last_peered":"2024-04-24T13:33:42.094403+0000","last_clean":"2024-04-24T13:33:42.094403+0000","last_became_active":"2024-04-24T13:33:08.716585+0000","last_became_peered":"2024-04-24T13:33:08.716585+0000","last_unstale":"2024-04-24T13:33:42.094403+0000","last_undegraded":"2024-04-24T13:33:42.094403+0000","last_fullsized":"2024-04-24T13:33:42.094403+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:36.135388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"114'24","reported_seq":58,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434875+0000","last_change":"2024-04-24T13:33:10.818135+0000","last_active":"2024-04-24T13:33:41.434875+0000","last_peered":"2024-04-24T13:33:41.434875+0000","last_clean":"2024-04-24T13:33:41.434875+0000","last_became_active":"2024-04-24T13:33:08.736280+0000","last_became_peered":"2024-04-24T13:33:08.736280+0000","last_unstale":"2024-04-24T13:33:41.434875+0000","last_undegraded":"2024-04-24T13:33:41.434875+0000","last_fullsized":"2024-04-24T13:33:41.434875+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:41:16.005578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":187,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450054+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:33:42.450054+0000","last_peered":"2024-04-24T13:33:42.450054+0000","last_clean":"2024-04-24T13:33:42.450054+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:33:42.450054+0000","last_undegraded":"2024-04-24T13:33:42.450054+0000","last_fullsized":"2024-04-24T13:33:42.450054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"82'2","reported_seq":202,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094140+0000","last_change":"2024-04-24T13:33:09.338972+0000","last_active":"2024-04-24T13:33:42.094140+0000","last_peered":"2024-04-24T13:33:42.094140+0000","last_clean":"2024-04-24T13:33:42.094140+0000","last_became_active":"2024-04-24T13:33:08.727402+0000","last_became_peered":"2024-04-24T13:33:08.727402+0000","last_unstale":"2024-04-24T13:33:42.094140+0000","last_undegraded":"2024-04-24T13:33:42.094140+0000","last_fullsized":"2024-04-24T13:33:42.094140+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:34.956692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"105'4","reported_seq":216,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.452067+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:33:42.452067+0000","last_peered":"2024-04-24T13:33:42.452067+0000","last_clean":"2024-04-24T13:33:42.452067+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:33:42.452067+0000","last_undegraded":"2024-04-24T13:33:42.452067+0000","last_fullsized":"2024-04-24T13:33:42.452067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":328,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090735+0000","last_change":"2024-04-24T13:30:53.928527+0000","last_active":"2024-04-24T13:33:42.090735+0000","last_peered":"2024-04-24T13:33:42.090735+0000","last_clean":"2024-04-24T13:33:42.090735+0000","last_became_active":"2024-04-24T13:30:53.928167+0000","last_became_peered":"2024-04-24T13:30:53.928167+0000","last_unstale":"2024-04-24T13:33:42.090735+0000","last_undegraded":"2024-04-24T13:33:42.090735+0000","last_fullsized":"2024-04-24T13:33:42.090735+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:43.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433335+0000","last_change":"2024-04-24T13:33:08.717037+0000","last_active":"2024-04-24T13:33:41.433335+0000","last_peered":"2024-04-24T13:33:41.433335+0000","last_clean":"2024-04-24T13:33:41.433335+0000","last_became_active":"2024-04-24T13:33:08.715914+0000","last_became_peered":"2024-04-24T13:33:08.715914+0000","last_unstale":"2024-04-24T13:33:41.433335+0000","last_undegraded":"2024-04-24T13:33:41.433335+0000","last_fullsized":"2024-04-24T13:33:41.433335+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:03.765941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"114'15","reported_seq":245,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090531+0000","last_change":"2024-04-24T13:33:09.529789+0000","last_active":"2024-04-24T13:33:42.090531+0000","last_peered":"2024-04-24T13:33:42.090531+0000","last_clean":"2024-04-24T13:33:42.090531+0000","last_became_active":"2024-04-24T13:33:08.725348+0000","last_became_peered":"2024-04-24T13:33:08.725348+0000","last_unstale":"2024-04-24T13:33:42.090531+0000","last_undegraded":"2024-04-24T13:33:42.090531+0000","last_fullsized":"2024-04-24T13:33:42.090531+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:18.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":176,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448588+0000","last_change":"2024-04-24T13:33:08.739176+0000","last_active":"2024-04-24T13:33:42.448588+0000","last_peered":"2024-04-24T13:33:42.448588+0000","last_clean":"2024-04-24T13:33:42.448588+0000","last_became_active":"2024-04-24T13:33:08.738740+0000","last_became_peered":"2024-04-24T13:33:08.738740+0000","last_unstale":"2024-04-24T13:33:42.448588+0000","last_undegraded":"2024-04-24T13:33:42.448588+0000","last_fullsized":"2024-04-24T13:33:42.448588+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:46:07.432330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"114'37","reported_seq":56,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435765+0000","last_change":"2024-04-24T13:33:09.565111+0000","last_active":"2024-04-24T13:33:41.435765+0000","last_peered":"2024-04-24T13:33:41.435765+0000","last_clean":"2024-04-24T13:33:41.435765+0000","last_became_active":"2024-04-24T13:33:08.719950+0000","last_became_peered":"2024-04-24T13:33:08.719950+0000","last_unstale":"2024-04-24T13:33:41.435765+0000","last_undegraded":"2024-04-24T13:33:41.435765+0000","last_fullsized":"2024-04-24T13:33:41.435765+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:37.122088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62524,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":20,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":58868,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":192,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100189+0000","last_change":"2024-04-24T13:30:50.917737+0000","last_active":"2024-04-24T13:33:42.100189+0000","last_peered":"2024-04-24T13:33:42.100189+0000","last_clean":"2024-04-24T13:33:42.100189+0000","last_became_active":"2024-04-24T13:30:50.916920+0000","last_became_peered":"2024-04-24T13:30:50.916920+0000","last_unstale":"2024-04-24T13:33:42.100189+0000","last_undegraded":"2024-04-24T13:33:42.100189+0000","last_fullsized":"2024-04-24T13:33:42.100189+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:12.813827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":193,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448972+0000","last_change":"2024-04-24T13:33:08.727069+0000","last_active":"2024-04-24T13:33:42.448972+0000","last_peered":"2024-04-24T13:33:42.448972+0000","last_clean":"2024-04-24T13:33:42.448972+0000","last_became_active":"2024-04-24T13:33:08.726216+0000","last_became_peered":"2024-04-24T13:33:08.726216+0000","last_unstale":"2024-04-24T13:33:42.448972+0000","last_undegraded":"2024-04-24T13:33:42.448972+0000","last_fullsized":"2024-04-24T13:33:42.448972+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:59.675122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"105'6","reported_seq":226,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099851+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:33:42.099851+0000","last_peered":"2024-04-24T13:33:42.099851+0000","last_clean":"2024-04-24T13:33:42.099851+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:33:42.099851+0000","last_undegraded":"2024-04-24T13:33:42.099851+0000","last_fullsized":"2024-04-24T13:33:42.099851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096593+0000","last_change":"2024-04-24T13:30:50.937903+0000","last_active":"2024-04-24T13:33:42.096593+0000","last_peered":"2024-04-24T13:33:42.096593+0000","last_clean":"2024-04-24T13:33:42.096593+0000","last_became_active":"2024-04-24T13:30:50.937359+0000","last_became_peered":"2024-04-24T13:30:50.937359+0000","last_unstale":"2024-04-24T13:33:42.096593+0000","last_undegraded":"2024-04-24T13:33:42.096593+0000","last_fullsized":"2024-04-24T13:33:42.096593+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:27.651521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"114'18","reported_seq":221,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095809+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:33:42.095809+0000","last_peered":"2024-04-24T13:33:42.095809+0000","last_clean":"2024-04-24T13:33:42.095809+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:33:42.095809+0000","last_undegraded":"2024-04-24T13:33:42.095809+0000","last_fullsized":"2024-04-24T13:33:42.095809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435711+0000","last_change":"2024-04-24T13:33:08.734054+0000","last_active":"2024-04-24T13:33:41.435711+0000","last_peered":"2024-04-24T13:33:41.435711+0000","last_clean":"2024-04-24T13:33:41.435711+0000","last_became_active":"2024-04-24T13:33:08.728126+0000","last_became_peered":"2024-04-24T13:33:08.728126+0000","last_unstale":"2024-04-24T13:33:41.435711+0000","last_undegraded":"2024-04-24T13:33:41.435711+0000","last_fullsized":"2024-04-24T13:33:41.435711+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:48.542362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"114'123","reported_seq":411,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092936+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:33:42.092936+0000","last_peered":"2024-04-24T13:33:42.092936+0000","last_clean":"2024-04-24T13:33:42.092936+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:33:42.092936+0000","last_undegraded":"2024-04-24T13:33:42.092936+0000","last_fullsized":"2024-04-24T13:33:42.092936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120994,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":161,"num_read_kb":146,"num_write":28,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":166,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448395+0000","last_change":"2024-04-24T13:30:50.925382+0000","last_active":"2024-04-24T13:33:42.448395+0000","last_peered":"2024-04-24T13:33:42.448395+0000","last_clean":"2024-04-24T13:33:42.448395+0000","last_became_active":"2024-04-24T13:30:50.924919+0000","last_became_peered":"2024-04-24T13:30:50.924919+0000","last_unstale":"2024-04-24T13:33:42.448395+0000","last_undegraded":"2024-04-24T13:33:42.448395+0000","last_fullsized":"2024-04-24T13:33:42.448395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":184,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091800+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:33:42.091800+0000","last_peered":"2024-04-24T13:33:42.091800+0000","last_clean":"2024-04-24T13:33:42.091800+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:33:42.091800+0000","last_undegraded":"2024-04-24T13:33:42.091800+0000","last_fullsized":"2024-04-24T13:33:42.091800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":210,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096283+0000","last_change":"2024-04-24T13:33:08.745743+0000","last_active":"2024-04-24T13:33:42.096283+0000","last_peered":"2024-04-24T13:33:42.096283+0000","last_clean":"2024-04-24T13:33:42.096283+0000","last_became_active":"2024-04-24T13:33:08.745363+0000","last_became_peered":"2024-04-24T13:33:08.745363+0000","last_unstale":"2024-04-24T13:33:42.096283+0000","last_undegraded":"2024-04-24T13:33:42.096283+0000","last_fullsized":"2024-04-24T13:33:42.096283+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:23:38.852782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":210,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.447870+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:33:42.447870+0000","last_peered":"2024-04-24T13:33:42.447870+0000","last_clean":"2024-04-24T13:33:42.447870+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:33:42.447870+0000","last_undegraded":"2024-04-24T13:33:42.447870+0000","last_fullsized":"2024-04-24T13:33:42.447870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"114'17","reported_seq":221,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096319+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:33:42.096319+0000","last_peered":"2024-04-24T13:33:42.096319+0000","last_clean":"2024-04-24T13:33:42.096319+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:33:42.096319+0000","last_undegraded":"2024-04-24T13:33:42.096319+0000","last_fullsized":"2024-04-24T13:33:42.096319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":215,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448710+0000","last_change":"2024-04-24T13:33:09.537358+0000","last_active":"2024-04-24T13:33:42.448710+0000","last_peered":"2024-04-24T13:33:42.448710+0000","last_clean":"2024-04-24T13:33:42.448710+0000","last_became_active":"2024-04-24T13:33:08.726022+0000","last_became_peered":"2024-04-24T13:33:08.726022+0000","last_unstale":"2024-04-24T13:33:42.448710+0000","last_undegraded":"2024-04-24T13:33:42.448710+0000","last_fullsized":"2024-04-24T13:33:42.448710+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:53:29.132620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"82'17","reported_seq":258,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451387+0000","last_change":"2024-04-24T13:30:50.991700+0000","last_active":"2024-04-24T13:33:42.451387+0000","last_peered":"2024-04-24T13:33:42.451387+0000","last_clean":"2024-04-24T13:33:42.451387+0000","last_became_active":"2024-04-24T13:30:50.940740+0000","last_became_peered":"2024-04-24T13:30:50.940740+0000","last_unstale":"2024-04-24T13:33:42.451387+0000","last_undegraded":"2024-04-24T13:33:42.451387+0000","last_fullsized":"2024-04-24T13:33:42.451387+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:39.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091467+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:33:42.091467+0000","last_peered":"2024-04-24T13:33:42.091467+0000","last_clean":"2024-04-24T13:33:42.091467+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:33:42.091467+0000","last_undegraded":"2024-04-24T13:33:42.091467+0000","last_fullsized":"2024-04-24T13:33:42.091467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":182,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093206+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:33:42.093206+0000","last_peered":"2024-04-24T13:33:42.093206+0000","last_clean":"2024-04-24T13:33:42.093206+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:33:42.093206+0000","last_undegraded":"2024-04-24T13:33:42.093206+0000","last_fullsized":"2024-04-24T13:33:42.093206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"82'2","reported_seq":209,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094901+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:33:42.094901+0000","last_peered":"2024-04-24T13:33:42.094901+0000","last_clean":"2024-04-24T13:33:42.094901+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:33:42.094901+0000","last_undegraded":"2024-04-24T13:33:42.094901+0000","last_fullsized":"2024-04-24T13:33:42.094901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433538+0000","last_change":"2024-04-24T13:33:08.727739+0000","last_active":"2024-04-24T13:33:41.433538+0000","last_peered":"2024-04-24T13:33:41.433538+0000","last_clean":"2024-04-24T13:33:41.433538+0000","last_became_active":"2024-04-24T13:33:08.727324+0000","last_became_peered":"2024-04-24T13:33:08.727324+0000","last_unstale":"2024-04-24T13:33:41.433538+0000","last_undegraded":"2024-04-24T13:33:41.433538+0000","last_fullsized":"2024-04-24T13:33:41.433538+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:23.918692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"114'14","reported_seq":222,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093613+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:33:42.093613+0000","last_peered":"2024-04-24T13:33:42.093613+0000","last_clean":"2024-04-24T13:33:42.093613+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:33:42.093613+0000","last_undegraded":"2024-04-24T13:33:42.093613+0000","last_fullsized":"2024-04-24T13:33:42.093613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.760398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":195,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091381+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:33:42.091381+0000","last_peered":"2024-04-24T13:33:42.091381+0000","last_clean":"2024-04-24T13:33:42.091381+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:33:42.091381+0000","last_undegraded":"2024-04-24T13:33:42.091381+0000","last_fullsized":"2024-04-24T13:33:42.091381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":208,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092616+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:33:42.092616+0000","last_peered":"2024-04-24T13:33:42.092616+0000","last_clean":"2024-04-24T13:33:42.092616+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:33:42.092616+0000","last_undegraded":"2024-04-24T13:33:42.092616+0000","last_fullsized":"2024-04-24T13:33:42.092616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":187,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451080+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:33:42.451080+0000","last_peered":"2024-04-24T13:33:42.451080+0000","last_clean":"2024-04-24T13:33:42.451080+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:33:42.451080+0000","last_undegraded":"2024-04-24T13:33:42.451080+0000","last_fullsized":"2024-04-24T13:33:42.451080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"81'4","reported_seq":42,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433195+0000","last_change":"2024-04-24T13:33:09.289060+0000","last_active":"2024-04-24T13:33:41.433195+0000","last_peered":"2024-04-24T13:33:41.433195+0000","last_clean":"2024-04-24T13:33:41.433195+0000","last_became_active":"2024-04-24T13:33:08.717929+0000","last_became_peered":"2024-04-24T13:33:08.717929+0000","last_unstale":"2024-04-24T13:33:41.433195+0000","last_undegraded":"2024-04-24T13:33:41.433195+0000","last_fullsized":"2024-04-24T13:33:41.433195+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:36.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":210,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092732+0000","last_change":"2024-04-24T13:33:08.738475+0000","last_active":"2024-04-24T13:33:42.092732+0000","last_peered":"2024-04-24T13:33:42.092732+0000","last_clean":"2024-04-24T13:33:42.092732+0000","last_became_active":"2024-04-24T13:33:08.738109+0000","last_became_peered":"2024-04-24T13:33:08.738109+0000","last_unstale":"2024-04-24T13:33:42.092732+0000","last_undegraded":"2024-04-24T13:33:42.092732+0000","last_fullsized":"2024-04-24T13:33:42.092732+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:14:49.386651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"114'18","reported_seq":64,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433999+0000","last_change":"2024-04-24T13:33:10.091580+0000","last_active":"2024-04-24T13:33:41.433999+0000","last_peered":"2024-04-24T13:33:41.433999+0000","last_clean":"2024-04-24T13:33:41.433999+0000","last_became_active":"2024-04-24T13:33:08.716808+0000","last_became_peered":"2024-04-24T13:33:08.716808+0000","last_unstale":"2024-04-24T13:33:41.433999+0000","last_undegraded":"2024-04-24T13:33:41.433999+0000","last_fullsized":"2024-04-24T13:33:41.433999+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:05:06.347329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":210,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095349+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:33:42.095349+0000","last_peered":"2024-04-24T13:33:42.095349+0000","last_clean":"2024-04-24T13:33:42.095349+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:33:42.095349+0000","last_undegraded":"2024-04-24T13:33:42.095349+0000","last_fullsized":"2024-04-24T13:33:42.095349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":195,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089939+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:33:42.089939+0000","last_peered":"2024-04-24T13:33:42.089939+0000","last_clean":"2024-04-24T13:33:42.089939+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:33:42.089939+0000","last_undegraded":"2024-04-24T13:33:42.089939+0000","last_fullsized":"2024-04-24T13:33:42.089939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"114'32","reported_seq":237,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089565+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:33:42.089565+0000","last_peered":"2024-04-24T13:33:42.089565+0000","last_clean":"2024-04-24T13:33:42.089565+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:33:42.089565+0000","last_undegraded":"2024-04-24T13:33:42.089565+0000","last_fullsized":"2024-04-24T13:33:42.089565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093991+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:33:42.093991+0000","last_peered":"2024-04-24T13:33:42.093991+0000","last_clean":"2024-04-24T13:33:42.093991+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:33:42.093991+0000","last_undegraded":"2024-04-24T13:33:42.093991+0000","last_fullsized":"2024-04-24T13:33:42.093991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":183,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100449+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:33:42.100449+0000","last_peered":"2024-04-24T13:33:42.100449+0000","last_clean":"2024-04-24T13:33:42.100449+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:33:42.100449+0000","last_undegraded":"2024-04-24T13:33:42.100449+0000","last_fullsized":"2024-04-24T13:33:42.100449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"114'18","reported_seq":289,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091973+0000","last_change":"2024-04-24T13:33:09.335136+0000","last_active":"2024-04-24T13:33:42.091973+0000","last_peered":"2024-04-24T13:33:42.091973+0000","last_clean":"2024-04-24T13:33:42.091973+0000","last_became_active":"2024-04-24T13:33:08.705853+0000","last_became_peered":"2024-04-24T13:33:08.705853+0000","last_unstale":"2024-04-24T13:33:42.091973+0000","last_undegraded":"2024-04-24T13:33:42.091973+0000","last_fullsized":"2024-04-24T13:33:42.091973+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:53.758485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":86,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"112'6","reported_seq":210,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095063+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:33:42.095063+0000","last_peered":"2024-04-24T13:33:42.095063+0000","last_clean":"2024-04-24T13:33:42.095063+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:33:42.095063+0000","last_undegraded":"2024-04-24T13:33:42.095063+0000","last_fullsized":"2024-04-24T13:33:42.095063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099764+0000","last_change":"2024-04-24T13:30:50.937016+0000","last_active":"2024-04-24T13:33:42.099764+0000","last_peered":"2024-04-24T13:33:42.099764+0000","last_clean":"2024-04-24T13:33:42.099764+0000","last_became_active":"2024-04-24T13:30:50.934998+0000","last_became_peered":"2024-04-24T13:30:50.934998+0000","last_unstale":"2024-04-24T13:33:42.099764+0000","last_undegraded":"2024-04-24T13:33:42.099764+0000","last_fullsized":"2024-04-24T13:33:42.099764+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:42:03.696601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":195,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449696+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:33:42.449696+0000","last_peered":"2024-04-24T13:33:42.449696+0000","last_clean":"2024-04-24T13:33:42.449696+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:33:42.449696+0000","last_undegraded":"2024-04-24T13:33:42.449696+0000","last_fullsized":"2024-04-24T13:33:42.449696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"105'15","reported_seq":214,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090475+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:33:42.090475+0000","last_peered":"2024-04-24T13:33:42.090475+0000","last_clean":"2024-04-24T13:33:42.090475+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:33:42.090475+0000","last_undegraded":"2024-04-24T13:33:42.090475+0000","last_fullsized":"2024-04-24T13:33:42.090475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"114'122","reported_seq":260,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.432606+0000","last_change":"2024-04-24T13:33:11.712104+0000","last_active":"2024-04-24T13:33:41.432606+0000","last_peered":"2024-04-24T13:33:41.432606+0000","last_clean":"2024-04-24T13:33:41.432606+0000","last_became_active":"2024-04-24T13:33:11.710310+0000","last_became_peered":"2024-04-24T13:33:11.710310+0000","last_unstale":"2024-04-24T13:33:41.432606+0000","last_undegraded":"2024-04-24T13:33:41.432606+0000","last_fullsized":"2024-04-24T13:33:41.432606+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:44.878043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"114'3","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091279+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:33:42.091279+0000","last_peered":"2024-04-24T13:33:42.091279+0000","last_clean":"2024-04-24T13:33:42.091279+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:33:42.091279+0000","last_undegraded":"2024-04-24T13:33:42.091279+0000","last_fullsized":"2024-04-24T13:33:42.091279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"82'2","reported_seq":160,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.446774+0000","last_change":"2024-04-24T13:31:01.035271+0000","last_active":"2024-04-24T13:33:42.446774+0000","last_peered":"2024-04-24T13:33:42.446774+0000","last_clean":"2024-04-24T13:33:42.446774+0000","last_became_active":"2024-04-24T13:31:01.034314+0000","last_became_peered":"2024-04-24T13:31:01.034314+0000","last_unstale":"2024-04-24T13:33:42.446774+0000","last_undegraded":"2024-04-24T13:33:42.446774+0000","last_fullsized":"2024-04-24T13:33:42.446774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:45.074671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"114'16","reported_seq":223,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090941+0000","last_change":"2024-04-24T13:30:50.913675+0000","last_active":"2024-04-24T13:33:42.090941+0000","last_peered":"2024-04-24T13:33:42.090941+0000","last_clean":"2024-04-24T13:33:42.090941+0000","last_became_active":"2024-04-24T13:30:50.912153+0000","last_became_peered":"2024-04-24T13:30:50.912153+0000","last_unstale":"2024-04-24T13:33:42.090941+0000","last_undegraded":"2024-04-24T13:33:42.090941+0000","last_fullsized":"2024-04-24T13:33:42.090941+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.808699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":210,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.097051+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:33:42.097051+0000","last_peered":"2024-04-24T13:33:42.097051+0000","last_clean":"2024-04-24T13:33:42.097051+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:33:42.097051+0000","last_undegraded":"2024-04-24T13:33:42.097051+0000","last_fullsized":"2024-04-24T13:33:42.097051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":195,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093400+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:33:42.093400+0000","last_peered":"2024-04-24T13:33:42.093400+0000","last_clean":"2024-04-24T13:33:42.093400+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:33:42.093400+0000","last_undegraded":"2024-04-24T13:33:42.093400+0000","last_fullsized":"2024-04-24T13:33:42.093400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":206,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093551+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:33:42.093551+0000","last_peered":"2024-04-24T13:33:42.093551+0000","last_clean":"2024-04-24T13:33:42.093551+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:33:42.093551+0000","last_undegraded":"2024-04-24T13:33:42.093551+0000","last_fullsized":"2024-04-24T13:33:42.093551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"114'119","reported_seq":344,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094475+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:33:42.094475+0000","last_peered":"2024-04-24T13:33:42.094475+0000","last_clean":"2024-04-24T13:33:42.094475+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:33:42.094475+0000","last_undegraded":"2024-04-24T13:33:42.094475+0000","last_fullsized":"2024-04-24T13:33:42.094475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"82'6","reported_seq":191,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091565+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:33:42.091565+0000","last_peered":"2024-04-24T13:33:42.091565+0000","last_clean":"2024-04-24T13:33:42.091565+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:33:42.091565+0000","last_undegraded":"2024-04-24T13:33:42.091565+0000","last_fullsized":"2024-04-24T13:33:42.091565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"114'6","reported_seq":240,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092628+0000","last_change":"2024-04-24T13:33:08.753804+0000","last_active":"2024-04-24T13:33:42.092628+0000","last_peered":"2024-04-24T13:33:42.092628+0000","last_clean":"2024-04-24T13:33:42.092628+0000","last_became_active":"2024-04-24T13:33:08.707993+0000","last_became_peered":"2024-04-24T13:33:08.707993+0000","last_unstale":"2024-04-24T13:33:42.092628+0000","last_undegraded":"2024-04-24T13:33:42.092628+0000","last_fullsized":"2024-04-24T13:33:42.092628+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:02.680781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"114'17","reported_seq":220,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099659+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:33:42.099659+0000","last_peered":"2024-04-24T13:33:42.099659+0000","last_clean":"2024-04-24T13:33:42.099659+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:33:42.099659+0000","last_undegraded":"2024-04-24T13:33:42.099659+0000","last_fullsized":"2024-04-24T13:33:42.099659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":214,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451617+0000","last_change":"2024-04-24T13:30:50.937218+0000","last_active":"2024-04-24T13:33:42.451617+0000","last_peered":"2024-04-24T13:33:42.451617+0000","last_clean":"2024-04-24T13:33:42.451617+0000","last_became_active":"2024-04-24T13:30:50.936420+0000","last_became_peered":"2024-04-24T13:30:50.936420+0000","last_unstale":"2024-04-24T13:33:42.451617+0000","last_undegraded":"2024-04-24T13:33:42.451617+0000","last_fullsized":"2024-04-24T13:33:42.451617+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:08.910360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":194,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092525+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:33:42.092525+0000","last_peered":"2024-04-24T13:33:42.092525+0000","last_clean":"2024-04-24T13:33:42.092525+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:33:42.092525+0000","last_undegraded":"2024-04-24T13:33:42.092525+0000","last_fullsized":"2024-04-24T13:33:42.092525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"114'40","reported_seq":257,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449726+0000","last_change":"2024-04-24T13:30:50.977698+0000","last_active":"2024-04-24T13:33:42.449726+0000","last_peered":"2024-04-24T13:33:42.449726+0000","last_clean":"2024-04-24T13:33:42.449726+0000","last_became_active":"2024-04-24T13:30:50.936955+0000","last_became_peered":"2024-04-24T13:30:50.936955+0000","last_unstale":"2024-04-24T13:33:42.449726+0000","last_undegraded":"2024-04-24T13:33:42.449726+0000","last_fullsized":"2024-04-24T13:33:42.449726+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:47.349331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":186,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090322+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:33:42.090322+0000","last_peered":"2024-04-24T13:33:42.090322+0000","last_clean":"2024-04-24T13:33:42.090322+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:33:42.090322+0000","last_undegraded":"2024-04-24T13:33:42.090322+0000","last_fullsized":"2024-04-24T13:33:42.090322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"105'6","reported_seq":45,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434300+0000","last_change":"2024-04-24T13:33:10.795857+0000","last_active":"2024-04-24T13:33:41.434300+0000","last_peered":"2024-04-24T13:33:41.434300+0000","last_clean":"2024-04-24T13:33:41.434300+0000","last_became_active":"2024-04-24T13:33:08.735079+0000","last_became_peered":"2024-04-24T13:33:08.735079+0000","last_unstale":"2024-04-24T13:33:41.434300+0000","last_undegraded":"2024-04-24T13:33:41.434300+0000","last_fullsized":"2024-04-24T13:33:41.434300+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:48:31.488596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"82'2","reported_seq":201,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099938+0000","last_change":"2024-04-24T13:33:09.076639+0000","last_active":"2024-04-24T13:33:42.099938+0000","last_peered":"2024-04-24T13:33:42.099938+0000","last_clean":"2024-04-24T13:33:42.099938+0000","last_became_active":"2024-04-24T13:33:08.705821+0000","last_became_peered":"2024-04-24T13:33:08.705821+0000","last_unstale":"2024-04-24T13:33:42.099938+0000","last_undegraded":"2024-04-24T13:33:42.099938+0000","last_fullsized":"2024-04-24T13:33:42.099938+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:07:09.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"82'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092817+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:33:42.092817+0000","last_peered":"2024-04-24T13:33:42.092817+0000","last_clean":"2024-04-24T13:33:42.092817+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:33:42.092817+0000","last_undegraded":"2024-04-24T13:33:42.092817+0000","last_fullsized":"2024-04-24T13:33:42.092817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"114'24","reported_seq":175,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448172+0000","last_change":"2024-04-24T13:31:00.986151+0000","last_active":"2024-04-24T13:33:42.448172+0000","last_peered":"2024-04-24T13:33:42.448172+0000","last_clean":"2024-04-24T13:33:42.448172+0000","last_became_active":"2024-04-24T13:31:00.985421+0000","last_became_peered":"2024-04-24T13:31:00.985421+0000","last_unstale":"2024-04-24T13:33:42.448172+0000","last_undegraded":"2024-04-24T13:33:42.448172+0000","last_fullsized":"2024-04-24T13:33:42.448172+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:42.662404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":294,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092826+0000","last_change":"2024-04-24T13:33:09.553473+0000","last_active":"2024-04-24T13:33:42.092826+0000","last_peered":"2024-04-24T13:33:42.092826+0000","last_clean":"2024-04-24T13:33:42.092826+0000","last_became_active":"2024-04-24T13:33:08.738276+0000","last_became_peered":"2024-04-24T13:33:08.738276+0000","last_unstale":"2024-04-24T13:33:42.092826+0000","last_undegraded":"2024-04-24T13:33:42.092826+0000","last_fullsized":"2024-04-24T13:33:42.092826+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:44.215595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"114'19","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093629+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:33:42.093629+0000","last_peered":"2024-04-24T13:33:42.093629+0000","last_clean":"2024-04-24T13:33:42.093629+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:33:42.093629+0000","last_undegraded":"2024-04-24T13:33:42.093629+0000","last_fullsized":"2024-04-24T13:33:42.093629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":186,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092880+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:33:42.092880+0000","last_peered":"2024-04-24T13:33:42.092880+0000","last_clean":"2024-04-24T13:33:42.092880+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:33:42.092880+0000","last_undegraded":"2024-04-24T13:33:42.092880+0000","last_fullsized":"2024-04-24T13:33:42.092880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091819+0000","last_change":"2024-04-24T13:30:50.930475+0000","last_active":"2024-04-24T13:33:42.091819+0000","last_peered":"2024-04-24T13:33:42.091819+0000","last_clean":"2024-04-24T13:33:42.091819+0000","last_became_active":"2024-04-24T13:30:50.929905+0000","last_became_peered":"2024-04-24T13:30:50.929905+0000","last_unstale":"2024-04-24T13:33:42.091819+0000","last_undegraded":"2024-04-24T13:33:42.091819+0000","last_fullsized":"2024-04-24T13:33:42.091819+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:41.257023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":200,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092503+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:33:42.092503+0000","last_peered":"2024-04-24T13:33:42.092503+0000","last_clean":"2024-04-24T13:33:42.092503+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:33:42.092503+0000","last_undegraded":"2024-04-24T13:33:42.092503+0000","last_fullsized":"2024-04-24T13:33:42.092503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"113'9","reported_seq":170,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095163+0000","last_change":"2024-04-24T13:30:50.931263+0000","last_active":"2024-04-24T13:33:42.095163+0000","last_peered":"2024-04-24T13:33:42.095163+0000","last_clean":"2024-04-24T13:33:42.095163+0000","last_became_active":"2024-04-24T13:30:50.929683+0000","last_became_peered":"2024-04-24T13:30:50.929683+0000","last_unstale":"2024-04-24T13:33:42.095163+0000","last_undegraded":"2024-04-24T13:33:42.095163+0000","last_fullsized":"2024-04-24T13:33:42.095163+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:28:57.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":194,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092994+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:33:42.092994+0000","last_peered":"2024-04-24T13:33:42.092994+0000","last_clean":"2024-04-24T13:33:42.092994+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:33:42.092994+0000","last_undegraded":"2024-04-24T13:33:42.092994+0000","last_fullsized":"2024-04-24T13:33:42.092994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"113'8","reported_seq":227,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090167+0000","last_change":"2024-04-24T13:33:09.548972+0000","last_active":"2024-04-24T13:33:42.090167+0000","last_peered":"2024-04-24T13:33:42.090167+0000","last_clean":"2024-04-24T13:33:42.090167+0000","last_became_active":"2024-04-24T13:33:08.721855+0000","last_became_peered":"2024-04-24T13:33:08.721855+0000","last_unstale":"2024-04-24T13:33:42.090167+0000","last_undegraded":"2024-04-24T13:33:42.090167+0000","last_fullsized":"2024-04-24T13:33:42.090167+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:12.936976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":30,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":164,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448989+0000","last_change":"2024-04-24T13:30:50.924952+0000","last_active":"2024-04-24T13:33:42.448989+0000","last_peered":"2024-04-24T13:33:42.448989+0000","last_clean":"2024-04-24T13:33:42.448989+0000","last_became_active":"2024-04-24T13:30:50.923933+0000","last_became_peered":"2024-04-24T13:30:50.923933+0000","last_unstale":"2024-04-24T13:33:42.448989+0000","last_undegraded":"2024-04-24T13:33:42.448989+0000","last_fullsized":"2024-04-24T13:33:42.448989+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:17.479670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"82'4","reported_seq":189,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091085+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:33:42.091085+0000","last_peered":"2024-04-24T13:33:42.091085+0000","last_clean":"2024-04-24T13:33:42.091085+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:33:42.091085+0000","last_undegraded":"2024-04-24T13:33:42.091085+0000","last_fullsized":"2024-04-24T13:33:42.091085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"82'4","reported_seq":219,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094357+0000","last_change":"2024-04-24T13:30:50.925917+0000","last_active":"2024-04-24T13:33:42.094357+0000","last_peered":"2024-04-24T13:33:42.094357+0000","last_clean":"2024-04-24T13:33:42.094357+0000","last_became_active":"2024-04-24T13:30:50.925580+0000","last_became_peered":"2024-04-24T13:30:50.925580+0000","last_unstale":"2024-04-24T13:33:42.094357+0000","last_undegraded":"2024-04-24T13:33:42.094357+0000","last_fullsized":"2024-04-24T13:33:42.094357+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"114'17","reported_seq":62,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434785+0000","last_change":"2024-04-24T13:33:09.911129+0000","last_active":"2024-04-24T13:33:41.434785+0000","last_peered":"2024-04-24T13:33:41.434785+0000","last_clean":"2024-04-24T13:33:41.434785+0000","last_became_active":"2024-04-24T13:33:08.725239+0000","last_became_peered":"2024-04-24T13:33:08.725239+0000","last_unstale":"2024-04-24T13:33:41.434785+0000","last_undegraded":"2024-04-24T13:33:41.434785+0000","last_fullsized":"2024-04-24T13:33:41.434785+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:14:16.523695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":163,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091391+0000","last_change":"2024-04-24T13:30:50.934577+0000","last_active":"2024-04-24T13:33:42.091391+0000","last_peered":"2024-04-24T13:33:42.091391+0000","last_clean":"2024-04-24T13:33:42.091391+0000","last_became_active":"2024-04-24T13:30:50.931559+0000","last_became_peered":"2024-04-24T13:30:50.931559+0000","last_unstale":"2024-04-24T13:33:42.091391+0000","last_undegraded":"2024-04-24T13:33:42.091391+0000","last_fullsized":"2024-04-24T13:33:42.091391+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:35.372215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"114'19","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092517+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:33:42.092517+0000","last_peered":"2024-04-24T13:33:42.092517+0000","last_clean":"2024-04-24T13:33:42.092517+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:33:42.092517+0000","last_undegraded":"2024-04-24T13:33:42.092517+0000","last_fullsized":"2024-04-24T13:33:42.092517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":187,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449973+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:33:42.449973+0000","last_peered":"2024-04-24T13:33:42.449973+0000","last_clean":"2024-04-24T13:33:42.449973+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:33:42.449973+0000","last_undegraded":"2024-04-24T13:33:42.449973+0000","last_fullsized":"2024-04-24T13:33:42.449973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"114'4","reported_seq":44,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434242+0000","last_change":"2024-04-24T13:33:08.738102+0000","last_active":"2024-04-24T13:33:41.434242+0000","last_peered":"2024-04-24T13:33:41.434242+0000","last_clean":"2024-04-24T13:33:41.434242+0000","last_became_active":"2024-04-24T13:33:08.737722+0000","last_became_peered":"2024-04-24T13:33:08.737722+0000","last_unstale":"2024-04-24T13:33:41.434242+0000","last_undegraded":"2024-04-24T13:33:41.434242+0000","last_fullsized":"2024-04-24T13:33:41.434242+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:09:43.232587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092073+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:33:42.092073+0000","last_peered":"2024-04-24T13:33:42.092073+0000","last_clean":"2024-04-24T13:33:42.092073+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:33:42.092073+0000","last_undegraded":"2024-04-24T13:33:42.092073+0000","last_fullsized":"2024-04-24T13:33:42.092073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"114'14","reported_seq":245,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100544+0000","last_change":"2024-04-24T13:33:09.773703+0000","last_active":"2024-04-24T13:33:42.100544+0000","last_peered":"2024-04-24T13:33:42.100544+0000","last_clean":"2024-04-24T13:33:42.100544+0000","last_became_active":"2024-04-24T13:33:08.722546+0000","last_became_peered":"2024-04-24T13:33:08.722546+0000","last_unstale":"2024-04-24T13:33:42.100544+0000","last_undegraded":"2024-04-24T13:33:42.100544+0000","last_fullsized":"2024-04-24T13:33:42.100544+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:26.369698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":195,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449646+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:33:42.449646+0000","last_peered":"2024-04-24T13:33:42.449646+0000","last_clean":"2024-04-24T13:33:42.449646+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:33:42.449646+0000","last_undegraded":"2024-04-24T13:33:42.449646+0000","last_fullsized":"2024-04-24T13:33:42.449646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"114'17","reported_seq":218,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.447333+0000","last_change":"2024-04-24T13:30:50.981989+0000","last_active":"2024-04-24T13:33:42.447333+0000","last_peered":"2024-04-24T13:33:42.447333+0000","last_clean":"2024-04-24T13:33:42.447333+0000","last_became_active":"2024-04-24T13:30:50.939707+0000","last_became_peered":"2024-04-24T13:30:50.939707+0000","last_unstale":"2024-04-24T13:33:42.447333+0000","last_undegraded":"2024-04-24T13:33:42.447333+0000","last_fullsized":"2024-04-24T13:33:42.447333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:38.379316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":192,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089553+0000","last_change":"2024-04-24T13:30:50.935071+0000","last_active":"2024-04-24T13:33:42.089553+0000","last_peered":"2024-04-24T13:33:42.089553+0000","last_clean":"2024-04-24T13:33:42.089553+0000","last_became_active":"2024-04-24T13:30:50.934309+0000","last_became_peered":"2024-04-24T13:30:50.934309+0000","last_unstale":"2024-04-24T13:33:42.089553+0000","last_undegraded":"2024-04-24T13:33:42.089553+0000","last_fullsized":"2024-04-24T13:33:42.089553+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:51.520511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"82'8","reported_seq":235,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451362+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:33:42.451362+0000","last_peered":"2024-04-24T13:33:42.451362+0000","last_clean":"2024-04-24T13:33:42.451362+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:33:42.451362+0000","last_undegraded":"2024-04-24T13:33:42.451362+0000","last_fullsized":"2024-04-24T13:33:42.451362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"114'18","reported_seq":220,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091546+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:33:42.091546+0000","last_peered":"2024-04-24T13:33:42.091546+0000","last_clean":"2024-04-24T13:33:42.091546+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:33:42.091546+0000","last_undegraded":"2024-04-24T13:33:42.091546+0000","last_fullsized":"2024-04-24T13:33:42.091546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":200,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100075+0000","last_change":"2024-04-24T13:30:50.921993+0000","last_active":"2024-04-24T13:33:42.100075+0000","last_peered":"2024-04-24T13:33:42.100075+0000","last_clean":"2024-04-24T13:33:42.100075+0000","last_became_active":"2024-04-24T13:30:50.921257+0000","last_became_peered":"2024-04-24T13:30:50.921257+0000","last_unstale":"2024-04-24T13:33:42.100075+0000","last_undegraded":"2024-04-24T13:33:42.100075+0000","last_fullsized":"2024-04-24T13:33:42.100075+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:58.034297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"114'27","reported_seq":230,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095764+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:33:42.095764+0000","last_peered":"2024-04-24T13:33:42.095764+0000","last_clean":"2024-04-24T13:33:42.095764+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:33:42.095764+0000","last_undegraded":"2024-04-24T13:33:42.095764+0000","last_fullsized":"2024-04-24T13:33:42.095764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62357,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434225+0000","last_change":"2024-04-24T13:33:08.717844+0000","last_active":"2024-04-24T13:33:41.434225+0000","last_peered":"2024-04-24T13:33:41.434225+0000","last_clean":"2024-04-24T13:33:41.434225+0000","last_became_active":"2024-04-24T13:33:08.716627+0000","last_became_peered":"2024-04-24T13:33:08.716627+0000","last_unstale":"2024-04-24T13:33:41.434225+0000","last_undegraded":"2024-04-24T13:33:41.434225+0000","last_fullsized":"2024-04-24T13:33:41.434225+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:43.447785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":182,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091734+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:33:42.091734+0000","last_peered":"2024-04-24T13:33:42.091734+0000","last_clean":"2024-04-24T13:33:42.091734+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:33:42.091734+0000","last_undegraded":"2024-04-24T13:33:42.091734+0000","last_fullsized":"2024-04-24T13:33:42.091734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"114'10","reported_seq":245,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099955+0000","last_change":"2024-04-24T13:30:50.917948+0000","last_active":"2024-04-24T13:33:42.099955+0000","last_peered":"2024-04-24T13:33:42.099955+0000","last_clean":"2024-04-24T13:33:42.099955+0000","last_became_active":"2024-04-24T13:30:50.917339+0000","last_became_peered":"2024-04-24T13:30:50.917339+0000","last_unstale":"2024-04-24T13:33:42.099955+0000","last_undegraded":"2024-04-24T13:33:42.099955+0000","last_fullsized":"2024-04-24T13:33:42.099955+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:36:03.041606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"114'13","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092524+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:33:42.092524+0000","last_peered":"2024-04-24T13:33:42.092524+0000","last_clean":"2024-04-24T13:33:42.092524+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:33:42.092524+0000","last_undegraded":"2024-04-24T13:33:42.092524+0000","last_fullsized":"2024-04-24T13:33:42.092524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":195,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451132+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:33:42.451132+0000","last_peered":"2024-04-24T13:33:42.451132+0000","last_clean":"2024-04-24T13:33:42.451132+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:33:42.451132+0000","last_undegraded":"2024-04-24T13:33:42.451132+0000","last_fullsized":"2024-04-24T13:33:42.451132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"114'22","reported_seq":56,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433168+0000","last_change":"2024-04-24T13:33:09.130597+0000","last_active":"2024-04-24T13:33:41.433168+0000","last_peered":"2024-04-24T13:33:41.433168+0000","last_clean":"2024-04-24T13:33:41.433168+0000","last_became_active":"2024-04-24T13:33:08.712750+0000","last_became_peered":"2024-04-24T13:33:08.712750+0000","last_unstale":"2024-04-24T13:33:41.433168+0000","last_undegraded":"2024-04-24T13:33:41.433168+0000","last_fullsized":"2024-04-24T13:33:41.433168+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:57.772686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":188,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096032+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:33:42.096032+0000","last_peered":"2024-04-24T13:33:42.096032+0000","last_clean":"2024-04-24T13:33:42.096032+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:33:42.096032+0000","last_undegraded":"2024-04-24T13:33:42.096032+0000","last_fullsized":"2024-04-24T13:33:42.096032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":188,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449976+0000","last_change":"2024-04-24T13:30:50.937377+0000","last_active":"2024-04-24T13:33:42.449976+0000","last_peered":"2024-04-24T13:33:42.449976+0000","last_clean":"2024-04-24T13:33:42.449976+0000","last_became_active":"2024-04-24T13:30:50.936540+0000","last_became_peered":"2024-04-24T13:30:50.936540+0000","last_unstale":"2024-04-24T13:33:42.449976+0000","last_undegraded":"2024-04-24T13:33:42.449976+0000","last_fullsized":"2024-04-24T13:33:42.449976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:44.053660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":198,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095391+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:33:42.095391+0000","last_peered":"2024-04-24T13:33:42.095391+0000","last_clean":"2024-04-24T13:33:42.095391+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:33:42.095391+0000","last_undegraded":"2024-04-24T13:33:42.095391+0000","last_fullsized":"2024-04-24T13:33:42.095391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"114'10","reported_seq":213,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093960+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:33:42.093960+0000","last_peered":"2024-04-24T13:33:42.093960+0000","last_clean":"2024-04-24T13:33:42.093960+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:33:42.093960+0000","last_undegraded":"2024-04-24T13:33:42.093960+0000","last_fullsized":"2024-04-24T13:33:42.093960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":195,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094596+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:33:42.094596+0000","last_peered":"2024-04-24T13:33:42.094596+0000","last_clean":"2024-04-24T13:33:42.094596+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:33:42.094596+0000","last_undegraded":"2024-04-24T13:33:42.094596+0000","last_fullsized":"2024-04-24T13:33:42.094596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"114'19","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096762+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:33:42.096762+0000","last_peered":"2024-04-24T13:33:42.096762+0000","last_clean":"2024-04-24T13:33:42.096762+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:33:42.096762+0000","last_undegraded":"2024-04-24T13:33:42.096762+0000","last_fullsized":"2024-04-24T13:33:42.096762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":188,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096467+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:33:42.096467+0000","last_peered":"2024-04-24T13:33:42.096467+0000","last_clean":"2024-04-24T13:33:42.096467+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:33:42.096467+0000","last_undegraded":"2024-04-24T13:33:42.096467+0000","last_fullsized":"2024-04-24T13:33:42.096467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":189,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433763+0000","last_change":"2024-04-24T13:30:50.929993+0000","last_active":"2024-04-24T13:33:41.433763+0000","last_peered":"2024-04-24T13:33:41.433763+0000","last_clean":"2024-04-24T13:33:41.433763+0000","last_became_active":"2024-04-24T13:30:50.929169+0000","last_became_peered":"2024-04-24T13:30:50.929169+0000","last_unstale":"2024-04-24T13:33:41.433763+0000","last_undegraded":"2024-04-24T13:33:41.433763+0000","last_fullsized":"2024-04-24T13:33:41.433763+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:57.047113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"114'2","reported_seq":208,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448731+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:33:42.448731+0000","last_peered":"2024-04-24T13:33:42.448731+0000","last_clean":"2024-04-24T13:33:42.448731+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:33:42.448731+0000","last_undegraded":"2024-04-24T13:33:42.448731+0000","last_fullsized":"2024-04-24T13:33:42.448731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"114'18","reported_seq":221,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089649+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:33:42.089649+0000","last_peered":"2024-04-24T13:33:42.089649+0000","last_clean":"2024-04-24T13:33:42.089649+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:33:42.089649+0000","last_undegraded":"2024-04-24T13:33:42.089649+0000","last_fullsized":"2024-04-24T13:33:42.089649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":196,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096833+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:33:42.096833+0000","last_peered":"2024-04-24T13:33:42.096833+0000","last_clean":"2024-04-24T13:33:42.096833+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:33:42.096833+0000","last_undegraded":"2024-04-24T13:33:42.096833+0000","last_fullsized":"2024-04-24T13:33:42.096833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":206,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094156+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:33:42.094156+0000","last_peered":"2024-04-24T13:33:42.094156+0000","last_clean":"2024-04-24T13:33:42.094156+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:33:42.094156+0000","last_undegraded":"2024-04-24T13:33:42.094156+0000","last_fullsized":"2024-04-24T13:33:42.094156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"114'119","reported_seq":345,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450817+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:33:42.450817+0000","last_peered":"2024-04-24T13:33:42.450817+0000","last_clean":"2024-04-24T13:33:42.450817+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:33:42.450817+0000","last_undegraded":"2024-04-24T13:33:42.450817+0000","last_fullsized":"2024-04-24T13:33:42.450817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"82'6","reported_seq":42,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.432617+0000","last_change":"2024-04-24T13:33:08.908066+0000","last_active":"2024-04-24T13:33:41.432617+0000","last_peered":"2024-04-24T13:33:41.432617+0000","last_clean":"2024-04-24T13:33:41.432617+0000","last_became_active":"2024-04-24T13:33:08.706175+0000","last_became_peered":"2024-04-24T13:33:08.706175+0000","last_unstale":"2024-04-24T13:33:41.432617+0000","last_undegraded":"2024-04-24T13:33:41.432617+0000","last_fullsized":"2024-04-24T13:33:41.432617+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:13:39.788663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"86'4","reported_seq":216,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092529+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:33:42.092529+0000","last_peered":"2024-04-24T13:33:42.092529+0000","last_clean":"2024-04-24T13:33:42.092529+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:33:42.092529+0000","last_undegraded":"2024-04-24T13:33:42.092529+0000","last_fullsized":"2024-04-24T13:33:42.092529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"114'20","reported_seq":71,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433746+0000","last_change":"2024-04-24T13:33:09.116807+0000","last_active":"2024-04-24T13:33:41.433746+0000","last_peered":"2024-04-24T13:33:41.433746+0000","last_clean":"2024-04-24T13:33:41.433746+0000","last_became_active":"2024-04-24T13:33:08.708911+0000","last_became_peered":"2024-04-24T13:33:08.708911+0000","last_unstale":"2024-04-24T13:33:41.433746+0000","last_undegraded":"2024-04-24T13:33:41.433746+0000","last_fullsized":"2024-04-24T13:33:41.433746+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:59.171558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73400320,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":163,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092243+0000","last_change":"2024-04-24T13:30:50.927331+0000","last_active":"2024-04-24T13:33:42.092243+0000","last_peered":"2024-04-24T13:33:42.092243+0000","last_clean":"2024-04-24T13:33:42.092243+0000","last_became_active":"2024-04-24T13:30:50.926529+0000","last_became_peered":"2024-04-24T13:30:50.926529+0000","last_unstale":"2024-04-24T13:33:42.092243+0000","last_undegraded":"2024-04-24T13:33:42.092243+0000","last_fullsized":"2024-04-24T13:33:42.092243+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:23.529403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"114'24","reported_seq":56,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.432871+0000","last_change":"2024-04-24T13:33:09.934600+0000","last_active":"2024-04-24T13:33:41.432871+0000","last_peered":"2024-04-24T13:33:41.432871+0000","last_clean":"2024-04-24T13:33:41.432871+0000","last_became_active":"2024-04-24T13:33:08.732254+0000","last_became_peered":"2024-04-24T13:33:08.732254+0000","last_unstale":"2024-04-24T13:33:41.432871+0000","last_undegraded":"2024-04-24T13:33:41.432871+0000","last_fullsized":"2024-04-24T13:33:41.432871+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:35.846866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091424+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:33:42.091424+0000","last_peered":"2024-04-24T13:33:42.091424+0000","last_clean":"2024-04-24T13:33:42.091424+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:33:42.091424+0000","last_undegraded":"2024-04-24T13:33:42.091424+0000","last_fullsized":"2024-04-24T13:33:42.091424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":164,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099929+0000","last_change":"2024-04-24T13:30:50.922108+0000","last_active":"2024-04-24T13:33:42.099929+0000","last_peered":"2024-04-24T13:33:42.099929+0000","last_clean":"2024-04-24T13:33:42.099929+0000","last_became_active":"2024-04-24T13:30:50.921514+0000","last_became_peered":"2024-04-24T13:30:50.921514+0000","last_unstale":"2024-04-24T13:33:42.099929+0000","last_undegraded":"2024-04-24T13:33:42.099929+0000","last_fullsized":"2024-04-24T13:33:42.099929+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:05.867839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"105'6","reported_seq":88,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449212+0000","last_change":"2024-04-24T13:32:32.751387+0000","last_active":"2024-04-24T13:33:42.449212+0000","last_peered":"2024-04-24T13:33:42.449212+0000","last_clean":"2024-04-24T13:33:42.449212+0000","last_became_active":"2024-04-24T13:32:32.741990+0000","last_became_peered":"2024-04-24T13:32:32.741990+0000","last_unstale":"2024-04-24T13:33:42.449212+0000","last_undegraded":"2024-04-24T13:33:42.449212+0000","last_fullsized":"2024-04-24T13:33:42.449212+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:49.789798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"114'18","reported_seq":222,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435388+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:33:41.435388+0000","last_peered":"2024-04-24T13:33:41.435388+0000","last_clean":"2024-04-24T13:33:41.435388+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:33:41.435388+0000","last_undegraded":"2024-04-24T13:33:41.435388+0000","last_fullsized":"2024-04-24T13:33:41.435388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433363+0000","last_change":"2024-04-24T13:33:08.705125+0000","last_active":"2024-04-24T13:33:41.433363+0000","last_peered":"2024-04-24T13:33:41.433363+0000","last_clean":"2024-04-24T13:33:41.433363+0000","last_became_active":"2024-04-24T13:33:08.704735+0000","last_became_peered":"2024-04-24T13:33:08.704735+0000","last_unstale":"2024-04-24T13:33:41.433363+0000","last_undegraded":"2024-04-24T13:33:41.433363+0000","last_fullsized":"2024-04-24T13:33:41.433363+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:14.183681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"114'17","reported_seq":215,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091026+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:33:42.091026+0000","last_peered":"2024-04-24T13:33:42.091026+0000","last_clean":"2024-04-24T13:33:42.091026+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:33:42.091026+0000","last_undegraded":"2024-04-24T13:33:42.091026+0000","last_fullsized":"2024-04-24T13:33:42.091026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":192,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449245+0000","last_change":"2024-04-24T13:30:50.938940+0000","last_active":"2024-04-24T13:33:42.449245+0000","last_peered":"2024-04-24T13:33:42.449245+0000","last_clean":"2024-04-24T13:33:42.449245+0000","last_became_active":"2024-04-24T13:30:50.936355+0000","last_became_peered":"2024-04-24T13:30:50.936355+0000","last_unstale":"2024-04-24T13:33:42.449245+0000","last_undegraded":"2024-04-24T13:33:42.449245+0000","last_fullsized":"2024-04-24T13:33:42.449245+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":182,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092069+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:33:42.092069+0000","last_peered":"2024-04-24T13:33:42.092069+0000","last_clean":"2024-04-24T13:33:42.092069+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:33:42.092069+0000","last_undegraded":"2024-04-24T13:33:42.092069+0000","last_fullsized":"2024-04-24T13:33:42.092069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"105'10","reported_seq":180,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433477+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:33:41.433477+0000","last_peered":"2024-04-24T13:33:41.433477+0000","last_clean":"2024-04-24T13:33:41.433477+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:33:41.433477+0000","last_undegraded":"2024-04-24T13:33:41.433477+0000","last_fullsized":"2024-04-24T13:33:41.433477+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"114'15","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093312+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:33:42.093312+0000","last_peered":"2024-04-24T13:33:42.093312+0000","last_clean":"2024-04-24T13:33:42.093312+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:33:42.093312+0000","last_undegraded":"2024-04-24T13:33:42.093312+0000","last_fullsized":"2024-04-24T13:33:42.093312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":195,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091193+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:33:42.091193+0000","last_peered":"2024-04-24T13:33:42.091193+0000","last_clean":"2024-04-24T13:33:42.091193+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:33:42.091193+0000","last_undegraded":"2024-04-24T13:33:42.091193+0000","last_fullsized":"2024-04-24T13:33:42.091193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"114'12","reported_seq":109,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448280+0000","last_change":"2024-04-24T13:32:01.553569+0000","last_active":"2024-04-24T13:33:42.448280+0000","last_peered":"2024-04-24T13:33:42.448280+0000","last_clean":"2024-04-24T13:33:42.448280+0000","last_became_active":"2024-04-24T13:32:01.547833+0000","last_became_peered":"2024-04-24T13:32:01.547833+0000","last_unstale":"2024-04-24T13:33:42.448280+0000","last_undegraded":"2024-04-24T13:33:42.448280+0000","last_fullsized":"2024-04-24T13:33:42.448280+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:10.789162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092086+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:33:42.092086+0000","last_peered":"2024-04-24T13:33:42.092086+0000","last_clean":"2024-04-24T13:33:42.092086+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:33:42.092086+0000","last_undegraded":"2024-04-24T13:33:42.092086+0000","last_fullsized":"2024-04-24T13:33:42.092086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"82'2","reported_seq":167,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096419+0000","last_change":"2024-04-24T13:30:50.939033+0000","last_active":"2024-04-24T13:33:42.096419+0000","last_peered":"2024-04-24T13:33:42.096419+0000","last_clean":"2024-04-24T13:33:42.096419+0000","last_became_active":"2024-04-24T13:30:50.938747+0000","last_became_peered":"2024-04-24T13:30:50.938747+0000","last_unstale":"2024-04-24T13:33:42.096419+0000","last_undegraded":"2024-04-24T13:33:42.096419+0000","last_fullsized":"2024-04-24T13:33:42.096419+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:48.546868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"82'4","reported_seq":216,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091834+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:33:42.091834+0000","last_peered":"2024-04-24T13:33:42.091834+0000","last_clean":"2024-04-24T13:33:42.091834+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:33:42.091834+0000","last_undegraded":"2024-04-24T13:33:42.091834+0000","last_fullsized":"2024-04-24T13:33:42.091834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"114'13","reported_seq":126,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449225+0000","last_change":"2024-04-24T13:33:09.073468+0000","last_active":"2024-04-24T13:33:42.449225+0000","last_peered":"2024-04-24T13:33:42.449225+0000","last_clean":"2024-04-24T13:33:42.449225+0000","last_became_active":"2024-04-24T13:33:08.725822+0000","last_became_peered":"2024-04-24T13:33:08.725822+0000","last_unstale":"2024-04-24T13:33:42.449225+0000","last_undegraded":"2024-04-24T13:33:42.449225+0000","last_fullsized":"2024-04-24T13:33:42.449225+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:24:41.185601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":215,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090741+0000","last_change":"2024-04-24T13:33:09.078708+0000","last_active":"2024-04-24T13:33:42.090741+0000","last_peered":"2024-04-24T13:33:42.090741+0000","last_clean":"2024-04-24T13:33:42.090741+0000","last_became_active":"2024-04-24T13:33:08.726873+0000","last_became_peered":"2024-04-24T13:33:08.726873+0000","last_unstale":"2024-04-24T13:33:42.090741+0000","last_undegraded":"2024-04-24T13:33:42.090741+0000","last_fullsized":"2024-04-24T13:33:42.090741+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:53:23.482374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"114'16","reported_seq":244,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092592+0000","last_change":"2024-04-24T13:33:09.087185+0000","last_active":"2024-04-24T13:33:42.092592+0000","last_peered":"2024-04-24T13:33:42.092592+0000","last_clean":"2024-04-24T13:33:42.092592+0000","last_became_active":"2024-04-24T13:33:08.726347+0000","last_became_peered":"2024-04-24T13:33:08.726347+0000","last_unstale":"2024-04-24T13:33:42.092592+0000","last_undegraded":"2024-04-24T13:33:42.092592+0000","last_fullsized":"2024-04-24T13:33:42.092592+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:37.412890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089439+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:33:42.089439+0000","last_peered":"2024-04-24T13:33:42.089439+0000","last_clean":"2024-04-24T13:33:42.089439+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:33:42.089439+0000","last_undegraded":"2024-04-24T13:33:42.089439+0000","last_fullsized":"2024-04-24T13:33:42.089439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":183,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092415+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:33:42.092415+0000","last_peered":"2024-04-24T13:33:42.092415+0000","last_clean":"2024-04-24T13:33:42.092415+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:33:42.092415+0000","last_undegraded":"2024-04-24T13:33:42.092415+0000","last_fullsized":"2024-04-24T13:33:42.092415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"114'8","reported_seq":232,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096078+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:33:42.096078+0000","last_peered":"2024-04-24T13:33:42.096078+0000","last_clean":"2024-04-24T13:33:42.096078+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:33:42.096078+0000","last_undegraded":"2024-04-24T13:33:42.096078+0000","last_fullsized":"2024-04-24T13:33:42.096078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"114'11","reported_seq":214,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449196+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:33:42.449196+0000","last_peered":"2024-04-24T13:33:42.449196+0000","last_clean":"2024-04-24T13:33:42.449196+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:33:42.449196+0000","last_undegraded":"2024-04-24T13:33:42.449196+0000","last_fullsized":"2024-04-24T13:33:42.449196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"105'12","reported_seq":240,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096773+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:33:42.096773+0000","last_peered":"2024-04-24T13:33:42.096773+0000","last_clean":"2024-04-24T13:33:42.096773+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:33:42.096773+0000","last_undegraded":"2024-04-24T13:33:42.096773+0000","last_fullsized":"2024-04-24T13:33:42.096773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"113'13","reported_seq":243,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.447768+0000","last_change":"2024-04-24T13:33:09.324802+0000","last_active":"2024-04-24T13:33:42.447768+0000","last_peered":"2024-04-24T13:33:42.447768+0000","last_clean":"2024-04-24T13:33:42.447768+0000","last_became_active":"2024-04-24T13:33:08.725876+0000","last_became_peered":"2024-04-24T13:33:08.725876+0000","last_unstale":"2024-04-24T13:33:42.447768+0000","last_undegraded":"2024-04-24T13:33:42.447768+0000","last_fullsized":"2024-04-24T13:33:42.447768+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:21:58.951897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"82'2","reported_seq":42,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434558+0000","last_change":"2024-04-24T13:33:10.580909+0000","last_active":"2024-04-24T13:33:41.434558+0000","last_peered":"2024-04-24T13:33:41.434558+0000","last_clean":"2024-04-24T13:33:41.434558+0000","last_became_active":"2024-04-24T13:33:08.735041+0000","last_became_peered":"2024-04-24T13:33:08.735041+0000","last_unstale":"2024-04-24T13:33:41.434558+0000","last_undegraded":"2024-04-24T13:33:41.434558+0000","last_fullsized":"2024-04-24T13:33:41.434558+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:43:23.330340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"114'19","reported_seq":70,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433819+0000","last_change":"2024-04-24T13:33:09.548908+0000","last_active":"2024-04-24T13:33:41.433819+0000","last_peered":"2024-04-24T13:33:41.433819+0000","last_clean":"2024-04-24T13:33:41.433819+0000","last_became_active":"2024-04-24T13:33:08.720010+0000","last_became_peered":"2024-04-24T13:33:08.720010+0000","last_unstale":"2024-04-24T13:33:41.433819+0000","last_undegraded":"2024-04-24T13:33:41.433819+0000","last_fullsized":"2024-04-24T13:33:41.433819+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:06.195033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"114'12","reported_seq":242,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095205+0000","last_change":"2024-04-24T13:30:50.918913+0000","last_active":"2024-04-24T13:33:42.095205+0000","last_peered":"2024-04-24T13:33:42.095205+0000","last_clean":"2024-04-24T13:33:42.095205+0000","last_became_active":"2024-04-24T13:30:50.918221+0000","last_became_peered":"2024-04-24T13:30:50.918221+0000","last_unstale":"2024-04-24T13:33:42.095205+0000","last_undegraded":"2024-04-24T13:33:42.095205+0000","last_fullsized":"2024-04-24T13:33:42.095205+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:43.128644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"114'21","reported_seq":224,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089841+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:33:42.089841+0000","last_peered":"2024-04-24T13:33:42.089841+0000","last_clean":"2024-04-24T13:33:42.089841+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:33:42.089841+0000","last_undegraded":"2024-04-24T13:33:42.089841+0000","last_fullsized":"2024-04-24T13:33:42.089841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"82'2","reported_seq":211,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093587+0000","last_change":"2024-04-24T13:30:50.926509+0000","last_active":"2024-04-24T13:33:42.093587+0000","last_peered":"2024-04-24T13:33:42.093587+0000","last_clean":"2024-04-24T13:33:42.093587+0000","last_became_active":"2024-04-24T13:30:50.925894+0000","last_became_peered":"2024-04-24T13:30:50.925894+0000","last_unstale":"2024-04-24T13:33:42.093587+0000","last_undegraded":"2024-04-24T13:33:42.093587+0000","last_fullsized":"2024-04-24T13:33:42.093587+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"114'15","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096369+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:33:42.096369+0000","last_peered":"2024-04-24T13:33:42.096369+0000","last_clean":"2024-04-24T13:33:42.096369+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:33:42.096369+0000","last_undegraded":"2024-04-24T13:33:42.096369+0000","last_fullsized":"2024-04-24T13:33:42.096369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"81'2","reported_seq":208,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093855+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:33:42.093855+0000","last_peered":"2024-04-24T13:33:42.093855+0000","last_clean":"2024-04-24T13:33:42.093855+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:33:42.093855+0000","last_undegraded":"2024-04-24T13:33:42.093855+0000","last_fullsized":"2024-04-24T13:33:42.093855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"114'14","reported_seq":218,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.097191+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:33:42.097191+0000","last_peered":"2024-04-24T13:33:42.097191+0000","last_clean":"2024-04-24T13:33:42.097191+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:33:42.097191+0000","last_undegraded":"2024-04-24T13:33:42.097191+0000","last_fullsized":"2024-04-24T13:33:42.097191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"105'10","reported_seq":228,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094123+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:33:42.094123+0000","last_peered":"2024-04-24T13:33:42.094123+0000","last_clean":"2024-04-24T13:33:42.094123+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:33:42.094123+0000","last_undegraded":"2024-04-24T13:33:42.094123+0000","last_fullsized":"2024-04-24T13:33:42.094123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"114'18","reported_seq":226,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451095+0000","last_change":"2024-04-24T13:30:50.956474+0000","last_active":"2024-04-24T13:33:42.451095+0000","last_peered":"2024-04-24T13:33:42.451095+0000","last_clean":"2024-04-24T13:33:42.451095+0000","last_became_active":"2024-04-24T13:30:50.955801+0000","last_became_peered":"2024-04-24T13:30:50.955801+0000","last_unstale":"2024-04-24T13:33:42.451095+0000","last_undegraded":"2024-04-24T13:33:42.451095+0000","last_fullsized":"2024-04-24T13:33:42.451095+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:41.114080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":199,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449072+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:33:42.449072+0000","last_peered":"2024-04-24T13:33:42.449072+0000","last_clean":"2024-04-24T13:33:42.449072+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:33:42.449072+0000","last_undegraded":"2024-04-24T13:33:42.449072+0000","last_fullsized":"2024-04-24T13:33:42.449072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"113'12","reported_seq":214,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091189+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:33:42.091189+0000","last_peered":"2024-04-24T13:33:42.091189+0000","last_clean":"2024-04-24T13:33:42.091189+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:33:42.091189+0000","last_undegraded":"2024-04-24T13:33:42.091189+0000","last_fullsized":"2024-04-24T13:33:42.091189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"105'8","reported_seq":234,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100563+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:33:42.100563+0000","last_peered":"2024-04-24T13:33:42.100563+0000","last_clean":"2024-04-24T13:33:42.100563+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:33:42.100563+0000","last_undegraded":"2024-04-24T13:33:42.100563+0000","last_fullsized":"2024-04-24T13:33:42.100563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"114'15","reported_seq":64,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.432251+0000","last_change":"2024-04-24T13:33:09.287304+0000","last_active":"2024-04-24T13:33:41.432251+0000","last_peered":"2024-04-24T13:33:41.432251+0000","last_clean":"2024-04-24T13:33:41.432251+0000","last_became_active":"2024-04-24T13:33:08.716282+0000","last_became_peered":"2024-04-24T13:33:08.716282+0000","last_unstale":"2024-04-24T13:33:41.432251+0000","last_undegraded":"2024-04-24T13:33:41.432251+0000","last_fullsized":"2024-04-24T13:33:41.432251+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094542+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:33:42.094542+0000","last_peered":"2024-04-24T13:33:42.094542+0000","last_clean":"2024-04-24T13:33:42.094542+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:33:42.094542+0000","last_undegraded":"2024-04-24T13:33:42.094542+0000","last_fullsized":"2024-04-24T13:33:42.094542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"114'20","reported_seq":222,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094733+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:33:42.094733+0000","last_peered":"2024-04-24T13:33:42.094733+0000","last_clean":"2024-04-24T13:33:42.094733+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:33:42.094733+0000","last_undegraded":"2024-04-24T13:33:42.094733+0000","last_fullsized":"2024-04-24T13:33:42.094733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":200,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448413+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:33:42.448413+0000","last_peered":"2024-04-24T13:33:42.448413+0000","last_clean":"2024-04-24T13:33:42.448413+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:33:42.448413+0000","last_undegraded":"2024-04-24T13:33:42.448413+0000","last_fullsized":"2024-04-24T13:33:42.448413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"114'14","reported_seq":59,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433389+0000","last_change":"2024-04-24T13:33:10.576425+0000","last_active":"2024-04-24T13:33:41.433389+0000","last_peered":"2024-04-24T13:33:41.433389+0000","last_clean":"2024-04-24T13:33:41.433389+0000","last_became_active":"2024-04-24T13:33:08.734588+0000","last_became_peered":"2024-04-24T13:33:08.734588+0000","last_unstale":"2024-04-24T13:33:41.433389+0000","last_undegraded":"2024-04-24T13:33:41.433389+0000","last_fullsized":"2024-04-24T13:33:41.433389+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:05:17.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"82'6","reported_seq":225,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094340+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:33:42.094340+0000","last_peered":"2024-04-24T13:33:42.094340+0000","last_clean":"2024-04-24T13:33:42.094340+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:33:42.094340+0000","last_undegraded":"2024-04-24T13:33:42.094340+0000","last_fullsized":"2024-04-24T13:33:42.094340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"113'17","reported_seq":225,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090033+0000","last_change":"2024-04-24T13:30:50.920564+0000","last_active":"2024-04-24T13:33:42.090033+0000","last_peered":"2024-04-24T13:33:42.090033+0000","last_clean":"2024-04-24T13:33:42.090033+0000","last_became_active":"2024-04-24T13:30:50.920252+0000","last_became_peered":"2024-04-24T13:30:50.920252+0000","last_unstale":"2024-04-24T13:33:42.090033+0000","last_undegraded":"2024-04-24T13:33:42.090033+0000","last_fullsized":"2024-04-24T13:33:42.090033+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:29.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69206016,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"82'2","reported_seq":184,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092246+0000","last_change":"2024-04-24T13:33:09.090089+0000","last_active":"2024-04-24T13:33:42.092246+0000","last_peered":"2024-04-24T13:33:42.092246+0000","last_clean":"2024-04-24T13:33:42.092246+0000","last_became_active":"2024-04-24T13:33:08.720538+0000","last_became_peered":"2024-04-24T13:33:08.720538+0000","last_unstale":"2024-04-24T13:33:42.092246+0000","last_undegraded":"2024-04-24T13:33:42.092246+0000","last_fullsized":"2024-04-24T13:33:42.092246+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:30.442779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"114'22","reported_seq":225,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450695+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:33:42.450695+0000","last_peered":"2024-04-24T13:33:42.450695+0000","last_clean":"2024-04-24T13:33:42.450695+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:33:42.450695+0000","last_undegraded":"2024-04-24T13:33:42.450695+0000","last_fullsized":"2024-04-24T13:33:42.450695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"82'4","reported_seq":216,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091108+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:33:42.091108+0000","last_peered":"2024-04-24T13:33:42.091108+0000","last_clean":"2024-04-24T13:33:42.091108+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:33:42.091108+0000","last_undegraded":"2024-04-24T13:33:42.091108+0000","last_fullsized":"2024-04-24T13:33:42.091108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"114'13","reported_seq":179,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448490+0000","last_change":"2024-04-24T13:30:50.936271+0000","last_active":"2024-04-24T13:33:42.448490+0000","last_peered":"2024-04-24T13:33:42.448490+0000","last_clean":"2024-04-24T13:33:42.448490+0000","last_became_active":"2024-04-24T13:30:50.935833+0000","last_became_peered":"2024-04-24T13:30:50.935833+0000","last_unstale":"2024-04-24T13:33:42.448490+0000","last_undegraded":"2024-04-24T13:33:42.448490+0000","last_fullsized":"2024-04-24T13:33:42.448490+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:04.149889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52428800,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"82'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093884+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:33:42.093884+0000","last_peered":"2024-04-24T13:33:42.093884+0000","last_clean":"2024-04-24T13:33:42.093884+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:33:42.093884+0000","last_undegraded":"2024-04-24T13:33:42.093884+0000","last_fullsized":"2024-04-24T13:33:42.093884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"114'11","reported_seq":215,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448914+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:33:42.448914+0000","last_peered":"2024-04-24T13:33:42.448914+0000","last_clean":"2024-04-24T13:33:42.448914+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:33:42.448914+0000","last_undegraded":"2024-04-24T13:33:42.448914+0000","last_fullsized":"2024-04-24T13:33:42.448914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":162,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092316+0000","last_change":"2024-04-24T13:30:50.913925+0000","last_active":"2024-04-24T13:33:42.092316+0000","last_peered":"2024-04-24T13:33:42.092316+0000","last_clean":"2024-04-24T13:33:42.092316+0000","last_became_active":"2024-04-24T13:30:50.913630+0000","last_became_peered":"2024-04-24T13:30:50.913630+0000","last_unstale":"2024-04-24T13:33:42.092316+0000","last_undegraded":"2024-04-24T13:33:42.092316+0000","last_fullsized":"2024-04-24T13:33:42.092316+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:45.481646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"114'17","reported_seq":65,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435180+0000","last_change":"2024-04-24T13:33:09.790363+0000","last_active":"2024-04-24T13:33:41.435180+0000","last_peered":"2024-04-24T13:33:41.435180+0000","last_clean":"2024-04-24T13:33:41.435180+0000","last_became_active":"2024-04-24T13:33:08.724714+0000","last_became_peered":"2024-04-24T13:33:08.724714+0000","last_unstale":"2024-04-24T13:33:41.435180+0000","last_undegraded":"2024-04-24T13:33:41.435180+0000","last_fullsized":"2024-04-24T13:33:41.435180+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:28.428215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"113'14","reported_seq":64,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.432926+0000","last_change":"2024-04-24T13:33:10.398117+0000","last_active":"2024-04-24T13:33:41.432926+0000","last_peered":"2024-04-24T13:33:41.432926+0000","last_clean":"2024-04-24T13:33:41.432926+0000","last_became_active":"2024-04-24T13:33:08.735696+0000","last_became_peered":"2024-04-24T13:33:08.735696+0000","last_unstale":"2024-04-24T13:33:41.432926+0000","last_undegraded":"2024-04-24T13:33:41.432926+0000","last_fullsized":"2024-04-24T13:33:41.432926+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:01:26.139144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"82'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100402+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:33:42.100402+0000","last_peered":"2024-04-24T13:33:42.100402+0000","last_clean":"2024-04-24T13:33:42.100402+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:33:42.100402+0000","last_undegraded":"2024-04-24T13:33:42.100402+0000","last_fullsized":"2024-04-24T13:33:42.100402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"114'7","reported_seq":211,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092095+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:33:42.092095+0000","last_peered":"2024-04-24T13:33:42.092095+0000","last_clean":"2024-04-24T13:33:42.092095+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:33:42.092095+0000","last_undegraded":"2024-04-24T13:33:42.092095+0000","last_fullsized":"2024-04-24T13:33:42.092095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"82'6","reported_seq":46,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435047+0000","last_change":"2024-04-24T13:33:09.917888+0000","last_active":"2024-04-24T13:33:41.435047+0000","last_peered":"2024-04-24T13:33:41.435047+0000","last_clean":"2024-04-24T13:33:41.435047+0000","last_became_active":"2024-04-24T13:33:08.732489+0000","last_became_peered":"2024-04-24T13:33:08.732489+0000","last_unstale":"2024-04-24T13:33:41.435047+0000","last_undegraded":"2024-04-24T13:33:41.435047+0000","last_fullsized":"2024-04-24T13:33:41.435047+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:16.213872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":325,"num_read_kb":307,"num_write":271,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":194,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":960,"ondisk_log_size":960,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":262298,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":822,"num_read_kb":584,"num_write":457,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":61779,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":839680,"data_stored":478238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":712,"ondisk_log_size":712,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":289,"num_read_kb":289,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2233,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1344,"num_read_kb":1316,"num_write":284,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4206886912,"num_objects":1005,"num_object_clones":0,"num_object_copies":2010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1005,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":1089,"num_write_kb":4136960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":543162368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8413773824,"data_stored":8413773824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1019,"ondisk_log_size":1019,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":55834574894,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1161604,"kb_used_data":1130424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93210236,"statfs":{"total":96636764160,"available":95447281664,"internally_reserved":0,"allocated":1157554176,"data_stored":1156953569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1370284,"kb_used_data":1334944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93001556,"statfs":{"total":96636764160,"available":95233593344,"internally_reserved":0,"allocated":1366982656,"data_stored":1366322075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1447736,"kb_used_data":1416556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92924104,"statfs":{"total":96636764160,"available":95154282496,"internally_reserved":0,"allocated":1450553344,"data_stored":1449964089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1382320,"kb_used_data":1351136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92989520,"statfs":{"total":96636764160,"available":95221268480,"internally_reserved":0,"allocated":1383563264,"data_stored":1382923853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":948084,"kb_used_data":916896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93423756,"statfs":{"total":96636764160,"available":95665926144,"internally_reserved":0,"allocated":938901504,"data_stored":938276105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":796756,"kb_used_data":761412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93575084,"statfs":{"total":96636764160,"available":95820886016,"internally_reserved":0,"allocated":779685888,"data_stored":779053270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1347976,"kb_used_data":1316796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93023864,"statfs":{"total":96636764160,"available":95256436736,"internally_reserved":0,"allocated":1348399104,"data_stored":1347794914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1346371584,"data_stored":1346371584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":778043392,"data_stored":778043392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":937426944,"data_stored":937426944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1382023168,"data_stored":1382023168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1449132032,"data_stored":1449132032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1365245952,"data_stored":1365245952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1155530752,"data_stored":1155530752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":176486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":60796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":235024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:33:46.874 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:33:46.888 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:46.889+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:46.953 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:46.953 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:46.953 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:46.953 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:46.968 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:33:47.015 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:47.014+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:47.091 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:47.090+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:47.134 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:47.134 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:47.134 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:47.134 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:47.134 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:47.148 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:33:47.192 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:47.189+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:47.248 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:33:47.253 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:33:47.266 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":225,"stamp":"2024-04-24T13:33:46.473843+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":4207741594,"num_objects":1203,"num_object_clones":0,"num_object_copies":2406,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1203,"num_whiteouts":0,"num_read":2924,"num_read_kb":2617,"num_write":2270,"num_write_kb":4139780,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":297,"num_bytes_recovered":543816942,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3195,"ondisk_log_size":3195,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":7,"num_per_pool_osds":7,"num_per_pool_omap_osds":7,"kb":660602880,"kb_used":8454760,"kb_used_data":8228164,"kb_used_omap":10,"kb_used_meta":226485,"kb_avail":652148120,"statfs":{"total":676457349120,"available":667799674880,"internally_reserved":0,"allocated":8425639936,"data_stored":8421287875,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":11161,"internal_metadata":231920743},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":8,"apply_latency_ms":8,"commit_latency_ns":8000000,"apply_latency_ns":8000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"4.028462"},"pg_stats":[{"pgid":"3.3f","version":"114'15","reported_seq":184,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451511+0000","last_change":"2024-04-24T13:31:00.989667+0000","last_active":"2024-04-24T13:33:42.451511+0000","last_peered":"2024-04-24T13:33:42.451511+0000","last_clean":"2024-04-24T13:33:42.451511+0000","last_became_active":"2024-04-24T13:31:00.989365+0000","last_became_peered":"2024-04-24T13:31:00.989365+0000","last_unstale":"2024-04-24T13:33:42.451511+0000","last_undegraded":"2024-04-24T13:33:42.451511+0000","last_fullsized":"2024-04-24T13:33:42.451511+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:00:51.108396+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.38","version":"82'14","reported_seq":245,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433668+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:33:41.433668+0000","last_peered":"2024-04-24T13:33:41.433668+0000","last_clean":"2024-04-24T13:33:41.433668+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:33:41.433668+0000","last_undegraded":"2024-04-24T13:33:41.433668+0000","last_fullsized":"2024-04-24T13:33:41.433668+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"114'8","reported_seq":212,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096949+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:33:42.096949+0000","last_peered":"2024-04-24T13:33:42.096949+0000","last_clean":"2024-04-24T13:33:42.096949+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:33:42.096949+0000","last_undegraded":"2024-04-24T13:33:42.096949+0000","last_fullsized":"2024-04-24T13:33:42.096949+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":33554432,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":32768,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"82'4","reported_seq":182,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091651+0000","last_change":"2024-04-24T13:30:50.941589+0000","last_active":"2024-04-24T13:33:42.091651+0000","last_peered":"2024-04-24T13:33:42.091651+0000","last_clean":"2024-04-24T13:33:42.091651+0000","last_became_active":"2024-04-24T13:30:50.941305+0000","last_became_peered":"2024-04-24T13:30:50.941305+0000","last_unstale":"2024-04-24T13:33:42.091651+0000","last_undegraded":"2024-04-24T13:33:42.091651+0000","last_fullsized":"2024-04-24T13:33:42.091651+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:23.793119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3d","version":"114'13","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099594+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:33:42.099594+0000","last_peered":"2024-04-24T13:33:42.099594+0000","last_clean":"2024-04-24T13:33:42.099594+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:33:42.099594+0000","last_undegraded":"2024-04-24T13:33:42.099594+0000","last_fullsized":"2024-04-24T13:33:42.099594+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":23,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":199,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093291+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:33:42.093291+0000","last_peered":"2024-04-24T13:33:42.093291+0000","last_clean":"2024-04-24T13:33:42.093291+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:33:42.093291+0000","last_undegraded":"2024-04-24T13:33:42.093291+0000","last_fullsized":"2024-04-24T13:33:42.093291+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"114'11","reported_seq":215,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434764+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:33:41.434764+0000","last_peered":"2024-04-24T13:33:41.434764+0000","last_clean":"2024-04-24T13:33:41.434764+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:33:41.434764+0000","last_undegraded":"2024-04-24T13:33:41.434764+0000","last_fullsized":"2024-04-24T13:33:41.434764+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"86'4","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089753+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:33:42.089753+0000","last_peered":"2024-04-24T13:33:42.089753+0000","last_clean":"2024-04-24T13:33:42.089753+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:33:42.089753+0000","last_undegraded":"2024-04-24T13:33:42.089753+0000","last_fullsized":"2024-04-24T13:33:42.089753+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"114'24","reported_seq":190,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448094+0000","last_change":"2024-04-24T13:30:50.941360+0000","last_active":"2024-04-24T13:33:42.448094+0000","last_peered":"2024-04-24T13:33:42.448094+0000","last_clean":"2024-04-24T13:33:42.448094+0000","last_became_active":"2024-04-24T13:30:50.940816+0000","last_became_peered":"2024-04-24T13:30:50.940816+0000","last_unstale":"2024-04-24T13:33:42.448094+0000","last_undegraded":"2024-04-24T13:33:42.448094+0000","last_fullsized":"2024-04-24T13:33:42.448094+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:04.247947+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3c","version":"82'2","reported_seq":207,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450471+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:33:42.450471+0000","last_peered":"2024-04-24T13:33:42.450471+0000","last_clean":"2024-04-24T13:33:42.450471+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:33:42.450471+0000","last_undegraded":"2024-04-24T13:33:42.450471+0000","last_fullsized":"2024-04-24T13:33:42.450471+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"114'23","reported_seq":227,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434186+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:33:41.434186+0000","last_peered":"2024-04-24T13:33:41.434186+0000","last_clean":"2024-04-24T13:33:41.434186+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:33:41.434186+0000","last_undegraded":"2024-04-24T13:33:41.434186+0000","last_fullsized":"2024-04-24T13:33:41.434186+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"82'4","reported_seq":216,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093203+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:33:42.093203+0000","last_peered":"2024-04-24T13:33:42.093203+0000","last_clean":"2024-04-24T13:33:42.093203+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:33:42.093203+0000","last_undegraded":"2024-04-24T13:33:42.093203+0000","last_fullsized":"2024-04-24T13:33:42.093203+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"114'21","reported_seq":185,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090469+0000","last_change":"2024-04-24T13:30:50.911441+0000","last_active":"2024-04-24T13:33:42.090469+0000","last_peered":"2024-04-24T13:33:42.090469+0000","last_clean":"2024-04-24T13:33:42.090469+0000","last_became_active":"2024-04-24T13:30:50.911096+0000","last_became_peered":"2024-04-24T13:30:50.911096+0000","last_unstale":"2024-04-24T13:33:42.090469+0000","last_undegraded":"2024-04-24T13:33:42.090469+0000","last_fullsized":"2024-04-24T13:33:42.090469+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:21:12.878818+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3e","version":"82'2","reported_seq":42,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435364+0000","last_change":"2024-04-24T13:33:09.792748+0000","last_active":"2024-04-24T13:33:41.435364+0000","last_peered":"2024-04-24T13:33:41.435364+0000","last_clean":"2024-04-24T13:33:41.435364+0000","last_became_active":"2024-04-24T13:33:08.725324+0000","last_became_peered":"2024-04-24T13:33:08.725324+0000","last_unstale":"2024-04-24T13:33:41.435364+0000","last_undegraded":"2024-04-24T13:33:41.435364+0000","last_fullsized":"2024-04-24T13:33:41.435364+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:20.696769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"114'12","reported_seq":232,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091824+0000","last_change":"2024-04-24T13:33:08.836525+0000","last_active":"2024-04-24T13:33:42.091824+0000","last_peered":"2024-04-24T13:33:42.091824+0000","last_clean":"2024-04-24T13:33:42.091824+0000","last_became_active":"2024-04-24T13:33:08.720200+0000","last_became_peered":"2024-04-24T13:33:08.720200+0000","last_unstale":"2024-04-24T13:33:42.091824+0000","last_undegraded":"2024-04-24T13:33:42.091824+0000","last_fullsized":"2024-04-24T13:33:42.091824+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:31.093323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"82'6","reported_seq":225,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449445+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:33:42.449445+0000","last_peered":"2024-04-24T13:33:42.449445+0000","last_clean":"2024-04-24T13:33:42.449445+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:33:42.449445+0000","last_undegraded":"2024-04-24T13:33:42.449445+0000","last_fullsized":"2024-04-24T13:33:42.449445+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"86'4","reported_seq":216,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091673+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:33:42.091673+0000","last_peered":"2024-04-24T13:33:42.091673+0000","last_clean":"2024-04-24T13:33:42.091673+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:33:42.091673+0000","last_undegraded":"2024-04-24T13:33:42.091673+0000","last_fullsized":"2024-04-24T13:33:42.091673+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"114'18","reported_seq":65,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434935+0000","last_change":"2024-04-24T13:33:08.903178+0000","last_active":"2024-04-24T13:33:41.434935+0000","last_peered":"2024-04-24T13:33:41.434935+0000","last_clean":"2024-04-24T13:33:41.434935+0000","last_became_active":"2024-04-24T13:33:08.706032+0000","last_became_peered":"2024-04-24T13:33:08.706032+0000","last_unstale":"2024-04-24T13:33:41.434935+0000","last_undegraded":"2024-04-24T13:33:41.434935+0000","last_fullsized":"2024-04-24T13:33:41.434935+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:05:00.168247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.31","version":"82'4","reported_seq":181,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091158+0000","last_change":"2024-04-24T13:30:50.937742+0000","last_active":"2024-04-24T13:33:42.091158+0000","last_peered":"2024-04-24T13:33:42.091158+0000","last_clean":"2024-04-24T13:33:42.091158+0000","last_became_active":"2024-04-24T13:30:50.937395+0000","last_became_peered":"2024-04-24T13:30:50.937395+0000","last_unstale":"2024-04-24T13:33:42.091158+0000","last_undegraded":"2024-04-24T13:33:42.091158+0000","last_fullsized":"2024-04-24T13:33:42.091158+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:43.335130+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"114'16","reported_seq":248,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450843+0000","last_change":"2024-04-24T13:33:08.998015+0000","last_active":"2024-04-24T13:33:42.450843+0000","last_peered":"2024-04-24T13:33:42.450843+0000","last_clean":"2024-04-24T13:33:42.450843+0000","last_became_active":"2024-04-24T13:33:08.726581+0000","last_became_peered":"2024-04-24T13:33:08.726581+0000","last_unstale":"2024-04-24T13:33:42.450843+0000","last_undegraded":"2024-04-24T13:33:42.450843+0000","last_fullsized":"2024-04-24T13:33:42.450843+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:03:25.814262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":26,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"86'6","reported_seq":46,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433266+0000","last_change":"2024-04-24T13:33:09.293808+0000","last_active":"2024-04-24T13:33:41.433266+0000","last_peered":"2024-04-24T13:33:41.433266+0000","last_clean":"2024-04-24T13:33:41.433266+0000","last_became_active":"2024-04-24T13:33:08.719391+0000","last_became_peered":"2024-04-24T13:33:08.719391+0000","last_unstale":"2024-04-24T13:33:41.433266+0000","last_undegraded":"2024-04-24T13:33:41.433266+0000","last_fullsized":"2024-04-24T13:33:41.433266+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:10.422756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"114'13","reported_seq":238,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.452441+0000","last_change":"2024-04-24T13:33:09.199641+0000","last_active":"2024-04-24T13:33:42.452441+0000","last_peered":"2024-04-24T13:33:42.452441+0000","last_clean":"2024-04-24T13:33:42.452441+0000","last_became_active":"2024-04-24T13:33:08.737789+0000","last_became_peered":"2024-04-24T13:33:08.737789+0000","last_unstale":"2024-04-24T13:33:42.452441+0000","last_undegraded":"2024-04-24T13:33:42.452441+0000","last_fullsized":"2024-04-24T13:33:42.452441+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:41.648006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":200,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448125+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:33:42.448125+0000","last_peered":"2024-04-24T13:33:42.448125+0000","last_clean":"2024-04-24T13:33:42.448125+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:33:42.448125+0000","last_undegraded":"2024-04-24T13:33:42.448125+0000","last_fullsized":"2024-04-24T13:33:42.448125+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"114'16","reported_seq":219,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092838+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:33:42.092838+0000","last_peered":"2024-04-24T13:33:42.092838+0000","last_clean":"2024-04-24T13:33:42.092838+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:33:42.092838+0000","last_undegraded":"2024-04-24T13:33:42.092838+0000","last_fullsized":"2024-04-24T13:33:42.092838+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"86'4","reported_seq":218,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448689+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:33:42.448689+0000","last_peered":"2024-04-24T13:33:42.448689+0000","last_clean":"2024-04-24T13:33:42.448689+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:33:42.448689+0000","last_undegraded":"2024-04-24T13:33:42.448689+0000","last_fullsized":"2024-04-24T13:33:42.448689+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"113'16","reported_seq":218,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092757+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:33:42.092757+0000","last_peered":"2024-04-24T13:33:42.092757+0000","last_clean":"2024-04-24T13:33:42.092757+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:33:42.092757+0000","last_undegraded":"2024-04-24T13:33:42.092757+0000","last_fullsized":"2024-04-24T13:33:42.092757+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"82'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093527+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:33:42.093527+0000","last_peered":"2024-04-24T13:33:42.093527+0000","last_clean":"2024-04-24T13:33:42.093527+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:33:42.093527+0000","last_undegraded":"2024-04-24T13:33:42.093527+0000","last_fullsized":"2024-04-24T13:33:42.093527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"114'14","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094116+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:33:42.094116+0000","last_peered":"2024-04-24T13:33:42.094116+0000","last_clean":"2024-04-24T13:33:42.094116+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:33:42.094116+0000","last_undegraded":"2024-04-24T13:33:42.094116+0000","last_fullsized":"2024-04-24T13:33:42.094116+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":183,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091120+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:33:42.091120+0000","last_peered":"2024-04-24T13:33:42.091120+0000","last_clean":"2024-04-24T13:33:42.091120+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:33:42.091120+0000","last_undegraded":"2024-04-24T13:33:42.091120+0000","last_fullsized":"2024-04-24T13:33:42.091120+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"82'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096120+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:33:42.096120+0000","last_peered":"2024-04-24T13:33:42.096120+0000","last_clean":"2024-04-24T13:33:42.096120+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:33:42.096120+0000","last_undegraded":"2024-04-24T13:33:42.096120+0000","last_fullsized":"2024-04-24T13:33:42.096120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"114'21","reported_seq":185,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093147+0000","last_change":"2024-04-24T13:30:50.929479+0000","last_active":"2024-04-24T13:33:42.093147+0000","last_peered":"2024-04-24T13:33:42.093147+0000","last_clean":"2024-04-24T13:33:42.093147+0000","last_became_active":"2024-04-24T13:30:50.928545+0000","last_became_peered":"2024-04-24T13:30:50.928545+0000","last_unstale":"2024-04-24T13:33:42.093147+0000","last_undegraded":"2024-04-24T13:33:42.093147+0000","last_fullsized":"2024-04-24T13:33:42.093147+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:26:58.476605+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":31,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":52,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434691+0000","last_change":"2024-04-24T13:33:10.797093+0000","last_active":"2024-04-24T13:33:41.434691+0000","last_peered":"2024-04-24T13:33:41.434691+0000","last_clean":"2024-04-24T13:33:41.434691+0000","last_became_active":"2024-04-24T13:33:08.736087+0000","last_became_peered":"2024-04-24T13:33:08.736087+0000","last_unstale":"2024-04-24T13:33:41.434691+0000","last_undegraded":"2024-04-24T13:33:41.434691+0000","last_fullsized":"2024-04-24T13:33:41.434691+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:49:31.056251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"114'16","reported_seq":229,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100291+0000","last_change":"2024-04-24T13:30:50.953480+0000","last_active":"2024-04-24T13:33:42.100291+0000","last_peered":"2024-04-24T13:33:42.100291+0000","last_clean":"2024-04-24T13:33:42.100291+0000","last_became_active":"2024-04-24T13:30:50.917577+0000","last_became_peered":"2024-04-24T13:30:50.917577+0000","last_unstale":"2024-04-24T13:33:42.100291+0000","last_undegraded":"2024-04-24T13:33:42.100291+0000","last_fullsized":"2024-04-24T13:33:42.100291+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:41.264286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434816+0000","last_change":"2024-04-24T13:33:08.716116+0000","last_active":"2024-04-24T13:33:41.434816+0000","last_peered":"2024-04-24T13:33:41.434816+0000","last_clean":"2024-04-24T13:33:41.434816+0000","last_became_active":"2024-04-24T13:33:08.714157+0000","last_became_peered":"2024-04-24T13:33:08.714157+0000","last_unstale":"2024-04-24T13:33:41.434816+0000","last_undegraded":"2024-04-24T13:33:41.434816+0000","last_fullsized":"2024-04-24T13:33:41.434816+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:28.341076+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.19","version":"114'44","reported_seq":52,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433332+0000","last_change":"2024-04-24T13:33:08.911162+0000","last_active":"2024-04-24T13:33:41.433332+0000","last_peered":"2024-04-24T13:33:41.433332+0000","last_clean":"2024-04-24T13:33:41.433332+0000","last_became_active":"2024-04-24T13:33:08.709158+0000","last_became_peered":"2024-04-24T13:33:08.709158+0000","last_unstale":"2024-04-24T13:33:41.433332+0000","last_undegraded":"2024-04-24T13:33:41.433332+0000","last_fullsized":"2024-04-24T13:33:41.433332+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:56.162767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":103,"num_read_kb":103,"num_write":88,"num_write_kb":33,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"82'4","reported_seq":44,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435372+0000","last_change":"2024-04-24T13:33:10.792268+0000","last_active":"2024-04-24T13:33:41.435372+0000","last_peered":"2024-04-24T13:33:41.435372+0000","last_clean":"2024-04-24T13:33:41.435372+0000","last_became_active":"2024-04-24T13:33:08.735563+0000","last_became_peered":"2024-04-24T13:33:08.735563+0000","last_unstale":"2024-04-24T13:33:41.435372+0000","last_undegraded":"2024-04-24T13:33:41.435372+0000","last_fullsized":"2024-04-24T13:33:41.435372+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:09.560179+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"113'14","reported_seq":222,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094380+0000","last_change":"2024-04-24T13:30:50.915215+0000","last_active":"2024-04-24T13:33:42.094380+0000","last_peered":"2024-04-24T13:33:42.094380+0000","last_clean":"2024-04-24T13:33:42.094380+0000","last_became_active":"2024-04-24T13:30:50.913930+0000","last_became_peered":"2024-04-24T13:30:50.913930+0000","last_unstale":"2024-04-24T13:33:42.094380+0000","last_undegraded":"2024-04-24T13:33:42.094380+0000","last_fullsized":"2024-04-24T13:33:42.094380+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:53.839067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":199,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095891+0000","last_change":"2024-04-24T13:30:50.926673+0000","last_active":"2024-04-24T13:33:42.095891+0000","last_peered":"2024-04-24T13:33:42.095891+0000","last_clean":"2024-04-24T13:33:42.095891+0000","last_became_active":"2024-04-24T13:30:50.926286+0000","last_became_peered":"2024-04-24T13:30:50.926286+0000","last_unstale":"2024-04-24T13:33:42.095891+0000","last_undegraded":"2024-04-24T13:33:42.095891+0000","last_fullsized":"2024-04-24T13:33:42.095891+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:21:21.951639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":200,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093848+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:33:42.093848+0000","last_peered":"2024-04-24T13:33:42.093848+0000","last_clean":"2024-04-24T13:33:42.093848+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:33:42.093848+0000","last_undegraded":"2024-04-24T13:33:42.093848+0000","last_fullsized":"2024-04-24T13:33:42.093848+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092856+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:33:42.092856+0000","last_peered":"2024-04-24T13:33:42.092856+0000","last_clean":"2024-04-24T13:33:42.092856+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:33:42.092856+0000","last_undegraded":"2024-04-24T13:33:42.092856+0000","last_fullsized":"2024-04-24T13:33:42.092856+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":183,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091366+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:33:42.091366+0000","last_peered":"2024-04-24T13:33:42.091366+0000","last_clean":"2024-04-24T13:33:42.091366+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:33:42.091366+0000","last_undegraded":"2024-04-24T13:33:42.091366+0000","last_fullsized":"2024-04-24T13:33:42.091366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"86'10","reported_seq":230,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099730+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:33:42.099730+0000","last_peered":"2024-04-24T13:33:42.099730+0000","last_clean":"2024-04-24T13:33:42.099730+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:33:42.099730+0000","last_undegraded":"2024-04-24T13:33:42.099730+0000","last_fullsized":"2024-04-24T13:33:42.099730+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"114'19","reported_seq":182,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092328+0000","last_change":"2024-04-24T13:30:50.946908+0000","last_active":"2024-04-24T13:33:42.092328+0000","last_peered":"2024-04-24T13:33:42.092328+0000","last_clean":"2024-04-24T13:33:42.092328+0000","last_became_active":"2024-04-24T13:30:50.932201+0000","last_became_peered":"2024-04-24T13:30:50.932201+0000","last_unstale":"2024-04-24T13:33:42.092328+0000","last_undegraded":"2024-04-24T13:33:42.092328+0000","last_fullsized":"2024-04-24T13:33:42.092328+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:41.874257+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":194,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096973+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:33:42.096973+0000","last_peered":"2024-04-24T13:33:42.096973+0000","last_clean":"2024-04-24T13:33:42.096973+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:33:42.096973+0000","last_undegraded":"2024-04-24T13:33:42.096973+0000","last_fullsized":"2024-04-24T13:33:42.096973+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":207,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448394+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:33:42.448394+0000","last_peered":"2024-04-24T13:33:42.448394+0000","last_clean":"2024-04-24T13:33:42.448394+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:33:42.448394+0000","last_undegraded":"2024-04-24T13:33:42.448394+0000","last_fullsized":"2024-04-24T13:33:42.448394+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"114'120","reported_seq":328,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.097364+0000","last_change":"2024-04-24T13:30:50.933595+0000","last_active":"2024-04-24T13:33:42.097364+0000","last_peered":"2024-04-24T13:33:42.097364+0000","last_clean":"2024-04-24T13:33:42.097364+0000","last_became_active":"2024-04-24T13:30:50.926963+0000","last_became_peered":"2024-04-24T13:30:50.926963+0000","last_unstale":"2024-04-24T13:33:42.097364+0000","last_undegraded":"2024-04-24T13:33:42.097364+0000","last_fullsized":"2024-04-24T13:33:42.097364+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":120,"log_dups_size":0,"ondisk_log_size":120,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1b","version":"105'8","reported_seq":195,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092213+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:33:42.092213+0000","last_peered":"2024-04-24T13:33:42.092213+0000","last_clean":"2024-04-24T13:33:42.092213+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:33:42.092213+0000","last_undegraded":"2024-04-24T13:33:42.092213+0000","last_fullsized":"2024-04-24T13:33:42.092213+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"86'2","reported_seq":212,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091098+0000","last_change":"2024-04-24T13:30:50.921336+0000","last_active":"2024-04-24T13:33:42.091098+0000","last_peered":"2024-04-24T13:33:42.091098+0000","last_clean":"2024-04-24T13:33:42.091098+0000","last_became_active":"2024-04-24T13:30:50.920829+0000","last_became_peered":"2024-04-24T13:30:50.920829+0000","last_unstale":"2024-04-24T13:33:42.091098+0000","last_undegraded":"2024-04-24T13:33:42.091098+0000","last_fullsized":"2024-04-24T13:33:42.091098+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:13:37.250085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"114'16","reported_seq":219,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449391+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:33:42.449391+0000","last_peered":"2024-04-24T13:33:42.449391+0000","last_clean":"2024-04-24T13:33:42.449391+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:33:42.449391+0000","last_undegraded":"2024-04-24T13:33:42.449391+0000","last_fullsized":"2024-04-24T13:33:42.449391+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435521+0000","last_change":"2024-04-24T13:33:08.718010+0000","last_active":"2024-04-24T13:33:41.435521+0000","last_peered":"2024-04-24T13:33:41.435521+0000","last_clean":"2024-04-24T13:33:41.435521+0000","last_became_active":"2024-04-24T13:33:08.716072+0000","last_became_peered":"2024-04-24T13:33:08.716072+0000","last_unstale":"2024-04-24T13:33:41.435521+0000","last_undegraded":"2024-04-24T13:33:41.435521+0000","last_fullsized":"2024-04-24T13:33:41.435521+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:26.626730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"114'16","reported_seq":215,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451659+0000","last_change":"2024-04-24T13:30:51.001114+0000","last_active":"2024-04-24T13:33:42.451659+0000","last_peered":"2024-04-24T13:33:42.451659+0000","last_clean":"2024-04-24T13:33:42.451659+0000","last_became_active":"2024-04-24T13:30:50.954422+0000","last_became_peered":"2024-04-24T13:30:50.954422+0000","last_unstale":"2024-04-24T13:33:42.451659+0000","last_undegraded":"2024-04-24T13:33:42.451659+0000","last_fullsized":"2024-04-24T13:33:42.451659+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:44.516492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.14","version":"114'119","reported_seq":364,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095251+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:33:42.095251+0000","last_peered":"2024-04-24T13:33:42.095251+0000","last_clean":"2024-04-24T13:33:42.095251+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:33:42.095251+0000","last_undegraded":"2024-04-24T13:33:42.095251+0000","last_fullsized":"2024-04-24T13:33:42.095251+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"82'2","reported_seq":42,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434097+0000","last_change":"2024-04-24T13:33:08.913939+0000","last_active":"2024-04-24T13:33:41.434097+0000","last_peered":"2024-04-24T13:33:41.434097+0000","last_clean":"2024-04-24T13:33:41.434097+0000","last_became_active":"2024-04-24T13:33:08.708842+0000","last_became_peered":"2024-04-24T13:33:08.708842+0000","last_unstale":"2024-04-24T13:33:41.434097+0000","last_undegraded":"2024-04-24T13:33:41.434097+0000","last_fullsized":"2024-04-24T13:33:41.434097+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:47.448716+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"114'13","reported_seq":164,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449173+0000","last_change":"2024-04-24T13:31:01.035289+0000","last_active":"2024-04-24T13:33:42.449173+0000","last_peered":"2024-04-24T13:33:42.449173+0000","last_clean":"2024-04-24T13:33:42.449173+0000","last_became_active":"2024-04-24T13:31:01.034325+0000","last_became_peered":"2024-04-24T13:31:01.034325+0000","last_unstale":"2024-04-24T13:33:42.449173+0000","last_undegraded":"2024-04-24T13:33:42.449173+0000","last_fullsized":"2024-04-24T13:33:42.449173+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:08.322191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":164,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449456+0000","last_change":"2024-04-24T13:30:50.948387+0000","last_active":"2024-04-24T13:33:42.449456+0000","last_peered":"2024-04-24T13:33:42.449456+0000","last_clean":"2024-04-24T13:33:42.449456+0000","last_became_active":"2024-04-24T13:30:50.947644+0000","last_became_peered":"2024-04-24T13:30:50.947644+0000","last_unstale":"2024-04-24T13:33:42.449456+0000","last_undegraded":"2024-04-24T13:33:42.449456+0000","last_fullsized":"2024-04-24T13:33:42.449456+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:03.622375+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.a","version":"114'26","reported_seq":60,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434126+0000","last_change":"2024-04-24T13:33:10.421787+0000","last_active":"2024-04-24T13:33:41.434126+0000","last_peered":"2024-04-24T13:33:41.434126+0000","last_clean":"2024-04-24T13:33:41.434126+0000","last_became_active":"2024-04-24T13:33:08.733302+0000","last_became_peered":"2024-04-24T13:33:08.733302+0000","last_unstale":"2024-04-24T13:33:41.434126+0000","last_undegraded":"2024-04-24T13:33:41.434126+0000","last_fullsized":"2024-04-24T13:33:41.434126+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:10:16.339117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":198,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094459+0000","last_change":"2024-04-24T13:33:08.727357+0000","last_active":"2024-04-24T13:33:42.094459+0000","last_peered":"2024-04-24T13:33:42.094459+0000","last_clean":"2024-04-24T13:33:42.094459+0000","last_became_active":"2024-04-24T13:33:08.726787+0000","last_became_peered":"2024-04-24T13:33:08.726787+0000","last_unstale":"2024-04-24T13:33:42.094459+0000","last_undegraded":"2024-04-24T13:33:42.094459+0000","last_fullsized":"2024-04-24T13:33:42.094459+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:49.701435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"86'7","reported_seq":194,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434480+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:33:41.434480+0000","last_peered":"2024-04-24T13:33:41.434480+0000","last_clean":"2024-04-24T13:33:41.434480+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:33:41.434480+0000","last_undegraded":"2024-04-24T13:33:41.434480+0000","last_fullsized":"2024-04-24T13:33:41.434480+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"114'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093124+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:33:42.093124+0000","last_peered":"2024-04-24T13:33:42.093124+0000","last_clean":"2024-04-24T13:33:42.093124+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:33:42.093124+0000","last_undegraded":"2024-04-24T13:33:42.093124+0000","last_fullsized":"2024-04-24T13:33:42.093124+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"114'10","reported_seq":173,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094894+0000","last_change":"2024-04-24T13:30:50.930041+0000","last_active":"2024-04-24T13:33:42.094894+0000","last_peered":"2024-04-24T13:33:42.094894+0000","last_clean":"2024-04-24T13:33:42.094894+0000","last_became_active":"2024-04-24T13:30:50.929179+0000","last_became_peered":"2024-04-24T13:30:50.929179+0000","last_unstale":"2024-04-24T13:33:42.094894+0000","last_undegraded":"2024-04-24T13:33:42.094894+0000","last_fullsized":"2024-04-24T13:33:42.094894+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:46.987972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":196,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.446997+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:33:42.446997+0000","last_peered":"2024-04-24T13:33:42.446997+0000","last_clean":"2024-04-24T13:33:42.446997+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:33:42.446997+0000","last_undegraded":"2024-04-24T13:33:42.446997+0000","last_fullsized":"2024-04-24T13:33:42.446997+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"114'17","reported_seq":229,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093833+0000","last_change":"2024-04-24T13:30:50.948850+0000","last_active":"2024-04-24T13:33:42.093833+0000","last_peered":"2024-04-24T13:33:42.093833+0000","last_clean":"2024-04-24T13:33:42.093833+0000","last_became_active":"2024-04-24T13:30:50.921374+0000","last_became_peered":"2024-04-24T13:30:50.921374+0000","last_unstale":"2024-04-24T13:33:42.093833+0000","last_undegraded":"2024-04-24T13:33:42.093833+0000","last_fullsized":"2024-04-24T13:33:42.093833+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:22:03.728196+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":186,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090221+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:33:42.090221+0000","last_peered":"2024-04-24T13:33:42.090221+0000","last_clean":"2024-04-24T13:33:42.090221+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:33:42.090221+0000","last_undegraded":"2024-04-24T13:33:42.090221+0000","last_fullsized":"2024-04-24T13:33:42.090221+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":183,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450477+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:33:42.450477+0000","last_peered":"2024-04-24T13:33:42.450477+0000","last_clean":"2024-04-24T13:33:42.450477+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:33:42.450477+0000","last_undegraded":"2024-04-24T13:33:42.450477+0000","last_fullsized":"2024-04-24T13:33:42.450477+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"82'4","reported_seq":222,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449056+0000","last_change":"2024-04-24T13:32:01.548738+0000","last_active":"2024-04-24T13:33:42.449056+0000","last_peered":"2024-04-24T13:33:42.449056+0000","last_clean":"2024-04-24T13:33:42.449056+0000","last_became_active":"2024-04-24T13:32:01.548259+0000","last_became_peered":"2024-04-24T13:32:01.548259+0000","last_unstale":"2024-04-24T13:33:42.449056+0000","last_undegraded":"2024-04-24T13:33:42.449056+0000","last_fullsized":"2024-04-24T13:33:42.449056+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"114'19","reported_seq":69,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435003+0000","last_change":"2024-04-24T13:33:11.062433+0000","last_active":"2024-04-24T13:33:41.435003+0000","last_peered":"2024-04-24T13:33:41.435003+0000","last_clean":"2024-04-24T13:33:41.435003+0000","last_became_active":"2024-04-24T13:33:08.736638+0000","last_became_peered":"2024-04-24T13:33:08.736638+0000","last_unstale":"2024-04-24T13:33:41.435003+0000","last_undegraded":"2024-04-24T13:33:41.435003+0000","last_fullsized":"2024-04-24T13:33:41.435003+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:11.066693+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":29,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":196,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.447119+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:33:42.447119+0000","last_peered":"2024-04-24T13:33:42.447119+0000","last_clean":"2024-04-24T13:33:42.447119+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:33:42.447119+0000","last_undegraded":"2024-04-24T13:33:42.447119+0000","last_fullsized":"2024-04-24T13:33:42.447119+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"114'22","reported_seq":232,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.447061+0000","last_change":"2024-04-24T13:30:50.970163+0000","last_active":"2024-04-24T13:33:42.447061+0000","last_peered":"2024-04-24T13:33:42.447061+0000","last_clean":"2024-04-24T13:33:42.447061+0000","last_became_active":"2024-04-24T13:30:50.920182+0000","last_became_peered":"2024-04-24T13:30:50.920182+0000","last_unstale":"2024-04-24T13:33:42.447061+0000","last_undegraded":"2024-04-24T13:33:42.447061+0000","last_fullsized":"2024-04-24T13:33:42.447061+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:29.765956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.9","version":"114'119","reported_seq":426,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089879+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:33:42.089879+0000","last_peered":"2024-04-24T13:33:42.089879+0000","last_clean":"2024-04-24T13:33:42.089879+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:33:42.089879+0000","last_undegraded":"2024-04-24T13:33:42.089879+0000","last_fullsized":"2024-04-24T13:33:42.089879+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"82'3","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100229+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:33:42.100229+0000","last_peered":"2024-04-24T13:33:42.100229+0000","last_clean":"2024-04-24T13:33:42.100229+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:33:42.100229+0000","last_undegraded":"2024-04-24T13:33:42.100229+0000","last_fullsized":"2024-04-24T13:33:42.100229+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"105'8","reported_seq":233,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092067+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:33:42.092067+0000","last_peered":"2024-04-24T13:33:42.092067+0000","last_clean":"2024-04-24T13:33:42.092067+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:33:42.092067+0000","last_undegraded":"2024-04-24T13:33:42.092067+0000","last_fullsized":"2024-04-24T13:33:42.092067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":42,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"114'17","reported_seq":65,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434781+0000","last_change":"2024-04-24T13:33:10.787412+0000","last_active":"2024-04-24T13:33:41.434781+0000","last_peered":"2024-04-24T13:33:41.434781+0000","last_clean":"2024-04-24T13:33:41.434781+0000","last_became_active":"2024-04-24T13:33:08.718332+0000","last_became_peered":"2024-04-24T13:33:08.718332+0000","last_unstale":"2024-04-24T13:33:41.434781+0000","last_undegraded":"2024-04-24T13:33:41.434781+0000","last_fullsized":"2024-04-24T13:33:41.434781+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:11.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":196,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.447470+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:33:42.447470+0000","last_peered":"2024-04-24T13:33:42.447470+0000","last_clean":"2024-04-24T13:33:42.447470+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:33:42.447470+0000","last_undegraded":"2024-04-24T13:33:42.447470+0000","last_fullsized":"2024-04-24T13:33:42.447470+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"114'26","reported_seq":245,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090734+0000","last_change":"2024-04-24T13:30:51.000083+0000","last_active":"2024-04-24T13:33:42.090734+0000","last_peered":"2024-04-24T13:33:42.090734+0000","last_clean":"2024-04-24T13:33:42.090734+0000","last_became_active":"2024-04-24T13:30:50.934568+0000","last_became_peered":"2024-04-24T13:30:50.934568+0000","last_unstale":"2024-04-24T13:33:42.090734+0000","last_undegraded":"2024-04-24T13:33:42.090734+0000","last_fullsized":"2024-04-24T13:33:42.090734+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:10.436000+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":193,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.446900+0000","last_change":"2024-04-24T13:30:50.908390+0000","last_active":"2024-04-24T13:33:42.446900+0000","last_peered":"2024-04-24T13:33:42.446900+0000","last_clean":"2024-04-24T13:33:42.446900+0000","last_became_active":"2024-04-24T13:30:50.908013+0000","last_became_peered":"2024-04-24T13:30:50.908013+0000","last_unstale":"2024-04-24T13:33:42.446900+0000","last_undegraded":"2024-04-24T13:33:42.446900+0000","last_fullsized":"2024-04-24T13:33:42.446900+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"94'10","reported_seq":220,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095905+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:33:42.095905+0000","last_peered":"2024-04-24T13:33:42.095905+0000","last_clean":"2024-04-24T13:33:42.095905+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:33:42.095905+0000","last_undegraded":"2024-04-24T13:33:42.095905+0000","last_fullsized":"2024-04-24T13:33:42.095905+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":78,"num_read_kb":78,"num_write":23,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"82'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093634+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:33:42.093634+0000","last_peered":"2024-04-24T13:33:42.093634+0000","last_clean":"2024-04-24T13:33:42.093634+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:33:42.093634+0000","last_undegraded":"2024-04-24T13:33:42.093634+0000","last_fullsized":"2024-04-24T13:33:42.093634+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"114'20","reported_seq":222,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091996+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:33:42.091996+0000","last_peered":"2024-04-24T13:33:42.091996+0000","last_clean":"2024-04-24T13:33:42.091996+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:33:42.091996+0000","last_undegraded":"2024-04-24T13:33:42.091996+0000","last_fullsized":"2024-04-24T13:33:42.091996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":211,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448304+0000","last_change":"2024-04-24T13:33:08.738006+0000","last_active":"2024-04-24T13:33:42.448304+0000","last_peered":"2024-04-24T13:33:42.448304+0000","last_clean":"2024-04-24T13:33:42.448304+0000","last_became_active":"2024-04-24T13:33:08.737341+0000","last_became_peered":"2024-04-24T13:33:08.737341+0000","last_unstale":"2024-04-24T13:33:42.448304+0000","last_undegraded":"2024-04-24T13:33:42.448304+0000","last_fullsized":"2024-04-24T13:33:42.448304+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:51.796840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"114'18","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092988+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:33:42.092988+0000","last_peered":"2024-04-24T13:33:42.092988+0000","last_clean":"2024-04-24T13:33:42.092988+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:33:42.092988+0000","last_undegraded":"2024-04-24T13:33:42.092988+0000","last_fullsized":"2024-04-24T13:33:42.092988+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100240+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:33:42.100240+0000","last_peered":"2024-04-24T13:33:42.100240+0000","last_clean":"2024-04-24T13:33:42.100240+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:33:42.100240+0000","last_undegraded":"2024-04-24T13:33:42.100240+0000","last_fullsized":"2024-04-24T13:33:42.100240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":192,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093255+0000","last_change":"2024-04-24T13:33:08.720576+0000","last_active":"2024-04-24T13:33:42.093255+0000","last_peered":"2024-04-24T13:33:42.093255+0000","last_clean":"2024-04-24T13:33:42.093255+0000","last_became_active":"2024-04-24T13:33:08.720133+0000","last_became_peered":"2024-04-24T13:33:08.720133+0000","last_unstale":"2024-04-24T13:33:42.093255+0000","last_undegraded":"2024-04-24T13:33:42.093255+0000","last_fullsized":"2024-04-24T13:33:42.093255+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:16.254173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":199,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094028+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:33:42.094028+0000","last_peered":"2024-04-24T13:33:42.094028+0000","last_clean":"2024-04-24T13:33:42.094028+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:33:42.094028+0000","last_undegraded":"2024-04-24T13:33:42.094028+0000","last_fullsized":"2024-04-24T13:33:42.094028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"114'24","reported_seq":232,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449403+0000","last_change":"2024-04-24T13:31:00.986244+0000","last_active":"2024-04-24T13:33:42.449403+0000","last_peered":"2024-04-24T13:33:42.449403+0000","last_clean":"2024-04-24T13:33:42.449403+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:33:42.449403+0000","last_undegraded":"2024-04-24T13:33:42.449403+0000","last_fullsized":"2024-04-24T13:33:42.449403+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:23.355231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":196,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093188+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:33:42.093188+0000","last_peered":"2024-04-24T13:33:42.093188+0000","last_clean":"2024-04-24T13:33:42.093188+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:33:42.093188+0000","last_undegraded":"2024-04-24T13:33:42.093188+0000","last_fullsized":"2024-04-24T13:33:42.093188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"114'24","reported_seq":226,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449359+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:33:42.449359+0000","last_peered":"2024-04-24T13:33:42.449359+0000","last_clean":"2024-04-24T13:33:42.449359+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:33:42.449359+0000","last_undegraded":"2024-04-24T13:33:42.449359+0000","last_fullsized":"2024-04-24T13:33:42.449359+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"114'123","reported_seq":381,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448617+0000","last_change":"2024-04-24T13:33:11.710852+0000","last_active":"2024-04-24T13:33:42.448617+0000","last_peered":"2024-04-24T13:33:42.448617+0000","last_clean":"2024-04-24T13:33:42.448617+0000","last_became_active":"2024-04-24T13:33:11.709412+0000","last_became_peered":"2024-04-24T13:33:11.709412+0000","last_unstale":"2024-04-24T13:33:42.448617+0000","last_undegraded":"2024-04-24T13:33:42.448617+0000","last_fullsized":"2024-04-24T13:33:42.448617+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:22:40.670445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":184,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091405+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:33:42.091405+0000","last_peered":"2024-04-24T13:33:42.091405+0000","last_clean":"2024-04-24T13:33:42.091405+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:33:42.091405+0000","last_undegraded":"2024-04-24T13:33:42.091405+0000","last_fullsized":"2024-04-24T13:33:42.091405+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"114'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094680+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:33:42.094680+0000","last_peered":"2024-04-24T13:33:42.094680+0000","last_clean":"2024-04-24T13:33:42.094680+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:33:42.094680+0000","last_undegraded":"2024-04-24T13:33:42.094680+0000","last_fullsized":"2024-04-24T13:33:42.094680+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"113'21","reported_seq":224,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091808+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:33:42.091808+0000","last_peered":"2024-04-24T13:33:42.091808+0000","last_clean":"2024-04-24T13:33:42.091808+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:33:42.091808+0000","last_undegraded":"2024-04-24T13:33:42.091808+0000","last_fullsized":"2024-04-24T13:33:42.091808+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":64,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435518+0000","last_change":"2024-04-24T13:33:09.912410+0000","last_active":"2024-04-24T13:33:41.435518+0000","last_peered":"2024-04-24T13:33:41.435518+0000","last_clean":"2024-04-24T13:33:41.435518+0000","last_became_active":"2024-04-24T13:33:08.724858+0000","last_became_peered":"2024-04-24T13:33:08.724858+0000","last_unstale":"2024-04-24T13:33:41.435518+0000","last_undegraded":"2024-04-24T13:33:41.435518+0000","last_fullsized":"2024-04-24T13:33:41.435518+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:26.760043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":156,"num_read_kb":156,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"82'11","reported_seq":206,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095482+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:33:42.095482+0000","last_peered":"2024-04-24T13:33:42.095482+0000","last_clean":"2024-04-24T13:33:42.095482+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:33:42.095482+0000","last_undegraded":"2024-04-24T13:33:42.095482+0000","last_fullsized":"2024-04-24T13:33:42.095482+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"114'119","reported_seq":389,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450901+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:33:42.450901+0000","last_peered":"2024-04-24T13:33:42.450901+0000","last_clean":"2024-04-24T13:33:42.450901+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:33:42.450901+0000","last_undegraded":"2024-04-24T13:33:42.450901+0000","last_fullsized":"2024-04-24T13:33:42.450901+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"0'0","reported_seq":183,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093027+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:33:42.093027+0000","last_peered":"2024-04-24T13:33:42.093027+0000","last_clean":"2024-04-24T13:33:42.093027+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:33:42.093027+0000","last_undegraded":"2024-04-24T13:33:42.093027+0000","last_fullsized":"2024-04-24T13:33:42.093027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"86'4","reported_seq":218,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096183+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:33:42.096183+0000","last_peered":"2024-04-24T13:33:42.096183+0000","last_clean":"2024-04-24T13:33:42.096183+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:33:42.096183+0000","last_undegraded":"2024-04-24T13:33:42.096183+0000","last_fullsized":"2024-04-24T13:33:42.096183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"114'22","reported_seq":224,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091266+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:33:42.091266+0000","last_peered":"2024-04-24T13:33:42.091266+0000","last_clean":"2024-04-24T13:33:42.091266+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:33:42.091266+0000","last_undegraded":"2024-04-24T13:33:42.091266+0000","last_fullsized":"2024-04-24T13:33:42.091266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":205,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094403+0000","last_change":"2024-04-24T13:33:08.716879+0000","last_active":"2024-04-24T13:33:42.094403+0000","last_peered":"2024-04-24T13:33:42.094403+0000","last_clean":"2024-04-24T13:33:42.094403+0000","last_became_active":"2024-04-24T13:33:08.716585+0000","last_became_peered":"2024-04-24T13:33:08.716585+0000","last_unstale":"2024-04-24T13:33:42.094403+0000","last_undegraded":"2024-04-24T13:33:42.094403+0000","last_fullsized":"2024-04-24T13:33:42.094403+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:36.135388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"114'24","reported_seq":58,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434875+0000","last_change":"2024-04-24T13:33:10.818135+0000","last_active":"2024-04-24T13:33:41.434875+0000","last_peered":"2024-04-24T13:33:41.434875+0000","last_clean":"2024-04-24T13:33:41.434875+0000","last_became_active":"2024-04-24T13:33:08.736280+0000","last_became_peered":"2024-04-24T13:33:08.736280+0000","last_unstale":"2024-04-24T13:33:41.434875+0000","last_undegraded":"2024-04-24T13:33:41.434875+0000","last_fullsized":"2024-04-24T13:33:41.434875+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:41:16.005578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":187,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450054+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:33:42.450054+0000","last_peered":"2024-04-24T13:33:42.450054+0000","last_clean":"2024-04-24T13:33:42.450054+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:33:42.450054+0000","last_undegraded":"2024-04-24T13:33:42.450054+0000","last_fullsized":"2024-04-24T13:33:42.450054+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"82'2","reported_seq":202,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094140+0000","last_change":"2024-04-24T13:33:09.338972+0000","last_active":"2024-04-24T13:33:42.094140+0000","last_peered":"2024-04-24T13:33:42.094140+0000","last_clean":"2024-04-24T13:33:42.094140+0000","last_became_active":"2024-04-24T13:33:08.727402+0000","last_became_peered":"2024-04-24T13:33:08.727402+0000","last_unstale":"2024-04-24T13:33:42.094140+0000","last_undegraded":"2024-04-24T13:33:42.094140+0000","last_fullsized":"2024-04-24T13:33:42.094140+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:34.956692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"105'4","reported_seq":216,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.452067+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:33:42.452067+0000","last_peered":"2024-04-24T13:33:42.452067+0000","last_clean":"2024-04-24T13:33:42.452067+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:33:42.452067+0000","last_undegraded":"2024-04-24T13:33:42.452067+0000","last_fullsized":"2024-04-24T13:33:42.452067+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":328,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090735+0000","last_change":"2024-04-24T13:30:53.928527+0000","last_active":"2024-04-24T13:33:42.090735+0000","last_peered":"2024-04-24T13:33:42.090735+0000","last_clean":"2024-04-24T13:33:42.090735+0000","last_became_active":"2024-04-24T13:30:53.928167+0000","last_became_peered":"2024-04-24T13:30:53.928167+0000","last_unstale":"2024-04-24T13:33:42.090735+0000","last_undegraded":"2024-04-24T13:33:42.090735+0000","last_fullsized":"2024-04-24T13:33:42.090735+0000","mapping_epoch":44,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":45,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:43.966986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433335+0000","last_change":"2024-04-24T13:33:08.717037+0000","last_active":"2024-04-24T13:33:41.433335+0000","last_peered":"2024-04-24T13:33:41.433335+0000","last_clean":"2024-04-24T13:33:41.433335+0000","last_became_active":"2024-04-24T13:33:08.715914+0000","last_became_peered":"2024-04-24T13:33:08.715914+0000","last_unstale":"2024-04-24T13:33:41.433335+0000","last_undegraded":"2024-04-24T13:33:41.433335+0000","last_fullsized":"2024-04-24T13:33:41.433335+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:03.765941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"114'15","reported_seq":245,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090531+0000","last_change":"2024-04-24T13:33:09.529789+0000","last_active":"2024-04-24T13:33:42.090531+0000","last_peered":"2024-04-24T13:33:42.090531+0000","last_clean":"2024-04-24T13:33:42.090531+0000","last_became_active":"2024-04-24T13:33:08.725348+0000","last_became_peered":"2024-04-24T13:33:08.725348+0000","last_unstale":"2024-04-24T13:33:42.090531+0000","last_undegraded":"2024-04-24T13:33:42.090531+0000","last_fullsized":"2024-04-24T13:33:42.090531+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:18.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":176,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448588+0000","last_change":"2024-04-24T13:33:08.739176+0000","last_active":"2024-04-24T13:33:42.448588+0000","last_peered":"2024-04-24T13:33:42.448588+0000","last_clean":"2024-04-24T13:33:42.448588+0000","last_became_active":"2024-04-24T13:33:08.738740+0000","last_became_peered":"2024-04-24T13:33:08.738740+0000","last_unstale":"2024-04-24T13:33:42.448588+0000","last_undegraded":"2024-04-24T13:33:42.448588+0000","last_fullsized":"2024-04-24T13:33:42.448588+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:46:07.432330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.7","version":"114'37","reported_seq":56,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435765+0000","last_change":"2024-04-24T13:33:09.565111+0000","last_active":"2024-04-24T13:33:41.435765+0000","last_peered":"2024-04-24T13:33:41.435765+0000","last_clean":"2024-04-24T13:33:41.435765+0000","last_became_active":"2024-04-24T13:33:08.719950+0000","last_became_peered":"2024-04-24T13:33:08.719950+0000","last_unstale":"2024-04-24T13:33:41.435765+0000","last_undegraded":"2024-04-24T13:33:41.435765+0000","last_fullsized":"2024-04-24T13:33:41.435765+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:37.122088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62524,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":33,"num_read_kb":25,"num_write":20,"num_write_kb":63,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":58868,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":192,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100189+0000","last_change":"2024-04-24T13:30:50.917737+0000","last_active":"2024-04-24T13:33:42.100189+0000","last_peered":"2024-04-24T13:33:42.100189+0000","last_clean":"2024-04-24T13:33:42.100189+0000","last_became_active":"2024-04-24T13:30:50.916920+0000","last_became_peered":"2024-04-24T13:30:50.916920+0000","last_unstale":"2024-04-24T13:33:42.100189+0000","last_undegraded":"2024-04-24T13:33:42.100189+0000","last_fullsized":"2024-04-24T13:33:42.100189+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:12.813827+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":193,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448972+0000","last_change":"2024-04-24T13:33:08.727069+0000","last_active":"2024-04-24T13:33:42.448972+0000","last_peered":"2024-04-24T13:33:42.448972+0000","last_clean":"2024-04-24T13:33:42.448972+0000","last_became_active":"2024-04-24T13:33:08.726216+0000","last_became_peered":"2024-04-24T13:33:08.726216+0000","last_unstale":"2024-04-24T13:33:42.448972+0000","last_undegraded":"2024-04-24T13:33:42.448972+0000","last_fullsized":"2024-04-24T13:33:42.448972+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:59.675122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"105'6","reported_seq":226,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099851+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:33:42.099851+0000","last_peered":"2024-04-24T13:33:42.099851+0000","last_clean":"2024-04-24T13:33:42.099851+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:33:42.099851+0000","last_undegraded":"2024-04-24T13:33:42.099851+0000","last_fullsized":"2024-04-24T13:33:42.099851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":164,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096593+0000","last_change":"2024-04-24T13:30:50.937903+0000","last_active":"2024-04-24T13:33:42.096593+0000","last_peered":"2024-04-24T13:33:42.096593+0000","last_clean":"2024-04-24T13:33:42.096593+0000","last_became_active":"2024-04-24T13:30:50.937359+0000","last_became_peered":"2024-04-24T13:30:50.937359+0000","last_unstale":"2024-04-24T13:33:42.096593+0000","last_undegraded":"2024-04-24T13:33:42.096593+0000","last_fullsized":"2024-04-24T13:33:42.096593+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:27.651521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.1","version":"114'18","reported_seq":221,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095809+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:33:42.095809+0000","last_peered":"2024-04-24T13:33:42.095809+0000","last_clean":"2024-04-24T13:33:42.095809+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:33:42.095809+0000","last_undegraded":"2024-04-24T13:33:42.095809+0000","last_fullsized":"2024-04-24T13:33:42.095809+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435711+0000","last_change":"2024-04-24T13:33:08.734054+0000","last_active":"2024-04-24T13:33:41.435711+0000","last_peered":"2024-04-24T13:33:41.435711+0000","last_clean":"2024-04-24T13:33:41.435711+0000","last_became_active":"2024-04-24T13:33:08.728126+0000","last_became_peered":"2024-04-24T13:33:08.728126+0000","last_unstale":"2024-04-24T13:33:41.435711+0000","last_undegraded":"2024-04-24T13:33:41.435711+0000","last_fullsized":"2024-04-24T13:33:41.435711+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:48.542362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"114'123","reported_seq":411,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092936+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:33:42.092936+0000","last_peered":"2024-04-24T13:33:42.092936+0000","last_clean":"2024-04-24T13:33:42.092936+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:33:42.092936+0000","last_undegraded":"2024-04-24T13:33:42.092936+0000","last_fullsized":"2024-04-24T13:33:42.092936+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":123,"log_dups_size":0,"ondisk_log_size":123,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120994,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":161,"num_read_kb":146,"num_write":28,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":166,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448395+0000","last_change":"2024-04-24T13:30:50.925382+0000","last_active":"2024-04-24T13:33:42.448395+0000","last_peered":"2024-04-24T13:33:42.448395+0000","last_clean":"2024-04-24T13:33:42.448395+0000","last_became_active":"2024-04-24T13:30:50.924919+0000","last_became_peered":"2024-04-24T13:30:50.924919+0000","last_unstale":"2024-04-24T13:33:42.448395+0000","last_undegraded":"2024-04-24T13:33:42.448395+0000","last_fullsized":"2024-04-24T13:33:42.448395+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":184,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091800+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:33:42.091800+0000","last_peered":"2024-04-24T13:33:42.091800+0000","last_clean":"2024-04-24T13:33:42.091800+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:33:42.091800+0000","last_undegraded":"2024-04-24T13:33:42.091800+0000","last_fullsized":"2024-04-24T13:33:42.091800+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"0'0","reported_seq":210,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096283+0000","last_change":"2024-04-24T13:33:08.745743+0000","last_active":"2024-04-24T13:33:42.096283+0000","last_peered":"2024-04-24T13:33:42.096283+0000","last_clean":"2024-04-24T13:33:42.096283+0000","last_became_active":"2024-04-24T13:33:08.745363+0000","last_became_peered":"2024-04-24T13:33:08.745363+0000","last_unstale":"2024-04-24T13:33:42.096283+0000","last_undegraded":"2024-04-24T13:33:42.096283+0000","last_fullsized":"2024-04-24T13:33:42.096283+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:23:38.852782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":210,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.447870+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:33:42.447870+0000","last_peered":"2024-04-24T13:33:42.447870+0000","last_clean":"2024-04-24T13:33:42.447870+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:33:42.447870+0000","last_undegraded":"2024-04-24T13:33:42.447870+0000","last_fullsized":"2024-04-24T13:33:42.447870+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"114'17","reported_seq":221,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096319+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:33:42.096319+0000","last_peered":"2024-04-24T13:33:42.096319+0000","last_clean":"2024-04-24T13:33:42.096319+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:33:42.096319+0000","last_undegraded":"2024-04-24T13:33:42.096319+0000","last_fullsized":"2024-04-24T13:33:42.096319+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":215,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448710+0000","last_change":"2024-04-24T13:33:09.537358+0000","last_active":"2024-04-24T13:33:42.448710+0000","last_peered":"2024-04-24T13:33:42.448710+0000","last_clean":"2024-04-24T13:33:42.448710+0000","last_became_active":"2024-04-24T13:33:08.726022+0000","last_became_peered":"2024-04-24T13:33:08.726022+0000","last_unstale":"2024-04-24T13:33:42.448710+0000","last_undegraded":"2024-04-24T13:33:42.448710+0000","last_fullsized":"2024-04-24T13:33:42.448710+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:53:29.132620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"82'17","reported_seq":258,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451387+0000","last_change":"2024-04-24T13:30:50.991700+0000","last_active":"2024-04-24T13:33:42.451387+0000","last_peered":"2024-04-24T13:33:42.451387+0000","last_clean":"2024-04-24T13:33:42.451387+0000","last_became_active":"2024-04-24T13:30:50.940740+0000","last_became_peered":"2024-04-24T13:30:50.940740+0000","last_unstale":"2024-04-24T13:33:42.451387+0000","last_undegraded":"2024-04-24T13:33:42.451387+0000","last_fullsized":"2024-04-24T13:33:42.451387+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:39.725529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091467+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:33:42.091467+0000","last_peered":"2024-04-24T13:33:42.091467+0000","last_clean":"2024-04-24T13:33:42.091467+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:33:42.091467+0000","last_undegraded":"2024-04-24T13:33:42.091467+0000","last_fullsized":"2024-04-24T13:33:42.091467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":182,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093206+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:33:42.093206+0000","last_peered":"2024-04-24T13:33:42.093206+0000","last_clean":"2024-04-24T13:33:42.093206+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:33:42.093206+0000","last_undegraded":"2024-04-24T13:33:42.093206+0000","last_fullsized":"2024-04-24T13:33:42.093206+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"82'2","reported_seq":209,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094901+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:33:42.094901+0000","last_peered":"2024-04-24T13:33:42.094901+0000","last_clean":"2024-04-24T13:33:42.094901+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:33:42.094901+0000","last_undegraded":"2024-04-24T13:33:42.094901+0000","last_fullsized":"2024-04-24T13:33:42.094901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433538+0000","last_change":"2024-04-24T13:33:08.727739+0000","last_active":"2024-04-24T13:33:41.433538+0000","last_peered":"2024-04-24T13:33:41.433538+0000","last_clean":"2024-04-24T13:33:41.433538+0000","last_became_active":"2024-04-24T13:33:08.727324+0000","last_became_peered":"2024-04-24T13:33:08.727324+0000","last_unstale":"2024-04-24T13:33:41.433538+0000","last_undegraded":"2024-04-24T13:33:41.433538+0000","last_fullsized":"2024-04-24T13:33:41.433538+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:23.918692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"114'14","reported_seq":222,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093613+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:33:42.093613+0000","last_peered":"2024-04-24T13:33:42.093613+0000","last_clean":"2024-04-24T13:33:42.093613+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:33:42.093613+0000","last_undegraded":"2024-04-24T13:33:42.093613+0000","last_fullsized":"2024-04-24T13:33:42.093613+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.760398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":195,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091381+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:33:42.091381+0000","last_peered":"2024-04-24T13:33:42.091381+0000","last_clean":"2024-04-24T13:33:42.091381+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:33:42.091381+0000","last_undegraded":"2024-04-24T13:33:42.091381+0000","last_fullsized":"2024-04-24T13:33:42.091381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":208,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092616+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:33:42.092616+0000","last_peered":"2024-04-24T13:33:42.092616+0000","last_clean":"2024-04-24T13:33:42.092616+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:33:42.092616+0000","last_undegraded":"2024-04-24T13:33:42.092616+0000","last_fullsized":"2024-04-24T13:33:42.092616+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":187,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451080+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:33:42.451080+0000","last_peered":"2024-04-24T13:33:42.451080+0000","last_clean":"2024-04-24T13:33:42.451080+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:33:42.451080+0000","last_undegraded":"2024-04-24T13:33:42.451080+0000","last_fullsized":"2024-04-24T13:33:42.451080+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"81'4","reported_seq":42,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433195+0000","last_change":"2024-04-24T13:33:09.289060+0000","last_active":"2024-04-24T13:33:41.433195+0000","last_peered":"2024-04-24T13:33:41.433195+0000","last_clean":"2024-04-24T13:33:41.433195+0000","last_became_active":"2024-04-24T13:33:08.717929+0000","last_became_peered":"2024-04-24T13:33:08.717929+0000","last_unstale":"2024-04-24T13:33:41.433195+0000","last_undegraded":"2024-04-24T13:33:41.433195+0000","last_fullsized":"2024-04-24T13:33:41.433195+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:36.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":210,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092732+0000","last_change":"2024-04-24T13:33:08.738475+0000","last_active":"2024-04-24T13:33:42.092732+0000","last_peered":"2024-04-24T13:33:42.092732+0000","last_clean":"2024-04-24T13:33:42.092732+0000","last_became_active":"2024-04-24T13:33:08.738109+0000","last_became_peered":"2024-04-24T13:33:08.738109+0000","last_unstale":"2024-04-24T13:33:42.092732+0000","last_undegraded":"2024-04-24T13:33:42.092732+0000","last_fullsized":"2024-04-24T13:33:42.092732+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:14:49.386651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"114'18","reported_seq":64,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433999+0000","last_change":"2024-04-24T13:33:10.091580+0000","last_active":"2024-04-24T13:33:41.433999+0000","last_peered":"2024-04-24T13:33:41.433999+0000","last_clean":"2024-04-24T13:33:41.433999+0000","last_became_active":"2024-04-24T13:33:08.716808+0000","last_became_peered":"2024-04-24T13:33:08.716808+0000","last_unstale":"2024-04-24T13:33:41.433999+0000","last_undegraded":"2024-04-24T13:33:41.433999+0000","last_fullsized":"2024-04-24T13:33:41.433999+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:05:06.347329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":28,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":210,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095349+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:33:42.095349+0000","last_peered":"2024-04-24T13:33:42.095349+0000","last_clean":"2024-04-24T13:33:42.095349+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:33:42.095349+0000","last_undegraded":"2024-04-24T13:33:42.095349+0000","last_fullsized":"2024-04-24T13:33:42.095349+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":195,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089939+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:33:42.089939+0000","last_peered":"2024-04-24T13:33:42.089939+0000","last_clean":"2024-04-24T13:33:42.089939+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:33:42.089939+0000","last_undegraded":"2024-04-24T13:33:42.089939+0000","last_fullsized":"2024-04-24T13:33:42.089939+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"114'32","reported_seq":237,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089565+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:33:42.089565+0000","last_peered":"2024-04-24T13:33:42.089565+0000","last_clean":"2024-04-24T13:33:42.089565+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:33:42.089565+0000","last_undegraded":"2024-04-24T13:33:42.089565+0000","last_fullsized":"2024-04-24T13:33:42.089565+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093991+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:33:42.093991+0000","last_peered":"2024-04-24T13:33:42.093991+0000","last_clean":"2024-04-24T13:33:42.093991+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:33:42.093991+0000","last_undegraded":"2024-04-24T13:33:42.093991+0000","last_fullsized":"2024-04-24T13:33:42.093991+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":183,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100449+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:33:42.100449+0000","last_peered":"2024-04-24T13:33:42.100449+0000","last_clean":"2024-04-24T13:33:42.100449+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:33:42.100449+0000","last_undegraded":"2024-04-24T13:33:42.100449+0000","last_fullsized":"2024-04-24T13:33:42.100449+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"114'18","reported_seq":289,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091973+0000","last_change":"2024-04-24T13:33:09.335136+0000","last_active":"2024-04-24T13:33:42.091973+0000","last_peered":"2024-04-24T13:33:42.091973+0000","last_clean":"2024-04-24T13:33:42.091973+0000","last_became_active":"2024-04-24T13:33:08.705853+0000","last_became_peered":"2024-04-24T13:33:08.705853+0000","last_unstale":"2024-04-24T13:33:42.091973+0000","last_undegraded":"2024-04-24T13:33:42.091973+0000","last_fullsized":"2024-04-24T13:33:42.091973+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:53.758485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":86,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"112'6","reported_seq":210,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095063+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:33:42.095063+0000","last_peered":"2024-04-24T13:33:42.095063+0000","last_clean":"2024-04-24T13:33:42.095063+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:33:42.095063+0000","last_undegraded":"2024-04-24T13:33:42.095063+0000","last_fullsized":"2024-04-24T13:33:42.095063+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":25165824,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":6,"num_write_kb":24576,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":164,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099764+0000","last_change":"2024-04-24T13:30:50.937016+0000","last_active":"2024-04-24T13:33:42.099764+0000","last_peered":"2024-04-24T13:33:42.099764+0000","last_clean":"2024-04-24T13:33:42.099764+0000","last_became_active":"2024-04-24T13:30:50.934998+0000","last_became_peered":"2024-04-24T13:30:50.934998+0000","last_unstale":"2024-04-24T13:33:42.099764+0000","last_undegraded":"2024-04-24T13:33:42.099764+0000","last_fullsized":"2024-04-24T13:33:42.099764+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:42:03.696601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":195,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449696+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:33:42.449696+0000","last_peered":"2024-04-24T13:33:42.449696+0000","last_clean":"2024-04-24T13:33:42.449696+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:33:42.449696+0000","last_undegraded":"2024-04-24T13:33:42.449696+0000","last_fullsized":"2024-04-24T13:33:42.449696+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"105'15","reported_seq":214,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090475+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:33:42.090475+0000","last_peered":"2024-04-24T13:33:42.090475+0000","last_clean":"2024-04-24T13:33:42.090475+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:33:42.090475+0000","last_undegraded":"2024-04-24T13:33:42.090475+0000","last_fullsized":"2024-04-24T13:33:42.090475+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"114'122","reported_seq":260,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.432606+0000","last_change":"2024-04-24T13:33:11.712104+0000","last_active":"2024-04-24T13:33:41.432606+0000","last_peered":"2024-04-24T13:33:41.432606+0000","last_clean":"2024-04-24T13:33:41.432606+0000","last_became_active":"2024-04-24T13:33:11.710310+0000","last_became_peered":"2024-04-24T13:33:11.710310+0000","last_unstale":"2024-04-24T13:33:41.432606+0000","last_undegraded":"2024-04-24T13:33:41.432606+0000","last_fullsized":"2024-04-24T13:33:41.432606+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":122,"log_dups_size":0,"ondisk_log_size":122,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:44.878043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"114'3","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091279+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:33:42.091279+0000","last_peered":"2024-04-24T13:33:42.091279+0000","last_clean":"2024-04-24T13:33:42.091279+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:33:42.091279+0000","last_undegraded":"2024-04-24T13:33:42.091279+0000","last_fullsized":"2024-04-24T13:33:42.091279+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"82'2","reported_seq":160,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.446774+0000","last_change":"2024-04-24T13:31:01.035271+0000","last_active":"2024-04-24T13:33:42.446774+0000","last_peered":"2024-04-24T13:33:42.446774+0000","last_clean":"2024-04-24T13:33:42.446774+0000","last_became_active":"2024-04-24T13:31:01.034314+0000","last_became_peered":"2024-04-24T13:31:01.034314+0000","last_unstale":"2024-04-24T13:33:42.446774+0000","last_undegraded":"2024-04-24T13:33:42.446774+0000","last_fullsized":"2024-04-24T13:33:42.446774+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:45.074671+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"114'16","reported_seq":223,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090941+0000","last_change":"2024-04-24T13:30:50.913675+0000","last_active":"2024-04-24T13:33:42.090941+0000","last_peered":"2024-04-24T13:33:42.090941+0000","last_clean":"2024-04-24T13:33:42.090941+0000","last_became_active":"2024-04-24T13:30:50.912153+0000","last_became_peered":"2024-04-24T13:30:50.912153+0000","last_unstale":"2024-04-24T13:33:42.090941+0000","last_undegraded":"2024-04-24T13:33:42.090941+0000","last_fullsized":"2024-04-24T13:33:42.090941+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:10:55.808699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":65011712,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":63488,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":210,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.097051+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:33:42.097051+0000","last_peered":"2024-04-24T13:33:42.097051+0000","last_clean":"2024-04-24T13:33:42.097051+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:33:42.097051+0000","last_undegraded":"2024-04-24T13:33:42.097051+0000","last_fullsized":"2024-04-24T13:33:42.097051+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":195,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093400+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:33:42.093400+0000","last_peered":"2024-04-24T13:33:42.093400+0000","last_clean":"2024-04-24T13:33:42.093400+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:33:42.093400+0000","last_undegraded":"2024-04-24T13:33:42.093400+0000","last_fullsized":"2024-04-24T13:33:42.093400+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":206,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093551+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:33:42.093551+0000","last_peered":"2024-04-24T13:33:42.093551+0000","last_clean":"2024-04-24T13:33:42.093551+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:33:42.093551+0000","last_undegraded":"2024-04-24T13:33:42.093551+0000","last_fullsized":"2024-04-24T13:33:42.093551+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"114'119","reported_seq":344,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094475+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:33:42.094475+0000","last_peered":"2024-04-24T13:33:42.094475+0000","last_clean":"2024-04-24T13:33:42.094475+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:33:42.094475+0000","last_undegraded":"2024-04-24T13:33:42.094475+0000","last_fullsized":"2024-04-24T13:33:42.094475+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"82'6","reported_seq":191,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091565+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:33:42.091565+0000","last_peered":"2024-04-24T13:33:42.091565+0000","last_clean":"2024-04-24T13:33:42.091565+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:33:42.091565+0000","last_undegraded":"2024-04-24T13:33:42.091565+0000","last_fullsized":"2024-04-24T13:33:42.091565+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"114'6","reported_seq":240,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092628+0000","last_change":"2024-04-24T13:33:08.753804+0000","last_active":"2024-04-24T13:33:42.092628+0000","last_peered":"2024-04-24T13:33:42.092628+0000","last_clean":"2024-04-24T13:33:42.092628+0000","last_became_active":"2024-04-24T13:33:08.707993+0000","last_became_peered":"2024-04-24T13:33:08.707993+0000","last_unstale":"2024-04-24T13:33:42.092628+0000","last_undegraded":"2024-04-24T13:33:42.092628+0000","last_fullsized":"2024-04-24T13:33:42.092628+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:02.680781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"114'17","reported_seq":220,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099659+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:33:42.099659+0000","last_peered":"2024-04-24T13:33:42.099659+0000","last_clean":"2024-04-24T13:33:42.099659+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:33:42.099659+0000","last_undegraded":"2024-04-24T13:33:42.099659+0000","last_fullsized":"2024-04-24T13:33:42.099659+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":214,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451617+0000","last_change":"2024-04-24T13:30:50.937218+0000","last_active":"2024-04-24T13:33:42.451617+0000","last_peered":"2024-04-24T13:33:42.451617+0000","last_clean":"2024-04-24T13:33:42.451617+0000","last_became_active":"2024-04-24T13:30:50.936420+0000","last_became_peered":"2024-04-24T13:30:50.936420+0000","last_unstale":"2024-04-24T13:33:42.451617+0000","last_undegraded":"2024-04-24T13:33:42.451617+0000","last_fullsized":"2024-04-24T13:33:42.451617+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:08.910360+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":194,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092525+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:33:42.092525+0000","last_peered":"2024-04-24T13:33:42.092525+0000","last_clean":"2024-04-24T13:33:42.092525+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:33:42.092525+0000","last_undegraded":"2024-04-24T13:33:42.092525+0000","last_fullsized":"2024-04-24T13:33:42.092525+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"114'40","reported_seq":257,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449726+0000","last_change":"2024-04-24T13:30:50.977698+0000","last_active":"2024-04-24T13:33:42.449726+0000","last_peered":"2024-04-24T13:33:42.449726+0000","last_clean":"2024-04-24T13:33:42.449726+0000","last_became_active":"2024-04-24T13:30:50.936955+0000","last_became_peered":"2024-04-24T13:30:50.936955+0000","last_unstale":"2024-04-24T13:33:42.449726+0000","last_undegraded":"2024-04-24T13:33:42.449726+0000","last_fullsized":"2024-04-24T13:33:42.449726+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:47.349331+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":186,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090322+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:33:42.090322+0000","last_peered":"2024-04-24T13:33:42.090322+0000","last_clean":"2024-04-24T13:33:42.090322+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:33:42.090322+0000","last_undegraded":"2024-04-24T13:33:42.090322+0000","last_fullsized":"2024-04-24T13:33:42.090322+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"105'6","reported_seq":45,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434300+0000","last_change":"2024-04-24T13:33:10.795857+0000","last_active":"2024-04-24T13:33:41.434300+0000","last_peered":"2024-04-24T13:33:41.434300+0000","last_clean":"2024-04-24T13:33:41.434300+0000","last_became_active":"2024-04-24T13:33:08.735079+0000","last_became_peered":"2024-04-24T13:33:08.735079+0000","last_unstale":"2024-04-24T13:33:41.434300+0000","last_undegraded":"2024-04-24T13:33:41.434300+0000","last_fullsized":"2024-04-24T13:33:41.434300+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:48:31.488596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"82'2","reported_seq":201,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099938+0000","last_change":"2024-04-24T13:33:09.076639+0000","last_active":"2024-04-24T13:33:42.099938+0000","last_peered":"2024-04-24T13:33:42.099938+0000","last_clean":"2024-04-24T13:33:42.099938+0000","last_became_active":"2024-04-24T13:33:08.705821+0000","last_became_peered":"2024-04-24T13:33:08.705821+0000","last_unstale":"2024-04-24T13:33:42.099938+0000","last_undegraded":"2024-04-24T13:33:42.099938+0000","last_fullsized":"2024-04-24T13:33:42.099938+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:07:09.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"82'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092817+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:33:42.092817+0000","last_peered":"2024-04-24T13:33:42.092817+0000","last_clean":"2024-04-24T13:33:42.092817+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:33:42.092817+0000","last_undegraded":"2024-04-24T13:33:42.092817+0000","last_fullsized":"2024-04-24T13:33:42.092817+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"114'24","reported_seq":175,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448172+0000","last_change":"2024-04-24T13:31:00.986151+0000","last_active":"2024-04-24T13:33:42.448172+0000","last_peered":"2024-04-24T13:33:42.448172+0000","last_clean":"2024-04-24T13:33:42.448172+0000","last_became_active":"2024-04-24T13:31:00.985421+0000","last_became_peered":"2024-04-24T13:31:00.985421+0000","last_unstale":"2024-04-24T13:33:42.448172+0000","last_undegraded":"2024-04-24T13:33:42.448172+0000","last_fullsized":"2024-04-24T13:33:42.448172+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:42.662404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":294,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092826+0000","last_change":"2024-04-24T13:33:09.553473+0000","last_active":"2024-04-24T13:33:42.092826+0000","last_peered":"2024-04-24T13:33:42.092826+0000","last_clean":"2024-04-24T13:33:42.092826+0000","last_became_active":"2024-04-24T13:33:08.738276+0000","last_became_peered":"2024-04-24T13:33:08.738276+0000","last_unstale":"2024-04-24T13:33:42.092826+0000","last_undegraded":"2024-04-24T13:33:42.092826+0000","last_fullsized":"2024-04-24T13:33:42.092826+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:44.215595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":118,"num_read_kb":118,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"114'19","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093629+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:33:42.093629+0000","last_peered":"2024-04-24T13:33:42.093629+0000","last_clean":"2024-04-24T13:33:42.093629+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:33:42.093629+0000","last_undegraded":"2024-04-24T13:33:42.093629+0000","last_fullsized":"2024-04-24T13:33:42.093629+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":186,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092880+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:33:42.092880+0000","last_peered":"2024-04-24T13:33:42.092880+0000","last_clean":"2024-04-24T13:33:42.092880+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:33:42.092880+0000","last_undegraded":"2024-04-24T13:33:42.092880+0000","last_fullsized":"2024-04-24T13:33:42.092880+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091819+0000","last_change":"2024-04-24T13:30:50.930475+0000","last_active":"2024-04-24T13:33:42.091819+0000","last_peered":"2024-04-24T13:33:42.091819+0000","last_clean":"2024-04-24T13:33:42.091819+0000","last_became_active":"2024-04-24T13:30:50.929905+0000","last_became_peered":"2024-04-24T13:30:50.929905+0000","last_unstale":"2024-04-24T13:33:42.091819+0000","last_undegraded":"2024-04-24T13:33:42.091819+0000","last_fullsized":"2024-04-24T13:33:42.091819+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:41.257023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":200,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092503+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:33:42.092503+0000","last_peered":"2024-04-24T13:33:42.092503+0000","last_clean":"2024-04-24T13:33:42.092503+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:33:42.092503+0000","last_undegraded":"2024-04-24T13:33:42.092503+0000","last_fullsized":"2024-04-24T13:33:42.092503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"113'9","reported_seq":170,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095163+0000","last_change":"2024-04-24T13:30:50.931263+0000","last_active":"2024-04-24T13:33:42.095163+0000","last_peered":"2024-04-24T13:33:42.095163+0000","last_clean":"2024-04-24T13:33:42.095163+0000","last_became_active":"2024-04-24T13:30:50.929683+0000","last_became_peered":"2024-04-24T13:30:50.929683+0000","last_unstale":"2024-04-24T13:33:42.095163+0000","last_undegraded":"2024-04-24T13:33:42.095163+0000","last_fullsized":"2024-04-24T13:33:42.095163+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:28:57.986709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":37748736,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":9,"num_write_kb":36864,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":194,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092994+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:33:42.092994+0000","last_peered":"2024-04-24T13:33:42.092994+0000","last_clean":"2024-04-24T13:33:42.092994+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:33:42.092994+0000","last_undegraded":"2024-04-24T13:33:42.092994+0000","last_fullsized":"2024-04-24T13:33:42.092994+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"113'8","reported_seq":227,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090167+0000","last_change":"2024-04-24T13:33:09.548972+0000","last_active":"2024-04-24T13:33:42.090167+0000","last_peered":"2024-04-24T13:33:42.090167+0000","last_clean":"2024-04-24T13:33:42.090167+0000","last_became_active":"2024-04-24T13:33:08.721855+0000","last_became_peered":"2024-04-24T13:33:08.721855+0000","last_unstale":"2024-04-24T13:33:42.090167+0000","last_undegraded":"2024-04-24T13:33:42.090167+0000","last_fullsized":"2024-04-24T13:33:42.090167+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:12.936976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":19,"num_read_kb":17,"num_write":30,"num_write_kb":26,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":164,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448989+0000","last_change":"2024-04-24T13:30:50.924952+0000","last_active":"2024-04-24T13:33:42.448989+0000","last_peered":"2024-04-24T13:33:42.448989+0000","last_clean":"2024-04-24T13:33:42.448989+0000","last_became_active":"2024-04-24T13:30:50.923933+0000","last_became_peered":"2024-04-24T13:30:50.923933+0000","last_unstale":"2024-04-24T13:33:42.448989+0000","last_undegraded":"2024-04-24T13:33:42.448989+0000","last_fullsized":"2024-04-24T13:33:42.448989+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:17.479670+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1d","version":"82'4","reported_seq":189,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091085+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:33:42.091085+0000","last_peered":"2024-04-24T13:33:42.091085+0000","last_clean":"2024-04-24T13:33:42.091085+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:33:42.091085+0000","last_undegraded":"2024-04-24T13:33:42.091085+0000","last_fullsized":"2024-04-24T13:33:42.091085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"82'4","reported_seq":219,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094357+0000","last_change":"2024-04-24T13:30:50.925917+0000","last_active":"2024-04-24T13:33:42.094357+0000","last_peered":"2024-04-24T13:33:42.094357+0000","last_clean":"2024-04-24T13:33:42.094357+0000","last_became_active":"2024-04-24T13:30:50.925580+0000","last_became_peered":"2024-04-24T13:30:50.925580+0000","last_unstale":"2024-04-24T13:33:42.094357+0000","last_undegraded":"2024-04-24T13:33:42.094357+0000","last_fullsized":"2024-04-24T13:33:42.094357+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"114'17","reported_seq":62,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434785+0000","last_change":"2024-04-24T13:33:09.911129+0000","last_active":"2024-04-24T13:33:41.434785+0000","last_peered":"2024-04-24T13:33:41.434785+0000","last_clean":"2024-04-24T13:33:41.434785+0000","last_became_active":"2024-04-24T13:33:08.725239+0000","last_became_peered":"2024-04-24T13:33:08.725239+0000","last_unstale":"2024-04-24T13:33:41.434785+0000","last_undegraded":"2024-04-24T13:33:41.434785+0000","last_fullsized":"2024-04-24T13:33:41.434785+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:14:16.523695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":163,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091391+0000","last_change":"2024-04-24T13:30:50.934577+0000","last_active":"2024-04-24T13:33:42.091391+0000","last_peered":"2024-04-24T13:33:42.091391+0000","last_clean":"2024-04-24T13:33:42.091391+0000","last_became_active":"2024-04-24T13:30:50.931559+0000","last_became_peered":"2024-04-24T13:30:50.931559+0000","last_unstale":"2024-04-24T13:33:42.091391+0000","last_undegraded":"2024-04-24T13:33:42.091391+0000","last_fullsized":"2024-04-24T13:33:42.091391+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:35.372215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.13","version":"114'19","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092517+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:33:42.092517+0000","last_peered":"2024-04-24T13:33:42.092517+0000","last_clean":"2024-04-24T13:33:42.092517+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:33:42.092517+0000","last_undegraded":"2024-04-24T13:33:42.092517+0000","last_fullsized":"2024-04-24T13:33:42.092517+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":187,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449973+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:33:42.449973+0000","last_peered":"2024-04-24T13:33:42.449973+0000","last_clean":"2024-04-24T13:33:42.449973+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:33:42.449973+0000","last_undegraded":"2024-04-24T13:33:42.449973+0000","last_fullsized":"2024-04-24T13:33:42.449973+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"114'4","reported_seq":44,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434242+0000","last_change":"2024-04-24T13:33:08.738102+0000","last_active":"2024-04-24T13:33:41.434242+0000","last_peered":"2024-04-24T13:33:41.434242+0000","last_clean":"2024-04-24T13:33:41.434242+0000","last_became_active":"2024-04-24T13:33:08.737722+0000","last_became_peered":"2024-04-24T13:33:08.737722+0000","last_unstale":"2024-04-24T13:33:41.434242+0000","last_undegraded":"2024-04-24T13:33:41.434242+0000","last_fullsized":"2024-04-24T13:33:41.434242+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:09:43.232587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092073+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:33:42.092073+0000","last_peered":"2024-04-24T13:33:42.092073+0000","last_clean":"2024-04-24T13:33:42.092073+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:33:42.092073+0000","last_undegraded":"2024-04-24T13:33:42.092073+0000","last_fullsized":"2024-04-24T13:33:42.092073+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"114'14","reported_seq":245,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100544+0000","last_change":"2024-04-24T13:33:09.773703+0000","last_active":"2024-04-24T13:33:42.100544+0000","last_peered":"2024-04-24T13:33:42.100544+0000","last_clean":"2024-04-24T13:33:42.100544+0000","last_became_active":"2024-04-24T13:33:08.722546+0000","last_became_peered":"2024-04-24T13:33:08.722546+0000","last_unstale":"2024-04-24T13:33:42.100544+0000","last_undegraded":"2024-04-24T13:33:42.100544+0000","last_fullsized":"2024-04-24T13:33:42.100544+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:26.369698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":195,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449646+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:33:42.449646+0000","last_peered":"2024-04-24T13:33:42.449646+0000","last_clean":"2024-04-24T13:33:42.449646+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:33:42.449646+0000","last_undegraded":"2024-04-24T13:33:42.449646+0000","last_fullsized":"2024-04-24T13:33:42.449646+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"114'17","reported_seq":218,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.447333+0000","last_change":"2024-04-24T13:30:50.981989+0000","last_active":"2024-04-24T13:33:42.447333+0000","last_peered":"2024-04-24T13:33:42.447333+0000","last_clean":"2024-04-24T13:33:42.447333+0000","last_became_active":"2024-04-24T13:30:50.939707+0000","last_became_peered":"2024-04-24T13:30:50.939707+0000","last_unstale":"2024-04-24T13:33:42.447333+0000","last_undegraded":"2024-04-24T13:33:42.447333+0000","last_fullsized":"2024-04-24T13:33:42.447333+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:38.379316+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":192,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089553+0000","last_change":"2024-04-24T13:30:50.935071+0000","last_active":"2024-04-24T13:33:42.089553+0000","last_peered":"2024-04-24T13:33:42.089553+0000","last_clean":"2024-04-24T13:33:42.089553+0000","last_became_active":"2024-04-24T13:30:50.934309+0000","last_became_peered":"2024-04-24T13:30:50.934309+0000","last_unstale":"2024-04-24T13:33:42.089553+0000","last_undegraded":"2024-04-24T13:33:42.089553+0000","last_fullsized":"2024-04-24T13:33:42.089553+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:51.520511+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"82'8","reported_seq":235,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451362+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:33:42.451362+0000","last_peered":"2024-04-24T13:33:42.451362+0000","last_clean":"2024-04-24T13:33:42.451362+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:33:42.451362+0000","last_undegraded":"2024-04-24T13:33:42.451362+0000","last_fullsized":"2024-04-24T13:33:42.451362+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"114'18","reported_seq":220,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091546+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:33:42.091546+0000","last_peered":"2024-04-24T13:33:42.091546+0000","last_clean":"2024-04-24T13:33:42.091546+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:33:42.091546+0000","last_undegraded":"2024-04-24T13:33:42.091546+0000","last_fullsized":"2024-04-24T13:33:42.091546+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":200,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100075+0000","last_change":"2024-04-24T13:30:50.921993+0000","last_active":"2024-04-24T13:33:42.100075+0000","last_peered":"2024-04-24T13:33:42.100075+0000","last_clean":"2024-04-24T13:33:42.100075+0000","last_became_active":"2024-04-24T13:30:50.921257+0000","last_became_peered":"2024-04-24T13:30:50.921257+0000","last_unstale":"2024-04-24T13:33:42.100075+0000","last_undegraded":"2024-04-24T13:33:42.100075+0000","last_fullsized":"2024-04-24T13:33:42.100075+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:36:58.034297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"114'27","reported_seq":230,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095764+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:33:42.095764+0000","last_peered":"2024-04-24T13:33:42.095764+0000","last_clean":"2024-04-24T13:33:42.095764+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:33:42.095764+0000","last_undegraded":"2024-04-24T13:33:42.095764+0000","last_fullsized":"2024-04-24T13:33:42.095764+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62357,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434225+0000","last_change":"2024-04-24T13:33:08.717844+0000","last_active":"2024-04-24T13:33:41.434225+0000","last_peered":"2024-04-24T13:33:41.434225+0000","last_clean":"2024-04-24T13:33:41.434225+0000","last_became_active":"2024-04-24T13:33:08.716627+0000","last_became_peered":"2024-04-24T13:33:08.716627+0000","last_unstale":"2024-04-24T13:33:41.434225+0000","last_undegraded":"2024-04-24T13:33:41.434225+0000","last_fullsized":"2024-04-24T13:33:41.434225+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:43.447785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":182,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091734+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:33:42.091734+0000","last_peered":"2024-04-24T13:33:42.091734+0000","last_clean":"2024-04-24T13:33:42.091734+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:33:42.091734+0000","last_undegraded":"2024-04-24T13:33:42.091734+0000","last_fullsized":"2024-04-24T13:33:42.091734+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"114'10","reported_seq":245,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099955+0000","last_change":"2024-04-24T13:30:50.917948+0000","last_active":"2024-04-24T13:33:42.099955+0000","last_peered":"2024-04-24T13:33:42.099955+0000","last_clean":"2024-04-24T13:33:42.099955+0000","last_became_active":"2024-04-24T13:30:50.917339+0000","last_became_peered":"2024-04-24T13:30:50.917339+0000","last_unstale":"2024-04-24T13:33:42.099955+0000","last_undegraded":"2024-04-24T13:33:42.099955+0000","last_fullsized":"2024-04-24T13:33:42.099955+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:36:03.041606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"114'13","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092524+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:33:42.092524+0000","last_peered":"2024-04-24T13:33:42.092524+0000","last_clean":"2024-04-24T13:33:42.092524+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:33:42.092524+0000","last_undegraded":"2024-04-24T13:33:42.092524+0000","last_fullsized":"2024-04-24T13:33:42.092524+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":195,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451132+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:33:42.451132+0000","last_peered":"2024-04-24T13:33:42.451132+0000","last_clean":"2024-04-24T13:33:42.451132+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:33:42.451132+0000","last_undegraded":"2024-04-24T13:33:42.451132+0000","last_fullsized":"2024-04-24T13:33:42.451132+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"114'22","reported_seq":56,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433168+0000","last_change":"2024-04-24T13:33:09.130597+0000","last_active":"2024-04-24T13:33:41.433168+0000","last_peered":"2024-04-24T13:33:41.433168+0000","last_clean":"2024-04-24T13:33:41.433168+0000","last_became_active":"2024-04-24T13:33:08.712750+0000","last_became_peered":"2024-04-24T13:33:08.712750+0000","last_unstale":"2024-04-24T13:33:41.433168+0000","last_undegraded":"2024-04-24T13:33:41.433168+0000","last_fullsized":"2024-04-24T13:33:41.433168+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:57.772686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":188,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096032+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:33:42.096032+0000","last_peered":"2024-04-24T13:33:42.096032+0000","last_clean":"2024-04-24T13:33:42.096032+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:33:42.096032+0000","last_undegraded":"2024-04-24T13:33:42.096032+0000","last_fullsized":"2024-04-24T13:33:42.096032+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":188,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449976+0000","last_change":"2024-04-24T13:30:50.937377+0000","last_active":"2024-04-24T13:33:42.449976+0000","last_peered":"2024-04-24T13:33:42.449976+0000","last_clean":"2024-04-24T13:33:42.449976+0000","last_became_active":"2024-04-24T13:30:50.936540+0000","last_became_peered":"2024-04-24T13:30:50.936540+0000","last_unstale":"2024-04-24T13:33:42.449976+0000","last_undegraded":"2024-04-24T13:33:42.449976+0000","last_fullsized":"2024-04-24T13:33:42.449976+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:44.053660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":198,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095391+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:33:42.095391+0000","last_peered":"2024-04-24T13:33:42.095391+0000","last_clean":"2024-04-24T13:33:42.095391+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:33:42.095391+0000","last_undegraded":"2024-04-24T13:33:42.095391+0000","last_fullsized":"2024-04-24T13:33:42.095391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"114'10","reported_seq":213,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093960+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:33:42.093960+0000","last_peered":"2024-04-24T13:33:42.093960+0000","last_clean":"2024-04-24T13:33:42.093960+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:33:42.093960+0000","last_undegraded":"2024-04-24T13:33:42.093960+0000","last_fullsized":"2024-04-24T13:33:42.093960+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":41943040,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":10,"num_write_kb":40960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":195,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094596+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:33:42.094596+0000","last_peered":"2024-04-24T13:33:42.094596+0000","last_clean":"2024-04-24T13:33:42.094596+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:33:42.094596+0000","last_undegraded":"2024-04-24T13:33:42.094596+0000","last_fullsized":"2024-04-24T13:33:42.094596+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"114'19","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096762+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:33:42.096762+0000","last_peered":"2024-04-24T13:33:42.096762+0000","last_clean":"2024-04-24T13:33:42.096762+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:33:42.096762+0000","last_undegraded":"2024-04-24T13:33:42.096762+0000","last_fullsized":"2024-04-24T13:33:42.096762+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":188,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096467+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:33:42.096467+0000","last_peered":"2024-04-24T13:33:42.096467+0000","last_clean":"2024-04-24T13:33:42.096467+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:33:42.096467+0000","last_undegraded":"2024-04-24T13:33:42.096467+0000","last_fullsized":"2024-04-24T13:33:42.096467+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":189,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433763+0000","last_change":"2024-04-24T13:30:50.929993+0000","last_active":"2024-04-24T13:33:41.433763+0000","last_peered":"2024-04-24T13:33:41.433763+0000","last_clean":"2024-04-24T13:33:41.433763+0000","last_became_active":"2024-04-24T13:30:50.929169+0000","last_became_peered":"2024-04-24T13:30:50.929169+0000","last_unstale":"2024-04-24T13:33:41.433763+0000","last_undegraded":"2024-04-24T13:33:41.433763+0000","last_fullsized":"2024-04-24T13:33:41.433763+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:38:57.047113+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"114'2","reported_seq":208,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448731+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:33:42.448731+0000","last_peered":"2024-04-24T13:33:42.448731+0000","last_clean":"2024-04-24T13:33:42.448731+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:33:42.448731+0000","last_undegraded":"2024-04-24T13:33:42.448731+0000","last_fullsized":"2024-04-24T13:33:42.448731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"114'18","reported_seq":221,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089649+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:33:42.089649+0000","last_peered":"2024-04-24T13:33:42.089649+0000","last_clean":"2024-04-24T13:33:42.089649+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:33:42.089649+0000","last_undegraded":"2024-04-24T13:33:42.089649+0000","last_fullsized":"2024-04-24T13:33:42.089649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":196,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096833+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:33:42.096833+0000","last_peered":"2024-04-24T13:33:42.096833+0000","last_clean":"2024-04-24T13:33:42.096833+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:33:42.096833+0000","last_undegraded":"2024-04-24T13:33:42.096833+0000","last_fullsized":"2024-04-24T13:33:42.096833+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":206,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094156+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:33:42.094156+0000","last_peered":"2024-04-24T13:33:42.094156+0000","last_clean":"2024-04-24T13:33:42.094156+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:33:42.094156+0000","last_undegraded":"2024-04-24T13:33:42.094156+0000","last_fullsized":"2024-04-24T13:33:42.094156+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"114'119","reported_seq":345,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450817+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:33:42.450817+0000","last_peered":"2024-04-24T13:33:42.450817+0000","last_clean":"2024-04-24T13:33:42.450817+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:33:42.450817+0000","last_undegraded":"2024-04-24T13:33:42.450817+0000","last_fullsized":"2024-04-24T13:33:42.450817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"82'6","reported_seq":42,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.432617+0000","last_change":"2024-04-24T13:33:08.908066+0000","last_active":"2024-04-24T13:33:41.432617+0000","last_peered":"2024-04-24T13:33:41.432617+0000","last_clean":"2024-04-24T13:33:41.432617+0000","last_became_active":"2024-04-24T13:33:08.706175+0000","last_became_peered":"2024-04-24T13:33:08.706175+0000","last_unstale":"2024-04-24T13:33:41.432617+0000","last_undegraded":"2024-04-24T13:33:41.432617+0000","last_fullsized":"2024-04-24T13:33:41.432617+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:13:39.788663+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1b","version":"86'4","reported_seq":216,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092529+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:33:42.092529+0000","last_peered":"2024-04-24T13:33:42.092529+0000","last_clean":"2024-04-24T13:33:42.092529+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:33:42.092529+0000","last_undegraded":"2024-04-24T13:33:42.092529+0000","last_fullsized":"2024-04-24T13:33:42.092529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"114'20","reported_seq":71,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433746+0000","last_change":"2024-04-24T13:33:09.116807+0000","last_active":"2024-04-24T13:33:41.433746+0000","last_peered":"2024-04-24T13:33:41.433746+0000","last_clean":"2024-04-24T13:33:41.433746+0000","last_became_active":"2024-04-24T13:33:08.708911+0000","last_became_peered":"2024-04-24T13:33:08.708911+0000","last_unstale":"2024-04-24T13:33:41.433746+0000","last_undegraded":"2024-04-24T13:33:41.433746+0000","last_fullsized":"2024-04-24T13:33:41.433746+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:59.171558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":73400320,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":75776,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":163,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092243+0000","last_change":"2024-04-24T13:30:50.927331+0000","last_active":"2024-04-24T13:33:42.092243+0000","last_peered":"2024-04-24T13:33:42.092243+0000","last_clean":"2024-04-24T13:33:42.092243+0000","last_became_active":"2024-04-24T13:30:50.926529+0000","last_became_peered":"2024-04-24T13:30:50.926529+0000","last_unstale":"2024-04-24T13:33:42.092243+0000","last_undegraded":"2024-04-24T13:33:42.092243+0000","last_fullsized":"2024-04-24T13:33:42.092243+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:23.529403+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.19","version":"114'24","reported_seq":56,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.432871+0000","last_change":"2024-04-24T13:33:09.934600+0000","last_active":"2024-04-24T13:33:41.432871+0000","last_peered":"2024-04-24T13:33:41.432871+0000","last_clean":"2024-04-24T13:33:41.432871+0000","last_became_active":"2024-04-24T13:33:08.732254+0000","last_became_peered":"2024-04-24T13:33:08.732254+0000","last_unstale":"2024-04-24T13:33:41.432871+0000","last_undegraded":"2024-04-24T13:33:41.432871+0000","last_fullsized":"2024-04-24T13:33:41.432871+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:35.846866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091424+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:33:42.091424+0000","last_peered":"2024-04-24T13:33:42.091424+0000","last_clean":"2024-04-24T13:33:42.091424+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:33:42.091424+0000","last_undegraded":"2024-04-24T13:33:42.091424+0000","last_fullsized":"2024-04-24T13:33:42.091424+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":164,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.099929+0000","last_change":"2024-04-24T13:30:50.922108+0000","last_active":"2024-04-24T13:33:42.099929+0000","last_peered":"2024-04-24T13:33:42.099929+0000","last_clean":"2024-04-24T13:33:42.099929+0000","last_became_active":"2024-04-24T13:30:50.921514+0000","last_became_peered":"2024-04-24T13:30:50.921514+0000","last_unstale":"2024-04-24T13:33:42.099929+0000","last_undegraded":"2024-04-24T13:33:42.099929+0000","last_fullsized":"2024-04-24T13:33:42.099929+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:11:05.867839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1a","version":"105'6","reported_seq":88,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449212+0000","last_change":"2024-04-24T13:32:32.751387+0000","last_active":"2024-04-24T13:33:42.449212+0000","last_peered":"2024-04-24T13:33:42.449212+0000","last_clean":"2024-04-24T13:33:42.449212+0000","last_became_active":"2024-04-24T13:32:32.741990+0000","last_became_peered":"2024-04-24T13:32:32.741990+0000","last_unstale":"2024-04-24T13:33:42.449212+0000","last_undegraded":"2024-04-24T13:33:42.449212+0000","last_fullsized":"2024-04-24T13:33:42.449212+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:49.789798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"114'18","reported_seq":222,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435388+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:33:41.435388+0000","last_peered":"2024-04-24T13:33:41.435388+0000","last_clean":"2024-04-24T13:33:41.435388+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:33:41.435388+0000","last_undegraded":"2024-04-24T13:33:41.435388+0000","last_fullsized":"2024-04-24T13:33:41.435388+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433363+0000","last_change":"2024-04-24T13:33:08.705125+0000","last_active":"2024-04-24T13:33:41.433363+0000","last_peered":"2024-04-24T13:33:41.433363+0000","last_clean":"2024-04-24T13:33:41.433363+0000","last_became_active":"2024-04-24T13:33:08.704735+0000","last_became_peered":"2024-04-24T13:33:08.704735+0000","last_unstale":"2024-04-24T13:33:41.433363+0000","last_undegraded":"2024-04-24T13:33:41.433363+0000","last_fullsized":"2024-04-24T13:33:41.433363+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:14.183681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"114'17","reported_seq":215,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091026+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:33:42.091026+0000","last_peered":"2024-04-24T13:33:42.091026+0000","last_clean":"2024-04-24T13:33:42.091026+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:33:42.091026+0000","last_undegraded":"2024-04-24T13:33:42.091026+0000","last_fullsized":"2024-04-24T13:33:42.091026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":192,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449245+0000","last_change":"2024-04-24T13:30:50.938940+0000","last_active":"2024-04-24T13:33:42.449245+0000","last_peered":"2024-04-24T13:33:42.449245+0000","last_clean":"2024-04-24T13:33:42.449245+0000","last_became_active":"2024-04-24T13:30:50.936355+0000","last_became_peered":"2024-04-24T13:30:50.936355+0000","last_unstale":"2024-04-24T13:33:42.449245+0000","last_undegraded":"2024-04-24T13:33:42.449245+0000","last_fullsized":"2024-04-24T13:33:42.449245+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":182,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092069+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:33:42.092069+0000","last_peered":"2024-04-24T13:33:42.092069+0000","last_clean":"2024-04-24T13:33:42.092069+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:33:42.092069+0000","last_undegraded":"2024-04-24T13:33:42.092069+0000","last_fullsized":"2024-04-24T13:33:42.092069+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"105'10","reported_seq":180,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433477+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:33:41.433477+0000","last_peered":"2024-04-24T13:33:41.433477+0000","last_clean":"2024-04-24T13:33:41.433477+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:33:41.433477+0000","last_undegraded":"2024-04-24T13:33:41.433477+0000","last_fullsized":"2024-04-24T13:33:41.433477+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"114'15","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093312+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:33:42.093312+0000","last_peered":"2024-04-24T13:33:42.093312+0000","last_clean":"2024-04-24T13:33:42.093312+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:33:42.093312+0000","last_undegraded":"2024-04-24T13:33:42.093312+0000","last_fullsized":"2024-04-24T13:33:42.093312+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":195,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091193+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:33:42.091193+0000","last_peered":"2024-04-24T13:33:42.091193+0000","last_clean":"2024-04-24T13:33:42.091193+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:33:42.091193+0000","last_undegraded":"2024-04-24T13:33:42.091193+0000","last_fullsized":"2024-04-24T13:33:42.091193+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"114'12","reported_seq":109,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448280+0000","last_change":"2024-04-24T13:32:01.553569+0000","last_active":"2024-04-24T13:33:42.448280+0000","last_peered":"2024-04-24T13:33:42.448280+0000","last_clean":"2024-04-24T13:33:42.448280+0000","last_became_active":"2024-04-24T13:32:01.547833+0000","last_became_peered":"2024-04-24T13:32:01.547833+0000","last_unstale":"2024-04-24T13:33:42.448280+0000","last_undegraded":"2024-04-24T13:33:42.448280+0000","last_fullsized":"2024-04-24T13:33:42.448280+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:10.789162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092086+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:33:42.092086+0000","last_peered":"2024-04-24T13:33:42.092086+0000","last_clean":"2024-04-24T13:33:42.092086+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:33:42.092086+0000","last_undegraded":"2024-04-24T13:33:42.092086+0000","last_fullsized":"2024-04-24T13:33:42.092086+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"82'2","reported_seq":167,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096419+0000","last_change":"2024-04-24T13:30:50.939033+0000","last_active":"2024-04-24T13:33:42.096419+0000","last_peered":"2024-04-24T13:33:42.096419+0000","last_clean":"2024-04-24T13:33:42.096419+0000","last_became_active":"2024-04-24T13:30:50.938747+0000","last_became_peered":"2024-04-24T13:30:50.938747+0000","last_unstale":"2024-04-24T13:33:42.096419+0000","last_undegraded":"2024-04-24T13:33:42.096419+0000","last_fullsized":"2024-04-24T13:33:42.096419+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:19:48.546868+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.18","version":"82'4","reported_seq":216,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091834+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:33:42.091834+0000","last_peered":"2024-04-24T13:33:42.091834+0000","last_clean":"2024-04-24T13:33:42.091834+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:33:42.091834+0000","last_undegraded":"2024-04-24T13:33:42.091834+0000","last_fullsized":"2024-04-24T13:33:42.091834+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"114'13","reported_seq":126,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449225+0000","last_change":"2024-04-24T13:33:09.073468+0000","last_active":"2024-04-24T13:33:42.449225+0000","last_peered":"2024-04-24T13:33:42.449225+0000","last_clean":"2024-04-24T13:33:42.449225+0000","last_became_active":"2024-04-24T13:33:08.725822+0000","last_became_peered":"2024-04-24T13:33:08.725822+0000","last_unstale":"2024-04-24T13:33:42.449225+0000","last_undegraded":"2024-04-24T13:33:42.449225+0000","last_fullsized":"2024-04-24T13:33:42.449225+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:24:41.185601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":215,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090741+0000","last_change":"2024-04-24T13:33:09.078708+0000","last_active":"2024-04-24T13:33:42.090741+0000","last_peered":"2024-04-24T13:33:42.090741+0000","last_clean":"2024-04-24T13:33:42.090741+0000","last_became_active":"2024-04-24T13:33:08.726873+0000","last_became_peered":"2024-04-24T13:33:08.726873+0000","last_unstale":"2024-04-24T13:33:42.090741+0000","last_undegraded":"2024-04-24T13:33:42.090741+0000","last_fullsized":"2024-04-24T13:33:42.090741+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:53:23.482374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"114'16","reported_seq":244,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092592+0000","last_change":"2024-04-24T13:33:09.087185+0000","last_active":"2024-04-24T13:33:42.092592+0000","last_peered":"2024-04-24T13:33:42.092592+0000","last_clean":"2024-04-24T13:33:42.092592+0000","last_became_active":"2024-04-24T13:33:08.726347+0000","last_became_peered":"2024-04-24T13:33:08.726347+0000","last_unstale":"2024-04-24T13:33:42.092592+0000","last_undegraded":"2024-04-24T13:33:42.092592+0000","last_fullsized":"2024-04-24T13:33:42.092592+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:37.412890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":187,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089439+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:33:42.089439+0000","last_peered":"2024-04-24T13:33:42.089439+0000","last_clean":"2024-04-24T13:33:42.089439+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:33:42.089439+0000","last_undegraded":"2024-04-24T13:33:42.089439+0000","last_fullsized":"2024-04-24T13:33:42.089439+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":183,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092415+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:33:42.092415+0000","last_peered":"2024-04-24T13:33:42.092415+0000","last_clean":"2024-04-24T13:33:42.092415+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:33:42.092415+0000","last_undegraded":"2024-04-24T13:33:42.092415+0000","last_fullsized":"2024-04-24T13:33:42.092415+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"114'8","reported_seq":232,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096078+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:33:42.096078+0000","last_peered":"2024-04-24T13:33:42.096078+0000","last_clean":"2024-04-24T13:33:42.096078+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:33:42.096078+0000","last_undegraded":"2024-04-24T13:33:42.096078+0000","last_fullsized":"2024-04-24T13:33:42.096078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":40,"num_read_kb":40,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"114'11","reported_seq":214,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449196+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:33:42.449196+0000","last_peered":"2024-04-24T13:33:42.449196+0000","last_clean":"2024-04-24T13:33:42.449196+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:33:42.449196+0000","last_undegraded":"2024-04-24T13:33:42.449196+0000","last_fullsized":"2024-04-24T13:33:42.449196+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"105'12","reported_seq":240,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096773+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:33:42.096773+0000","last_peered":"2024-04-24T13:33:42.096773+0000","last_clean":"2024-04-24T13:33:42.096773+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:33:42.096773+0000","last_undegraded":"2024-04-24T13:33:42.096773+0000","last_fullsized":"2024-04-24T13:33:42.096773+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"113'13","reported_seq":243,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.447768+0000","last_change":"2024-04-24T13:33:09.324802+0000","last_active":"2024-04-24T13:33:42.447768+0000","last_peered":"2024-04-24T13:33:42.447768+0000","last_clean":"2024-04-24T13:33:42.447768+0000","last_became_active":"2024-04-24T13:33:08.725876+0000","last_became_peered":"2024-04-24T13:33:08.725876+0000","last_unstale":"2024-04-24T13:33:42.447768+0000","last_undegraded":"2024-04-24T13:33:42.447768+0000","last_fullsized":"2024-04-24T13:33:42.447768+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:21:58.951897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":54525952,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"82'2","reported_seq":42,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.434558+0000","last_change":"2024-04-24T13:33:10.580909+0000","last_active":"2024-04-24T13:33:41.434558+0000","last_peered":"2024-04-24T13:33:41.434558+0000","last_clean":"2024-04-24T13:33:41.434558+0000","last_became_active":"2024-04-24T13:33:08.735041+0000","last_became_peered":"2024-04-24T13:33:08.735041+0000","last_unstale":"2024-04-24T13:33:41.434558+0000","last_undegraded":"2024-04-24T13:33:41.434558+0000","last_fullsized":"2024-04-24T13:33:41.434558+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:43:23.330340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"114'19","reported_seq":70,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433819+0000","last_change":"2024-04-24T13:33:09.548908+0000","last_active":"2024-04-24T13:33:41.433819+0000","last_peered":"2024-04-24T13:33:41.433819+0000","last_clean":"2024-04-24T13:33:41.433819+0000","last_became_active":"2024-04-24T13:33:08.720010+0000","last_became_peered":"2024-04-24T13:33:08.720010+0000","last_unstale":"2024-04-24T13:33:41.433819+0000","last_undegraded":"2024-04-24T13:33:41.433819+0000","last_fullsized":"2024-04-24T13:33:41.433819+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:06.195033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"114'12","reported_seq":242,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.095205+0000","last_change":"2024-04-24T13:30:50.918913+0000","last_active":"2024-04-24T13:33:42.095205+0000","last_peered":"2024-04-24T13:33:42.095205+0000","last_clean":"2024-04-24T13:33:42.095205+0000","last_became_active":"2024-04-24T13:30:50.918221+0000","last_became_peered":"2024-04-24T13:30:50.918221+0000","last_unstale":"2024-04-24T13:33:42.095205+0000","last_undegraded":"2024-04-24T13:33:42.095205+0000","last_fullsized":"2024-04-24T13:33:42.095205+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:43.128644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"114'21","reported_seq":224,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.089841+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:33:42.089841+0000","last_peered":"2024-04-24T13:33:42.089841+0000","last_clean":"2024-04-24T13:33:42.089841+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:33:42.089841+0000","last_undegraded":"2024-04-24T13:33:42.089841+0000","last_fullsized":"2024-04-24T13:33:42.089841+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"82'2","reported_seq":211,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093587+0000","last_change":"2024-04-24T13:30:50.926509+0000","last_active":"2024-04-24T13:33:42.093587+0000","last_peered":"2024-04-24T13:33:42.093587+0000","last_clean":"2024-04-24T13:33:42.093587+0000","last_became_active":"2024-04-24T13:30:50.925894+0000","last_became_peered":"2024-04-24T13:30:50.925894+0000","last_unstale":"2024-04-24T13:33:42.093587+0000","last_undegraded":"2024-04-24T13:33:42.093587+0000","last_fullsized":"2024-04-24T13:33:42.093587+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"114'15","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.096369+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:33:42.096369+0000","last_peered":"2024-04-24T13:33:42.096369+0000","last_clean":"2024-04-24T13:33:42.096369+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:33:42.096369+0000","last_undegraded":"2024-04-24T13:33:42.096369+0000","last_fullsized":"2024-04-24T13:33:42.096369+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"81'2","reported_seq":208,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093855+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:33:42.093855+0000","last_peered":"2024-04-24T13:33:42.093855+0000","last_clean":"2024-04-24T13:33:42.093855+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:33:42.093855+0000","last_undegraded":"2024-04-24T13:33:42.093855+0000","last_fullsized":"2024-04-24T13:33:42.093855+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"114'14","reported_seq":218,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.097191+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:33:42.097191+0000","last_peered":"2024-04-24T13:33:42.097191+0000","last_clean":"2024-04-24T13:33:42.097191+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:33:42.097191+0000","last_undegraded":"2024-04-24T13:33:42.097191+0000","last_fullsized":"2024-04-24T13:33:42.097191+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"105'10","reported_seq":228,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094123+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:33:42.094123+0000","last_peered":"2024-04-24T13:33:42.094123+0000","last_clean":"2024-04-24T13:33:42.094123+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:33:42.094123+0000","last_undegraded":"2024-04-24T13:33:42.094123+0000","last_fullsized":"2024-04-24T13:33:42.094123+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":46,"num_read_kb":42,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"114'18","reported_seq":226,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.451095+0000","last_change":"2024-04-24T13:30:50.956474+0000","last_active":"2024-04-24T13:33:42.451095+0000","last_peered":"2024-04-24T13:33:42.451095+0000","last_clean":"2024-04-24T13:33:42.451095+0000","last_became_active":"2024-04-24T13:30:50.955801+0000","last_became_peered":"2024-04-24T13:30:50.955801+0000","last_unstale":"2024-04-24T13:33:42.451095+0000","last_undegraded":"2024-04-24T13:33:42.451095+0000","last_fullsized":"2024-04-24T13:33:42.451095+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:41.114080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":199,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.449072+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:33:42.449072+0000","last_peered":"2024-04-24T13:33:42.449072+0000","last_clean":"2024-04-24T13:33:42.449072+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:33:42.449072+0000","last_undegraded":"2024-04-24T13:33:42.449072+0000","last_fullsized":"2024-04-24T13:33:42.449072+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"113'12","reported_seq":214,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091189+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:33:42.091189+0000","last_peered":"2024-04-24T13:33:42.091189+0000","last_clean":"2024-04-24T13:33:42.091189+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:33:42.091189+0000","last_undegraded":"2024-04-24T13:33:42.091189+0000","last_fullsized":"2024-04-24T13:33:42.091189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":12,"num_write_kb":49152,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"105'8","reported_seq":234,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100563+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:33:42.100563+0000","last_peered":"2024-04-24T13:33:42.100563+0000","last_clean":"2024-04-24T13:33:42.100563+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:33:42.100563+0000","last_undegraded":"2024-04-24T13:33:42.100563+0000","last_fullsized":"2024-04-24T13:33:42.100563+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"114'15","reported_seq":64,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.432251+0000","last_change":"2024-04-24T13:33:09.287304+0000","last_active":"2024-04-24T13:33:41.432251+0000","last_peered":"2024-04-24T13:33:41.432251+0000","last_clean":"2024-04-24T13:33:41.432251+0000","last_became_active":"2024-04-24T13:33:08.716282+0000","last_became_peered":"2024-04-24T13:33:08.716282+0000","last_unstale":"2024-04-24T13:33:41.432251+0000","last_undegraded":"2024-04-24T13:33:41.432251+0000","last_fullsized":"2024-04-24T13:33:41.432251+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":15,"num_write_kb":61440,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":217,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094542+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:33:42.094542+0000","last_peered":"2024-04-24T13:33:42.094542+0000","last_clean":"2024-04-24T13:33:42.094542+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:33:42.094542+0000","last_undegraded":"2024-04-24T13:33:42.094542+0000","last_fullsized":"2024-04-24T13:33:42.094542+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"114'20","reported_seq":222,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094733+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:33:42.094733+0000","last_peered":"2024-04-24T13:33:42.094733+0000","last_clean":"2024-04-24T13:33:42.094733+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:33:42.094733+0000","last_undegraded":"2024-04-24T13:33:42.094733+0000","last_fullsized":"2024-04-24T13:33:42.094733+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":200,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448413+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:33:42.448413+0000","last_peered":"2024-04-24T13:33:42.448413+0000","last_clean":"2024-04-24T13:33:42.448413+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:33:42.448413+0000","last_undegraded":"2024-04-24T13:33:42.448413+0000","last_fullsized":"2024-04-24T13:33:42.448413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"114'14","reported_seq":59,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.433389+0000","last_change":"2024-04-24T13:33:10.576425+0000","last_active":"2024-04-24T13:33:41.433389+0000","last_peered":"2024-04-24T13:33:41.433389+0000","last_clean":"2024-04-24T13:33:41.433389+0000","last_became_active":"2024-04-24T13:33:08.734588+0000","last_became_peered":"2024-04-24T13:33:08.734588+0000","last_unstale":"2024-04-24T13:33:41.433389+0000","last_undegraded":"2024-04-24T13:33:41.433389+0000","last_fullsized":"2024-04-24T13:33:41.433389+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:05:17.557507+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":50331648,"num_objects":12,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":12,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":24,"num_write_kb":53248,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"82'6","reported_seq":225,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.094340+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:33:42.094340+0000","last_peered":"2024-04-24T13:33:42.094340+0000","last_clean":"2024-04-24T13:33:42.094340+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:33:42.094340+0000","last_undegraded":"2024-04-24T13:33:42.094340+0000","last_fullsized":"2024-04-24T13:33:42.094340+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"113'17","reported_seq":225,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.090033+0000","last_change":"2024-04-24T13:30:50.920564+0000","last_active":"2024-04-24T13:33:42.090033+0000","last_peered":"2024-04-24T13:33:42.090033+0000","last_clean":"2024-04-24T13:33:42.090033+0000","last_became_active":"2024-04-24T13:30:50.920252+0000","last_became_peered":"2024-04-24T13:30:50.920252+0000","last_unstale":"2024-04-24T13:33:42.090033+0000","last_undegraded":"2024-04-24T13:33:42.090033+0000","last_fullsized":"2024-04-24T13:33:42.090033+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:59:29.646530+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69206016,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"82'2","reported_seq":184,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092246+0000","last_change":"2024-04-24T13:33:09.090089+0000","last_active":"2024-04-24T13:33:42.092246+0000","last_peered":"2024-04-24T13:33:42.092246+0000","last_clean":"2024-04-24T13:33:42.092246+0000","last_became_active":"2024-04-24T13:33:08.720538+0000","last_became_peered":"2024-04-24T13:33:08.720538+0000","last_unstale":"2024-04-24T13:33:42.092246+0000","last_undegraded":"2024-04-24T13:33:42.092246+0000","last_fullsized":"2024-04-24T13:33:42.092246+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:30.442779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2c","version":"114'22","reported_seq":225,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.450695+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:33:42.450695+0000","last_peered":"2024-04-24T13:33:42.450695+0000","last_clean":"2024-04-24T13:33:42.450695+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:33:42.450695+0000","last_undegraded":"2024-04-24T13:33:42.450695+0000","last_fullsized":"2024-04-24T13:33:42.450695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"82'4","reported_seq":216,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.091108+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:33:42.091108+0000","last_peered":"2024-04-24T13:33:42.091108+0000","last_clean":"2024-04-24T13:33:42.091108+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:33:42.091108+0000","last_undegraded":"2024-04-24T13:33:42.091108+0000","last_fullsized":"2024-04-24T13:33:42.091108+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"114'13","reported_seq":179,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448490+0000","last_change":"2024-04-24T13:30:50.936271+0000","last_active":"2024-04-24T13:33:42.448490+0000","last_peered":"2024-04-24T13:33:42.448490+0000","last_clean":"2024-04-24T13:33:42.448490+0000","last_became_active":"2024-04-24T13:30:50.935833+0000","last_became_peered":"2024-04-24T13:30:50.935833+0000","last_unstale":"2024-04-24T13:33:42.448490+0000","last_undegraded":"2024-04-24T13:33:42.448490+0000","last_fullsized":"2024-04-24T13:33:42.448490+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:04.149889+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":52428800,"num_objects":13,"num_object_clones":0,"num_object_copies":26,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":13,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":13,"num_write_kb":51200,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.29","version":"82'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.093884+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:33:42.093884+0000","last_peered":"2024-04-24T13:33:42.093884+0000","last_clean":"2024-04-24T13:33:42.093884+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:33:42.093884+0000","last_undegraded":"2024-04-24T13:33:42.093884+0000","last_fullsized":"2024-04-24T13:33:42.093884+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"114'11","reported_seq":215,"reported_epoch":119,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.448914+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:33:42.448914+0000","last_peered":"2024-04-24T13:33:42.448914+0000","last_clean":"2024-04-24T13:33:42.448914+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:33:42.448914+0000","last_undegraded":"2024-04-24T13:33:42.448914+0000","last_fullsized":"2024-04-24T13:33:42.448914+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46137344,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":11,"num_write_kb":45056,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":162,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092316+0000","last_change":"2024-04-24T13:30:50.913925+0000","last_active":"2024-04-24T13:33:42.092316+0000","last_peered":"2024-04-24T13:33:42.092316+0000","last_clean":"2024-04-24T13:33:42.092316+0000","last_became_active":"2024-04-24T13:30:50.913630+0000","last_became_peered":"2024-04-24T13:30:50.913630+0000","last_unstale":"2024-04-24T13:33:42.092316+0000","last_undegraded":"2024-04-24T13:33:42.092316+0000","last_fullsized":"2024-04-24T13:33:42.092316+0000","mapping_epoch":41,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":42,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:46:45.481646+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2f","version":"114'17","reported_seq":65,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435180+0000","last_change":"2024-04-24T13:33:09.790363+0000","last_active":"2024-04-24T13:33:41.435180+0000","last_peered":"2024-04-24T13:33:41.435180+0000","last_clean":"2024-04-24T13:33:41.435180+0000","last_became_active":"2024-04-24T13:33:08.724714+0000","last_became_peered":"2024-04-24T13:33:08.724714+0000","last_unstale":"2024-04-24T13:33:41.435180+0000","last_undegraded":"2024-04-24T13:33:41.435180+0000","last_fullsized":"2024-04-24T13:33:41.435180+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:28.428215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"113'14","reported_seq":64,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.432926+0000","last_change":"2024-04-24T13:33:10.398117+0000","last_active":"2024-04-24T13:33:41.432926+0000","last_peered":"2024-04-24T13:33:41.432926+0000","last_clean":"2024-04-24T13:33:41.432926+0000","last_became_active":"2024-04-24T13:33:08.735696+0000","last_became_peered":"2024-04-24T13:33:08.735696+0000","last_unstale":"2024-04-24T13:33:41.432926+0000","last_undegraded":"2024-04-24T13:33:41.432926+0000","last_fullsized":"2024-04-24T13:33:41.432926+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:01:26.139144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"82'2","reported_seq":207,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.100402+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:33:42.100402+0000","last_peered":"2024-04-24T13:33:42.100402+0000","last_clean":"2024-04-24T13:33:42.100402+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:33:42.100402+0000","last_undegraded":"2024-04-24T13:33:42.100402+0000","last_fullsized":"2024-04-24T13:33:42.100402+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"114'7","reported_seq":211,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:42.092095+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:33:42.092095+0000","last_peered":"2024-04-24T13:33:42.092095+0000","last_clean":"2024-04-24T13:33:42.092095+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:33:42.092095+0000","last_undegraded":"2024-04-24T13:33:42.092095+0000","last_fullsized":"2024-04-24T13:33:42.092095+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":29360128,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":7,"num_write_kb":28672,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"82'6","reported_seq":46,"reported_epoch":118,"state":"active+clean","last_fresh":"2024-04-24T13:33:41.435047+0000","last_change":"2024-04-24T13:33:09.917888+0000","last_active":"2024-04-24T13:33:41.435047+0000","last_peered":"2024-04-24T13:33:41.435047+0000","last_clean":"2024-04-24T13:33:41.435047+0000","last_became_active":"2024-04-24T13:33:08.732489+0000","last_became_peered":"2024-04-24T13:33:08.732489+0000","last_unstale":"2024-04-24T13:33:41.435047+0000","last_undegraded":"2024-04-24T13:33:41.435047+0000","last_fullsized":"2024-04-24T13:33:41.435047+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:16.213872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":325,"num_read_kb":307,"num_write":271,"num_write_kb":78,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":194,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":111,"ondisk_log_size":111,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":960,"ondisk_log_size":960,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":262298,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":822,"num_read_kb":584,"num_write":457,"num_write_kb":299,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":117,"num_bytes_recovered":61779,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":839680,"data_stored":478238,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":712,"ondisk_log_size":712,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":289,"num_read_kb":289,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2233,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1344,"num_read_kb":1316,"num_write":284,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":270,"ondisk_log_size":270,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":4206886912,"num_objects":1005,"num_object_clones":0,"num_object_copies":2010,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1005,"num_whiteouts":0,"num_read":28,"num_read_kb":21,"num_write":1089,"num_write_kb":4136960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":133,"num_bytes_recovered":543162368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8413773824,"data_stored":8413773824,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1019,"ondisk_log_size":1019,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":590368,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":0,"seq":55834574894,"num_pgs":0,"num_osds":0,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":0,"kb_used":0,"kb_used_data":0,"kb_used_omap":0,"kb_used_meta":0,"kb_avail":0,"statfs":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574894,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1161604,"kb_used_data":1130424,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93210236,"statfs":{"total":96636764160,"available":95447281664,"internally_reserved":0,"allocated":1157554176,"data_stored":1156953569,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574895,"num_pgs":73,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1370284,"kb_used_data":1334944,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93001556,"statfs":{"total":96636764160,"available":95233593344,"internally_reserved":0,"allocated":1366982656,"data_stored":1366322075,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574895,"num_pgs":80,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1447736,"kb_used_data":1416556,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92924104,"statfs":{"total":96636764160,"available":95154282496,"internally_reserved":0,"allocated":1450553344,"data_stored":1449964089,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574894,"num_pgs":86,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1382320,"kb_used_data":1351136,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92989520,"statfs":{"total":96636764160,"available":95221268480,"internally_reserved":0,"allocated":1383563264,"data_stored":1382923853,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":31914439},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574895,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":948084,"kb_used_data":916896,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93423756,"statfs":{"total":96636764160,"available":95665926144,"internally_reserved":0,"allocated":938901504,"data_stored":938276105,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574896,"num_pgs":72,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":796756,"kb_used_data":761412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93575084,"statfs":{"total":96636764160,"available":95820886016,"internally_reserved":0,"allocated":779685888,"data_stored":779053270,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574895,"num_pgs":79,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1347976,"kb_used_data":1316796,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93023864,"statfs":{"total":96636764160,"available":95256436736,"internally_reserved":0,"allocated":1348399104,"data_stored":1347794914,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1346371584,"data_stored":1346371584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":778043392,"data_stored":778043392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":937426944,"data_stored":937426944,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":1382023168,"data_stored":1382023168,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1449132032,"data_stored":1449132032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":1365245952,"data_stored":1365245952,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1155530752,"data_stored":1155530752,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":229376,"data_stored":176486,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":45056,"data_stored":1657,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":122880,"data_stored":60796,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":303104,"data_stored":235024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":924,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:33:47.309 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-24T13:33:47.309 INFO:tasks.thrashosds.thrasher:choose_action: min_in 4 min_out 0 min_live 2 min_dead 0 chance_down 0.40 2024-04-24T13:33:47.309 INFO:tasks.thrashosds.thrasher:Adding osd 7 2024-04-24T13:33:47.309 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd in 7 2024-04-24T13:33:47.311 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:47.310+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:47.312 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:47.312 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2207 3.38 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 79.006930083, 2024-04-24T13:33:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022686873999999999, 2024-04-24T13:33:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.313 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2207 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302499+0000", 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307861+0000", 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053622089999999997 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307899+0000", 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978999999999997e-05 2024-04-24T13:33:47.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307917+0000", 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8576999999999998e-05 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308018+0000", 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010080499999999999 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308202+0000", 2024-04-24T13:33:47.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000183628 2024-04-24T13:33:47.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:47.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308352+0000", 2024-04-24T13:33:47.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149806 2024-04-24T13:33:47.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318520+0000", 2024-04-24T13:33:47.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010168744 2024-04-24T13:33:47.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.324908+0000", 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063874739999999998 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325063+0000", 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155131 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325182+0000", 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011915499999999999 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.318 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 78.983335370000006, 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.319 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.321 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:47.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:33:47.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 78.838279516, 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:33:47.324 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:47.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:33:47.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:33:47.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:33:47.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:33:47.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:33:47.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:33:47.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:33:47.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2242 3.b 3:d16b554f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 78.569780584, 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022940439, 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.330 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2242 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739648+0000", 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.785e-06 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741765+0000", 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002117655 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741781+0000", 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6062e-05 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741792+0000", 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0937999999999999e-05 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741918+0000", 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623199999999999 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742189+0000", 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027047300000000002 2024-04-24T13:33:47.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742430+0000", 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024077699999999999 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752990+0000", 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010559875 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762422+0000", 2024-04-24T13:33:47.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094325120000000005 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762510+0000", 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7879000000000003e-05 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762585+0000", 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5251000000000002e-05 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2662 3.33 3:ce195145:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.180862277000003, 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028670389000000001, 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2662 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128567+0000", 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4640000000000002e-06 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130845+0000", 2024-04-24T13:33:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002278389 2024-04-24T13:33:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130869+0000", 2024-04-24T13:33:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4394999999999999e-05 2024-04-24T13:33:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130879+0000", 2024-04-24T13:33:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0000000000000001e-05 2024-04-24T13:33:47.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130957+0000", 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7968999999999998e-05 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130963+0000", 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2499999999999997e-06 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137507+0000", 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065442900000000003 2024-04-24T13:33:47.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137607+0000", 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010002599999999999 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137727+0000", 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120142 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152307+0000", 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01458017 2024-04-24T13:33:47.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157112+0000", 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048051350000000003 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157181+0000", 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9051e-05 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157233+0000", 2024-04-24T13:33:47.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2108000000000003e-05 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2676 3.22 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 42.037660369000001, 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025889562000000001, 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.342 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2676 2024-04-24T13:33:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271767+0000", 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.273986+0000", 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022195560000000001 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274011+0000", 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4953e-05 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274023+0000", 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1856e-05 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274116+0000", 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3168e-05 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274377+0000", 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026071500000000001 2024-04-24T13:33:47.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274531+0000", 2024-04-24T13:33:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015427299999999999 2024-04-24T13:33:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297124+0000", 2024-04-24T13:33:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022592476 2024-04-24T13:33:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297544+0000", 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000420691 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297605+0000", 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0888999999999999e-05 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297655+0000", 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9119999999999997e-05 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.347 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2722 3.25 e101/20 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head v 101'6, mlcod=86'4)", 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.665915087999998, 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023380372, 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643511+0000", 2024-04-24T13:33:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4400000000000001e-07 2024-04-24T13:33:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647450+0000", 2024-04-24T13:33:47.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039389259999999997 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647470+0000", 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0534e-05 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647484+0000", 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3370000000000001e-05 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647599+0000", 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115513 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647629+0000", 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0145e-05 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666761+0000", 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019132303999999999 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666891+0000", 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012913599999999999 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2747 3.24 3:2754d069:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.411365226000001, 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024857536999999999, 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.352 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2747 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:47.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898063+0000", 2024-04-24T13:33:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5289999999999998e-06 2024-04-24T13:33:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899956+0000", 2024-04-24T13:33:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932759999999999 2024-04-24T13:33:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899984+0000", 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7801999999999999e-05 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899997+0000", 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3127e-05 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900063+0000", 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900200+0000", 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000137324 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900302+0000", 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010168 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.908151+0000", 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078489579999999996 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922784+0000", 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014633116 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922860+0000", 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5708000000000001e-05 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922918+0000", 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7686000000000003e-05 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.357 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2754 3.b 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 41.330895726000001, 2024-04-24T13:33:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.032358206, 2024-04-24T13:33:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.358 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2754 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978532+0000", 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6079999999999998e-06 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979768+0000", 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012357869999999999 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979791+0000", 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3224e-05 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979804+0000", 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.274e-05 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979889+0000", 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5483999999999997e-05 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980063+0000", 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017384599999999999 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980227+0000", 2024-04-24T13:33:47.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163764 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987774+0000", 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075472029999999997 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010776+0000", 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023001886999999999 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010838+0000", 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1527999999999998e-05 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010888+0000", 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0135e-05 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2811 3.7 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.739256894, 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044582597000000002, 2024-04-24T13:33:47.363 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2811 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570171+0000", 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9100000000000001e-06 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580122+0000", 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099505930000000006 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580150+0000", 2024-04-24T13:33:47.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7827e-05 2024-04-24T13:33:47.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580164+0000", 2024-04-24T13:33:47.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4547e-05 2024-04-24T13:33:47.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580245+0000", 2024-04-24T13:33:47.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0810999999999996e-05 2024-04-24T13:33:47.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580355+0000", 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109656 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580475+0000", 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120278 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607433+0000", 2024-04-24T13:33:47.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026957894 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614636+0000", 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072028359999999998 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614703+0000", 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7645999999999996e-05 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614751+0000", 2024-04-24T13:33:47.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7599000000000003e-05 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2812 3.1e 3:7bd62ca6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 40.729213014000003, 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.038041177000000002, 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.369 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2812 2024-04-24T13:33:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580214+0000", 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.708e-06 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582574+0000", 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023601799999999999 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582591+0000", 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6648999999999999e-05 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582598+0000", 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.391e-06 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583731+0000", 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011332029999999999 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583843+0000", 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111889 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583936+0000", 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2968999999999997e-05 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.599363+0000", 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015427186000000001 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618143+0000", 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018779051000000001 2024-04-24T13:33:47.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618200+0000", 2024-04-24T13:33:47.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7151999999999998e-05 2024-04-24T13:33:47.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618253+0000", 2024-04-24T13:33:47.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3798999999999998e-05 2024-04-24T13:33:47.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.374 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.374 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.375 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3110 3.1e 3:79ca4af0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:47.375 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:47.375 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.510154814, 2024-04-24T13:33:47.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022894164000000002, 2024-04-24T13:33:47.375 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.375 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.375 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.375 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.375 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.375 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.375 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3110 2024-04-24T13:33:47.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.376 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:47.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:47.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799272+0000", 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9470000000000002e-06 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800698+0000", 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001425204 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800721+0000", 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3577000000000001e-05 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800731+0000", 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9969999999999993e-06 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800797+0000", 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6087999999999995e-05 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800954+0000", 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015699 2024-04-24T13:33:47.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.801064+0000", 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109715 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.807584+0000", 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065197479999999997 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822063+0000", 2024-04-24T13:33:47.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014479156999999999 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822122+0000", 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9095000000000003e-05 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822165+0000", 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2645999999999998e-05 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3117 3.27 3:e455931d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.438796784000001, 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02353235, 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3117 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.381 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:47.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:47.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870631+0000", 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.075e-06 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872287+0000", 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016561449999999999 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872316+0000", 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9543000000000002e-05 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872333+0000", 2024-04-24T13:33:47.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6806000000000001e-05 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872403+0000", 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9917000000000002e-05 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872540+0000", 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013735200000000001 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872686+0000", 2024-04-24T13:33:47.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014519899999999999 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.878440+0000", 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057539490000000004 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894072+0000", 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015632801000000002 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894106+0000", 2024-04-24T13:33:47.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3933999999999997e-05 2024-04-24T13:33:47.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894161+0000", 2024-04-24T13:33:47.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4629000000000002e-05 2024-04-24T13:33:47.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.386 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.386 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.386 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3127 3.15 3:a9239ffa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:47.386 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:47.386 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.334069608, 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023707346000000001, 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3127 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975357+0000", 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.418e-06 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976868+0000", 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015108719999999999 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976894+0000", 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5885e-05 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976905+0000", 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1076e-05 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976983+0000", 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8532e-05 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977149+0000", 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016571500000000001 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977313+0000", 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163719 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.984588+0000", 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072751600000000001 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998908+0000", 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014319705 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998988+0000", 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9839000000000006e-05 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.999063+0000", 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5425000000000004e-05 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.391 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3136 3.25 e112/20 3:a4e0a0f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_51:head v 112'10, mlcod=102'8)", 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.233009938999999, 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026701701000000001, 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076417+0000", 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.779e-06 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077651+0000", 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233428 2024-04-24T13:33:47.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077679+0000", 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8535e-05 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077694+0000", 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077775+0000", 2024-04-24T13:33:47.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0927000000000006e-05 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077801+0000", 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5933999999999999e-05 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103085+0000", 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284238000000001 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103117+0000", 2024-04-24T13:33:47.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1917e-05 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3429 3.7 3:e226ff6b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_327:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 14.482840633, 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023122228000000002, 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.396 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3429 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826588+0000", 2024-04-24T13:33:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.942e-06 2024-04-24T13:33:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829078+0000", 2024-04-24T13:33:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002489982 2024-04-24T13:33:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829098+0000", 2024-04-24T13:33:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0747999999999999e-05 2024-04-24T13:33:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829110+0000", 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1569000000000001e-05 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829206+0000", 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6303000000000003e-05 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829419+0000", 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021229300000000001 2024-04-24T13:33:47.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829606+0000", 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187219 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.835770+0000", 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061641819999999998 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849620+0000", 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013849889000000001 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849663+0000", 2024-04-24T13:33:47.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2725999999999997e-05 2024-04-24T13:33:47.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.401 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.401 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849707+0000", 2024-04-24T13:33:47.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4375000000000001e-05 2024-04-24T13:33:47.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.401 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.401 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.401 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3484 3.18 3:1a64f732:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_382:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.927845454, 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029616456999999999, 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3484 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381583+0000", 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6510000000000001e-06 2024-04-24T13:33:47.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382670+0000", 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010878870000000001 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382689+0000", 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8723999999999999e-05 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382700+0000", 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0908e-05 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385156+0000", 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002456176 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385287+0000", 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013060400000000001 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385402+0000", 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115658 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.406717+0000", 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021314317999999999 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411063+0000", 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043465719999999999 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411141+0000", 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7193000000000004e-05 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411196+0000", 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5766000000000001e-05 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3483 3.c e114/103 3:3033c1b6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_381:head v 114'16, mlcod=113'14)", 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.925660242999999, 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028448153, 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383766+0000", 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0130000000000001e-06 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387173+0000", 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034066330000000001 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387201+0000", 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8705999999999999e-05 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387216+0000", 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5019e-05 2024-04-24T13:33:47.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387369+0000", 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015276299999999999 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387397+0000", 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7559000000000002e-05 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412160+0000", 2024-04-24T13:33:47.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024763314000000002 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412213+0000", 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3146000000000002e-05 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3501 3.24 3:27356806:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_399:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.748772767, 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029132884000000001, 2024-04-24T13:33:47.411 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3501 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:47.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560656+0000", 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.066e-06 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562392+0000", 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017359980000000001 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562431+0000", 2024-04-24T13:33:47.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9325e-05 2024-04-24T13:33:47.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562453+0000", 2024-04-24T13:33:47.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2476e-05 2024-04-24T13:33:47.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562541+0000", 2024-04-24T13:33:47.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7678999999999999e-05 2024-04-24T13:33:47.414 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.414 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.414 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562688+0000", 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014673600000000001 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562785+0000", 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6903000000000004e-05 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.571188+0000", 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084030449999999996 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.415 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589689+0000", 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018500876999999999 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589735+0000", 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589785+0000", 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0290999999999997e-05 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.416 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3521 3.1e 3:7803006f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_419:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 13.541820920999999, 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024446572999999999, 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3521 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:47.417 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767608+0000", 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3239999999999999e-06 2024-04-24T13:33:47.418 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770197+0000", 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025895129999999999 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770220+0000", 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2605000000000001e-05 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770233+0000", 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3159999999999999e-05 2024-04-24T13:33:47.419 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770329+0000", 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5995999999999994e-05 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770543+0000", 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000214348 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770732+0000", 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000188975 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.420 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.779877+0000", 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0091449860000000008 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.791883+0000", 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012005266000000001 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792002+0000", 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119351 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:47.421 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:47.422 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792051+0000", 2024-04-24T13:33:47.422 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9048999999999997e-05 2024-04-24T13:33:47.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.422 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.422 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:47.422 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:47.422 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:47.424 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:33:47.424 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:47.422+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:47.490 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:33:47.525 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:47.521+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:47.555 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:47.556 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:33:47.556 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:47.569 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:33:47.625 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:47.622+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:47.630 INFO:tasks.ceph.mon.a.smithi071.stderr:2024-04-24T13:33:47.630+0000 7fe3769ab640 -1 mon.a@0(leader).osd e123 definitely_dead 0 2024-04-24T13:33:47.726 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:47.725+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:47.739 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:47.739 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:47.739 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:33:47.739 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:33:47.739 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:47.753 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:33:47.838 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:47.837+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:47.926 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:47.926 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:33:47.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:33:47.926 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:33:47.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.926 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2208 3.29 e85/20 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:47.926 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:33:47.926 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 79.594024121999993, 2024-04-24T13:33:47.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026370000000000001, 2024-04-24T13:33:47.926 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:47.926 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:47.927 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.927 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:47.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:47.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:33:47.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:47.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:33:47.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:47.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328650+0000", 2024-04-24T13:33:47.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.413e-06 2024-04-24T13:33:47.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:47.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335219+0000", 2024-04-24T13:33:47.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006569788 2024-04-24T13:33:47.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:47.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335258+0000", 2024-04-24T13:33:47.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9062e-05 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335277+0000", 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.836e-05 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335422+0000", 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014537 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:47.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335481+0000", 2024-04-24T13:33:47.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9259000000000003e-05 2024-04-24T13:33:47.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:47.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354858+0000", 2024-04-24T13:33:47.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019376757000000001 2024-04-24T13:33:47.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:47.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.355017+0000", 2024-04-24T13:33:47.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015899100000000001 2024-04-24T13:33:47.930 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.930 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2672 3.1c 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 42.691216185999998, 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028612909999999998, 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.931 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2672 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:47.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231458+0000", 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.977e-06 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236408+0000", 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049496929999999998 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236444+0000", 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5713000000000002e-05 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236461+0000", 2024-04-24T13:33:47.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.789e-05 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236562+0000", 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100352 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236842+0000", 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027979399999999998 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:47.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.237091+0000", 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024988499999999998 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.246295+0000", 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0092031279999999997 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.259775+0000", 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013480634 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:47.935 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.259922+0000", 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146565 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.260068+0000", 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146279 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2706 3.1c 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:33:47.936 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 42.453589358999999, 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027254180999999999, 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:33:47.937 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:47.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:33:47.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:47.938 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469086+0000", 2024-04-24T13:33:47.938 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6100000000000002e-06 2024-04-24T13:33:47.938 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.938 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.938 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473145+0000", 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040598769999999999 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473180+0000", 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4345999999999999e-05 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473197+0000", 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.721e-05 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.939 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473377+0000", 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000179805 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473830+0000", 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045276700000000002 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.474315+0000", 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000485842 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.940 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.485841+0000", 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011525822 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496030+0000", 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010188401 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496205+0000", 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000175632 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.941 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:47.942 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496336+0000", 2024-04-24T13:33:47.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013086900000000001 2024-04-24T13:33:47.942 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.942 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:47.942 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.942 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.942 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.942 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2752 3.1c 3:3ae15365:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:47.942 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:33:47.942 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 41.968366359999997, 2024-04-24T13:33:47.942 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027425952, 2024-04-24T13:33:47.942 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2752 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.943 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954308+0000", 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3100000000000001e-06 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959305+0000", 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049969649999999999 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.944 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959349+0000", 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3590000000000001e-05 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959375+0000", 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6268999999999999e-05 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959561+0000", 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018558600000000001 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.945 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:47.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959821+0000", 2024-04-24T13:33:47.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000260704 2024-04-24T13:33:47.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:47.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.960063+0000", 2024-04-24T13:33:47.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024149499999999999 2024-04-24T13:33:47.946 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.946 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.946 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.946 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.974409+0000", 2024-04-24T13:33:47.946 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014345689999999999 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981424+0000", 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070159250000000001 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981651+0000", 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022641499999999999 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981731+0000", 2024-04-24T13:33:47.947 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0003e-05 2024-04-24T13:33:47.948 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.948 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:47.948 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.948 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.948 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.948 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2772 3.1a 3:589df240:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:47.948 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:06.151960+0000", 2024-04-24T13:33:47.948 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 41.770711523999999, 2024-04-24T13:33:47.948 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024913555, 2024-04-24T13:33:47.948 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:47.948 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:47.948 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.948 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2772 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.151960+0000", 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.151960+0000", 2024-04-24T13:33:47.949 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.151963+0000", 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8729999999999999e-06 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.157999+0000", 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060360609999999997 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:47.950 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158051+0000", 2024-04-24T13:33:47.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2283000000000001e-05 2024-04-24T13:33:47.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158078+0000", 2024-04-24T13:33:47.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7163000000000001e-05 2024-04-24T13:33:47.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.951 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:47.951 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158261+0000", 2024-04-24T13:33:47.951 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182342 2024-04-24T13:33:47.951 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.951 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158680+0000", 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041904000000000003 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.159122+0000", 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044224599999999998 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.172894+0000", 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013771782 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.952 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:47.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.176730+0000", 2024-04-24T13:33:47.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038359940000000001 2024-04-24T13:33:47.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:47.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.176810+0000", 2024-04-24T13:33:47.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9985000000000001e-05 2024-04-24T13:33:47.953 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.953 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.953 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:47.953 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.176873+0000", 2024-04-24T13:33:47.953 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3786000000000002e-05 2024-04-24T13:33:47.954 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.954 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:47.954 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.954 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.954 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.954 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2817 3.13 3:c886ce92:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:47.954 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:06.637721+0000", 2024-04-24T13:33:47.954 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 41.284950125999998, 2024-04-24T13:33:47.954 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024927993999999998, 2024-04-24T13:33:47.954 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:47.954 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:47.954 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.954 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2817 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.637721+0000", 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.637721+0000", 2024-04-24T13:33:47.955 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:47.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.637725+0000", 2024-04-24T13:33:47.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8229999999999997e-06 2024-04-24T13:33:47.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:47.956 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642579+0000", 2024-04-24T13:33:47.956 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048544010000000004 2024-04-24T13:33:47.956 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.956 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.956 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642615+0000", 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5392999999999998e-05 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642634+0000", 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8933e-05 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642774+0000", 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014001199999999999 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.957 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.643201+0000", 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042696999999999999 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.643553+0000", 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035225099999999999 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.660632+0000", 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017079436999999999 2024-04-24T13:33:47.958 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.662499+0000", 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001866611 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.662591+0000", 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1762999999999995e-05 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.662649+0000", 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8400000000000003e-05 2024-04-24T13:33:47.959 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3091 3.9 3:91019aa3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.355434413000001, 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026195184999999999, 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:47.960 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3091 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.961 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567241+0000", 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7570000000000002e-06 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575380+0000", 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081391740000000008 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575427+0000", 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6839999999999999e-05 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.962 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575451+0000", 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4329999999999999e-05 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575651+0000", 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020028400000000001 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576089+0000", 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043775699999999999 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.963 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576498+0000", 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040853999999999999 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.592857+0000", 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016359097 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593257+0000", 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000400553 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.964 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:47.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593358+0000", 2024-04-24T13:33:47.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010064 2024-04-24T13:33:47.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.965 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:47.965 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593432+0000", 2024-04-24T13:33:47.965 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4213000000000002e-05 2024-04-24T13:33:47.965 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.965 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:47.965 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.965 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.965 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3093 3.9 3:918af506:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.586455+0000", 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.336216128, 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024560463000000001, 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3093 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:47.966 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.586455+0000", 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.586455+0000", 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.586459+0000", 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4400000000000001e-06 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.967 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:47.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593639+0000", 2024-04-24T13:33:47.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071801740000000001 2024-04-24T13:33:47.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:47.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593670+0000", 2024-04-24T13:33:47.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1186999999999998e-05 2024-04-24T13:33:47.968 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.968 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.968 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.968 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593685+0000", 2024-04-24T13:33:47.968 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5302999999999999e-05 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593801+0000", 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115949 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.594038+0000", 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000237078 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.594259+0000", 2024-04-24T13:33:47.969 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022082800000000001 2024-04-24T13:33:47.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:47.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.607515+0000", 2024-04-24T13:33:47.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013255829 2024-04-24T13:33:47.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.970 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.970 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.610697+0000", 2024-04-24T13:33:47.970 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031818879999999999 2024-04-24T13:33:47.970 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.970 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.610884+0000", 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018670199999999999 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.611016+0000", 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013208499999999999 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.971 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3121 3.e 3:70900501:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.012030974000002, 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026429009, 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3121 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.972 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910644+0000", 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2270000000000002e-06 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.973 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914662+0000", 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040188539999999997 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914705+0000", 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2562999999999999e-05 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914726+0000", 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0996e-05 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.974 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914911+0000", 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018524500000000001 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.915177+0000", 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026601100000000003 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.915402+0000", 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224928 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.975 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.925683+0000", 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010280821000000001 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.936831+0000", 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011148362 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.936987+0000", 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155749 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.976 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:47.977 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.937069+0000", 2024-04-24T13:33:47.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2253e-05 2024-04-24T13:33:47.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.977 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:47.977 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.977 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.977 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.977 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3123 3.13 3:ca3e100b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:47.977 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:33:47.977 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.992769188, 2024-04-24T13:33:47.977 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029312213, 2024-04-24T13:33:47.977 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:47.977 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3123 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:47.978 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929905+0000", 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6970000000000002e-06 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933842+0000", 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039367320000000001 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:47.979 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933877+0000", 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.561e-05 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933894+0000", 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7212999999999999e-05 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934030+0000", 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013565199999999999 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:47.980 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934295+0000", 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000265235 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934540+0000", 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024482399999999999 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.957909+0000", 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023368684000000001 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959004+0000", 2024-04-24T13:33:47.981 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010949709999999999 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959124+0000", 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012061900000000001 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959214+0000", 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9975999999999994e-05 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.982 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.983 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.983 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3140 3.13 3:cb1b51c5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:47.983 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:29.122081+0000", 2024-04-24T13:33:47.983 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.800590609, 2024-04-24T13:33:47.983 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024992602999999999, 2024-04-24T13:33:47.983 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:47.983 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:47.983 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:47.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:47.983 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.983 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3140 2024-04-24T13:33:47.983 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.122081+0000", 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.122081+0000", 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:47.984 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.122084+0000", 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0029999999999999e-06 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126170+0000", 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040860200000000001 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126206+0000", 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6672999999999999e-05 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.985 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126225+0000", 2024-04-24T13:33:47.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8114e-05 2024-04-24T13:33:47.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:47.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126363+0000", 2024-04-24T13:33:47.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013847800000000001 2024-04-24T13:33:47.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.986 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:47.986 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126618+0000", 2024-04-24T13:33:47.986 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025469499999999999 2024-04-24T13:33:47.986 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.986 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126861+0000", 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000243408 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.136738+0000", 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098770560000000004 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.146717+0000", 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099784629999999999 2024-04-24T13:33:47.987 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.146923+0000", 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020675199999999999 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.147073+0000", 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014994100000000001 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.988 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3431 3.9 3:910e1c92:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_329:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.851638+0000", 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.071033205999999, 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024517051000000002, 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3431 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.989 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:47.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.851638+0000", 2024-04-24T13:33:47.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:47.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.851638+0000", 2024-04-24T13:33:47.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.990 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.990 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:47.990 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.851642+0000", 2024-04-24T13:33:47.990 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6799999999999999e-06 2024-04-24T13:33:47.990 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857208+0000", 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055657950000000001 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857250+0000", 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2530000000000001e-05 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857272+0000", 2024-04-24T13:33:47.991 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2042999999999999e-05 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857440+0000", 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016773499999999999 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857796+0000", 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035583700000000002 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.858038+0000", 2024-04-24T13:33:47.992 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000242138 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.873499+0000", 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015461228 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.875780+0000", 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022812610000000001 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:47.993 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.875972+0000", 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019177899999999999 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876155+0000", 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018302499999999999 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3433 3.34 3:2ce81ea4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_331:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:33:47.994 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.052359161, 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026583214000000001, 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3433 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.995 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870316+0000", 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.16e-06 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876622+0000", 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063053919999999999 2024-04-24T13:33:47.996 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876650+0000", 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8007000000000001e-05 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876669+0000", 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8972999999999999e-05 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876789+0000", 2024-04-24T13:33:47.997 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119849 2024-04-24T13:33:47.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:47.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.877065+0000", 2024-04-24T13:33:47.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276407 2024-04-24T13:33:47.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:47.998 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.877304+0000", 2024-04-24T13:33:47.998 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023901799999999999 2024-04-24T13:33:47.998 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.998 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.998 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.890409+0000", 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013105047 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896721+0000", 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063118360000000004 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896819+0000", 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7728999999999999e-05 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:47.999 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896895+0000", 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6796000000000001e-05 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3463 3.39 e113/41 3:9e84137f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_361:head v 113'19, mlcod=113'17)", 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.749862348000001, 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025926719000000001, 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.000 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172811+0000", 2024-04-24T13:33:48.001 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1160000000000002e-06 2024-04-24T13:33:48.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177659+0000", 2024-04-24T13:33:48.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048481549999999998 2024-04-24T13:33:48.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.002 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177694+0000", 2024-04-24T13:33:48.002 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4473e-05 2024-04-24T13:33:48.002 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.002 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.002 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177717+0000", 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3750000000000001e-05 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177886+0000", 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000168405 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177925+0000", 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9555999999999999e-05 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.003 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.198662+0000", 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020736167999999999 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.198736+0000", 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4096000000000003e-05 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3469 3.3 3:c2771714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_367:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:33:48.004 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.690626803000001, 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028440263, 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3469 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:33:48.005 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232047+0000", 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4669999999999998e-06 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.237943+0000", 2024-04-24T13:33:48.006 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058964320000000001 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.237979+0000", 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5907e-05 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238000+0000", 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0536000000000001e-05 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.007 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238104+0000", 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010404300000000001 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238355+0000", 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000250881 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238590+0000", 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000235388 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.008 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.248777+0000", 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010187244 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260299+0000", 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011521933 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260403+0000", 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010400600000000001 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.009 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260485+0000", 2024-04-24T13:33:48.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1426000000000003e-05 2024-04-24T13:33:48.010 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.010 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.010 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.010 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.010 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.010 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3501 3.24 e114/20 3:27356806:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_399:head v 114'14, mlcod=113'12)", 2024-04-24T13:33:48.010 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:33:48.010 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.359423175, 2024-04-24T13:33:48.010 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026449908000000001, 2024-04-24T13:33:48.010 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.010 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.010 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.011 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:33:48.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.011 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:33:48.011 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.011 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.011 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.011 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563249+0000", 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9299999999999998e-07 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568259+0000", 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050107759999999998 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568292+0000", 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2892999999999998e-05 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.012 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568310+0000", 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7819e-05 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568429+0000", 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011896999999999999 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568469+0000", 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9739e-05 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.013 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.589582+0000", 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021113072 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.589698+0000", 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116146 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3509 3.39 e114/41 3:9cf0e09a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_407:head v 114'21, mlcod=113'19)", 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.652439+0000", 2024-04-24T13:33:48.014 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.270231969999999, 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025495436, 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.652439+0000", 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.652439+0000", 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.015 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.652441+0000", 2024-04-24T13:33:48.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.03e-06 2024-04-24T13:33:48.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656544+0000", 2024-04-24T13:33:48.016 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041031030000000003 2024-04-24T13:33:48.016 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.016 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.016 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.016 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656570+0000", 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5996999999999999e-05 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656583+0000", 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2935999999999999e-05 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656723+0000", 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139226 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.017 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656763+0000", 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0655999999999998e-05 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.677805+0000", 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021042079000000002 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.677935+0000", 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012940900000000001 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.018 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3534 3.34 3:2c938e61:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_432:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.899747+0000", 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.022924278, 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025402460000000002, 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3534 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.019 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.899747+0000", 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.899747+0000", 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.899751+0000", 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9269999999999998e-06 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.020 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.905900+0000", 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061494890000000002 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.905936+0000", 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5196e-05 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.905955+0000", 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8913999999999999e-05 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.021 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.906122+0000", 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000167715 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.906540+0000", 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041803599999999999 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.906963+0000", 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042224 2024-04-24T13:33:48.022 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.924057+0000", 2024-04-24T13:33:48.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017094272000000001 2024-04-24T13:33:48.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.924812+0000", 2024-04-24T13:33:48.023 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075491399999999998 2024-04-24T13:33:48.023 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.023 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.023 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.023 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.925002+0000", 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190101 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.925149+0000", 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147656 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3585 3.11 3:88ded408:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_482:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:33:48.024 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.522349106, 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034777737000000003, 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3585 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.025 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400326+0000", 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9330000000000003e-06 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404462+0000", 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041354130000000001 2024-04-24T13:33:48.026 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404537+0000", 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5282000000000002e-05 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404565+0000", 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7797000000000002e-05 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404716+0000", 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015126500000000001 2024-04-24T13:33:48.027 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.405051+0000", 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033540099999999998 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.405296+0000", 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024506099999999998 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.429261+0000", 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023964485000000001 2024-04-24T13:33:48.028 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.434796+0000", 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055355559999999996 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.434949+0000", 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015286499999999999 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.435100+0000", 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000150679 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.029 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3586 3.11 3:89fac597:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_483:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 13.511062924999999, 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028873106999999999, 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3586 2024-04-24T13:33:48.030 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.031 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411611+0000", 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7930000000000002e-06 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415739+0000", 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00412751 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415776+0000", 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7082999999999997e-05 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.032 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415795+0000", 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9539999999999999e-05 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418234+0000", 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024391310000000002 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418476+0000", 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000242026 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:48.033 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418697+0000", 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000220564 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.432206+0000", 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013508922 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440330+0000", 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081238649999999992 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.034 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440414+0000", 2024-04-24T13:33:48.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4270999999999993e-05 2024-04-24T13:33:48.035 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.035 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.035 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.035 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440481+0000", 2024-04-24T13:33:48.035 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7402000000000003e-05 2024-04-24T13:33:48.035 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.035 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.035 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.035 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.035 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.035 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:48.037 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:33:48.037 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:48.034+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:48.138 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:48.137+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:48.213 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:48.213 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:48.213 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:33:48.213 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:48.227 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:33:48.239 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:48.238+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:48.339 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:48.337+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:48.392 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:48.392 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:48.392 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:33:48.392 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:33:48.392 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:48.406 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:33:48.436 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:33:48.450 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:48.449+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:48.493 INFO:teuthology.orchestra.run.smithi071.stderr:marked in osd.7. 2024-04-24T13:33:48.497 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:33:48.540 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:48.538+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:48.545 INFO:tasks.thrashosds.thrasher:Added osd 7 2024-04-24T13:33:48.593 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:48.593 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:33:48.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:33:48.593 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:33:48.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.593 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2251 3.3a 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:48.593 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:33:48.593 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 79.756217526, 2024-04-24T13:33:48.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030524880000000001, 2024-04-24T13:33:48.594 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.594 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.594 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.594 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2251 2024-04-24T13:33:48.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.594 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.594 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.594 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834880+0000", 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6769999999999999e-06 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839556+0000", 2024-04-24T13:33:48.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046751350000000004 2024-04-24T13:33:48.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839593+0000", 2024-04-24T13:33:48.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7079999999999997e-05 2024-04-24T13:33:48.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839617+0000", 2024-04-24T13:33:48.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4015999999999998e-05 2024-04-24T13:33:48.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839773+0000", 2024-04-24T13:33:48.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015627699999999999 2024-04-24T13:33:48.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840011+0000", 2024-04-24T13:33:48.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023843900000000001 2024-04-24T13:33:48.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:48.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840261+0000", 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024939899999999997 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.853562+0000", 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013301726999999999 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865276+0000", 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011713779000000001 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865349+0000", 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2624000000000001e-05 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865403+0000", 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3727000000000002e-05 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2665 3.1d 3:b85990f0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:48.599 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.162820+0000", 2024-04-24T13:33:48.600 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.428275386000003, 2024-04-24T13:33:48.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031707361000000003, 2024-04-24T13:33:48.600 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.600 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.600 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.600 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2665 2024-04-24T13:33:48.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.600 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.600 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.162820+0000", 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.162820+0000", 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.162824+0000", 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.997e-06 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171282+0000", 2024-04-24T13:33:48.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084578310000000007 2024-04-24T13:33:48.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171325+0000", 2024-04-24T13:33:48.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3183000000000003e-05 2024-04-24T13:33:48.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171346+0000", 2024-04-24T13:33:48.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0976999999999999e-05 2024-04-24T13:33:48.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171546+0000", 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020003100000000001 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171818+0000", 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027171500000000001 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.172172+0000", 2024-04-24T13:33:48.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035402699999999998 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.188938+0000", 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016766519000000001 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.194193+0000", 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052545140000000001 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.194379+0000", 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000186212 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.194527+0000", 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148355 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2688 3.3a 3:5c6b1f96:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.390932+0000", 2024-04-24T13:33:48.605 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 43.200162790999997, 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026775021999999999, 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2688 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.390932+0000", 2024-04-24T13:33:48.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.390932+0000", 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.390954+0000", 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1993000000000001e-05 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.395625+0000", 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046703819999999998 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.395671+0000", 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6360000000000003e-05 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.395690+0000", 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9156000000000001e-05 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.395858+0000", 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016796899999999999 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.396141+0000", 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000282491 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.396376+0000", 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023479800000000001 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.409413+0000", 2024-04-24T13:33:48.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013037686999999999 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.417525+0000", 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081113699999999997 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.417626+0000", 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010090300000000001 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.417707+0000", 2024-04-24T13:33:48.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1913e-05 2024-04-24T13:33:48.611 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.611 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.611 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.611 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2726 3.3c 3:3c53550d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:48.611 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.682300+0000", 2024-04-24T13:33:48.611 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 42.908794896000003, 2024-04-24T13:33:48.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032107164000000001, 2024-04-24T13:33:48.611 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.611 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.611 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2726 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.682300+0000", 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.682300+0000", 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.682304+0000", 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6270000000000002e-06 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.687934+0000", 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056300899999999999 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.687976+0000", 2024-04-24T13:33:48.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1542999999999998e-05 2024-04-24T13:33:48.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.687995+0000", 2024-04-24T13:33:48.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9326000000000001e-05 2024-04-24T13:33:48.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.688149+0000", 2024-04-24T13:33:48.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015422299999999999 2024-04-24T13:33:48.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.688160+0000", 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0723000000000001e-05 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.691501+0000", 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033414619999999999 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.691704+0000", 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020224899999999999 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.691913+0000", 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020945800000000001 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.711338+0000", 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019425141999999999 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.714104+0000", 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027660340000000001 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.714273+0000", 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016885500000000001 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.714407+0000", 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134432 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3088 3.2f 3:f713650a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.537981+0000", 2024-04-24T13:33:48.617 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 20.053114281999999, 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029051113999999999, 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3088 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.537981+0000", 2024-04-24T13:33:48.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.537981+0000", 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.537983+0000", 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3499999999999999e-06 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546609+0000", 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086254480000000008 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546652+0000", 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3346000000000001e-05 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546671+0000", 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8899999999999999e-05 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546852+0000", 2024-04-24T13:33:48.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000181318 2024-04-24T13:33:48.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.547138+0000", 2024-04-24T13:33:48.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028545099999999999 2024-04-24T13:33:48.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:48.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.547379+0000", 2024-04-24T13:33:48.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024102800000000001 2024-04-24T13:33:48.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.565501+0000", 2024-04-24T13:33:48.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018122406000000001 2024-04-24T13:33:48.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.566815+0000", 2024-04-24T13:33:48.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001313579 2024-04-24T13:33:48.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.566911+0000", 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6056000000000003e-05 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567032+0000", 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012123199999999999 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3089 3.17 e112/103 3:e81f13af:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_4:head v 112'10, mlcod=102'8)", 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.550578+0000", 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 20.040517550000001, 2024-04-24T13:33:48.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025883415999999999, 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.550578+0000", 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.550578+0000", 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.550580+0000", 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3630000000000001e-06 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.560984+0000", 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010404063 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.561019+0000", 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4659000000000001e-05 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.561035+0000", 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6586e-05 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.561147+0000", 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111346 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.561187+0000", 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9879999999999998e-05 2024-04-24T13:33:48.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576330+0000", 2024-04-24T13:33:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015143386999999999 2024-04-24T13:33:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576461+0000", 2024-04-24T13:33:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131132 2024-04-24T13:33:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3090 3.36 e112/103 3:6dcd93d9:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_5:head v 112'10, mlcod=102'8)", 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.571193+0000", 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 20.019901926999999, 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029191265000000001, 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.571193+0000", 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.571193+0000", 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.571196+0000", 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3860000000000001e-06 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574406+0000", 2024-04-24T13:33:48.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032107809999999998 2024-04-24T13:33:48.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574468+0000", 2024-04-24T13:33:48.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1636000000000004e-05 2024-04-24T13:33:48.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574496+0000", 2024-04-24T13:33:48.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-05 2024-04-24T13:33:48.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574664+0000", 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000168185 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574703+0000", 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8318999999999997e-05 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.600283+0000", 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025580226000000001 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.600385+0000", 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010160199999999999 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3107 3.16 3:6bf97696:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.764376+0000", 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.826718847999999, 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034648104999999998, 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.632 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.633 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.633 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.633 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.633 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3107 2024-04-24T13:33:48.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.633 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.633 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.764376+0000", 2024-04-24T13:33:48.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.633 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.633 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.764376+0000", 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.764380+0000", 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1030000000000004e-06 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771397+0000", 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00701682 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771445+0000", 2024-04-24T13:33:48.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7273e-05 2024-04-24T13:33:48.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771465+0000", 2024-04-24T13:33:48.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0506999999999999e-05 2024-04-24T13:33:48.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771641+0000", 2024-04-24T13:33:48.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000175661 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.772047+0000", 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040609000000000001 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.772460+0000", 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041274699999999998 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.793165+0000", 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020705128 2024-04-24T13:33:48.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.798765+0000", 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055998250000000001 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.798903+0000", 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013819200000000001 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.799024+0000", 2024-04-24T13:33:48.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121759 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3109 3.2a 3:54bfd822:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.789724+0000", 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.801371184000001, 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027841423000000001, 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.638 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3109 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.789724+0000", 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.789724+0000", 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.639 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.789728+0000", 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5099999999999999e-06 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.794177+0000", 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044491469999999997 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.794212+0000", 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5259999999999998e-05 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.794233+0000", 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.101e-05 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.794365+0000", 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132402 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.794610+0000", 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024423199999999999 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:48.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.794836+0000", 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022610100000000001 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.816153+0000", 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021317262999999999 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.817335+0000", 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011824769999999999 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.817438+0000", 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102939 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.817565+0000", 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012708199999999999 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3153 3.3a 3:5d66cd8d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:48.643 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:29.258930+0000", 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.332165082, 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025637142000000002, 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3153 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.258930+0000", 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.258930+0000", 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.258934+0000", 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.557e-06 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.263334+0000", 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044001839999999997 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.263364+0000", 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9807000000000001e-05 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.263384+0000", 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.056e-05 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.263519+0000", 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013479200000000001 2024-04-24T13:33:48.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.263786+0000", 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026703799999999999 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.264074+0000", 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028755399999999998 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.277687+0000", 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013613446 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.284293+0000", 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066059229999999997 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.284459+0000", 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016623899999999999 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.284567+0000", 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010804200000000001 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.648 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3166 3.5 3:a0bc589b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:29.415673+0000", 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.175422064999999, 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025463712999999999, 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3166 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.649 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.415673+0000", 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.415673+0000", 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.415677+0000", 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5030000000000002e-06 2024-04-24T13:33:48.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.420615+0000", 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049380700000000001 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.420652+0000", 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6810000000000002e-05 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.420670+0000", 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8712999999999999e-05 2024-04-24T13:33:48.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.420829+0000", 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015834900000000001 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.421234+0000", 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040548 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.421649+0000", 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041469599999999999 2024-04-24T13:33:48.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.434762+0000", 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013113154 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.440830+0000", 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060679369999999998 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.441010+0000", 2024-04-24T13:33:48.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000179922 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.441137+0000", 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012707899999999999 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3185 3.2f 3:f6424cca:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:29.616372+0000", 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.974722839999998, 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025526185999999999, 2024-04-24T13:33:48.654 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3185 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.616372+0000", 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.616372+0000", 2024-04-24T13:33:48.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.616376+0000", 2024-04-24T13:33:48.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3900000000000002e-06 2024-04-24T13:33:48.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.620445+0000", 2024-04-24T13:33:48.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040689109999999997 2024-04-24T13:33:48.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.620486+0000", 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1452999999999998e-05 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.620506+0000", 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9599999999999999e-05 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.620686+0000", 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018018799999999999 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.620969+0000", 2024-04-24T13:33:48.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028279100000000001 2024-04-24T13:33:48.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:48.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.621202+0000", 2024-04-24T13:33:48.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023289099999999999 2024-04-24T13:33:48.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.658 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.658 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.636973+0000", 2024-04-24T13:33:48.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015771186 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.641579+0000", 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046060060000000002 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.641760+0000", 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000180848 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.641899+0000", 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013892200000000001 2024-04-24T13:33:48.659 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3380 3.3a 3:5cb232f4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_285:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.346253+0000", 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 16.244842167000002, 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032318024000000001, 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.660 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3380 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.346253+0000", 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.346253+0000", 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.346257+0000", 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1699999999999999e-06 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350569+0000", 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043118740000000003 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350632+0000", 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2663000000000006e-05 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350665+0000", 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2895999999999998e-05 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350861+0000", 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019607199999999999 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.351303+0000", 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044276299999999999 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:48.663 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.351690+0000", 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038655699999999999 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.362989+0000", 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011298475000000001 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.378400+0000", 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015411747999999999 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.378496+0000", 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6152999999999999e-05 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.378571+0000", 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4653000000000005e-05 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3420 3.c 3:30a790eb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_318:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.718876+0000", 2024-04-24T13:33:48.665 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.872219615000001, 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028978935000000001, 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3420 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.718876+0000", 2024-04-24T13:33:48.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.718876+0000", 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.718895+0000", 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9517e-05 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728273+0000", 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093782440000000009 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728295+0000", 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1742999999999998e-05 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728312+0000", 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6413999999999999e-05 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728441+0000", 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129419 2024-04-24T13:33:48.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728811+0000", 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037002299999999998 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.729054+0000", 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024291100000000001 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.739199+0000", 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010145101 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.747523+0000", 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0083244700000000005 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.747721+0000", 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019801399999999999 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.747855+0000", 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000133079 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.670 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3483 3.c 3:3033c1b6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_381:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.370370+0000", 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 15.220725499, 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.043221212000000002, 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3483 2024-04-24T13:33:48.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.370370+0000", 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.370370+0000", 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.370419+0000", 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9283000000000002e-05 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.374810+0000", 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043905979999999999 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.374848+0000", 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8041999999999999e-05 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.374871+0000", 2024-04-24T13:33:48.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.379359+0000", 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044878909999999999 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.379749+0000", 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038957 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:48.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.380113+0000", 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000363834 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.392454+0000", 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012341097000000001 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.413294+0000", 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020840033000000001 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.675 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.413471+0000", 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000177579 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.413591+0000", 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119492 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3520 3.3a 3:5c3c2822:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_418:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.756549+0000", 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.834546012000001, 2024-04-24T13:33:48.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027907472999999999, 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3520 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.756549+0000", 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.756549+0000", 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.756554+0000", 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3059999999999999e-06 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.761743+0000", 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051890850000000004 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.761791+0000", 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8359999999999998e-05 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.761812+0000", 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1223e-05 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.761994+0000", 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018138200000000001 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.762425+0000", 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116600000000003 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.762848+0000", 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042281399999999998 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.773653+0000", 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010805682 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.784146+0000", 2024-04-24T13:33:48.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010492837 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.784325+0000", 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017865900000000001 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.784457+0000", 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013195899999999999 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.681 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3537 3.1c 3:3b17e225:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_435:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:48.682 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.931231+0000", 2024-04-24T13:33:48.682 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.659863940999999, 2024-04-24T13:33:48.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025717324999999999, 2024-04-24T13:33:48.682 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.682 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.682 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.682 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.682 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.682 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.682 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3537 2024-04-24T13:33:48.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.682 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.931231+0000", 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.931231+0000", 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.931234+0000", 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.666e-06 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.935539+0000", 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043045729999999999 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.935569+0000", 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0522999999999999e-05 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.935585+0000", 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6045999999999998e-05 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.935762+0000", 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017669499999999999 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.936191+0000", 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042953000000000002 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.936617+0000", 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042530999999999998 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.952624+0000", 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016007812999999999 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.956625+0000", 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040003080000000002 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.956811+0000", 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000186515 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.956949+0000", 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000137346 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3548 3.1d 3:bbc96e42:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_446:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.038024+0000", 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.553070898, 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028372396000000001, 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.687 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3548 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.038024+0000", 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.038024+0000", 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.038058+0000", 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4042999999999999e-05 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043019+0000", 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049610390000000004 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043092+0000", 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2166e-05 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043120+0000", 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8390000000000001e-05 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043309+0000", 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000189345 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043724+0000", 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041498700000000002 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.690 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.044164+0000", 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043983299999999999 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.057294+0000", 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01313023 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.066184+0000", 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088898120000000004 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.691 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.066284+0000", 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9984999999999999e-05 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.066397+0000", 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011256600000000001 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3571 3.d 3:b1ad9891:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_468:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.260486+0000", 2024-04-24T13:33:48.692 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.330609690999999, 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026174981, 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3571 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.260486+0000", 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.260486+0000", 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.260489+0000", 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.366e-06 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.264517+0000", 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040285410000000001 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.264560+0000", 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2079999999999997e-05 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.264580+0000", 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0106e-05 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.264763+0000", 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018310200000000001 2024-04-24T13:33:48.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.265073+0000", 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031075800000000001 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.265309+0000", 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023542100000000001 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.282061+0000", 2024-04-24T13:33:48.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016751683999999999 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.286487+0000", 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044259240000000004 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.286588+0000", 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101803 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.286661+0000", 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2195999999999998e-05 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3584 3.1c 3:3bb2f2b7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_481:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.391716+0000", 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 14.199379716999999, 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026180821, 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:48.698 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3584 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.391716+0000", 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.391716+0000", 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.391719+0000", 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7670000000000001e-06 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.396345+0000", 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046257090000000004 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.396390+0000", 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5386000000000002e-05 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.396412+0000", 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1189999999999999e-05 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.396615+0000", 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000203635 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.396876+0000", 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026126799999999999 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:48.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.397110+0000", 2024-04-24T13:33:48.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000233482 2024-04-24T13:33:48.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:48.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.409752+0000", 2024-04-24T13:33:48.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012641813 2024-04-24T13:33:48.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:48.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.417667+0000", 2024-04-24T13:33:48.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079150499999999999 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.417819+0000", 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015267500000000001 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.417896+0000", 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6846000000000003e-05 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:48.703 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:48.704 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:48.704 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:48.705 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:48.705 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:48.706 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:48.706 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:33:48.706 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:48.701+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:48.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:48.707 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:48.707 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:48.707 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:48.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:48.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:48.708 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:48.708 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:48.716 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:48.716 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:48.737 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:48.737 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:48.806 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:48.805+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:48.878 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:48.878 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:48.893 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:33:48.906 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:48.906+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:49.000 INFO:tasks.workunit.client.0.smithi071.stderr:200+0 records in 2024-04-24T13:33:49.000 INFO:tasks.workunit.client.0.smithi071.stderr:200+0 records out 2024-04-24T13:33:49.000 INFO:tasks.workunit.client.0.smithi071.stderr:2097152000 bytes (2.1 GB, 2.0 GiB) copied, 13.9426 s, 150 MB/s 2024-04-24T13:33:49.007 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:49.006+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:49.057 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:49.057 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:49.071 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:33:49.108 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:49.106+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:49.187 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:49.188 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:49.202 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:33:49.209 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:49.206+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:49.310 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:49.306+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:49.348 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:49.348 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:49.365 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:49.411 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:49.410+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:49.503 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:49.503 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:49.511 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:49.509+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:49.523 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:49.613 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:49.610+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:49.714 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:49.710+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:49.716 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:49.716 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:49.736 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:49.815 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:49.814+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:49.868 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:49.868 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:49.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:49.923 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:49.922+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:50.017 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:50.014+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:50.040 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:50.040 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:50.055 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:50.143 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:50.142+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:50.218 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:50.217+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:50.223 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:50.224 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:50.238 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:50.327 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:50.326+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:50.358 INFO:tasks.workunit.client.0.smithi071.stdout:Bucket Created: buck_2024_03_24_13_33_50 2024-04-24T13:33:50.420 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:50.417+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:50.433 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:50.433 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:50.455 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:33:50.543 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:50.542+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:50.545 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:33:50.623 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:50.621+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:50.641 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:50.641 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:50.660 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:33:50.666 INFO:tasks.workunit.client.0.smithi071.stdout:bucket quota max size set for the given user: buck_2024_03_24_13_33_50 2024-04-24T13:33:50.723 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:50.722+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:50.756 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:33:50.804 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:50.804 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:50.822 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:33:50.823 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:50.821+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:50.905 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:50.906 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:50.923 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:50.923 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:50.924 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:50.921+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:50.940 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:50.941 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:50.958 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:50.959 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:50.980 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:50.981 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:50.981 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:50.981 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:50.981 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:50.981 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:50.995 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:33:51.016 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:51.016 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:51.039 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:51.039 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:51.039 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:51.038+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:51.061 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:51.061 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:51.127 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:51.126+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:51.127 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:51.127 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:51.127 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:51.127 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:51.127 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:51.140 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:33:51.225 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:51.221+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:51.296 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:51.296 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:51.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:51.296 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:51.296 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.296 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2206 3.f 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:51.296 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:51.296 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 83.002201886999998, 2024-04-24T13:33:51.296 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028291495999999999, 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2206 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.297 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:51.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.298 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290398+0000", 2024-04-24T13:33:51.298 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000001e-06 2024-04-24T13:33:51.298 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.298 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.298 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294671+0000", 2024-04-24T13:33:51.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042724390000000003 2024-04-24T13:33:51.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294711+0000", 2024-04-24T13:33:51.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0376000000000001e-05 2024-04-24T13:33:51.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.299 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.299 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.299 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294730+0000", 2024-04-24T13:33:51.299 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8607e-05 2024-04-24T13:33:51.299 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294856+0000", 2024-04-24T13:33:51.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126651 2024-04-24T13:33:51.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295125+0000", 2024-04-24T13:33:51.300 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026840700000000002 2024-04-24T13:33:51.300 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.300 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.300 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:51.300 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295349+0000", 2024-04-24T13:33:51.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022454699999999999 2024-04-24T13:33:51.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307240+0000", 2024-04-24T13:33:51.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011891048 2024-04-24T13:33:51.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.301 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.301 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318593+0000", 2024-04-24T13:33:51.301 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011352777999999999 2024-04-24T13:33:51.301 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.301 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318652+0000", 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8677000000000001e-05 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318686+0000", 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4616000000000002e-05 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.302 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2669 3.21 3:86a0e0c3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:51.303 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:51.303 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.090271227999999, 2024-04-24T13:33:51.303 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020962138000000002, 2024-04-24T13:33:51.303 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.303 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.303 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.303 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.303 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.303 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.303 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2669 2024-04-24T13:33:51.303 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.303 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.303 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202325+0000", 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.202328+0000", 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-06 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.304 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204239+0000", 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019104409999999999 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204265+0000", 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6054000000000002e-05 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204279+0000", 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3654e-05 2024-04-24T13:33:51.305 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204361+0000", 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.2522999999999996e-05 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204523+0000", 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000162332 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.204661+0000", 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013798200000000001 2024-04-24T13:33:51.306 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.210336+0000", 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0056743339999999996 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223107+0000", 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012771714999999999 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223228+0000", 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012061300000000001 2024-04-24T13:33:51.307 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.223288+0000", 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9537999999999998e-05 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2710 3.3b 3:ddce91ac:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.780468820000003, 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026438756000000001, 2024-04-24T13:33:51.308 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.309 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.309 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.309 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.309 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.309 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.309 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2710 2024-04-24T13:33:51.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.309 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.309 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.309 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.309 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:51.309 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.309 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:51.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512131+0000", 2024-04-24T13:33:51.310 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0130000000000002e-06 2024-04-24T13:33:51.310 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.310 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.310 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.310 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514363+0000", 2024-04-24T13:33:51.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022325940000000001 2024-04-24T13:33:51.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514394+0000", 2024-04-24T13:33:51.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0144000000000001e-05 2024-04-24T13:33:51.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.311 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.311 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514409+0000", 2024-04-24T13:33:51.311 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5786000000000001e-05 2024-04-24T13:33:51.311 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.311 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514497+0000", 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7876999999999999e-05 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514670+0000", 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000173096 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514768+0000", 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8089000000000002e-05 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.312 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.523354+0000", 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085854190000000004 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538483+0000", 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015128922 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538527+0000", 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3835999999999998e-05 2024-04-24T13:33:51.313 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.314 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.314 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538567+0000", 2024-04-24T13:33:51.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.998e-05 2024-04-24T13:33:51.314 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.314 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.314 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.314 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.314 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.314 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2808 3.2e 3:7441f999:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:51.314 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:51.314 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 44.761234119000001, 2024-04-24T13:33:51.314 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021413788, 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2808 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.315 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:51.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531366+0000", 2024-04-24T13:33:51.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1089999999999998e-06 2024-04-24T13:33:51.316 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.316 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.316 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.316 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533059+0000", 2024-04-24T13:33:51.316 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001693186 2024-04-24T13:33:51.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533088+0000", 2024-04-24T13:33:51.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9470000000000001e-05 2024-04-24T13:33:51.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.317 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533100+0000", 2024-04-24T13:33:51.317 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1979e-05 2024-04-24T13:33:51.317 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.317 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.317 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533176+0000", 2024-04-24T13:33:51.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5691000000000004e-05 2024-04-24T13:33:51.318 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.318 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.318 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.318 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533334+0000", 2024-04-24T13:33:51.318 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015822199999999999 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533513+0000", 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178846 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.546303+0000", 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012790331 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.319 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552696+0000", 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063923169999999998 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552741+0000", 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126999999999997e-05 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552776+0000", 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5509999999999997e-05 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.320 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3094 3.14 3:29338048:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.696241647000001, 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022112211, 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3094 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.321 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:51.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:51.322 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.322 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.322 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.322 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.322 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596358+0000", 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6560000000000001e-06 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598612+0000", 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022539050000000001 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598639+0000", 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7767e-05 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.323 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598651+0000", 2024-04-24T13:33:51.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:33:51.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598735+0000", 2024-04-24T13:33:51.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4176000000000002e-05 2024-04-24T13:33:51.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.324 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.324 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598928+0000", 2024-04-24T13:33:51.324 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019318199999999999 2024-04-24T13:33:51.324 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.324 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.599089+0000", 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016078899999999999 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.612538+0000", 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013449081999999999 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618346+0000", 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058079799999999999 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.325 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618413+0000", 2024-04-24T13:33:51.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7101999999999996e-05 2024-04-24T13:33:51.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.326 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.326 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618467+0000", 2024-04-24T13:33:51.326 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4295000000000001e-05 2024-04-24T13:33:51.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.326 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.326 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.326 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.326 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3128 3.1f 3:f8849f48:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.305857663000001, 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027867126999999998, 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3128 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.327 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986743+0000", 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.495e-06 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.328 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988482+0000", 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001739237 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988510+0000", 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8343999999999998e-05 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988525+0000", 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5384999999999999e-05 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.329 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988630+0000", 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010412 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988808+0000", 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178123 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988956+0000", 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014802399999999999 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.330 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.995102+0000", 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061461179999999999 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014480+0000", 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019378581999999998 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014541+0000", 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1007000000000001e-05 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.331 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014606+0000", 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4691999999999997e-05 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3130 3.f 3:f22fdcf5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.282676208000002, 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021419780999999999, 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.332 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3130 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.333 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:51.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009923+0000", 2024-04-24T13:33:51.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5890000000000001e-06 2024-04-24T13:33:51.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.334 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.334 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011652+0000", 2024-04-24T13:33:51.334 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017287419999999999 2024-04-24T13:33:51.334 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.334 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011692+0000", 2024-04-24T13:33:51.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0346000000000003e-05 2024-04-24T13:33:51.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011707+0000", 2024-04-24T13:33:51.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5068e-05 2024-04-24T13:33:51.335 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.335 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.335 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.335 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011805+0000", 2024-04-24T13:33:51.335 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7935000000000003e-05 2024-04-24T13:33:51.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011984+0000", 2024-04-24T13:33:51.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178629 2024-04-24T13:33:51.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.336 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:51.336 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.012159+0000", 2024-04-24T13:33:51.336 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017566500000000001 2024-04-24T13:33:51.336 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.336 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.025987+0000", 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013827409000000001 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031173+0000", 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051865590000000003 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031263+0000", 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9598000000000005e-05 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.337 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031340+0000", 2024-04-24T13:33:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7241000000000001e-05 2024-04-24T13:33:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3406 3.3b 3:dffc7604:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_304:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.737230798999999, 2024-04-24T13:33:51.338 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020810539999999999, 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3406 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.339 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555366+0000", 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.555369+0000", 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.672e-06 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557249+0000", 2024-04-24T13:33:51.340 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001880086 2024-04-24T13:33:51.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557282+0000", 2024-04-24T13:33:51.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3065000000000003e-05 2024-04-24T13:33:51.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.341 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557297+0000", 2024-04-24T13:33:51.341 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4990999999999999e-05 2024-04-24T13:33:51.341 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.341 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.341 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557389+0000", 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2447000000000004e-05 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557525+0000", 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000135821 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.557677+0000", 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015188699999999999 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.342 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.564715+0000", 2024-04-24T13:33:51.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0070385329999999996 2024-04-24T13:33:51.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576037+0000", 2024-04-24T13:33:51.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011321721999999999 2024-04-24T13:33:51.343 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.343 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.343 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.343 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576112+0000", 2024-04-24T13:33:51.343 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4924000000000003e-05 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.576176+0000", 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4392000000000003e-05 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3426 3.f 3:f3517f93:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_324:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.498744175999999, 2024-04-24T13:33:51.344 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024699635000000001, 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3426 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.345 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:51.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793855+0000", 2024-04-24T13:33:51.346 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4669999999999998e-06 2024-04-24T13:33:51.346 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.346 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.346 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.346 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796548+0000", 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026926369999999999 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796572+0000", 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4456000000000001e-05 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796586+0000", 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3937000000000001e-05 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.347 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796690+0000", 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104226 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796877+0000", 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018668299999999999 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.797048+0000", 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017070599999999999 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.348 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.817921+0000", 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020873198999999999 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818393+0000", 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000472459 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818475+0000", 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1403999999999995e-05 2024-04-24T13:33:51.349 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.350 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.350 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818552+0000", 2024-04-24T13:33:51.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7460999999999996e-05 2024-04-24T13:33:51.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.350 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.350 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.350 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.350 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.350 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3427 3.21 3:854a3dc6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_325:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:51.350 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:51.350 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.488112037, 2024-04-24T13:33:51.350 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023613657999999999, 2024-04-24T13:33:51.351 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.351 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.351 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.351 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.351 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3427 2024-04-24T13:33:51.351 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.351 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.351 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.351 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.351 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:51.351 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:51.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.352 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.352 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804488+0000", 2024-04-24T13:33:51.352 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.23e-06 2024-04-24T13:33:51.352 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.352 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807535+0000", 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030472709999999998 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807563+0000", 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8087999999999999e-05 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807579+0000", 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5732000000000001e-05 2024-04-24T13:33:51.353 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807691+0000", 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111894 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807850+0000", 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015951999999999999 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.808005+0000", 2024-04-24T13:33:51.354 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154487 2024-04-24T13:33:51.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.823418+0000", 2024-04-24T13:33:51.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015413526 2024-04-24T13:33:51.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.355 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828003+0000", 2024-04-24T13:33:51.355 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045842299999999999 2024-04-24T13:33:51.355 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.355 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.355 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828048+0000", 2024-04-24T13:33:51.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5504999999999999e-05 2024-04-24T13:33:51.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.356 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.356 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828098+0000", 2024-04-24T13:33:51.356 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0175e-05 2024-04-24T13:33:51.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.356 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.356 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.356 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.356 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.356 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3430 3.3b 3:de51c163:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:51.357 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:51.357 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.454887189000001, 2024-04-24T13:33:51.357 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025624112000000001, 2024-04-24T13:33:51.357 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.357 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.357 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.357 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.357 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3430 2024-04-24T13:33:51.357 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.357 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.357 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:51.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:51.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.358 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.358 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.358 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.358 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837713+0000", 2024-04-24T13:33:51.358 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6509999999999999e-06 2024-04-24T13:33:51.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839548+0000", 2024-04-24T13:33:51.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001834521 2024-04-24T13:33:51.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.359 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839577+0000", 2024-04-24T13:33:51.359 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8850999999999999e-05 2024-04-24T13:33:51.359 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.359 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.359 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839611+0000", 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4140000000000002e-05 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839718+0000", 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107534 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839883+0000", 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016485999999999999 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.360 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.840056+0000", 2024-04-24T13:33:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017321200000000001 2024-04-24T13:33:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849455+0000", 2024-04-24T13:33:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093988590000000007 2024-04-24T13:33:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863165+0000", 2024-04-24T13:33:51.361 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013710178 2024-04-24T13:33:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863263+0000", 2024-04-24T13:33:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7559000000000006e-05 2024-04-24T13:33:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863334+0000", 2024-04-24T13:33:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0747000000000006e-05 2024-04-24T13:33:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.362 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3443 3.a e113/48 3:53aaab58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_341:head v 113'18, mlcod=113'16)", 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.316940104, 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022399639999999998, 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.363 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975668+0000", 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.113e-05 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.364 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979725+0000", 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040574219999999998 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979759+0000", 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4362000000000001e-05 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979774+0000", 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4935e-05 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.365 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979871+0000", 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.658e-05 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979901+0000", 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-05 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.997990+0000", 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018089483 2024-04-24T13:33:51.366 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.998056+0000", 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6208e-05 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3458 3.f 3:f34a4471:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.172423770999998, 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026075494000000001, 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.367 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3458 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.368 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120175+0000", 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5220000000000002e-06 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121620+0000", 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014442280000000001 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.369 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121646+0000", 2024-04-24T13:33:51.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6424999999999999e-05 2024-04-24T13:33:51.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121659+0000", 2024-04-24T13:33:51.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:33:51.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.370 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.370 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121754+0000", 2024-04-24T13:33:51.370 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4388999999999994e-05 2024-04-24T13:33:51.370 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.370 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121968+0000", 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021460199999999999 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.122165+0000", 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019710999999999999 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.141554+0000", 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019388847000000001 2024-04-24T13:33:51.371 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146083+0000", 2024-04-24T13:33:51.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045284469999999997 2024-04-24T13:33:51.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146129+0000", 2024-04-24T13:33:51.372 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6257000000000001e-05 2024-04-24T13:33:51.372 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.372 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.372 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.372 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146248+0000", 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011958100000000001 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3460 3.a e113/48 3:5102140b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_358:head v 113'19, mlcod=113'17)", 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.146409748, 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025573478, 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.373 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:51.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:51.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.374 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.374 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.374 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.374 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146188+0000", 2024-04-24T13:33:51.374 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.02e-07 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150270+0000", 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004082011 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150302+0000", 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2570999999999997e-05 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150319+0000", 2024-04-24T13:33:51.375 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6843000000000001e-05 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150404+0000", 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4538999999999998e-05 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150432+0000", 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8098000000000001e-05 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.376 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.170266+0000", 2024-04-24T13:33:51.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019834497 2024-04-24T13:33:51.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.377 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.377 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171760+0000", 2024-04-24T13:33:51.377 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001494017 2024-04-24T13:33:51.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.377 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.377 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.377 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.377 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.377 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3461 3.3b 3:dfe1b3a0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_359:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:51.377 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:51.378 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.143701841999999, 2024-04-24T13:33:51.378 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024256994, 2024-04-24T13:33:51.378 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.378 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.378 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.378 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.378 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.378 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.378 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3461 2024-04-24T13:33:51.378 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.378 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.378 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.378 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148898+0000", 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6970000000000002e-06 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.379 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150603+0000", 2024-04-24T13:33:51.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017049809999999999 2024-04-24T13:33:51.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150615+0000", 2024-04-24T13:33:51.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2368000000000001e-05 2024-04-24T13:33:51.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.380 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.380 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.380 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150620+0000", 2024-04-24T13:33:51.380 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5210000000000002e-06 2024-04-24T13:33:51.380 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150671+0000", 2024-04-24T13:33:51.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0315000000000002e-05 2024-04-24T13:33:51.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150844+0000", 2024-04-24T13:33:51.381 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017304399999999999 2024-04-24T13:33:51.381 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.381 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.381 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:51.381 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.151009+0000", 2024-04-24T13:33:51.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016544800000000001 2024-04-24T13:33:51.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171479+0000", 2024-04-24T13:33:51.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020469355000000002 2024-04-24T13:33:51.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.382 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.382 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173035+0000", 2024-04-24T13:33:51.382 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001556857 2024-04-24T13:33:51.382 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.382 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173096+0000", 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0285999999999998e-05 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173152+0000", 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6122000000000002e-05 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3491 3.14 3:2a9aeaa0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_389:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:51.383 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.829949937999999, 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029663012999999998, 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3491 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.384 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:51.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:51.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.385 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.385 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462649+0000", 2024-04-24T13:33:51.385 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.65e-06 2024-04-24T13:33:51.385 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.385 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464539+0000", 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001889527 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464565+0000", 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6061999999999999e-05 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464580+0000", 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5273000000000001e-05 2024-04-24T13:33:51.386 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464678+0000", 2024-04-24T13:33:51.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7639000000000005e-05 2024-04-24T13:33:51.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464899+0000", 2024-04-24T13:33:51.387 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000220638 2024-04-24T13:33:51.387 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.387 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.387 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:51.387 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.465088+0000", 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018922700000000001 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.478519+0000", 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013430884000000001 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492184+0000", 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013665797 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.388 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492260+0000", 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6038999999999995e-05 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492310+0000", 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9277000000000003e-05 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3514 3.a e114/48 3:5344e333:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_412:head v 114'23, mlcod=114'21)", 2024-04-24T13:33:51.389 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.590878223000001, 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021739380999999999, 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.390 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701734+0000", 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5807999999999998e-05 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705769+0000", 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040343660000000002 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.391 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705801+0000", 2024-04-24T13:33:51.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2406000000000001e-05 2024-04-24T13:33:51.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705816+0000", 2024-04-24T13:33:51.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4537e-05 2024-04-24T13:33:51.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.392 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.392 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.392 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705925+0000", 2024-04-24T13:33:51.392 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109114 2024-04-24T13:33:51.392 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705959+0000", 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4239999999999997e-05 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723399+0000", 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017439748000000001 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723458+0000", 2024-04-24T13:33:51.393 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9162e-05 2024-04-24T13:33:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3525 3.f 3:f35962b2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_423:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.485379336000001, 2024-04-24T13:33:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028712260999999999, 2024-04-24T13:33:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.394 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.395 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.395 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.395 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3525 2024-04-24T13:33:51.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.395 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:51.395 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.395 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.395 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.395 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.395 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807221+0000", 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7529999999999999e-06 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813425+0000", 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062037280000000004 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.396 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813449+0000", 2024-04-24T13:33:51.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:33:51.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813462+0000", 2024-04-24T13:33:51.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200999999999999e-05 2024-04-24T13:33:51.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.397 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.397 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.397 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813554+0000", 2024-04-24T13:33:51.397 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2369999999999998e-05 2024-04-24T13:33:51.397 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813730+0000", 2024-04-24T13:33:51.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017569800000000001 2024-04-24T13:33:51.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:51.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813908+0000", 2024-04-24T13:33:51.398 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178219 2024-04-24T13:33:51.398 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.398 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.398 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.398 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.826992+0000", 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013083567000000001 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835795+0000", 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088026630000000005 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835870+0000", 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5649999999999996e-05 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.399 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.400 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835930+0000", 2024-04-24T13:33:51.400 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9318999999999999e-05 2024-04-24T13:33:51.400 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.400 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.400 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.400 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.400 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3528 3.3b 3:dc395008:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_426:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 17.457035269999999, 2024-04-24T13:33:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024383452999999999, 2024-04-24T13:33:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3528 2024-04-24T13:33:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.401 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:51.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.402 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:51.402 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.402 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.402 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.402 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835564+0000", 2024-04-24T13:33:51.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7369999999999998e-06 2024-04-24T13:33:51.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837236+0000", 2024-04-24T13:33:51.403 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001671964 2024-04-24T13:33:51.403 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.403 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.403 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.403 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837275+0000", 2024-04-24T13:33:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8760000000000002e-05 2024-04-24T13:33:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837292+0000", 2024-04-24T13:33:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6884999999999998e-05 2024-04-24T13:33:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837382+0000", 2024-04-24T13:33:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9809999999999996e-05 2024-04-24T13:33:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.404 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837556+0000", 2024-04-24T13:33:51.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174103 2024-04-24T13:33:51.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:51.405 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837728+0000", 2024-04-24T13:33:51.405 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017202600000000001 2024-04-24T13:33:51.405 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.405 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.405 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859492+0000", 2024-04-24T13:33:51.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021764644999999999 2024-04-24T13:33:51.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859714+0000", 2024-04-24T13:33:51.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221809 2024-04-24T13:33:51.406 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.406 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.406 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.406 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859857+0000", 2024-04-24T13:33:51.406 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142738 2024-04-24T13:33:51.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.407 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.407 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859945+0000", 2024-04-24T13:33:51.407 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7975999999999999e-05 2024-04-24T13:33:51.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.407 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.407 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.407 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.407 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.407 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3596 3.3b 3:dcf4b716:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_493:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:51.407 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:51.407 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 16.770010113000001, 2024-04-24T13:33:51.408 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021336183000000002, 2024-04-24T13:33:51.408 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.408 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.408 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.408 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.408 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3596 2024-04-24T13:33:51.408 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.408 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.408 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:51.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:51.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.409 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.409 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.409 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.409 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522589+0000", 2024-04-24T13:33:51.409 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.853e-06 2024-04-24T13:33:51.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524412+0000", 2024-04-24T13:33:51.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018229559999999999 2024-04-24T13:33:51.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.410 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.410 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524440+0000", 2024-04-24T13:33:51.410 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7489999999999999e-05 2024-04-24T13:33:51.410 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.410 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524454+0000", 2024-04-24T13:33:51.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4565e-05 2024-04-24T13:33:51.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524556+0000", 2024-04-24T13:33:51.411 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101166 2024-04-24T13:33:51.411 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.411 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.411 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.411 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524666+0000", 2024-04-24T13:33:51.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109918 2024-04-24T13:33:51.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:51.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524816+0000", 2024-04-24T13:33:51.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015030800000000001 2024-04-24T13:33:51.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.412 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.412 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.412 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.531231+0000", 2024-04-24T13:33:51.412 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064155159999999996 2024-04-24T13:33:51.412 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543790+0000", 2024-04-24T13:33:51.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012558565000000001 2024-04-24T13:33:51.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.413 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543865+0000", 2024-04-24T13:33:51.413 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4999999999999993e-05 2024-04-24T13:33:51.413 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.413 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.413 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.414 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543923+0000", 2024-04-24T13:33:51.414 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7846000000000001e-05 2024-04-24T13:33:51.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.414 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.414 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.414 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.414 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:51.416 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:33:51.417 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:51.413+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:51.516 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:51.514+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:51.529 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:33:51.541 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:51.542 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:51.542 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:51.542 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:51.560 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:33:51.617 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:51.613+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:51.718 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:51.717+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:51.719 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:51.720 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:51.720 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:51.720 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:51.720 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:51.733 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:33:51.819 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:51.817+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:51.863 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:51.863 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:51.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:51.864 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:51.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.864 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2207 3.38 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:51.864 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:51.864 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 83.557455661999995, 2024-04-24T13:33:51.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022686873999999999, 2024-04-24T13:33:51.864 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.864 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.864 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.864 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.864 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.864 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2207 2024-04-24T13:33:51.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.865 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:51.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:51.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302499+0000", 2024-04-24T13:33:51.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-04-24T13:33:51.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307861+0000", 2024-04-24T13:33:51.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053622089999999997 2024-04-24T13:33:51.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307899+0000", 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978999999999997e-05 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307917+0000", 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8576999999999998e-05 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308018+0000", 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010080499999999999 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308202+0000", 2024-04-24T13:33:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000183628 2024-04-24T13:33:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308352+0000", 2024-04-24T13:33:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149806 2024-04-24T13:33:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318520+0000", 2024-04-24T13:33:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010168744 2024-04-24T13:33:51.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.324908+0000", 2024-04-24T13:33:51.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063874739999999998 2024-04-24T13:33:51.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325063+0000", 2024-04-24T13:33:51.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155131 2024-04-24T13:33:51.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.869 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.869 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325182+0000", 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011915499999999999 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 83.533860949000001, 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.870 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:33:51.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:33:51.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:33:51.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:33:51.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:33:51.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:33:51.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:33:51.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:51.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:33:51.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:33:51.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 83.388805094999995, 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:33:51.876 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.877 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.877 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.877 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.877 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:33:51.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.877 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:51.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:51.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:33:51.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:33:51.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:33:51.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2242 3.b 3:d16b554f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 83.120306162999995, 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022940439, 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.882 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2242 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739648+0000", 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.785e-06 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741765+0000", 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002117655 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741781+0000", 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6062e-05 2024-04-24T13:33:51.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741792+0000", 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0937999999999999e-05 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741918+0000", 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623199999999999 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742189+0000", 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027047300000000002 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742430+0000", 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024077699999999999 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752990+0000", 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010559875 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762422+0000", 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094325120000000005 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762510+0000", 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7879000000000003e-05 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762585+0000", 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5251000000000002e-05 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.887 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2662 3.33 3:ce195145:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.731387855999998, 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028670389000000001, 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2662 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128567+0000", 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4640000000000002e-06 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130845+0000", 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002278389 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130869+0000", 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4394999999999999e-05 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130879+0000", 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0000000000000001e-05 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130957+0000", 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7968999999999998e-05 2024-04-24T13:33:51.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130963+0000", 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2499999999999997e-06 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137507+0000", 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065442900000000003 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137607+0000", 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010002599999999999 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137727+0000", 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120142 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152307+0000", 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01458017 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157112+0000", 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048051350000000003 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157181+0000", 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9051e-05 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157233+0000", 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2108000000000003e-05 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.893 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2676 3.22 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.588185948000003, 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025889562000000001, 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2676 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271767+0000", 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.273986+0000", 2024-04-24T13:33:51.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022195560000000001 2024-04-24T13:33:51.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274011+0000", 2024-04-24T13:33:51.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4953e-05 2024-04-24T13:33:51.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274023+0000", 2024-04-24T13:33:51.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1856e-05 2024-04-24T13:33:51.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274116+0000", 2024-04-24T13:33:51.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3168e-05 2024-04-24T13:33:51.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274377+0000", 2024-04-24T13:33:51.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026071500000000001 2024-04-24T13:33:51.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274531+0000", 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015427299999999999 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297124+0000", 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022592476 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297544+0000", 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000420691 2024-04-24T13:33:51.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297605+0000", 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0888999999999999e-05 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297655+0000", 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9119999999999997e-05 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.899 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2722 3.25 e101/20 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head v 101'6, mlcod=86'4)", 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 46.216440667000001, 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023380372, 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643511+0000", 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4400000000000001e-07 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647450+0000", 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039389259999999997 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647470+0000", 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0534e-05 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647484+0000", 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3370000000000001e-05 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647599+0000", 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115513 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647629+0000", 2024-04-24T13:33:51.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0145e-05 2024-04-24T13:33:51.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666761+0000", 2024-04-24T13:33:51.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019132303999999999 2024-04-24T13:33:51.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666891+0000", 2024-04-24T13:33:51.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012913599999999999 2024-04-24T13:33:51.903 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2747 3.24 3:2754d069:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.961890805000003, 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024857536999999999, 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.904 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2747 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898063+0000", 2024-04-24T13:33:51.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5289999999999998e-06 2024-04-24T13:33:51.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899956+0000", 2024-04-24T13:33:51.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932759999999999 2024-04-24T13:33:51.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899984+0000", 2024-04-24T13:33:51.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7801999999999999e-05 2024-04-24T13:33:51.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899997+0000", 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3127e-05 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900063+0000", 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900200+0000", 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000137324 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:51.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900302+0000", 2024-04-24T13:33:51.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010168 2024-04-24T13:33:51.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.908151+0000", 2024-04-24T13:33:51.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078489579999999996 2024-04-24T13:33:51.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922784+0000", 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014633116 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922860+0000", 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5708000000000001e-05 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922918+0000", 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7686000000000003e-05 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.909 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2754 3.b 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.881421305000003, 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.032358206, 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2754 2024-04-24T13:33:51.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978532+0000", 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6079999999999998e-06 2024-04-24T13:33:51.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979768+0000", 2024-04-24T13:33:51.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012357869999999999 2024-04-24T13:33:51.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979791+0000", 2024-04-24T13:33:51.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3224e-05 2024-04-24T13:33:51.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979804+0000", 2024-04-24T13:33:51.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.274e-05 2024-04-24T13:33:51.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979889+0000", 2024-04-24T13:33:51.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5483999999999997e-05 2024-04-24T13:33:51.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980063+0000", 2024-04-24T13:33:51.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017384599999999999 2024-04-24T13:33:51.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:51.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980227+0000", 2024-04-24T13:33:51.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163764 2024-04-24T13:33:51.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987774+0000", 2024-04-24T13:33:51.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075472029999999997 2024-04-24T13:33:51.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010776+0000", 2024-04-24T13:33:51.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023001886999999999 2024-04-24T13:33:51.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010838+0000", 2024-04-24T13:33:51.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1527999999999998e-05 2024-04-24T13:33:51.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010888+0000", 2024-04-24T13:33:51.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0135e-05 2024-04-24T13:33:51.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.916 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.916 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2811 3.7 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:51.916 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:51.916 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.289782473000002, 2024-04-24T13:33:51.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044582597000000002, 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2811 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.917 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:51.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570171+0000", 2024-04-24T13:33:51.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9100000000000001e-06 2024-04-24T13:33:51.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580122+0000", 2024-04-24T13:33:51.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099505930000000006 2024-04-24T13:33:51.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580150+0000", 2024-04-24T13:33:51.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7827e-05 2024-04-24T13:33:51.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580164+0000", 2024-04-24T13:33:51.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4547e-05 2024-04-24T13:33:51.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580245+0000", 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0810999999999996e-05 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580355+0000", 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109656 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580475+0000", 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120278 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607433+0000", 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026957894 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614636+0000", 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072028359999999998 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614703+0000", 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7645999999999996e-05 2024-04-24T13:33:51.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614751+0000", 2024-04-24T13:33:51.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7599000000000003e-05 2024-04-24T13:33:51.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.922 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.922 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2812 3.1e 3:7bd62ca6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:51.922 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:51.922 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 45.279738592999998, 2024-04-24T13:33:51.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.038041177000000002, 2024-04-24T13:33:51.923 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.923 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.923 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.923 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2812 2024-04-24T13:33:51.923 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.923 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.923 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:51.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:51.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580214+0000", 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.708e-06 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582574+0000", 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023601799999999999 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582591+0000", 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6648999999999999e-05 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582598+0000", 2024-04-24T13:33:51.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.391e-06 2024-04-24T13:33:51.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583731+0000", 2024-04-24T13:33:51.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011332029999999999 2024-04-24T13:33:51.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583843+0000", 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111889 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583936+0000", 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2968999999999997e-05 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.599363+0000", 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015427186000000001 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618143+0000", 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018779051000000001 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618200+0000", 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7151999999999998e-05 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618253+0000", 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3798999999999998e-05 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.928 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3110 3.1e 3:79ca4af0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.060680392999998, 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022894164000000002, 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3110 2024-04-24T13:33:51.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.930 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:51.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:51.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799272+0000", 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9470000000000002e-06 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800698+0000", 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001425204 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800721+0000", 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3577000000000001e-05 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800731+0000", 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9969999999999993e-06 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800797+0000", 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6087999999999995e-05 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800954+0000", 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015699 2024-04-24T13:33:51.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:51.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.801064+0000", 2024-04-24T13:33:51.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109715 2024-04-24T13:33:51.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.807584+0000", 2024-04-24T13:33:51.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065197479999999997 2024-04-24T13:33:51.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822063+0000", 2024-04-24T13:33:51.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014479156999999999 2024-04-24T13:33:51.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822122+0000", 2024-04-24T13:33:51.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9095000000000003e-05 2024-04-24T13:33:51.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.934 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.934 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822165+0000", 2024-04-24T13:33:51.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2645999999999998e-05 2024-04-24T13:33:51.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3117 3.27 3:e455931d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.989322362999999, 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02353235, 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3117 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870631+0000", 2024-04-24T13:33:51.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.075e-06 2024-04-24T13:33:51.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872287+0000", 2024-04-24T13:33:51.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016561449999999999 2024-04-24T13:33:51.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872316+0000", 2024-04-24T13:33:51.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9543000000000002e-05 2024-04-24T13:33:51.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872333+0000", 2024-04-24T13:33:51.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6806000000000001e-05 2024-04-24T13:33:51.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872403+0000", 2024-04-24T13:33:51.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9917000000000002e-05 2024-04-24T13:33:51.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872540+0000", 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013735200000000001 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872686+0000", 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014519899999999999 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.878440+0000", 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057539490000000004 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894072+0000", 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015632801000000002 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894106+0000", 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3933999999999997e-05 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894161+0000", 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4629000000000002e-05 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.940 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.941 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.941 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3127 3.15 3:a9239ffa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:51.941 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:51.941 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.884595186999999, 2024-04-24T13:33:51.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023707346000000001, 2024-04-24T13:33:51.941 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.941 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.941 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.942 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3127 2024-04-24T13:33:51.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.942 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:51.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:51.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975357+0000", 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.418e-06 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976868+0000", 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015108719999999999 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976894+0000", 2024-04-24T13:33:51.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5885e-05 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976905+0000", 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1076e-05 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976983+0000", 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8532e-05 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977149+0000", 2024-04-24T13:33:51.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016571500000000001 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977313+0000", 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163719 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.984588+0000", 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072751600000000001 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998908+0000", 2024-04-24T13:33:51.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014319705 2024-04-24T13:33:51.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998988+0000", 2024-04-24T13:33:51.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9839000000000006e-05 2024-04-24T13:33:51.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.946 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.999063+0000", 2024-04-24T13:33:51.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5425000000000004e-05 2024-04-24T13:33:51.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.946 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3136 3.25 e112/20 3:a4e0a0f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_51:head v 112'10, mlcod=102'8)", 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.783535518000001, 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026701701000000001, 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076417+0000", 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.779e-06 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077651+0000", 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233428 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077679+0000", 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8535e-05 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077694+0000", 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077775+0000", 2024-04-24T13:33:51.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0927000000000006e-05 2024-04-24T13:33:51.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077801+0000", 2024-04-24T13:33:51.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5933999999999999e-05 2024-04-24T13:33:51.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103085+0000", 2024-04-24T13:33:51.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284238000000001 2024-04-24T13:33:51.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103117+0000", 2024-04-24T13:33:51.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1917e-05 2024-04-24T13:33:51.955 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.955 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3429 3.7 3:e226ff6b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_327:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 19.033366212000001, 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023122228000000002, 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.956 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3429 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826588+0000", 2024-04-24T13:33:51.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.942e-06 2024-04-24T13:33:51.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829078+0000", 2024-04-24T13:33:51.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002489982 2024-04-24T13:33:51.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829098+0000", 2024-04-24T13:33:51.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0747999999999999e-05 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829110+0000", 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1569000000000001e-05 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829206+0000", 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6303000000000003e-05 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829419+0000", 2024-04-24T13:33:51.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021229300000000001 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829606+0000", 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187219 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.835770+0000", 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061641819999999998 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849620+0000", 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013849889000000001 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849663+0000", 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2725999999999997e-05 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849707+0000", 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4375000000000001e-05 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.961 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3484 3.18 3:1a64f732:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_382:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.478371032999998, 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029616456999999999, 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3484 2024-04-24T13:33:51.962 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.963 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:51.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.963 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:51.963 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.963 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.963 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.963 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381583+0000", 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6510000000000001e-06 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382670+0000", 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010878870000000001 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382689+0000", 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8723999999999999e-05 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.964 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382700+0000", 2024-04-24T13:33:51.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0908e-05 2024-04-24T13:33:51.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.965 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385156+0000", 2024-04-24T13:33:51.965 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002456176 2024-04-24T13:33:51.965 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.965 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.965 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385287+0000", 2024-04-24T13:33:51.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013060400000000001 2024-04-24T13:33:51.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:51.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385402+0000", 2024-04-24T13:33:51.966 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115658 2024-04-24T13:33:51.966 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.966 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.966 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.966 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.406717+0000", 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021314317999999999 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411063+0000", 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043465719999999999 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411141+0000", 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7193000000000004e-05 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.967 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411196+0000", 2024-04-24T13:33:51.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5766000000000001e-05 2024-04-24T13:33:51.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.968 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.968 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.968 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.968 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.968 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3483 3.c e114/103 3:3033c1b6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_381:head v 114'16, mlcod=113'14)", 2024-04-24T13:33:51.968 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:51.968 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.476185822000001, 2024-04-24T13:33:51.968 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028448153, 2024-04-24T13:33:51.968 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.968 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.969 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.969 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:51.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.969 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.969 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.969 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.969 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:51.969 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.970 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.970 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383766+0000", 2024-04-24T13:33:51.970 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0130000000000001e-06 2024-04-24T13:33:51.970 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.970 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387173+0000", 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034066330000000001 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387201+0000", 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8705999999999999e-05 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387216+0000", 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5019e-05 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.971 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387369+0000", 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015276299999999999 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387397+0000", 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7559000000000002e-05 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412160+0000", 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024763314000000002 2024-04-24T13:33:51.972 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412213+0000", 2024-04-24T13:33:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3146000000000002e-05 2024-04-24T13:33:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3501 3.24 3:27356806:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_399:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.299298346, 2024-04-24T13:33:51.973 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029132884000000001, 2024-04-24T13:33:51.974 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.974 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.974 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.974 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.974 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3501 2024-04-24T13:33:51.974 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.974 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.974 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.974 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.974 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560656+0000", 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.066e-06 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.975 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562392+0000", 2024-04-24T13:33:51.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017359980000000001 2024-04-24T13:33:51.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.976 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562431+0000", 2024-04-24T13:33:51.976 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9325e-05 2024-04-24T13:33:51.976 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.976 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.976 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562453+0000", 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2476e-05 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562541+0000", 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7678999999999999e-05 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562688+0000", 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014673600000000001 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.977 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:51.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562785+0000", 2024-04-24T13:33:51.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6903000000000004e-05 2024-04-24T13:33:51.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.571188+0000", 2024-04-24T13:33:51.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084030449999999996 2024-04-24T13:33:51.978 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.978 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.978 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.978 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589689+0000", 2024-04-24T13:33:51.978 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018500876999999999 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589735+0000", 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589785+0000", 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0290999999999997e-05 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.979 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3521 3.1e 3:7803006f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_419:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 18.092346500000001, 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024446572999999999, 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3521 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:51.980 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767608+0000", 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3239999999999999e-06 2024-04-24T13:33:51.981 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:51.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770197+0000", 2024-04-24T13:33:51.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025895129999999999 2024-04-24T13:33:51.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:51.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770220+0000", 2024-04-24T13:33:51.982 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2605000000000001e-05 2024-04-24T13:33:51.982 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.982 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.982 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:51.982 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770233+0000", 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3159999999999999e-05 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770329+0000", 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5995999999999994e-05 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770543+0000", 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000214348 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.983 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770732+0000", 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000188975 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.779877+0000", 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0091449860000000008 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.791883+0000", 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012005266000000001 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.984 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:51.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792002+0000", 2024-04-24T13:33:51.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119351 2024-04-24T13:33:51.985 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:51.985 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:51.985 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:51.985 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792051+0000", 2024-04-24T13:33:51.985 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9048999999999997e-05 2024-04-24T13:33:51.985 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.985 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.985 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.985 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:51.986 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:51.986 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:51.987 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:33:51.988 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:51.986+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:52.088 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:52.085+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:52.131 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:52.131 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:33:52.131 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:52.147 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:33:52.190 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:52.189+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:52.290 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:52.289+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:52.363 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:52.363 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:52.363 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:33:52.363 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:33:52.363 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:52.363 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:33:52.406 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:52.405+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:52.493 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:52.489+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:52.562 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:33:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:33:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:33:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2208 3.29 e85/20 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:52.562 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:33:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 84.230496076999998, 2024-04-24T13:33:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026370000000000001, 2024-04-24T13:33:52.563 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.566 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.566 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.566 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.566 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.566 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.566 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:33:52.566 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:33:52.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.567 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.567 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328650+0000", 2024-04-24T13:33:52.567 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.413e-06 2024-04-24T13:33:52.567 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.567 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335219+0000", 2024-04-24T13:33:52.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006569788 2024-04-24T13:33:52.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335258+0000", 2024-04-24T13:33:52.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9062e-05 2024-04-24T13:33:52.568 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.568 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.568 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.568 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335277+0000", 2024-04-24T13:33:52.568 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.836e-05 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335422+0000", 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014537 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335481+0000", 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9259000000000003e-05 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.569 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354858+0000", 2024-04-24T13:33:52.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019376757000000001 2024-04-24T13:33:52.570 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.570 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.570 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.570 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.355017+0000", 2024-04-24T13:33:52.570 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015899100000000001 2024-04-24T13:33:52.570 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2672 3.1c 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.327688141000003, 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028612909999999998, 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.571 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.572 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2672 2024-04-24T13:33:52.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.572 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:33:52.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.572 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.572 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.572 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:33:52.572 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.572 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231458+0000", 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.977e-06 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236408+0000", 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049496929999999998 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236444+0000", 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5713000000000002e-05 2024-04-24T13:33:52.573 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236461+0000", 2024-04-24T13:33:52.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.789e-05 2024-04-24T13:33:52.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.574 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236562+0000", 2024-04-24T13:33:52.574 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100352 2024-04-24T13:33:52.574 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.574 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.574 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236842+0000", 2024-04-24T13:33:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027979399999999998 2024-04-24T13:33:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.237091+0000", 2024-04-24T13:33:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024988499999999998 2024-04-24T13:33:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.246295+0000", 2024-04-24T13:33:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0092031279999999997 2024-04-24T13:33:52.575 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.259775+0000", 2024-04-24T13:33:52.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013480634 2024-04-24T13:33:52.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.576 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.576 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.576 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.259922+0000", 2024-04-24T13:33:52.576 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146565 2024-04-24T13:33:52.576 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.577 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.577 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.577 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.260068+0000", 2024-04-24T13:33:52.577 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146279 2024-04-24T13:33:52.577 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.577 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.577 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.578 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.578 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.578 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2706 3.1c 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:52.578 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:33:52.578 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.090061314000003, 2024-04-24T13:33:52.578 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027254180999999999, 2024-04-24T13:33:52.579 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.579 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.579 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.579 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.579 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.580 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.580 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-24T13:33:52.580 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.580 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.580 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.580 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.580 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:33:52.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:33:52.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.581 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.581 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.581 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469086+0000", 2024-04-24T13:33:52.581 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6100000000000002e-06 2024-04-24T13:33:52.581 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473145+0000", 2024-04-24T13:33:52.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040598769999999999 2024-04-24T13:33:52.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.582 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.582 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.582 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473180+0000", 2024-04-24T13:33:52.582 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4345999999999999e-05 2024-04-24T13:33:52.582 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473197+0000", 2024-04-24T13:33:52.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.721e-05 2024-04-24T13:33:52.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.583 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473377+0000", 2024-04-24T13:33:52.583 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000179805 2024-04-24T13:33:52.583 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.583 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.583 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473830+0000", 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045276700000000002 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.474315+0000", 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000485842 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.485841+0000", 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011525822 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.584 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496030+0000", 2024-04-24T13:33:52.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010188401 2024-04-24T13:33:52.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496205+0000", 2024-04-24T13:33:52.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000175632 2024-04-24T13:33:52.585 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.585 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.585 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.585 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496336+0000", 2024-04-24T13:33:52.585 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013086900000000001 2024-04-24T13:33:52.586 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.586 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.586 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.586 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.586 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.586 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2752 3.1c 3:3ae15365:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:52.586 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:33:52.586 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 46.604838315000002, 2024-04-24T13:33:52.586 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027425952, 2024-04-24T13:33:52.586 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.586 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.586 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.586 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2752 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:33:52.587 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954308+0000", 2024-04-24T13:33:52.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3100000000000001e-06 2024-04-24T13:33:52.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.588 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959305+0000", 2024-04-24T13:33:52.588 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049969649999999999 2024-04-24T13:33:52.588 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.588 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.588 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959349+0000", 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3590000000000001e-05 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959375+0000", 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6268999999999999e-05 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959561+0000", 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018558600000000001 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.589 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959821+0000", 2024-04-24T13:33:52.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000260704 2024-04-24T13:33:52.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:52.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.960063+0000", 2024-04-24T13:33:52.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024149499999999999 2024-04-24T13:33:52.590 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.590 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.590 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.590 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.974409+0000", 2024-04-24T13:33:52.590 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014345689999999999 2024-04-24T13:33:52.591 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.591 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981424+0000", 2024-04-24T13:33:52.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070159250000000001 2024-04-24T13:33:52.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981651+0000", 2024-04-24T13:33:52.592 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022641499999999999 2024-04-24T13:33:52.592 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.592 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.592 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.592 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981731+0000", 2024-04-24T13:33:52.593 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0003e-05 2024-04-24T13:33:52.593 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.593 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.593 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.593 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.593 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.593 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2772 3.1a 3:589df240:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:52.593 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:06.151960+0000", 2024-04-24T13:33:52.594 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 46.407183478999997, 2024-04-24T13:33:52.594 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024913555, 2024-04-24T13:33:52.594 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.594 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.594 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.594 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.594 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2772 2024-04-24T13:33:52.594 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.594 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.151960+0000", 2024-04-24T13:33:52.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.151960+0000", 2024-04-24T13:33:52.595 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.595 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.595 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.595 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.595 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.151963+0000", 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8729999999999999e-06 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.157999+0000", 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060360609999999997 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158051+0000", 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2283000000000001e-05 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.596 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158078+0000", 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7163000000000001e-05 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158261+0000", 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182342 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158680+0000", 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041904000000000003 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.597 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:52.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.159122+0000", 2024-04-24T13:33:52.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044224599999999998 2024-04-24T13:33:52.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.172894+0000", 2024-04-24T13:33:52.598 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013771782 2024-04-24T13:33:52.598 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.598 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.598 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.598 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.176730+0000", 2024-04-24T13:33:52.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038359940000000001 2024-04-24T13:33:52.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.176810+0000", 2024-04-24T13:33:52.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9985000000000001e-05 2024-04-24T13:33:52.599 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.599 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.599 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.599 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.176873+0000", 2024-04-24T13:33:52.599 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3786000000000002e-05 2024-04-24T13:33:52.600 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.600 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.600 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.600 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.600 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.600 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2817 3.13 3:c886ce92:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:52.600 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:06.637721+0000", 2024-04-24T13:33:52.600 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 45.921422081000003, 2024-04-24T13:33:52.600 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024927993999999998, 2024-04-24T13:33:52.600 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.600 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.600 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.600 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.601 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.601 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2817 2024-04-24T13:33:52.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.601 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.601 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.601 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.601 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.637721+0000", 2024-04-24T13:33:52.601 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.601 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.637721+0000", 2024-04-24T13:33:52.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.602 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.637725+0000", 2024-04-24T13:33:52.602 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8229999999999997e-06 2024-04-24T13:33:52.602 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.602 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.602 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642579+0000", 2024-04-24T13:33:52.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048544010000000004 2024-04-24T13:33:52.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642615+0000", 2024-04-24T13:33:52.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5392999999999998e-05 2024-04-24T13:33:52.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.603 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.603 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.603 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642634+0000", 2024-04-24T13:33:52.603 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8933e-05 2024-04-24T13:33:52.603 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642774+0000", 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014001199999999999 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.643201+0000", 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042696999999999999 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.643553+0000", 2024-04-24T13:33:52.604 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035225099999999999 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.660632+0000", 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017079436999999999 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.662499+0000", 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001866611 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.605 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.662591+0000", 2024-04-24T13:33:52.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1762999999999995e-05 2024-04-24T13:33:52.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.606 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.606 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.662649+0000", 2024-04-24T13:33:52.606 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8400000000000003e-05 2024-04-24T13:33:52.606 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.606 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.606 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.606 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.606 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.606 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3091 3.9 3:91019aa3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:52.606 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.991906367999999, 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026195184999999999, 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3091 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.607 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567241+0000", 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7570000000000002e-06 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.608 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575380+0000", 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081391740000000008 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575427+0000", 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6839999999999999e-05 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575451+0000", 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4329999999999999e-05 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.609 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575651+0000", 2024-04-24T13:33:52.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020028400000000001 2024-04-24T13:33:52.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.610 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576089+0000", 2024-04-24T13:33:52.610 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043775699999999999 2024-04-24T13:33:52.610 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.610 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.610 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:52.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576498+0000", 2024-04-24T13:33:52.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040853999999999999 2024-04-24T13:33:52.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.592857+0000", 2024-04-24T13:33:52.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016359097 2024-04-24T13:33:52.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.611 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.611 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.611 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593257+0000", 2024-04-24T13:33:52.611 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000400553 2024-04-24T13:33:52.611 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.612 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593358+0000", 2024-04-24T13:33:52.612 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010064 2024-04-24T13:33:52.612 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.612 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.612 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.613 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593432+0000", 2024-04-24T13:33:52.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4213000000000002e-05 2024-04-24T13:33:52.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.613 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.613 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.613 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.613 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.613 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3093 3.9 3:918af506:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_8:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:52.613 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.586455+0000", 2024-04-24T13:33:52.613 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.972688083000001, 2024-04-24T13:33:52.613 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024560463000000001, 2024-04-24T13:33:52.613 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.613 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.614 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.614 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.614 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3093 2024-04-24T13:33:52.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.614 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.614 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.614 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.586455+0000", 2024-04-24T13:33:52.614 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.614 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.614 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.586455+0000", 2024-04-24T13:33:52.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.586459+0000", 2024-04-24T13:33:52.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4400000000000001e-06 2024-04-24T13:33:52.615 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.615 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.615 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.615 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593639+0000", 2024-04-24T13:33:52.615 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0071801740000000001 2024-04-24T13:33:52.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593670+0000", 2024-04-24T13:33:52.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1186999999999998e-05 2024-04-24T13:33:52.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.616 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.616 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593685+0000", 2024-04-24T13:33:52.616 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5302999999999999e-05 2024-04-24T13:33:52.616 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.616 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593801+0000", 2024-04-24T13:33:52.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115949 2024-04-24T13:33:52.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.594038+0000", 2024-04-24T13:33:52.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000237078 2024-04-24T13:33:52.617 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.617 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.617 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:52.617 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.594259+0000", 2024-04-24T13:33:52.617 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022082800000000001 2024-04-24T13:33:52.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.607515+0000", 2024-04-24T13:33:52.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013255829 2024-04-24T13:33:52.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.618 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.618 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.610697+0000", 2024-04-24T13:33:52.618 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0031818879999999999 2024-04-24T13:33:52.618 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.618 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.610884+0000", 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018670199999999999 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.611016+0000", 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013208499999999999 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.619 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3121 3.e 3:70900501:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.648502928999999, 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026429009, 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3121 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.620 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:33:52.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.621 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:33:52.621 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.621 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.621 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.621 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910644+0000", 2024-04-24T13:33:52.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2270000000000002e-06 2024-04-24T13:33:52.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914662+0000", 2024-04-24T13:33:52.622 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040188539999999997 2024-04-24T13:33:52.622 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.622 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.622 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.622 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914705+0000", 2024-04-24T13:33:52.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2562999999999999e-05 2024-04-24T13:33:52.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914726+0000", 2024-04-24T13:33:52.623 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0996e-05 2024-04-24T13:33:52.623 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.623 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.623 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.623 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914911+0000", 2024-04-24T13:33:52.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018524500000000001 2024-04-24T13:33:52.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.915177+0000", 2024-04-24T13:33:52.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026601100000000003 2024-04-24T13:33:52.624 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.624 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.624 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:52.624 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.915402+0000", 2024-04-24T13:33:52.624 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224928 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.925683+0000", 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010280821000000001 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.936831+0000", 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011148362 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.625 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.936987+0000", 2024-04-24T13:33:52.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155749 2024-04-24T13:33:52.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.626 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.626 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.937069+0000", 2024-04-24T13:33:52.626 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2253e-05 2024-04-24T13:33:52.626 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.626 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.626 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.626 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.626 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.626 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3123 3.13 3:ca3e100b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.629241143000002, 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029312213, 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3123 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.627 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929905+0000", 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6970000000000002e-06 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.628 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933842+0000", 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039367320000000001 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933877+0000", 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.561e-05 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933894+0000", 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7212999999999999e-05 2024-04-24T13:33:52.629 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934030+0000", 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013565199999999999 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934295+0000", 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000265235 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934540+0000", 2024-04-24T13:33:52.630 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024482399999999999 2024-04-24T13:33:52.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.957909+0000", 2024-04-24T13:33:52.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023368684000000001 2024-04-24T13:33:52.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.631 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.631 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.631 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959004+0000", 2024-04-24T13:33:52.631 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010949709999999999 2024-04-24T13:33:52.631 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959124+0000", 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012061900000000001 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959214+0000", 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9975999999999994e-05 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.632 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.633 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3140 3.13 3:cb1b51c5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:52.633 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:29.122081+0000", 2024-04-24T13:33:52.633 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.437062564000001, 2024-04-24T13:33:52.633 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024992602999999999, 2024-04-24T13:33:52.633 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.633 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.633 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.633 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.633 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.633 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.633 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3140 2024-04-24T13:33:52.633 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.634 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.122081+0000", 2024-04-24T13:33:52.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.634 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.634 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.122081+0000", 2024-04-24T13:33:52.634 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.634 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.634 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.122084+0000", 2024-04-24T13:33:52.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0029999999999999e-06 2024-04-24T13:33:52.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126170+0000", 2024-04-24T13:33:52.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040860200000000001 2024-04-24T13:33:52.635 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.635 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.635 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.635 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126206+0000", 2024-04-24T13:33:52.635 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6672999999999999e-05 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126225+0000", 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8114e-05 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126363+0000", 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013847800000000001 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126618+0000", 2024-04-24T13:33:52.636 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025469499999999999 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126861+0000", 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000243408 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.136738+0000", 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098770560000000004 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.146717+0000", 2024-04-24T13:33:52.637 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099784629999999999 2024-04-24T13:33:52.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.146923+0000", 2024-04-24T13:33:52.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020675199999999999 2024-04-24T13:33:52.638 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.638 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.638 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.638 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.147073+0000", 2024-04-24T13:33:52.638 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014994100000000001 2024-04-24T13:33:52.638 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.638 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.639 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.639 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.639 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.639 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3431 3.9 3:910e1c92:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_329:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:52.639 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.851638+0000", 2024-04-24T13:33:52.639 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.707505161, 2024-04-24T13:33:52.639 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024517051000000002, 2024-04-24T13:33:52.639 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.639 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.639 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.639 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.639 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.639 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3431 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.851638+0000", 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.851638+0000", 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.640 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.851642+0000", 2024-04-24T13:33:52.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6799999999999999e-06 2024-04-24T13:33:52.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.641 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.641 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.641 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857208+0000", 2024-04-24T13:33:52.641 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055657950000000001 2024-04-24T13:33:52.641 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857250+0000", 2024-04-24T13:33:52.642 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2530000000000001e-05 2024-04-24T13:33:52.642 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.642 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.642 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.642 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857272+0000", 2024-04-24T13:33:52.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2042999999999999e-05 2024-04-24T13:33:52.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.643 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.643 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857440+0000", 2024-04-24T13:33:52.643 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016773499999999999 2024-04-24T13:33:52.643 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.643 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.857796+0000", 2024-04-24T13:33:52.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035583700000000002 2024-04-24T13:33:52.644 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.644 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.644 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:52.644 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.858038+0000", 2024-04-24T13:33:52.644 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000242138 2024-04-24T13:33:52.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.645 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.645 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.873499+0000", 2024-04-24T13:33:52.645 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015461228 2024-04-24T13:33:52.645 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.645 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.646 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.646 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.875780+0000", 2024-04-24T13:33:52.646 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0022812610000000001 2024-04-24T13:33:52.646 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.646 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.875972+0000", 2024-04-24T13:33:52.647 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019177899999999999 2024-04-24T13:33:52.647 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.647 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.647 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.647 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876155+0000", 2024-04-24T13:33:52.648 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018302499999999999 2024-04-24T13:33:52.648 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.648 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.648 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.648 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.648 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.648 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3433 3.34 3:2ce81ea4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_331:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:52.649 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:33:52.649 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.688831115999999, 2024-04-24T13:33:52.649 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026583214000000001, 2024-04-24T13:33:52.649 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.649 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.649 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.649 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.650 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.650 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3433 2024-04-24T13:33:52.650 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.650 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.650 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.650 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:33:52.651 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.651 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.651 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.651 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.651 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:33:52.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.652 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.652 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.652 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.652 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870316+0000", 2024-04-24T13:33:52.652 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.16e-06 2024-04-24T13:33:52.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.653 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.653 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876622+0000", 2024-04-24T13:33:52.653 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063053919999999999 2024-04-24T13:33:52.653 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.653 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876650+0000", 2024-04-24T13:33:52.654 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8007000000000001e-05 2024-04-24T13:33:52.654 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.654 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.654 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.654 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876669+0000", 2024-04-24T13:33:52.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8972999999999999e-05 2024-04-24T13:33:52.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876789+0000", 2024-04-24T13:33:52.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119849 2024-04-24T13:33:52.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.655 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.655 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.655 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.877065+0000", 2024-04-24T13:33:52.655 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276407 2024-04-24T13:33:52.655 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.877304+0000", 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023901799999999999 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.890409+0000", 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013105047 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896721+0000", 2024-04-24T13:33:52.656 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063118360000000004 2024-04-24T13:33:52.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896819+0000", 2024-04-24T13:33:52.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7728999999999999e-05 2024-04-24T13:33:52.657 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.657 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.657 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.657 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896895+0000", 2024-04-24T13:33:52.657 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6796000000000001e-05 2024-04-24T13:33:52.657 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.658 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.658 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.658 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.658 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.658 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3463 3.39 e113/41 3:9e84137f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_361:head v 113'19, mlcod=113'17)", 2024-04-24T13:33:52.658 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:33:52.658 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.386334303000002, 2024-04-24T13:33:52.658 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025926719000000001, 2024-04-24T13:33:52.658 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.658 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.658 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.658 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:33:52.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.659 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.659 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:33:52.659 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.659 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.659 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172811+0000", 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1160000000000002e-06 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177659+0000", 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048481549999999998 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177694+0000", 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4473e-05 2024-04-24T13:33:52.660 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177717+0000", 2024-04-24T13:33:52.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3750000000000001e-05 2024-04-24T13:33:52.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177886+0000", 2024-04-24T13:33:52.661 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000168405 2024-04-24T13:33:52.661 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.661 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.661 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.661 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177925+0000", 2024-04-24T13:33:52.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9555999999999999e-05 2024-04-24T13:33:52.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.198662+0000", 2024-04-24T13:33:52.662 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020736167999999999 2024-04-24T13:33:52.662 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.662 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.662 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.662 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.198736+0000", 2024-04-24T13:33:52.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4096000000000003e-05 2024-04-24T13:33:52.663 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.663 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.663 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.663 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.663 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.663 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3469 3.3 3:c2771714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_367:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:52.663 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:33:52.663 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.327098757999998, 2024-04-24T13:33:52.663 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028440263, 2024-04-24T13:33:52.663 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.663 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3469 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.664 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:33:52.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.665 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.665 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232047+0000", 2024-04-24T13:33:52.665 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4669999999999998e-06 2024-04-24T13:33:52.665 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.665 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.237943+0000", 2024-04-24T13:33:52.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058964320000000001 2024-04-24T13:33:52.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.666 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.237979+0000", 2024-04-24T13:33:52.666 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5907e-05 2024-04-24T13:33:52.666 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.666 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.666 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238000+0000", 2024-04-24T13:33:52.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0536000000000001e-05 2024-04-24T13:33:52.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238104+0000", 2024-04-24T13:33:52.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010404300000000001 2024-04-24T13:33:52.667 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.667 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.667 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.667 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238355+0000", 2024-04-24T13:33:52.667 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000250881 2024-04-24T13:33:52.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:52.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238590+0000", 2024-04-24T13:33:52.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000235388 2024-04-24T13:33:52.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.668 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.248777+0000", 2024-04-24T13:33:52.668 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010187244 2024-04-24T13:33:52.668 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.668 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.668 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260299+0000", 2024-04-24T13:33:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011521933 2024-04-24T13:33:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260403+0000", 2024-04-24T13:33:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010400600000000001 2024-04-24T13:33:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260485+0000", 2024-04-24T13:33:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1426000000000003e-05 2024-04-24T13:33:52.669 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.670 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.670 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.670 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.670 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3501 3.24 e114/20 3:27356806:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_399:head v 114'14, mlcod=113'12)", 2024-04-24T13:33:52.670 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:33:52.670 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.995895130000001, 2024-04-24T13:33:52.670 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026449908000000001, 2024-04-24T13:33:52.670 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.670 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.670 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.670 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.670 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563249+0000", 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9299999999999998e-07 2024-04-24T13:33:52.671 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568259+0000", 2024-04-24T13:33:52.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050107759999999998 2024-04-24T13:33:52.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.672 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.672 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.672 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568292+0000", 2024-04-24T13:33:52.672 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2892999999999998e-05 2024-04-24T13:33:52.672 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568310+0000", 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7819e-05 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568429+0000", 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011896999999999999 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568469+0000", 2024-04-24T13:33:52.673 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9739e-05 2024-04-24T13:33:52.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.589582+0000", 2024-04-24T13:33:52.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021113072 2024-04-24T13:33:52.674 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.674 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.674 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.674 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.589698+0000", 2024-04-24T13:33:52.674 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116146 2024-04-24T13:33:52.674 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.674 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.675 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.675 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.675 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.675 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3509 3.39 e114/41 3:9cf0e09a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_407:head v 114'21, mlcod=113'19)", 2024-04-24T13:33:52.675 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.652439+0000", 2024-04-24T13:33:52.675 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.906703924999999, 2024-04-24T13:33:52.675 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025495436, 2024-04-24T13:33:52.675 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.675 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.675 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.652439+0000", 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.652439+0000", 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.676 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.652441+0000", 2024-04-24T13:33:52.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.03e-06 2024-04-24T13:33:52.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656544+0000", 2024-04-24T13:33:52.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041031030000000003 2024-04-24T13:33:52.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.677 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.677 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656570+0000", 2024-04-24T13:33:52.677 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5996999999999999e-05 2024-04-24T13:33:52.677 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.677 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656583+0000", 2024-04-24T13:33:52.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2935999999999999e-05 2024-04-24T13:33:52.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656723+0000", 2024-04-24T13:33:52.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139226 2024-04-24T13:33:52.678 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.678 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.678 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.678 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656763+0000", 2024-04-24T13:33:52.678 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0655999999999998e-05 2024-04-24T13:33:52.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.677805+0000", 2024-04-24T13:33:52.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021042079000000002 2024-04-24T13:33:52.679 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.679 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.679 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.679 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.677935+0000", 2024-04-24T13:33:52.679 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012940900000000001 2024-04-24T13:33:52.679 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.679 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.680 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.680 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.680 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.680 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3534 3.34 3:2c938e61:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_432:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:52.680 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.899747+0000", 2024-04-24T13:33:52.680 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.659396232999999, 2024-04-24T13:33:52.680 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025402460000000002, 2024-04-24T13:33:52.680 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.680 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.680 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.681 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.681 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.681 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.681 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3534 2024-04-24T13:33:52.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.681 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.681 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.899747+0000", 2024-04-24T13:33:52.681 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.681 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.681 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.681 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.899747+0000", 2024-04-24T13:33:52.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.899751+0000", 2024-04-24T13:33:52.682 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9269999999999998e-06 2024-04-24T13:33:52.682 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.682 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.682 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.682 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.905900+0000", 2024-04-24T13:33:52.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061494890000000002 2024-04-24T13:33:52.683 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.683 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.683 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.683 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.905936+0000", 2024-04-24T13:33:52.683 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5196e-05 2024-04-24T13:33:52.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.684 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.684 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.905955+0000", 2024-04-24T13:33:52.684 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8913999999999999e-05 2024-04-24T13:33:52.684 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.684 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.685 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.685 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.906122+0000", 2024-04-24T13:33:52.685 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000167715 2024-04-24T13:33:52.685 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.685 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.686 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.906540+0000", 2024-04-24T13:33:52.686 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041803599999999999 2024-04-24T13:33:52.686 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.686 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.686 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:52.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.906963+0000", 2024-04-24T13:33:52.687 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042224 2024-04-24T13:33:52.687 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.687 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.687 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.687 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.924057+0000", 2024-04-24T13:33:52.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017094272000000001 2024-04-24T13:33:52.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.688 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.688 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.688 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.924812+0000", 2024-04-24T13:33:52.688 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075491399999999998 2024-04-24T13:33:52.688 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.689 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.689 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.925002+0000", 2024-04-24T13:33:52.689 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190101 2024-04-24T13:33:52.689 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.689 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.690 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.690 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.925149+0000", 2024-04-24T13:33:52.690 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147656 2024-04-24T13:33:52.690 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.690 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.690 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.691 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.691 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.691 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3585 3.11 3:88ded408:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_482:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:52.691 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:33:52.691 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.158821061000001, 2024-04-24T13:33:52.691 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034777737000000003, 2024-04-24T13:33:52.692 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.692 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.692 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.692 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.692 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.693 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.693 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3585 2024-04-24T13:33:52.693 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.693 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.693 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.693 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.693 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:33:52.693 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:33:52.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.694 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400326+0000", 2024-04-24T13:33:52.694 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9330000000000003e-06 2024-04-24T13:33:52.694 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.694 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.694 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404462+0000", 2024-04-24T13:33:52.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041354130000000001 2024-04-24T13:33:52.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404537+0000", 2024-04-24T13:33:52.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5282000000000002e-05 2024-04-24T13:33:52.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.695 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.695 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.695 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404565+0000", 2024-04-24T13:33:52.695 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7797000000000002e-05 2024-04-24T13:33:52.695 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404716+0000", 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015126500000000001 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.405051+0000", 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033540099999999998 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.405296+0000", 2024-04-24T13:33:52.696 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024506099999999998 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.429261+0000", 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023964485000000001 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.434796+0000", 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055355559999999996 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.697 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.434949+0000", 2024-04-24T13:33:52.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015286499999999999 2024-04-24T13:33:52.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.698 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.698 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.435100+0000", 2024-04-24T13:33:52.698 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000150679 2024-04-24T13:33:52.698 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.698 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.698 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.698 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.698 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.698 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3586 3.11 3:89fac597:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_483:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.147534879999998, 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028873106999999999, 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3586 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.699 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:33:52.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:33:52.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.700 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.700 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.700 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.700 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411611+0000", 2024-04-24T13:33:52.700 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7930000000000002e-06 2024-04-24T13:33:52.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415739+0000", 2024-04-24T13:33:52.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00412751 2024-04-24T13:33:52.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.701 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415776+0000", 2024-04-24T13:33:52.701 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7082999999999997e-05 2024-04-24T13:33:52.701 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.701 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.701 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415795+0000", 2024-04-24T13:33:52.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9539999999999999e-05 2024-04-24T13:33:52.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418234+0000", 2024-04-24T13:33:52.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024391310000000002 2024-04-24T13:33:52.702 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.702 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.702 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:52.702 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418476+0000", 2024-04-24T13:33:52.702 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000242026 2024-04-24T13:33:52.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:52.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418697+0000", 2024-04-24T13:33:52.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000220564 2024-04-24T13:33:52.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.703 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:52.703 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.432206+0000", 2024-04-24T13:33:52.703 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013508922 2024-04-24T13:33:52.703 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.703 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:52.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440330+0000", 2024-04-24T13:33:52.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081238649999999992 2024-04-24T13:33:52.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:52.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440414+0000", 2024-04-24T13:33:52.704 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4270999999999993e-05 2024-04-24T13:33:52.704 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.704 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.704 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:52.704 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440481+0000", 2024-04-24T13:33:52.705 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7402000000000003e-05 2024-04-24T13:33:52.705 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.705 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.705 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.705 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.705 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.705 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:52.706 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:33:52.707 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:52.706+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:52.807 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:52.805+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:52.898 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:52.898 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:33:52.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.898 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "MOSDPGPushReply(3.2f 128/124 [PushReplyOp(3:f64a1145:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_202:head)])", 2024-04-24T13:33:52.898 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:52.897176+0000", 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.0017555030000000001, 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001791139, 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "reached pg", 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:52.897176+0000", 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:52.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:52.897176+0000", 2024-04-24T13:33:52.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:52.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:52.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:52.897177+0000", 2024-04-24T13:33:52.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1999999999999999e-06 2024-04-24T13:33:52.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:52.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:52.897186+0000", 2024-04-24T13:33:52.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9039999999999998e-06 2024-04-24T13:33:52.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:52.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:52.897212+0000", 2024-04-24T13:33:52.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5367999999999998e-05 2024-04-24T13:33:52.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:52.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:52.897227+0000", 2024-04-24T13:33:52.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4806e-05 2024-04-24T13:33:52.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:52.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:52.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:52.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:52.897307+0000", 2024-04-24T13:33:52.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0791999999999995e-05 2024-04-24T13:33:52.902 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.902 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:52.902 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.902 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:52.902 INFO:teuthology.orchestra.run.smithi138.stdout: ], 2024-04-24T13:33:52.902 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 1 2024-04-24T13:33:52.902 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:52.908 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:52.905+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:52.918 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:33:53.009 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:53.006+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:53.080 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:33:53.100 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:33:53.100 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:33:53.101 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:53.119 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:33:53.127 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:53.126+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:53.211 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:53.210+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:53.221 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:53.221 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:53.252 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:53.252 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:53.267 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:53.267 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:33:53.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:33:53.268 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:33:53.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.268 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2251 3.3a 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:53.268 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:33:53.268 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 84.431698670000003, 2024-04-24T13:33:53.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030524880000000001, 2024-04-24T13:33:53.268 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.268 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.268 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.268 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.268 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.269 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.269 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2251 2024-04-24T13:33:53.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.269 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:33:53.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:33:53.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834880+0000", 2024-04-24T13:33:53.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6769999999999999e-06 2024-04-24T13:33:53.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839556+0000", 2024-04-24T13:33:53.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046751350000000004 2024-04-24T13:33:53.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839593+0000", 2024-04-24T13:33:53.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7079999999999997e-05 2024-04-24T13:33:53.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839617+0000", 2024-04-24T13:33:53.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4015999999999998e-05 2024-04-24T13:33:53.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839773+0000", 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015627699999999999 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840011+0000", 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023843900000000001 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840261+0000", 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024939899999999997 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.853562+0000", 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013301726999999999 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865276+0000", 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011713779000000001 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865349+0000", 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2624000000000001e-05 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865403+0000", 2024-04-24T13:33:53.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3727000000000002e-05 2024-04-24T13:33:53.274 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.274 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.274 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.274 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2665 3.1d 3:b85990f0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:53.274 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.162820+0000", 2024-04-24T13:33:53.274 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 48.103756529999998, 2024-04-24T13:33:53.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031707361000000003, 2024-04-24T13:33:53.274 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2665 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.162820+0000", 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.162820+0000", 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.162824+0000", 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.997e-06 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171282+0000", 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084578310000000007 2024-04-24T13:33:53.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171325+0000", 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3183000000000003e-05 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171346+0000", 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0976999999999999e-05 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171546+0000", 2024-04-24T13:33:53.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020003100000000001 2024-04-24T13:33:53.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171818+0000", 2024-04-24T13:33:53.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027171500000000001 2024-04-24T13:33:53.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:53.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.172172+0000", 2024-04-24T13:33:53.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035402699999999998 2024-04-24T13:33:53.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.188938+0000", 2024-04-24T13:33:53.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016766519000000001 2024-04-24T13:33:53.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.194193+0000", 2024-04-24T13:33:53.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052545140000000001 2024-04-24T13:33:53.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.194379+0000", 2024-04-24T13:33:53.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000186212 2024-04-24T13:33:53.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.194527+0000", 2024-04-24T13:33:53.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148355 2024-04-24T13:33:53.281 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.281 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.281 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.282 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2688 3.3a 3:5c6b1f96:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_27:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:53.282 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.390932+0000", 2024-04-24T13:33:53.282 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.875643934999999, 2024-04-24T13:33:53.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026775021999999999, 2024-04-24T13:33:53.283 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.283 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.283 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.283 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.283 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.283 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.283 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2688 2024-04-24T13:33:53.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.283 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.390932+0000", 2024-04-24T13:33:53.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.390932+0000", 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.390954+0000", 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1993000000000001e-05 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.395625+0000", 2024-04-24T13:33:53.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046703819999999998 2024-04-24T13:33:53.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.395671+0000", 2024-04-24T13:33:53.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6360000000000003e-05 2024-04-24T13:33:53.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.395690+0000", 2024-04-24T13:33:53.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9156000000000001e-05 2024-04-24T13:33:53.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.395858+0000", 2024-04-24T13:33:53.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016796899999999999 2024-04-24T13:33:53.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.396141+0000", 2024-04-24T13:33:53.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000282491 2024-04-24T13:33:53.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:53.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.396376+0000", 2024-04-24T13:33:53.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023479800000000001 2024-04-24T13:33:53.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.409413+0000", 2024-04-24T13:33:53.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013037686999999999 2024-04-24T13:33:53.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.417525+0000", 2024-04-24T13:33:53.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081113699999999997 2024-04-24T13:33:53.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.417626+0000", 2024-04-24T13:33:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010090300000000001 2024-04-24T13:33:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.417707+0000", 2024-04-24T13:33:53.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1913e-05 2024-04-24T13:33:53.292 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.292 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.292 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.292 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2726 3.3c 3:3c53550d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.682300+0000", 2024-04-24T13:33:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 47.584276039999999, 2024-04-24T13:33:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032107164000000001, 2024-04-24T13:33:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.293 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2726 2024-04-24T13:33:53.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.295 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.682300+0000", 2024-04-24T13:33:53.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.682300+0000", 2024-04-24T13:33:53.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.682304+0000", 2024-04-24T13:33:53.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6270000000000002e-06 2024-04-24T13:33:53.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.687934+0000", 2024-04-24T13:33:53.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056300899999999999 2024-04-24T13:33:53.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.687976+0000", 2024-04-24T13:33:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1542999999999998e-05 2024-04-24T13:33:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.687995+0000", 2024-04-24T13:33:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9326000000000001e-05 2024-04-24T13:33:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.688149+0000", 2024-04-24T13:33:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015422299999999999 2024-04-24T13:33:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:33:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.688160+0000", 2024-04-24T13:33:53.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0723000000000001e-05 2024-04-24T13:33:53.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.691501+0000", 2024-04-24T13:33:53.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033414619999999999 2024-04-24T13:33:53.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.691704+0000", 2024-04-24T13:33:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020224899999999999 2024-04-24T13:33:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.691913+0000", 2024-04-24T13:33:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020945800000000001 2024-04-24T13:33:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.711338+0000", 2024-04-24T13:33:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019425141999999999 2024-04-24T13:33:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.714104+0000", 2024-04-24T13:33:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027660340000000001 2024-04-24T13:33:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.714273+0000", 2024-04-24T13:33:53.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016885500000000001 2024-04-24T13:33:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.714407+0000", 2024-04-24T13:33:53.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134432 2024-04-24T13:33:53.307 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.307 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.307 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.307 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3088 3.2f 3:f713650a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:53.307 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.537981+0000", 2024-04-24T13:33:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.728595425999998, 2024-04-24T13:33:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029051113999999999, 2024-04-24T13:33:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.308 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3088 2024-04-24T13:33:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.537981+0000", 2024-04-24T13:33:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.537981+0000", 2024-04-24T13:33:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.537983+0000", 2024-04-24T13:33:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3499999999999999e-06 2024-04-24T13:33:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546609+0000", 2024-04-24T13:33:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086254480000000008 2024-04-24T13:33:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546652+0000", 2024-04-24T13:33:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3346000000000001e-05 2024-04-24T13:33:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546671+0000", 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8899999999999999e-05 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546852+0000", 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000181318 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.547138+0000", 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028545099999999999 2024-04-24T13:33:53.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.547379+0000", 2024-04-24T13:33:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024102800000000001 2024-04-24T13:33:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.565501+0000", 2024-04-24T13:33:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018122406000000001 2024-04-24T13:33:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.566815+0000", 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001313579 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.566911+0000", 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6056000000000003e-05 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567032+0000", 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012123199999999999 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.315 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3089 3.17 e112/103 3:e81f13af:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_4:head v 112'10, mlcod=102'8)", 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.550578+0000", 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.715998694, 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025883415999999999, 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.550578+0000", 2024-04-24T13:33:53.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.550578+0000", 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.550580+0000", 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3630000000000001e-06 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.560984+0000", 2024-04-24T13:33:53.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010404063 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.561019+0000", 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4659000000000001e-05 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.561035+0000", 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6586e-05 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.561147+0000", 2024-04-24T13:33:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111346 2024-04-24T13:33:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.561187+0000", 2024-04-24T13:33:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9879999999999998e-05 2024-04-24T13:33:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576330+0000", 2024-04-24T13:33:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015143386999999999 2024-04-24T13:33:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576461+0000", 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131132 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3090 3.36 e112/103 3:6dcd93d9:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_5:head v 112'10, mlcod=102'8)", 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.571193+0000", 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.695383070999998, 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029191265000000001, 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.320 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.571193+0000", 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.571193+0000", 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.571196+0000", 2024-04-24T13:33:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3860000000000001e-06 2024-04-24T13:33:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574406+0000", 2024-04-24T13:33:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032107809999999998 2024-04-24T13:33:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574468+0000", 2024-04-24T13:33:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1636000000000004e-05 2024-04-24T13:33:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574496+0000", 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-05 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574664+0000", 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000168185 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574703+0000", 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8318999999999997e-05 2024-04-24T13:33:53.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.600283+0000", 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025580226000000001 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.600385+0000", 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010160199999999999 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3107 3.16 3:6bf97696:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.764376+0000", 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.502199992000001, 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034648104999999998, 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3107 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.764376+0000", 2024-04-24T13:33:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.764376+0000", 2024-04-24T13:33:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.764380+0000", 2024-04-24T13:33:53.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1030000000000004e-06 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771397+0000", 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00701682 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771445+0000", 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7273e-05 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771465+0000", 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0506999999999999e-05 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771641+0000", 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000175661 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.772047+0000", 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040609000000000001 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.772460+0000", 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041274699999999998 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.793165+0000", 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020705128 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.798765+0000", 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055998250000000001 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.798903+0000", 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013819200000000001 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.799024+0000", 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121759 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.330 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3109 3.2a 3:54bfd822:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_24:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.789724+0000", 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.476852328, 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027841423000000001, 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3109 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.789724+0000", 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.789724+0000", 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.789728+0000", 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5099999999999999e-06 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.794177+0000", 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044491469999999997 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.794212+0000", 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5259999999999998e-05 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.794233+0000", 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.101e-05 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.794365+0000", 2024-04-24T13:33:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000132402 2024-04-24T13:33:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.794610+0000", 2024-04-24T13:33:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024423199999999999 2024-04-24T13:33:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.794836+0000", 2024-04-24T13:33:53.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022610100000000001 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.816153+0000", 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021317262999999999 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.817335+0000", 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011824769999999999 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.335 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.817438+0000", 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102939 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.817565+0000", 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012708199999999999 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3153 3.3a 3:5d66cd8d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_68:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:29.258930+0000", 2024-04-24T13:33:53.336 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.007646225999999, 2024-04-24T13:33:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025637142000000002, 2024-04-24T13:33:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3153 2024-04-24T13:33:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.258930+0000", 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.258930+0000", 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.258934+0000", 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.557e-06 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.263334+0000", 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044001839999999997 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.263364+0000", 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9807000000000001e-05 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.263384+0000", 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.056e-05 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.263519+0000", 2024-04-24T13:33:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013479200000000001 2024-04-24T13:33:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.263786+0000", 2024-04-24T13:33:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026703799999999999 2024-04-24T13:33:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.264074+0000", 2024-04-24T13:33:53.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028755399999999998 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.277687+0000", 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013613446 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.284293+0000", 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066059229999999997 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.284459+0000", 2024-04-24T13:33:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016623899999999999 2024-04-24T13:33:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.284567+0000", 2024-04-24T13:33:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010804200000000001 2024-04-24T13:33:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3166 3.5 3:a0bc589b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:53.342 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:29.415673+0000", 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.850903208999998, 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025463712999999999, 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3166 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.415673+0000", 2024-04-24T13:33:53.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.415673+0000", 2024-04-24T13:33:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.415677+0000", 2024-04-24T13:33:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5030000000000002e-06 2024-04-24T13:33:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.420615+0000", 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049380700000000001 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.420652+0000", 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6810000000000002e-05 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.420670+0000", 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8712999999999999e-05 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.420829+0000", 2024-04-24T13:33:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015834900000000001 2024-04-24T13:33:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.421234+0000", 2024-04-24T13:33:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040548 2024-04-24T13:33:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.421649+0000", 2024-04-24T13:33:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041469599999999999 2024-04-24T13:33:53.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.434762+0000", 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013113154 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.440830+0000", 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060679369999999998 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.441010+0000", 2024-04-24T13:33:53.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000179922 2024-04-24T13:33:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.441137+0000", 2024-04-24T13:33:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012707899999999999 2024-04-24T13:33:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3185 3.2f 3:f6424cca:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_100:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:29.616372+0000", 2024-04-24T13:33:53.348 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.650203984000001, 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025526185999999999, 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3185 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.616372+0000", 2024-04-24T13:33:53.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.616372+0000", 2024-04-24T13:33:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.616376+0000", 2024-04-24T13:33:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3900000000000002e-06 2024-04-24T13:33:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.620445+0000", 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040689109999999997 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.620486+0000", 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1452999999999998e-05 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.620506+0000", 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9599999999999999e-05 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.620686+0000", 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018018799999999999 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.620969+0000", 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028279100000000001 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.621202+0000", 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023289099999999999 2024-04-24T13:33:53.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.636973+0000", 2024-04-24T13:33:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015771186 2024-04-24T13:33:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.641579+0000", 2024-04-24T13:33:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046060060000000002 2024-04-24T13:33:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.641760+0000", 2024-04-24T13:33:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000180848 2024-04-24T13:33:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.641899+0000", 2024-04-24T13:33:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013892200000000001 2024-04-24T13:33:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3380 3.3a 3:5cb232f4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_285:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:53.354 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.346253+0000", 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 20.920323311000001, 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032318024000000001, 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3380 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.346253+0000", 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.346253+0000", 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.346257+0000", 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1699999999999999e-06 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.356 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350569+0000", 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043118740000000003 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350632+0000", 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2663000000000006e-05 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350665+0000", 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2895999999999998e-05 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350861+0000", 2024-04-24T13:33:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019607199999999999 2024-04-24T13:33:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.351303+0000", 2024-04-24T13:33:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044276299999999999 2024-04-24T13:33:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.351690+0000", 2024-04-24T13:33:53.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038655699999999999 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.362989+0000", 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011298475000000001 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.378400+0000", 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015411747999999999 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.378496+0000", 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6152999999999999e-05 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.378571+0000", 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4653000000000005e-05 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3420 3.c 3:30a790eb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_318:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.718876+0000", 2024-04-24T13:33:53.360 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 20.547700759000001, 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028978935000000001, 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3420 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.718876+0000", 2024-04-24T13:33:53.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.718876+0000", 2024-04-24T13:33:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.718895+0000", 2024-04-24T13:33:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9517e-05 2024-04-24T13:33:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.362 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728273+0000", 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093782440000000009 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728295+0000", 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1742999999999998e-05 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728312+0000", 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6413999999999999e-05 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728441+0000", 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129419 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728811+0000", 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037002299999999998 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.729054+0000", 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024291100000000001 2024-04-24T13:33:53.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.739199+0000", 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010145101 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.747523+0000", 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0083244700000000005 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.747721+0000", 2024-04-24T13:33:53.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019801399999999999 2024-04-24T13:33:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.747855+0000", 2024-04-24T13:33:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000133079 2024-04-24T13:33:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3483 3.c 3:3033c1b6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_381:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.370370+0000", 2024-04-24T13:33:53.366 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.896206642999999, 2024-04-24T13:33:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.043221212000000002, 2024-04-24T13:33:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3483 2024-04-24T13:33:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.370370+0000", 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.370370+0000", 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.370419+0000", 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9283000000000002e-05 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.368 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.374810+0000", 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043905979999999999 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.374848+0000", 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8041999999999999e-05 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.374871+0000", 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.379359+0000", 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044878909999999999 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.379749+0000", 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038957 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.380113+0000", 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000363834 2024-04-24T13:33:53.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.392454+0000", 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012341097000000001 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.413294+0000", 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020840033000000001 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.413471+0000", 2024-04-24T13:33:53.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000177579 2024-04-24T13:33:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.413591+0000", 2024-04-24T13:33:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119492 2024-04-24T13:33:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3520 3.3a 3:5c3c2822:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_418:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.756549+0000", 2024-04-24T13:33:53.372 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.510027156, 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027907472999999999, 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3520 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.756549+0000", 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.756549+0000", 2024-04-24T13:33:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.756554+0000", 2024-04-24T13:33:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3059999999999999e-06 2024-04-24T13:33:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.761743+0000", 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051890850000000004 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.761791+0000", 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8359999999999998e-05 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.761812+0000", 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1223e-05 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.761994+0000", 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018138200000000001 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.762425+0000", 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116600000000003 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.762848+0000", 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042281399999999998 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.773653+0000", 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010805682 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.784146+0000", 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010492837 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.784325+0000", 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017865900000000001 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.784457+0000", 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013195899999999999 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3537 3.1c 3:3b17e225:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_435:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.931231+0000", 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.335345085, 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025717324999999999, 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.378 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3537 2024-04-24T13:33:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.931231+0000", 2024-04-24T13:33:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.931231+0000", 2024-04-24T13:33:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.931234+0000", 2024-04-24T13:33:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.666e-06 2024-04-24T13:33:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.935539+0000", 2024-04-24T13:33:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043045729999999999 2024-04-24T13:33:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.935569+0000", 2024-04-24T13:33:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0522999999999999e-05 2024-04-24T13:33:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.935585+0000", 2024-04-24T13:33:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6045999999999998e-05 2024-04-24T13:33:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.935762+0000", 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017669499999999999 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.936191+0000", 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042953000000000002 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.936617+0000", 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042530999999999998 2024-04-24T13:33:53.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.952624+0000", 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016007812999999999 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.956625+0000", 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040003080000000002 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.956811+0000", 2024-04-24T13:33:53.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000186515 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.956949+0000", 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000137346 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3548 3.1d 3:bbc96e42:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_446:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.038024+0000", 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.228552042, 2024-04-24T13:33:53.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028372396000000001, 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3548 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.038024+0000", 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.038024+0000", 2024-04-24T13:33:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.038058+0000", 2024-04-24T13:33:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4042999999999999e-05 2024-04-24T13:33:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043019+0000", 2024-04-24T13:33:53.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049610390000000004 2024-04-24T13:33:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043092+0000", 2024-04-24T13:33:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2166e-05 2024-04-24T13:33:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043120+0000", 2024-04-24T13:33:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8390000000000001e-05 2024-04-24T13:33:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043309+0000", 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000189345 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043724+0000", 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041498700000000002 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.044164+0000", 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043983299999999999 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.057294+0000", 2024-04-24T13:33:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01313023 2024-04-24T13:33:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.066184+0000", 2024-04-24T13:33:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088898120000000004 2024-04-24T13:33:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.066284+0000", 2024-04-24T13:33:53.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9984999999999999e-05 2024-04-24T13:33:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.066397+0000", 2024-04-24T13:33:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011256600000000001 2024-04-24T13:33:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3571 3.d 3:b1ad9891:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_468:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.260486+0000", 2024-04-24T13:33:53.390 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 19.006090834999998, 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026174981, 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3571 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.260486+0000", 2024-04-24T13:33:53.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.260486+0000", 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.260489+0000", 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.366e-06 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.264517+0000", 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040285410000000001 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.264560+0000", 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2079999999999997e-05 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.264580+0000", 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0106e-05 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.264763+0000", 2024-04-24T13:33:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018310200000000001 2024-04-24T13:33:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.265073+0000", 2024-04-24T13:33:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00031075800000000001 2024-04-24T13:33:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.265309+0000", 2024-04-24T13:33:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023542100000000001 2024-04-24T13:33:53.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.282061+0000", 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016751683999999999 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.286487+0000", 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044259240000000004 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.286588+0000", 2024-04-24T13:33:53.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101803 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.286661+0000", 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2195999999999998e-05 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3584 3.1c 3:3bb2f2b7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_481:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.391716+0000", 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 18.874860860999998, 2024-04-24T13:33:53.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026180821, 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3584 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.391716+0000", 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.391716+0000", 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.391719+0000", 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7670000000000001e-06 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.396345+0000", 2024-04-24T13:33:53.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046257090000000004 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.396390+0000", 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5386000000000002e-05 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.396412+0000", 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1189999999999999e-05 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:53.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.396615+0000", 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000203635 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.396876+0000", 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026126799999999999 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.397110+0000", 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000233482 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:53.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.409752+0000", 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012641813 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.417667+0000", 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079150499999999999 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.417819+0000", 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015267500000000001 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:53.401 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.417896+0000", 2024-04-24T13:33:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6846000000000003e-05 2024-04-24T13:33:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:53.402 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:53.402 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:53.403 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:53.403 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:53.404 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:53.404 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:53.405 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:33:53.405 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:53.405 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:53.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:53.406 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:53.406 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:53.407 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:53.408 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:53.408 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:53.402+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:53.504 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:53.501+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:53.541 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:53.541 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:53.551 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set noscrub 2024-04-24T13:33:53.561 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:33:53.606 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:53.605+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:53.707 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:53.705+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:53.741 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:53.742 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:53.758 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:33:53.807 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:53.806+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:53.908 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:53.906+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:53.945 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:53.945 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:53.961 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:33:54.008 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:54.005+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:54.097 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:54.097 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:54.109 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:54.105+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:54.113 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:54.210 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:54.209+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:54.286 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:54.287 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:54.300 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:54.342 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:54.341+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:54.412 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:54.410+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:54.465 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:54.465 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:54.479 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:54.522 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:54.522+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:54.546 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is set 2024-04-24T13:33:54.598 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:54.598 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:54.611 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:54.655 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:54.654+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:54.715 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:54.714+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:54.777 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:54.777 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:54.791 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:54.816 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:54.813+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:54.917 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:54.914+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:54.961 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:54.961 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:54.975 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:55.021 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:55.017+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:55.122 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:55.121+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:55.174 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:55.174 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:55.191 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:33:55.238 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:55.238+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:55.324 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:55.322+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:55.332 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:55.332 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:55.351 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:33:55.408 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:33:55.441 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:55.438+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:55.526 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:55.522+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:55.539 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:55.539 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:55.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:33:55.627 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:55.624+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:55.673 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:55.673 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:55.692 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:55.693 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:55.715 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:55.715 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:55.727 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:55.726+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:55.748 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:55.748 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:55.753 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:55.753 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:55.753 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:55.753 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:55.775 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:33:55.776 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:55.776 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:55.817 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:55.817 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:55.828 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:55.824+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:55.859 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:55.859 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:55.885 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:55.885 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:55.917 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:55.917 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:55.917 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:55.929 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:55.924+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:55.937 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:33:56.030 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:56.026+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:56.111 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:56.111 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:56.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:56.111 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2206 3.f 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 87.819334169000001, 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028291495999999999, 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2206 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290398+0000", 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000001e-06 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294671+0000", 2024-04-24T13:33:56.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042724390000000003 2024-04-24T13:33:56.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294711+0000", 2024-04-24T13:33:56.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0376000000000001e-05 2024-04-24T13:33:56.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294730+0000", 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8607e-05 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294856+0000", 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126651 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295125+0000", 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026840700000000002 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:56.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295349+0000", 2024-04-24T13:33:56.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022454699999999999 2024-04-24T13:33:56.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307240+0000", 2024-04-24T13:33:56.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011891048 2024-04-24T13:33:56.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318593+0000", 2024-04-24T13:33:56.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011352777999999999 2024-04-24T13:33:56.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318652+0000", 2024-04-24T13:33:56.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8677000000000001e-05 2024-04-24T13:33:56.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318686+0000", 2024-04-24T13:33:56.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4616000000000002e-05 2024-04-24T13:33:56.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2710 3.3b 3:ddce91ac:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.597601101999999, 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026438756000000001, 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.118 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2710 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512131+0000", 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0130000000000002e-06 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514363+0000", 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022325940000000001 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514394+0000", 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0144000000000001e-05 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514409+0000", 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5786000000000001e-05 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514497+0000", 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7876999999999999e-05 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514670+0000", 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000173096 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:56.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514768+0000", 2024-04-24T13:33:56.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8089000000000002e-05 2024-04-24T13:33:56.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.523354+0000", 2024-04-24T13:33:56.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085854190000000004 2024-04-24T13:33:56.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.122 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538483+0000", 2024-04-24T13:33:56.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015128922 2024-04-24T13:33:56.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538527+0000", 2024-04-24T13:33:56.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3835999999999998e-05 2024-04-24T13:33:56.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538567+0000", 2024-04-24T13:33:56.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.998e-05 2024-04-24T13:33:56.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.123 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.123 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.124 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2808 3.2e 3:7441f999:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_137:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:56.124 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:56.124 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 49.578366400999997, 2024-04-24T13:33:56.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021413788, 2024-04-24T13:33:56.124 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.124 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.124 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.124 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.124 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.125 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.125 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2808 2024-04-24T13:33:56.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.125 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:56.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531363+0000", 2024-04-24T13:33:56.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.531366+0000", 2024-04-24T13:33:56.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1089999999999998e-06 2024-04-24T13:33:56.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533059+0000", 2024-04-24T13:33:56.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001693186 2024-04-24T13:33:56.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533088+0000", 2024-04-24T13:33:56.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9470000000000001e-05 2024-04-24T13:33:56.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533100+0000", 2024-04-24T13:33:56.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1979e-05 2024-04-24T13:33:56.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533176+0000", 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5691000000000004e-05 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533334+0000", 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015822199999999999 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.533513+0000", 2024-04-24T13:33:56.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178846 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.546303+0000", 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012790331 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552696+0000", 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063923169999999998 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552741+0000", 2024-04-24T13:33:56.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5126999999999997e-05 2024-04-24T13:33:56.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.552776+0000", 2024-04-24T13:33:56.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.5509999999999997e-05 2024-04-24T13:33:56.130 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.130 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.130 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.130 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3094 3.14 3:29338048:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:56.130 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.513373929, 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022112211, 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3094 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596358+0000", 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6560000000000001e-06 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598612+0000", 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022539050000000001 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598639+0000", 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7767e-05 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598651+0000", 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598735+0000", 2024-04-24T13:33:56.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4176000000000002e-05 2024-04-24T13:33:56.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598928+0000", 2024-04-24T13:33:56.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019318199999999999 2024-04-24T13:33:56.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:56.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.599089+0000", 2024-04-24T13:33:56.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016078899999999999 2024-04-24T13:33:56.134 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.612538+0000", 2024-04-24T13:33:56.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013449081999999999 2024-04-24T13:33:56.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618346+0000", 2024-04-24T13:33:56.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058079799999999999 2024-04-24T13:33:56.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618413+0000", 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7101999999999996e-05 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618467+0000", 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4295000000000001e-05 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.136 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3128 3.1f 3:f8849f48:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.122989945, 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027867126999999998, 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3128 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:56.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:33:56.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986743+0000", 2024-04-24T13:33:56.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.495e-06 2024-04-24T13:33:56.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988482+0000", 2024-04-24T13:33:56.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001739237 2024-04-24T13:33:56.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988510+0000", 2024-04-24T13:33:56.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8343999999999998e-05 2024-04-24T13:33:56.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.139 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988525+0000", 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5384999999999999e-05 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988630+0000", 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010412 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988808+0000", 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178123 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988956+0000", 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014802399999999999 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.995102+0000", 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061461179999999999 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014480+0000", 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019378581999999998 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014541+0000", 2024-04-24T13:33:56.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1007000000000001e-05 2024-04-24T13:33:56.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014606+0000", 2024-04-24T13:33:56.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4691999999999997e-05 2024-04-24T13:33:56.142 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.142 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.142 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.142 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3130 3.f 3:f22fdcf5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_45:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.099808490000001, 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021419780999999999, 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3130 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009920+0000", 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.009923+0000", 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5890000000000001e-06 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011652+0000", 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017287419999999999 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011692+0000", 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0346000000000003e-05 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011707+0000", 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5068e-05 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011805+0000", 2024-04-24T13:33:56.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7935000000000003e-05 2024-04-24T13:33:56.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.011984+0000", 2024-04-24T13:33:56.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178629 2024-04-24T13:33:56.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:56.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.012159+0000", 2024-04-24T13:33:56.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017566500000000001 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.025987+0000", 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013827409000000001 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031173+0000", 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0051865590000000003 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031263+0000", 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9598000000000005e-05 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.031340+0000", 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7241000000000001e-05 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3426 3.f 3:f3517f93:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_324:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.315876458000002, 2024-04-24T13:33:56.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024699635000000001, 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3426 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793855+0000", 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4669999999999998e-06 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796548+0000", 2024-04-24T13:33:56.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026926369999999999 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796572+0000", 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4456000000000001e-05 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796586+0000", 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3937000000000001e-05 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796690+0000", 2024-04-24T13:33:56.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104226 2024-04-24T13:33:56.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796877+0000", 2024-04-24T13:33:56.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018668299999999999 2024-04-24T13:33:56.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:56.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.797048+0000", 2024-04-24T13:33:56.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017070599999999999 2024-04-24T13:33:56.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.817921+0000", 2024-04-24T13:33:56.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020873198999999999 2024-04-24T13:33:56.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818393+0000", 2024-04-24T13:33:56.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000472459 2024-04-24T13:33:56.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818475+0000", 2024-04-24T13:33:56.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1403999999999995e-05 2024-04-24T13:33:56.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818552+0000", 2024-04-24T13:33:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7460999999999996e-05 2024-04-24T13:33:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3427 3.21 3:854a3dc6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_325:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.305244319, 2024-04-24T13:33:56.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023613657999999999, 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3427 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804488+0000", 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.23e-06 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807535+0000", 2024-04-24T13:33:56.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030472709999999998 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807563+0000", 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8087999999999999e-05 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807579+0000", 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5732000000000001e-05 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807691+0000", 2024-04-24T13:33:56.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111894 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807850+0000", 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015951999999999999 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.808005+0000", 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154487 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.823418+0000", 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015413526 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828003+0000", 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045842299999999999 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828048+0000", 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5504999999999999e-05 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828098+0000", 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0175e-05 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3430 3.3b 3:de51c163:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.272019471, 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025624112000000001, 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.160 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.161 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.161 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.162 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3430 2024-04-24T13:33:56.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.162 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:56.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837713+0000", 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6509999999999999e-06 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839548+0000", 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001834521 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839577+0000", 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8850999999999999e-05 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839611+0000", 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4140000000000002e-05 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839718+0000", 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107534 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839883+0000", 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016485999999999999 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.840056+0000", 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017321200000000001 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849455+0000", 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093988590000000007 2024-04-24T13:33:56.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863165+0000", 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013710178 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863263+0000", 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7559000000000006e-05 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863334+0000", 2024-04-24T13:33:56.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0747000000000006e-05 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3443 3.a e113/48 3:53aaab58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_341:head v 113'18, mlcod=113'16)", 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.134072386, 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022399639999999998, 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975668+0000", 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.113e-05 2024-04-24T13:33:56.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979725+0000", 2024-04-24T13:33:56.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040574219999999998 2024-04-24T13:33:56.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979759+0000", 2024-04-24T13:33:56.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4362000000000001e-05 2024-04-24T13:33:56.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979774+0000", 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4935e-05 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979871+0000", 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.658e-05 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979901+0000", 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-05 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.997990+0000", 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018089483 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.998056+0000", 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6208e-05 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3458 3.f 3:f34a4471:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:56.171 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.989556053000001, 2024-04-24T13:33:56.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026075494000000001, 2024-04-24T13:33:56.172 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.172 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.172 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.172 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.172 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.172 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.172 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3458 2024-04-24T13:33:56.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.172 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120175+0000", 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5220000000000002e-06 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121620+0000", 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014442280000000001 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121646+0000", 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6424999999999999e-05 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121659+0000", 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:33:56.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121754+0000", 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4388999999999994e-05 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121968+0000", 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021460199999999999 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.122165+0000", 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019710999999999999 2024-04-24T13:33:56.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.141554+0000", 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019388847000000001 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146083+0000", 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045284469999999997 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146129+0000", 2024-04-24T13:33:56.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6257000000000001e-05 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146248+0000", 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011958100000000001 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3460 3.a e113/48 3:5102140b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_358:head v 113'19, mlcod=113'17)", 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.963542029999999, 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025573478, 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.177 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.178 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.178 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:56.178 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.178 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.178 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.178 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.178 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146188+0000", 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.02e-07 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150270+0000", 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004082011 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.179 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150302+0000", 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2570999999999997e-05 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150319+0000", 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6843000000000001e-05 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150404+0000", 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4538999999999998e-05 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150432+0000", 2024-04-24T13:33:56.180 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8098000000000001e-05 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.170266+0000", 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019834497 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171760+0000", 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001494017 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.181 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.182 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.182 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3461 3.3b 3:dfe1b3a0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_359:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:56.182 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:56.182 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.960834124000002, 2024-04-24T13:33:56.182 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024256994, 2024-04-24T13:33:56.182 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.182 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.182 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.182 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.182 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.182 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.182 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3461 2024-04-24T13:33:56.182 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148898+0000", 2024-04-24T13:33:56.183 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6970000000000002e-06 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150603+0000", 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017049809999999999 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150615+0000", 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2368000000000001e-05 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150620+0000", 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5210000000000002e-06 2024-04-24T13:33:56.184 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150671+0000", 2024-04-24T13:33:56.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0315000000000002e-05 2024-04-24T13:33:56.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150844+0000", 2024-04-24T13:33:56.185 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017304399999999999 2024-04-24T13:33:56.185 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.185 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.185 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:56.185 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.151009+0000", 2024-04-24T13:33:56.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016544800000000001 2024-04-24T13:33:56.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171479+0000", 2024-04-24T13:33:56.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020469355000000002 2024-04-24T13:33:56.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.186 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.186 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.186 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173035+0000", 2024-04-24T13:33:56.186 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001556857 2024-04-24T13:33:56.186 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173096+0000", 2024-04-24T13:33:56.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0285999999999998e-05 2024-04-24T13:33:56.187 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.187 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.187 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.187 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173152+0000", 2024-04-24T13:33:56.187 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6122000000000002e-05 2024-04-24T13:33:56.187 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.187 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.188 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.188 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.188 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.188 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3491 3.14 3:2a9aeaa0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_389:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:56.188 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:56.188 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.647082220000001, 2024-04-24T13:33:56.188 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029663012999999998, 2024-04-24T13:33:56.188 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.188 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.188 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.188 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.188 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.188 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3491 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.189 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462649+0000", 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.65e-06 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464539+0000", 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001889527 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464565+0000", 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6061999999999999e-05 2024-04-24T13:33:56.190 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464580+0000", 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5273000000000001e-05 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464678+0000", 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7639000000000005e-05 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464899+0000", 2024-04-24T13:33:56.191 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000220638 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.465088+0000", 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018922700000000001 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.478519+0000", 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013430884000000001 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492184+0000", 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013665797 2024-04-24T13:33:56.192 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492260+0000", 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6038999999999995e-05 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492310+0000", 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9277000000000003e-05 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.193 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3514 3.a e114/48 3:5344e333:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_412:head v 114'23, mlcod=114'21)", 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.408010505, 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021739380999999999, 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.194 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701734+0000", 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5807999999999998e-05 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705769+0000", 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040343660000000002 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.195 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705801+0000", 2024-04-24T13:33:56.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2406000000000001e-05 2024-04-24T13:33:56.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705816+0000", 2024-04-24T13:33:56.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4537e-05 2024-04-24T13:33:56.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.196 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.196 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705925+0000", 2024-04-24T13:33:56.196 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109114 2024-04-24T13:33:56.196 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.196 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705959+0000", 2024-04-24T13:33:56.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4239999999999997e-05 2024-04-24T13:33:56.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.197 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723399+0000", 2024-04-24T13:33:56.197 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017439748000000001 2024-04-24T13:33:56.197 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.197 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.197 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.198 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723458+0000", 2024-04-24T13:33:56.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9162e-05 2024-04-24T13:33:56.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.198 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.198 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.198 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.198 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.198 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3525 3.f 3:f35962b2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_423:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:56.198 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:56.198 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.302511618, 2024-04-24T13:33:56.198 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028712260999999999, 2024-04-24T13:33:56.198 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3525 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.199 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807221+0000", 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7529999999999999e-06 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813425+0000", 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062037280000000004 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.200 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813449+0000", 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813462+0000", 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200999999999999e-05 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813554+0000", 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2369999999999998e-05 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813730+0000", 2024-04-24T13:33:56.201 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017569800000000001 2024-04-24T13:33:56.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:56.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813908+0000", 2024-04-24T13:33:56.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178219 2024-04-24T13:33:56.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.202 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.826992+0000", 2024-04-24T13:33:56.202 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013083567000000001 2024-04-24T13:33:56.202 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.202 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.202 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835795+0000", 2024-04-24T13:33:56.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088026630000000005 2024-04-24T13:33:56.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.203 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835870+0000", 2024-04-24T13:33:56.203 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5649999999999996e-05 2024-04-24T13:33:56.203 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.203 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.203 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835930+0000", 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9318999999999999e-05 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3528 3.3b 3:dc395008:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_426:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 22.274167552000002, 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024383452999999999, 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.204 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3528 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.205 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835564+0000", 2024-04-24T13:33:56.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7369999999999998e-06 2024-04-24T13:33:56.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837236+0000", 2024-04-24T13:33:56.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001671964 2024-04-24T13:33:56.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.206 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.206 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.206 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837275+0000", 2024-04-24T13:33:56.206 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8760000000000002e-05 2024-04-24T13:33:56.206 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837292+0000", 2024-04-24T13:33:56.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6884999999999998e-05 2024-04-24T13:33:56.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837382+0000", 2024-04-24T13:33:56.207 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9809999999999996e-05 2024-04-24T13:33:56.207 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.207 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.207 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.207 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837556+0000", 2024-04-24T13:33:56.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174103 2024-04-24T13:33:56.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:56.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837728+0000", 2024-04-24T13:33:56.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017202600000000001 2024-04-24T13:33:56.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.208 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.208 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859492+0000", 2024-04-24T13:33:56.208 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021764644999999999 2024-04-24T13:33:56.208 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.208 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859714+0000", 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221809 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859857+0000", 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142738 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859945+0000", 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7975999999999999e-05 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.209 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.210 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.210 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.210 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3596 3.3b 3:dcf4b716:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_493:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:56.210 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:56.210 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 21.587142395000001, 2024-04-24T13:33:56.210 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021336183000000002, 2024-04-24T13:33:56.210 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.210 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.210 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.210 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.210 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3596 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522587+0000", 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.211 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.522589+0000", 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.853e-06 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524412+0000", 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018229559999999999 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524440+0000", 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7489999999999999e-05 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.212 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524454+0000", 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4565e-05 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524556+0000", 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000101166 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524666+0000", 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109918 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.213 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.524816+0000", 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015030800000000001 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.531231+0000", 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0064155159999999996 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543790+0000", 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012558565000000001 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.214 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543865+0000", 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4999999999999993e-05 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:34.543923+0000", 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7846000000000001e-05 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3853 3.14 3:2921a635:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:33:56.215 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:55.878143+0000", 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.23158573700000001, 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029161538000000001, 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3853 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.216 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.878143+0000", 2024-04-24T13:33:56.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.878143+0000", 2024-04-24T13:33:56.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.217 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.217 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.217 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.878145+0000", 2024-04-24T13:33:56.217 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9850000000000001e-06 2024-04-24T13:33:56.217 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.880109+0000", 2024-04-24T13:33:56.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019635830000000001 2024-04-24T13:33:56.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.218 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.218 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.880135+0000", 2024-04-24T13:33:56.218 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6233000000000001e-05 2024-04-24T13:33:56.218 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.218 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.880148+0000", 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3373000000000001e-05 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.880216+0000", 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7162000000000005e-05 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.880374+0000", 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158548 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.219 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.880486+0000", 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011158399999999999 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.886612+0000", 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061260100000000003 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.907175+0000", 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020563287 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.220 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.907249+0000", 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4010999999999993e-05 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.907305+0000", 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5761999999999999e-05 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3858 3.2e 3:77365e53:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:33:56.221 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:55.929644+0000", 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.18008458699999999, 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022584149000000001, 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3858 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.222 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.929644+0000", 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.929644+0000", 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.929647+0000", 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5299999999999999e-06 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.223 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.931248+0000", 2024-04-24T13:33:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016014670000000001 2024-04-24T13:33:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.931273+0000", 2024-04-24T13:33:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4902999999999999e-05 2024-04-24T13:33:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.931284+0000", 2024-04-24T13:33:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0429e-05 2024-04-24T13:33:56.224 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.931362+0000", 2024-04-24T13:33:56.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7968999999999998e-05 2024-04-24T13:33:56.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.225 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.931533+0000", 2024-04-24T13:33:56.225 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017143799999999999 2024-04-24T13:33:56.225 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.225 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.225 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:56.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.931705+0000", 2024-04-24T13:33:56.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017213800000000001 2024-04-24T13:33:56.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.938580+0000", 2024-04-24T13:33:56.226 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068748029999999996 2024-04-24T13:33:56.226 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.226 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.226 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.226 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.952096+0000", 2024-04-24T13:33:56.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013516248 2024-04-24T13:33:56.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.952172+0000", 2024-04-24T13:33:56.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6169999999999997e-05 2024-04-24T13:33:56.227 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.227 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.227 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.227 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.952229+0000", 2024-04-24T13:33:56.227 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6054000000000002e-05 2024-04-24T13:33:56.227 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.227 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.228 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.228 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.228 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.228 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:56.229 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:33:56.230 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:56.224+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:56.329 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:56.326+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:56.407 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:56.407 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:33:56.407 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:56.424 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:33:56.430 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:56.428+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:56.531 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:56.530+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:56.567 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd set nodeep-scrub 2024-04-24T13:33:56.630 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:56.630 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:33:56.630 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:33:56.630 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:33:56.630 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:56.631 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:56.630+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:56.657 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:33:56.742 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:56.742+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:56.837 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:56.830+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:56.842 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:33:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:33:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:33:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:33:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2207 3.38 3:1d741f7f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_2:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:56.842 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 88.538609976999993, 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022686873999999999, 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2207 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:56.843 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302495+0000", 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.302499+0000", 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.366e-06 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307861+0000", 2024-04-24T13:33:56.844 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0053622089999999997 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307899+0000", 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7978999999999997e-05 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307917+0000", 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8576999999999998e-05 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308018+0000", 2024-04-24T13:33:56.845 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010080499999999999 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308202+0000", 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000183628 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.308352+0000", 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000149806 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.846 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318520+0000", 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010168744 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.324908+0000", 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0063874739999999998 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325063+0000", 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000155131 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.847 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.325182+0000", 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011915499999999999 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 88.515015263999999, 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.848 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.849 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:33:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:33:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.850 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.853 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:33:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:33:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:33:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:33:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:33:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:33:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.854 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:33:56.855 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:33:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:33:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:33:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:33:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.856 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:56.857 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 88.369959410000007, 2024-04-24T13:33:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:33:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:33:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.858 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.859 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.860 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:33:56.861 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:33:56.862 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2242 3.b 3:d16b554f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_37:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 88.101460478000007, 2024-04-24T13:33:56.863 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022940439, 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2242 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.864 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739645+0000", 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.739648+0000", 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.785e-06 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741765+0000", 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002117655 2024-04-24T13:33:56.865 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741781+0000", 2024-04-24T13:33:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6062e-05 2024-04-24T13:33:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741792+0000", 2024-04-24T13:33:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0937999999999999e-05 2024-04-24T13:33:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.866 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.741918+0000", 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012623199999999999 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742189+0000", 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00027047300000000002 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.742430+0000", 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00024077699999999999 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.752990+0000", 2024-04-24T13:33:56.867 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010559875 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762422+0000", 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0094325120000000005 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762510+0000", 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7879000000000003e-05 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.868 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.762585+0000", 2024-04-24T13:33:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5251000000000002e-05 2024-04-24T13:33:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2662 3.33 3:ce195145:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.712542171000003, 2024-04-24T13:33:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028670389000000001, 2024-04-24T13:33:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.869 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2662 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.870 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128567+0000", 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4640000000000002e-06 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130845+0000", 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002278389 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.871 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130869+0000", 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4394999999999999e-05 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130879+0000", 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0000000000000001e-05 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130957+0000", 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7968999999999998e-05 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:33:56.872 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130963+0000", 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2499999999999997e-06 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137507+0000", 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065442900000000003 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137607+0000", 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010002599999999999 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.873 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137727+0000", 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120142 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152307+0000", 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01458017 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157112+0000", 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048051350000000003 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.874 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157181+0000", 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9051e-05 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157233+0000", 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2108000000000003e-05 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2676 3.22 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:56.875 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.569340263000001, 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025889562000000001, 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2676 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:56.876 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:33:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.877 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271767+0000", 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.273986+0000", 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022195560000000001 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274011+0000", 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4953e-05 2024-04-24T13:33:56.878 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274023+0000", 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1856e-05 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274116+0000", 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3168e-05 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274377+0000", 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026071500000000001 2024-04-24T13:33:56.879 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274531+0000", 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015427299999999999 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297124+0000", 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022592476 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297544+0000", 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000420691 2024-04-24T13:33:56.880 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297605+0000", 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0888999999999999e-05 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297655+0000", 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9119999999999997e-05 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.881 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:2722 3.25 e101/20 3:a78b5fb7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_51:head v 101'6, mlcod=86'4)", 2024-04-24T13:33:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 51.197594981999998, 2024-04-24T13:33:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023380372, 2024-04-24T13:33:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.882 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643510+0000", 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.643511+0000", 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4400000000000001e-07 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.883 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647450+0000", 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0039389259999999997 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647470+0000", 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0534e-05 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647484+0000", 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3370000000000001e-05 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.884 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647599+0000", 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115513 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.647629+0000", 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0145e-05 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666761+0000", 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019132303999999999 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.885 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.886 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.666891+0000", 2024-04-24T13:33:56.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012913599999999999 2024-04-24T13:33:56.886 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.886 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.886 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.886 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.886 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.886 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2747 3.24 3:2754d069:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:56.886 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:56.886 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.943045120000001, 2024-04-24T13:33:56.886 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024857536999999999, 2024-04-24T13:33:56.886 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.886 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2747 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.887 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898063+0000", 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5289999999999998e-06 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899956+0000", 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932759999999999 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.888 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899984+0000", 2024-04-24T13:33:56.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7801999999999999e-05 2024-04-24T13:33:56.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.889 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899997+0000", 2024-04-24T13:33:56.889 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3127e-05 2024-04-24T13:33:56.889 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.889 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.889 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900063+0000", 2024-04-24T13:33:56.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:33:56.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900200+0000", 2024-04-24T13:33:56.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000137324 2024-04-24T13:33:56.890 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.890 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.890 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:56.890 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900302+0000", 2024-04-24T13:33:56.890 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010168 2024-04-24T13:33:56.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.908151+0000", 2024-04-24T13:33:56.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078489579999999996 2024-04-24T13:33:56.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.891 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922784+0000", 2024-04-24T13:33:56.891 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014633116 2024-04-24T13:33:56.891 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.891 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.891 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922860+0000", 2024-04-24T13:33:56.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5708000000000001e-05 2024-04-24T13:33:56.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.892 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.892 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922918+0000", 2024-04-24T13:33:56.892 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7686000000000003e-05 2024-04-24T13:33:56.892 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.892 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.892 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.892 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.892 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2754 3.b 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.862575620000001, 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.032358206, 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2754 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.893 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:56.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:33:56.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.894 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.894 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.894 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.894 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978532+0000", 2024-04-24T13:33:56.894 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6079999999999998e-06 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979768+0000", 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012357869999999999 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979791+0000", 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3224e-05 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979804+0000", 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.274e-05 2024-04-24T13:33:56.895 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979889+0000", 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5483999999999997e-05 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980063+0000", 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017384599999999999 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980227+0000", 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163764 2024-04-24T13:33:56.896 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987774+0000", 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075472029999999997 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010776+0000", 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023001886999999999 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010838+0000", 2024-04-24T13:33:56.897 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1527999999999998e-05 2024-04-24T13:33:56.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.898 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.898 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010888+0000", 2024-04-24T13:33:56.898 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0135e-05 2024-04-24T13:33:56.898 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.898 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.898 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.898 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.898 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.899 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2811 3.7 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:56.899 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:56.899 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.270936788, 2024-04-24T13:33:56.899 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044582597000000002, 2024-04-24T13:33:56.899 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.899 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.899 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.899 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.899 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.899 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.899 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2811 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.900 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570171+0000", 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9100000000000001e-06 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580122+0000", 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099505930000000006 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580150+0000", 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7827e-05 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.901 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580164+0000", 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4547e-05 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580245+0000", 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0810999999999996e-05 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580355+0000", 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109656 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.902 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580475+0000", 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120278 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607433+0000", 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026957894 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614636+0000", 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072028359999999998 2024-04-24T13:33:56.903 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614703+0000", 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7645999999999996e-05 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614751+0000", 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7599000000000003e-05 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.904 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2812 3.1e 3:7bd62ca6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 50.260892908000002, 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.038041177000000002, 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2812 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.905 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:56.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:33:56.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.906 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.906 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.906 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580214+0000", 2024-04-24T13:33:56.906 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.708e-06 2024-04-24T13:33:56.906 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582574+0000", 2024-04-24T13:33:56.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023601799999999999 2024-04-24T13:33:56.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.907 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582591+0000", 2024-04-24T13:33:56.907 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6648999999999999e-05 2024-04-24T13:33:56.907 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.907 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.907 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582598+0000", 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.391e-06 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583731+0000", 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011332029999999999 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583843+0000", 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111889 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.908 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583936+0000", 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2968999999999997e-05 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.599363+0000", 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015427186000000001 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618143+0000", 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018779051000000001 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.909 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618200+0000", 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7151999999999998e-05 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618253+0000", 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3798999999999998e-05 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.910 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3110 3.1e 3:79ca4af0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_25:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.041834708, 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022894164000000002, 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3110 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.911 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:56.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799271+0000", 2024-04-24T13:33:56.912 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.912 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.912 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.912 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.912 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.799272+0000", 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9470000000000002e-06 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800698+0000", 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001425204 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800721+0000", 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3577000000000001e-05 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.913 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800731+0000", 2024-04-24T13:33:56.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.9969999999999993e-06 2024-04-24T13:33:56.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800797+0000", 2024-04-24T13:33:56.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6087999999999995e-05 2024-04-24T13:33:56.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.914 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.914 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.914 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.800954+0000", 2024-04-24T13:33:56.914 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015699 2024-04-24T13:33:56.914 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.801064+0000", 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109715 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.807584+0000", 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065197479999999997 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822063+0000", 2024-04-24T13:33:56.915 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014479156999999999 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822122+0000", 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9095000000000003e-05 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.822165+0000", 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2645999999999998e-05 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.916 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.917 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3117 3.27 3:e455931d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:56.917 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:56.917 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.970476678000001, 2024-04-24T13:33:56.917 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02353235, 2024-04-24T13:33:56.917 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.917 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.917 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.917 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.917 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3117 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.918 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870631+0000", 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.075e-06 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872287+0000", 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016561449999999999 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872316+0000", 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9543000000000002e-05 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.919 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872333+0000", 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6806000000000001e-05 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872403+0000", 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9917000000000002e-05 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872540+0000", 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013735200000000001 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:56.920 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872686+0000", 2024-04-24T13:33:56.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014519899999999999 2024-04-24T13:33:56.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.878440+0000", 2024-04-24T13:33:56.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057539490000000004 2024-04-24T13:33:56.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.921 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.921 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.921 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894072+0000", 2024-04-24T13:33:56.921 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015632801000000002 2024-04-24T13:33:56.921 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894106+0000", 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3933999999999997e-05 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894161+0000", 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4629000000000002e-05 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.922 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.923 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3127 3.15 3:a9239ffa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:56.923 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:56.923 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.865749502, 2024-04-24T13:33:56.923 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023707346000000001, 2024-04-24T13:33:56.923 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.923 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.923 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.923 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3127 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.924 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975357+0000", 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.418e-06 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976868+0000", 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015108719999999999 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976894+0000", 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5885e-05 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.925 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976905+0000", 2024-04-24T13:33:56.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1076e-05 2024-04-24T13:33:56.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976983+0000", 2024-04-24T13:33:56.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8532e-05 2024-04-24T13:33:56.926 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.926 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.926 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.926 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977149+0000", 2024-04-24T13:33:56.926 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016571500000000001 2024-04-24T13:33:56.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:56.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977313+0000", 2024-04-24T13:33:56.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163719 2024-04-24T13:33:56.927 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.927 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.927 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.927 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.984588+0000", 2024-04-24T13:33:56.927 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072751600000000001 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998908+0000", 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014319705 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998988+0000", 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9839000000000006e-05 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.928 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.999063+0000", 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5425000000000004e-05 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3136 3.25 e112/20 3:a4e0a0f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_51:head v 112'10, mlcod=102'8)", 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.764689832999998, 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026701701000000001, 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.929 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:56.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:33:56.930 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.930 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.930 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.930 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.930 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076417+0000", 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.779e-06 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077651+0000", 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233428 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077679+0000", 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8535e-05 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.931 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077694+0000", 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077775+0000", 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0927000000000006e-05 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077801+0000", 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5933999999999999e-05 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.932 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103085+0000", 2024-04-24T13:33:56.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284238000000001 2024-04-24T13:33:56.933 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.933 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.933 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.933 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103117+0000", 2024-04-24T13:33:56.933 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1917e-05 2024-04-24T13:33:56.933 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.934 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.934 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.934 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.934 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.934 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3429 3.7 3:e226ff6b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_327:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:56.934 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:56.934 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 24.014520526999998, 2024-04-24T13:33:56.934 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023122228000000002, 2024-04-24T13:33:56.934 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.934 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.934 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.934 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3429 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826585+0000", 2024-04-24T13:33:56.935 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.826588+0000", 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.942e-06 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829078+0000", 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002489982 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.936 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829098+0000", 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.0747999999999999e-05 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829110+0000", 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1569000000000001e-05 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829206+0000", 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6303000000000003e-05 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.937 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829419+0000", 2024-04-24T13:33:56.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021229300000000001 2024-04-24T13:33:56.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:56.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.829606+0000", 2024-04-24T13:33:56.938 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000187219 2024-04-24T13:33:56.938 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.938 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.938 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.938 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.835770+0000", 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061641819999999998 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849620+0000", 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013849889000000001 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849663+0000", 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.2725999999999997e-05 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.939 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849707+0000", 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4375000000000001e-05 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3484 3.18 3:1a64f732:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_382:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.459525348, 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029616456999999999, 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.940 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3484 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:33:56.941 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381583+0000", 2024-04-24T13:33:56.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6510000000000001e-06 2024-04-24T13:33:56.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.942 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382670+0000", 2024-04-24T13:33:56.942 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010878870000000001 2024-04-24T13:33:56.942 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.942 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.942 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382689+0000", 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8723999999999999e-05 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382700+0000", 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0908e-05 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385156+0000", 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002456176 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.943 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385287+0000", 2024-04-24T13:33:56.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013060400000000001 2024-04-24T13:33:56.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:56.944 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385402+0000", 2024-04-24T13:33:56.944 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115658 2024-04-24T13:33:56.944 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.944 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.944 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.406717+0000", 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021314317999999999 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411063+0000", 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043465719999999999 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411141+0000", 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7193000000000004e-05 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.945 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411196+0000", 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5766000000000001e-05 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3483 3.c e114/103 3:3033c1b6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_381:head v 114'16, mlcod=113'14)", 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.457340136999999, 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028448153, 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.946 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.947 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383766+0000", 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0130000000000001e-06 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387173+0000", 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034066330000000001 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387201+0000", 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8705999999999999e-05 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.948 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387216+0000", 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5019e-05 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387369+0000", 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015276299999999999 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387397+0000", 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7559000000000002e-05 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.949 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412160+0000", 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024763314000000002 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412213+0000", 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3146000000000002e-05 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3501 3.24 3:27356806:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_399:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:56.950 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.280452660999998, 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029132884000000001, 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3501 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.951 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560656+0000", 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.066e-06 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562392+0000", 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017359980000000001 2024-04-24T13:33:56.952 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562431+0000", 2024-04-24T13:33:56.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9325e-05 2024-04-24T13:33:56.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562453+0000", 2024-04-24T13:33:56.953 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2476e-05 2024-04-24T13:33:56.953 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.953 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.953 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.953 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562541+0000", 2024-04-24T13:33:56.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7678999999999999e-05 2024-04-24T13:33:56.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.954 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562688+0000", 2024-04-24T13:33:56.954 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014673600000000001 2024-04-24T13:33:56.954 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.954 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.954 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:56.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562785+0000", 2024-04-24T13:33:56.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6903000000000004e-05 2024-04-24T13:33:56.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.571188+0000", 2024-04-24T13:33:56.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084030449999999996 2024-04-24T13:33:56.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.955 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.955 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.955 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589689+0000", 2024-04-24T13:33:56.955 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018500876999999999 2024-04-24T13:33:56.955 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589735+0000", 2024-04-24T13:33:56.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-04-24T13:33:56.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.956 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.956 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.956 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589785+0000", 2024-04-24T13:33:56.956 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0290999999999997e-05 2024-04-24T13:33:56.956 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.956 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.956 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.956 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3521 3.1e 3:7803006f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_419:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 23.073500814999999, 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024446572999999999, 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3521 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.957 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767608+0000", 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3239999999999999e-06 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.958 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770197+0000", 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025895129999999999 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770220+0000", 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2605000000000001e-05 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770233+0000", 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3159999999999999e-05 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.959 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770329+0000", 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5995999999999994e-05 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770543+0000", 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000214348 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770732+0000", 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000188975 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.960 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.779877+0000", 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0091449860000000008 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.791883+0000", 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012005266000000001 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792002+0000", 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119351 2024-04-24T13:33:56.961 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:33:56.962 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:33:56.962 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:33:56.962 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792051+0000", 2024-04-24T13:33:56.962 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9048999999999997e-05 2024-04-24T13:33:56.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.962 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.962 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:33:56.962 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:33:56.962 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:33:56.964 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:33:56.964 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:56.960+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:57.065 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:57.062+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:57.117 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:57.117 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:57.117 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:33:57.117 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:57.132 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:33:57.166 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:57.162+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:57.262 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:33:57.263 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:33:57.263 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:57.267 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:57.264+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:57.277 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:33:57.368 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:57.364+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:57.451 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:57.451 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:33:57.451 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:33:57.451 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:33:57.451 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.451 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2208 3.29 e85/20 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head v 85'1, mlcod=0'0)", 2024-04-24T13:33:57.451 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 89.120516214999995, 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026370000000000001, 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.452 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328650+0000", 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.413e-06 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335219+0000", 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006569788 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.453 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335258+0000", 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9062e-05 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335277+0000", 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.836e-05 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335422+0000", 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014537 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.454 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335481+0000", 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9259000000000003e-05 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354858+0000", 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019376757000000001 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.355017+0000", 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015899100000000001 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.455 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2672 3.1c 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.217708279, 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028612909999999998, 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2672 2024-04-24T13:33:57.456 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231458+0000", 2024-04-24T13:33:57.457 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.977e-06 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236408+0000", 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049496929999999998 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236444+0000", 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5713000000000002e-05 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.458 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236461+0000", 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.789e-05 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236562+0000", 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100352 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236842+0000", 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027979399999999998 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.459 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.237091+0000", 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024988499999999998 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.246295+0000", 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0092031279999999997 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.259775+0000", 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013480634 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.460 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.259922+0000", 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146565 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.260068+0000", 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146279 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2706 3.1c 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 51.980081452, 2024-04-24T13:33:57.461 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027254180999999999, 2024-04-24T13:33:57.462 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.462 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.462 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.462 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.462 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-24T13:33:57.462 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.462 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.462 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.462 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.462 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:33:57.462 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469086+0000", 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6100000000000002e-06 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473145+0000", 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040598769999999999 2024-04-24T13:33:57.463 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473180+0000", 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4345999999999999e-05 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473197+0000", 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.721e-05 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473377+0000", 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000179805 2024-04-24T13:33:57.464 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473830+0000", 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045276700000000002 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.474315+0000", 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000485842 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.485841+0000", 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011525822 2024-04-24T13:33:57.465 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496030+0000", 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010188401 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496205+0000", 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000175632 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496336+0000", 2024-04-24T13:33:57.466 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013086900000000001 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2752 3.1c 3:3ae15365:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 51.494858452999999, 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027425952, 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.467 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2752 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.468 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954308+0000", 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3100000000000001e-06 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959305+0000", 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049969649999999999 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959349+0000", 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3590000000000001e-05 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.469 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959375+0000", 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6268999999999999e-05 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959561+0000", 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018558600000000001 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959821+0000", 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000260704 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.470 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.960063+0000", 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024149499999999999 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.974409+0000", 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014345689999999999 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981424+0000", 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070159250000000001 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.471 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981651+0000", 2024-04-24T13:33:57.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022641499999999999 2024-04-24T13:33:57.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.472 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.472 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981731+0000", 2024-04-24T13:33:57.472 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0003e-05 2024-04-24T13:33:57.472 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.472 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.472 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.472 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.472 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2772 3.1a 3:589df240:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_101:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:06.151960+0000", 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 51.297203617000001, 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024913555, 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2772 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.473 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.151960+0000", 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.151960+0000", 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.151963+0000", 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8729999999999999e-06 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.474 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.157999+0000", 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0060360609999999997 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158051+0000", 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2283000000000001e-05 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158078+0000", 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7163000000000001e-05 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.475 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158261+0000", 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000182342 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.158680+0000", 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041904000000000003 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.159122+0000", 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044224599999999998 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.476 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.172894+0000", 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013771782 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.176730+0000", 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038359940000000001 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.176810+0000", 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9985000000000001e-05 2024-04-24T13:33:57.477 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.176873+0000", 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3786000000000002e-05 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2817 3.13 3:c886ce92:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_146:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:06.637721+0000", 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 50.811442219, 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024927993999999998, 2024-04-24T13:33:57.478 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2817 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.637721+0000", 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.479 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.637721+0000", 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.637725+0000", 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8229999999999997e-06 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642579+0000", 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048544010000000004 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.480 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642615+0000", 2024-04-24T13:33:57.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5392999999999998e-05 2024-04-24T13:33:57.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642634+0000", 2024-04-24T13:33:57.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8933e-05 2024-04-24T13:33:57.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.481 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.481 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.642774+0000", 2024-04-24T13:33:57.481 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014001199999999999 2024-04-24T13:33:57.481 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.481 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.643201+0000", 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042696999999999999 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.643553+0000", 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035225099999999999 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.660632+0000", 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017079436999999999 2024-04-24T13:33:57.482 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.662499+0000", 2024-04-24T13:33:57.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001866611 2024-04-24T13:33:57.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.662591+0000", 2024-04-24T13:33:57.483 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1762999999999995e-05 2024-04-24T13:33:57.483 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.483 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.483 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.483 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.662649+0000", 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8400000000000003e-05 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3091 3.9 3:91019aa3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.881926505999999, 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026195184999999999, 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.484 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.485 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.485 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3091 2024-04-24T13:33:57.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.485 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:33:57.485 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.485 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.485 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.485 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.485 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:33:57.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567241+0000", 2024-04-24T13:33:57.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7570000000000002e-06 2024-04-24T13:33:57.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.486 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.486 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.486 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575380+0000", 2024-04-24T13:33:57.486 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081391740000000008 2024-04-24T13:33:57.486 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575427+0000", 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6839999999999999e-05 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575451+0000", 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4329999999999999e-05 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575651+0000", 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020028400000000001 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.487 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576089+0000", 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043775699999999999 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576498+0000", 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040853999999999999 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.592857+0000", 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016359097 2024-04-24T13:33:57.488 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593257+0000", 2024-04-24T13:33:57.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000400553 2024-04-24T13:33:57.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593358+0000", 2024-04-24T13:33:57.489 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010064 2024-04-24T13:33:57.489 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.489 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.489 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.489 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593432+0000", 2024-04-24T13:33:57.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4213000000000002e-05 2024-04-24T13:33:57.490 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.490 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.490 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.490 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.490 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.490 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3121 3.e 3:70900501:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:57.490 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:33:57.490 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.538523067, 2024-04-24T13:33:57.490 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026429009, 2024-04-24T13:33:57.490 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.490 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3121 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.491 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910644+0000", 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2270000000000002e-06 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914662+0000", 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040188539999999997 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.492 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914705+0000", 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2562999999999999e-05 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914726+0000", 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0996e-05 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914911+0000", 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018524500000000001 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.493 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.915177+0000", 2024-04-24T13:33:57.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026601100000000003 2024-04-24T13:33:57.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:57.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.915402+0000", 2024-04-24T13:33:57.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224928 2024-04-24T13:33:57.494 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.494 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.494 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.494 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.925683+0000", 2024-04-24T13:33:57.494 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010280821000000001 2024-04-24T13:33:57.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.936831+0000", 2024-04-24T13:33:57.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011148362 2024-04-24T13:33:57.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.495 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.495 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.495 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.936987+0000", 2024-04-24T13:33:57.495 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155749 2024-04-24T13:33:57.495 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.937069+0000", 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2253e-05 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3123 3.13 3:ca3e100b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.519261280999999, 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029312213, 2024-04-24T13:33:57.496 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3123 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.497 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:33:57.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929905+0000", 2024-04-24T13:33:57.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6970000000000002e-06 2024-04-24T13:33:57.498 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.498 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.498 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.498 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933842+0000", 2024-04-24T13:33:57.498 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039367320000000001 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933877+0000", 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.561e-05 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933894+0000", 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7212999999999999e-05 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.499 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934030+0000", 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013565199999999999 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934295+0000", 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000265235 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934540+0000", 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024482399999999999 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.500 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.957909+0000", 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023368684000000001 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959004+0000", 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010949709999999999 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959124+0000", 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012061900000000001 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.501 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.502 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959214+0000", 2024-04-24T13:33:57.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9975999999999994e-05 2024-04-24T13:33:57.502 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.502 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.502 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.502 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.502 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.502 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3140 3.13 3:cb1b51c5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:57.502 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:29.122081+0000", 2024-04-24T13:33:57.502 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.327082701999998, 2024-04-24T13:33:57.502 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024992602999999999, 2024-04-24T13:33:57.502 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.502 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3140 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.122081+0000", 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.503 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.122081+0000", 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.122084+0000", 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0029999999999999e-06 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126170+0000", 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040860200000000001 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.504 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126206+0000", 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6672999999999999e-05 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126225+0000", 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8114e-05 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126363+0000", 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013847800000000001 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.505 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126618+0000", 2024-04-24T13:33:57.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025469499999999999 2024-04-24T13:33:57.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:57.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.126861+0000", 2024-04-24T13:33:57.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000243408 2024-04-24T13:33:57.506 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.506 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.506 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.506 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.136738+0000", 2024-04-24T13:33:57.506 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0098770560000000004 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.146717+0000", 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099784629999999999 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.146923+0000", 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020675199999999999 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.507 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.147073+0000", 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014994100000000001 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3433 3.34 3:2ce81ea4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_331:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.578851254, 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026583214000000001, 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.508 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.509 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.509 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.509 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3433 2024-04-24T13:33:57.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.509 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:33:57.509 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.509 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.509 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.509 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.509 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:33:57.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870316+0000", 2024-04-24T13:33:57.510 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.16e-06 2024-04-24T13:33:57.510 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.510 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.510 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.510 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876622+0000", 2024-04-24T13:33:57.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063053919999999999 2024-04-24T13:33:57.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876650+0000", 2024-04-24T13:33:57.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8007000000000001e-05 2024-04-24T13:33:57.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.511 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.511 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.511 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876669+0000", 2024-04-24T13:33:57.511 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8972999999999999e-05 2024-04-24T13:33:57.511 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876789+0000", 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119849 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.877065+0000", 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276407 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.877304+0000", 2024-04-24T13:33:57.512 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023901799999999999 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.890409+0000", 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013105047 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896721+0000", 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063118360000000004 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896819+0000", 2024-04-24T13:33:57.513 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7728999999999999e-05 2024-04-24T13:33:57.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.514 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.514 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896895+0000", 2024-04-24T13:33:57.514 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6796000000000001e-05 2024-04-24T13:33:57.514 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.514 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.514 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.514 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.514 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.514 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3463 3.39 e113/41 3:9e84137f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_361:head v 113'19, mlcod=113'17)", 2024-04-24T13:33:57.514 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:33:57.514 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.276354440999999, 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025926719000000001, 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.515 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172811+0000", 2024-04-24T13:33:57.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1160000000000002e-06 2024-04-24T13:33:57.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.516 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177659+0000", 2024-04-24T13:33:57.516 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048481549999999998 2024-04-24T13:33:57.516 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.516 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.516 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177694+0000", 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4473e-05 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177717+0000", 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3750000000000001e-05 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177886+0000", 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000168405 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.517 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177925+0000", 2024-04-24T13:33:57.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9555999999999999e-05 2024-04-24T13:33:57.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.518 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.198662+0000", 2024-04-24T13:33:57.518 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020736167999999999 2024-04-24T13:33:57.518 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.518 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.518 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.519 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.198736+0000", 2024-04-24T13:33:57.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4096000000000003e-05 2024-04-24T13:33:57.519 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.519 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.519 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.519 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.519 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.519 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3469 3.3 3:c2771714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_367:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:57.519 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:33:57.519 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.217118895999999, 2024-04-24T13:33:57.519 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028440263, 2024-04-24T13:33:57.519 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.519 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.520 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.520 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.520 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.520 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.520 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3469 2024-04-24T13:33:57.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.520 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.520 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.520 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:33:57.520 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.520 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.520 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:33:57.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232047+0000", 2024-04-24T13:33:57.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4669999999999998e-06 2024-04-24T13:33:57.521 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.521 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.521 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.521 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.237943+0000", 2024-04-24T13:33:57.521 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058964320000000001 2024-04-24T13:33:57.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.237979+0000", 2024-04-24T13:33:57.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5907e-05 2024-04-24T13:33:57.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.522 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238000+0000", 2024-04-24T13:33:57.522 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0536000000000001e-05 2024-04-24T13:33:57.522 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.522 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.522 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238104+0000", 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010404300000000001 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238355+0000", 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000250881 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238590+0000", 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000235388 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.523 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.248777+0000", 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010187244 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260299+0000", 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011521933 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260403+0000", 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010400600000000001 2024-04-24T13:33:57.524 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.525 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.525 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260485+0000", 2024-04-24T13:33:57.525 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1426000000000003e-05 2024-04-24T13:33:57.525 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.525 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.525 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.525 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.525 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.525 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3501 3.24 e114/20 3:27356806:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_399:head v 114'14, mlcod=113'12)", 2024-04-24T13:33:57.525 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:33:57.525 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.885915268000002, 2024-04-24T13:33:57.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026449908000000001, 2024-04-24T13:33:57.526 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.526 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.526 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.526 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:33:57.526 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.526 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.526 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.526 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.526 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563249+0000", 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9299999999999998e-07 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568259+0000", 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050107759999999998 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.527 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568292+0000", 2024-04-24T13:33:57.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2892999999999998e-05 2024-04-24T13:33:57.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568310+0000", 2024-04-24T13:33:57.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7819e-05 2024-04-24T13:33:57.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.528 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.528 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568429+0000", 2024-04-24T13:33:57.528 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011896999999999999 2024-04-24T13:33:57.528 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.528 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568469+0000", 2024-04-24T13:33:57.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9739e-05 2024-04-24T13:33:57.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.589582+0000", 2024-04-24T13:33:57.529 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021113072 2024-04-24T13:33:57.529 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.529 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.529 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.529 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.589698+0000", 2024-04-24T13:33:57.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116146 2024-04-24T13:33:57.530 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.530 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.530 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.530 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.530 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.530 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3509 3.39 e114/41 3:9cf0e09a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_407:head v 114'21, mlcod=113'19)", 2024-04-24T13:33:57.530 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.652439+0000", 2024-04-24T13:33:57.530 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.796724062999999, 2024-04-24T13:33:57.530 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025495436, 2024-04-24T13:33:57.530 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.530 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.652439+0000", 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.652439+0000", 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.531 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.652441+0000", 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.03e-06 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656544+0000", 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041031030000000003 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656570+0000", 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5996999999999999e-05 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.532 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656583+0000", 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2935999999999999e-05 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656723+0000", 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139226 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.656763+0000", 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0655999999999998e-05 2024-04-24T13:33:57.533 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.677805+0000", 2024-04-24T13:33:57.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021042079000000002 2024-04-24T13:33:57.534 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.534 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.534 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.534 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.677935+0000", 2024-04-24T13:33:57.534 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012940900000000001 2024-04-24T13:33:57.534 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3534 3.34 3:2c938e61:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_432:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.899747+0000", 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.549416371, 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025402460000000002, 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.535 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3534 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.899747+0000", 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.899747+0000", 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.536 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.899751+0000", 2024-04-24T13:33:57.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9269999999999998e-06 2024-04-24T13:33:57.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.905900+0000", 2024-04-24T13:33:57.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0061494890000000002 2024-04-24T13:33:57.537 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.537 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.537 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.537 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.905936+0000", 2024-04-24T13:33:57.537 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5196e-05 2024-04-24T13:33:57.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.905955+0000", 2024-04-24T13:33:57.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8913999999999999e-05 2024-04-24T13:33:57.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.538 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.906122+0000", 2024-04-24T13:33:57.538 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000167715 2024-04-24T13:33:57.538 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.538 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.538 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.906540+0000", 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041803599999999999 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.906963+0000", 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042224 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.924057+0000", 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017094272000000001 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.539 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.924812+0000", 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00075491399999999998 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.925002+0000", 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000190101 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.925149+0000", 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147656 2024-04-24T13:33:57.540 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3585 3.11 3:88ded408:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_482:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.048841199000002, 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034777737000000003, 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.541 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3585 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.542 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400326+0000", 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9330000000000003e-06 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404462+0000", 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041354130000000001 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404537+0000", 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5282000000000002e-05 2024-04-24T13:33:57.543 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404565+0000", 2024-04-24T13:33:57.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7797000000000002e-05 2024-04-24T13:33:57.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.544 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.544 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.544 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404716+0000", 2024-04-24T13:33:57.544 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015126500000000001 2024-04-24T13:33:57.544 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.405051+0000", 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033540099999999998 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.405296+0000", 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024506099999999998 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.429261+0000", 2024-04-24T13:33:57.545 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023964485000000001 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.434796+0000", 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055355559999999996 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.434949+0000", 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015286499999999999 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.546 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.435100+0000", 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000150679 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3586 3.11 3:89fac597:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_483:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 23.037555017999999, 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028873106999999999, 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.547 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3586 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.548 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411611+0000", 2024-04-24T13:33:57.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7930000000000002e-06 2024-04-24T13:33:57.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415739+0000", 2024-04-24T13:33:57.549 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00412751 2024-04-24T13:33:57.549 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.549 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.549 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.549 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415776+0000", 2024-04-24T13:33:57.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7082999999999997e-05 2024-04-24T13:33:57.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415795+0000", 2024-04-24T13:33:57.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9539999999999999e-05 2024-04-24T13:33:57.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.550 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.550 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418234+0000", 2024-04-24T13:33:57.550 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024391310000000002 2024-04-24T13:33:57.550 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.550 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418476+0000", 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000242026 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418697+0000", 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000220564 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.432206+0000", 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013508922 2024-04-24T13:33:57.551 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440330+0000", 2024-04-24T13:33:57.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081238649999999992 2024-04-24T13:33:57.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440414+0000", 2024-04-24T13:33:57.552 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4270999999999993e-05 2024-04-24T13:33:57.552 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.552 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.552 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.552 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440481+0000", 2024-04-24T13:33:57.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7402000000000003e-05 2024-04-24T13:33:57.553 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.553 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.553 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.553 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.553 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.553 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3859 3.34 3:2daed54a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:33:57.553 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:55.939896+0000", 2024-04-24T13:33:57.553 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.509267275, 2024-04-24T13:33:57.553 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032849999999999997, 2024-04-24T13:33:57.553 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.553 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.553 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.554 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.554 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.554 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.554 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3859 2024-04-24T13:33:57.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.554 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.554 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.939896+0000", 2024-04-24T13:33:57.554 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.554 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.554 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.554 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.939896+0000", 2024-04-24T13:33:57.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.939900+0000", 2024-04-24T13:33:57.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3170000000000003e-06 2024-04-24T13:33:57.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.555 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.555 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.555 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.947660+0000", 2024-04-24T13:33:57.555 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077590539999999996 2024-04-24T13:33:57.555 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.947706+0000", 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6712999999999998e-05 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.947726+0000", 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9700000000000001e-05 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.947884+0000", 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158474 2024-04-24T13:33:57.556 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.948144+0000", 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025912 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.948379+0000", 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000235679 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.970143+0000", 2024-04-24T13:33:57.557 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021763480000000002 2024-04-24T13:33:57.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.972541+0000", 2024-04-24T13:33:57.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023987169999999999 2024-04-24T13:33:57.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.558 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.972644+0000", 2024-04-24T13:33:57.558 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102907 2024-04-24T13:33:57.558 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.558 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.558 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.972746+0000", 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101839 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3954 3.9 3:926d5c8b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_178:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.917295+0000", 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.53186837300000001, 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025100502, 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:57.559 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:57.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:57.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:57.560 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:57.560 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3954 2024-04-24T13:33:57.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.560 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:57.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:57.560 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.917295+0000", 2024-04-24T13:33:57.560 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.560 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.560 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.560 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.917295+0000", 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.917299+0000", 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.63e-06 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.925481+0000", 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081818599999999991 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.561 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.925523+0000", 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2858999999999997e-05 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.925552+0000", 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8509000000000001e-05 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.925696+0000", 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014430199999999999 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.562 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.925974+0000", 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000278056 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.926230+0000", 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025586899999999999 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.935676+0000", 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0094460110000000007 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.563 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.942188+0000", 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065123189999999999 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.942312+0000", 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012357899999999999 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.942396+0000", 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.3508000000000001e-05 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.564 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.565 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.565 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:57.565 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:57.565 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:57.566 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is set 2024-04-24T13:33:57.567 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:33:57.567 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:57.562+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:57.670 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:57.664+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:57.751 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:57.751 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:57.751 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:33:57.751 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:57.769 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:33:57.770 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:57.766+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:57.868 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:57.866+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:57.908 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=false 2024-04-24T13:33:57.946 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:33:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:33:57.946 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:33:57.946 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:57.970 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:33:57.970 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:57.966+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:58.070 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:58.066+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:58.088 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:33:58.088 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:33:58.100 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:33:58.100 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:33:58.100 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:33:58.100 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:33:58.100 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.101 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2251 3.3a 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:33:58.101 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:33:58.101 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 89.263257367999998, 2024-04-24T13:33:58.101 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030524880000000001, 2024-04-24T13:33:58.101 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.101 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.101 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.101 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.101 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.101 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.101 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2251 2024-04-24T13:33:58.101 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.101 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:33:58.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:33:58.102 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.102 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.102 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.102 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.102 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834880+0000", 2024-04-24T13:33:58.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6769999999999999e-06 2024-04-24T13:33:58.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839556+0000", 2024-04-24T13:33:58.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046751350000000004 2024-04-24T13:33:58.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.103 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.103 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.103 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839593+0000", 2024-04-24T13:33:58.103 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7079999999999997e-05 2024-04-24T13:33:58.103 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839617+0000", 2024-04-24T13:33:58.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4015999999999998e-05 2024-04-24T13:33:58.104 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.104 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.104 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.104 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839773+0000", 2024-04-24T13:33:58.104 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015627699999999999 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840011+0000", 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023843900000000001 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840261+0000", 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024939899999999997 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.105 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.853562+0000", 2024-04-24T13:33:58.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013301726999999999 2024-04-24T13:33:58.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865276+0000", 2024-04-24T13:33:58.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011713779000000001 2024-04-24T13:33:58.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.106 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.106 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.106 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865349+0000", 2024-04-24T13:33:58.106 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2624000000000001e-05 2024-04-24T13:33:58.106 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.107 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.107 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865403+0000", 2024-04-24T13:33:58.107 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3727000000000002e-05 2024-04-24T13:33:58.107 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.107 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.107 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.107 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.107 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.107 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2665 3.1d 3:b85990f0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:33:58.107 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.162820+0000", 2024-04-24T13:33:58.108 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.935315228, 2024-04-24T13:33:58.108 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031707361000000003, 2024-04-24T13:33:58.108 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.108 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.108 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.108 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.108 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.108 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.108 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2665 2024-04-24T13:33:58.108 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.108 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.108 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.108 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.162820+0000", 2024-04-24T13:33:58.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.162820+0000", 2024-04-24T13:33:58.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.109 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.109 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.109 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.162824+0000", 2024-04-24T13:33:58.109 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.997e-06 2024-04-24T13:33:58.109 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171282+0000", 2024-04-24T13:33:58.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084578310000000007 2024-04-24T13:33:58.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171325+0000", 2024-04-24T13:33:58.110 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3183000000000003e-05 2024-04-24T13:33:58.110 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.110 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.110 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.110 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171346+0000", 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0976999999999999e-05 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171546+0000", 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020003100000000001 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171818+0000", 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027171500000000001 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.111 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:58.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.172172+0000", 2024-04-24T13:33:58.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035402699999999998 2024-04-24T13:33:58.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.188938+0000", 2024-04-24T13:33:58.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016766519000000001 2024-04-24T13:33:58.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.112 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.112 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.112 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.194193+0000", 2024-04-24T13:33:58.112 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052545140000000001 2024-04-24T13:33:58.112 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.194379+0000", 2024-04-24T13:33:58.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000186212 2024-04-24T13:33:58.113 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.113 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.113 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.113 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.194527+0000", 2024-04-24T13:33:58.113 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148355 2024-04-24T13:33:58.113 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.113 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.113 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.114 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.114 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.114 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2726 3.3c 3:3c53550d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:33:58.114 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.682300+0000", 2024-04-24T13:33:58.114 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 52.415834738000001, 2024-04-24T13:33:58.114 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032107164000000001, 2024-04-24T13:33:58.114 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.114 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.115 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.115 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.115 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.115 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.115 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2726 2024-04-24T13:33:58.115 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.115 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.115 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.115 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.115 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.682300+0000", 2024-04-24T13:33:58.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.682300+0000", 2024-04-24T13:33:58.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.116 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.116 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.116 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.682304+0000", 2024-04-24T13:33:58.116 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6270000000000002e-06 2024-04-24T13:33:58.116 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.687934+0000", 2024-04-24T13:33:58.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056300899999999999 2024-04-24T13:33:58.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.117 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.117 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.117 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.687976+0000", 2024-04-24T13:33:58.117 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1542999999999998e-05 2024-04-24T13:33:58.117 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.687995+0000", 2024-04-24T13:33:58.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9326000000000001e-05 2024-04-24T13:33:58.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.688149+0000", 2024-04-24T13:33:58.118 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015422299999999999 2024-04-24T13:33:58.118 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.118 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.118 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:33:58.118 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.688160+0000", 2024-04-24T13:33:58.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0723000000000001e-05 2024-04-24T13:33:58.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.691501+0000", 2024-04-24T13:33:58.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033414619999999999 2024-04-24T13:33:58.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.119 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.119 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.691704+0000", 2024-04-24T13:33:58.119 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020224899999999999 2024-04-24T13:33:58.119 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.119 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:58.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.691913+0000", 2024-04-24T13:33:58.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020945800000000001 2024-04-24T13:33:58.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.711338+0000", 2024-04-24T13:33:58.120 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019425141999999999 2024-04-24T13:33:58.120 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.120 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.120 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.120 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.714104+0000", 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027660340000000001 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.714273+0000", 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016885500000000001 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.714407+0000", 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134432 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.121 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.122 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.122 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3088 3.2f 3:f713650a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:58.122 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.537981+0000", 2024-04-24T13:33:58.122 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.560154124, 2024-04-24T13:33:58.122 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029051113999999999, 2024-04-24T13:33:58.122 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.122 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.122 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.122 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.122 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3088 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.537981+0000", 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.537981+0000", 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.537983+0000", 2024-04-24T13:33:58.123 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3499999999999999e-06 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546609+0000", 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086254480000000008 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546652+0000", 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3346000000000001e-05 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546671+0000", 2024-04-24T13:33:58.124 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8899999999999999e-05 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546852+0000", 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000181318 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.547138+0000", 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028545099999999999 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.547379+0000", 2024-04-24T13:33:58.125 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024102800000000001 2024-04-24T13:33:58.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.565501+0000", 2024-04-24T13:33:58.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018122406000000001 2024-04-24T13:33:58.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.126 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.566815+0000", 2024-04-24T13:33:58.126 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001313579 2024-04-24T13:33:58.126 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.126 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.126 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.566911+0000", 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6056000000000003e-05 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567032+0000", 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012123199999999999 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3090 3.36 e112/103 3:6dcd93d9:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_5:head v 112'10, mlcod=102'8)", 2024-04-24T13:33:58.127 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.571193+0000", 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.526941769, 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029191265000000001, 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.571193+0000", 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.571193+0000", 2024-04-24T13:33:58.128 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.571196+0000", 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3860000000000001e-06 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574406+0000", 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032107809999999998 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.129 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574468+0000", 2024-04-24T13:33:58.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1636000000000004e-05 2024-04-24T13:33:58.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574496+0000", 2024-04-24T13:33:58.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-05 2024-04-24T13:33:58.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.130 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.130 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574664+0000", 2024-04-24T13:33:58.130 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000168185 2024-04-24T13:33:58.130 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.130 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574703+0000", 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8318999999999997e-05 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.600283+0000", 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025580226000000001 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.600385+0000", 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010160199999999999 2024-04-24T13:33:58.131 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3107 3.16 3:6bf97696:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.764376+0000", 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.33375869, 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034648104999999998, 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.132 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3107 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.764376+0000", 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.764376+0000", 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.133 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.764380+0000", 2024-04-24T13:33:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1030000000000004e-06 2024-04-24T13:33:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771397+0000", 2024-04-24T13:33:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00701682 2024-04-24T13:33:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771445+0000", 2024-04-24T13:33:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7273e-05 2024-04-24T13:33:58.134 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771465+0000", 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0506999999999999e-05 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771641+0000", 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000175661 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.772047+0000", 2024-04-24T13:33:58.135 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040609000000000001 2024-04-24T13:33:58.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.136 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:33:58.136 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.772460+0000", 2024-04-24T13:33:58.136 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041274699999999998 2024-04-24T13:33:58.136 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.136 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.793165+0000", 2024-04-24T13:33:58.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020705128 2024-04-24T13:33:58.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.137 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.798765+0000", 2024-04-24T13:33:58.137 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055998250000000001 2024-04-24T13:33:58.137 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.137 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.137 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.798903+0000", 2024-04-24T13:33:58.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013819200000000001 2024-04-24T13:33:58.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.138 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.138 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.138 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.799024+0000", 2024-04-24T13:33:58.138 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121759 2024-04-24T13:33:58.138 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.138 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.138 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.138 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.139 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.139 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3380 3.3a 3:5cb232f4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_285:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:58.139 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.346253+0000", 2024-04-24T13:33:58.139 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 25.751882008999999, 2024-04-24T13:33:58.139 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032318024000000001, 2024-04-24T13:33:58.139 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.139 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.139 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.139 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.139 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.139 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.139 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3380 2024-04-24T13:33:58.139 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.346253+0000", 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.346253+0000", 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.140 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.346257+0000", 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1699999999999999e-06 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350569+0000", 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043118740000000003 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350632+0000", 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2663000000000006e-05 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.141 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350665+0000", 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2895999999999998e-05 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350861+0000", 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019607199999999999 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.351303+0000", 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044276299999999999 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.142 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.351690+0000", 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038655699999999999 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.362989+0000", 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011298475000000001 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.378400+0000", 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015411747999999999 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.143 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.378496+0000", 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6152999999999999e-05 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.378571+0000", 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4653000000000005e-05 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.144 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3420 3.c 3:30a790eb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_318:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.718876+0000", 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 25.379259457, 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028978935000000001, 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3420 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.145 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.718876+0000", 2024-04-24T13:33:58.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.718876+0000", 2024-04-24T13:33:58.146 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.146 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.146 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.146 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.146 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.718895+0000", 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9517e-05 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728273+0000", 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093782440000000009 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728295+0000", 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1742999999999998e-05 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.147 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728312+0000", 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6413999999999999e-05 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728441+0000", 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129419 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728811+0000", 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037002299999999998 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:58.148 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.729054+0000", 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024291100000000001 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.739199+0000", 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010145101 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.747523+0000", 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0083244700000000005 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.149 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.747721+0000", 2024-04-24T13:33:58.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019801399999999999 2024-04-24T13:33:58.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.150 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.150 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.747855+0000", 2024-04-24T13:33:58.150 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000133079 2024-04-24T13:33:58.150 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.150 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.150 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.150 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.150 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.150 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3483 3.c 3:3033c1b6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_381:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:33:58.150 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.370370+0000", 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.727765341000001, 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.043221212000000002, 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3483 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.151 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.370370+0000", 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.370370+0000", 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.370419+0000", 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9283000000000002e-05 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.152 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.374810+0000", 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043905979999999999 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.374848+0000", 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8041999999999999e-05 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.374871+0000", 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.153 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.379359+0000", 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044878909999999999 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.379749+0000", 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038957 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.380113+0000", 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000363834 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.154 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.392454+0000", 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012341097000000001 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.413294+0000", 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020840033000000001 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.413471+0000", 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000177579 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.155 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.413591+0000", 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119492 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3520 3.3a 3:5c3c2822:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_418:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.756549+0000", 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.341585854000002, 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027907472999999999, 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.156 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3520 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.756549+0000", 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.756549+0000", 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.157 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.756554+0000", 2024-04-24T13:33:58.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3059999999999999e-06 2024-04-24T13:33:58.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.761743+0000", 2024-04-24T13:33:58.158 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051890850000000004 2024-04-24T13:33:58.158 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.158 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.158 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.158 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.761791+0000", 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8359999999999998e-05 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.761812+0000", 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1223e-05 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.761994+0000", 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018138200000000001 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.159 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.762425+0000", 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043116600000000003 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.762848+0000", 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042281399999999998 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.773653+0000", 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010805682 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.160 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.784146+0000", 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010492837 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.784325+0000", 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017865900000000001 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.784457+0000", 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013195899999999999 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.161 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.162 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.162 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.162 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.162 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3548 3.1d 3:bbc96e42:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_446:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:33:58.162 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.038024+0000", 2024-04-24T13:33:58.162 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 24.060110739999999, 2024-04-24T13:33:58.162 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028372396000000001, 2024-04-24T13:33:58.162 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.162 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.162 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.162 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.162 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.162 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3548 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.038024+0000", 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.038024+0000", 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.163 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.038058+0000", 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4042999999999999e-05 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043019+0000", 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049610390000000004 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043092+0000", 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2166e-05 2024-04-24T13:33:58.164 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043120+0000", 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8390000000000001e-05 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043309+0000", 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000189345 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043724+0000", 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041498700000000002 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.165 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:58.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.044164+0000", 2024-04-24T13:33:58.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043983299999999999 2024-04-24T13:33:58.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.057294+0000", 2024-04-24T13:33:58.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01313023 2024-04-24T13:33:58.166 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.166 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.166 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.166 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.066184+0000", 2024-04-24T13:33:58.166 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088898120000000004 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.066284+0000", 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9984999999999999e-05 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.066397+0000", 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011256600000000001 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.167 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3874 3.1c 3:3b11da42:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.085616+0000", 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.0125186030000002, 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028220240000000001, 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3874 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.168 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.085616+0000", 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.085616+0000", 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.085621+0000", 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7400000000000004e-06 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.169 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.090183+0000", 2024-04-24T13:33:58.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045617069999999999 2024-04-24T13:33:58.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.090217+0000", 2024-04-24T13:33:58.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4263e-05 2024-04-24T13:33:58.170 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.170 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.170 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.170 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.090236+0000", 2024-04-24T13:33:58.170 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8810000000000001e-05 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.090397+0000", 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016104699999999999 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.090751+0000", 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000354259 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:33:58.171 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.091135+0000", 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038387499999999999 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.110988+0000", 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019853061000000002 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.113553+0000", 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025646250000000001 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.113714+0000", 2024-04-24T13:33:58.172 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000161392 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.113837+0000", 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012246100000000001 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3907 3.22 3:46fb8056:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.407579+0000", 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.69055562, 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034857285000000002, 2024-04-24T13:33:58.173 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.174 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.174 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.174 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.174 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.174 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.174 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3907 2024-04-24T13:33:58.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.174 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.174 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.174 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.174 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.407579+0000", 2024-04-24T13:33:58.174 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.174 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.407579+0000", 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.407583+0000", 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.546e-06 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.415996+0000", 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084128529999999997 2024-04-24T13:33:58.175 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.416035+0000", 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9422000000000003e-05 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.416054+0000", 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9020000000000001e-05 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.416234+0000", 2024-04-24T13:33:58.176 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017937500000000001 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.416646+0000", 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041236700000000002 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.417057+0000", 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041098699999999997 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.177 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.430716+0000", 2024-04-24T13:33:58.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013659190999999999 2024-04-24T13:33:58.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.178 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.442210+0000", 2024-04-24T13:33:58.178 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011493348 2024-04-24T13:33:58.178 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.178 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.178 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.442329+0000", 2024-04-24T13:33:58.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119028 2024-04-24T13:33:58.179 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.179 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.179 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.179 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.442437+0000", 2024-04-24T13:33:58.179 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108148 2024-04-24T13:33:58.179 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.179 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.179 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3912 3.c 3:32d3ce07:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.455463+0000", 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.642672248, 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034289577000000002, 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3912 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.180 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.455463+0000", 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.455463+0000", 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.455494+0000", 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0911999999999998e-05 2024-04-24T13:33:58.181 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.462171+0000", 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066776450000000003 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.462219+0000", 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8096000000000002e-05 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.462240+0000", 2024-04-24T13:33:58.182 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0112999999999999e-05 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.462404+0000", 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016432 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.462840+0000", 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043655799999999998 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:58.183 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.463172+0000", 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033127500000000002 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.475658+0000", 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012486397 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.489476+0000", 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013817685 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.184 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.489630+0000", 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153838 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.489752+0000", 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122738 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3933 3.c 3:32cafe03:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.681901+0000", 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.4162345460000001, 2024-04-24T13:33:58.185 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028961298, 2024-04-24T13:33:58.186 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.186 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.186 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.186 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.186 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3933 2024-04-24T13:33:58.186 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.187 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.681901+0000", 2024-04-24T13:33:58.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.187 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.681901+0000", 2024-04-24T13:33:58.187 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.187 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.187 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.187 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.681904+0000", 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.41e-06 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.686760+0000", 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048558639999999997 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.686802+0000", 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2622e-05 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.188 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.686822+0000", 2024-04-24T13:33:58.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9953e-05 2024-04-24T13:33:58.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.686961+0000", 2024-04-24T13:33:58.189 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000138498 2024-04-24T13:33:58.189 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.189 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.189 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.189 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.687262+0000", 2024-04-24T13:33:58.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030122200000000002 2024-04-24T13:33:58.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:58.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.687501+0000", 2024-04-24T13:33:58.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023848000000000001 2024-04-24T13:33:58.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.190 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.190 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.699846+0000", 2024-04-24T13:33:58.190 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012344963 2024-04-24T13:33:58.190 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.190 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.710327+0000", 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010481829 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.710750+0000", 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042271099999999999 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.710862+0000", 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111746 2024-04-24T13:33:58.191 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3958 3.16 3:6aedc82b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.956908+0000", 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.141226904, 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042285376, 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.192 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3958 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.956908+0000", 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.956908+0000", 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.193 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.956910+0000", 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1959999999999998e-06 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.962795+0000", 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058843589999999996 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.962832+0000", 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7406000000000001e-05 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.194 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.962849+0000", 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7169000000000001e-05 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.963016+0000", 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016647799999999999 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.963315+0000", 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000299516 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.195 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.963561+0000", 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024568000000000002 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.993441+0000", 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029879658999999999 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.999055+0000", 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056145559999999997 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.196 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.999141+0000", 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5779999999999995e-05 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.999194+0000", 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2577000000000002e-05 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3971 3.c 3:3025c353:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:33:58.197 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:57.111089+0000", 2024-04-24T13:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.98704591100000005, 2024-04-24T13:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029562297000000001, 2024-04-24T13:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3971 2024-04-24T13:33:58.198 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.111089+0000", 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.111089+0000", 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.199 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.111093+0000", 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6399999999999999e-06 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.115186+0000", 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004092788 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.115219+0000", 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3887000000000003e-05 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.200 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.115245+0000", 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5062000000000002e-05 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.115363+0000", 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118125 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.115595+0000", 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232208 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.201 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.115802+0000", 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020743399999999999 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.125479+0000", 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096769739999999996 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.140451+0000", 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014971635 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.202 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.140575+0000", 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124072 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.140651+0000", 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6471999999999996e-05 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3977 3.30 3:0e7c1a92:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:57.184722+0000", 2024-04-24T13:33:58.203 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.91341329599999999, 2024-04-24T13:33:58.204 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030392626999999998, 2024-04-24T13:33:58.204 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.204 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.204 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.204 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.204 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3977 2024-04-24T13:33:58.204 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.204 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.204 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.204 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.184722+0000", 2024-04-24T13:33:58.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.184722+0000", 2024-04-24T13:33:58.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.205 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.205 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.205 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.184725+0000", 2024-04-24T13:33:58.205 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0920000000000002e-06 2024-04-24T13:33:58.205 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.188732+0000", 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040074109999999998 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.188769+0000", 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7116000000000002e-05 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.188786+0000", 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6863000000000001e-05 2024-04-24T13:33:58.206 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.188881+0000", 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4734999999999993e-05 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.189059+0000", 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017770199999999999 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.189223+0000", 2024-04-24T13:33:58.207 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016456500000000001 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.198455+0000", 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0092320760000000005 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.214788+0000", 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016332170999999999 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.214972+0000", 2024-04-24T13:33:58.208 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000184184 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.215114+0000", 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142712 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4001 3.5 3:a2733705:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:57.547802+0000", 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.55033288599999997, 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029378332, 2024-04-24T13:33:58.209 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4001 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.547802+0000", 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.210 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.547802+0000", 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.547805+0000", 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0000000000000001e-06 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.551839+0000", 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040333890000000001 2024-04-24T13:33:58.211 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.551864+0000", 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5507000000000002e-05 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.551877+0000", 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2893e-05 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.552073+0000", 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000195854 2024-04-24T13:33:58.212 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.552342+0000", 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026963200000000001 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.552589+0000", 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024700299999999998 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.562283+0000", 2024-04-24T13:33:58.213 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096937340000000007 2024-04-24T13:33:58.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.576912+0000", 2024-04-24T13:33:58.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014628390999999999 2024-04-24T13:33:58.214 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.214 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.214 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.214 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.577074+0000", 2024-04-24T13:33:58.214 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162867 2024-04-24T13:33:58.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.215 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.215 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.577181+0000", 2024-04-24T13:33:58.215 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106062 2024-04-24T13:33:58.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.215 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.215 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.215 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.215 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.215 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4006 3.3c 3:3cf6118c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131)", 2024-04-24T13:33:58.216 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:57.606243+0000", 2024-04-24T13:33:58.216 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 0.49189161100000001, 2024-04-24T13:33:58.216 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027927771000000001, 2024-04-24T13:33:58.216 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:33:58.216 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:33:58.216 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:33:58.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:33:58.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:33:58.216 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:33:58.216 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4006 2024-04-24T13:33:58.216 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.216 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:33:58.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:33:58.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.606243+0000", 2024-04-24T13:33:58.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:33:58.217 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.606243+0000", 2024-04-24T13:33:58.217 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:33:58.217 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.217 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.217 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:33:58.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.606246+0000", 2024-04-24T13:33:58.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9569999999999998e-06 2024-04-24T13:33:58.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:33:58.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.612428+0000", 2024-04-24T13:33:58.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006181705 2024-04-24T13:33:58.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.218 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.218 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:33:58.218 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.612471+0000", 2024-04-24T13:33:58.218 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3328999999999998e-05 2024-04-24T13:33:58.218 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:33:58.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.612492+0000", 2024-04-24T13:33:58.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0236000000000001e-05 2024-04-24T13:33:58.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:33:58.219 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.612693+0000", 2024-04-24T13:33:58.219 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201724 2024-04-24T13:33:58.219 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.219 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.219 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:33:58.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.613169+0000", 2024-04-24T13:33:58.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047542999999999999 2024-04-24T13:33:58.220 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.220 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.220 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:33:58.220 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.613434+0000", 2024-04-24T13:33:58.220 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026466599999999999 2024-04-24T13:33:58.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:33:58.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.623732+0000", 2024-04-24T13:33:58.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010298539000000001 2024-04-24T13:33:58.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:33:58.221 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.633995+0000", 2024-04-24T13:33:58.221 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010262521 2024-04-24T13:33:58.221 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.221 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.221 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:33:58.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.634098+0000", 2024-04-24T13:33:58.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103755 2024-04-24T13:33:58.222 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:33:58.222 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:33:58.222 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:33:58.222 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.634171+0000", 2024-04-24T13:33:58.222 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2909000000000003e-05 2024-04-24T13:33:58.222 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.222 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.222 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.222 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:33:58.222 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:33:58.222 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:33:58.223 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:33:58.224 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:33:58.224 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:33:58.225 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:33:58.225 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:33:58.225 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:58.220+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:58.226 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:33:58.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:33:58.226 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:33:58.226 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:33:58.227 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:33:58.227 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:33:58.232 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:33:58.233 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:33:58.259 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:33:58.259 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:33:58.326 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:58.326+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:58.409 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:58.409 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:58.426 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:33:58.422+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:33:58.429 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:33:58.526 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:58.524+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:58.567 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:58.567 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:58.586 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:33:58.628 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:33:58.626+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:33:58.729 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:58.724+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:58.763 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:58.763 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:58.777 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:33:58.870 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:58.868+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:58.931 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:58.928+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:58.953 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:58.953 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:58.972 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:33:59.032 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:59.030+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:59.133 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:59.130+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:59.142 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:59.142 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:59.156 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:33:59.234 INFO:tasks.ceph.osd.3.smithi071.stderr:2024-04-24T13:33:59.230+0000 7f6c78502640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 3 (PID: 25169) UID: 0 2024-04-24T13:33:59.285 INFO:teuthology.orchestra.run.smithi138.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:59.285 INFO:teuthology.orchestra.run.smithi138.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:59.300 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_ops_in_flight 2024-04-24T13:33:59.335 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:33:59.332+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:33:59.436 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:59.432+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:59.442 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:59.442 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:59.461 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_blocked_ops 2024-04-24T13:33:59.537 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:33:59.532+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:33:59.602 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:33:59.612 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:59.612 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:59.639 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.0.asok dump_historic_ops 2024-04-24T13:33:59.639 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:33:59.634+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:33:59.738 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:59.736+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:33:59.836 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:33:59.836 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:33:59.840 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:33:59.836+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:33:59.859 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_ops_in_flight 2024-04-24T13:33:59.940 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:33:59.936+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:34:00.017 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:34:00.017 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:34:00.041 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:34:00.038+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:34:00.045 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_blocked_ops 2024-04-24T13:34:00.143 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:34:00.140+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:34:00.243 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:34:00.244 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:34:00.244 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:34:00.242+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:34:00.268 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.1.asok dump_historic_ops 2024-04-24T13:34:00.285 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'osd.*' injectargs --osd_enable_op_tracker=true 2024-04-24T13:34:00.355 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:34:00.354+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:34:00.444 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:34:00.442+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:34:00.455 INFO:teuthology.orchestra.run.smithi071.stdout:ERROR: (22) Invalid argument 2024-04-24T13:34:00.455 INFO:teuthology.orchestra.run.smithi071.stdout:op_tracker tracking is not enabled now, so no ops are tracked currently, even those get stuck. Please enable "osd_enable_op_tracker", and the tracker will start to track new ops received afterwards. 2024-04-24T13:34:00.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_ops_in_flight 2024-04-24T13:34:00.496 INFO:teuthology.orchestra.run.smithi071.stdout:osd.0: {} 2024-04-24T13:34:00.496 INFO:teuthology.orchestra.run.smithi071.stderr:osd.0: osd_enable_op_tracker = '' 2024-04-24T13:34:00.520 INFO:teuthology.orchestra.run.smithi071.stdout:osd.1: {} 2024-04-24T13:34:00.520 INFO:teuthology.orchestra.run.smithi071.stderr:osd.1: osd_enable_op_tracker = '' 2024-04-24T13:34:00.551 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:34:00.550+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:34:00.553 INFO:teuthology.orchestra.run.smithi071.stdout:osd.2: {} 2024-04-24T13:34:00.553 INFO:teuthology.orchestra.run.smithi071.stderr:osd.2: osd_enable_op_tracker = '' 2024-04-24T13:34:00.594 INFO:teuthology.orchestra.run.smithi071.stdout:osd.3: {} 2024-04-24T13:34:00.594 INFO:teuthology.orchestra.run.smithi071.stderr:osd.3: osd_enable_op_tracker = '' 2024-04-24T13:34:00.630 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:34:00.642 INFO:teuthology.orchestra.run.smithi071.stdout:osd.4: {} 2024-04-24T13:34:00.643 INFO:teuthology.orchestra.run.smithi071.stderr:osd.4: osd_enable_op_tracker = '' 2024-04-24T13:34:00.646 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:34:00.644+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:34:00.667 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:00.667 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:34:00.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:00.667 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:4251 3.4 e132/20 3:2396f0ca:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_465:head v 132'14, mlcod=131'12)", 2024-04-24T13:34:00.667 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:34:00.660945+0000", 2024-04-24T13:34:00.667 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.006118213, 2024-04-24T13:34:00.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061517680000000002, 2024-04-24T13:34:00.667 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:00.667 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:00.667 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "started", 2024-04-24T13:34:00.667 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:00.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:00.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:00.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.660945+0000", 2024-04-24T13:34:00.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:00.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:00.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:00.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:00.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.660945+0000", 2024-04-24T13:34:00.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:00.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:00.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:00.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:00.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.660945+0000", 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.28e-07 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.661976+0000", 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010307420000000001 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.661993+0000", 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.7034e-05 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:00.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.662005+0000", 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.164e-05 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.662084+0000", 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9474000000000005e-05 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.662114+0000", 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9893e-05 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:00.670 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:00.671 INFO:teuthology.orchestra.run.smithi071.stdout: ], 2024-04-24T13:34:00.671 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 1 2024-04-24T13:34:00.671 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:00.688 INFO:teuthology.orchestra.run.smithi071.stdout:osd.5: {} 2024-04-24T13:34:00.688 INFO:teuthology.orchestra.run.smithi071.stderr:osd.5: osd_enable_op_tracker = '' 2024-04-24T13:34:00.690 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_blocked_ops 2024-04-24T13:34:00.714 INFO:teuthology.orchestra.run.smithi071.stdout:osd.6: {} 2024-04-24T13:34:00.714 INFO:teuthology.orchestra.run.smithi071.stderr:osd.6: osd_enable_op_tracker = '' 2024-04-24T13:34:00.747 INFO:teuthology.orchestra.run.smithi071.stdout:osd.7: {} 2024-04-24T13:34:00.747 INFO:teuthology.orchestra.run.smithi071.stderr:osd.7: osd_enable_op_tracker = '' 2024-04-24T13:34:00.748 INFO:tasks.ceph.osd.5.smithi138.stderr:2024-04-24T13:34:00.744+0000 7fe8c1447640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 5 (PID: 25242) UID: 0 2024-04-24T13:34:00.849 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:34:00.846+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:34:00.870 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:00.870 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:34:00.871 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:34:00.871 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:34:00.871 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:00.889 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.2.asok dump_historic_ops 2024-04-24T13:34:00.951 INFO:tasks.ceph.osd.6.smithi138.stderr:2024-04-24T13:34:00.948+0000 7f5cd2729640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 6 (PID: 25244) UID: 0 2024-04-24T13:34:01.052 INFO:tasks.ceph.osd.4.smithi138.stderr:2024-04-24T13:34:01.048+0000 7f0380751640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 4 (PID: 25240) UID: 0 2024-04-24T13:34:01.060 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:01.060 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2206 3.f 3:f35e5a46:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 92.767025564999997, 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028291495999999999, 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2206 2024-04-24T13:34:01.061 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:34:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290395+0000", 2024-04-24T13:34:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.062 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.290398+0000", 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3500000000000001e-06 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294671+0000", 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0042724390000000003 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294711+0000", 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0376000000000001e-05 2024-04-24T13:34:01.063 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294730+0000", 2024-04-24T13:34:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8607e-05 2024-04-24T13:34:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.294856+0000", 2024-04-24T13:34:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000126651 2024-04-24T13:34:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.064 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295125+0000", 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026840700000000002 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.295349+0000", 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022454699999999999 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.307240+0000", 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011891048 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.065 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318593+0000", 2024-04-24T13:34:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011352777999999999 2024-04-24T13:34:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318652+0000", 2024-04-24T13:34:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8677000000000001e-05 2024-04-24T13:34:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.318686+0000", 2024-04-24T13:34:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4616000000000002e-05 2024-04-24T13:34:01.066 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2710 3.3b 3:ddce91ac:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_39:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:34:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:34:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.545292498000002, 2024-04-24T13:34:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026438756000000001, 2024-04-24T13:34:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.067 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2710 2024-04-24T13:34:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:34:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.068 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512128+0000", 2024-04-24T13:34:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.512131+0000", 2024-04-24T13:34:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0130000000000002e-06 2024-04-24T13:34:01.069 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514363+0000", 2024-04-24T13:34:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022325940000000001 2024-04-24T13:34:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.070 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514394+0000", 2024-04-24T13:34:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.0144000000000001e-05 2024-04-24T13:34:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514409+0000", 2024-04-24T13:34:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5786000000000001e-05 2024-04-24T13:34:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514497+0000", 2024-04-24T13:34:01.071 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7876999999999999e-05 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514670+0000", 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000173096 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.514768+0000", 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.8089000000000002e-05 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.072 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.523354+0000", 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0085854190000000004 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538483+0000", 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015128922 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538527+0000", 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.3835999999999998e-05 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.073 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.538567+0000", 2024-04-24T13:34:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.998e-05 2024-04-24T13:34:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3094 3.14 3:29338048:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_9:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:34:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:34:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.461065325, 2024-04-24T13:34:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022112211, 2024-04-24T13:34:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.074 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3094 2024-04-24T13:34:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:34:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.075 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596355+0000", 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.596358+0000", 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6560000000000001e-06 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598612+0000", 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022539050000000001 2024-04-24T13:34:01.076 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598639+0000", 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7767e-05 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598651+0000", 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1277000000000001e-05 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598735+0000", 2024-04-24T13:34:01.077 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4176000000000002e-05 2024-04-24T13:34:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.598928+0000", 2024-04-24T13:34:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019318199999999999 2024-04-24T13:34:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:34:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.599089+0000", 2024-04-24T13:34:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016078899999999999 2024-04-24T13:34:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.078 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.612538+0000", 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013449081999999999 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618346+0000", 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0058079799999999999 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618413+0000", 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7101999999999996e-05 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.079 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.618467+0000", 2024-04-24T13:34:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4295000000000001e-05 2024-04-24T13:34:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3128 3.1f 3:f8849f48:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_43:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:34:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:34:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.070681340999997, 2024-04-24T13:34:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.027867126999999998, 2024-04-24T13:34:01.080 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3128 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.081 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986739+0000", 2024-04-24T13:34:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.986743+0000", 2024-04-24T13:34:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.495e-06 2024-04-24T13:34:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.082 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988482+0000", 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001739237 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988510+0000", 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8343999999999998e-05 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988525+0000", 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5384999999999999e-05 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.083 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988630+0000", 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010412 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988808+0000", 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178123 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.988956+0000", 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014802399999999999 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.084 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.995102+0000", 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061461179999999999 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014480+0000", 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019378581999999998 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014541+0000", 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1007000000000001e-05 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.085 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.014606+0000", 2024-04-24T13:34:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.4691999999999997e-05 2024-04-24T13:34:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3426 3.f 3:f3517f93:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_324:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:34:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:34:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.263567854000001, 2024-04-24T13:34:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024699635000000001, 2024-04-24T13:34:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.086 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3426 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.087 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793853+0000", 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.793855+0000", 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4669999999999998e-06 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796548+0000", 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0026926369999999999 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.088 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796572+0000", 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4456000000000001e-05 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796586+0000", 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3937000000000001e-05 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796690+0000", 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000104226 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.089 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.796877+0000", 2024-04-24T13:34:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018668299999999999 2024-04-24T13:34:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.797048+0000", 2024-04-24T13:34:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017070599999999999 2024-04-24T13:34:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.817921+0000", 2024-04-24T13:34:01.090 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020873198999999999 2024-04-24T13:34:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818393+0000", 2024-04-24T13:34:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000472459 2024-04-24T13:34:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818475+0000", 2024-04-24T13:34:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.1403999999999995e-05 2024-04-24T13:34:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.091 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.818552+0000", 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7460999999999996e-05 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3427 3.21 3:854a3dc6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_325:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.252935715, 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023613657999999999, 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.092 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3427 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.093 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804485+0000", 2024-04-24T13:34:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.804488+0000", 2024-04-24T13:34:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.23e-06 2024-04-24T13:34:01.094 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807535+0000", 2024-04-24T13:34:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0030472709999999998 2024-04-24T13:34:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.095 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807563+0000", 2024-04-24T13:34:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8087999999999999e-05 2024-04-24T13:34:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807579+0000", 2024-04-24T13:34:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5732000000000001e-05 2024-04-24T13:34:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807691+0000", 2024-04-24T13:34:01.096 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111894 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.807850+0000", 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015951999999999999 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.808005+0000", 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000154487 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.823418+0000", 2024-04-24T13:34:01.097 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015413526 2024-04-24T13:34:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828003+0000", 2024-04-24T13:34:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045842299999999999 2024-04-24T13:34:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828048+0000", 2024-04-24T13:34:01.098 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5504999999999999e-05 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.828098+0000", 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0175e-05 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3430 3.3b 3:de51c163:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_328:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.219710867, 2024-04-24T13:34:01.099 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025624112000000001, 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3430 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.100 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837709+0000", 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.837713+0000", 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6509999999999999e-06 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839548+0000", 2024-04-24T13:34:01.101 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001834521 2024-04-24T13:34:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839577+0000", 2024-04-24T13:34:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8850999999999999e-05 2024-04-24T13:34:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839611+0000", 2024-04-24T13:34:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4140000000000002e-05 2024-04-24T13:34:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.102 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839718+0000", 2024-04-24T13:34:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000107534 2024-04-24T13:34:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.839883+0000", 2024-04-24T13:34:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016485999999999999 2024-04-24T13:34:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.840056+0000", 2024-04-24T13:34:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017321200000000001 2024-04-24T13:34:01.103 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.849455+0000", 2024-04-24T13:34:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093988590000000007 2024-04-24T13:34:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863165+0000", 2024-04-24T13:34:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013710178 2024-04-24T13:34:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.104 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863263+0000", 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7559000000000006e-05 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.863334+0000", 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0747000000000006e-05 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3443 3.a e113/48 3:53aaab58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_341:head v 113'18, mlcod=113'16)", 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:34:01.105 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.081763781999999, 2024-04-24T13:34:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022399639999999998, 2024-04-24T13:34:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:34:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.106 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975657+0000", 2024-04-24T13:34:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.975668+0000", 2024-04-24T13:34:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.113e-05 2024-04-24T13:34:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.107 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979725+0000", 2024-04-24T13:34:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040574219999999998 2024-04-24T13:34:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979759+0000", 2024-04-24T13:34:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4362000000000001e-05 2024-04-24T13:34:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979774+0000", 2024-04-24T13:34:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4935e-05 2024-04-24T13:34:01.108 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979871+0000", 2024-04-24T13:34:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.658e-05 2024-04-24T13:34:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.979901+0000", 2024-04-24T13:34:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9519999999999999e-05 2024-04-24T13:34:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.109 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.997990+0000", 2024-04-24T13:34:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018089483 2024-04-24T13:34:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:32.998056+0000", 2024-04-24T13:34:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6208e-05 2024-04-24T13:34:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.110 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3458 3.f 3:f34a4471:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_356:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.937247449000001, 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026075494000000001, 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3458 2024-04-24T13:34:01.111 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:34:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120173+0000", 2024-04-24T13:34:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.112 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.120175+0000", 2024-04-24T13:34:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5220000000000002e-06 2024-04-24T13:34:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.113 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121620+0000", 2024-04-24T13:34:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0014442280000000001 2024-04-24T13:34:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121646+0000", 2024-04-24T13:34:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6424999999999999e-05 2024-04-24T13:34:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121659+0000", 2024-04-24T13:34:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3086e-05 2024-04-24T13:34:01.114 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121754+0000", 2024-04-24T13:34:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.4388999999999994e-05 2024-04-24T13:34:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.121968+0000", 2024-04-24T13:34:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00021460199999999999 2024-04-24T13:34:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:01.115 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.122165+0000", 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019710999999999999 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.141554+0000", 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019388847000000001 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146083+0000", 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0045284469999999997 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.116 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146129+0000", 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6257000000000001e-05 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146248+0000", 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011958100000000001 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3460 3.a e113/48 3:5102140b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_358:head v 113'19, mlcod=113'17)", 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:34:01.117 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.911233425999999, 2024-04-24T13:34:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025573478, 2024-04-24T13:34:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:34:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.118 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146187+0000", 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.146188+0000", 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.02e-07 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150270+0000", 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.004082011 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.119 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150302+0000", 2024-04-24T13:34:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2570999999999997e-05 2024-04-24T13:34:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150319+0000", 2024-04-24T13:34:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6843000000000001e-05 2024-04-24T13:34:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.120 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150404+0000", 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.4538999999999998e-05 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150432+0000", 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8098000000000001e-05 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.170266+0000", 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019834497 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.121 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171760+0000", 2024-04-24T13:34:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001494017 2024-04-24T13:34:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3461 3.3b 3:dfe1b3a0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_359:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:34:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:34:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.908525520000001, 2024-04-24T13:34:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024256994, 2024-04-24T13:34:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.122 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3461 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.123 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148895+0000", 2024-04-24T13:34:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.148898+0000", 2024-04-24T13:34:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6970000000000002e-06 2024-04-24T13:34:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150603+0000", 2024-04-24T13:34:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017049809999999999 2024-04-24T13:34:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.124 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150615+0000", 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2368000000000001e-05 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150620+0000", 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5210000000000002e-06 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150671+0000", 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0315000000000002e-05 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.125 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.150844+0000", 2024-04-24T13:34:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017304399999999999 2024-04-24T13:34:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.151009+0000", 2024-04-24T13:34:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016544800000000001 2024-04-24T13:34:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.171479+0000", 2024-04-24T13:34:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020469355000000002 2024-04-24T13:34:01.126 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173035+0000", 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001556857 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173096+0000", 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0285999999999998e-05 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.173152+0000", 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6122000000000002e-05 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.127 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3491 3.14 3:2a9aeaa0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_389:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.594773616000001, 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029663012999999998, 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3491 2024-04-24T13:34:01.128 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462647+0000", 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.462649+0000", 2024-04-24T13:34:01.129 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.65e-06 2024-04-24T13:34:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464539+0000", 2024-04-24T13:34:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001889527 2024-04-24T13:34:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464565+0000", 2024-04-24T13:34:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6061999999999999e-05 2024-04-24T13:34:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.130 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464580+0000", 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5273000000000001e-05 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464678+0000", 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.7639000000000005e-05 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.464899+0000", 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000220638 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.131 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.465088+0000", 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018922700000000001 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.478519+0000", 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013430884000000001 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492184+0000", 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013665797 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.132 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492260+0000", 2024-04-24T13:34:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6038999999999995e-05 2024-04-24T13:34:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.492310+0000", 2024-04-24T13:34:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9277000000000003e-05 2024-04-24T13:34:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.133 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3514 3.a e114/48 3:5344e333:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_412:head v 114'23, mlcod=114'21)", 2024-04-24T13:34:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:34:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.355701901, 2024-04-24T13:34:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021739380999999999, 2024-04-24T13:34:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.134 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:34:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701718+0000", 2024-04-24T13:34:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.135 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.701734+0000", 2024-04-24T13:34:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5807999999999998e-05 2024-04-24T13:34:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705769+0000", 2024-04-24T13:34:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0040343660000000002 2024-04-24T13:34:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.136 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705801+0000", 2024-04-24T13:34:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2406000000000001e-05 2024-04-24T13:34:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705816+0000", 2024-04-24T13:34:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4537e-05 2024-04-24T13:34:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705925+0000", 2024-04-24T13:34:01.137 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109114 2024-04-24T13:34:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.705959+0000", 2024-04-24T13:34:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4239999999999997e-05 2024-04-24T13:34:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723399+0000", 2024-04-24T13:34:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017439748000000001 2024-04-24T13:34:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.138 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.723458+0000", 2024-04-24T13:34:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9162e-05 2024-04-24T13:34:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3525 3.f 3:f35962b2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_423:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:34:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:34:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.250203014, 2024-04-24T13:34:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028712260999999999, 2024-04-24T13:34:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.139 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3525 2024-04-24T13:34:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:34:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.140 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807217+0000", 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.807221+0000", 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.7529999999999999e-06 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813425+0000", 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0062037280000000004 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.141 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813449+0000", 2024-04-24T13:34:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4093000000000001e-05 2024-04-24T13:34:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813462+0000", 2024-04-24T13:34:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3200999999999999e-05 2024-04-24T13:34:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813554+0000", 2024-04-24T13:34:01.142 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2369999999999998e-05 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813730+0000", 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017569800000000001 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.813908+0000", 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000178219 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.826992+0000", 2024-04-24T13:34:01.143 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013083567000000001 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835795+0000", 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0088026630000000005 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835870+0000", 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5649999999999996e-05 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835930+0000", 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9318999999999999e-05 2024-04-24T13:34:01.144 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3528 3.3b 3:dc395008:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_426:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.221858948000001, 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024383452999999999, 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3528 2024-04-24T13:34:01.145 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:34:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835561+0000", 2024-04-24T13:34:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.146 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.835564+0000", 2024-04-24T13:34:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7369999999999998e-06 2024-04-24T13:34:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837236+0000", 2024-04-24T13:34:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001671964 2024-04-24T13:34:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837275+0000", 2024-04-24T13:34:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.8760000000000002e-05 2024-04-24T13:34:01.147 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837292+0000", 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6884999999999998e-05 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837382+0000", 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.9809999999999996e-05 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837556+0000", 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000174103 2024-04-24T13:34:01.148 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.837728+0000", 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017202600000000001 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859492+0000", 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021764644999999999 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859714+0000", 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000221809 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.149 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859857+0000", 2024-04-24T13:34:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000142738 2024-04-24T13:34:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.859945+0000", 2024-04-24T13:34:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7975999999999999e-05 2024-04-24T13:34:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.150 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3853 3.14 3:2921a635:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_77:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:55.878143+0000", 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1792771330000003, 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029161538000000001, 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3853 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.151 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.878143+0000", 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.878143+0000", 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.878145+0000", 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.9850000000000001e-06 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.152 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.880109+0000", 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019635830000000001 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.880135+0000", 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6233000000000001e-05 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.880148+0000", 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3373000000000001e-05 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.153 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.880216+0000", 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7162000000000005e-05 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.880374+0000", 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000158548 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.880486+0000", 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00011158399999999999 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.154 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.886612+0000", 2024-04-24T13:34:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0061260100000000003 2024-04-24T13:34:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.907175+0000", 2024-04-24T13:34:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020563287 2024-04-24T13:34:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.907249+0000", 2024-04-24T13:34:01.155 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.4010999999999993e-05 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.907305+0000", 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5761999999999999e-05 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3858 3.2e 3:77365e53:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_82:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:55.929644+0000", 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 5.1277759830000003, 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022584149000000001, 2024-04-24T13:34:01.156 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3858 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.929644+0000", 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.157 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.929644+0000", 2024-04-24T13:34:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.929647+0000", 2024-04-24T13:34:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5299999999999999e-06 2024-04-24T13:34:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.931248+0000", 2024-04-24T13:34:01.158 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016014670000000001 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.931273+0000", 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4902999999999999e-05 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.931284+0000", 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0429e-05 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.159 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.931362+0000", 2024-04-24T13:34:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7968999999999998e-05 2024-04-24T13:34:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.931533+0000", 2024-04-24T13:34:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017143799999999999 2024-04-24T13:34:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:34:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.931705+0000", 2024-04-24T13:34:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017213800000000001 2024-04-24T13:34:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.160 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.938580+0000", 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0068748029999999996 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.952096+0000", 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013516248 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.952172+0000", 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.6169999999999997e-05 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.161 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:55.952229+0000", 2024-04-24T13:34:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.6054000000000002e-05 2024-04-24T13:34:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3892 3.f e130/124 3:f2d0842a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_116:head v 130'17, mlcod=130'14)", 2024-04-24T13:34:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:56.266169+0000", 2024-04-24T13:34:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.7912512950000004, 2024-04-24T13:34:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026324006, 2024-04-24T13:34:01.162 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.266169+0000", 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.266169+0000", 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.163 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.266171+0000", 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4610000000000001e-06 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.271163+0000", 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0049922009999999999 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.271199+0000", 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.6603999999999997e-05 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.164 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.271216+0000", 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6339999999999999e-05 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.271306+0000", 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0288e-05 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.271332+0000", 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6061999999999999e-05 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.165 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.292433+0000", 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021101101000000001 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.292493+0000", 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.9948999999999998e-05 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:4268 3.9 e132/20 3:914b6af1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_482:head v 132'26, mlcod=130'24)", 2024-04-24T13:34:01.166 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:34:00.839319+0000", 2024-04-24T13:34:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.21810167599999999, 2024-04-24T13:34:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026628387999999999, 2024-04-24T13:34:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.839319+0000", 2024-04-24T13:34:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.167 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.839319+0000", 2024-04-24T13:34:01.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.839319+0000", 2024-04-24T13:34:01.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4099999999999999e-07 2024-04-24T13:34:01.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.168 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.168 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.168 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.845906+0000", 2024-04-24T13:34:01.168 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065870010000000003 2024-04-24T13:34:01.168 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.845930+0000", 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3714999999999999e-05 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.845941+0000", 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0710000000000001e-05 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.846016+0000", 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5123999999999994e-05 2024-04-24T13:34:01.169 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.846042+0000", 2024-04-24T13:34:01.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6475999999999999e-05 2024-04-24T13:34:01.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.865880+0000", 2024-04-24T13:34:01.170 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.019837761999999998 2024-04-24T13:34:01.170 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.170 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.170 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.170 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.865947+0000", 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7158999999999999e-05 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:4276 3.21 3:8733b3c4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_490:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:34:00.913871+0000", 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.14354888299999999, 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029095927000000001, 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.171 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 4276 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.913871+0000", 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.913871+0000", 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.172 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.913874+0000", 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.835e-06 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.917557+0000", 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0036831839999999999 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.917583+0000", 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5386000000000001e-05 2024-04-24T13:34:01.173 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.917595+0000", 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.2235000000000001e-05 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.917684+0000", 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.8605999999999998e-05 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.917877+0000", 2024-04-24T13:34:01.174 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019367599999999999 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.918065+0000", 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018778600000000001 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.925441+0000", 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0073754679999999996 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.175 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.942882+0000", 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017441130999999999 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.942927+0000", 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.5028999999999999e-05 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.942967+0000", 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.0590999999999998e-05 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.176 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.177 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:01.178 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_ops_in_flight 2024-04-24T13:34:01.179 INFO:tasks.workunit.client.0.smithi071.stdout:quota disabled for the bucket: buck_2024_03_24_13_33_50 2024-04-24T13:34:01.179 INFO:tasks.workunit.client.0.smithi071.stdout:adding file to bucket: 2Gb. 2024-04-24T13:34:01.179 INFO:tasks.workunit.client.0.smithi071.stdout:upload file successful 2024-04-24T13:34:01.179 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:34:01.179 INFO:tasks.workunit.client.0.smithi071.stdout:Test case: PASSED - bucket quota size for a given user doesnt take effect when quota is disabled 2024-04-24T13:34:01.179 INFO:tasks.workunit.client.0.smithi071.stdout:~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ 2024-04-24T13:34:01.179 INFO:tasks.ceph.osd.1.smithi071.stderr:2024-04-24T13:34:01.174+0000 7f4501ef7640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 1 (PID: 25170) UID: 0 2024-04-24T13:34:01.279 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:34:01.278+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:34:01.344 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:01.344 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:34:01.344 INFO:teuthology.orchestra.run.smithi071.stdout: "num_ops": 0 2024-04-24T13:34:01.344 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:01.358 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_blocked_ops 2024-04-24T13:34:01.380 INFO:tasks.workunit.client.0.smithi071.stdout:user qa_user deleted 2024-04-24T13:34:01.380 INFO:tasks.workunit.client.0.smithi071.stdout:bucket delete succeeded 2024-04-24T13:34:01.380 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:34:01.376+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:34:01.384 INFO:tasks.workunit.client.0.smithi071.stdout:OK 2024-04-24T13:34:01.384 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-04-24T13:34:01.384 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-04-24T13:34:01.435 INFO:tasks.workunit:Stopping ['rgw/s3_bucket_quota.pl'] on client.0... 2024-04-24T13:34:01.435 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-04-24T13:34:01.484 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:01.484 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [], 2024-04-24T13:34:01.484 INFO:teuthology.orchestra.run.smithi071.stdout: "complaint_time": 30, 2024-04-24T13:34:01.484 INFO:teuthology.orchestra.run.smithi071.stdout: "num_blocked_ops": 0 2024-04-24T13:34:01.484 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:01.485 INFO:tasks.ceph.osd.2.smithi071.stderr:2024-04-24T13:34:01.482+0000 7f1158fca640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 2 (PID: 25167) UID: 0 2024-04-24T13:34:01.498 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.3.asok dump_historic_ops 2024-04-24T13:34:01.587 INFO:tasks.ceph.osd.0.smithi071.stderr:2024-04-24T13:34:01.586+0000 7fef34b1d640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 0 (PID: 25165) UID: 0 2024-04-24T13:34:01.664 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:01.664 INFO:teuthology.orchestra.run.smithi071.stdout: "size": 20, 2024-04-24T13:34:01.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 600, 2024-04-24T13:34:01.664 INFO:teuthology.orchestra.run.smithi071.stdout: "ops": [ 2024-04-24T13:34:01.664 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.664 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2208 3.29 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:34:01.664 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:34:01.664 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 93.336698451000004, 2024-04-24T13:34:01.664 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.030079873, 2024-04-24T13:34:01.664 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.664 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2208 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.665 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326090+0000", 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.326092+0000", 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3829999999999999e-06 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328409+0000", 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002316275 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.666 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328450+0000", 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.1105e-05 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328475+0000", 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5267000000000001e-05 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328604+0000", 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00012910100000000001 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.667 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.328860+0000", 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00025553400000000002 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.329088+0000", 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00022823400000000001 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.338453+0000", 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0093653490000000002 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.668 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356039+0000", 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.017585661999999998 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356110+0000", 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.0963000000000005e-05 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.356170+0000", 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0000000000000002e-05 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.669 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.670 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.670 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.670 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2217 3.7 3:e22c5455:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_12:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:34:01.670 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:34:01.670 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 93.191642596999998, 2024-04-24T13:34:01.670 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025813151999999999, 2024-04-24T13:34:01.670 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.670 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.670 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.670 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.670 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2217 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471146+0000", 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.671 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.471148+0000", 2024-04-24T13:34:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5830000000000001e-06 2024-04-24T13:34:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473129+0000", 2024-04-24T13:34:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019805980000000001 2024-04-24T13:34:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.672 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473161+0000", 2024-04-24T13:34:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1798999999999998e-05 2024-04-24T13:34:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473189+0000", 2024-04-24T13:34:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8405999999999999e-05 2024-04-24T13:34:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473275+0000", 2024-04-24T13:34:01.673 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6207999999999999e-05 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473446+0000", 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000170216 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.473613+0000", 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016721300000000001 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.674 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.482687+0000", 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0090737460000000006 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496825+0000", 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014138001000000001 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496898+0000", 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.3564000000000002e-05 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.675 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:32:28.496959+0000", 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0817999999999999e-05 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2662 3.33 3:ce195145:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_1:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.534225358, 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028670389000000001, 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.676 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2662 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128563+0000", 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.677 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.128567+0000", 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4640000000000002e-06 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130845+0000", 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002278389 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130869+0000", 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4394999999999999e-05 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.678 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130879+0000", 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0000000000000001e-05 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130957+0000", 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7968999999999998e-05 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op must wait for map", 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.130963+0000", 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2499999999999997e-06 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.679 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137507+0000", 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0065442900000000003 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137607+0000", 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010002599999999999 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.137727+0000", 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120142 2024-04-24T13:34:01.680 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.152307+0000", 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01458017 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157112+0000", 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0048051350000000003 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157181+0000", 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9051e-05 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.681 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.157233+0000", 2024-04-24T13:34:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2108000000000003e-05 2024-04-24T13:34:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2676 3.22 3:464d06dc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_15:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:34:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:34:01.682 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 56.391023449999999, 2024-04-24T13:34:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025889562000000001, 2024-04-24T13:34:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2676 2024-04-24T13:34:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.683 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271765+0000", 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.271767+0000", 2024-04-24T13:34:01.684 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8649999999999999e-06 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.273986+0000", 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0022195560000000001 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274011+0000", 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4953e-05 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274023+0000", 2024-04-24T13:34:01.685 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1856e-05 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274116+0000", 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.3168e-05 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274377+0000", 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00026071500000000001 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:01.686 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.274531+0000", 2024-04-24T13:34:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015427299999999999 2024-04-24T13:34:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297124+0000", 2024-04-24T13:34:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.022592476 2024-04-24T13:34:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297544+0000", 2024-04-24T13:34:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000420691 2024-04-24T13:34:01.687 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297605+0000", 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0888999999999999e-05 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.297655+0000", 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9119999999999997e-05 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.688 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2747 3.24 3:2754d069:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_76:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.764728306999999, 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024857536999999999, 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2747 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.689 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:34:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898060+0000", 2024-04-24T13:34:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.690 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.898063+0000", 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5289999999999998e-06 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899956+0000", 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0018932759999999999 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899984+0000", 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7801999999999999e-05 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.691 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.899997+0000", 2024-04-24T13:34:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3127e-05 2024-04-24T13:34:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900063+0000", 2024-04-24T13:34:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.6330999999999999e-05 2024-04-24T13:34:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900200+0000", 2024-04-24T13:34:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000137324 2024-04-24T13:34:01.692 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.900302+0000", 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00010168 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.908151+0000", 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0078489579999999996 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922784+0000", 2024-04-24T13:34:01.693 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014633116 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922860+0000", 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5708000000000001e-05 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.922918+0000", 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7686000000000003e-05 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.694 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2754 3.b 3:d1ba0ac8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.684258806999999, 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.032358206, 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2754 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.695 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978530+0000", 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.978532+0000", 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6079999999999998e-06 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.696 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979768+0000", 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0012357869999999999 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979791+0000", 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3224e-05 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979804+0000", 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.274e-05 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.697 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.979889+0000", 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5483999999999997e-05 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980063+0000", 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017384599999999999 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.980227+0000", 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163764 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.698 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:05.987774+0000", 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0075472029999999997 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010776+0000", 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023001886999999999 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010838+0000", 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.1527999999999998e-05 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.699 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.010888+0000", 2024-04-24T13:34:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0135e-05 2024-04-24T13:34:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2811 3.7 3:e2a95610:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_140:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:34:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:34:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.092619974999998, 2024-04-24T13:34:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.044582597000000002, 2024-04-24T13:34:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.700 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2811 2024-04-24T13:34:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:34:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.701 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570168+0000", 2024-04-24T13:34:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.570171+0000", 2024-04-24T13:34:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9100000000000001e-06 2024-04-24T13:34:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580122+0000", 2024-04-24T13:34:01.702 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0099505930000000006 2024-04-24T13:34:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580150+0000", 2024-04-24T13:34:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7827e-05 2024-04-24T13:34:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.703 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580164+0000", 2024-04-24T13:34:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4547e-05 2024-04-24T13:34:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580245+0000", 2024-04-24T13:34:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0810999999999996e-05 2024-04-24T13:34:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580355+0000", 2024-04-24T13:34:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000109656 2024-04-24T13:34:01.704 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580475+0000", 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120278 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.607433+0000", 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026957894 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614636+0000", 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072028359999999998 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.705 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614703+0000", 2024-04-24T13:34:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.7645999999999996e-05 2024-04-24T13:34:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.614751+0000", 2024-04-24T13:34:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7599000000000003e-05 2024-04-24T13:34:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.706 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:2812 3.1e 3:7bd62ca6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_141:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 55.082576095, 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.038041177000000002, 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 2812 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.707 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580212+0000", 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.580214+0000", 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.708e-06 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582574+0000", 2024-04-24T13:34:01.708 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023601799999999999 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582591+0000", 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6648999999999999e-05 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.582598+0000", 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.391e-06 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583731+0000", 2024-04-24T13:34:01.709 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0011332029999999999 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583843+0000", 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000111889 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.583936+0000", 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.2968999999999997e-05 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.599363+0000", 2024-04-24T13:34:01.710 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015427186000000001 2024-04-24T13:34:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618143+0000", 2024-04-24T13:34:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018779051000000001 2024-04-24T13:34:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618200+0000", 2024-04-24T13:34:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7151999999999998e-05 2024-04-24T13:34:01.711 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:06.618253+0000", 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3798999999999998e-05 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3117 3.27 3:e455931d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_32:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.792159865000002, 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.02353235, 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.712 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3117 2024-04-24T13:34:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:34:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.713 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870629+0000", 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.870631+0000", 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.075e-06 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872287+0000", 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0016561449999999999 2024-04-24T13:34:01.714 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872316+0000", 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.9543000000000002e-05 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872333+0000", 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.6806000000000001e-05 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872403+0000", 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9917000000000002e-05 2024-04-24T13:34:01.715 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872540+0000", 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013735200000000001 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.872686+0000", 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014519899999999999 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.878440+0000", 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0057539490000000004 2024-04-24T13:34:01.716 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894072+0000", 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015632801000000002 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894106+0000", 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3933999999999997e-05 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.894161+0000", 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.4629000000000002e-05 2024-04-24T13:34:01.717 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3127 3.15 3:a9239ffa:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_42:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.687432688999998, 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023707346000000001, 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.718 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3127 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975356+0000", 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.719 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.975357+0000", 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.418e-06 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976868+0000", 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0015108719999999999 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976894+0000", 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5885e-05 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.720 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976905+0000", 2024-04-24T13:34:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1076e-05 2024-04-24T13:34:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.976983+0000", 2024-04-24T13:34:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8532e-05 2024-04-24T13:34:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.721 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977149+0000", 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00016571500000000001 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.977313+0000", 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000163719 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.984588+0000", 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0072751600000000001 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.722 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998908+0000", 2024-04-24T13:34:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.014319705 2024-04-24T13:34:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.998988+0000", 2024-04-24T13:34:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.9839000000000006e-05 2024-04-24T13:34:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:28.999063+0000", 2024-04-24T13:34:01.723 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.5425000000000004e-05 2024-04-24T13:34:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3136 3.25 e112/20 3:a4e0a0f7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_51:head v 112'10, mlcod=102'8)", 2024-04-24T13:34:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:34:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 32.586373020000003, 2024-04-24T13:34:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.026701701000000001, 2024-04-24T13:34:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.724 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076415+0000", 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.076417+0000", 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.779e-06 2024-04-24T13:34:01.725 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077651+0000", 2024-04-24T13:34:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.001233428 2024-04-24T13:34:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077679+0000", 2024-04-24T13:34:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8535e-05 2024-04-24T13:34:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.726 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077694+0000", 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4943000000000001e-05 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077775+0000", 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.0927000000000006e-05 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.077801+0000", 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.5933999999999999e-05 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.727 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103085+0000", 2024-04-24T13:34:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025284238000000001 2024-04-24T13:34:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:29.103117+0000", 2024-04-24T13:34:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.1917e-05 2024-04-24T13:34:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.728 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3484 3.18 3:1a64f732:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_382:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.281208535000001, 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029616456999999999, 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3484 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:34:01.729 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381580+0000", 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.381583+0000", 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.6510000000000001e-06 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382670+0000", 2024-04-24T13:34:01.730 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0010878870000000001 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382689+0000", 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.8723999999999999e-05 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.382700+0000", 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0908e-05 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385156+0000", 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.002456176 2024-04-24T13:34:01.731 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385287+0000", 2024-04-24T13:34:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00013060400000000001 2024-04-24T13:34:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.385402+0000", 2024-04-24T13:34:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000115658 2024-04-24T13:34:01.732 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.406717+0000", 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.021314317999999999 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411063+0000", 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0043465719999999999 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411141+0000", 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.7193000000000004e-05 2024-04-24T13:34:01.733 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.411196+0000", 2024-04-24T13:34:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.5766000000000001e-05 2024-04-24T13:34:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3483 3.c e114/103 3:3033c1b6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_381:head v 114'16, mlcod=113'14)", 2024-04-24T13:34:01.734 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.279023324000001, 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028448153, 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.735 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383765+0000", 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.383766+0000", 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.0130000000000001e-06 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387173+0000", 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0034066330000000001 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.736 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387201+0000", 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.8705999999999999e-05 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387216+0000", 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5019e-05 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387369+0000", 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00015276299999999999 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.387397+0000", 2024-04-24T13:34:01.737 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.7559000000000002e-05 2024-04-24T13:34:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412160+0000", 2024-04-24T13:34:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024763314000000002 2024-04-24T13:34:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.412213+0000", 2024-04-24T13:34:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.3146000000000002e-05 2024-04-24T13:34:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.738 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3501 3.24 3:27356806:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_399:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:34:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:34:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 28.102135848, 2024-04-24T13:34:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.029132884000000001, 2024-04-24T13:34:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.739 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3501 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560653+0000", 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.740 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.560656+0000", 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.066e-06 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562392+0000", 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0017359980000000001 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562431+0000", 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.9325e-05 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.741 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562453+0000", 2024-04-24T13:34:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2476e-05 2024-04-24T13:34:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562541+0000", 2024-04-24T13:34:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.7678999999999999e-05 2024-04-24T13:34:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.742 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562688+0000", 2024-04-24T13:34:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00014673600000000001 2024-04-24T13:34:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.562785+0000", 2024-04-24T13:34:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.6903000000000004e-05 2024-04-24T13:34:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.743 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.571188+0000", 2024-04-24T13:34:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0084030449999999996 2024-04-24T13:34:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589689+0000", 2024-04-24T13:34:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018500876999999999 2024-04-24T13:34:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589735+0000", 2024-04-24T13:34:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.6487999999999999e-05 2024-04-24T13:34:01.744 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.589785+0000", 2024-04-24T13:34:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.0290999999999997e-05 2024-04-24T13:34:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3521 3.1e 3:7803006f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_419:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:34:01.745 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:34:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 27.895184002000001, 2024-04-24T13:34:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024446572999999999, 2024-04-24T13:34:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.746 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3521 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767604+0000", 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.747 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.767608+0000", 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3239999999999999e-06 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770197+0000", 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0025895129999999999 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770220+0000", 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.2605000000000001e-05 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.748 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770233+0000", 2024-04-24T13:34:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.3159999999999999e-05 2024-04-24T13:34:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770329+0000", 2024-04-24T13:34:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.5995999999999994e-05 2024-04-24T13:34:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770543+0000", 2024-04-24T13:34:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000214348 2024-04-24T13:34:01.749 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 6", 2024-04-24T13:34:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.770732+0000", 2024-04-24T13:34:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000188975 2024-04-24T13:34:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.779877+0000", 2024-04-24T13:34:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0091449860000000008 2024-04-24T13:34:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.750 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.791883+0000", 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.012005266000000001 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792002+0000", 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000119351 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:33.792051+0000", 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.9048999999999997e-05 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.751 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:3952 3.24 3:2600f628:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_176:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:56.897440+0000", 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.7653484370000001, 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.025961484, 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 3952 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.752 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.897440+0000", 2024-04-24T13:34:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.897440+0000", 2024-04-24T13:34:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.753 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.897443+0000", 2024-04-24T13:34:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.909e-06 2024-04-24T13:34:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.899835+0000", 2024-04-24T13:34:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0023916469999999998 2024-04-24T13:34:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.754 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.899859+0000", 2024-04-24T13:34:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4000999999999999e-05 2024-04-24T13:34:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.899872+0000", 2024-04-24T13:34:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.306e-05 2024-04-24T13:34:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.755 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.899958+0000", 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.6089999999999997e-05 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.900147+0000", 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00018913799999999999 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.900319+0000", 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000172461 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.756 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.907869+0000", 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.007549521 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.923279+0000", 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.015410708 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.923349+0000", 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.9301000000000006e-05 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.757 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:56.923401+0000", 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.2648000000000001e-05 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:3971 3.c e130/103 3:3025c353:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_195:head v 130'22, mlcod=130'20)", 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:33:57.115871+0000", 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 4.5469169579999997, 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023785131000000001, 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.758 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:57.115871+0000", 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:57.115871+0000", 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:57.115874+0000", 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.407e-06 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.759 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:57.121108+0000", 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.005234552 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:57.121133+0000", 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4705000000000001e-05 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:57.121145+0000", 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.1484000000000001e-05 2024-04-24T13:34:01.760 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:57.121223+0000", 2024-04-24T13:34:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 7.8425999999999998e-05 2024-04-24T13:34:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:57.121256+0000", 2024-04-24T13:34:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.2996000000000001e-05 2024-04-24T13:34:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.761 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:57.139598+0000", 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.018341884999999999 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:33:57.139657+0000", 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.8675999999999999e-05 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_repop(client.4385.0:4269 3.23 e132/20 3:c6e7c00e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_483:head v 132'31, mlcod=131'29)", 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:34:00.844406+0000", 2024-04-24T13:34:01.762 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.81838226599999997, 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.023602519999999998, 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.844406+0000", 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.844406+0000", 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.763 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.844408+0000", 2024-04-24T13:34:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.567e-06 2024-04-24T13:34:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.847210+0000", 2024-04-24T13:34:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0028021180000000001 2024-04-24T13:34:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.764 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.847235+0000", 2024-04-24T13:34:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4844000000000001e-05 2024-04-24T13:34:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.847249+0000", 2024-04-24T13:34:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.4253999999999999e-05 2024-04-24T13:34:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.765 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.847339+0000", 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 9.0014999999999998e-05 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.847364+0000", 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.4817e-05 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.867948+0000", 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.020584155999999999 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.766 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.868009+0000", 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 6.0748999999999997e-05 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:4272 3.7 3:e04d468a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_486:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:34:00.874190+0000", 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.78859877899999997, 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.024320136999999999, 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.767 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 4272 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.874190+0000", 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.874190+0000", 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.768 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.874192+0000", 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.3470000000000001e-06 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.876186+0000", 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0019942779999999999 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.876220+0000", 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.3840000000000001e-05 2024-04-24T13:34:01.769 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.876236+0000", 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 1.5608e-05 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.876321+0000", 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 8.5536000000000002e-05 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.876498+0000", 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00017722199999999999 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.770 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 7", 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.876655+0000", 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000156649 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.886734+0000", 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.010079289 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.898431+0000", 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.011696242000000001 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.771 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.898475+0000", 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4212999999999998e-05 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.898510+0000", 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4913000000000003e-05 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "description": "osd_op(client.4385.0:4278 3.2 3:436bb357:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_492:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-04-24T13:34:01.772 INFO:teuthology.orchestra.run.smithi071.stdout: "initiated_at": "2024-04-24T13:34:00.932668+0000", 2024-04-24T13:34:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "age": 0.73011993600000002, 2024-04-24T13:34:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.028400874999999999, 2024-04-24T13:34:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "continuous": false, 2024-04-24T13:34:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "type_data": { 2024-04-24T13:34:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "client_info": { 2024-04-24T13:34:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "client": "client.4385", 2024-04-24T13:34:01.773 INFO:teuthology.orchestra.run.smithi071.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "tid": 4278 2024-04-24T13:34:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "events": [ 2024-04-24T13:34:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "initiated", 2024-04-24T13:34:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.932668+0000", 2024-04-24T13:34:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.774 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "header_read", 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.932668+0000", 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "throttled", 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.932671+0000", 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 2.543e-06 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "all_read", 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.934857+0000", 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.0021856860000000001 2024-04-24T13:34:01.775 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "dispatched", 2024-04-24T13:34:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.934915+0000", 2024-04-24T13:34:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 5.7822000000000003e-05 2024-04-24T13:34:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "queued_for_pg", 2024-04-24T13:34:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.934959+0000", 2024-04-24T13:34:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.4549999999999999e-05 2024-04-24T13:34:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.776 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "reached_pg", 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.935079+0000", 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.000120191 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "started", 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.935281+0000", 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00020136199999999999 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "waiting for subops from 5", 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.935477+0000", 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.00019625400000000001 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "op_commit", 2024-04-24T13:34:01.777 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.949094+0000", 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.013616990000000001 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.960987+0000", 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 0.01189348 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "commit_sent", 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.961034+0000", 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 4.7117000000000003e-05 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: }, 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: { 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: "event": "done", 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: "time": "2024-04-24T13:34:00.961069+0000", 2024-04-24T13:34:01.778 INFO:teuthology.orchestra.run.smithi071.stdout: "duration": 3.4879999999999998e-05 2024-04-24T13:34:01.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.779 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.779 INFO:teuthology.orchestra.run.smithi071.stdout: } 2024-04-24T13:34:01.779 INFO:teuthology.orchestra.run.smithi071.stdout: ] 2024-04-24T13:34:01.779 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:01.780 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_ops_in_flight 2024-04-24T13:34:01.781 DEBUG:teuthology.parallel:result is None 2024-04-24T13:34:01.781 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T13:34:01.782 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:34:01.776+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:34:01.835 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T13:34:01.835 DEBUG:teuthology.orchestra.run.smithi071:> rmdir -- /home/ubuntu/cephtest/mnt.0 2024-04-24T13:34:01.881 INFO:tasks.ceph.osd.7.smithi138.stderr:2024-04-24T13:34:01.876+0000 7fe762226640 -1 received signal: Hangup from /usr/bin/python3 /usr/bin/daemon-helper kill ceph-osd -f --cluster ceph -i 7 (PID: 25245) UID: 0 2024-04-24T13:34:01.895 INFO:tasks.workunit:Deleted artificial mount point /home/ubuntu/cephtest/mnt.0/client.0 2024-04-24T13:34:01.895 DEBUG:teuthology.run_tasks:Unwinding manager thrashosds 2024-04-24T13:34:01.906 INFO:tasks.thrashosds:joining thrashosds 2024-04-24T13:34:01.913 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:34:01.913 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:34:01.913 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:34:01.913 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:34:01.927 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_blocked_ops 2024-04-24T13:34:02.094 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:34:02.094 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:34:02.094 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:34:02.094 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:34:02.094 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:34:02.108 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.4.asok dump_historic_ops 2024-04-24T13:34:02.234 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:34:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:34:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:34:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:34:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.234 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:2208 3.29 e85/20 3:96e80ffb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_3:head v 85'1, mlcod=0'0)", 2024-04-24T13:34:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:34:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 93.903041715000001, 2024-04-24T13:34:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026370000000000001, 2024-04-24T13:34:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:34:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.235 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328647+0000", 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.328650+0000", 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.413e-06 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335219+0000", 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006569788 2024-04-24T13:34:02.236 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335258+0000", 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9062e-05 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335277+0000", 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.836e-05 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335422+0000", 2024-04-24T13:34:02.237 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014537 2024-04-24T13:34:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.335481+0000", 2024-04-24T13:34:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.9259000000000003e-05 2024-04-24T13:34:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.354858+0000", 2024-04-24T13:34:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019376757000000001 2024-04-24T13:34:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.238 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.355017+0000", 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015899100000000001 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2672 3.1c 3:381a7ad7:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_11:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.000233778999998, 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028612909999999998, 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.239 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2672 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231455+0000", 2024-04-24T13:34:02.240 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.231458+0000", 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.977e-06 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236408+0000", 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049496929999999998 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.241 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236444+0000", 2024-04-24T13:34:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5713000000000002e-05 2024-04-24T13:34:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236461+0000", 2024-04-24T13:34:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.789e-05 2024-04-24T13:34:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236562+0000", 2024-04-24T13:34:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100352 2024-04-24T13:34:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.242 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.236842+0000", 2024-04-24T13:34:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027979399999999998 2024-04-24T13:34:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:34:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.237091+0000", 2024-04-24T13:34:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024988499999999998 2024-04-24T13:34:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.246295+0000", 2024-04-24T13:34:02.243 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0092031279999999997 2024-04-24T13:34:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.259775+0000", 2024-04-24T13:34:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013480634 2024-04-24T13:34:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.259922+0000", 2024-04-24T13:34:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146565 2024-04-24T13:34:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.244 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.260068+0000", 2024-04-24T13:34:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000146279 2024-04-24T13:34:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2706 3.1c 3:3923c0c8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_35:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:34:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:34:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.762606951999999, 2024-04-24T13:34:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027254180999999999, 2024-04-24T13:34:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.245 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2706 2024-04-24T13:34:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:34:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.246 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469082+0000", 2024-04-24T13:34:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.469086+0000", 2024-04-24T13:34:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6100000000000002e-06 2024-04-24T13:34:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.247 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473145+0000", 2024-04-24T13:34:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040598769999999999 2024-04-24T13:34:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473180+0000", 2024-04-24T13:34:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4345999999999999e-05 2024-04-24T13:34:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.248 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473197+0000", 2024-04-24T13:34:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.721e-05 2024-04-24T13:34:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473377+0000", 2024-04-24T13:34:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000179805 2024-04-24T13:34:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.473830+0000", 2024-04-24T13:34:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045276700000000002 2024-04-24T13:34:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.249 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:34:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.474315+0000", 2024-04-24T13:34:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000485842 2024-04-24T13:34:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.485841+0000", 2024-04-24T13:34:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011525822 2024-04-24T13:34:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496030+0000", 2024-04-24T13:34:02.250 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010188401 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496205+0000", 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000175632 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.496336+0000", 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013086900000000001 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.251 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2752 3.1c 3:3ae15365:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.277383952999998, 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027425952, 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2752 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.252 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954305+0000", 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.954308+0000", 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3100000000000001e-06 2024-04-24T13:34:02.253 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959305+0000", 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049969649999999999 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959349+0000", 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3590000000000001e-05 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959375+0000", 2024-04-24T13:34:02.254 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6268999999999999e-05 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959561+0000", 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018558600000000001 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.959821+0000", 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000260704 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.960063+0000", 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024149499999999999 2024-04-24T13:34:02.255 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.974409+0000", 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014345689999999999 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981424+0000", 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070159250000000001 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981651+0000", 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022641499999999999 2024-04-24T13:34:02.256 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.981731+0000", 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0003e-05 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3091 3.9 3:91019aa3:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_6:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.664452005999998, 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026195184999999999, 2024-04-24T13:34:02.257 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3091 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.258 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567237+0000", 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567241+0000", 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7570000000000002e-06 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575380+0000", 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081391740000000008 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.259 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575427+0000", 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6839999999999999e-05 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575451+0000", 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4329999999999999e-05 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.575651+0000", 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020028400000000001 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.260 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576089+0000", 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043775699999999999 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.576498+0000", 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040853999999999999 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.592857+0000", 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016359097 2024-04-24T13:34:02.261 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593257+0000", 2024-04-24T13:34:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000400553 2024-04-24T13:34:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593358+0000", 2024-04-24T13:34:02.262 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010064 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.593432+0000", 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4213000000000002e-05 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3121 3.e 3:70900501:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_36:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.321048566999998, 2024-04-24T13:34:02.263 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026429009, 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3121 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.264 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910640+0000", 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.910644+0000", 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2270000000000002e-06 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914662+0000", 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040188539999999997 2024-04-24T13:34:02.265 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914705+0000", 2024-04-24T13:34:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2562999999999999e-05 2024-04-24T13:34:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914726+0000", 2024-04-24T13:34:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0996e-05 2024-04-24T13:34:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.266 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.914911+0000", 2024-04-24T13:34:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018524500000000001 2024-04-24T13:34:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.915177+0000", 2024-04-24T13:34:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026601100000000003 2024-04-24T13:34:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:34:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.915402+0000", 2024-04-24T13:34:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000224928 2024-04-24T13:34:02.267 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.925683+0000", 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010280821000000001 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.936831+0000", 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011148362 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.936987+0000", 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000155749 2024-04-24T13:34:02.268 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.937069+0000", 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2253e-05 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3123 3.13 3:ca3e100b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_38:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.301786780999997, 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029312213, 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.269 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3123 2024-04-24T13:34:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:34:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.270 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929902+0000", 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.929905+0000", 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6970000000000002e-06 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933842+0000", 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039367320000000001 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.271 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933877+0000", 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.561e-05 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.933894+0000", 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7212999999999999e-05 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934030+0000", 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013565199999999999 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.272 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934295+0000", 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000265235 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.934540+0000", 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024482399999999999 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.957909+0000", 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023368684000000001 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.273 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959004+0000", 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0010949709999999999 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959124+0000", 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012061900000000001 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.959214+0000", 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9975999999999994e-05 2024-04-24T13:34:02.274 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3433 3.34 3:2ce81ea4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_331:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:34:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:34:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.361376753999998, 2024-04-24T13:34:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026583214000000001, 2024-04-24T13:34:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.275 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3433 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870312+0000", 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.276 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.870316+0000", 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.16e-06 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876622+0000", 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063053919999999999 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876650+0000", 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8007000000000001e-05 2024-04-24T13:34:02.277 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876669+0000", 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8972999999999999e-05 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.876789+0000", 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119849 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.877065+0000", 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000276407 2024-04-24T13:34:02.278 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.877304+0000", 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023901799999999999 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.890409+0000", 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013105047 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896721+0000", 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0063118360000000004 2024-04-24T13:34:02.279 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896819+0000", 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7728999999999999e-05 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.896895+0000", 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6796000000000001e-05 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.280 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3463 3.39 e113/41 3:9e84137f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_361:head v 113'19, mlcod=113'17)", 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.058879941000001, 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025926719000000001, 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.281 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172809+0000", 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172811+0000", 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1160000000000002e-06 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177659+0000", 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048481549999999998 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.282 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177694+0000", 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4473e-05 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177717+0000", 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3750000000000001e-05 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177886+0000", 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000168405 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.283 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.177925+0000", 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9555999999999999e-05 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.198662+0000", 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020736167999999999 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.198736+0000", 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4096000000000003e-05 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.284 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3469 3.3 3:c2771714:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_367:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.999644396000001, 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028440263, 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3469 2024-04-24T13:34:02.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232045+0000", 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.232047+0000", 2024-04-24T13:34:02.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4669999999999998e-06 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.237943+0000", 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058964320000000001 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.237979+0000", 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5907e-05 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238000+0000", 2024-04-24T13:34:02.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0536000000000001e-05 2024-04-24T13:34:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238104+0000", 2024-04-24T13:34:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010404300000000001 2024-04-24T13:34:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238355+0000", 2024-04-24T13:34:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000250881 2024-04-24T13:34:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.238590+0000", 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000235388 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.248777+0000", 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010187244 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260299+0000", 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011521933 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260403+0000", 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010400600000000001 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.260485+0000", 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1426000000000003e-05 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3501 3.24 e114/20 3:27356806:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_399:head v 114'14, mlcod=113'12)", 2024-04-24T13:34:02.290 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.668440768, 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026449908000000001, 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563248+0000", 2024-04-24T13:34:02.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.563249+0000", 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9299999999999998e-07 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568259+0000", 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0050107759999999998 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568292+0000", 2024-04-24T13:34:02.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2892999999999998e-05 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568310+0000", 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7819e-05 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568429+0000", 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011896999999999999 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.568469+0000", 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9739e-05 2024-04-24T13:34:02.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.589582+0000", 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021113072 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.589698+0000", 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000116146 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3585 3.11 3:88ded408:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_482:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.831366699, 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034777737000000003, 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3585 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400322+0000", 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.400326+0000", 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9330000000000003e-06 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404462+0000", 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041354130000000001 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404537+0000", 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.5282000000000002e-05 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404565+0000", 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7797000000000002e-05 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.404716+0000", 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015126500000000001 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.405051+0000", 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033540099999999998 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.405296+0000", 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024506099999999998 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.298 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.429261+0000", 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023964485000000001 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.434796+0000", 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055355559999999996 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.434949+0000", 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015286499999999999 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.435100+0000", 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000150679 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3586 3.11 3:89fac597:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_483:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 27.820080518000001, 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028873106999999999, 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.300 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3586 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411608+0000", 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.411611+0000", 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7930000000000002e-06 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415739+0000", 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00412751 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415776+0000", 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7082999999999997e-05 2024-04-24T13:34:02.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.415795+0000", 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9539999999999999e-05 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418234+0000", 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0024391310000000002 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418476+0000", 2024-04-24T13:34:02.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000242026 2024-04-24T13:34:02.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:34:02.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.418697+0000", 2024-04-24T13:34:02.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000220564 2024-04-24T13:34:02.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.304 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.432206+0000", 2024-04-24T13:34:02.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013508922 2024-04-24T13:34:02.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.304 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440330+0000", 2024-04-24T13:34:02.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0081238649999999992 2024-04-24T13:34:02.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440414+0000", 2024-04-24T13:34:02.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4270999999999993e-05 2024-04-24T13:34:02.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.440481+0000", 2024-04-24T13:34:02.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.7402000000000003e-05 2024-04-24T13:34:02.305 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3859 3.34 3:2daed54a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_83:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:55.939896+0000", 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.2917927750000002, 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032849999999999997, 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.306 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3859 2024-04-24T13:34:02.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.307 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.939896+0000", 2024-04-24T13:34:02.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.939896+0000", 2024-04-24T13:34:02.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.939900+0000", 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3170000000000003e-06 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.947660+0000", 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0077590539999999996 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.947706+0000", 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6712999999999998e-05 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.947726+0000", 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9700000000000001e-05 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.947884+0000", 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000158474 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.948144+0000", 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025912 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.948379+0000", 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000235679 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.970143+0000", 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021763480000000002 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.972541+0000", 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023987169999999999 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.310 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.972644+0000", 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000102907 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.972746+0000", 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101839 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4032 3.34 3:2e370911:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_256:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131)", 2024-04-24T13:34:02.311 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:57.913263+0000", 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 4.3184262960000002, 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028415363999999999, 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4032 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.913263+0000", 2024-04-24T13:34:02.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.913263+0000", 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.913265+0000", 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7829999999999999e-06 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.918187+0000", 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049212500000000003 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.918231+0000", 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4286000000000003e-05 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.918250+0000", 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9485999999999999e-05 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.918366+0000", 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000115639 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.918496+0000", 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013004800000000001 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.918604+0000", 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108089 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.940617+0000", 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022012324999999999 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.941528+0000", 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00091108699999999999 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.941608+0000", 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0201e-05 2024-04-24T13:34:02.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.941678+0000", 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0170000000000001e-05 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4250 3.1a 3:5a22ba2e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_464:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131)", 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:34:00.636968+0000", 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.594720581, 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028547576000000002, 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.317 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4250 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.636968+0000", 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.636968+0000", 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.636972+0000", 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5599999999999998e-06 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.643416+0000", 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0064437640000000003 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.643455+0000", 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9539999999999998e-05 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.643476+0000", 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0591999999999999e-05 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.643660+0000", 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018457099999999999 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.644089+0000", 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042836099999999999 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.644521+0000", 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043236000000000001 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.655154+0000", 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010633362 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.665315+0000", 2024-04-24T13:34:02.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010160382000000001 2024-04-24T13:34:02.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.665421+0000", 2024-04-24T13:34:02.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106229 2024-04-24T13:34:02.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.665516+0000", 2024-04-24T13:34:02.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4854999999999999e-05 2024-04-24T13:34:02.322 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.323 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.323 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.323 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4268 3.9 3:914b6af1:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_482:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-04-24T13:34:02.323 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:34:00.833149+0000", 2024-04-24T13:34:02.323 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.3985399680000001, 2024-04-24T13:34:02.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034012709000000002, 2024-04-24T13:34:02.323 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.323 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.323 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.323 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.323 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4268 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.833149+0000", 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.833149+0000", 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.833152+0000", 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6299999999999998e-06 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.838607+0000", 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0054552760000000002 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.838643+0000", 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6585999999999998e-05 2024-04-24T13:34:02.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.838660+0000", 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6886999999999999e-05 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.838799+0000", 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013866799999999999 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.839094+0000", 2024-04-24T13:34:02.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029523599999999999 2024-04-24T13:34:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:34:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.839342+0000", 2024-04-24T13:34:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024732600000000002 2024-04-24T13:34:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.849885+0000", 2024-04-24T13:34:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010543782999999999 2024-04-24T13:34:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.866826+0000", 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016940207999999998 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.867005+0000", 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017992400000000001 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.867162+0000", 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015618500000000001 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.328 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4271 3.34 3:2f212713:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_485:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:34:00.865112+0000", 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.366576824, 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026083582000000001, 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.329 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4271 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.865112+0000", 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.865112+0000", 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.865132+0000", 2024-04-24T13:34:02.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9760000000000001e-05 2024-04-24T13:34:02.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.869975+0000", 2024-04-24T13:34:02.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004843445 2024-04-24T13:34:02.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.870011+0000", 2024-04-24T13:34:02.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5441999999999997e-05 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.870027+0000", 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6623e-05 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.870192+0000", 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016507800000000001 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.870476+0000", 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028400000000000002 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 6", 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.870723+0000", 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024697199999999998 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.880624+0000", 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099009930000000003 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.890914+0000", 2024-04-24T13:34:02.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010289303 2024-04-24T13:34:02.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.891042+0000", 2024-04-24T13:34:02.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012794400000000001 2024-04-24T13:34:02.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.891196+0000", 2024-04-24T13:34:02.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000154022 2024-04-24T13:34:02.334 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4274 3.1a 3:5952556c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_488:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:34:00.893099+0000", 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.3385899430000001, 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029077682000000001, 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.335 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4274 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.893099+0000", 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.893099+0000", 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.893103+0000", 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.053e-06 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.900026+0000", 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0069233480000000002 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.900066+0000", 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0092999999999997e-05 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.900086+0000", 2024-04-24T13:34:02.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9922999999999999e-05 2024-04-24T13:34:02.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.900250+0000", 2024-04-24T13:34:02.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016369099999999999 2024-04-24T13:34:02.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.900616+0000", 2024-04-24T13:34:02.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036588799999999998 2024-04-24T13:34:02.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:34:02.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.900977+0000", 2024-04-24T13:34:02.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036088800000000002 2024-04-24T13:34:02.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.912922+0000", 2024-04-24T13:34:02.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011944843 2024-04-24T13:34:02.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.921868+0000", 2024-04-24T13:34:02.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0089460059999999994 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.922046+0000", 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000177851 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.922177+0000", 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013109800000000001 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.341 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4281 3.3 3:c101151f:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_495:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-04-24T13:34:02.341 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:34:00.964705+0000", 2024-04-24T13:34:02.341 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.2669836480000001, 2024-04-24T13:34:02.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028494776999999999, 2024-04-24T13:34:02.341 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.341 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.341 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.341 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.341 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.341 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.341 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4281 2024-04-24T13:34:02.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.342 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.964705+0000", 2024-04-24T13:34:02.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.964705+0000", 2024-04-24T13:34:02.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.964708+0000", 2024-04-24T13:34:02.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7099999999999999e-06 2024-04-24T13:34:02.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.968690+0000", 2024-04-24T13:34:02.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039820400000000001 2024-04-24T13:34:02.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.968731+0000", 2024-04-24T13:34:02.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0615999999999999e-05 2024-04-24T13:34:02.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.968750+0000", 2024-04-24T13:34:02.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8992999999999999e-05 2024-04-24T13:34:02.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.968949+0000", 2024-04-24T13:34:02.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019937399999999999 2024-04-24T13:34:02.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.969405+0000", 2024-04-24T13:34:02.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045583700000000001 2024-04-24T13:34:02.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:34:02.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.969850+0000", 2024-04-24T13:34:02.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044516999999999999 2024-04-24T13:34:02.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.985552+0000", 2024-04-24T13:34:02.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015701603000000001 2024-04-24T13:34:02.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.993022+0000", 2024-04-24T13:34:02.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0074700529999999999 2024-04-24T13:34:02.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.993122+0000", 2024-04-24T13:34:02.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000100499 2024-04-24T13:34:02.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.346 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.346 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.993200+0000", 2024-04-24T13:34:02.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.7881999999999997e-05 2024-04-24T13:34:02.347 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.347 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.347 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.347 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.347 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.347 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:34:02.348 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_ops_in_flight 2024-04-24T13:34:02.475 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:34:02.475 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:34:02.475 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:34:02.475 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:34:02.490 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_blocked_ops 2024-04-24T13:34:02.614 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:34:02.614 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:34:02.614 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:34:02.614 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:34:02.614 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:34:02.628 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.5.asok dump_historic_ops 2024-04-24T13:34:02.678 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset noscrub 2024-04-24T13:34:02.754 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:34:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:34:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:34:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:34:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2251 3.3a 3:5f9a160e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.9__shadow_.Y1LWGzxY88enpVK_No9nXI3-xJcF7HX_46:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e85)", 2024-04-24T13:34:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:34:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 93.917215189000004, 2024-04-24T13:34:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030524880000000001, 2024-04-24T13:34:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.755 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2251 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834878+0000", 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.756 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.834880+0000", 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6769999999999999e-06 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839556+0000", 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046751350000000004 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839593+0000", 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7079999999999997e-05 2024-04-24T13:34:02.757 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839617+0000", 2024-04-24T13:34:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4015999999999998e-05 2024-04-24T13:34:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.839773+0000", 2024-04-24T13:34:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015627699999999999 2024-04-24T13:34:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.758 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840011+0000", 2024-04-24T13:34:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023843900000000001 2024-04-24T13:34:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.840261+0000", 2024-04-24T13:34:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024939899999999997 2024-04-24T13:34:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.853562+0000", 2024-04-24T13:34:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013301726999999999 2024-04-24T13:34:02.759 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865276+0000", 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011713779000000001 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865349+0000", 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2624000000000001e-05 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:32:28.865403+0000", 2024-04-24T13:34:02.760 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3727000000000002e-05 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2665 3.1d 3:b85990f0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_4:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.162820+0000", 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.589273048999999, 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031707361000000003, 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.761 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2665 2024-04-24T13:34:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.162820+0000", 2024-04-24T13:34:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.162820+0000", 2024-04-24T13:34:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.762 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.162824+0000", 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.997e-06 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171282+0000", 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084578310000000007 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171325+0000", 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3183000000000003e-05 2024-04-24T13:34:02.763 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171346+0000", 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0976999999999999e-05 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171546+0000", 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020003100000000001 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.171818+0000", 2024-04-24T13:34:02.764 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027171500000000001 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.172172+0000", 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00035402699999999998 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.188938+0000", 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016766519000000001 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.194193+0000", 2024-04-24T13:34:02.765 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0052545140000000001 2024-04-24T13:34:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.194379+0000", 2024-04-24T13:34:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000186212 2024-04-24T13:34:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.194527+0000", 2024-04-24T13:34:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148355 2024-04-24T13:34:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.766 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2726 3.3c 3:3c53550d:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_55:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.682300+0000", 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.069792559, 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032107164000000001, 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.767 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2726 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.682300+0000", 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.682300+0000", 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.768 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.682304+0000", 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6270000000000002e-06 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.687934+0000", 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056300899999999999 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.687976+0000", 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1542999999999998e-05 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.769 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.687995+0000", 2024-04-24T13:34:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9326000000000001e-05 2024-04-24T13:34:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.688149+0000", 2024-04-24T13:34:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015422299999999999 2024-04-24T13:34:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:34:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.688160+0000", 2024-04-24T13:34:02.770 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0723000000000001e-05 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.691501+0000", 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0033414619999999999 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.691704+0000", 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020224899999999999 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:34:02.771 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.691913+0000", 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020945800000000001 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.711338+0000", 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019425141999999999 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.714104+0000", 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027660340000000001 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.772 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.714273+0000", 2024-04-24T13:34:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016885500000000001 2024-04-24T13:34:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.714407+0000", 2024-04-24T13:34:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000134432 2024-04-24T13:34:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3088 3.2f 3:f713650a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_3:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:34:02.773 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.537981+0000", 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 34.214111944999999, 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029051113999999999, 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3088 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.537981+0000", 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.774 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.537981+0000", 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.537983+0000", 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3499999999999999e-06 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546609+0000", 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0086254480000000008 2024-04-24T13:34:02.775 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546652+0000", 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3346000000000001e-05 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546671+0000", 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8899999999999999e-05 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.546852+0000", 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000181318 2024-04-24T13:34:02.776 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.547138+0000", 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028545099999999999 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.547379+0000", 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024102800000000001 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.565501+0000", 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018122406000000001 2024-04-24T13:34:02.777 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.566815+0000", 2024-04-24T13:34:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001313579 2024-04-24T13:34:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.566911+0000", 2024-04-24T13:34:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6056000000000003e-05 2024-04-24T13:34:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.778 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.567032+0000", 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012123199999999999 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3090 3.36 e112/103 3:6dcd93d9:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_5:head v 112'10, mlcod=102'8)", 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.571193+0000", 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 34.180899590000003, 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029191265000000001, 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.779 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.571193+0000", 2024-04-24T13:34:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.571193+0000", 2024-04-24T13:34:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.780 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.571196+0000", 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3860000000000001e-06 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574406+0000", 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0032107809999999998 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574468+0000", 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.1636000000000004e-05 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.781 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574496+0000", 2024-04-24T13:34:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.813e-05 2024-04-24T13:34:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574664+0000", 2024-04-24T13:34:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000168185 2024-04-24T13:34:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.574703+0000", 2024-04-24T13:34:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8318999999999997e-05 2024-04-24T13:34:02.782 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.600283+0000", 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025580226000000001 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.600385+0000", 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010160199999999999 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.783 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3107 3.16 3:6bf97696:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_22:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.764376+0000", 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 33.987716511000002, 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034648104999999998, 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3107 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.784 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.764376+0000", 2024-04-24T13:34:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.764376+0000", 2024-04-24T13:34:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.785 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.764380+0000", 2024-04-24T13:34:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1030000000000004e-06 2024-04-24T13:34:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771397+0000", 2024-04-24T13:34:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00701682 2024-04-24T13:34:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771445+0000", 2024-04-24T13:34:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7273e-05 2024-04-24T13:34:02.786 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771465+0000", 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0506999999999999e-05 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.771641+0000", 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000175661 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.772047+0000", 2024-04-24T13:34:02.787 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040609000000000001 2024-04-24T13:34:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 1", 2024-04-24T13:34:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.772460+0000", 2024-04-24T13:34:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041274699999999998 2024-04-24T13:34:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.793165+0000", 2024-04-24T13:34:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020705128 2024-04-24T13:34:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.788 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.798765+0000", 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055998250000000001 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.798903+0000", 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013819200000000001 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.799024+0000", 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121759 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.789 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3380 3.3a 3:5cb232f4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_285:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:34:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.346253+0000", 2024-04-24T13:34:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.405839830000001, 2024-04-24T13:34:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032318024000000001, 2024-04-24T13:34:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.790 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3380 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.346253+0000", 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.346253+0000", 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.791 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.346257+0000", 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1699999999999999e-06 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350569+0000", 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043118740000000003 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350632+0000", 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.2663000000000006e-05 2024-04-24T13:34:02.792 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350665+0000", 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2895999999999998e-05 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.350861+0000", 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019607199999999999 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.351303+0000", 2024-04-24T13:34:02.793 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044276299999999999 2024-04-24T13:34:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.351690+0000", 2024-04-24T13:34:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038655699999999999 2024-04-24T13:34:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.362989+0000", 2024-04-24T13:34:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011298475000000001 2024-04-24T13:34:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.794 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.378400+0000", 2024-04-24T13:34:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015411747999999999 2024-04-24T13:34:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.378496+0000", 2024-04-24T13:34:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.6152999999999999e-05 2024-04-24T13:34:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.378571+0000", 2024-04-24T13:34:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4653000000000005e-05 2024-04-24T13:34:02.795 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3420 3.c 3:30a790eb:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_318:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.718876+0000", 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.033217277999999, 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028978935000000001, 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.796 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3420 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.718876+0000", 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.718876+0000", 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.797 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.718895+0000", 2024-04-24T13:34:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9517e-05 2024-04-24T13:34:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728273+0000", 2024-04-24T13:34:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093782440000000009 2024-04-24T13:34:02.798 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728295+0000", 2024-04-24T13:34:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1742999999999998e-05 2024-04-24T13:34:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728312+0000", 2024-04-24T13:34:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6413999999999999e-05 2024-04-24T13:34:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.799 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728441+0000", 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129419 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.728811+0000", 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037002299999999998 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.729054+0000", 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024291100000000001 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.800 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.739199+0000", 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010145101 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.747523+0000", 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0083244700000000005 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.747721+0000", 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019801399999999999 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.801 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.747855+0000", 2024-04-24T13:34:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000133079 2024-04-24T13:34:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3483 3.c 3:3033c1b6:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_381:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:34:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.370370+0000", 2024-04-24T13:34:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.381723162, 2024-04-24T13:34:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.043221212000000002, 2024-04-24T13:34:02.802 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3483 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.370370+0000", 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.803 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.370370+0000", 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.370419+0000", 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.9283000000000002e-05 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.374810+0000", 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043905979999999999 2024-04-24T13:34:02.804 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.374848+0000", 2024-04-24T13:34:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8041999999999999e-05 2024-04-24T13:34:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.374871+0000", 2024-04-24T13:34:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3793000000000001e-05 2024-04-24T13:34:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.805 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.379359+0000", 2024-04-24T13:34:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044878909999999999 2024-04-24T13:34:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.379749+0000", 2024-04-24T13:34:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038957 2024-04-24T13:34:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:34:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.380113+0000", 2024-04-24T13:34:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000363834 2024-04-24T13:34:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.806 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.392454+0000", 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012341097000000001 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.413294+0000", 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020840033000000001 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.413471+0000", 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000177579 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.807 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.413591+0000", 2024-04-24T13:34:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119492 2024-04-24T13:34:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3548 3.1d 3:bbc96e42:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_446:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:34:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.038024+0000", 2024-04-24T13:34:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.714068561000001, 2024-04-24T13:34:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028372396000000001, 2024-04-24T13:34:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.808 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3548 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.038024+0000", 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.809 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.038024+0000", 2024-04-24T13:34:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.038058+0000", 2024-04-24T13:34:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4042999999999999e-05 2024-04-24T13:34:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043019+0000", 2024-04-24T13:34:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049610390000000004 2024-04-24T13:34:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.810 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043092+0000", 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2166e-05 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043120+0000", 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8390000000000001e-05 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043309+0000", 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000189345 2024-04-24T13:34:02.811 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.043724+0000", 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041498700000000002 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.044164+0000", 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043983299999999999 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.057294+0000", 2024-04-24T13:34:02.812 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01313023 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.066184+0000", 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0088898120000000004 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.066284+0000", 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9984999999999999e-05 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.813 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.066397+0000", 2024-04-24T13:34:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011256600000000001 2024-04-24T13:34:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3874 3.1c 3:3b11da42:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.085616+0000", 2024-04-24T13:34:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.6664764239999998, 2024-04-24T13:34:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028220240000000001, 2024-04-24T13:34:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.814 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3874 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.085616+0000", 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.085616+0000", 2024-04-24T13:34:02.815 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.085621+0000", 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.7400000000000004e-06 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.090183+0000", 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0045617069999999999 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.816 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.090217+0000", 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4263e-05 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.090236+0000", 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8810000000000001e-05 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.090397+0000", 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016104699999999999 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.817 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.090751+0000", 2024-04-24T13:34:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000354259 2024-04-24T13:34:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.091135+0000", 2024-04-24T13:34:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00038387499999999999 2024-04-24T13:34:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.110988+0000", 2024-04-24T13:34:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019853061000000002 2024-04-24T13:34:02.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.113553+0000", 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025646250000000001 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.113714+0000", 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000161392 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.113837+0000", 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012246100000000001 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.819 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3907 3.22 3:46fb8056:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_131:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.407579+0000", 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.3445134410000001, 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034857285000000002, 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3907 2024-04-24T13:34:02.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.407579+0000", 2024-04-24T13:34:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.407579+0000", 2024-04-24T13:34:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.407583+0000", 2024-04-24T13:34:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.546e-06 2024-04-24T13:34:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.415996+0000", 2024-04-24T13:34:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084128529999999997 2024-04-24T13:34:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.416035+0000", 2024-04-24T13:34:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9422000000000003e-05 2024-04-24T13:34:02.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.416054+0000", 2024-04-24T13:34:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9020000000000001e-05 2024-04-24T13:34:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.416234+0000", 2024-04-24T13:34:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017937500000000001 2024-04-24T13:34:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.416646+0000", 2024-04-24T13:34:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041236700000000002 2024-04-24T13:34:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:34:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.417057+0000", 2024-04-24T13:34:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041098699999999997 2024-04-24T13:34:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.430716+0000", 2024-04-24T13:34:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013659190999999999 2024-04-24T13:34:02.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.442210+0000", 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011493348 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.442329+0000", 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119028 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.442437+0000", 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000108148 2024-04-24T13:34:02.825 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3912 3.c 3:32d3ce07:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_136:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.455463+0000", 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.2966300689999999, 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034289577000000002, 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.826 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3912 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.455463+0000", 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.455463+0000", 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.455494+0000", 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0911999999999998e-05 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.462171+0000", 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066776450000000003 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.462219+0000", 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8096000000000002e-05 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.462240+0000", 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0112999999999999e-05 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.462404+0000", 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016432 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.462840+0000", 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043655799999999998 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:34:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.463172+0000", 2024-04-24T13:34:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00033127500000000002 2024-04-24T13:34:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.475658+0000", 2024-04-24T13:34:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012486397 2024-04-24T13:34:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.489476+0000", 2024-04-24T13:34:02.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013817685 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.489630+0000", 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000153838 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.489752+0000", 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122738 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3933 3.c 3:32cafe03:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_157:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.681901+0000", 2024-04-24T13:34:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.0701923669999998, 2024-04-24T13:34:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028961298, 2024-04-24T13:34:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.832 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3933 2024-04-24T13:34:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.681901+0000", 2024-04-24T13:34:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.681901+0000", 2024-04-24T13:34:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.681904+0000", 2024-04-24T13:34:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.41e-06 2024-04-24T13:34:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.686760+0000", 2024-04-24T13:34:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0048558639999999997 2024-04-24T13:34:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.686802+0000", 2024-04-24T13:34:02.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2622e-05 2024-04-24T13:34:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.686822+0000", 2024-04-24T13:34:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9953e-05 2024-04-24T13:34:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.686961+0000", 2024-04-24T13:34:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000138498 2024-04-24T13:34:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.687262+0000", 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00030122200000000002 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.687501+0000", 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023848000000000001 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.699846+0000", 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012344963 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.710327+0000", 2024-04-24T13:34:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010481829 2024-04-24T13:34:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.710750+0000", 2024-04-24T13:34:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042271099999999999 2024-04-24T13:34:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.710862+0000", 2024-04-24T13:34:02.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111746 2024-04-24T13:34:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3958 3.16 3:6aedc82b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_182:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.956908+0000", 2024-04-24T13:34:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.7951847250000004, 2024-04-24T13:34:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042285376, 2024-04-24T13:34:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.838 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3958 2024-04-24T13:34:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.956908+0000", 2024-04-24T13:34:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.956908+0000", 2024-04-24T13:34:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.956910+0000", 2024-04-24T13:34:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1959999999999998e-06 2024-04-24T13:34:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.962795+0000", 2024-04-24T13:34:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0058843589999999996 2024-04-24T13:34:02.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.962832+0000", 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7406000000000001e-05 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.962849+0000", 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7169000000000001e-05 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.963016+0000", 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016647799999999999 2024-04-24T13:34:02.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.963315+0000", 2024-04-24T13:34:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000299516 2024-04-24T13:34:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 7", 2024-04-24T13:34:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.963561+0000", 2024-04-24T13:34:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024568000000000002 2024-04-24T13:34:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.993441+0000", 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029879658999999999 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.999055+0000", 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056145559999999997 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.999141+0000", 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5779999999999995e-05 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.999194+0000", 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2577000000000002e-05 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3971 3.c 3:3025c353:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_195:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:57.111089+0000", 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.6410037319999997, 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029562297000000001, 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3971 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.111089+0000", 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.111089+0000", 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.111093+0000", 2024-04-24T13:34:02.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6399999999999999e-06 2024-04-24T13:34:02.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.115186+0000", 2024-04-24T13:34:02.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004092788 2024-04-24T13:34:02.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.115219+0000", 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3887000000000003e-05 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.115245+0000", 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5062000000000002e-05 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.115363+0000", 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000118125 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.115595+0000", 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000232208 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.115802+0000", 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020743399999999999 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.125479+0000", 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096769739999999996 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.140451+0000", 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014971635 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.140575+0000", 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124072 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.140651+0000", 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6471999999999996e-05 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.850 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3977 3.30 3:0e7c1a92:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_201:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:02.850 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:57.184722+0000", 2024-04-24T13:34:02.850 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.5673711170000004, 2024-04-24T13:34:02.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.030392626999999998, 2024-04-24T13:34:02.850 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.850 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.850 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.850 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3977 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.184722+0000", 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.184722+0000", 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.184725+0000", 2024-04-24T13:34:02.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0920000000000002e-06 2024-04-24T13:34:02.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.188732+0000", 2024-04-24T13:34:02.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040074109999999998 2024-04-24T13:34:02.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.188769+0000", 2024-04-24T13:34:02.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7116000000000002e-05 2024-04-24T13:34:02.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.188786+0000", 2024-04-24T13:34:02.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6863000000000001e-05 2024-04-24T13:34:02.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.188881+0000", 2024-04-24T13:34:02.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4734999999999993e-05 2024-04-24T13:34:02.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.189059+0000", 2024-04-24T13:34:02.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017770199999999999 2024-04-24T13:34:02.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:02.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.189223+0000", 2024-04-24T13:34:02.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016456500000000001 2024-04-24T13:34:02.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.198455+0000", 2024-04-24T13:34:02.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0092320760000000005 2024-04-24T13:34:02.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.214788+0000", 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016332170999999999 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.214972+0000", 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000184184 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.215114+0000", 2024-04-24T13:34:02.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000142712 2024-04-24T13:34:02.856 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.856 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.856 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.856 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4001 3.5 3:a2733705:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_225:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:02.856 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:57.547802+0000", 2024-04-24T13:34:02.856 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.2042907070000002, 2024-04-24T13:34:02.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029378332, 2024-04-24T13:34:02.856 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.856 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.856 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4001 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.547802+0000", 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.547802+0000", 2024-04-24T13:34:02.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.547805+0000", 2024-04-24T13:34:02.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0000000000000001e-06 2024-04-24T13:34:02.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.551839+0000", 2024-04-24T13:34:02.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040333890000000001 2024-04-24T13:34:02.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.551864+0000", 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5507000000000002e-05 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.551877+0000", 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2893e-05 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.552073+0000", 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000195854 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.552342+0000", 2024-04-24T13:34:02.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026963200000000001 2024-04-24T13:34:02.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:34:02.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.552589+0000", 2024-04-24T13:34:02.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024700299999999998 2024-04-24T13:34:02.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.860 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.562283+0000", 2024-04-24T13:34:02.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0096937340000000007 2024-04-24T13:34:02.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.576912+0000", 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014628390999999999 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.577074+0000", 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000162867 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.577181+0000", 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000106062 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.861 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4006 3.3c 3:3cf6118c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_230:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131)", 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:57.606243+0000", 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 5.1458494320000003, 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027927771000000001, 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4006 2024-04-24T13:34:02.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.863 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.606243+0000", 2024-04-24T13:34:02.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.606243+0000", 2024-04-24T13:34:02.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.606246+0000", 2024-04-24T13:34:02.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9569999999999998e-06 2024-04-24T13:34:02.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.612428+0000", 2024-04-24T13:34:02.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.006181705 2024-04-24T13:34:02.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.612471+0000", 2024-04-24T13:34:02.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3328999999999998e-05 2024-04-24T13:34:02.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.612492+0000", 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0236000000000001e-05 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.612693+0000", 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000201724 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.613169+0000", 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00047542999999999999 2024-04-24T13:34:02.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:34:02.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.613434+0000", 2024-04-24T13:34:02.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026466599999999999 2024-04-24T13:34:02.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.623732+0000", 2024-04-24T13:34:02.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010298539000000001 2024-04-24T13:34:02.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.633995+0000", 2024-04-24T13:34:02.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010262521 2024-04-24T13:34:02.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.634098+0000", 2024-04-24T13:34:02.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103755 2024-04-24T13:34:02.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.634171+0000", 2024-04-24T13:34:02.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2909000000000003e-05 2024-04-24T13:34:02.867 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.867 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4277 3.5 3:a293491b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_491:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:34:00.924102+0000", 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 1.8279907259999999, 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028900724999999999, 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:02.868 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4277 2024-04-24T13:34:02.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.869 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:02.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:02.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.924102+0000", 2024-04-24T13:34:02.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:02.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.924102+0000", 2024-04-24T13:34:02.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:02.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.924118+0000", 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6140000000000001e-05 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.932563+0000", 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0084443230000000001 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.932604+0000", 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1329999999999999e-05 2024-04-24T13:34:02.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.932624+0000", 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9703000000000001e-05 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.932827+0000", 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020303699999999999 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.933269+0000", 2024-04-24T13:34:02.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044197300000000002 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 3", 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.933702+0000", 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043358699999999998 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.949573+0000", 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015870558 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.952805+0000", 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00323201 2024-04-24T13:34:02.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:02.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.952931+0000", 2024-04-24T13:34:02.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126549 2024-04-24T13:34:02.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:02.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:02.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:02.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.953003+0000", 2024-04-24T13:34:02.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.1514999999999995e-05 2024-04-24T13:34:02.873 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.873 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.873 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.873 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:02.874 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:02.874 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:34:02.875 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_ops_in_flight 2024-04-24T13:34:03.004 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:34:03.005 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:34:03.005 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:34:03.005 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:34:03.019 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_blocked_ops 2024-04-24T13:34:03.030 INFO:teuthology.orchestra.run.smithi071.stderr:noscrub is unset 2024-04-24T13:34:03.051 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd unset nodeep-scrub 2024-04-24T13:34:03.141 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:34:03.142 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:34:03.142 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:34:03.142 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:34:03.142 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:34:03.155 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.6.asok dump_historic_ops 2024-04-24T13:34:03.283 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:34:03.284 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:34:03.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:34:03.284 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:34:03.284 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.284 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:46 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e29)", 2024-04-24T13:34:03.284 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:34:03.284 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 214.03639018600001, 2024-04-24T13:34:03.284 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034354744, 2024-04-24T13:34:03.284 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.284 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.284 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.285 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.285 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 46 2024-04-24T13:34:03.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.285 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.285 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:34:03.285 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.285 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.285 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.285 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244304+0000", 2024-04-24T13:34:03.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244307+0000", 2024-04-24T13:34:03.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9359999999999999e-06 2024-04-24T13:34:03.286 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.286 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.286 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.286 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244337+0000", 2024-04-24T13:34:03.286 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9303e-05 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244380+0000", 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2960000000000002e-05 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244411+0000", 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1612999999999997e-05 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.287 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244579+0000", 2024-04-24T13:34:03.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016787200000000001 2024-04-24T13:34:03.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:34:03.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.244596+0000", 2024-04-24T13:34:03.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6529999999999999e-05 2024-04-24T13:34:03.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.288 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.288 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.288 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248591+0000", 2024-04-24T13:34:03.288 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0039951930000000002 2024-04-24T13:34:03.288 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.248612+0000", 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1259000000000001e-05 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265281+0000", 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016669278999999999 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265570+0000", 2024-04-24T13:34:03.289 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000288671 2024-04-24T13:34:03.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:03.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.265914+0000", 2024-04-24T13:34:03.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00034401700000000001 2024-04-24T13:34:03.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.290 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278263+0000", 2024-04-24T13:34:03.290 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012348679 2024-04-24T13:34:03.290 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.290 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.290 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278433+0000", 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017002799999999999 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278555+0000", 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012276999999999999 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:29.278659+0000", 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103634 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.291 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2675 3.20 3:04d57de4:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_14:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.261997+0000", 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 58.018697414000002, 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035525625999999998, 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2675 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.292 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.261997+0000", 2024-04-24T13:34:03.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.261997+0000", 2024-04-24T13:34:03.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.293 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.293 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.293 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.293 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.262008+0000", 2024-04-24T13:34:03.293 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0672999999999999e-05 2024-04-24T13:34:03.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.268658+0000", 2024-04-24T13:34:03.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0066501920000000001 2024-04-24T13:34:03.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.294 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.268692+0000", 2024-04-24T13:34:03.294 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4396000000000001e-05 2024-04-24T13:34:03.294 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.294 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.294 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.268712+0000", 2024-04-24T13:34:03.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9349999999999999e-05 2024-04-24T13:34:03.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.268838+0000", 2024-04-24T13:34:03.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000125933 2024-04-24T13:34:03.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.295 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.295 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.295 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.269101+0000", 2024-04-24T13:34:03.295 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026382400000000001 2024-04-24T13:34:03.295 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:03.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.269333+0000", 2024-04-24T13:34:03.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000231435 2024-04-24T13:34:03.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.278511+0000", 2024-04-24T13:34:03.296 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0091777049999999995 2024-04-24T13:34:03.296 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.296 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.296 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.296 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.297196+0000", 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.018685171 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.297396+0000", 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000200352 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.297523+0000", 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012659499999999999 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.297 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.298 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.298 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.298 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2682 3.26 3:6774ab3c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_21:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e100)", 2024-04-24T13:34:03.298 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:05.331756+0000", 2024-04-24T13:34:03.298 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.948938050000002, 2024-04-24T13:34:03.298 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028106160000000002, 2024-04-24T13:34:03.298 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.298 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.298 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.298 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.298 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.298 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2682 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.331756+0000", 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.331756+0000", 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.299 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.331759+0000", 2024-04-24T13:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5500000000000001e-06 2024-04-24T13:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.336907+0000", 2024-04-24T13:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051476539999999998 2024-04-24T13:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.336943+0000", 2024-04-24T13:34:03.300 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.676e-05 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.336965+0000", 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.1793e-05 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.337097+0000", 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000131576 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.301 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.337362+0000", 2024-04-24T13:34:03.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026527799999999998 2024-04-24T13:34:03.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:03.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.337590+0000", 2024-04-24T13:34:03.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022786400000000001 2024-04-24T13:34:03.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.302 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.302 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.356627+0000", 2024-04-24T13:34:03.302 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019037251000000002 2024-04-24T13:34:03.302 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.302 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.359701+0000", 2024-04-24T13:34:03.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0030738190000000002 2024-04-24T13:34:03.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.359792+0000", 2024-04-24T13:34:03.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.0883000000000004e-05 2024-04-24T13:34:03.303 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.303 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.303 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.303 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:05.359863+0000", 2024-04-24T13:34:03.303 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.0732e-05 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2769 3.26 3:6798754c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_98:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e101)", 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:06.124461+0000", 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 57.156233821999997, 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.039716904999999997, 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.304 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2769 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.124461+0000", 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.124461+0000", 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.305 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.124464+0000", 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3170000000000002e-06 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.129365+0000", 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0049009860000000004 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.129409+0000", 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4036000000000003e-05 2024-04-24T13:34:03.306 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.129429+0000", 2024-04-24T13:34:03.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9919999999999999e-05 2024-04-24T13:34:03.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.307 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.129604+0000", 2024-04-24T13:34:03.307 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000174752 2024-04-24T13:34:03.307 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.307 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.307 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.129871+0000", 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026712200000000001 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.130101+0000", 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000229884 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.144097+0000", 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013996562000000001 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.308 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.163754+0000", 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019656247000000002 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.163932+0000", 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017807500000000001 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.164178+0000", 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024600400000000003 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.309 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:2825 3.a 3:5302f1a2:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.10__shadow_.ntIErikZNyRYR8P-dsPdpNPLG7SzUbz_154:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e102)", 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:06.725313+0000", 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 56.555381128999997, 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.035421660000000001, 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.310 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 2825 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.725313+0000", 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.725313+0000", 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.311 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.725317+0000", 2024-04-24T13:34:03.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6990000000000001e-06 2024-04-24T13:34:03.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.730699+0000", 2024-04-24T13:34:03.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053821399999999997 2024-04-24T13:34:03.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.312 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.312 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.730737+0000", 2024-04-24T13:34:03.312 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8105999999999997e-05 2024-04-24T13:34:03.312 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.312 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.730755+0000", 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7883000000000001e-05 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.730891+0000", 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013549600000000001 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.730902+0000", 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1542999999999999e-05 2024-04-24T13:34:03.313 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.737658+0000", 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0067552810000000001 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.738019+0000", 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036111100000000001 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.738420+0000", 2024-04-24T13:34:03.314 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040145600000000001 2024-04-24T13:34:03.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.755237+0000", 2024-04-24T13:34:03.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016816795999999998 2024-04-24T13:34:03.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.315 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.760550+0000", 2024-04-24T13:34:03.315 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0053130770000000003 2024-04-24T13:34:03.315 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.315 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.315 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.760641+0000", 2024-04-24T13:34:03.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1266000000000003e-05 2024-04-24T13:34:03.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.316 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.316 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:06.760735+0000", 2024-04-24T13:34:03.316 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.3806000000000003e-05 2024-04-24T13:34:03.316 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.316 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.316 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.316 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.316 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.317 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3090 3.36 3:6dcd93d9:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_5:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:34:03.317 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:28.558253+0000", 2024-04-24T13:34:03.317 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 34.722441015000001, 2024-04-24T13:34:03.317 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.042737982000000001, 2024-04-24T13:34:03.317 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.317 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.317 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.317 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.317 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.317 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.317 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3090 2024-04-24T13:34:03.317 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.318 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.558253+0000", 2024-04-24T13:34:03.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.318 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.558253+0000", 2024-04-24T13:34:03.318 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.318 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.318 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.318 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.558257+0000", 2024-04-24T13:34:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9199999999999997e-06 2024-04-24T13:34:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.570021+0000", 2024-04-24T13:34:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011763493999999999 2024-04-24T13:34:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.570187+0000", 2024-04-24T13:34:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016621600000000001 2024-04-24T13:34:03.319 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.570260+0000", 2024-04-24T13:34:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.2922000000000004e-05 2024-04-24T13:34:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.570472+0000", 2024-04-24T13:34:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021147200000000001 2024-04-24T13:34:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.320 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.570732+0000", 2024-04-24T13:34:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026012499999999999 2024-04-24T13:34:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:34:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.570967+0000", 2024-04-24T13:34:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023569500000000001 2024-04-24T13:34:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.595136+0000", 2024-04-24T13:34:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024168603 2024-04-24T13:34:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.321 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.600760+0000", 2024-04-24T13:34:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0056243400000000002 2024-04-24T13:34:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.600874+0000", 2024-04-24T13:34:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000113699 2024-04-24T13:34:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.322 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:28.600991+0000", 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000117496 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3134 3.36 3:6e3a5aab:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_49:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e112)", 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:29.052310+0000", 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 34.228384785000003, 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027170143000000001, 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.323 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3134 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.052310+0000", 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.324 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.052310+0000", 2024-04-24T13:34:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.052313+0000", 2024-04-24T13:34:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5930000000000002e-06 2024-04-24T13:34:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.056809+0000", 2024-04-24T13:34:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044957870000000002 2024-04-24T13:34:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.325 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.056854+0000", 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4727000000000001e-05 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.056873+0000", 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9233e-05 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.057060+0000", 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018732500000000001 2024-04-24T13:34:03.326 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.057484+0000", 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042350299999999999 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.057918+0000", 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000433967 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.068872+0000", 2024-04-24T13:34:03.327 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010954234 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.079299+0000", 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010427015 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.079400+0000", 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010116900000000001 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.328 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:29.079480+0000", 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9590000000000002e-05 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3397 3.26 3:65d3918c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_295:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.461240+0000", 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.819454984, 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028818305999999998, 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.329 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3397 2024-04-24T13:34:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.461240+0000", 2024-04-24T13:34:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.330 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.461240+0000", 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.461243+0000", 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.5360000000000001e-06 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.465489+0000", 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042460429999999997 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.331 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.465526+0000", 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7069e-05 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.465544+0000", 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7937000000000001e-05 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.465716+0000", 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017152500000000001 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.332 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.466123+0000", 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040734300000000001 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.466570+0000", 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00044718399999999999 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.486670+0000", 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020099486 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.333 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.489764+0000", 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003094828 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.489930+0000", 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000165849 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.490058+0000", 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127506 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.334 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3443 3.a 3:53aaab58:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_341:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:32.970186+0000", 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.310508821999999, 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028660028000000001, 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3443 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.335 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.970186+0000", 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.970186+0000", 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.970190+0000", 2024-04-24T13:34:03.336 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6199999999999998e-06 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.974672+0000", 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0044820379999999998 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.974714+0000", 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2098999999999998e-05 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.974740+0000", 2024-04-24T13:34:03.337 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5372999999999999e-05 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.974878+0000", 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013777200000000001 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.975156+0000", 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027818500000000002 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:34:03.338 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.975533+0000", 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037726399999999998 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.985967+0000", 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010433628 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.998626+0000", 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012659827 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.339 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.998726+0000", 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9759000000000005e-05 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:32.998846+0000", 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000119463 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3460 3.a 3:5102140b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_358:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e113)", 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.140682+0000", 2024-04-24T13:34:03.340 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 30.140012593000002, 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031830232, 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3460 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.140682+0000", 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.341 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.140682+0000", 2024-04-24T13:34:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.140685+0000", 2024-04-24T13:34:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4230000000000001e-06 2024-04-24T13:34:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.342 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.145485+0000", 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047993879999999999 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.145528+0000", 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.3689999999999997e-05 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.145549+0000", 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0803000000000001e-05 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.343 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.145715+0000", 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000165515 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.145964+0000", 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024896500000000003 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.146190+0000", 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022663100000000001 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.344 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.155575+0000", 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093845909999999994 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172329+0000", 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016754313 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172430+0000", 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000101153 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.345 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.172512+0000", 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.1760000000000003e-05 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3490 3.a 3:53c4586b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_388:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.452101+0000", 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.828593209000001, 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026845449, 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.346 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3490 2024-04-24T13:34:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.452101+0000", 2024-04-24T13:34:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.347 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.452101+0000", 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.452104+0000", 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9330000000000001e-06 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.457639+0000", 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0055350249999999998 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.348 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.457681+0000", 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1433999999999997e-05 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.457701+0000", 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0553000000000001e-05 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.457853+0000", 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000151285 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.349 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.458125+0000", 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000272871 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.458365+0000", 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000239502 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.469343+0000", 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010977974 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.350 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.478665+0000", 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093223969999999996 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.478806+0000", 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014106200000000001 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.478947+0000", 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014041300000000001 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.351 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3491 3.14 e114/48 3:2a9aeaa0:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_389:head v 114'21, mlcod=113'19)", 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.465516+0000", 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.815178030999999, 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026473640999999999, 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.465516+0000", 2024-04-24T13:34:03.352 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.465516+0000", 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.465519+0000", 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0999999999999998e-06 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.353 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.469547+0000", 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004028121 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.469572+0000", 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5119000000000001e-05 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.469586+0000", 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.4153e-05 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.354 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.469784+0000", 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000198199 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.469826+0000", 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1332999999999999e-05 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.491917+0000", 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022091070000000001 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.355 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.491990+0000", 2024-04-24T13:34:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.3546000000000004e-05 2024-04-24T13:34:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3492 3.2c 3:37e29121:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_390:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:34:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.473983+0000", 2024-04-24T13:34:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.806711913000001, 2024-04-24T13:34:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027383523999999999, 2024-04-24T13:34:03.356 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3492 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.473983+0000", 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.357 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.473983+0000", 2024-04-24T13:34:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.473987+0000", 2024-04-24T13:34:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4059999999999998e-06 2024-04-24T13:34:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.478344+0000", 2024-04-24T13:34:03.358 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043573220000000003 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.478381+0000", 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6848999999999999e-05 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.478401+0000", 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9760000000000001e-05 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.478533+0000", 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013158500000000001 2024-04-24T13:34:03.359 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.478941+0000", 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00040844699999999999 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.479215+0000", 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000273532 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.499412+0000", 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020197209000000001 2024-04-24T13:34:03.360 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.501067+0000", 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001655559 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.501240+0000", 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000172786 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.501366+0000", 2024-04-24T13:34:03.361 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126069 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3514 3.a 3:5344e333:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_412:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.697009+0000", 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.583685507999999, 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027168666000000001, 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.362 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3514 2024-04-24T13:34:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.697009+0000", 2024-04-24T13:34:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.697009+0000", 2024-04-24T13:34:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.363 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.697012+0000", 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6369999999999999e-06 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.701036+0000", 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040242129999999996 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.701070+0000", 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4547e-05 2024-04-24T13:34:03.364 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.701087+0000", 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6877000000000001e-05 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.701212+0000", 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000124249 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.701470+0000", 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025818400000000001 2024-04-24T13:34:03.365 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.701702+0000", 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023233800000000001 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.711232+0000", 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.009530396 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.724004+0000", 2024-04-24T13:34:03.366 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012771403000000001 2024-04-24T13:34:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.724101+0000", 2024-04-24T13:34:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7089000000000005e-05 2024-04-24T13:34:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.724178+0000", 2024-04-24T13:34:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6732999999999999e-05 2024-04-24T13:34:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.367 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3523 3.2c 3:361200dd:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_421:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e114)", 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:33.788604+0000", 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 29.492090505, 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029155912999999999, 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3523 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.368 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.788604+0000", 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.788604+0000", 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.788636+0000", 2024-04-24T13:34:03.369 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2020000000000002e-05 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.796636+0000", 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0079996979999999995 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.796676+0000", 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0163000000000002e-05 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.796693+0000", 2024-04-24T13:34:03.370 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.755e-05 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.796898+0000", 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020453800000000001 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.797161+0000", 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026300500000000002 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.797400+0000", 2024-04-24T13:34:03.371 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000239301 2024-04-24T13:34:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.808081+0000", 2024-04-24T13:34:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01068055 2024-04-24T13:34:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.817452+0000", 2024-04-24T13:34:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0093716440000000002 2024-04-24T13:34:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.372 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.817624+0000", 2024-04-24T13:34:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000171096 2024-04-24T13:34:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:33.817760+0000", 2024-04-24T13:34:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000136348 2024-04-24T13:34:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.373 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3585 3.11 e114/41 3:88ded408:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.11__shadow_.tvSUdLsT5AOXlVlVfGeZg954SPHIS-u_482:head v 114'17, mlcod=113'15)", 2024-04-24T13:34:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:34.405548+0000", 2024-04-24T13:34:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 28.875146502, 2024-04-24T13:34:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028875996000000001, 2024-04-24T13:34:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.405548+0000", 2024-04-24T13:34:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.374 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.405548+0000", 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.405551+0000", 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0970000000000002e-06 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.409441+0000", 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0038902350000000001 2024-04-24T13:34:03.375 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.409494+0000", 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.2618999999999999e-05 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.409519+0000", 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4953999999999999e-05 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.409683+0000", 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016437799999999999 2024-04-24T13:34:03.376 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.409747+0000", 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3823000000000002e-05 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.434292+0000", 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.024545071000000002 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:34.434424+0000", 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013181900000000001 2024-04-24T13:34:03.377 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3863 3.36 3:6e7fd296:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_87:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:55.977406+0000", 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.3032882079999997, 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029272201000000001, 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.378 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3863 2024-04-24T13:34:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.977406+0000", 2024-04-24T13:34:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.977406+0000", 2024-04-24T13:34:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.379 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.977410+0000", 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.8290000000000001e-06 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.981434+0000", 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040241030000000002 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.981463+0000", 2024-04-24T13:34:03.380 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8739e-05 2024-04-24T13:34:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.981478+0000", 2024-04-24T13:34:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5437000000000001e-05 2024-04-24T13:34:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.981610+0000", 2024-04-24T13:34:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013164399999999999 2024-04-24T13:34:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.381 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.981905+0000", 2024-04-24T13:34:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029520600000000001 2024-04-24T13:34:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:34:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.982165+0000", 2024-04-24T13:34:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025979699999999998 2024-04-24T13:34:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.994499+0000", 2024-04-24T13:34:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01233359 2024-04-24T13:34:03.382 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.006524+0000", 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012025284000000001 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.006613+0000", 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.9215000000000006e-05 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.006679+0000", 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.5357000000000005e-05 2024-04-24T13:34:03.383 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3865 3.35 3:af8873b5:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_89:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:55.996747+0000", 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.2839471470000001, 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.02716876, 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.384 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3865 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.996747+0000", 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.996747+0000", 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.996751+0000", 2024-04-24T13:34:03.385 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1520000000000001e-06 2024-04-24T13:34:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.000724+0000", 2024-04-24T13:34:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003973814 2024-04-24T13:34:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.000757+0000", 2024-04-24T13:34:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2308000000000003e-05 2024-04-24T13:34:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.386 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.000774+0000", 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6912e-05 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.000922+0000", 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000148047 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.001170+0000", 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000248364 2024-04-24T13:34:03.387 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.001424+0000", 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00025360299999999998 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.009984+0000", 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0085605070000000002 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.023744+0000", 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.013760355 2024-04-24T13:34:03.388 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.023841+0000", 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7041999999999997e-05 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.023916+0000", 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.4655999999999998e-05 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3872 3.35 3:acba713e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_96:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:03.389 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.066502+0000", 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.2141926930000002, 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029190337, 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3872 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.066502+0000", 2024-04-24T13:34:03.390 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.066502+0000", 2024-04-24T13:34:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.066505+0000", 2024-04-24T13:34:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.1860000000000001e-06 2024-04-24T13:34:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.391 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.070611+0000", 2024-04-24T13:34:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0041061860000000004 2024-04-24T13:34:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.070651+0000", 2024-04-24T13:34:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9332000000000002e-05 2024-04-24T13:34:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.070669+0000", 2024-04-24T13:34:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8317000000000001e-05 2024-04-24T13:34:03.392 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.070833+0000", 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016384099999999999 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.071114+0000", 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000280959 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.071362+0000", 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024786300000000002 2024-04-24T13:34:03.393 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.088411+0000", 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017049715 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.095448+0000", 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070369919999999997 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.095577+0000", 2024-04-24T13:34:03.394 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012899799999999999 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.095692+0000", 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114948 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3898 3.36 3:6c05e76e:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_122:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.319089+0000", 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.9616059720000001, 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.028456207000000001, 2024-04-24T13:34:03.395 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3898 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.319089+0000", 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.396 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.319089+0000", 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.319095+0000", 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0599999999999996e-06 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.323711+0000", 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046164090000000001 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.397 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.323756+0000", 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4546999999999999e-05 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.323776+0000", 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.0475999999999998e-05 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.323929+0000", 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015295400000000001 2024-04-24T13:34:03.398 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.324301+0000", 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00037180200000000002 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.324665+0000", 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00036393100000000001 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.346221+0000", 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.021555939999999999 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.399 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.347369+0000", 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0011486739999999999 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.347468+0000", 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9061999999999994e-05 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.347545+0000", 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6352000000000004e-05 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.400 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.401 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.401 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:34:03.402 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_ops_in_flight 2024-04-24T13:34:03.535 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:34:03.535 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:34:03.535 INFO:teuthology.orchestra.run.smithi138.stdout: "num_ops": 0 2024-04-24T13:34:03.535 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:34:03.549 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_blocked_ops 2024-04-24T13:34:03.673 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:34:03.673 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [], 2024-04-24T13:34:03.673 INFO:teuthology.orchestra.run.smithi138.stdout: "complaint_time": 30, 2024-04-24T13:34:03.673 INFO:teuthology.orchestra.run.smithi138.stdout: "num_blocked_ops": 0 2024-04-24T13:34:03.673 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:34:03.687 DEBUG:teuthology.orchestra.run.smithi138:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 30 ceph --cluster ceph --admin-daemon /var/run/ceph/ceph-osd.7.asok dump_historic_ops 2024-04-24T13:34:03.817 INFO:teuthology.orchestra.run.smithi138.stdout:{ 2024-04-24T13:34:03.817 INFO:teuthology.orchestra.run.smithi138.stdout: "size": 20, 2024-04-24T13:34:03.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 600, 2024-04-24T13:34:03.817 INFO:teuthology.orchestra.run.smithi138.stdout: "ops": [ 2024-04-24T13:34:03.817 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.817 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:113 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197140~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:34:03.817 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:34:03.817 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 234.75052899900001, 2024-04-24T13:34:03.817 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022338007, 2024-04-24T13:34:03.818 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.818 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.818 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:34:03.818 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:34:03.818 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 113 2024-04-24T13:34:03.818 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.818 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.818 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.818 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.818 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060583+0000", 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060585+0000", 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.61e-06 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.819 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060596+0000", 2024-04-24T13:34:03.820 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1392999999999999e-05 2024-04-24T13:34:03.820 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.820 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.821 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.821 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060618+0000", 2024-04-24T13:34:03.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.2266e-05 2024-04-24T13:34:03.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060634+0000", 2024-04-24T13:34:03.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5299999999999999e-05 2024-04-24T13:34:03.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.822 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.822 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.822 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.074885+0000", 2024-04-24T13:34:03.822 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.014251059999999999 2024-04-24T13:34:03.822 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075015+0000", 2024-04-24T13:34:03.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000129782 2024-04-24T13:34:03.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:03.823 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.075302+0000", 2024-04-24T13:34:03.823 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00028776099999999998 2024-04-24T13:34:03.823 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.823 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.823 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080100+0000", 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0047972199999999996 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082662+0000", 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0025628869999999998 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082810+0000", 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000147415 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.824 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082921+0000", 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000111313 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:114 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197144~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 234.75041933700001, 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022620685000000001, 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.825 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.826 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.826 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.826 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:34:03.826 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:34:03.826 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 114 2024-04-24T13:34:03.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.826 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.826 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.826 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:34:03.826 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.826 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.826 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060693+0000", 2024-04-24T13:34:03.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060694+0000", 2024-04-24T13:34:03.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.127e-06 2024-04-24T13:34:03.827 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.827 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.827 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.827 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060701+0000", 2024-04-24T13:34:03.827 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.8700000000000003e-06 2024-04-24T13:34:03.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060713+0000", 2024-04-24T13:34:03.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.203e-05 2024-04-24T13:34:03.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.828 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060721+0000", 2024-04-24T13:34:03.828 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.4800000000000001e-06 2024-04-24T13:34:03.828 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.828 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.828 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077305+0000", 2024-04-24T13:34:03.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.016583937999999999 2024-04-24T13:34:03.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077433+0000", 2024-04-24T13:34:03.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000127959 2024-04-24T13:34:03.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.829 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.829 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:03.829 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.077632+0000", 2024-04-24T13:34:03.829 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00019920800000000001 2024-04-24T13:34:03.829 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081668+0000", 2024-04-24T13:34:03.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004035332 2024-04-24T13:34:03.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083057+0000", 2024-04-24T13:34:03.830 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0013891260000000001 2024-04-24T13:34:03.830 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.830 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.830 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.830 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083198+0000", 2024-04-24T13:34:03.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000141509 2024-04-24T13:34:03.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.831 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.831 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083314+0000", 2024-04-24T13:34:03.831 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011510600000000001 2024-04-24T13:34:03.831 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.831 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.831 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.831 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.831 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.831 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:115 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 197148~65536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:34:03.831 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 234.75034730799999, 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023847568999999999, 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 115 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:34:03.832 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060765+0000", 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060766+0000", 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1570000000000001e-06 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.833 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060896+0000", 2024-04-24T13:34:03.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013011199999999999 2024-04-24T13:34:03.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060910+0000", 2024-04-24T13:34:03.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.3546999999999999e-05 2024-04-24T13:34:03.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.834 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.834 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.834 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060919+0000", 2024-04-24T13:34:03.834 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5000000000000005e-06 2024-04-24T13:34:03.834 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078258+0000", 2024-04-24T13:34:03.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017338602000000002 2024-04-24T13:34:03.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078491+0000", 2024-04-24T13:34:03.835 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023270499999999999 2024-04-24T13:34:03.835 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.835 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.835 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:03.835 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.078883+0000", 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00039287399999999998 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082953+0000", 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040697019999999997 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084346+0000", 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001392562 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.836 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084490+0000", 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014484599999999999 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084612+0000", 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000121962 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:116 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [write 262684~4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:34:03.837 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:34:03.838 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 234.750176272, 2024-04-24T13:34:03.838 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023987820999999999, 2024-04-24T13:34:03.838 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.838 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.838 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.838 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.838 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:34:03.838 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:34:03.838 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 116 2024-04-24T13:34:03.838 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.838 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.838 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.838 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:34:03.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060936+0000", 2024-04-24T13:34:03.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.839 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.839 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.839 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060937+0000", 2024-04-24T13:34:03.839 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.1999999999999998e-07 2024-04-24T13:34:03.839 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060943+0000", 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0360000000000003e-06 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060953+0000", 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9699999999999994e-06 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060963+0000", 2024-04-24T13:34:03.840 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0139999999999999e-05 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080207+0000", 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019244245 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080347+0000", 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000139849 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:03.841 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.080572+0000", 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022489400000000001 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083359+0000", 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0027868160000000001 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084722+0000", 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.001362769 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.842 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084809+0000", 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.7933e-05 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.084924+0000", 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000114249 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4219.0:117 1.0 1:1b0e96ae:devicehealth::main.db-journal.0000000000000000:head [setxattr striper.size (16) in=12b,setxattr striper.version (16) in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e15)", 2024-04-24T13:34:03.843 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 234.750136779, 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026176398, 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4219", 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.138:0/2674849272", 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 117 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.844 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060975+0000", 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060976+0000", 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.0299999999999998e-07 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.845 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060984+0000", 2024-04-24T13:34:03.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.374e-06 2024-04-24T13:34:03.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.060993+0000", 2024-04-24T13:34:03.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.9029999999999999e-06 2024-04-24T13:34:03.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.846 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.846 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.846 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.061001+0000", 2024-04-24T13:34:03.846 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9060000000000002e-06 2024-04-24T13:34:03.846 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081800+0000", 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.020798163000000001 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.081938+0000", 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013873499999999999 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.082149+0000", 2024-04-24T13:34:03.847 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000210275 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.083381+0000", 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0012322209999999999 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.086950+0000", 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035694289999999998 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087029+0000", 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9227000000000006e-05 2024-04-24T13:34:03.848 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:30:09.087152+0000", 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012236199999999999 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3765 7.15 7:a93a5511:::notify.2:head [watch reconnect cookie 94410010340608 gen 4] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e127)", 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:51.524750+0000", 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 12.286362359, 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.028614803, 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.849 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "started", 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3765 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:51.524750+0000", 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.850 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:51.524750+0000", 2024-04-24T13:34:03.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:51.524753+0000", 2024-04-24T13:34:03.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.0460000000000001e-06 2024-04-24T13:34:03.851 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.851 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.851 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.851 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:51.524765+0000", 2024-04-24T13:34:03.851 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.1747e-05 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:51.524797+0000", 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2363000000000002e-05 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:51.524814+0000", 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7419999999999999e-05 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.852 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:51.524965+0000", 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00015038700000000001 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:51.524982+0000", 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.6957e-05 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:51.538066+0000", 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01308437 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for peered", 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:51.538096+0000", 2024-04-24T13:34:03.853 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.9502999999999999e-05 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:52.550857+0000", 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.0127614709999999 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:52.551024+0000", 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016693799999999999 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.854 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:52.553365+0000", 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0023406009999999999 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3853 3.14 e130/124 3:2921a635:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_77:head v 130'26, mlcod=114'24)", 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:55.881059+0000", 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.9300530419999999, 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.026199587999999999, 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.855 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.881059+0000", 2024-04-24T13:34:03.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.881059+0000", 2024-04-24T13:34:03.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.856 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.856 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.856 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.856 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.881062+0000", 2024-04-24T13:34:03.856 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3929999999999998e-06 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.887341+0000", 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0062799259999999999 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.887374+0000", 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.2132999999999999e-05 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.857 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.887397+0000", 2024-04-24T13:34:03.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.3349999999999998e-05 2024-04-24T13:34:03.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.887598+0000", 2024-04-24T13:34:03.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00020140699999999999 2024-04-24T13:34:03.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.858 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.858 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.887662+0000", 2024-04-24T13:34:03.858 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3392000000000006e-05 2024-04-24T13:34:03.858 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.858 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.907120+0000", 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.019458413000000001 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.907259+0000", 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013857400000000001 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.859 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3857 3.e 3:71ed8068:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_81:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:55.920302+0000", 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.8908098779999998, 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.032180586999999997, 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3857 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.860 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.920302+0000", 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.920302+0000", 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.920320+0000", 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7920000000000001e-05 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.861 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.928627+0000", 2024-04-24T13:34:03.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0083070409999999994 2024-04-24T13:34:03.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.928661+0000", 2024-04-24T13:34:03.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3525999999999997e-05 2024-04-24T13:34:03.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.862 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.862 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.862 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.928680+0000", 2024-04-24T13:34:03.862 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9029e-05 2024-04-24T13:34:03.862 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.928841+0000", 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00016108499999999999 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.929253+0000", 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041249100000000002 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.929711+0000", 2024-04-24T13:34:03.863 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00045713299999999998 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.942287+0000", 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012576759 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.952191+0000", 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0099037970000000006 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.864 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.952379+0000", 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000188128 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:55.952483+0000", 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010367800000000001 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3891 3.f 3:f1353920:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_115:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.252453+0000", 2024-04-24T13:34:03.865 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.5586595399999998, 2024-04-24T13:34:03.866 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022133959000000002, 2024-04-24T13:34:03.866 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.866 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.866 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.866 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.866 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.866 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.866 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3891 2024-04-24T13:34:03.866 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.866 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.866 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.866 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.866 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.252453+0000", 2024-04-24T13:34:03.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.252453+0000", 2024-04-24T13:34:03.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.867 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.867 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.252456+0000", 2024-04-24T13:34:03.867 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7740000000000002e-06 2024-04-24T13:34:03.867 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.867 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.256478+0000", 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040218520000000002 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.256507+0000", 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8538999999999999e-05 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.256522+0000", 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5339999999999999e-05 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.868 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.256707+0000", 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018523699999999999 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.256947+0000", 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000240041 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.257166+0000", 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00021834999999999999 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.869 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.274289+0000", 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.01712311 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.274411+0000", 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000122259 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.274510+0000", 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8610999999999995e-05 2024-04-24T13:34:03.870 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.274587+0000", 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.6846000000000003e-05 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3892 3.f 3:f2d0842a:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_116:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.261611+0000", 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.5495008080000003, 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.031979934000000002, 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.871 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3892 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.261611+0000", 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.261611+0000", 2024-04-24T13:34:03.872 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.261614+0000", 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.627e-06 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.265657+0000", 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0040433450000000003 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.265682+0000", 2024-04-24T13:34:03.873 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.4553e-05 2024-04-24T13:34:03.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.265695+0000", 2024-04-24T13:34:03.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.2649999999999999e-05 2024-04-24T13:34:03.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.874 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.265823+0000", 2024-04-24T13:34:03.874 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000128751 2024-04-24T13:34:03.874 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.874 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.874 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.266068+0000", 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024487599999999999 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.266304+0000", 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023597700000000001 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.277492+0000", 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011187737 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.875 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.293405+0000", 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015913571000000001 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.293509+0000", 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000103584 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.293591+0000", 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.2262999999999995e-05 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.876 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3926 3.37 3:ece411d8:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_150:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.601244+0000", 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.2098677889999996, 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023486681999999998, 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.877 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3926 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.601244+0000", 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.601244+0000", 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.878 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.601248+0000", 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.427e-06 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.605036+0000", 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003787978 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.605076+0000", 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0096999999999999e-05 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.879 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.605094+0000", 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7785999999999999e-05 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.605242+0000", 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014857100000000001 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.605504+0000", 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00026212000000000002 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:34:03.880 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.605741+0000", 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023692599999999999 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.621301+0000", 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015560174 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.624496+0000", 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00319403 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.624591+0000", 2024-04-24T13:34:03.881 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.5304999999999996e-05 2024-04-24T13:34:03.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.882 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.882 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.624731+0000", 2024-04-24T13:34:03.882 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014026800000000001 2024-04-24T13:34:03.882 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.882 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.882 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.882 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.882 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.882 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3943 3.37 3:ee02fadc:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_167:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:03.882 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.796846+0000", 2024-04-24T13:34:03.882 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 7.0142664430000004, 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022199234000000002, 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3943 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.796846+0000", 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.883 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.796846+0000", 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.796850+0000", 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.1099999999999996e-06 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.801291+0000", 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.004440729 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.884 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.801333+0000", 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2327000000000003e-05 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.801359+0000", 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.6452e-05 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.801509+0000", 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00014984500000000001 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.885 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.801773+0000", 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000263489 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 5", 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.802010+0000", 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023760400000000001 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.812326+0000", 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010315748 2024-04-24T13:34:03.886 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.818829+0000", 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0065033900000000004 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.818927+0000", 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7299000000000005e-05 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.819045+0000", 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011824099999999999 2024-04-24T13:34:03.887 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3953 3.11 3:8a140a54:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_177:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.906746+0000", 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.904365716, 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025154671999999999, 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.888 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3953 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.906746+0000", 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.906746+0000", 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.889 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.906751+0000", 2024-04-24T13:34:03.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.4259999999999996e-06 2024-04-24T13:34:03.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.911132+0000", 2024-04-24T13:34:03.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043814020000000004 2024-04-24T13:34:03.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.890 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.890 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.890 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.911169+0000", 2024-04-24T13:34:03.890 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.7058999999999999e-05 2024-04-24T13:34:03.890 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.911188+0000", 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8899999999999999e-05 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.911314+0000", 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012541399999999999 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.911548+0000", 2024-04-24T13:34:03.891 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000234501 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.911778+0000", 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022991600000000001 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.924120+0000", 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012342209 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.931597+0000", 2024-04-24T13:34:03.892 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00747629 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.931779+0000", 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00018212400000000001 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.931901+0000", 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012243099999999999 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.893 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.894 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_repop(client.4385.0:3958 3.16 e130/124 3:6aedc82b:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_182:head v 130'19, mlcod=114'17)", 2024-04-24T13:34:03.894 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.963786+0000", 2024-04-24T13:34:03.894 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.8473266150000001, 2024-04-24T13:34:03.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.029407988999999999, 2024-04-24T13:34:03.894 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.894 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.894 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.894 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.894 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.894 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.894 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.963786+0000", 2024-04-24T13:34:03.894 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.894 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.963786+0000", 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.963788+0000", 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.8830000000000002e-06 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.970793+0000", 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0070043359999999999 2024-04-24T13:34:03.895 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.970851+0000", 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.8616000000000003e-05 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.970879+0000", 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.7623e-05 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.971010+0000", 2024-04-24T13:34:03.896 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00013066799999999999 2024-04-24T13:34:03.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.971073+0000", 2024-04-24T13:34:03.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.3569000000000001e-05 2024-04-24T13:34:03.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.897 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.993114+0000", 2024-04-24T13:34:03.897 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022040313999999998 2024-04-24T13:34:03.897 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.897 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.897 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.898 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.993194+0000", 2024-04-24T13:34:03.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9980000000000003e-05 2024-04-24T13:34:03.898 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.898 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.898 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.898 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.898 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.898 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3959 3.e 3:72bdeaa9:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_183:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:03.898 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:56.971078+0000", 2024-04-24T13:34:03.898 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.8400344799999999, 2024-04-24T13:34:03.898 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.027563918999999999, 2024-04-24T13:34:03.898 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3959 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.971078+0000", 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.899 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.971078+0000", 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.971082+0000", 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6759999999999998e-06 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.974866+0000", 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0037835759999999999 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.900 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.974911+0000", 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.5073e-05 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.974944+0000", 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.3371999999999998e-05 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.975184+0000", 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00023972699999999999 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.901 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.975597+0000", 2024-04-24T13:34:03.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041282100000000001 2024-04-24T13:34:03.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:03.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.976020+0000", 2024-04-24T13:34:03.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00042259399999999999 2024-04-24T13:34:03.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.902 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.902 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.902 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.998345+0000", 2024-04-24T13:34:03.902 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022325636999999999 2024-04-24T13:34:03.902 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.998454+0000", 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00010864700000000001 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.998581+0000", 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00012694299999999999 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:56.998642+0000", 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 6.0853000000000002e-05 2024-04-24T13:34:03.903 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3974 3.f 3:f3bd19de:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_198:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:57.143532+0000", 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.6675804489999999, 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022162721, 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.904 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3974 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.143532+0000", 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.143532+0000", 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.905 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.143537+0000", 2024-04-24T13:34:03.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.3839999999999996e-06 2024-04-24T13:34:03.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.147921+0000", 2024-04-24T13:34:03.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043840900000000002 2024-04-24T13:34:03.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.906 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.906 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.147962+0000", 2024-04-24T13:34:03.906 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.0899999999999998e-05 2024-04-24T13:34:03.906 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.906 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.147981+0000", 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.8842999999999999e-05 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.148091+0000", 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000109898 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.148298+0000", 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000207326 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.907 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.148533+0000", 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000235021 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.155372+0000", 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0068391959999999996 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.165605+0000", 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010233054 2024-04-24T13:34:03.908 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.165652+0000", 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.6177999999999997e-05 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.165694+0000", 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2830999999999997e-05 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.909 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.910 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:3982 3.39 3:9f1706ef:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_206:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e130)", 2024-04-24T13:34:03.910 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:57.249956+0000", 2024-04-24T13:34:03.910 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.5611557720000002, 2024-04-24T13:34:03.910 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.034014902999999999, 2024-04-24T13:34:03.910 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.910 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.910 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.910 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.910 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.910 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.910 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 3982 2024-04-24T13:34:03.910 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.910 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.249956+0000", 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.249956+0000", 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.249961+0000", 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.2429999999999999e-06 2024-04-24T13:34:03.911 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.254224+0000", 2024-04-24T13:34:03.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0042633330000000002 2024-04-24T13:34:03.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.254263+0000", 2024-04-24T13:34:03.912 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.9369000000000002e-05 2024-04-24T13:34:03.912 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.912 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.912 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.912 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.254281+0000", 2024-04-24T13:34:03.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.7839999999999999e-05 2024-04-24T13:34:03.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.254455+0000", 2024-04-24T13:34:03.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00017353099999999999 2024-04-24T13:34:03.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.913 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.913 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.254869+0000", 2024-04-24T13:34:03.913 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00041417 2024-04-24T13:34:03.913 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.913 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 0", 2024-04-24T13:34:03.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.255303+0000", 2024-04-24T13:34:03.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00043372099999999998 2024-04-24T13:34:03.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.266380+0000", 2024-04-24T13:34:03.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.011077145 2024-04-24T13:34:03.914 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.914 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.914 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.914 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.283872+0000", 2024-04-24T13:34:03.914 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.017492458999999998 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.283920+0000", 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 4.8037000000000001e-05 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.283971+0000", 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 5.1054999999999998e-05 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.915 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.916 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.916 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4015 3.13 3:c878a3db:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_239:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e131)", 2024-04-24T13:34:03.916 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:33:57.698024+0000", 2024-04-24T13:34:03.916 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 6.1130878089999996, 2024-04-24T13:34:03.916 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.023386552000000001, 2024-04-24T13:34:03.916 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.916 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.916 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.916 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.916 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.916 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.916 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4015 2024-04-24T13:34:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.698024+0000", 2024-04-24T13:34:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.698024+0000", 2024-04-24T13:34:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.917 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.698027+0000", 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 2.5639999999999999e-06 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.702392+0000", 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0043650750000000004 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.702428+0000", 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6186999999999998e-05 2024-04-24T13:34:03.918 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.702444+0000", 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.5613000000000001e-05 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.702557+0000", 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00011313499999999999 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op must wait for map", 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.702567+0000", 2024-04-24T13:34:03.919 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.7030000000000001e-06 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.706424+0000", 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003857156 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.706721+0000", 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00029730199999999999 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:03.920 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.706966+0000", 2024-04-24T13:34:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024474400000000003 2024-04-24T13:34:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.717338+0000", 2024-04-24T13:34:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.010371828 2024-04-24T13:34:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.721215+0000", 2024-04-24T13:34:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.003877349 2024-04-24T13:34:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.921 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.721326+0000", 2024-04-24T13:34:03.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000110895 2024-04-24T13:34:03.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.922 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.922 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:33:57.721411+0000", 2024-04-24T13:34:03.922 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 8.5000999999999995e-05 2024-04-24T13:34:03.922 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.922 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.922 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.922 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.922 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4266 3.e 3:7106ba36:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_480:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:34:00.812918+0000", 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.99819404, 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.022442093999999999, 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4266 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.923 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.812918+0000", 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.812918+0000", 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.812922+0000", 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.597e-06 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.924 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.818116+0000", 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0051942589999999997 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.818151+0000", 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.4666000000000003e-05 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.818171+0000", 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.9959999999999999e-05 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.925 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.818457+0000", 2024-04-24T13:34:03.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000286409 2024-04-24T13:34:03.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.818715+0000", 2024-04-24T13:34:03.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000258373 2024-04-24T13:34:03.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.926 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.926 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 4", 2024-04-24T13:34:03.926 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.818943+0000", 2024-04-24T13:34:03.926 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00022771999999999999 2024-04-24T13:34:03.926 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.831625+0000", 2024-04-24T13:34:03.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.012682222999999999 2024-04-24T13:34:03.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.835181+0000", 2024-04-24T13:34:03.927 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0035559849999999998 2024-04-24T13:34:03.927 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.927 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.927 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.927 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.835280+0000", 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.8979000000000002e-05 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.835360+0000", 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.9923e-05 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: "description": "osd_op(client.4385.0:4273 3.3b 3:df59496c:::e142676b-7cd6-4a83-935a-7deccd638cec.4385.12__shadow_.MjI5J6dHpz6qdUzyTPsxLuJtMKWzf5Z_487:head [set-alloc-hint object_size 0 write_size 0,writefull 0~4194304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e132)", 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: "initiated_at": "2024-04-24T13:34:00.885298+0000", 2024-04-24T13:34:03.928 INFO:teuthology.orchestra.run.smithi138.stdout: "age": 2.9258140589999999, 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.025253080000000001, 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: "continuous": false, 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: "type_data": { 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: "flag_point": "commit sent; apply or cleanup", 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: "client_info": { 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: "client": "client.4385", 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: "client_addr": "172.21.15.71:0/1985301317", 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: "tid": 4273 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: "events": [ 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "initiated", 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.885298+0000", 2024-04-24T13:34:03.929 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "header_read", 2024-04-24T13:34:03.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.885298+0000", 2024-04-24T13:34:03.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0 2024-04-24T13:34:03.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "throttled", 2024-04-24T13:34:03.930 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.885301+0000", 2024-04-24T13:34:03.930 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.337e-06 2024-04-24T13:34:03.930 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.930 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.930 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "all_read", 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.889924+0000", 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046223269999999999 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "dispatched", 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.889960+0000", 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 3.6219e-05 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "queued_for_pg", 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.889978+0000", 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 1.751e-05 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.931 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "reached_pg", 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.890104+0000", 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.000126818 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "started", 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.890381+0000", 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00027697300000000002 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "waiting for subops from 2", 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.890627+0000", 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.00024597600000000002 2024-04-24T13:34:03.932 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "sub_op_commit_rec", 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.905738+0000", 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.015110772 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "op_commit", 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.910378+0000", 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 0.0046395530000000003 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "commit_sent", 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.910472+0000", 2024-04-24T13:34:03.933 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 9.4648999999999995e-05 2024-04-24T13:34:03.934 INFO:teuthology.orchestra.run.smithi138.stdout: }, 2024-04-24T13:34:03.934 INFO:teuthology.orchestra.run.smithi138.stdout: { 2024-04-24T13:34:03.934 INFO:teuthology.orchestra.run.smithi138.stdout: "event": "done", 2024-04-24T13:34:03.934 INFO:teuthology.orchestra.run.smithi138.stdout: "time": "2024-04-24T13:34:00.910551+0000", 2024-04-24T13:34:03.934 INFO:teuthology.orchestra.run.smithi138.stdout: "duration": 7.8945999999999999e-05 2024-04-24T13:34:03.934 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.934 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.934 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.934 INFO:teuthology.orchestra.run.smithi138.stdout: } 2024-04-24T13:34:03.934 INFO:teuthology.orchestra.run.smithi138.stdout: ] 2024-04-24T13:34:03.934 INFO:teuthology.orchestra.run.smithi138.stdout:} 2024-04-24T13:34:04.047 INFO:teuthology.orchestra.run.smithi071.stderr:nodeep-scrub is unset 2024-04-24T13:34:18.546 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph -- tell 'mon.*' injectargs --mon_osd_down_out_interval=600 2024-04-24T13:34:18.690 INFO:teuthology.orchestra.run.smithi071.stdout:mon.a: {} 2024-04-24T13:34:18.690 INFO:teuthology.orchestra.run.smithi071.stderr:mon.a: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-24T13:34:18.703 INFO:teuthology.orchestra.run.smithi071.stdout:mon.b: {} 2024-04-24T13:34:18.703 INFO:teuthology.orchestra.run.smithi071.stderr:mon.b: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-24T13:34:18.712 INFO:teuthology.orchestra.run.smithi071.stdout:mon.c: {} 2024-04-24T13:34:18.712 INFO:teuthology.orchestra.run.smithi071.stderr:mon.c: mon_osd_down_out_interval = '' (not observed, change may require restart) 2024-04-24T13:34:18.729 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 0 1 2024-04-24T13:34:19.405 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.0 to 1 (10000) 2024-04-24T13:34:19.428 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 0 1 2024-04-24T13:34:20.398 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.0 primary-affinity to 1 (8655362) 2024-04-24T13:34:20.426 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 1 1 2024-04-24T13:34:21.416 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.1 to 1 (10000) 2024-04-24T13:34:21.442 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 1 1 2024-04-24T13:34:22.429 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.1 primary-affinity to 1 (8655362) 2024-04-24T13:34:22.453 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 2 1 2024-04-24T13:34:23.435 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.2 to 1 (10000) 2024-04-24T13:34:23.464 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 2 1 2024-04-24T13:34:24.449 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.2 primary-affinity to 1 (8655362) 2024-04-24T13:34:24.476 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 3 1 2024-04-24T13:34:25.465 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.3 to 1 (10000) 2024-04-24T13:34:25.492 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 3 1 2024-04-24T13:34:26.483 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.3 primary-affinity to 1 (8655362) 2024-04-24T13:34:26.507 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 4 1 2024-04-24T13:34:27.489 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.4 to 1 (10000) 2024-04-24T13:34:27.515 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 4 1 2024-04-24T13:34:28.512 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.4 primary-affinity to 1 (8655362) 2024-04-24T13:34:28.538 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 5 1 2024-04-24T13:34:29.536 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.5 to 1 (10000) 2024-04-24T13:34:29.562 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 5 1 2024-04-24T13:34:30.539 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.5 primary-affinity to 1 (8655362) 2024-04-24T13:34:30.563 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 6 1 2024-04-24T13:34:31.552 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.6 to 1 (10000) 2024-04-24T13:34:31.578 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 6 1 2024-04-24T13:34:32.565 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.6 primary-affinity to 1 (8655362) 2024-04-24T13:34:32.592 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd reweight 7 1 2024-04-24T13:34:33.586 INFO:teuthology.orchestra.run.smithi071.stderr:reweighted osd.7 to 1 (10000) 2024-04-24T13:34:33.609 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd primary-affinity 7 1 2024-04-24T13:34:34.586 INFO:teuthology.orchestra.run.smithi071.stderr:set osd.7 primary-affinity to 1 (8655362) 2024-04-24T13:34:34.612 INFO:tasks.thrashosds.thrasher:joining the do_sighup greenlet 2024-04-24T13:34:34.612 INFO:tasks.thrashosds.thrasher:joining the do_optrack_toggle greenlet 2024-04-24T13:34:34.612 INFO:tasks.thrashosds.thrasher:joining the do_dump_ops greenlet 2024-04-24T13:34:34.612 INFO:tasks.thrashosds.thrasher:joining the do_noscrub_toggle greenlet 2024-04-24T13:34:34.612 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-04-24T13:34:34.612 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T13:34:34.915 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:34:34.916 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":150,"fsid":"6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8","created":"2024-04-24T13:29:54.500837+0000","modified":"2024-04-24T13:34:34.578879+0000","last_up_change":"2024-04-24T13:30:06.614065+0000","last_in_change":"2024-04-24T13:33:48.485877+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T13:30:07.251223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T13:30:13.385113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-24T13:30:20.167043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-24T13:30:21.533214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-24T13:30:23.455631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-24T13:30:25.363907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-24T13:30:27.261843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-24T13:30:29.393640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dcf17737-d21a-4731-8a14-4b008f82e1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6801","nonce":1371554644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6803","nonce":1371554644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6812","nonce":1371554644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6806","nonce":1371554644}]},"public_addr":"172.21.15.71:6801/1371554644","cluster_addr":"172.21.15.71:6803/1371554644","heartbeat_back_addr":"172.21.15.71:6812/1371554644","heartbeat_front_addr":"172.21.15.71:6806/1371554644","state":["exists","up"]},{"osd":1,"uuid":"559511d8-704f-48ae-a330-331a8a18486a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6825","nonce":2907970623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6827","nonce":2907970623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6831","nonce":2907970623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6829","nonce":2907970623}]},"public_addr":"172.21.15.71:6825/2907970623","cluster_addr":"172.21.15.71:6827/2907970623","heartbeat_back_addr":"172.21.15.71:6831/2907970623","heartbeat_front_addr":"172.21.15.71:6829/2907970623","state":["exists","up"]},{"osd":2,"uuid":"496cf95c-01c4-4537-ba79-35c2ad152201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6808","nonce":747727017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6813","nonce":747727017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6823","nonce":747727017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6819","nonce":747727017}]},"public_addr":"172.21.15.71:6808/747727017","cluster_addr":"172.21.15.71:6813/747727017","heartbeat_back_addr":"172.21.15.71:6823/747727017","heartbeat_front_addr":"172.21.15.71:6819/747727017","state":["exists","up"]},{"osd":3,"uuid":"5ce9d307-23e5-4bb9-8035-0827520a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6810","nonce":2258589678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6815","nonce":2258589678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6821","nonce":2258589678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6818","nonce":2258589678}]},"public_addr":"172.21.15.71:6810/2258589678","cluster_addr":"172.21.15.71:6815/2258589678","heartbeat_back_addr":"172.21.15.71:6821/2258589678","heartbeat_front_addr":"172.21.15.71:6818/2258589678","state":["exists","up"]},{"osd":4,"uuid":"6d6e5b3c-301d-4b2c-996f-17d13224f780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6814","nonce":2264053969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6817","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6821","nonce":2264053969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6830","nonce":2264053969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6826","nonce":2264053969}]},"public_addr":"172.21.15.138:6814/2264053969","cluster_addr":"172.21.15.138:6821/2264053969","heartbeat_back_addr":"172.21.15.138:6830/2264053969","heartbeat_front_addr":"172.21.15.138:6826/2264053969","state":["exists","up"]},{"osd":5,"uuid":"b3d18c54-5a9a-4215-8b40-3e796ac2fed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6815","nonce":942955714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6819","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6822","nonce":942955714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6829","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6831","nonce":942955714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6827","nonce":942955714}]},"public_addr":"172.21.15.138:6815/942955714","cluster_addr":"172.21.15.138:6822/942955714","heartbeat_back_addr":"172.21.15.138:6831/942955714","heartbeat_front_addr":"172.21.15.138:6827/942955714","state":["exists","up"]},{"osd":6,"uuid":"12d21ba0-8670-470b-8fd5-a02349ecb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6809","nonce":889830629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6813","nonce":889830629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6823","nonce":889830629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6818","nonce":889830629}]},"public_addr":"172.21.15.138:6809/889830629","cluster_addr":"172.21.15.138:6813/889830629","heartbeat_back_addr":"172.21.15.138:6823/889830629","heartbeat_front_addr":"172.21.15.138:6818/889830629","state":["exists","up"]},{"osd":7,"uuid":"dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6801","nonce":2015291049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6803","nonce":2015291049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6807","nonce":2015291049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6805","nonce":2015291049}]},"public_addr":"172.21.15.138:6801/2015291049","cluster_addr":"172.21.15.138:6803/2015291049","heartbeat_back_addr":"172.21.15.138:6807/2015291049","heartbeat_front_addr":"172.21.15.138:6805/2015291049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.268101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.247572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.186485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.184532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.157242+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.126293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.118991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.213395+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.1a","osds":[6,2]}],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":1}]},{"pgid":"3.a","mappings":[{"from":4,"to":2}]},{"pgid":"3.f","mappings":[{"from":4,"to":2}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"6.1b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T13:34:34.935 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-04-24T13:34:34.935 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T13:34:35.226 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:34:35.226 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":150,"fsid":"6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8","created":"2024-04-24T13:29:54.500837+0000","modified":"2024-04-24T13:34:34.578879+0000","last_up_change":"2024-04-24T13:30:06.614065+0000","last_in_change":"2024-04-24T13:33:48.485877+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T13:30:07.251223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T13:30:13.385113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-24T13:30:20.167043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-24T13:30:21.533214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-24T13:30:23.455631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-24T13:30:25.363907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-24T13:30:27.261843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-24T13:30:29.393640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dcf17737-d21a-4731-8a14-4b008f82e1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6801","nonce":1371554644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6803","nonce":1371554644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6812","nonce":1371554644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6806","nonce":1371554644}]},"public_addr":"172.21.15.71:6801/1371554644","cluster_addr":"172.21.15.71:6803/1371554644","heartbeat_back_addr":"172.21.15.71:6812/1371554644","heartbeat_front_addr":"172.21.15.71:6806/1371554644","state":["exists","up"]},{"osd":1,"uuid":"559511d8-704f-48ae-a330-331a8a18486a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6825","nonce":2907970623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6827","nonce":2907970623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6831","nonce":2907970623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6829","nonce":2907970623}]},"public_addr":"172.21.15.71:6825/2907970623","cluster_addr":"172.21.15.71:6827/2907970623","heartbeat_back_addr":"172.21.15.71:6831/2907970623","heartbeat_front_addr":"172.21.15.71:6829/2907970623","state":["exists","up"]},{"osd":2,"uuid":"496cf95c-01c4-4537-ba79-35c2ad152201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6808","nonce":747727017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6813","nonce":747727017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6823","nonce":747727017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6819","nonce":747727017}]},"public_addr":"172.21.15.71:6808/747727017","cluster_addr":"172.21.15.71:6813/747727017","heartbeat_back_addr":"172.21.15.71:6823/747727017","heartbeat_front_addr":"172.21.15.71:6819/747727017","state":["exists","up"]},{"osd":3,"uuid":"5ce9d307-23e5-4bb9-8035-0827520a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6810","nonce":2258589678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6815","nonce":2258589678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6821","nonce":2258589678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6818","nonce":2258589678}]},"public_addr":"172.21.15.71:6810/2258589678","cluster_addr":"172.21.15.71:6815/2258589678","heartbeat_back_addr":"172.21.15.71:6821/2258589678","heartbeat_front_addr":"172.21.15.71:6818/2258589678","state":["exists","up"]},{"osd":4,"uuid":"6d6e5b3c-301d-4b2c-996f-17d13224f780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6814","nonce":2264053969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6817","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6821","nonce":2264053969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6830","nonce":2264053969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6826","nonce":2264053969}]},"public_addr":"172.21.15.138:6814/2264053969","cluster_addr":"172.21.15.138:6821/2264053969","heartbeat_back_addr":"172.21.15.138:6830/2264053969","heartbeat_front_addr":"172.21.15.138:6826/2264053969","state":["exists","up"]},{"osd":5,"uuid":"b3d18c54-5a9a-4215-8b40-3e796ac2fed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6815","nonce":942955714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6819","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6822","nonce":942955714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6829","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6831","nonce":942955714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6827","nonce":942955714}]},"public_addr":"172.21.15.138:6815/942955714","cluster_addr":"172.21.15.138:6822/942955714","heartbeat_back_addr":"172.21.15.138:6831/942955714","heartbeat_front_addr":"172.21.15.138:6827/942955714","state":["exists","up"]},{"osd":6,"uuid":"12d21ba0-8670-470b-8fd5-a02349ecb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6809","nonce":889830629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6813","nonce":889830629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6823","nonce":889830629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6818","nonce":889830629}]},"public_addr":"172.21.15.138:6809/889830629","cluster_addr":"172.21.15.138:6813/889830629","heartbeat_back_addr":"172.21.15.138:6823/889830629","heartbeat_front_addr":"172.21.15.138:6818/889830629","state":["exists","up"]},{"osd":7,"uuid":"dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6801","nonce":2015291049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6803","nonce":2015291049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6807","nonce":2015291049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6805","nonce":2015291049}]},"public_addr":"172.21.15.138:6801/2015291049","cluster_addr":"172.21.15.138:6803/2015291049","heartbeat_back_addr":"172.21.15.138:6807/2015291049","heartbeat_front_addr":"172.21.15.138:6805/2015291049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.268101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.247572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.186485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.184532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.157242+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.126293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.118991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.213395+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.1a","osds":[6,2]}],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":1}]},{"pgid":"3.a","mappings":[{"from":4,"to":2}]},{"pgid":"3.f","mappings":[{"from":4,"to":2}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"6.1b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T13:34:35.245 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-04-24T13:34:35.245 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-04-24T13:34:35.245 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-04-24T13:34:35.246 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-04-24T13:34:35.246 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 flush_pg_stats 2024-04-24T13:34:35.247 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 flush_pg_stats 2024-04-24T13:34:35.247 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 flush_pg_stats 2024-04-24T13:34:35.248 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 flush_pg_stats 2024-04-24T13:34:35.488 INFO:teuthology.orchestra.run.smithi071.stdout:55834574907 2024-04-24T13:34:35.489 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T13:34:35.498 INFO:teuthology.orchestra.run.smithi071.stdout:55834574906 2024-04-24T13:34:35.498 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T13:34:35.523 INFO:teuthology.orchestra.run.smithi071.stdout:55834574906 2024-04-24T13:34:35.523 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-24T13:34:35.527 INFO:teuthology.orchestra.run.smithi071.stdout:55834574906 2024-04-24T13:34:35.527 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T13:34:35.529 INFO:teuthology.orchestra.run.smithi071.stdout:55834574905 2024-04-24T13:34:35.529 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-24T13:34:35.531 INFO:teuthology.orchestra.run.smithi071.stdout:55834574905 2024-04-24T13:34:35.532 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-24T13:34:35.534 INFO:teuthology.orchestra.run.smithi071.stdout:55834574905 2024-04-24T13:34:35.534 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T13:34:35.538 INFO:teuthology.orchestra.run.smithi071.stdout:55834574906 2024-04-24T13:34:35.539 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-24T13:34:36.021 INFO:teuthology.orchestra.run.smithi071.stdout:55834574905 2024-04-24T13:34:36.027 INFO:teuthology.orchestra.run.smithi071.stdout:55834574904 2024-04-24T13:34:36.038 INFO:teuthology.orchestra.run.smithi071.stdout:55834574906 2024-04-24T13:34:36.042 INFO:teuthology.orchestra.run.smithi071.stdout:55834574905 2024-04-24T13:34:36.046 INFO:teuthology.orchestra.run.smithi071.stdout:55834574905 2024-04-24T13:34:36.050 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574906 got 55834574905 for osd.2 2024-04-24T13:34:36.058 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574905 got 55834574904 for osd.6 2024-04-24T13:34:36.070 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574907 got 55834574906 for osd.1 2024-04-24T13:34:36.073 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574906 got 55834574905 for osd.0 2024-04-24T13:34:36.076 INFO:teuthology.orchestra.run.smithi071.stdout:55834574904 2024-04-24T13:34:36.077 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574906 got 55834574905 for osd.5 2024-04-24T13:34:36.088 INFO:teuthology.orchestra.run.smithi071.stdout:55834574904 2024-04-24T13:34:36.094 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574905 got 55834574904 for osd.7 2024-04-24T13:34:36.095 INFO:teuthology.orchestra.run.smithi071.stdout:55834574905 2024-04-24T13:34:36.107 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574905 got 55834574904 for osd.3 2024-04-24T13:34:36.113 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574906 got 55834574905 for osd.4 2024-04-24T13:34:37.051 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T13:34:37.059 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.6 2024-04-24T13:34:37.070 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-04-24T13:34:37.074 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-04-24T13:34:37.077 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.5 2024-04-24T13:34:37.095 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.7 2024-04-24T13:34:37.107 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-04-24T13:34:37.114 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.4 2024-04-24T13:34:37.557 INFO:teuthology.orchestra.run.smithi071.stdout:55834574905 2024-04-24T13:34:37.584 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574906 got 55834574905 for osd.2 2024-04-24T13:34:37.617 INFO:teuthology.orchestra.run.smithi071.stdout:55834574907 2024-04-24T13:34:37.639 INFO:teuthology.orchestra.run.smithi071.stdout:55834574905 2024-04-24T13:34:37.642 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574907 got 55834574907 for osd.1 2024-04-24T13:34:37.642 DEBUG:teuthology.parallel:result is None 2024-04-24T13:34:37.645 INFO:teuthology.orchestra.run.smithi071.stdout:55834574906 2024-04-24T13:34:37.659 INFO:teuthology.orchestra.run.smithi071.stdout:55834574905 2024-04-24T13:34:37.661 INFO:teuthology.orchestra.run.smithi071.stdout:55834574906 2024-04-24T13:34:37.666 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574906 got 55834574906 for osd.5 2024-04-24T13:34:37.667 DEBUG:teuthology.parallel:result is None 2024-04-24T13:34:37.670 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574905 got 55834574905 for osd.6 2024-04-24T13:34:37.670 DEBUG:teuthology.parallel:result is None 2024-04-24T13:34:37.679 INFO:teuthology.orchestra.run.smithi071.stdout:55834574906 2024-04-24T13:34:37.685 INFO:teuthology.orchestra.run.smithi071.stdout:55834574905 2024-04-24T13:34:37.688 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574905 got 55834574905 for osd.7 2024-04-24T13:34:37.688 DEBUG:teuthology.parallel:result is None 2024-04-24T13:34:37.689 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574906 got 55834574906 for osd.0 2024-04-24T13:34:37.690 DEBUG:teuthology.parallel:result is None 2024-04-24T13:34:37.700 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574906 got 55834574906 for osd.4 2024-04-24T13:34:37.700 DEBUG:teuthology.parallel:result is None 2024-04-24T13:34:37.704 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574905 got 55834574905 for osd.3 2024-04-24T13:34:37.704 DEBUG:teuthology.parallel:result is None 2024-04-24T13:34:38.585 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-04-24T13:34:38.880 INFO:teuthology.orchestra.run.smithi071.stdout:55834574906 2024-04-24T13:34:38.898 INFO:tasks.ceph.ceph_manager.ceph:need seq 55834574906 got 55834574906 for osd.2 2024-04-24T13:34:38.898 DEBUG:teuthology.parallel:result is None 2024-04-24T13:34:38.898 INFO:tasks.ceph.ceph_manager.ceph:waiting for recovery to complete 2024-04-24T13:34:38.899 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:34:39.218 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:34:39.224 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:34:39.239 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":278,"stamp":"2024-04-24T13:34:37.322842+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300815940,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3149,"num_read_kb":2838,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":669,"num_bytes_recovered":1850933776,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3902,"ondisk_log_size":3902,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12595036,"kb_used_data":12320608,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":742379684,"statfs":{"total":773094113280,"available":760196796416,"internally_reserved":0,"allocated":12616302592,"data_stored":12610302000,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":280874545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":14,"apply_latency_ms":14,"commit_latency_ns":14000000,"apply_latency_ns":14000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.767360"},"pg_stats":[{"pgid":"3.3f","version":"131'18","reported_seq":90,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.752853+0000","last_change":"2024-04-24T13:33:52.298396+0000","last_active":"2024-04-24T13:34:33.752853+0000","last_peered":"2024-04-24T13:34:33.752853+0000","last_clean":"2024-04-24T13:34:33.752853+0000","last_became_active":"2024-04-24T13:33:49.293106+0000","last_became_peered":"2024-04-24T13:33:49.293106+0000","last_unstale":"2024-04-24T13:34:33.752853+0000","last_undegraded":"2024-04-24T13:34:33.752853+0000","last_fullsized":"2024-04-24T13:34:33.752853+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:44.520756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"82'14","reported_seq":309,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594851+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:34:34.594851+0000","last_peered":"2024-04-24T13:34:34.594851+0000","last_clean":"2024-04-24T13:34:34.594851+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:34:34.594851+0000","last_undegraded":"2024-04-24T13:34:34.594851+0000","last_fullsized":"2024-04-24T13:34:34.594851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"132'18","reported_seq":283,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744069+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:34:33.744069+0000","last_peered":"2024-04-24T13:34:33.744069+0000","last_clean":"2024-04-24T13:34:33.744069+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:34:33.744069+0000","last_undegraded":"2024-04-24T13:34:33.744069+0000","last_fullsized":"2024-04-24T13:34:33.744069+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"82'4","reported_seq":61,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.749186+0000","last_change":"2024-04-24T13:33:52.687680+0000","last_active":"2024-04-24T13:34:33.749186+0000","last_peered":"2024-04-24T13:34:33.749186+0000","last_clean":"2024-04-24T13:34:33.749186+0000","last_became_active":"2024-04-24T13:33:49.293840+0000","last_became_peered":"2024-04-24T13:33:49.293840+0000","last_unstale":"2024-04-24T13:34:33.749186+0000","last_undegraded":"2024-04-24T13:34:33.749186+0000","last_fullsized":"2024-04-24T13:34:33.749186+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:13:31.744087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"131'17","reported_seq":281,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743489+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:34:33.743489+0000","last_peered":"2024-04-24T13:34:33.743489+0000","last_clean":"2024-04-24T13:34:33.743489+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:34:33.743489+0000","last_undegraded":"2024-04-24T13:34:33.743489+0000","last_fullsized":"2024-04-24T13:34:33.743489+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":27,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589257+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:34:34.589257+0000","last_peered":"2024-04-24T13:34:34.589257+0000","last_clean":"2024-04-24T13:34:34.589257+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:34:34.589257+0000","last_undegraded":"2024-04-24T13:34:34.589257+0000","last_fullsized":"2024-04-24T13:34:34.589257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"132'25","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594720+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:34:34.594720+0000","last_peered":"2024-04-24T13:34:34.594720+0000","last_clean":"2024-04-24T13:34:34.594720+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:34:34.594720+0000","last_undegraded":"2024-04-24T13:34:34.594720+0000","last_fullsized":"2024-04-24T13:34:34.594720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"132'6","reported_seq":284,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742898+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:34:33.742898+0000","last_peered":"2024-04-24T13:34:33.742898+0000","last_clean":"2024-04-24T13:34:33.742898+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:34:33.742898+0000","last_undegraded":"2024-04-24T13:34:33.742898+0000","last_fullsized":"2024-04-24T13:34:33.742898+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"132'34","reported_seq":115,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.751052+0000","last_change":"2024-04-24T13:33:53.650464+0000","last_active":"2024-04-24T13:34:33.751052+0000","last_peered":"2024-04-24T13:34:33.751052+0000","last_clean":"2024-04-24T13:34:33.751052+0000","last_became_active":"2024-04-24T13:33:49.299781+0000","last_became_peered":"2024-04-24T13:33:49.299781+0000","last_unstale":"2024-04-24T13:34:33.751052+0000","last_undegraded":"2024-04-24T13:34:33.751052+0000","last_fullsized":"2024-04-24T13:34:33.751052+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:08.408193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"82'2","reported_seq":265,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.748566+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:34:33.748566+0000","last_peered":"2024-04-24T13:34:33.748566+0000","last_clean":"2024-04-24T13:34:33.748566+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:34:33.748566+0000","last_undegraded":"2024-04-24T13:34:33.748566+0000","last_fullsized":"2024-04-24T13:34:33.748566+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"131'30","reported_seq":298,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593034+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:34:34.593034+0000","last_peered":"2024-04-24T13:34:34.593034+0000","last_clean":"2024-04-24T13:34:34.593034+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:34:34.593034+0000","last_undegraded":"2024-04-24T13:34:34.593034+0000","last_fullsized":"2024-04-24T13:34:34.593034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"82'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590410+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:34:34.590410+0000","last_peered":"2024-04-24T13:34:34.590410+0000","last_clean":"2024-04-24T13:34:34.590410+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:34:34.590410+0000","last_undegraded":"2024-04-24T13:34:34.590410+0000","last_fullsized":"2024-04-24T13:34:34.590410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"131'29","reported_seq":107,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.748426+0000","last_change":"2024-04-24T13:33:51.145800+0000","last_active":"2024-04-24T13:34:33.748426+0000","last_peered":"2024-04-24T13:34:33.748426+0000","last_clean":"2024-04-24T13:34:33.748426+0000","last_became_active":"2024-04-24T13:33:49.287926+0000","last_became_peered":"2024-04-24T13:33:49.287926+0000","last_unstale":"2024-04-24T13:34:33.748426+0000","last_undegraded":"2024-04-24T13:34:33.748426+0000","last_fullsized":"2024-04-24T13:34:33.748426+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:22.605125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"82'2","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595672+0000","last_change":"2024-04-24T13:33:09.792748+0000","last_active":"2024-04-24T13:34:34.595672+0000","last_peered":"2024-04-24T13:34:34.595672+0000","last_clean":"2024-04-24T13:34:34.595672+0000","last_became_active":"2024-04-24T13:33:08.725324+0000","last_became_peered":"2024-04-24T13:33:08.725324+0000","last_unstale":"2024-04-24T13:34:34.595672+0000","last_undegraded":"2024-04-24T13:34:34.595672+0000","last_fullsized":"2024-04-24T13:34:34.595672+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:20.696769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"131'18","reported_seq":300,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.583666+0000","last_change":"2024-04-24T13:33:08.836525+0000","last_active":"2024-04-24T13:34:33.583666+0000","last_peered":"2024-04-24T13:34:33.583666+0000","last_clean":"2024-04-24T13:34:33.583666+0000","last_became_active":"2024-04-24T13:33:08.720200+0000","last_became_peered":"2024-04-24T13:33:08.720200+0000","last_unstale":"2024-04-24T13:34:33.583666+0000","last_undegraded":"2024-04-24T13:34:33.583666+0000","last_fullsized":"2024-04-24T13:34:33.583666+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:31.093323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"82'6","reported_seq":283,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.701626+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:34:33.701626+0000","last_peered":"2024-04-24T13:34:33.701626+0000","last_clean":"2024-04-24T13:34:33.701626+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:34:33.701626+0000","last_undegraded":"2024-04-24T13:34:33.701626+0000","last_fullsized":"2024-04-24T13:34:33.701626+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"86'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588496+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:34:34.588496+0000","last_peered":"2024-04-24T13:34:34.588496+0000","last_clean":"2024-04-24T13:34:34.588496+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:34:34.588496+0000","last_undegraded":"2024-04-24T13:34:34.588496+0000","last_fullsized":"2024-04-24T13:34:34.588496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"131'24","reported_seq":99,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.753440+0000","last_change":"2024-04-24T13:33:51.801208+0000","last_active":"2024-04-24T13:34:33.753440+0000","last_peered":"2024-04-24T13:34:33.753440+0000","last_clean":"2024-04-24T13:34:33.753440+0000","last_became_active":"2024-04-24T13:33:49.287950+0000","last_became_peered":"2024-04-24T13:33:49.287950+0000","last_unstale":"2024-04-24T13:34:33.753440+0000","last_undegraded":"2024-04-24T13:34:33.753440+0000","last_fullsized":"2024-04-24T13:34:33.753440+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:09.811184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"82'4","reported_seq":61,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.749528+0000","last_change":"2024-04-24T13:33:53.106900+0000","last_active":"2024-04-24T13:34:33.749528+0000","last_peered":"2024-04-24T13:34:33.749528+0000","last_clean":"2024-04-24T13:34:33.749528+0000","last_became_active":"2024-04-24T13:33:49.294597+0000","last_became_peered":"2024-04-24T13:33:49.294597+0000","last_unstale":"2024-04-24T13:34:33.749528+0000","last_undegraded":"2024-04-24T13:34:33.749528+0000","last_fullsized":"2024-04-24T13:34:33.749528+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:28.384262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"131'28","reported_seq":317,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.748428+0000","last_change":"2024-04-24T13:33:08.998015+0000","last_active":"2024-04-24T13:34:33.748428+0000","last_peered":"2024-04-24T13:34:33.748428+0000","last_clean":"2024-04-24T13:34:33.748428+0000","last_became_active":"2024-04-24T13:33:08.726581+0000","last_became_peered":"2024-04-24T13:33:08.726581+0000","last_unstale":"2024-04-24T13:34:33.748428+0000","last_undegraded":"2024-04-24T13:34:33.748428+0000","last_fullsized":"2024-04-24T13:34:33.748428+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:03:25.814262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"86'6","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592134+0000","last_change":"2024-04-24T13:33:09.293808+0000","last_active":"2024-04-24T13:34:34.592134+0000","last_peered":"2024-04-24T13:34:34.592134+0000","last_clean":"2024-04-24T13:34:34.592134+0000","last_became_active":"2024-04-24T13:33:08.719391+0000","last_became_peered":"2024-04-24T13:33:08.719391+0000","last_unstale":"2024-04-24T13:34:34.592134+0000","last_undegraded":"2024-04-24T13:34:34.592134+0000","last_fullsized":"2024-04-24T13:34:34.592134+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:10.422756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"132'22","reported_seq":304,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.747219+0000","last_change":"2024-04-24T13:33:09.199641+0000","last_active":"2024-04-24T13:34:33.747219+0000","last_peered":"2024-04-24T13:34:33.747219+0000","last_clean":"2024-04-24T13:34:33.747219+0000","last_became_active":"2024-04-24T13:33:08.737789+0000","last_became_peered":"2024-04-24T13:33:08.737789+0000","last_unstale":"2024-04-24T13:34:33.747219+0000","last_undegraded":"2024-04-24T13:34:33.747219+0000","last_fullsized":"2024-04-24T13:34:33.747219+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:41.648006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":257,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.701231+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:34:33.701231+0000","last_peered":"2024-04-24T13:34:33.701231+0000","last_clean":"2024-04-24T13:34:33.701231+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:34:33.701231+0000","last_undegraded":"2024-04-24T13:34:33.701231+0000","last_fullsized":"2024-04-24T13:34:33.701231+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"132'24","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590031+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:34:34.590031+0000","last_peered":"2024-04-24T13:34:34.590031+0000","last_clean":"2024-04-24T13:34:34.590031+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:34:34.590031+0000","last_undegraded":"2024-04-24T13:34:34.590031+0000","last_fullsized":"2024-04-24T13:34:34.590031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"132'6","reported_seq":283,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.702253+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:34:33.702253+0000","last_peered":"2024-04-24T13:34:33.702253+0000","last_clean":"2024-04-24T13:34:33.702253+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:34:33.702253+0000","last_undegraded":"2024-04-24T13:34:33.702253+0000","last_fullsized":"2024-04-24T13:34:33.702253+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"131'23","reported_seq":287,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.584775+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:34:33.584775+0000","last_peered":"2024-04-24T13:34:33.584775+0000","last_clean":"2024-04-24T13:34:33.584775+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:34:33.584775+0000","last_undegraded":"2024-04-24T13:34:33.584775+0000","last_fullsized":"2024-04-24T13:34:33.584775+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590560+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:34:34.590560+0000","last_peered":"2024-04-24T13:34:34.590560+0000","last_clean":"2024-04-24T13:34:34.590560+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:34:34.590560+0000","last_undegraded":"2024-04-24T13:34:34.590560+0000","last_fullsized":"2024-04-24T13:34:34.590560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"132'25","reported_seq":287,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743265+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:34:33.743265+0000","last_peered":"2024-04-24T13:34:33.743265+0000","last_clean":"2024-04-24T13:34:33.743265+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:34:33.743265+0000","last_undegraded":"2024-04-24T13:34:33.743265+0000","last_fullsized":"2024-04-24T13:34:33.743265+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587703+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:34:34.587703+0000","last_peered":"2024-04-24T13:34:34.587703+0000","last_clean":"2024-04-24T13:34:34.587703+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:34:34.587703+0000","last_undegraded":"2024-04-24T13:34:34.587703+0000","last_fullsized":"2024-04-24T13:34:34.587703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"82'2","reported_seq":269,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.585980+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:34:33.585980+0000","last_peered":"2024-04-24T13:34:33.585980+0000","last_clean":"2024-04-24T13:34:33.585980+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:34:33.585980+0000","last_undegraded":"2024-04-24T13:34:33.585980+0000","last_fullsized":"2024-04-24T13:34:33.585980+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"132'27","reported_seq":103,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.750675+0000","last_change":"2024-04-24T13:33:49.775824+0000","last_active":"2024-04-24T13:34:33.750675+0000","last_peered":"2024-04-24T13:34:33.750675+0000","last_clean":"2024-04-24T13:34:33.750675+0000","last_became_active":"2024-04-24T13:33:49.282849+0000","last_became_peered":"2024-04-24T13:33:49.282849+0000","last_unstale":"2024-04-24T13:34:33.750675+0000","last_undegraded":"2024-04-24T13:34:33.750675+0000","last_fullsized":"2024-04-24T13:34:33.750675+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:12:15.350559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595154+0000","last_change":"2024-04-24T13:33:10.797093+0000","last_active":"2024-04-24T13:34:34.595154+0000","last_peered":"2024-04-24T13:34:34.595154+0000","last_clean":"2024-04-24T13:34:34.595154+0000","last_became_active":"2024-04-24T13:33:08.736087+0000","last_became_peered":"2024-04-24T13:33:08.736087+0000","last_unstale":"2024-04-24T13:34:34.595154+0000","last_undegraded":"2024-04-24T13:34:34.595154+0000","last_fullsized":"2024-04-24T13:34:34.595154+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:49:31.056251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"132'17","reported_seq":304,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743647+0000","last_change":"2024-04-24T13:33:51.608371+0000","last_active":"2024-04-24T13:34:33.743647+0000","last_peered":"2024-04-24T13:34:33.743647+0000","last_clean":"2024-04-24T13:34:33.743647+0000","last_became_active":"2024-04-24T13:33:49.295172+0000","last_became_peered":"2024-04-24T13:33:49.295172+0000","last_unstale":"2024-04-24T13:34:33.743647+0000","last_undegraded":"2024-04-24T13:34:33.743647+0000","last_fullsized":"2024-04-24T13:34:33.743647+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:46:40.352367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":55,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.753438+0000","last_change":"2024-04-24T13:33:49.295489+0000","last_active":"2024-04-24T13:34:33.753438+0000","last_peered":"2024-04-24T13:34:33.753438+0000","last_clean":"2024-04-24T13:34:33.753438+0000","last_became_active":"2024-04-24T13:33:49.292611+0000","last_became_peered":"2024-04-24T13:33:49.292611+0000","last_unstale":"2024-04-24T13:34:33.753438+0000","last_undegraded":"2024-04-24T13:34:33.753438+0000","last_fullsized":"2024-04-24T13:34:33.753438+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:52:22.537619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"132'48","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592278+0000","last_change":"2024-04-24T13:33:08.911162+0000","last_active":"2024-04-24T13:34:34.592278+0000","last_peered":"2024-04-24T13:34:34.592278+0000","last_clean":"2024-04-24T13:34:34.592278+0000","last_became_active":"2024-04-24T13:33:08.709158+0000","last_became_peered":"2024-04-24T13:33:08.709158+0000","last_unstale":"2024-04-24T13:34:34.592278+0000","last_undegraded":"2024-04-24T13:34:34.592278+0000","last_fullsized":"2024-04-24T13:34:34.592278+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:56.162767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"82'4","reported_seq":119,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595727+0000","last_change":"2024-04-24T13:33:53.234461+0000","last_active":"2024-04-24T13:34:34.595727+0000","last_peered":"2024-04-24T13:34:34.595727+0000","last_clean":"2024-04-24T13:34:34.595727+0000","last_became_active":"2024-04-24T13:33:49.302172+0000","last_became_peered":"2024-04-24T13:33:49.302172+0000","last_unstale":"2024-04-24T13:34:34.595727+0000","last_undegraded":"2024-04-24T13:34:34.595727+0000","last_fullsized":"2024-04-24T13:34:34.595727+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:55:38.136746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"131'19","reported_seq":321,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744181+0000","last_change":"2024-04-24T13:33:49.666596+0000","last_active":"2024-04-24T13:34:33.744181+0000","last_peered":"2024-04-24T13:34:33.744181+0000","last_clean":"2024-04-24T13:34:33.744181+0000","last_became_active":"2024-04-24T13:33:49.283461+0000","last_became_peered":"2024-04-24T13:33:49.283461+0000","last_unstale":"2024-04-24T13:34:33.744181+0000","last_undegraded":"2024-04-24T13:34:33.744181+0000","last_fullsized":"2024-04-24T13:34:33.744181+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:49:27.034645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":266,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.586689+0000","last_change":"2024-04-24T13:33:49.301406+0000","last_active":"2024-04-24T13:34:33.586689+0000","last_peered":"2024-04-24T13:34:33.586689+0000","last_clean":"2024-04-24T13:34:33.586689+0000","last_became_active":"2024-04-24T13:33:49.300648+0000","last_became_peered":"2024-04-24T13:33:49.300648+0000","last_unstale":"2024-04-24T13:34:33.586689+0000","last_undegraded":"2024-04-24T13:34:33.586689+0000","last_fullsized":"2024-04-24T13:34:33.586689+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:41:13.998419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590838+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:34:34.590838+0000","last_peered":"2024-04-24T13:34:34.590838+0000","last_clean":"2024-04-24T13:34:34.590838+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:34:34.590838+0000","last_undegraded":"2024-04-24T13:34:34.590838+0000","last_fullsized":"2024-04-24T13:34:34.590838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590524+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:34:34.590524+0000","last_peered":"2024-04-24T13:34:34.590524+0000","last_clean":"2024-04-24T13:34:34.590524+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:34:34.590524+0000","last_undegraded":"2024-04-24T13:34:34.590524+0000","last_fullsized":"2024-04-24T13:34:34.590524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":242,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743013+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:34:33.743013+0000","last_peered":"2024-04-24T13:34:33.743013+0000","last_clean":"2024-04-24T13:34:33.743013+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:34:33.743013+0000","last_undegraded":"2024-04-24T13:34:33.743013+0000","last_fullsized":"2024-04-24T13:34:33.743013+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"86'10","reported_seq":289,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743059+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:34:33.743059+0000","last_peered":"2024-04-24T13:34:33.743059+0000","last_clean":"2024-04-24T13:34:33.743059+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:34:33.743059+0000","last_undegraded":"2024-04-24T13:34:33.743059+0000","last_fullsized":"2024-04-24T13:34:33.743059+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"132'24","reported_seq":100,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.748148+0000","last_change":"2024-04-24T13:33:50.330934+0000","last_active":"2024-04-24T13:34:33.748148+0000","last_peered":"2024-04-24T13:34:33.748148+0000","last_clean":"2024-04-24T13:34:33.748148+0000","last_became_active":"2024-04-24T13:33:49.286157+0000","last_became_peered":"2024-04-24T13:33:49.286157+0000","last_unstale":"2024-04-24T13:34:33.748148+0000","last_undegraded":"2024-04-24T13:34:33.748148+0000","last_fullsized":"2024-04-24T13:34:33.748148+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:10.162075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":256,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.588141+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:34:33.588141+0000","last_peered":"2024-04-24T13:34:33.588141+0000","last_clean":"2024-04-24T13:34:33.588141+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:34:33.588141+0000","last_undegraded":"2024-04-24T13:34:33.588141+0000","last_fullsized":"2024-04-24T13:34:33.588141+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":264,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.701552+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:34:33.701552+0000","last_peered":"2024-04-24T13:34:33.701552+0000","last_clean":"2024-04-24T13:34:33.701552+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:34:33.701552+0000","last_undegraded":"2024-04-24T13:34:33.701552+0000","last_fullsized":"2024-04-24T13:34:33.701552+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"132'138","reported_seq":422,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.753247+0000","last_change":"2024-04-24T13:33:52.550604+0000","last_active":"2024-04-24T13:34:33.753247+0000","last_peered":"2024-04-24T13:34:33.753247+0000","last_clean":"2024-04-24T13:34:33.753247+0000","last_became_active":"2024-04-24T13:33:52.550123+0000","last_became_peered":"2024-04-24T13:33:52.550123+0000","last_unstale":"2024-04-24T13:34:33.753247+0000","last_undegraded":"2024-04-24T13:34:33.753247+0000","last_fullsized":"2024-04-24T13:34:33.753247+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:09:41.226875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"105'8","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588558+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:34:34.588558+0000","last_peered":"2024-04-24T13:34:34.588558+0000","last_clean":"2024-04-24T13:34:34.588558+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:34:34.588558+0000","last_undegraded":"2024-04-24T13:34:34.588558+0000","last_fullsized":"2024-04-24T13:34:34.588558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"132'4","reported_seq":291,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.586887+0000","last_change":"2024-04-24T13:33:51.170660+0000","last_active":"2024-04-24T13:34:33.586887+0000","last_peered":"2024-04-24T13:34:33.586887+0000","last_clean":"2024-04-24T13:34:33.586887+0000","last_became_active":"2024-04-24T13:33:49.301591+0000","last_became_peered":"2024-04-24T13:33:49.301591+0000","last_unstale":"2024-04-24T13:34:33.586887+0000","last_undegraded":"2024-04-24T13:34:33.586887+0000","last_fullsized":"2024-04-24T13:34:33.586887+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:16:26.080736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"132'27","reported_seq":287,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.746039+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:34:33.746039+0000","last_peered":"2024-04-24T13:34:33.746039+0000","last_clean":"2024-04-24T13:34:33.746039+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:34:33.746039+0000","last_undegraded":"2024-04-24T13:34:33.746039+0000","last_fullsized":"2024-04-24T13:34:33.746039+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595591+0000","last_change":"2024-04-24T13:33:08.718010+0000","last_active":"2024-04-24T13:34:34.595591+0000","last_peered":"2024-04-24T13:34:34.595591+0000","last_clean":"2024-04-24T13:34:34.595591+0000","last_became_active":"2024-04-24T13:33:08.716072+0000","last_became_peered":"2024-04-24T13:33:08.716072+0000","last_unstale":"2024-04-24T13:34:34.595591+0000","last_undegraded":"2024-04-24T13:34:34.595591+0000","last_fullsized":"2024-04-24T13:34:34.595591+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:26.626730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"132'17","reported_seq":66,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.751922+0000","last_change":"2024-04-24T13:33:52.725009+0000","last_active":"2024-04-24T13:34:33.751922+0000","last_peered":"2024-04-24T13:34:33.751922+0000","last_clean":"2024-04-24T13:34:33.751922+0000","last_became_active":"2024-04-24T13:33:49.294133+0000","last_became_peered":"2024-04-24T13:33:49.294133+0000","last_unstale":"2024-04-24T13:34:33.751922+0000","last_undegraded":"2024-04-24T13:34:33.751922+0000","last_fullsized":"2024-04-24T13:34:33.751922+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:51.462917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"132'134","reported_seq":461,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.585177+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:34:33.585177+0000","last_peered":"2024-04-24T13:34:33.585177+0000","last_clean":"2024-04-24T13:34:33.585177+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:34:33.585177+0000","last_undegraded":"2024-04-24T13:34:33.585177+0000","last_fullsized":"2024-04-24T13:34:33.585177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"82'2","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594248+0000","last_change":"2024-04-24T13:33:49.308248+0000","last_active":"2024-04-24T13:34:34.594248+0000","last_peered":"2024-04-24T13:34:34.594248+0000","last_clean":"2024-04-24T13:34:34.594248+0000","last_became_active":"2024-04-24T13:33:49.278105+0000","last_became_peered":"2024-04-24T13:33:49.278105+0000","last_unstale":"2024-04-24T13:34:34.594248+0000","last_undegraded":"2024-04-24T13:34:34.594248+0000","last_fullsized":"2024-04-24T13:34:34.594248+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:20.068883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"132'25","reported_seq":95,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.752853+0000","last_change":"2024-04-24T13:33:53.103595+0000","last_active":"2024-04-24T13:34:33.752853+0000","last_peered":"2024-04-24T13:34:33.752853+0000","last_clean":"2024-04-24T13:34:33.752853+0000","last_became_active":"2024-04-24T13:33:49.297787+0000","last_became_peered":"2024-04-24T13:33:49.297787+0000","last_unstale":"2024-04-24T13:34:33.752853+0000","last_undegraded":"2024-04-24T13:34:33.752853+0000","last_fullsized":"2024-04-24T13:34:33.752853+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":55,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.748520+0000","last_change":"2024-04-24T13:33:49.299431+0000","last_active":"2024-04-24T13:34:33.748520+0000","last_peered":"2024-04-24T13:34:33.748520+0000","last_clean":"2024-04-24T13:34:33.748520+0000","last_became_active":"2024-04-24T13:33:49.294593+0000","last_became_peered":"2024-04-24T13:33:49.294593+0000","last_unstale":"2024-04-24T13:34:33.748520+0000","last_undegraded":"2024-04-24T13:34:33.748520+0000","last_fullsized":"2024-04-24T13:34:33.748520+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:36.135388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"132'28","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592767+0000","last_change":"2024-04-24T13:33:10.421787+0000","last_active":"2024-04-24T13:34:34.592767+0000","last_peered":"2024-04-24T13:34:34.592767+0000","last_clean":"2024-04-24T13:34:34.592767+0000","last_became_active":"2024-04-24T13:33:08.733302+0000","last_became_peered":"2024-04-24T13:33:08.733302+0000","last_unstale":"2024-04-24T13:34:34.592767+0000","last_undegraded":"2024-04-24T13:34:34.592767+0000","last_fullsized":"2024-04-24T13:34:34.592767+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:10:16.339117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":258,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744173+0000","last_change":"2024-04-24T13:33:08.727357+0000","last_active":"2024-04-24T13:34:33.744173+0000","last_peered":"2024-04-24T13:34:33.744173+0000","last_clean":"2024-04-24T13:34:33.744173+0000","last_became_active":"2024-04-24T13:33:08.726787+0000","last_became_peered":"2024-04-24T13:33:08.726787+0000","last_unstale":"2024-04-24T13:34:33.744173+0000","last_undegraded":"2024-04-24T13:34:33.744173+0000","last_fullsized":"2024-04-24T13:34:33.744173+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:49.701435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"86'7","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594598+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:34:34.594598+0000","last_peered":"2024-04-24T13:34:34.594598+0000","last_clean":"2024-04-24T13:34:34.594598+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:34:34.594598+0000","last_undegraded":"2024-04-24T13:34:34.594598+0000","last_fullsized":"2024-04-24T13:34:34.594598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"132'4","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588631+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:34:34.588631+0000","last_peered":"2024-04-24T13:34:34.588631+0000","last_clean":"2024-04-24T13:34:34.588631+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:34:34.588631+0000","last_undegraded":"2024-04-24T13:34:34.588631+0000","last_fullsized":"2024-04-24T13:34:34.588631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"132'17","reported_seq":84,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.752656+0000","last_change":"2024-04-24T13:33:50.539289+0000","last_active":"2024-04-24T13:34:33.752656+0000","last_peered":"2024-04-24T13:34:33.752656+0000","last_clean":"2024-04-24T13:34:33.752656+0000","last_became_active":"2024-04-24T13:33:49.284576+0000","last_became_peered":"2024-04-24T13:33:49.284576+0000","last_unstale":"2024-04-24T13:34:33.752656+0000","last_undegraded":"2024-04-24T13:34:33.752656+0000","last_fullsized":"2024-04-24T13:34:33.752656+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:20.287647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":253,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.699385+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:34:33.699385+0000","last_peered":"2024-04-24T13:34:33.699385+0000","last_clean":"2024-04-24T13:34:33.699385+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:34:33.699385+0000","last_undegraded":"2024-04-24T13:34:33.699385+0000","last_fullsized":"2024-04-24T13:34:33.699385+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"132'18","reported_seq":307,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.586802+0000","last_change":"2024-04-24T13:33:52.751477+0000","last_active":"2024-04-24T13:34:33.586802+0000","last_peered":"2024-04-24T13:34:33.586802+0000","last_clean":"2024-04-24T13:34:33.586802+0000","last_became_active":"2024-04-24T13:33:49.308018+0000","last_became_peered":"2024-04-24T13:33:49.308018+0000","last_unstale":"2024-04-24T13:34:33.586802+0000","last_undegraded":"2024-04-24T13:34:33.586802+0000","last_fullsized":"2024-04-24T13:34:33.586802+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:29:49.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":248,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.585240+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:34:33.585240+0000","last_peered":"2024-04-24T13:34:33.585240+0000","last_clean":"2024-04-24T13:34:33.585240+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:34:33.585240+0000","last_undegraded":"2024-04-24T13:34:33.585240+0000","last_fullsized":"2024-04-24T13:34:33.585240+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":240,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.746104+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:34:33.746104+0000","last_peered":"2024-04-24T13:34:33.746104+0000","last_clean":"2024-04-24T13:34:33.746104+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:34:33.746104+0000","last_undegraded":"2024-04-24T13:34:33.746104+0000","last_fullsized":"2024-04-24T13:34:33.746104+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"82'4","reported_seq":279,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.745612+0000","last_change":"2024-04-24T13:32:01.548738+0000","last_active":"2024-04-24T13:34:33.745612+0000","last_peered":"2024-04-24T13:34:33.745612+0000","last_clean":"2024-04-24T13:34:33.745612+0000","last_became_active":"2024-04-24T13:32:01.548259+0000","last_became_peered":"2024-04-24T13:32:01.548259+0000","last_unstale":"2024-04-24T13:34:33.745612+0000","last_undegraded":"2024-04-24T13:34:33.745612+0000","last_fullsized":"2024-04-24T13:34:33.745612+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"131'26","reported_seq":100,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.751832+0000","last_change":"2024-04-24T13:33:52.683024+0000","last_active":"2024-04-24T13:34:33.751832+0000","last_peered":"2024-04-24T13:34:33.751832+0000","last_clean":"2024-04-24T13:34:33.751832+0000","last_became_active":"2024-04-24T13:33:49.293373+0000","last_became_peered":"2024-04-24T13:33:49.293373+0000","last_unstale":"2024-04-24T13:34:33.751832+0000","last_undegraded":"2024-04-24T13:34:33.751832+0000","last_fullsized":"2024-04-24T13:34:33.751832+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:05:00.168247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":253,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.699465+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:34:33.699465+0000","last_peered":"2024-04-24T13:34:33.699465+0000","last_clean":"2024-04-24T13:34:33.699465+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:34:33.699465+0000","last_undegraded":"2024-04-24T13:34:33.699465+0000","last_fullsized":"2024-04-24T13:34:33.699465+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"132'23","reported_seq":72,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.747250+0000","last_change":"2024-04-24T13:33:53.666421+0000","last_active":"2024-04-24T13:34:33.747250+0000","last_peered":"2024-04-24T13:34:33.747250+0000","last_clean":"2024-04-24T13:34:33.747250+0000","last_became_active":"2024-04-24T13:33:49.302140+0000","last_became_peered":"2024-04-24T13:33:49.302140+0000","last_unstale":"2024-04-24T13:34:33.747250+0000","last_undegraded":"2024-04-24T13:34:33.747250+0000","last_fullsized":"2024-04-24T13:34:33.747250+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.223797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"132'134","reported_seq":510,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742306+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:34:33.742306+0000","last_peered":"2024-04-24T13:34:33.742306+0000","last_clean":"2024-04-24T13:34:33.742306+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:34:33.742306+0000","last_undegraded":"2024-04-24T13:34:33.742306+0000","last_fullsized":"2024-04-24T13:34:33.742306+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"82'3","reported_seq":246,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743608+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:34:33.743608+0000","last_peered":"2024-04-24T13:34:33.743608+0000","last_clean":"2024-04-24T13:34:33.743608+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:34:33.743608+0000","last_undegraded":"2024-04-24T13:34:33.743608+0000","last_fullsized":"2024-04-24T13:34:33.743608+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"132'10","reported_seq":300,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744235+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:34:33.744235+0000","last_peered":"2024-04-24T13:34:33.744235+0000","last_clean":"2024-04-24T13:34:33.744235+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:34:33.744235+0000","last_undegraded":"2024-04-24T13:34:33.744235+0000","last_fullsized":"2024-04-24T13:34:33.744235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"131'23","reported_seq":135,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594898+0000","last_change":"2024-04-24T13:33:10.787412+0000","last_active":"2024-04-24T13:34:34.594898+0000","last_peered":"2024-04-24T13:34:34.594898+0000","last_clean":"2024-04-24T13:34:34.594898+0000","last_became_active":"2024-04-24T13:33:08.718332+0000","last_became_peered":"2024-04-24T13:33:08.718332+0000","last_unstale":"2024-04-24T13:34:34.594898+0000","last_undegraded":"2024-04-24T13:34:34.594898+0000","last_fullsized":"2024-04-24T13:34:34.594898+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:11.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":253,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.700593+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:34:33.700593+0000","last_peered":"2024-04-24T13:34:33.700593+0000","last_clean":"2024-04-24T13:34:33.700593+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:34:33.700593+0000","last_undegraded":"2024-04-24T13:34:33.700593+0000","last_fullsized":"2024-04-24T13:34:33.700593+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"132'28","reported_seq":323,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742596+0000","last_change":"2024-04-24T13:33:51.156026+0000","last_active":"2024-04-24T13:34:33.742596+0000","last_peered":"2024-04-24T13:34:33.742596+0000","last_clean":"2024-04-24T13:34:33.742596+0000","last_became_active":"2024-04-24T13:33:49.292150+0000","last_became_peered":"2024-04-24T13:33:49.292150+0000","last_unstale":"2024-04-24T13:34:33.742596+0000","last_undegraded":"2024-04-24T13:34:33.742596+0000","last_fullsized":"2024-04-24T13:34:33.742596+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:42.853378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":255,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.699864+0000","last_change":"2024-04-24T13:33:49.306397+0000","last_active":"2024-04-24T13:34:33.699864+0000","last_peered":"2024-04-24T13:34:33.699864+0000","last_clean":"2024-04-24T13:34:33.699864+0000","last_became_active":"2024-04-24T13:33:49.305572+0000","last_became_peered":"2024-04-24T13:33:49.305572+0000","last_unstale":"2024-04-24T13:34:33.699864+0000","last_undegraded":"2024-04-24T13:34:33.699864+0000","last_fullsized":"2024-04-24T13:34:33.699864+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:48.247418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"126'11","reported_seq":284,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744238+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:34:33.744238+0000","last_peered":"2024-04-24T13:34:33.744238+0000","last_clean":"2024-04-24T13:34:33.744238+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:34:33.744238+0000","last_undegraded":"2024-04-24T13:34:33.744238+0000","last_fullsized":"2024-04-24T13:34:33.744238+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"132'8","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590413+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:34:34.590413+0000","last_peered":"2024-04-24T13:34:34.590413+0000","last_clean":"2024-04-24T13:34:34.590413+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:34:34.590413+0000","last_undegraded":"2024-04-24T13:34:34.590413+0000","last_fullsized":"2024-04-24T13:34:34.590413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"132'29","reported_seq":293,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.584452+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:34:33.584452+0000","last_peered":"2024-04-24T13:34:33.584452+0000","last_clean":"2024-04-24T13:34:33.584452+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:34:33.584452+0000","last_undegraded":"2024-04-24T13:34:33.584452+0000","last_fullsized":"2024-04-24T13:34:33.584452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":273,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.700981+0000","last_change":"2024-04-24T13:33:49.300767+0000","last_active":"2024-04-24T13:34:33.700981+0000","last_peered":"2024-04-24T13:34:33.700981+0000","last_clean":"2024-04-24T13:34:33.700981+0000","last_became_active":"2024-04-24T13:33:49.300030+0000","last_became_peered":"2024-04-24T13:33:49.300030+0000","last_unstale":"2024-04-24T13:34:33.700981+0000","last_undegraded":"2024-04-24T13:34:33.700981+0000","last_fullsized":"2024-04-24T13:34:33.700981+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:28.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"132'19","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590813+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:34:34.590813+0000","last_peered":"2024-04-24T13:34:34.590813+0000","last_clean":"2024-04-24T13:34:34.590813+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:34:34.590813+0000","last_undegraded":"2024-04-24T13:34:34.590813+0000","last_fullsized":"2024-04-24T13:34:34.590813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":246,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743595+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:34:33.743595+0000","last_peered":"2024-04-24T13:34:33.743595+0000","last_clean":"2024-04-24T13:34:33.743595+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:34:33.743595+0000","last_undegraded":"2024-04-24T13:34:33.743595+0000","last_fullsized":"2024-04-24T13:34:33.743595+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":255,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.584767+0000","last_change":"2024-04-24T13:33:08.720576+0000","last_active":"2024-04-24T13:34:33.584767+0000","last_peered":"2024-04-24T13:34:33.584767+0000","last_clean":"2024-04-24T13:34:33.584767+0000","last_became_active":"2024-04-24T13:33:08.720133+0000","last_became_peered":"2024-04-24T13:33:08.720133+0000","last_unstale":"2024-04-24T13:34:33.584767+0000","last_undegraded":"2024-04-24T13:34:33.584767+0000","last_fullsized":"2024-04-24T13:34:33.584767+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:16.254173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590861+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:34:34.590861+0000","last_peered":"2024-04-24T13:34:34.590861+0000","last_clean":"2024-04-24T13:34:34.590861+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:34:34.590861+0000","last_undegraded":"2024-04-24T13:34:34.590861+0000","last_fullsized":"2024-04-24T13:34:34.590861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"131'33","reported_seq":298,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.746647+0000","last_change":"2024-04-24T13:31:00.986244+0000","last_active":"2024-04-24T13:34:33.746647+0000","last_peered":"2024-04-24T13:34:33.746647+0000","last_clean":"2024-04-24T13:34:33.746647+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:34:33.746647+0000","last_undegraded":"2024-04-24T13:34:33.746647+0000","last_fullsized":"2024-04-24T13:34:33.746647+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:23.355231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":256,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742777+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:34:33.742777+0000","last_peered":"2024-04-24T13:34:33.742777+0000","last_clean":"2024-04-24T13:34:33.742777+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:34:33.742777+0000","last_undegraded":"2024-04-24T13:34:33.742777+0000","last_fullsized":"2024-04-24T13:34:33.742777+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"132'25","reported_seq":284,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.701693+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:34:33.701693+0000","last_peered":"2024-04-24T13:34:33.701693+0000","last_clean":"2024-04-24T13:34:33.701693+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:34:33.701693+0000","last_undegraded":"2024-04-24T13:34:33.701693+0000","last_fullsized":"2024-04-24T13:34:33.701693+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"132'138","reported_seq":466,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.702803+0000","last_change":"2024-04-24T13:33:11.710852+0000","last_active":"2024-04-24T13:34:33.702803+0000","last_peered":"2024-04-24T13:34:33.702803+0000","last_clean":"2024-04-24T13:34:33.702803+0000","last_became_active":"2024-04-24T13:33:11.709412+0000","last_became_peered":"2024-04-24T13:33:11.709412+0000","last_unstale":"2024-04-24T13:34:33.702803+0000","last_undegraded":"2024-04-24T13:34:33.702803+0000","last_fullsized":"2024-04-24T13:34:33.702803+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:22:40.670445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":244,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743446+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:34:33.743446+0000","last_peered":"2024-04-24T13:34:33.743446+0000","last_clean":"2024-04-24T13:34:33.743446+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:34:33.743446+0000","last_undegraded":"2024-04-24T13:34:33.743446+0000","last_fullsized":"2024-04-24T13:34:33.743446+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"114'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591312+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:34:34.591312+0000","last_peered":"2024-04-24T13:34:34.591312+0000","last_clean":"2024-04-24T13:34:34.591312+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:34:34.591312+0000","last_undegraded":"2024-04-24T13:34:34.591312+0000","last_fullsized":"2024-04-24T13:34:34.591312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"132'26","reported_seq":290,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587899+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:34:34.587899+0000","last_peered":"2024-04-24T13:34:34.587899+0000","last_clean":"2024-04-24T13:34:34.587899+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:34:34.587899+0000","last_undegraded":"2024-04-24T13:34:34.587899+0000","last_fullsized":"2024-04-24T13:34:34.587899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":148,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595952+0000","last_change":"2024-04-24T13:33:09.912410+0000","last_active":"2024-04-24T13:34:34.595952+0000","last_peered":"2024-04-24T13:34:34.595952+0000","last_clean":"2024-04-24T13:34:34.595952+0000","last_became_active":"2024-04-24T13:33:08.724858+0000","last_became_peered":"2024-04-24T13:33:08.724858+0000","last_unstale":"2024-04-24T13:34:34.595952+0000","last_undegraded":"2024-04-24T13:34:34.595952+0000","last_fullsized":"2024-04-24T13:34:34.595952+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:26.760043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":176,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"82'11","reported_seq":268,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.585152+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:34:33.585152+0000","last_peered":"2024-04-24T13:34:33.585152+0000","last_clean":"2024-04-24T13:34:33.585152+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:34:33.585152+0000","last_undegraded":"2024-04-24T13:34:33.585152+0000","last_fullsized":"2024-04-24T13:34:33.585152+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"132'134","reported_seq":475,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.746389+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:34:33.746389+0000","last_peered":"2024-04-24T13:34:33.746389+0000","last_clean":"2024-04-24T13:34:33.746389+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:34:33.746389+0000","last_undegraded":"2024-04-24T13:34:33.746389+0000","last_fullsized":"2024-04-24T13:34:33.746389+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"132'4","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588993+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:34:34.588993+0000","last_peered":"2024-04-24T13:34:34.588993+0000","last_clean":"2024-04-24T13:34:34.588993+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:34:34.588993+0000","last_undegraded":"2024-04-24T13:34:34.588993+0000","last_fullsized":"2024-04-24T13:34:34.588993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"86'4","reported_seq":278,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744440+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:34:33.744440+0000","last_peered":"2024-04-24T13:34:33.744440+0000","last_clean":"2024-04-24T13:34:33.744440+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:34:33.744440+0000","last_undegraded":"2024-04-24T13:34:33.744440+0000","last_fullsized":"2024-04-24T13:34:33.744440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"132'35","reported_seq":299,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.583403+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:34:33.583403+0000","last_peered":"2024-04-24T13:34:33.583403+0000","last_clean":"2024-04-24T13:34:33.583403+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:34:33.583403+0000","last_undegraded":"2024-04-24T13:34:33.583403+0000","last_fullsized":"2024-04-24T13:34:33.583403+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591102+0000","last_change":"2024-04-24T13:33:08.716879+0000","last_active":"2024-04-24T13:34:34.591102+0000","last_peered":"2024-04-24T13:34:34.591102+0000","last_clean":"2024-04-24T13:34:34.591102+0000","last_became_active":"2024-04-24T13:33:08.716585+0000","last_became_peered":"2024-04-24T13:33:08.716585+0000","last_unstale":"2024-04-24T13:34:34.591102+0000","last_undegraded":"2024-04-24T13:34:34.591102+0000","last_fullsized":"2024-04-24T13:34:34.591102+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:36.135388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"132'25","reported_seq":123,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595276+0000","last_change":"2024-04-24T13:33:10.818135+0000","last_active":"2024-04-24T13:34:34.595276+0000","last_peered":"2024-04-24T13:34:34.595276+0000","last_clean":"2024-04-24T13:34:34.595276+0000","last_became_active":"2024-04-24T13:33:08.736280+0000","last_became_peered":"2024-04-24T13:33:08.736280+0000","last_unstale":"2024-04-24T13:34:34.595276+0000","last_undegraded":"2024-04-24T13:34:34.595276+0000","last_fullsized":"2024-04-24T13:34:34.595276+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:41:16.005578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":244,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.746269+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:34:33.746269+0000","last_peered":"2024-04-24T13:34:33.746269+0000","last_clean":"2024-04-24T13:34:33.746269+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:34:33.746269+0000","last_undegraded":"2024-04-24T13:34:33.746269+0000","last_fullsized":"2024-04-24T13:34:33.746269+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"82'2","reported_seq":262,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744050+0000","last_change":"2024-04-24T13:33:09.338972+0000","last_active":"2024-04-24T13:34:33.744050+0000","last_peered":"2024-04-24T13:34:33.744050+0000","last_clean":"2024-04-24T13:34:33.744050+0000","last_became_active":"2024-04-24T13:33:08.727402+0000","last_became_peered":"2024-04-24T13:33:08.727402+0000","last_unstale":"2024-04-24T13:34:33.744050+0000","last_undegraded":"2024-04-24T13:34:33.744050+0000","last_fullsized":"2024-04-24T13:34:33.744050+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:34.956692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"105'4","reported_seq":274,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.748575+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:34:33.748575+0000","last_peered":"2024-04-24T13:34:33.748575+0000","last_clean":"2024-04-24T13:34:33.748575+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:34:33.748575+0000","last_undegraded":"2024-04-24T13:34:33.748575+0000","last_fullsized":"2024-04-24T13:34:33.748575+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":386,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.747630+0000","last_change":"2024-04-24T13:33:54.557574+0000","last_active":"2024-04-24T13:34:33.747630+0000","last_peered":"2024-04-24T13:34:33.747630+0000","last_clean":"2024-04-24T13:34:33.747630+0000","last_became_active":"2024-04-24T13:33:54.557258+0000","last_became_peered":"2024-04-24T13:33:54.557258+0000","last_unstale":"2024-04-24T13:34:33.747630+0000","last_undegraded":"2024-04-24T13:34:33.747630+0000","last_fullsized":"2024-04-24T13:34:33.747630+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:14:04.108561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593434+0000","last_change":"2024-04-24T13:33:08.717037+0000","last_active":"2024-04-24T13:34:34.593434+0000","last_peered":"2024-04-24T13:34:34.593434+0000","last_clean":"2024-04-24T13:34:34.593434+0000","last_became_active":"2024-04-24T13:33:08.715914+0000","last_became_peered":"2024-04-24T13:33:08.715914+0000","last_unstale":"2024-04-24T13:34:34.593434+0000","last_undegraded":"2024-04-24T13:34:34.593434+0000","last_fullsized":"2024-04-24T13:34:34.593434+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:03.765941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"132'28","reported_seq":321,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.585894+0000","last_change":"2024-04-24T13:33:09.529789+0000","last_active":"2024-04-24T13:34:33.585894+0000","last_peered":"2024-04-24T13:34:33.585894+0000","last_clean":"2024-04-24T13:34:33.585894+0000","last_became_active":"2024-04-24T13:33:08.725348+0000","last_became_peered":"2024-04-24T13:33:08.725348+0000","last_unstale":"2024-04-24T13:34:33.585894+0000","last_undegraded":"2024-04-24T13:34:33.585894+0000","last_fullsized":"2024-04-24T13:34:33.585894+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:18.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":55,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.750894+0000","last_change":"2024-04-24T13:33:49.295687+0000","last_active":"2024-04-24T13:34:33.750894+0000","last_peered":"2024-04-24T13:34:33.750894+0000","last_clean":"2024-04-24T13:34:33.750894+0000","last_became_active":"2024-04-24T13:33:49.293916+0000","last_became_peered":"2024-04-24T13:33:49.293916+0000","last_unstale":"2024-04-24T13:34:33.750894+0000","last_undegraded":"2024-04-24T13:34:33.750894+0000","last_fullsized":"2024-04-24T13:34:33.750894+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:19.712676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"132'41","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.596147+0000","last_change":"2024-04-24T13:33:09.565111+0000","last_active":"2024-04-24T13:34:34.596147+0000","last_peered":"2024-04-24T13:34:34.596147+0000","last_clean":"2024-04-24T13:34:34.596147+0000","last_became_active":"2024-04-24T13:33:08.719950+0000","last_became_peered":"2024-04-24T13:33:08.719950+0000","last_unstale":"2024-04-24T13:34:34.596147+0000","last_undegraded":"2024-04-24T13:34:34.596147+0000","last_fullsized":"2024-04-24T13:34:34.596147+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:37.122088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179174,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":22,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":58868,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":256,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743519+0000","last_change":"2024-04-24T13:33:49.296153+0000","last_active":"2024-04-24T13:34:33.743519+0000","last_peered":"2024-04-24T13:34:33.743519+0000","last_clean":"2024-04-24T13:34:33.743519+0000","last_became_active":"2024-04-24T13:33:49.294098+0000","last_became_peered":"2024-04-24T13:33:49.294098+0000","last_unstale":"2024-04-24T13:34:33.743519+0000","last_undegraded":"2024-04-24T13:34:33.743519+0000","last_fullsized":"2024-04-24T13:34:33.743519+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:15.599045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":250,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.748720+0000","last_change":"2024-04-24T13:33:08.727069+0000","last_active":"2024-04-24T13:34:33.748720+0000","last_peered":"2024-04-24T13:34:33.748720+0000","last_clean":"2024-04-24T13:34:33.748720+0000","last_became_active":"2024-04-24T13:33:08.726216+0000","last_became_peered":"2024-04-24T13:33:08.726216+0000","last_unstale":"2024-04-24T13:34:33.748720+0000","last_undegraded":"2024-04-24T13:34:33.748720+0000","last_fullsized":"2024-04-24T13:34:33.748720+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:59.675122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"105'6","reported_seq":285,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743207+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:34:33.743207+0000","last_peered":"2024-04-24T13:34:33.743207+0000","last_clean":"2024-04-24T13:34:33.743207+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:34:33.743207+0000","last_undegraded":"2024-04-24T13:34:33.743207+0000","last_fullsized":"2024-04-24T13:34:33.743207+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":55,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.748457+0000","last_change":"2024-04-24T13:33:49.282926+0000","last_active":"2024-04-24T13:34:33.748457+0000","last_peered":"2024-04-24T13:34:33.748457+0000","last_clean":"2024-04-24T13:34:33.748457+0000","last_became_active":"2024-04-24T13:33:49.282517+0000","last_became_peered":"2024-04-24T13:33:49.282517+0000","last_unstale":"2024-04-24T13:34:33.748457+0000","last_undegraded":"2024-04-24T13:34:33.748457+0000","last_fullsized":"2024-04-24T13:34:33.748457+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:18.852308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"132'24","reported_seq":287,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742697+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:34:33.742697+0000","last_peered":"2024-04-24T13:34:33.742697+0000","last_clean":"2024-04-24T13:34:33.742697+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:34:33.742697+0000","last_undegraded":"2024-04-24T13:34:33.742697+0000","last_fullsized":"2024-04-24T13:34:33.742697+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.596110+0000","last_change":"2024-04-24T13:33:08.734054+0000","last_active":"2024-04-24T13:34:34.596110+0000","last_peered":"2024-04-24T13:34:34.596110+0000","last_clean":"2024-04-24T13:34:34.596110+0000","last_became_active":"2024-04-24T13:33:08.728126+0000","last_became_peered":"2024-04-24T13:33:08.728126+0000","last_unstale":"2024-04-24T13:34:34.596110+0000","last_undegraded":"2024-04-24T13:34:34.596110+0000","last_fullsized":"2024-04-24T13:34:34.596110+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:48.542362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"132'136","reported_seq":499,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742895+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:34:33.742895+0000","last_peered":"2024-04-24T13:34:33.742895+0000","last_clean":"2024-04-24T13:34:33.742895+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:34:33.742895+0000","last_undegraded":"2024-04-24T13:34:33.742895+0000","last_fullsized":"2024-04-24T13:34:33.742895+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120994,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":55,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.751445+0000","last_change":"2024-04-24T13:33:49.298292+0000","last_active":"2024-04-24T13:34:33.751445+0000","last_peered":"2024-04-24T13:34:33.751445+0000","last_clean":"2024-04-24T13:34:33.751445+0000","last_became_active":"2024-04-24T13:33:49.297450+0000","last_became_peered":"2024-04-24T13:33:49.297450+0000","last_unstale":"2024-04-24T13:34:33.751445+0000","last_undegraded":"2024-04-24T13:34:33.751445+0000","last_fullsized":"2024-04-24T13:34:33.751445+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:11.836268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":244,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744628+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:34:33.744628+0000","last_peered":"2024-04-24T13:34:33.744628+0000","last_clean":"2024-04-24T13:34:33.744628+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:34:33.744628+0000","last_undegraded":"2024-04-24T13:34:33.744628+0000","last_fullsized":"2024-04-24T13:34:33.744628+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"132'2","reported_seq":278,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744488+0000","last_change":"2024-04-24T13:33:08.745743+0000","last_active":"2024-04-24T13:34:33.744488+0000","last_peered":"2024-04-24T13:34:33.744488+0000","last_clean":"2024-04-24T13:34:33.744488+0000","last_became_active":"2024-04-24T13:33:08.745363+0000","last_became_peered":"2024-04-24T13:33:08.745363+0000","last_unstale":"2024-04-24T13:34:33.744488+0000","last_undegraded":"2024-04-24T13:34:33.744488+0000","last_fullsized":"2024-04-24T13:34:33.744488+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:23:38.852782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":268,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.699925+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:34:33.699925+0000","last_peered":"2024-04-24T13:34:33.699925+0000","last_clean":"2024-04-24T13:34:33.699925+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:34:33.699925+0000","last_undegraded":"2024-04-24T13:34:33.699925+0000","last_fullsized":"2024-04-24T13:34:33.699925+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"132'23","reported_seq":288,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742789+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:34:33.742789+0000","last_peered":"2024-04-24T13:34:33.742789+0000","last_clean":"2024-04-24T13:34:33.742789+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:34:33.742789+0000","last_undegraded":"2024-04-24T13:34:33.742789+0000","last_fullsized":"2024-04-24T13:34:33.742789+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":272,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.701663+0000","last_change":"2024-04-24T13:33:09.537358+0000","last_active":"2024-04-24T13:34:33.701663+0000","last_peered":"2024-04-24T13:34:33.701663+0000","last_clean":"2024-04-24T13:34:33.701663+0000","last_became_active":"2024-04-24T13:33:08.726022+0000","last_became_peered":"2024-04-24T13:33:08.726022+0000","last_unstale":"2024-04-24T13:34:33.701663+0000","last_undegraded":"2024-04-24T13:34:33.701663+0000","last_fullsized":"2024-04-24T13:34:33.701663+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:53:29.132620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"126'18","reported_seq":83,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.752707+0000","last_change":"2024-04-24T13:33:52.755369+0000","last_active":"2024-04-24T13:34:33.752707+0000","last_peered":"2024-04-24T13:34:33.752707+0000","last_clean":"2024-04-24T13:34:33.752707+0000","last_became_active":"2024-04-24T13:33:49.297296+0000","last_became_peered":"2024-04-24T13:33:49.297296+0000","last_unstale":"2024-04-24T13:34:33.752707+0000","last_undegraded":"2024-04-24T13:34:33.752707+0000","last_fullsized":"2024-04-24T13:34:33.752707+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:57.772686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":246,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742867+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:34:33.742867+0000","last_peered":"2024-04-24T13:34:33.742867+0000","last_clean":"2024-04-24T13:34:33.742867+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:34:33.742867+0000","last_undegraded":"2024-04-24T13:34:33.742867+0000","last_fullsized":"2024-04-24T13:34:33.742867+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":244,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.586027+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:34:33.586027+0000","last_peered":"2024-04-24T13:34:33.586027+0000","last_clean":"2024-04-24T13:34:33.586027+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:34:33.586027+0000","last_undegraded":"2024-04-24T13:34:33.586027+0000","last_fullsized":"2024-04-24T13:34:33.586027+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"132'4","reported_seq":278,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743120+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:34:33.743120+0000","last_peered":"2024-04-24T13:34:33.743120+0000","last_clean":"2024-04-24T13:34:33.743120+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:34:33.743120+0000","last_undegraded":"2024-04-24T13:34:33.743120+0000","last_fullsized":"2024-04-24T13:34:33.743120+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592641+0000","last_change":"2024-04-24T13:33:08.727739+0000","last_active":"2024-04-24T13:34:34.592641+0000","last_peered":"2024-04-24T13:34:34.592641+0000","last_clean":"2024-04-24T13:34:34.592641+0000","last_became_active":"2024-04-24T13:33:08.727324+0000","last_became_peered":"2024-04-24T13:33:08.727324+0000","last_unstale":"2024-04-24T13:34:34.592641+0000","last_undegraded":"2024-04-24T13:34:34.592641+0000","last_fullsized":"2024-04-24T13:34:34.592641+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:23.918692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"132'22","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590105+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:34:34.590105+0000","last_peered":"2024-04-24T13:34:34.590105+0000","last_clean":"2024-04-24T13:34:34.590105+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:34:34.590105+0000","last_undegraded":"2024-04-24T13:34:34.590105+0000","last_fullsized":"2024-04-24T13:34:34.590105+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.760398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":254,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743328+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:34:33.743328+0000","last_peered":"2024-04-24T13:34:33.743328+0000","last_clean":"2024-04-24T13:34:33.743328+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:34:33.743328+0000","last_undegraded":"2024-04-24T13:34:33.743328+0000","last_fullsized":"2024-04-24T13:34:33.743328+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":270,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.586776+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:34:33.586776+0000","last_peered":"2024-04-24T13:34:33.586776+0000","last_clean":"2024-04-24T13:34:33.586776+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:34:33.586776+0000","last_undegraded":"2024-04-24T13:34:33.586776+0000","last_fullsized":"2024-04-24T13:34:33.586776+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":244,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.747199+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:34:33.747199+0000","last_peered":"2024-04-24T13:34:33.747199+0000","last_clean":"2024-04-24T13:34:33.747199+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:34:33.747199+0000","last_undegraded":"2024-04-24T13:34:33.747199+0000","last_fullsized":"2024-04-24T13:34:33.747199+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"81'4","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594411+0000","last_change":"2024-04-24T13:33:09.289060+0000","last_active":"2024-04-24T13:34:34.594411+0000","last_peered":"2024-04-24T13:34:34.594411+0000","last_clean":"2024-04-24T13:34:34.594411+0000","last_became_active":"2024-04-24T13:33:08.717929+0000","last_became_peered":"2024-04-24T13:33:08.717929+0000","last_unstale":"2024-04-24T13:34:34.594411+0000","last_undegraded":"2024-04-24T13:34:34.594411+0000","last_fullsized":"2024-04-24T13:34:34.594411+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:36.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":271,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744809+0000","last_change":"2024-04-24T13:33:08.738475+0000","last_active":"2024-04-24T13:34:33.744809+0000","last_peered":"2024-04-24T13:34:33.744809+0000","last_clean":"2024-04-24T13:34:33.744809+0000","last_became_active":"2024-04-24T13:33:08.738109+0000","last_became_peered":"2024-04-24T13:33:08.738109+0000","last_unstale":"2024-04-24T13:34:33.744809+0000","last_undegraded":"2024-04-24T13:34:33.744809+0000","last_fullsized":"2024-04-24T13:34:33.744809+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:14:49.386651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"132'27","reported_seq":137,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594648+0000","last_change":"2024-04-24T13:33:10.091580+0000","last_active":"2024-04-24T13:34:34.594648+0000","last_peered":"2024-04-24T13:34:34.594648+0000","last_clean":"2024-04-24T13:34:34.594648+0000","last_became_active":"2024-04-24T13:33:08.716808+0000","last_became_peered":"2024-04-24T13:33:08.716808+0000","last_unstale":"2024-04-24T13:34:34.594648+0000","last_undegraded":"2024-04-24T13:34:34.594648+0000","last_fullsized":"2024-04-24T13:34:34.594648+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:05:06.347329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":271,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744337+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:34:33.744337+0000","last_peered":"2024-04-24T13:34:33.744337+0000","last_clean":"2024-04-24T13:34:33.744337+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:34:33.744337+0000","last_undegraded":"2024-04-24T13:34:33.744337+0000","last_fullsized":"2024-04-24T13:34:33.744337+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":254,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743847+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:34:33.743847+0000","last_peered":"2024-04-24T13:34:33.743847+0000","last_clean":"2024-04-24T13:34:33.743847+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:34:33.743847+0000","last_undegraded":"2024-04-24T13:34:33.743847+0000","last_fullsized":"2024-04-24T13:34:33.743847+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"132'34","reported_seq":299,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742234+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:34:33.742234+0000","last_peered":"2024-04-24T13:34:33.742234+0000","last_clean":"2024-04-24T13:34:33.742234+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:34:33.742234+0000","last_undegraded":"2024-04-24T13:34:33.742234+0000","last_fullsized":"2024-04-24T13:34:33.742234+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588983+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:34:34.588983+0000","last_peered":"2024-04-24T13:34:34.588983+0000","last_clean":"2024-04-24T13:34:34.588983+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:34:34.588983+0000","last_undegraded":"2024-04-24T13:34:34.588983+0000","last_fullsized":"2024-04-24T13:34:34.588983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":242,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743802+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:34:33.743802+0000","last_peered":"2024-04-24T13:34:33.743802+0000","last_clean":"2024-04-24T13:34:33.743802+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:34:33.743802+0000","last_undegraded":"2024-04-24T13:34:33.743802+0000","last_fullsized":"2024-04-24T13:34:33.743802+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"114'18","reported_seq":349,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744226+0000","last_change":"2024-04-24T13:33:09.335136+0000","last_active":"2024-04-24T13:34:33.744226+0000","last_peered":"2024-04-24T13:34:33.744226+0000","last_clean":"2024-04-24T13:34:33.744226+0000","last_became_active":"2024-04-24T13:33:08.705853+0000","last_became_peered":"2024-04-24T13:33:08.705853+0000","last_unstale":"2024-04-24T13:34:33.744226+0000","last_undegraded":"2024-04-24T13:34:33.744226+0000","last_fullsized":"2024-04-24T13:34:33.744226+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:53.758485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":86,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"132'14","reported_seq":279,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743232+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:34:33.743232+0000","last_peered":"2024-04-24T13:34:33.743232+0000","last_clean":"2024-04-24T13:34:33.743232+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:34:33.743232+0000","last_undegraded":"2024-04-24T13:34:33.743232+0000","last_fullsized":"2024-04-24T13:34:33.743232+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":55,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.752310+0000","last_change":"2024-04-24T13:33:49.288345+0000","last_active":"2024-04-24T13:34:33.752310+0000","last_peered":"2024-04-24T13:34:33.752310+0000","last_clean":"2024-04-24T13:34:33.752310+0000","last_became_active":"2024-04-24T13:33:49.287893+0000","last_became_peered":"2024-04-24T13:33:49.287893+0000","last_unstale":"2024-04-24T13:34:33.752310+0000","last_undegraded":"2024-04-24T13:34:33.752310+0000","last_fullsized":"2024-04-24T13:34:33.752310+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:59.559096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":253,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.745128+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:34:33.745128+0000","last_peered":"2024-04-24T13:34:33.745128+0000","last_clean":"2024-04-24T13:34:33.745128+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:34:33.745128+0000","last_undegraded":"2024-04-24T13:34:33.745128+0000","last_fullsized":"2024-04-24T13:34:33.745128+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"105'15","reported_seq":275,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743112+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:34:33.743112+0000","last_peered":"2024-04-24T13:34:33.743112+0000","last_clean":"2024-04-24T13:34:33.743112+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:34:33.743112+0000","last_undegraded":"2024-04-24T13:34:33.743112+0000","last_fullsized":"2024-04-24T13:34:33.743112+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"132'137","reported_seq":349,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594029+0000","last_change":"2024-04-24T13:33:11.712104+0000","last_active":"2024-04-24T13:34:34.594029+0000","last_peered":"2024-04-24T13:34:34.594029+0000","last_clean":"2024-04-24T13:34:34.594029+0000","last_became_active":"2024-04-24T13:33:11.710310+0000","last_became_peered":"2024-04-24T13:33:11.710310+0000","last_unstale":"2024-04-24T13:34:34.594029+0000","last_undegraded":"2024-04-24T13:34:34.594029+0000","last_fullsized":"2024-04-24T13:34:34.594029+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:44.878043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"114'3","reported_seq":249,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.587012+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:34:33.587012+0000","last_peered":"2024-04-24T13:34:33.587012+0000","last_clean":"2024-04-24T13:34:33.587012+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:34:33.587012+0000","last_undegraded":"2024-04-24T13:34:33.587012+0000","last_fullsized":"2024-04-24T13:34:33.587012+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"82'2","reported_seq":226,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.699592+0000","last_change":"2024-04-24T13:33:49.682866+0000","last_active":"2024-04-24T13:34:33.699592+0000","last_peered":"2024-04-24T13:34:33.699592+0000","last_clean":"2024-04-24T13:34:33.699592+0000","last_became_active":"2024-04-24T13:33:49.296844+0000","last_became_peered":"2024-04-24T13:33:49.296844+0000","last_unstale":"2024-04-24T13:34:33.699592+0000","last_undegraded":"2024-04-24T13:34:33.699592+0000","last_fullsized":"2024-04-24T13:34:33.699592+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:34.675704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"132'24","reported_seq":332,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.586594+0000","last_change":"2024-04-24T13:33:51.134298+0000","last_active":"2024-04-24T13:34:33.586594+0000","last_peered":"2024-04-24T13:34:33.586594+0000","last_clean":"2024-04-24T13:34:33.586594+0000","last_became_active":"2024-04-24T13:33:49.300149+0000","last_became_peered":"2024-04-24T13:33:49.300149+0000","last_unstale":"2024-04-24T13:34:33.586594+0000","last_undegraded":"2024-04-24T13:34:33.586594+0000","last_fullsized":"2024-04-24T13:34:33.586594+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:46:34.323602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":271,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744122+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:34:33.744122+0000","last_peered":"2024-04-24T13:34:33.744122+0000","last_clean":"2024-04-24T13:34:33.744122+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:34:33.744122+0000","last_undegraded":"2024-04-24T13:34:33.744122+0000","last_fullsized":"2024-04-24T13:34:33.744122+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588762+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:34:34.588762+0000","last_peered":"2024-04-24T13:34:34.588762+0000","last_clean":"2024-04-24T13:34:34.588762+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:34:34.588762+0000","last_undegraded":"2024-04-24T13:34:34.588762+0000","last_fullsized":"2024-04-24T13:34:34.588762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589504+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:34:34.589504+0000","last_peered":"2024-04-24T13:34:34.589504+0000","last_clean":"2024-04-24T13:34:34.589504+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:34:34.589504+0000","last_undegraded":"2024-04-24T13:34:34.589504+0000","last_fullsized":"2024-04-24T13:34:34.589504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"132'134","reported_seq":431,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.587953+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:34:33.587953+0000","last_peered":"2024-04-24T13:34:33.587953+0000","last_clean":"2024-04-24T13:34:33.587953+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:34:33.587953+0000","last_undegraded":"2024-04-24T13:34:33.587953+0000","last_fullsized":"2024-04-24T13:34:33.587953+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"82'6","reported_seq":250,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742975+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:34:33.742975+0000","last_peered":"2024-04-24T13:34:33.742975+0000","last_clean":"2024-04-24T13:34:33.742975+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:34:33.742975+0000","last_undegraded":"2024-04-24T13:34:33.742975+0000","last_fullsized":"2024-04-24T13:34:33.742975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"114'6","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588275+0000","last_change":"2024-04-24T13:33:08.753804+0000","last_active":"2024-04-24T13:34:34.588275+0000","last_peered":"2024-04-24T13:34:34.588275+0000","last_clean":"2024-04-24T13:34:34.588275+0000","last_became_active":"2024-04-24T13:33:08.707993+0000","last_became_peered":"2024-04-24T13:33:08.707993+0000","last_unstale":"2024-04-24T13:34:34.588275+0000","last_undegraded":"2024-04-24T13:34:34.588275+0000","last_fullsized":"2024-04-24T13:34:34.588275+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:02.680781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"131'22","reported_seq":284,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742964+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:34:33.742964+0000","last_peered":"2024-04-24T13:34:33.742964+0000","last_clean":"2024-04-24T13:34:33.742964+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:34:33.742964+0000","last_undegraded":"2024-04-24T13:34:33.742964+0000","last_fullsized":"2024-04-24T13:34:33.742964+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":277,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.750587+0000","last_change":"2024-04-24T13:33:49.289245+0000","last_active":"2024-04-24T13:34:33.750587+0000","last_peered":"2024-04-24T13:34:33.750587+0000","last_clean":"2024-04-24T13:34:33.750587+0000","last_became_active":"2024-04-24T13:33:49.288766+0000","last_became_peered":"2024-04-24T13:33:49.288766+0000","last_unstale":"2024-04-24T13:34:33.750587+0000","last_undegraded":"2024-04-24T13:34:33.750587+0000","last_fullsized":"2024-04-24T13:34:33.750587+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:02:54.620974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":257,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.584165+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:34:33.584165+0000","last_peered":"2024-04-24T13:34:33.584165+0000","last_clean":"2024-04-24T13:34:33.584165+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:34:33.584165+0000","last_undegraded":"2024-04-24T13:34:33.584165+0000","last_fullsized":"2024-04-24T13:34:33.584165+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"132'43","reported_seq":76,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.751487+0000","last_change":"2024-04-24T13:33:52.712739+0000","last_active":"2024-04-24T13:34:33.751487+0000","last_peered":"2024-04-24T13:34:33.751487+0000","last_clean":"2024-04-24T13:34:33.751487+0000","last_became_active":"2024-04-24T13:33:49.295935+0000","last_became_peered":"2024-04-24T13:33:49.295935+0000","last_unstale":"2024-04-24T13:34:33.751487+0000","last_undegraded":"2024-04-24T13:34:33.751487+0000","last_fullsized":"2024-04-24T13:34:33.751487+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:52.132391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":248,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.585489+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:34:33.585489+0000","last_peered":"2024-04-24T13:34:33.585489+0000","last_clean":"2024-04-24T13:34:33.585489+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:34:33.585489+0000","last_undegraded":"2024-04-24T13:34:33.585489+0000","last_fullsized":"2024-04-24T13:34:33.585489+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"105'6","reported_seq":120,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594807+0000","last_change":"2024-04-24T13:33:51.141865+0000","last_active":"2024-04-24T13:34:34.594807+0000","last_peered":"2024-04-24T13:34:34.594807+0000","last_clean":"2024-04-24T13:34:34.594807+0000","last_became_active":"2024-04-24T13:33:49.289035+0000","last_became_peered":"2024-04-24T13:33:49.289035+0000","last_unstale":"2024-04-24T13:34:34.594807+0000","last_undegraded":"2024-04-24T13:34:34.594807+0000","last_fullsized":"2024-04-24T13:34:34.594807+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:08:46.400784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"82'2","reported_seq":260,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743452+0000","last_change":"2024-04-24T13:33:09.076639+0000","last_active":"2024-04-24T13:34:33.743452+0000","last_peered":"2024-04-24T13:34:33.743452+0000","last_clean":"2024-04-24T13:34:33.743452+0000","last_became_active":"2024-04-24T13:33:08.705821+0000","last_became_peered":"2024-04-24T13:33:08.705821+0000","last_unstale":"2024-04-24T13:34:33.743452+0000","last_undegraded":"2024-04-24T13:34:33.743452+0000","last_fullsized":"2024-04-24T13:34:33.743452+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:07:09.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589501+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:34:34.589501+0000","last_peered":"2024-04-24T13:34:34.589501+0000","last_clean":"2024-04-24T13:34:34.589501+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:34:34.589501+0000","last_undegraded":"2024-04-24T13:34:34.589501+0000","last_fullsized":"2024-04-24T13:34:34.589501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"132'33","reported_seq":296,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.700915+0000","last_change":"2024-04-24T13:33:50.684508+0000","last_active":"2024-04-24T13:34:33.700915+0000","last_peered":"2024-04-24T13:34:33.700915+0000","last_clean":"2024-04-24T13:34:33.700915+0000","last_became_active":"2024-04-24T13:33:49.297002+0000","last_became_peered":"2024-04-24T13:33:49.297002+0000","last_unstale":"2024-04-24T13:34:33.700915+0000","last_undegraded":"2024-04-24T13:34:33.700915+0000","last_fullsized":"2024-04-24T13:34:33.700915+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:05.604339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":364,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744860+0000","last_change":"2024-04-24T13:33:09.553473+0000","last_active":"2024-04-24T13:34:33.744860+0000","last_peered":"2024-04-24T13:34:33.744860+0000","last_clean":"2024-04-24T13:34:33.744860+0000","last_became_active":"2024-04-24T13:33:08.738276+0000","last_became_peered":"2024-04-24T13:33:08.738276+0000","last_unstale":"2024-04-24T13:34:33.744860+0000","last_undegraded":"2024-04-24T13:34:33.744860+0000","last_fullsized":"2024-04-24T13:34:33.744860+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:44.215595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"132'20","reported_seq":280,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.583619+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:34:33.583619+0000","last_peered":"2024-04-24T13:34:33.583619+0000","last_clean":"2024-04-24T13:34:33.583619+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:34:33.583619+0000","last_undegraded":"2024-04-24T13:34:33.583619+0000","last_fullsized":"2024-04-24T13:34:33.583619+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":248,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.584323+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:34:33.584323+0000","last_peered":"2024-04-24T13:34:33.584323+0000","last_clean":"2024-04-24T13:34:33.584323+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:34:33.584323+0000","last_undegraded":"2024-04-24T13:34:33.584323+0000","last_fullsized":"2024-04-24T13:34:33.584323+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":255,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.586119+0000","last_change":"2024-04-24T13:33:49.302711+0000","last_active":"2024-04-24T13:34:33.586119+0000","last_peered":"2024-04-24T13:34:33.586119+0000","last_clean":"2024-04-24T13:34:33.586119+0000","last_became_active":"2024-04-24T13:33:49.302201+0000","last_became_peered":"2024-04-24T13:33:49.302201+0000","last_unstale":"2024-04-24T13:34:33.586119+0000","last_undegraded":"2024-04-24T13:34:33.586119+0000","last_fullsized":"2024-04-24T13:34:33.586119+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:21.125833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":260,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744760+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:34:33.744760+0000","last_peered":"2024-04-24T13:34:33.744760+0000","last_clean":"2024-04-24T13:34:33.744760+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:34:33.744760+0000","last_undegraded":"2024-04-24T13:34:33.744760+0000","last_fullsized":"2024-04-24T13:34:33.744760+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"132'20","reported_seq":86,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.751500+0000","last_change":"2024-04-24T13:33:53.881731+0000","last_active":"2024-04-24T13:34:33.751500+0000","last_peered":"2024-04-24T13:34:33.751500+0000","last_clean":"2024-04-24T13:34:33.751500+0000","last_became_active":"2024-04-24T13:33:49.299864+0000","last_became_peered":"2024-04-24T13:33:49.299864+0000","last_unstale":"2024-04-24T13:34:33.751500+0000","last_undegraded":"2024-04-24T13:34:33.751500+0000","last_fullsized":"2024-04-24T13:34:33.751500+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:31.093323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":256,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.585662+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:34:33.585662+0000","last_peered":"2024-04-24T13:34:33.585662+0000","last_clean":"2024-04-24T13:34:33.585662+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:34:33.585662+0000","last_undegraded":"2024-04-24T13:34:33.585662+0000","last_fullsized":"2024-04-24T13:34:33.585662+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"132'9","reported_seq":287,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742358+0000","last_change":"2024-04-24T13:33:09.548972+0000","last_active":"2024-04-24T13:34:33.742358+0000","last_peered":"2024-04-24T13:34:33.742358+0000","last_clean":"2024-04-24T13:34:33.742358+0000","last_became_active":"2024-04-24T13:33:08.721855+0000","last_became_peered":"2024-04-24T13:33:08.721855+0000","last_unstale":"2024-04-24T13:34:33.742358+0000","last_undegraded":"2024-04-24T13:34:33.742358+0000","last_fullsized":"2024-04-24T13:34:33.742358+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:12.936976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":55,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.748853+0000","last_change":"2024-04-24T13:33:49.302936+0000","last_active":"2024-04-24T13:34:33.748853+0000","last_peered":"2024-04-24T13:34:33.748853+0000","last_clean":"2024-04-24T13:34:33.748853+0000","last_became_active":"2024-04-24T13:33:49.297478+0000","last_became_peered":"2024-04-24T13:33:49.297478+0000","last_unstale":"2024-04-24T13:34:33.748853+0000","last_undegraded":"2024-04-24T13:34:33.748853+0000","last_fullsized":"2024-04-24T13:34:33.748853+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:39.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"132'6","reported_seq":252,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743222+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:34:33.743222+0000","last_peered":"2024-04-24T13:34:33.743222+0000","last_clean":"2024-04-24T13:34:33.743222+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:34:33.743222+0000","last_undegraded":"2024-04-24T13:34:33.743222+0000","last_fullsized":"2024-04-24T13:34:33.743222+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"82'4","reported_seq":292,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.584258+0000","last_change":"2024-04-24T13:33:49.688460+0000","last_active":"2024-04-24T13:34:33.584258+0000","last_peered":"2024-04-24T13:34:33.584258+0000","last_clean":"2024-04-24T13:34:33.584258+0000","last_became_active":"2024-04-24T13:33:49.292866+0000","last_became_peered":"2024-04-24T13:33:49.292866+0000","last_unstale":"2024-04-24T13:34:33.584258+0000","last_undegraded":"2024-04-24T13:34:33.584258+0000","last_fullsized":"2024-04-24T13:34:33.584258+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:38.839177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"131'22","reported_seq":172,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595276+0000","last_change":"2024-04-24T13:33:52.207013+0000","last_active":"2024-04-24T13:34:34.595276+0000","last_peered":"2024-04-24T13:34:34.595276+0000","last_clean":"2024-04-24T13:34:34.595276+0000","last_became_active":"2024-04-24T13:33:49.289650+0000","last_became_peered":"2024-04-24T13:33:49.289650+0000","last_unstale":"2024-04-24T13:34:34.595276+0000","last_undegraded":"2024-04-24T13:34:34.595276+0000","last_fullsized":"2024-04-24T13:34:34.595276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:15:45.985778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":55,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.746875+0000","last_change":"2024-04-24T13:33:49.283767+0000","last_active":"2024-04-24T13:34:33.746875+0000","last_peered":"2024-04-24T13:34:33.746875+0000","last_clean":"2024-04-24T13:34:33.746875+0000","last_became_active":"2024-04-24T13:33:49.283342+0000","last_became_peered":"2024-04-24T13:33:49.283342+0000","last_unstale":"2024-04-24T13:34:33.746875+0000","last_undegraded":"2024-04-24T13:34:33.746875+0000","last_fullsized":"2024-04-24T13:34:33.746875+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:36.682746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"132'20","reported_seq":280,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.584713+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:34:33.584713+0000","last_peered":"2024-04-24T13:34:33.584713+0000","last_clean":"2024-04-24T13:34:33.584713+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:34:33.584713+0000","last_undegraded":"2024-04-24T13:34:33.584713+0000","last_fullsized":"2024-04-24T13:34:33.584713+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":244,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.747342+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:34:33.747342+0000","last_peered":"2024-04-24T13:34:33.747342+0000","last_clean":"2024-04-24T13:34:33.747342+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:34:33.747342+0000","last_undegraded":"2024-04-24T13:34:33.747342+0000","last_fullsized":"2024-04-24T13:34:33.747342+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"114'4","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594405+0000","last_change":"2024-04-24T13:33:50.241765+0000","last_active":"2024-04-24T13:34:34.594405+0000","last_peered":"2024-04-24T13:34:34.594405+0000","last_clean":"2024-04-24T13:34:34.594405+0000","last_became_active":"2024-04-24T13:33:49.288852+0000","last_became_peered":"2024-04-24T13:33:49.288852+0000","last_unstale":"2024-04-24T13:34:34.594405+0000","last_undegraded":"2024-04-24T13:34:34.594405+0000","last_fullsized":"2024-04-24T13:34:34.594405+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:53:23.401847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":269,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.583893+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:34:33.583893+0000","last_peered":"2024-04-24T13:34:33.583893+0000","last_clean":"2024-04-24T13:34:33.583893+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:34:33.583893+0000","last_undegraded":"2024-04-24T13:34:33.583893+0000","last_fullsized":"2024-04-24T13:34:33.583893+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"132'20","reported_seq":310,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744004+0000","last_change":"2024-04-24T13:33:09.773703+0000","last_active":"2024-04-24T13:34:33.744004+0000","last_peered":"2024-04-24T13:34:33.744004+0000","last_clean":"2024-04-24T13:34:33.744004+0000","last_became_active":"2024-04-24T13:33:08.722546+0000","last_became_peered":"2024-04-24T13:33:08.722546+0000","last_unstale":"2024-04-24T13:34:33.744004+0000","last_undegraded":"2024-04-24T13:34:33.744004+0000","last_fullsized":"2024-04-24T13:34:33.744004+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:26.369698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":252,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.746977+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:34:33.746977+0000","last_peered":"2024-04-24T13:34:33.746977+0000","last_clean":"2024-04-24T13:34:33.746977+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:34:33.746977+0000","last_undegraded":"2024-04-24T13:34:33.746977+0000","last_fullsized":"2024-04-24T13:34:33.746977+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"132'18","reported_seq":66,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.747992+0000","last_change":"2024-04-24T13:33:52.735528+0000","last_active":"2024-04-24T13:34:33.747992+0000","last_peered":"2024-04-24T13:34:33.747992+0000","last_clean":"2024-04-24T13:34:33.747992+0000","last_became_active":"2024-04-24T13:33:49.297667+0000","last_became_peered":"2024-04-24T13:33:49.297667+0000","last_unstale":"2024-04-24T13:34:33.747992+0000","last_undegraded":"2024-04-24T13:34:33.747992+0000","last_fullsized":"2024-04-24T13:34:33.747992+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:07:05.200322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":256,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742710+0000","last_change":"2024-04-24T13:33:49.286645+0000","last_active":"2024-04-24T13:34:33.742710+0000","last_peered":"2024-04-24T13:34:33.742710+0000","last_clean":"2024-04-24T13:34:33.742710+0000","last_became_active":"2024-04-24T13:33:49.285495+0000","last_became_peered":"2024-04-24T13:33:49.285495+0000","last_unstale":"2024-04-24T13:34:33.742710+0000","last_undegraded":"2024-04-24T13:34:33.742710+0000","last_fullsized":"2024-04-24T13:34:33.742710+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:19.867685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"82'8","reported_seq":293,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.750259+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:34:33.750259+0000","last_peered":"2024-04-24T13:34:33.750259+0000","last_clean":"2024-04-24T13:34:33.750259+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:34:33.750259+0000","last_undegraded":"2024-04-24T13:34:33.750259+0000","last_fullsized":"2024-04-24T13:34:33.750259+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"131'27","reported_seq":291,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.583574+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:34:33.583574+0000","last_peered":"2024-04-24T13:34:33.583574+0000","last_clean":"2024-04-24T13:34:33.583574+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:34:33.583574+0000","last_undegraded":"2024-04-24T13:34:33.583574+0000","last_fullsized":"2024-04-24T13:34:33.583574+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":265,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743438+0000","last_change":"2024-04-24T13:33:49.296871+0000","last_active":"2024-04-24T13:34:33.743438+0000","last_peered":"2024-04-24T13:34:33.743438+0000","last_clean":"2024-04-24T13:34:33.743438+0000","last_became_active":"2024-04-24T13:33:49.295933+0000","last_became_peered":"2024-04-24T13:33:49.295933+0000","last_unstale":"2024-04-24T13:34:33.743438+0000","last_undegraded":"2024-04-24T13:34:33.743438+0000","last_fullsized":"2024-04-24T13:34:33.743438+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:48:25.451061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"132'29","reported_seq":292,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743500+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:34:33.743500+0000","last_peered":"2024-04-24T13:34:33.743500+0000","last_clean":"2024-04-24T13:34:33.743500+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:34:33.743500+0000","last_undegraded":"2024-04-24T13:34:33.743500+0000","last_fullsized":"2024-04-24T13:34:33.743500+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62357,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594350+0000","last_change":"2024-04-24T13:33:08.717844+0000","last_active":"2024-04-24T13:34:34.594350+0000","last_peered":"2024-04-24T13:34:34.594350+0000","last_clean":"2024-04-24T13:34:34.594350+0000","last_became_active":"2024-04-24T13:33:08.716627+0000","last_became_peered":"2024-04-24T13:33:08.716627+0000","last_unstale":"2024-04-24T13:34:34.594350+0000","last_undegraded":"2024-04-24T13:34:34.594350+0000","last_fullsized":"2024-04-24T13:34:34.594350+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:43.447785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":244,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.584353+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:34:33.584353+0000","last_peered":"2024-04-24T13:34:33.584353+0000","last_clean":"2024-04-24T13:34:33.584353+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:34:33.584353+0000","last_undegraded":"2024-04-24T13:34:33.584353+0000","last_fullsized":"2024-04-24T13:34:33.584353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"114'10","reported_seq":322,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743293+0000","last_change":"2024-04-24T13:33:50.254858+0000","last_active":"2024-04-24T13:34:33.743293+0000","last_peered":"2024-04-24T13:34:33.743293+0000","last_clean":"2024-04-24T13:34:33.743293+0000","last_became_active":"2024-04-24T13:33:49.285680+0000","last_became_peered":"2024-04-24T13:33:49.285680+0000","last_unstale":"2024-04-24T13:34:33.743293+0000","last_undegraded":"2024-04-24T13:34:33.743293+0000","last_fullsized":"2024-04-24T13:34:33.743293+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:13.081256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"132'20","reported_seq":284,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743856+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:34:33.743856+0000","last_peered":"2024-04-24T13:34:33.743856+0000","last_clean":"2024-04-24T13:34:33.743856+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:34:33.743856+0000","last_undegraded":"2024-04-24T13:34:33.743856+0000","last_fullsized":"2024-04-24T13:34:33.743856+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":253,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.747355+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:34:33.747355+0000","last_peered":"2024-04-24T13:34:33.747355+0000","last_clean":"2024-04-24T13:34:33.747355+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:34:33.747355+0000","last_undegraded":"2024-04-24T13:34:33.747355+0000","last_fullsized":"2024-04-24T13:34:33.747355+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"132'23","reported_seq":72,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.751129+0000","last_change":"2024-04-24T13:33:51.826433+0000","last_active":"2024-04-24T13:34:33.751129+0000","last_peered":"2024-04-24T13:34:33.751129+0000","last_clean":"2024-04-24T13:34:33.751129+0000","last_became_active":"2024-04-24T13:33:49.291994+0000","last_became_peered":"2024-04-24T13:33:49.291994+0000","last_unstale":"2024-04-24T13:34:33.751129+0000","last_undegraded":"2024-04-24T13:34:33.751129+0000","last_fullsized":"2024-04-24T13:34:33.751129+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:35.992700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":248,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743567+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:34:33.743567+0000","last_peered":"2024-04-24T13:34:33.743567+0000","last_clean":"2024-04-24T13:34:33.743567+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:34:33.743567+0000","last_undegraded":"2024-04-24T13:34:33.743567+0000","last_fullsized":"2024-04-24T13:34:33.743567+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":250,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.748870+0000","last_change":"2024-04-24T13:33:49.289138+0000","last_active":"2024-04-24T13:34:33.748870+0000","last_peered":"2024-04-24T13:34:33.748870+0000","last_clean":"2024-04-24T13:34:33.748870+0000","last_became_active":"2024-04-24T13:33:49.288760+0000","last_became_peered":"2024-04-24T13:33:49.288760+0000","last_unstale":"2024-04-24T13:34:33.748870+0000","last_undegraded":"2024-04-24T13:34:33.748870+0000","last_fullsized":"2024-04-24T13:34:33.748870+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:12:25.409700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":260,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.586028+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:34:33.586028+0000","last_peered":"2024-04-24T13:34:33.586028+0000","last_clean":"2024-04-24T13:34:33.586028+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:34:33.586028+0000","last_undegraded":"2024-04-24T13:34:33.586028+0000","last_fullsized":"2024-04-24T13:34:33.586028+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"132'17","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589695+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:34:34.589695+0000","last_peered":"2024-04-24T13:34:34.589695+0000","last_clean":"2024-04-24T13:34:34.589695+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:34:34.589695+0000","last_undegraded":"2024-04-24T13:34:34.589695+0000","last_fullsized":"2024-04-24T13:34:34.589695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590976+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:34:34.590976+0000","last_peered":"2024-04-24T13:34:34.590976+0000","last_clean":"2024-04-24T13:34:34.590976+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:34:34.590976+0000","last_undegraded":"2024-04-24T13:34:34.590976+0000","last_fullsized":"2024-04-24T13:34:34.590976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"132'20","reported_seq":281,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.588157+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:34:33.588157+0000","last_peered":"2024-04-24T13:34:33.588157+0000","last_clean":"2024-04-24T13:34:33.588157+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:34:33.588157+0000","last_undegraded":"2024-04-24T13:34:33.588157+0000","last_fullsized":"2024-04-24T13:34:33.588157+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":249,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743800+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:34:33.743800+0000","last_peered":"2024-04-24T13:34:33.743800+0000","last_clean":"2024-04-24T13:34:33.743800+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:34:33.743800+0000","last_undegraded":"2024-04-24T13:34:33.743800+0000","last_fullsized":"2024-04-24T13:34:33.743800+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592796+0000","last_change":"2024-04-24T13:33:49.289867+0000","last_active":"2024-04-24T13:34:34.592796+0000","last_peered":"2024-04-24T13:34:34.592796+0000","last_clean":"2024-04-24T13:34:34.592796+0000","last_became_active":"2024-04-24T13:33:49.289412+0000","last_became_peered":"2024-04-24T13:33:49.289412+0000","last_unstale":"2024-04-24T13:34:34.592796+0000","last_undegraded":"2024-04-24T13:34:34.592796+0000","last_fullsized":"2024-04-24T13:34:34.592796+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:24:50.051036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"114'2","reported_seq":265,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.702429+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:34:33.702429+0000","last_peered":"2024-04-24T13:34:33.702429+0000","last_clean":"2024-04-24T13:34:33.702429+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:34:33.702429+0000","last_undegraded":"2024-04-24T13:34:33.702429+0000","last_fullsized":"2024-04-24T13:34:33.702429+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"131'28","reported_seq":290,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742799+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:34:33.742799+0000","last_peered":"2024-04-24T13:34:33.742799+0000","last_clean":"2024-04-24T13:34:33.742799+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:34:33.742799+0000","last_undegraded":"2024-04-24T13:34:33.742799+0000","last_fullsized":"2024-04-24T13:34:33.742799+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":256,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743233+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:34:33.743233+0000","last_peered":"2024-04-24T13:34:33.743233+0000","last_clean":"2024-04-24T13:34:33.743233+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:34:33.743233+0000","last_undegraded":"2024-04-24T13:34:33.743233+0000","last_fullsized":"2024-04-24T13:34:33.743233+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590834+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:34:34.590834+0000","last_peered":"2024-04-24T13:34:34.590834+0000","last_clean":"2024-04-24T13:34:34.590834+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:34:34.590834+0000","last_undegraded":"2024-04-24T13:34:34.590834+0000","last_fullsized":"2024-04-24T13:34:34.590834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"132'134","reported_seq":427,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.746259+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:34:33.746259+0000","last_peered":"2024-04-24T13:34:33.746259+0000","last_clean":"2024-04-24T13:34:33.746259+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:34:33.746259+0000","last_undegraded":"2024-04-24T13:34:33.746259+0000","last_fullsized":"2024-04-24T13:34:33.746259+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"82'6","reported_seq":59,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.748915+0000","last_change":"2024-04-24T13:33:50.541311+0000","last_active":"2024-04-24T13:34:33.748915+0000","last_peered":"2024-04-24T13:34:33.748915+0000","last_clean":"2024-04-24T13:34:33.748915+0000","last_became_active":"2024-04-24T13:33:49.285594+0000","last_became_peered":"2024-04-24T13:33:49.285594+0000","last_unstale":"2024-04-24T13:34:33.748915+0000","last_undegraded":"2024-04-24T13:34:33.748915+0000","last_fullsized":"2024-04-24T13:34:33.748915+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:45.453497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"86'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589448+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:34:34.589448+0000","last_peered":"2024-04-24T13:34:34.589448+0000","last_clean":"2024-04-24T13:34:34.589448+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:34:34.589448+0000","last_undegraded":"2024-04-24T13:34:34.589448+0000","last_fullsized":"2024-04-24T13:34:34.589448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"131'28","reported_seq":143,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591594+0000","last_change":"2024-04-24T13:33:09.116807+0000","last_active":"2024-04-24T13:34:34.591594+0000","last_peered":"2024-04-24T13:34:34.591594+0000","last_clean":"2024-04-24T13:34:34.591594+0000","last_became_active":"2024-04-24T13:33:08.708911+0000","last_became_peered":"2024-04-24T13:33:08.708911+0000","last_unstale":"2024-04-24T13:34:34.591594+0000","last_undegraded":"2024-04-24T13:34:34.591594+0000","last_fullsized":"2024-04-24T13:34:34.591594+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:59.171558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":108544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":55,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.748271+0000","last_change":"2024-04-24T13:33:49.283103+0000","last_active":"2024-04-24T13:34:33.748271+0000","last_peered":"2024-04-24T13:34:33.748271+0000","last_clean":"2024-04-24T13:34:33.748271+0000","last_became_active":"2024-04-24T13:33:49.282772+0000","last_became_peered":"2024-04-24T13:33:49.282772+0000","last_unstale":"2024-04-24T13:34:33.748271+0000","last_undegraded":"2024-04-24T13:34:33.748271+0000","last_fullsized":"2024-04-24T13:34:33.748271+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:44.215595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"132'25","reported_seq":121,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591993+0000","last_change":"2024-04-24T13:33:09.934600+0000","last_active":"2024-04-24T13:34:34.591993+0000","last_peered":"2024-04-24T13:34:34.591993+0000","last_clean":"2024-04-24T13:34:34.591993+0000","last_became_active":"2024-04-24T13:33:08.732254+0000","last_became_peered":"2024-04-24T13:33:08.732254+0000","last_unstale":"2024-04-24T13:34:34.591993+0000","last_undegraded":"2024-04-24T13:34:34.591993+0000","last_fullsized":"2024-04-24T13:34:34.591993+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:35.846866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":246,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742686+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:34:33.742686+0000","last_peered":"2024-04-24T13:34:33.742686+0000","last_clean":"2024-04-24T13:34:33.742686+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:34:33.742686+0000","last_undegraded":"2024-04-24T13:34:33.742686+0000","last_fullsized":"2024-04-24T13:34:33.742686+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":55,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.753218+0000","last_change":"2024-04-24T13:33:49.295971+0000","last_active":"2024-04-24T13:34:33.753218+0000","last_peered":"2024-04-24T13:34:33.753218+0000","last_clean":"2024-04-24T13:34:33.753218+0000","last_became_active":"2024-04-24T13:33:49.294486+0000","last_became_peered":"2024-04-24T13:33:49.294486+0000","last_unstale":"2024-04-24T13:34:33.753218+0000","last_undegraded":"2024-04-24T13:34:33.753218+0000","last_fullsized":"2024-04-24T13:34:33.753218+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:53:43.527494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"105'6","reported_seq":145,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.745989+0000","last_change":"2024-04-24T13:32:32.751387+0000","last_active":"2024-04-24T13:34:33.745989+0000","last_peered":"2024-04-24T13:34:33.745989+0000","last_clean":"2024-04-24T13:34:33.745989+0000","last_became_active":"2024-04-24T13:32:32.741990+0000","last_became_peered":"2024-04-24T13:32:32.741990+0000","last_unstale":"2024-04-24T13:34:33.745989+0000","last_undegraded":"2024-04-24T13:34:33.745989+0000","last_fullsized":"2024-04-24T13:34:33.745989+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:49.789798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"131'23","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595783+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:34:34.595783+0000","last_peered":"2024-04-24T13:34:34.595783+0000","last_clean":"2024-04-24T13:34:34.595783+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:34:34.595783+0000","last_undegraded":"2024-04-24T13:34:34.595783+0000","last_fullsized":"2024-04-24T13:34:34.595783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593550+0000","last_change":"2024-04-24T13:33:08.705125+0000","last_active":"2024-04-24T13:34:34.593550+0000","last_peered":"2024-04-24T13:34:34.593550+0000","last_clean":"2024-04-24T13:34:34.593550+0000","last_became_active":"2024-04-24T13:33:08.704735+0000","last_became_peered":"2024-04-24T13:33:08.704735+0000","last_unstale":"2024-04-24T13:34:34.593550+0000","last_undegraded":"2024-04-24T13:34:34.593550+0000","last_fullsized":"2024-04-24T13:34:34.593550+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:14.183681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"132'18","reported_seq":275,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742581+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:34:33.742581+0000","last_peered":"2024-04-24T13:34:33.742581+0000","last_clean":"2024-04-24T13:34:33.742581+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:34:33.742581+0000","last_undegraded":"2024-04-24T13:34:33.742581+0000","last_fullsized":"2024-04-24T13:34:33.742581+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":254,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.745821+0000","last_change":"2024-04-24T13:33:49.289409+0000","last_active":"2024-04-24T13:34:33.745821+0000","last_peered":"2024-04-24T13:34:33.745821+0000","last_clean":"2024-04-24T13:34:33.745821+0000","last_became_active":"2024-04-24T13:33:49.288970+0000","last_became_peered":"2024-04-24T13:33:49.288970+0000","last_unstale":"2024-04-24T13:34:33.745821+0000","last_undegraded":"2024-04-24T13:34:33.745821+0000","last_fullsized":"2024-04-24T13:34:33.745821+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:39.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":244,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.586379+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:34:33.586379+0000","last_peered":"2024-04-24T13:34:33.586379+0000","last_clean":"2024-04-24T13:34:33.586379+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:34:33.586379+0000","last_undegraded":"2024-04-24T13:34:33.586379+0000","last_fullsized":"2024-04-24T13:34:33.586379+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"105'10","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592552+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:34:34.592552+0000","last_peered":"2024-04-24T13:34:34.592552+0000","last_clean":"2024-04-24T13:34:34.592552+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:34:34.592552+0000","last_undegraded":"2024-04-24T13:34:34.592552+0000","last_fullsized":"2024-04-24T13:34:34.592552+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"131'19","reported_seq":284,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.587996+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:34:33.587996+0000","last_peered":"2024-04-24T13:34:33.587996+0000","last_clean":"2024-04-24T13:34:33.587996+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:34:33.587996+0000","last_undegraded":"2024-04-24T13:34:33.587996+0000","last_fullsized":"2024-04-24T13:34:33.587996+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587731+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:34:34.587731+0000","last_peered":"2024-04-24T13:34:34.587731+0000","last_clean":"2024-04-24T13:34:34.587731+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:34:34.587731+0000","last_undegraded":"2024-04-24T13:34:34.587731+0000","last_fullsized":"2024-04-24T13:34:34.587731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"132'13","reported_seq":179,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.701363+0000","last_change":"2024-04-24T13:33:51.167111+0000","last_active":"2024-04-24T13:34:33.701363+0000","last_peered":"2024-04-24T13:34:33.701363+0000","last_clean":"2024-04-24T13:34:33.701363+0000","last_became_active":"2024-04-24T13:33:49.302159+0000","last_became_peered":"2024-04-24T13:33:49.302159+0000","last_unstale":"2024-04-24T13:34:33.701363+0000","last_undegraded":"2024-04-24T13:34:33.701363+0000","last_fullsized":"2024-04-24T13:34:33.701363+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:21.719835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588137+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:34:34.588137+0000","last_peered":"2024-04-24T13:34:34.588137+0000","last_clean":"2024-04-24T13:34:34.588137+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:34:34.588137+0000","last_undegraded":"2024-04-24T13:34:34.588137+0000","last_fullsized":"2024-04-24T13:34:34.588137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"82'2","reported_seq":59,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.752908+0000","last_change":"2024-04-24T13:33:54.657281+0000","last_active":"2024-04-24T13:34:33.752908+0000","last_peered":"2024-04-24T13:34:33.752908+0000","last_clean":"2024-04-24T13:34:33.752908+0000","last_became_active":"2024-04-24T13:33:49.303239+0000","last_became_peered":"2024-04-24T13:33:49.303239+0000","last_unstale":"2024-04-24T13:34:33.752908+0000","last_undegraded":"2024-04-24T13:34:33.752908+0000","last_fullsized":"2024-04-24T13:34:33.752908+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:32.797578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"82'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588230+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:34:34.588230+0000","last_peered":"2024-04-24T13:34:34.588230+0000","last_clean":"2024-04-24T13:34:34.588230+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:34:34.588230+0000","last_undegraded":"2024-04-24T13:34:34.588230+0000","last_fullsized":"2024-04-24T13:34:34.588230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"131'21","reported_seq":191,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.701155+0000","last_change":"2024-04-24T13:33:09.073468+0000","last_active":"2024-04-24T13:34:33.701155+0000","last_peered":"2024-04-24T13:34:33.701155+0000","last_clean":"2024-04-24T13:34:33.701155+0000","last_became_active":"2024-04-24T13:33:08.725822+0000","last_became_peered":"2024-04-24T13:33:08.725822+0000","last_unstale":"2024-04-24T13:34:33.701155+0000","last_undegraded":"2024-04-24T13:34:33.701155+0000","last_fullsized":"2024-04-24T13:34:33.701155+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:24:41.185601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":275,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743166+0000","last_change":"2024-04-24T13:33:09.078708+0000","last_active":"2024-04-24T13:34:33.743166+0000","last_peered":"2024-04-24T13:34:33.743166+0000","last_clean":"2024-04-24T13:34:33.743166+0000","last_became_active":"2024-04-24T13:33:08.726873+0000","last_became_peered":"2024-04-24T13:33:08.726873+0000","last_unstale":"2024-04-24T13:34:33.743166+0000","last_undegraded":"2024-04-24T13:34:33.743166+0000","last_fullsized":"2024-04-24T13:34:33.743166+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:53:23.482374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"132'17","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588566+0000","last_change":"2024-04-24T13:33:09.087185+0000","last_active":"2024-04-24T13:34:34.588566+0000","last_peered":"2024-04-24T13:34:34.588566+0000","last_clean":"2024-04-24T13:34:34.588566+0000","last_became_active":"2024-04-24T13:33:08.726347+0000","last_became_peered":"2024-04-24T13:33:08.726347+0000","last_unstale":"2024-04-24T13:34:34.588566+0000","last_undegraded":"2024-04-24T13:34:34.588566+0000","last_fullsized":"2024-04-24T13:34:34.588566+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:37.412890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":246,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742608+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:34:33.742608+0000","last_peered":"2024-04-24T13:34:33.742608+0000","last_clean":"2024-04-24T13:34:33.742608+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:34:33.742608+0000","last_undegraded":"2024-04-24T13:34:33.742608+0000","last_fullsized":"2024-04-24T13:34:33.742608+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589644+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:34:34.589644+0000","last_peered":"2024-04-24T13:34:34.589644+0000","last_clean":"2024-04-24T13:34:34.589644+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:34:34.589644+0000","last_undegraded":"2024-04-24T13:34:34.589644+0000","last_fullsized":"2024-04-24T13:34:34.589644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"132'10","reported_seq":300,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744388+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:34:33.744388+0000","last_peered":"2024-04-24T13:34:33.744388+0000","last_clean":"2024-04-24T13:34:33.744388+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:34:33.744388+0000","last_undegraded":"2024-04-24T13:34:33.744388+0000","last_fullsized":"2024-04-24T13:34:33.744388+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"130'14","reported_seq":275,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.745805+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:34:33.745805+0000","last_peered":"2024-04-24T13:34:33.745805+0000","last_clean":"2024-04-24T13:34:33.745805+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:34:33.745805+0000","last_undegraded":"2024-04-24T13:34:33.745805+0000","last_fullsized":"2024-04-24T13:34:33.745805+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"105'12","reported_seq":300,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743977+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:34:33.743977+0000","last_peered":"2024-04-24T13:34:33.743977+0000","last_clean":"2024-04-24T13:34:33.743977+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:34:33.743977+0000","last_undegraded":"2024-04-24T13:34:33.743977+0000","last_fullsized":"2024-04-24T13:34:33.743977+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"132'20","reported_seq":309,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.699775+0000","last_change":"2024-04-24T13:33:09.324802+0000","last_active":"2024-04-24T13:34:33.699775+0000","last_peered":"2024-04-24T13:34:33.699775+0000","last_clean":"2024-04-24T13:34:33.699775+0000","last_became_active":"2024-04-24T13:33:08.725876+0000","last_became_peered":"2024-04-24T13:33:08.725876+0000","last_unstale":"2024-04-24T13:34:33.699775+0000","last_undegraded":"2024-04-24T13:34:33.699775+0000","last_fullsized":"2024-04-24T13:34:33.699775+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:21:58.951897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"82'2","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594991+0000","last_change":"2024-04-24T13:33:53.237778+0000","last_active":"2024-04-24T13:34:34.594991+0000","last_peered":"2024-04-24T13:34:34.594991+0000","last_clean":"2024-04-24T13:34:34.594991+0000","last_became_active":"2024-04-24T13:33:49.302722+0000","last_became_peered":"2024-04-24T13:33:49.302722+0000","last_unstale":"2024-04-24T13:34:34.594991+0000","last_undegraded":"2024-04-24T13:34:34.594991+0000","last_fullsized":"2024-04-24T13:34:34.594991+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:52:06.190295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"132'28","reported_seq":143,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592901+0000","last_change":"2024-04-24T13:33:09.548908+0000","last_active":"2024-04-24T13:34:34.592901+0000","last_peered":"2024-04-24T13:34:34.592901+0000","last_clean":"2024-04-24T13:34:34.592901+0000","last_became_active":"2024-04-24T13:33:08.720010+0000","last_became_peered":"2024-04-24T13:33:08.720010+0000","last_unstale":"2024-04-24T13:34:34.592901+0000","last_undegraded":"2024-04-24T13:34:34.592901+0000","last_fullsized":"2024-04-24T13:34:34.592901+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:06.195033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"114'12","reported_seq":317,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744235+0000","last_change":"2024-04-24T13:33:49.678468+0000","last_active":"2024-04-24T13:34:33.744235+0000","last_peered":"2024-04-24T13:34:33.744235+0000","last_clean":"2024-04-24T13:34:33.744235+0000","last_became_active":"2024-04-24T13:33:49.289642+0000","last_became_peered":"2024-04-24T13:33:49.289642+0000","last_unstale":"2024-04-24T13:34:33.744235+0000","last_undegraded":"2024-04-24T13:34:33.744235+0000","last_fullsized":"2024-04-24T13:34:33.744235+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:37.408920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"132'31","reported_seq":294,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743739+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:34:33.743739+0000","last_peered":"2024-04-24T13:34:33.743739+0000","last_clean":"2024-04-24T13:34:33.743739+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:34:33.743739+0000","last_undegraded":"2024-04-24T13:34:33.743739+0000","last_fullsized":"2024-04-24T13:34:33.743739+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"132'4","reported_seq":291,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.586528+0000","last_change":"2024-04-24T13:33:51.611283+0000","last_active":"2024-04-24T13:34:33.586528+0000","last_peered":"2024-04-24T13:34:33.586528+0000","last_clean":"2024-04-24T13:34:33.586528+0000","last_became_active":"2024-04-24T13:33:49.304888+0000","last_became_peered":"2024-04-24T13:33:49.304888+0000","last_unstale":"2024-04-24T13:34:33.586528+0000","last_undegraded":"2024-04-24T13:34:33.586528+0000","last_fullsized":"2024-04-24T13:34:33.586528+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:18.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"131'22","reported_seq":286,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.586548+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:34:33.586548+0000","last_peered":"2024-04-24T13:34:33.586548+0000","last_clean":"2024-04-24T13:34:33.586548+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:34:33.586548+0000","last_undegraded":"2024-04-24T13:34:33.586548+0000","last_fullsized":"2024-04-24T13:34:33.586548+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"81'2","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589524+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:34:34.589524+0000","last_peered":"2024-04-24T13:34:34.589524+0000","last_clean":"2024-04-24T13:34:34.589524+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:34:34.589524+0000","last_undegraded":"2024-04-24T13:34:34.589524+0000","last_fullsized":"2024-04-24T13:34:34.589524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"131'18","reported_seq":282,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.744053+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:34:33.744053+0000","last_peered":"2024-04-24T13:34:33.744053+0000","last_clean":"2024-04-24T13:34:33.744053+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:34:33.744053+0000","last_undegraded":"2024-04-24T13:34:33.744053+0000","last_fullsized":"2024-04-24T13:34:33.744053+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"132'12","reported_seq":299,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.584078+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:34:33.584078+0000","last_peered":"2024-04-24T13:34:33.584078+0000","last_clean":"2024-04-24T13:34:33.584078+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:34:33.584078+0000","last_undegraded":"2024-04-24T13:34:33.584078+0000","last_fullsized":"2024-04-24T13:34:33.584078+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"131'29","reported_seq":337,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.749896+0000","last_change":"2024-04-24T13:33:50.237368+0000","last_active":"2024-04-24T13:34:33.749896+0000","last_peered":"2024-04-24T13:34:33.749896+0000","last_clean":"2024-04-24T13:34:33.749896+0000","last_became_active":"2024-04-24T13:33:49.301145+0000","last_became_peered":"2024-04-24T13:33:49.301145+0000","last_unstale":"2024-04-24T13:34:33.749896+0000","last_undegraded":"2024-04-24T13:34:33.749896+0000","last_fullsized":"2024-04-24T13:34:33.749896+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:57:21.677851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":257,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.745647+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:34:33.745647+0000","last_peered":"2024-04-24T13:34:33.745647+0000","last_clean":"2024-04-24T13:34:33.745647+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:34:33.745647+0000","last_undegraded":"2024-04-24T13:34:33.745647+0000","last_fullsized":"2024-04-24T13:34:33.745647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"131'16","reported_seq":280,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.587031+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:34:33.587031+0000","last_peered":"2024-04-24T13:34:33.587031+0000","last_clean":"2024-04-24T13:34:33.587031+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:34:33.587031+0000","last_undegraded":"2024-04-24T13:34:33.587031+0000","last_fullsized":"2024-04-24T13:34:33.587031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"105'8","reported_seq":293,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743909+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:34:33.743909+0000","last_peered":"2024-04-24T13:34:33.743909+0000","last_clean":"2024-04-24T13:34:33.743909+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:34:33.743909+0000","last_undegraded":"2024-04-24T13:34:33.743909+0000","last_fullsized":"2024-04-24T13:34:33.743909+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"131'28","reported_seq":141,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593813+0000","last_change":"2024-04-24T13:33:09.287304+0000","last_active":"2024-04-24T13:34:34.593813+0000","last_peered":"2024-04-24T13:34:34.593813+0000","last_clean":"2024-04-24T13:34:34.593813+0000","last_became_active":"2024-04-24T13:33:08.716282+0000","last_became_peered":"2024-04-24T13:33:08.716282+0000","last_unstale":"2024-04-24T13:34:34.593813+0000","last_undegraded":"2024-04-24T13:34:34.593813+0000","last_fullsized":"2024-04-24T13:34:34.593813+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591204+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:34:34.591204+0000","last_peered":"2024-04-24T13:34:34.591204+0000","last_clean":"2024-04-24T13:34:34.591204+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:34:34.591204+0000","last_undegraded":"2024-04-24T13:34:34.591204+0000","last_fullsized":"2024-04-24T13:34:34.591204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"132'28","reported_seq":292,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.584520+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:34:33.584520+0000","last_peered":"2024-04-24T13:34:33.584520+0000","last_clean":"2024-04-24T13:34:33.584520+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:34:33.584520+0000","last_undegraded":"2024-04-24T13:34:33.584520+0000","last_fullsized":"2024-04-24T13:34:33.584520+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":257,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.701523+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:34:33.701523+0000","last_peered":"2024-04-24T13:34:33.701523+0000","last_clean":"2024-04-24T13:34:33.701523+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:34:33.701523+0000","last_undegraded":"2024-04-24T13:34:33.701523+0000","last_fullsized":"2024-04-24T13:34:33.701523+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"131'23","reported_seq":165,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592406+0000","last_change":"2024-04-24T13:33:51.593184+0000","last_active":"2024-04-24T13:34:34.592406+0000","last_peered":"2024-04-24T13:34:34.592406+0000","last_clean":"2024-04-24T13:34:34.592406+0000","last_became_active":"2024-04-24T13:33:49.289463+0000","last_became_peered":"2024-04-24T13:33:49.289463+0000","last_unstale":"2024-04-24T13:34:34.592406+0000","last_undegraded":"2024-04-24T13:34:34.592406+0000","last_fullsized":"2024-04-24T13:34:34.592406+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:42:20.618809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"82'6","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590679+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:34:34.590679+0000","last_peered":"2024-04-24T13:34:34.590679+0000","last_clean":"2024-04-24T13:34:34.590679+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:34:34.590679+0000","last_undegraded":"2024-04-24T13:34:34.590679+0000","last_fullsized":"2024-04-24T13:34:34.590679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"131'24","reported_seq":332,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743939+0000","last_change":"2024-04-24T13:33:52.627571+0000","last_active":"2024-04-24T13:34:33.743939+0000","last_peered":"2024-04-24T13:34:33.743939+0000","last_clean":"2024-04-24T13:34:33.743939+0000","last_became_active":"2024-04-24T13:33:49.302184+0000","last_became_peered":"2024-04-24T13:33:49.302184+0000","last_unstale":"2024-04-24T13:34:33.743939+0000","last_undegraded":"2024-04-24T13:34:33.743939+0000","last_fullsized":"2024-04-24T13:34:33.743939+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:16:24.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":69206016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"82'2","reported_seq":59,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.751646+0000","last_change":"2024-04-24T13:33:53.884916+0000","last_active":"2024-04-24T13:34:33.751646+0000","last_peered":"2024-04-24T13:34:33.751646+0000","last_clean":"2024-04-24T13:34:33.751646+0000","last_became_active":"2024-04-24T13:33:49.300182+0000","last_became_peered":"2024-04-24T13:33:49.300182+0000","last_unstale":"2024-04-24T13:34:33.751646+0000","last_undegraded":"2024-04-24T13:34:33.751646+0000","last_fullsized":"2024-04-24T13:34:33.751646+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:30.442779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"132'30","reported_seq":290,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.749240+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:34:33.749240+0000","last_peered":"2024-04-24T13:34:33.749240+0000","last_clean":"2024-04-24T13:34:33.749240+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:34:33.749240+0000","last_undegraded":"2024-04-24T13:34:33.749240+0000","last_fullsized":"2024-04-24T13:34:33.749240+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"82'4","reported_seq":275,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.742913+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:34:33.742913+0000","last_peered":"2024-04-24T13:34:33.742913+0000","last_clean":"2024-04-24T13:34:33.742913+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:34:33.742913+0000","last_undegraded":"2024-04-24T13:34:33.742913+0000","last_fullsized":"2024-04-24T13:34:33.742913+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"131'17","reported_seq":87,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.752440+0000","last_change":"2024-04-24T13:33:54.184096+0000","last_active":"2024-04-24T13:34:33.752440+0000","last_peered":"2024-04-24T13:34:33.752440+0000","last_clean":"2024-04-24T13:34:33.752440+0000","last_became_active":"2024-04-24T13:33:49.299554+0000","last_became_peered":"2024-04-24T13:33:49.299554+0000","last_unstale":"2024-04-24T13:34:33.752440+0000","last_undegraded":"2024-04-24T13:34:33.752440+0000","last_fullsized":"2024-04-24T13:34:33.752440+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:18.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69206016,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"82'2","reported_seq":269,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.583982+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:34:33.583982+0000","last_peered":"2024-04-24T13:34:33.583982+0000","last_clean":"2024-04-24T13:34:33.583982+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:34:33.583982+0000","last_undegraded":"2024-04-24T13:34:33.583982+0000","last_fullsized":"2024-04-24T13:34:33.583982+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"131'18","reported_seq":279,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.702716+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:34:33.702716+0000","last_peered":"2024-04-24T13:34:33.702716+0000","last_clean":"2024-04-24T13:34:33.702716+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:34:33.702716+0000","last_undegraded":"2024-04-24T13:34:33.702716+0000","last_fullsized":"2024-04-24T13:34:33.702716+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":55,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.746534+0000","last_change":"2024-04-24T13:33:49.302008+0000","last_active":"2024-04-24T13:34:33.746534+0000","last_peered":"2024-04-24T13:34:33.746534+0000","last_clean":"2024-04-24T13:34:33.746534+0000","last_became_active":"2024-04-24T13:33:49.300135+0000","last_became_peered":"2024-04-24T13:33:49.300135+0000","last_unstale":"2024-04-24T13:34:33.746534+0000","last_undegraded":"2024-04-24T13:34:33.746534+0000","last_fullsized":"2024-04-24T13:34:33.746534+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:02.680781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"131'24","reported_seq":177,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595741+0000","last_change":"2024-04-24T13:33:53.222020+0000","last_active":"2024-04-24T13:34:34.595741+0000","last_peered":"2024-04-24T13:34:34.595741+0000","last_clean":"2024-04-24T13:34:34.595741+0000","last_became_active":"2024-04-24T13:33:49.292734+0000","last_became_peered":"2024-04-24T13:33:49.292734+0000","last_unstale":"2024-04-24T13:34:34.595741+0000","last_undegraded":"2024-04-24T13:34:34.595741+0000","last_fullsized":"2024-04-24T13:34:34.595741+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:13.333265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"131'25","reported_seq":139,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594450+0000","last_change":"2024-04-24T13:33:10.398117+0000","last_active":"2024-04-24T13:34:34.594450+0000","last_peered":"2024-04-24T13:34:34.594450+0000","last_clean":"2024-04-24T13:34:34.594450+0000","last_became_active":"2024-04-24T13:33:08.735696+0000","last_became_peered":"2024-04-24T13:33:08.735696+0000","last_unstale":"2024-04-24T13:34:34.594450+0000","last_undegraded":"2024-04-24T13:34:34.594450+0000","last_fullsized":"2024-04-24T13:34:34.594450+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:01:26.139144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"82'2","reported_seq":266,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743691+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:34:33.743691+0000","last_peered":"2024-04-24T13:34:33.743691+0000","last_clean":"2024-04-24T13:34:33.743691+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:34:33.743691+0000","last_undegraded":"2024-04-24T13:34:33.743691+0000","last_fullsized":"2024-04-24T13:34:33.743691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"132'17","reported_seq":281,"reported_epoch":149,"state":"active+clean","last_fresh":"2024-04-24T13:34:33.743683+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:34:33.743683+0000","last_peered":"2024-04-24T13:34:33.743683+0000","last_clean":"2024-04-24T13:34:33.743683+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:34:33.743683+0000","last_undegraded":"2024-04-24T13:34:33.743683+0000","last_fullsized":"2024-04-24T13:34:33.743683+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"82'6","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595392+0000","last_change":"2024-04-24T13:33:09.917888+0000","last_active":"2024-04-24T13:34:34.595392+0000","last_peered":"2024-04-24T13:34:34.595392+0000","last_clean":"2024-04-24T13:34:34.595392+0000","last_became_active":"2024-04-24T13:33:08.732489+0000","last_became_peered":"2024-04-24T13:33:08.732489+0000","last_unstale":"2024-04-24T13:34:34.595392+0000","last_undegraded":"2024-04-24T13:34:34.595392+0000","last_fullsized":"2024-04-24T13:34:34.595392+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:16.213872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":342,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":194,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1083,"ondisk_log_size":1083,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":378948,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":842,"num_read_kb":607,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":143,"num_bytes_recovered":62549,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":339,"num_read_kb":339,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2233,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1458,"num_read_kb":1426,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":449,"num_bytes_recovered":1849688064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574905,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1887064,"kb_used_data":1851724,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92484776,"statfs":{"total":96636764160,"available":94704410624,"internally_reserved":0,"allocated":1896165376,"data_stored":1895407851,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574905,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1192124,"kb_used_data":1160944,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93179716,"statfs":{"total":96636764160,"available":95416029184,"internally_reserved":0,"allocated":1188806656,"data_stored":1188076599,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":3,"apply_latency_ms":3,"commit_latency_ns":3000000,"apply_latency_ns":3000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574906,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2087588,"kb_used_data":2052240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92284252,"statfs":{"total":96636764160,"available":94499074048,"internally_reserved":0,"allocated":2101493760,"data_stored":2100698156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574906,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1542340,"kb_used_data":1511152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92829500,"statfs":{"total":96636764160,"available":95057408000,"internally_reserved":0,"allocated":1547419648,"data_stored":1546697053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574905,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2030028,"kb_used_data":1994680,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92341812,"statfs":{"total":96636764160,"available":94558015488,"internally_reserved":0,"allocated":2042552320,"data_stored":2041794124,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574906,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1169660,"kb_used_data":1134320,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93202180,"statfs":{"total":96636764160,"available":95439032320,"internally_reserved":0,"allocated":1161543680,"data_stored":1160813863,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574907,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":983500,"kb_used_data":948160,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93388340,"statfs":{"total":96636764160,"available":95629660160,"internally_reserved":0,"allocated":970915840,"data_stored":970150220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574906,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1702732,"kb_used_data":1667388,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92669108,"statfs":{"total":96636764160,"available":94893166592,"internally_reserved":0,"allocated":1707405312,"data_stored":1706664134,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1704984576,"data_stored":1704984576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":968884224,"data_stored":968884224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1159725056,"data_stored":1159725056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2040528896,"data_stored":2040528896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1545601024,"data_stored":1545601024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2099249152,"data_stored":2099249152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1186988032,"data_stored":1186988032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1893728256,"data_stored":1893728256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":176376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":177072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":351674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:34:39.250 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:34:39.606 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:34:39.617 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:34:39.630 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":279,"stamp":"2024-04-24T13:34:39.324475+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300815940,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3149,"num_read_kb":2838,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":669,"num_bytes_recovered":1850933776,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3902,"ondisk_log_size":3902,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12595100,"kb_used_data":12320680,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":742379620,"statfs":{"total":773094113280,"available":760196730880,"internally_reserved":0,"allocated":12616376320,"data_stored":12610349784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":280874545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":7,"apply_latency_ms":7,"commit_latency_ns":7000000,"apply_latency_ns":7000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"6.766157"},"pg_stats":[{"pgid":"3.3f","version":"131'18","reported_seq":92,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669607+0000","last_change":"2024-04-24T13:33:52.298396+0000","last_active":"2024-04-24T13:34:35.669607+0000","last_peered":"2024-04-24T13:34:35.669607+0000","last_clean":"2024-04-24T13:34:35.669607+0000","last_became_active":"2024-04-24T13:33:49.293106+0000","last_became_peered":"2024-04-24T13:33:49.293106+0000","last_unstale":"2024-04-24T13:34:35.669607+0000","last_undegraded":"2024-04-24T13:34:35.669607+0000","last_fullsized":"2024-04-24T13:34:35.669607+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:44.520756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"82'14","reported_seq":309,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594851+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:34:34.594851+0000","last_peered":"2024-04-24T13:34:34.594851+0000","last_clean":"2024-04-24T13:34:34.594851+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:34:34.594851+0000","last_undegraded":"2024-04-24T13:34:34.594851+0000","last_fullsized":"2024-04-24T13:34:34.594851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"132'18","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.531293+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:34:35.531293+0000","last_peered":"2024-04-24T13:34:35.531293+0000","last_clean":"2024-04-24T13:34:35.531293+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:34:35.531293+0000","last_undegraded":"2024-04-24T13:34:35.531293+0000","last_fullsized":"2024-04-24T13:34:35.531293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"82'4","reported_seq":63,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669845+0000","last_change":"2024-04-24T13:33:52.687680+0000","last_active":"2024-04-24T13:34:35.669845+0000","last_peered":"2024-04-24T13:34:35.669845+0000","last_clean":"2024-04-24T13:34:35.669845+0000","last_became_active":"2024-04-24T13:33:49.293840+0000","last_became_peered":"2024-04-24T13:33:49.293840+0000","last_unstale":"2024-04-24T13:34:35.669845+0000","last_undegraded":"2024-04-24T13:34:35.669845+0000","last_fullsized":"2024-04-24T13:34:35.669845+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:13:31.744087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"131'17","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667042+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:34:35.667042+0000","last_peered":"2024-04-24T13:34:35.667042+0000","last_clean":"2024-04-24T13:34:35.667042+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:34:35.667042+0000","last_undegraded":"2024-04-24T13:34:35.667042+0000","last_fullsized":"2024-04-24T13:34:35.667042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":27,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589257+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:34:34.589257+0000","last_peered":"2024-04-24T13:34:34.589257+0000","last_clean":"2024-04-24T13:34:34.589257+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:34:34.589257+0000","last_undegraded":"2024-04-24T13:34:34.589257+0000","last_fullsized":"2024-04-24T13:34:34.589257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"132'25","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594720+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:34:34.594720+0000","last_peered":"2024-04-24T13:34:34.594720+0000","last_clean":"2024-04-24T13:34:34.594720+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:34:34.594720+0000","last_undegraded":"2024-04-24T13:34:34.594720+0000","last_fullsized":"2024-04-24T13:34:34.594720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"132'6","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666016+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:34:35.666016+0000","last_peered":"2024-04-24T13:34:35.666016+0000","last_clean":"2024-04-24T13:34:35.666016+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:34:35.666016+0000","last_undegraded":"2024-04-24T13:34:35.666016+0000","last_fullsized":"2024-04-24T13:34:35.666016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"132'34","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668947+0000","last_change":"2024-04-24T13:33:53.650464+0000","last_active":"2024-04-24T13:34:35.668947+0000","last_peered":"2024-04-24T13:34:35.668947+0000","last_clean":"2024-04-24T13:34:35.668947+0000","last_became_active":"2024-04-24T13:33:49.299781+0000","last_became_peered":"2024-04-24T13:33:49.299781+0000","last_unstale":"2024-04-24T13:34:35.668947+0000","last_undegraded":"2024-04-24T13:34:35.668947+0000","last_fullsized":"2024-04-24T13:34:35.668947+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:08.408193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"82'2","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668172+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:34:35.668172+0000","last_peered":"2024-04-24T13:34:35.668172+0000","last_clean":"2024-04-24T13:34:35.668172+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:34:35.668172+0000","last_undegraded":"2024-04-24T13:34:35.668172+0000","last_fullsized":"2024-04-24T13:34:35.668172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"131'30","reported_seq":298,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593034+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:34:34.593034+0000","last_peered":"2024-04-24T13:34:34.593034+0000","last_clean":"2024-04-24T13:34:34.593034+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:34:34.593034+0000","last_undegraded":"2024-04-24T13:34:34.593034+0000","last_fullsized":"2024-04-24T13:34:34.593034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"82'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590410+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:34:34.590410+0000","last_peered":"2024-04-24T13:34:34.590410+0000","last_clean":"2024-04-24T13:34:34.590410+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:34:34.590410+0000","last_undegraded":"2024-04-24T13:34:34.590410+0000","last_fullsized":"2024-04-24T13:34:34.590410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"131'29","reported_seq":109,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668747+0000","last_change":"2024-04-24T13:33:51.145800+0000","last_active":"2024-04-24T13:34:35.668747+0000","last_peered":"2024-04-24T13:34:35.668747+0000","last_clean":"2024-04-24T13:34:35.668747+0000","last_became_active":"2024-04-24T13:33:49.287926+0000","last_became_peered":"2024-04-24T13:33:49.287926+0000","last_unstale":"2024-04-24T13:34:35.668747+0000","last_undegraded":"2024-04-24T13:34:35.668747+0000","last_fullsized":"2024-04-24T13:34:35.668747+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:22.605125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"82'2","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595672+0000","last_change":"2024-04-24T13:33:09.792748+0000","last_active":"2024-04-24T13:34:34.595672+0000","last_peered":"2024-04-24T13:34:34.595672+0000","last_clean":"2024-04-24T13:34:34.595672+0000","last_became_active":"2024-04-24T13:33:08.725324+0000","last_became_peered":"2024-04-24T13:33:08.725324+0000","last_unstale":"2024-04-24T13:34:34.595672+0000","last_undegraded":"2024-04-24T13:34:34.595672+0000","last_fullsized":"2024-04-24T13:34:34.595672+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:20.696769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"131'18","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554234+0000","last_change":"2024-04-24T13:33:08.836525+0000","last_active":"2024-04-24T13:34:35.554234+0000","last_peered":"2024-04-24T13:34:35.554234+0000","last_clean":"2024-04-24T13:34:35.554234+0000","last_became_active":"2024-04-24T13:33:08.720200+0000","last_became_peered":"2024-04-24T13:33:08.720200+0000","last_unstale":"2024-04-24T13:34:35.554234+0000","last_undegraded":"2024-04-24T13:34:35.554234+0000","last_fullsized":"2024-04-24T13:34:35.554234+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:31.093323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"82'6","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666260+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:34:35.666260+0000","last_peered":"2024-04-24T13:34:35.666260+0000","last_clean":"2024-04-24T13:34:35.666260+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:34:35.666260+0000","last_undegraded":"2024-04-24T13:34:35.666260+0000","last_fullsized":"2024-04-24T13:34:35.666260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"86'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588496+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:34:34.588496+0000","last_peered":"2024-04-24T13:34:34.588496+0000","last_clean":"2024-04-24T13:34:34.588496+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:34:34.588496+0000","last_undegraded":"2024-04-24T13:34:34.588496+0000","last_fullsized":"2024-04-24T13:34:34.588496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"131'24","reported_seq":101,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670455+0000","last_change":"2024-04-24T13:33:51.801208+0000","last_active":"2024-04-24T13:34:35.670455+0000","last_peered":"2024-04-24T13:34:35.670455+0000","last_clean":"2024-04-24T13:34:35.670455+0000","last_became_active":"2024-04-24T13:33:49.287950+0000","last_became_peered":"2024-04-24T13:33:49.287950+0000","last_unstale":"2024-04-24T13:34:35.670455+0000","last_undegraded":"2024-04-24T13:34:35.670455+0000","last_fullsized":"2024-04-24T13:34:35.670455+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:09.811184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"82'4","reported_seq":63,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670154+0000","last_change":"2024-04-24T13:33:53.106900+0000","last_active":"2024-04-24T13:34:35.670154+0000","last_peered":"2024-04-24T13:34:35.670154+0000","last_clean":"2024-04-24T13:34:35.670154+0000","last_became_active":"2024-04-24T13:33:49.294597+0000","last_became_peered":"2024-04-24T13:33:49.294597+0000","last_unstale":"2024-04-24T13:34:35.670154+0000","last_undegraded":"2024-04-24T13:34:35.670154+0000","last_fullsized":"2024-04-24T13:34:35.670154+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:28.384262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"131'28","reported_seq":319,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671293+0000","last_change":"2024-04-24T13:33:08.998015+0000","last_active":"2024-04-24T13:34:35.671293+0000","last_peered":"2024-04-24T13:34:35.671293+0000","last_clean":"2024-04-24T13:34:35.671293+0000","last_became_active":"2024-04-24T13:33:08.726581+0000","last_became_peered":"2024-04-24T13:33:08.726581+0000","last_unstale":"2024-04-24T13:34:35.671293+0000","last_undegraded":"2024-04-24T13:34:35.671293+0000","last_fullsized":"2024-04-24T13:34:35.671293+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:03:25.814262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"86'6","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592134+0000","last_change":"2024-04-24T13:33:09.293808+0000","last_active":"2024-04-24T13:34:34.592134+0000","last_peered":"2024-04-24T13:34:34.592134+0000","last_clean":"2024-04-24T13:34:34.592134+0000","last_became_active":"2024-04-24T13:33:08.719391+0000","last_became_peered":"2024-04-24T13:33:08.719391+0000","last_unstale":"2024-04-24T13:34:34.592134+0000","last_undegraded":"2024-04-24T13:34:34.592134+0000","last_fullsized":"2024-04-24T13:34:34.592134+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:10.422756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"132'22","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670992+0000","last_change":"2024-04-24T13:33:09.199641+0000","last_active":"2024-04-24T13:34:35.670992+0000","last_peered":"2024-04-24T13:34:35.670992+0000","last_clean":"2024-04-24T13:34:35.670992+0000","last_became_active":"2024-04-24T13:33:08.737789+0000","last_became_peered":"2024-04-24T13:33:08.737789+0000","last_unstale":"2024-04-24T13:34:35.670992+0000","last_undegraded":"2024-04-24T13:34:35.670992+0000","last_fullsized":"2024-04-24T13:34:35.670992+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:41.648006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665653+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:34:35.665653+0000","last_peered":"2024-04-24T13:34:35.665653+0000","last_clean":"2024-04-24T13:34:35.665653+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:34:35.665653+0000","last_undegraded":"2024-04-24T13:34:35.665653+0000","last_fullsized":"2024-04-24T13:34:35.665653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"132'24","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590031+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:34:34.590031+0000","last_peered":"2024-04-24T13:34:34.590031+0000","last_clean":"2024-04-24T13:34:34.590031+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:34:34.590031+0000","last_undegraded":"2024-04-24T13:34:34.590031+0000","last_fullsized":"2024-04-24T13:34:34.590031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"132'6","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665503+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:34:35.665503+0000","last_peered":"2024-04-24T13:34:35.665503+0000","last_clean":"2024-04-24T13:34:35.665503+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:34:35.665503+0000","last_undegraded":"2024-04-24T13:34:35.665503+0000","last_fullsized":"2024-04-24T13:34:35.665503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"131'23","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554652+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:34:35.554652+0000","last_peered":"2024-04-24T13:34:35.554652+0000","last_clean":"2024-04-24T13:34:35.554652+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:34:35.554652+0000","last_undegraded":"2024-04-24T13:34:35.554652+0000","last_fullsized":"2024-04-24T13:34:35.554652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590560+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:34:34.590560+0000","last_peered":"2024-04-24T13:34:34.590560+0000","last_clean":"2024-04-24T13:34:34.590560+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:34:34.590560+0000","last_undegraded":"2024-04-24T13:34:34.590560+0000","last_fullsized":"2024-04-24T13:34:34.590560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"132'25","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665634+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:34:35.665634+0000","last_peered":"2024-04-24T13:34:35.665634+0000","last_clean":"2024-04-24T13:34:35.665634+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:34:35.665634+0000","last_undegraded":"2024-04-24T13:34:35.665634+0000","last_fullsized":"2024-04-24T13:34:35.665634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587703+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:34:34.587703+0000","last_peered":"2024-04-24T13:34:34.587703+0000","last_clean":"2024-04-24T13:34:34.587703+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:34:34.587703+0000","last_undegraded":"2024-04-24T13:34:34.587703+0000","last_fullsized":"2024-04-24T13:34:34.587703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"82'2","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556467+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:34:35.556467+0000","last_peered":"2024-04-24T13:34:35.556467+0000","last_clean":"2024-04-24T13:34:35.556467+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:34:35.556467+0000","last_undegraded":"2024-04-24T13:34:35.556467+0000","last_fullsized":"2024-04-24T13:34:35.556467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"132'27","reported_seq":105,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668651+0000","last_change":"2024-04-24T13:33:49.775824+0000","last_active":"2024-04-24T13:34:35.668651+0000","last_peered":"2024-04-24T13:34:35.668651+0000","last_clean":"2024-04-24T13:34:35.668651+0000","last_became_active":"2024-04-24T13:33:49.282849+0000","last_became_peered":"2024-04-24T13:33:49.282849+0000","last_unstale":"2024-04-24T13:34:35.668651+0000","last_undegraded":"2024-04-24T13:34:35.668651+0000","last_fullsized":"2024-04-24T13:34:35.668651+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:12:15.350559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595154+0000","last_change":"2024-04-24T13:33:10.797093+0000","last_active":"2024-04-24T13:34:34.595154+0000","last_peered":"2024-04-24T13:34:34.595154+0000","last_clean":"2024-04-24T13:34:34.595154+0000","last_became_active":"2024-04-24T13:33:08.736087+0000","last_became_peered":"2024-04-24T13:33:08.736087+0000","last_unstale":"2024-04-24T13:34:34.595154+0000","last_undegraded":"2024-04-24T13:34:34.595154+0000","last_fullsized":"2024-04-24T13:34:34.595154+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:49:31.056251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"132'17","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667818+0000","last_change":"2024-04-24T13:33:51.608371+0000","last_active":"2024-04-24T13:34:35.667818+0000","last_peered":"2024-04-24T13:34:35.667818+0000","last_clean":"2024-04-24T13:34:35.667818+0000","last_became_active":"2024-04-24T13:33:49.295172+0000","last_became_peered":"2024-04-24T13:33:49.295172+0000","last_unstale":"2024-04-24T13:34:35.667818+0000","last_undegraded":"2024-04-24T13:34:35.667818+0000","last_fullsized":"2024-04-24T13:34:35.667818+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:46:40.352367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670310+0000","last_change":"2024-04-24T13:33:49.295489+0000","last_active":"2024-04-24T13:34:35.670310+0000","last_peered":"2024-04-24T13:34:35.670310+0000","last_clean":"2024-04-24T13:34:35.670310+0000","last_became_active":"2024-04-24T13:33:49.292611+0000","last_became_peered":"2024-04-24T13:33:49.292611+0000","last_unstale":"2024-04-24T13:34:35.670310+0000","last_undegraded":"2024-04-24T13:34:35.670310+0000","last_fullsized":"2024-04-24T13:34:35.670310+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:52:22.537619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"132'48","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592278+0000","last_change":"2024-04-24T13:33:08.911162+0000","last_active":"2024-04-24T13:34:34.592278+0000","last_peered":"2024-04-24T13:34:34.592278+0000","last_clean":"2024-04-24T13:34:34.592278+0000","last_became_active":"2024-04-24T13:33:08.709158+0000","last_became_peered":"2024-04-24T13:33:08.709158+0000","last_unstale":"2024-04-24T13:34:34.592278+0000","last_undegraded":"2024-04-24T13:34:34.592278+0000","last_fullsized":"2024-04-24T13:34:34.592278+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:56.162767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"82'4","reported_seq":119,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595727+0000","last_change":"2024-04-24T13:33:53.234461+0000","last_active":"2024-04-24T13:34:34.595727+0000","last_peered":"2024-04-24T13:34:34.595727+0000","last_clean":"2024-04-24T13:34:34.595727+0000","last_became_active":"2024-04-24T13:33:49.302172+0000","last_became_peered":"2024-04-24T13:33:49.302172+0000","last_unstale":"2024-04-24T13:34:34.595727+0000","last_undegraded":"2024-04-24T13:34:34.595727+0000","last_fullsized":"2024-04-24T13:34:34.595727+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:55:38.136746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"131'19","reported_seq":323,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665731+0000","last_change":"2024-04-24T13:33:49.666596+0000","last_active":"2024-04-24T13:34:35.665731+0000","last_peered":"2024-04-24T13:34:35.665731+0000","last_clean":"2024-04-24T13:34:35.665731+0000","last_became_active":"2024-04-24T13:33:49.283461+0000","last_became_peered":"2024-04-24T13:33:49.283461+0000","last_unstale":"2024-04-24T13:34:35.665731+0000","last_undegraded":"2024-04-24T13:34:35.665731+0000","last_fullsized":"2024-04-24T13:34:35.665731+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:49:27.034645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556319+0000","last_change":"2024-04-24T13:33:49.301406+0000","last_active":"2024-04-24T13:34:35.556319+0000","last_peered":"2024-04-24T13:34:35.556319+0000","last_clean":"2024-04-24T13:34:35.556319+0000","last_became_active":"2024-04-24T13:33:49.300648+0000","last_became_peered":"2024-04-24T13:33:49.300648+0000","last_unstale":"2024-04-24T13:34:35.556319+0000","last_undegraded":"2024-04-24T13:34:35.556319+0000","last_fullsized":"2024-04-24T13:34:35.556319+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:41:13.998419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590838+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:34:34.590838+0000","last_peered":"2024-04-24T13:34:34.590838+0000","last_clean":"2024-04-24T13:34:34.590838+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:34:34.590838+0000","last_undegraded":"2024-04-24T13:34:34.590838+0000","last_fullsized":"2024-04-24T13:34:34.590838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590524+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:34:34.590524+0000","last_peered":"2024-04-24T13:34:34.590524+0000","last_clean":"2024-04-24T13:34:34.590524+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:34:34.590524+0000","last_undegraded":"2024-04-24T13:34:34.590524+0000","last_fullsized":"2024-04-24T13:34:34.590524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665370+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:34:35.665370+0000","last_peered":"2024-04-24T13:34:35.665370+0000","last_clean":"2024-04-24T13:34:35.665370+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:34:35.665370+0000","last_undegraded":"2024-04-24T13:34:35.665370+0000","last_fullsized":"2024-04-24T13:34:35.665370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"86'10","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667179+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:34:35.667179+0000","last_peered":"2024-04-24T13:34:35.667179+0000","last_clean":"2024-04-24T13:34:35.667179+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:34:35.667179+0000","last_undegraded":"2024-04-24T13:34:35.667179+0000","last_fullsized":"2024-04-24T13:34:35.667179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"132'24","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668571+0000","last_change":"2024-04-24T13:33:50.330934+0000","last_active":"2024-04-24T13:34:35.668571+0000","last_peered":"2024-04-24T13:34:35.668571+0000","last_clean":"2024-04-24T13:34:35.668571+0000","last_became_active":"2024-04-24T13:33:49.286157+0000","last_became_peered":"2024-04-24T13:33:49.286157+0000","last_unstale":"2024-04-24T13:34:35.668571+0000","last_undegraded":"2024-04-24T13:34:35.668571+0000","last_fullsized":"2024-04-24T13:34:35.668571+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:10.162075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.557008+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:34:35.557008+0000","last_peered":"2024-04-24T13:34:35.557008+0000","last_clean":"2024-04-24T13:34:35.557008+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:34:35.557008+0000","last_undegraded":"2024-04-24T13:34:35.557008+0000","last_fullsized":"2024-04-24T13:34:35.557008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664419+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:34:35.664419+0000","last_peered":"2024-04-24T13:34:35.664419+0000","last_clean":"2024-04-24T13:34:35.664419+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:34:35.664419+0000","last_undegraded":"2024-04-24T13:34:35.664419+0000","last_fullsized":"2024-04-24T13:34:35.664419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"132'138","reported_seq":425,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670562+0000","last_change":"2024-04-24T13:33:52.550604+0000","last_active":"2024-04-24T13:34:35.670562+0000","last_peered":"2024-04-24T13:34:35.670562+0000","last_clean":"2024-04-24T13:34:35.670562+0000","last_became_active":"2024-04-24T13:33:52.550123+0000","last_became_peered":"2024-04-24T13:33:52.550123+0000","last_unstale":"2024-04-24T13:34:35.670562+0000","last_undegraded":"2024-04-24T13:34:35.670562+0000","last_fullsized":"2024-04-24T13:34:35.670562+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:09:41.226875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"105'8","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588558+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:34:34.588558+0000","last_peered":"2024-04-24T13:34:34.588558+0000","last_clean":"2024-04-24T13:34:34.588558+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:34:34.588558+0000","last_undegraded":"2024-04-24T13:34:34.588558+0000","last_fullsized":"2024-04-24T13:34:34.588558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"132'4","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556508+0000","last_change":"2024-04-24T13:33:51.170660+0000","last_active":"2024-04-24T13:34:35.556508+0000","last_peered":"2024-04-24T13:34:35.556508+0000","last_clean":"2024-04-24T13:34:35.556508+0000","last_became_active":"2024-04-24T13:33:49.301591+0000","last_became_peered":"2024-04-24T13:33:49.301591+0000","last_unstale":"2024-04-24T13:34:35.556508+0000","last_undegraded":"2024-04-24T13:34:35.556508+0000","last_fullsized":"2024-04-24T13:34:35.556508+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:16:26.080736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"132'27","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667008+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:34:35.667008+0000","last_peered":"2024-04-24T13:34:35.667008+0000","last_clean":"2024-04-24T13:34:35.667008+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:34:35.667008+0000","last_undegraded":"2024-04-24T13:34:35.667008+0000","last_fullsized":"2024-04-24T13:34:35.667008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595591+0000","last_change":"2024-04-24T13:33:08.718010+0000","last_active":"2024-04-24T13:34:34.595591+0000","last_peered":"2024-04-24T13:34:34.595591+0000","last_clean":"2024-04-24T13:34:34.595591+0000","last_became_active":"2024-04-24T13:33:08.716072+0000","last_became_peered":"2024-04-24T13:33:08.716072+0000","last_unstale":"2024-04-24T13:34:34.595591+0000","last_undegraded":"2024-04-24T13:34:34.595591+0000","last_fullsized":"2024-04-24T13:34:34.595591+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:26.626730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"132'17","reported_seq":68,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669637+0000","last_change":"2024-04-24T13:33:52.725009+0000","last_active":"2024-04-24T13:34:35.669637+0000","last_peered":"2024-04-24T13:34:35.669637+0000","last_clean":"2024-04-24T13:34:35.669637+0000","last_became_active":"2024-04-24T13:33:49.294133+0000","last_became_peered":"2024-04-24T13:33:49.294133+0000","last_unstale":"2024-04-24T13:34:35.669637+0000","last_undegraded":"2024-04-24T13:34:35.669637+0000","last_fullsized":"2024-04-24T13:34:35.669637+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:51.462917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"132'134","reported_seq":464,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556000+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:34:35.556000+0000","last_peered":"2024-04-24T13:34:35.556000+0000","last_clean":"2024-04-24T13:34:35.556000+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:34:35.556000+0000","last_undegraded":"2024-04-24T13:34:35.556000+0000","last_fullsized":"2024-04-24T13:34:35.556000+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"82'2","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594248+0000","last_change":"2024-04-24T13:33:49.308248+0000","last_active":"2024-04-24T13:34:34.594248+0000","last_peered":"2024-04-24T13:34:34.594248+0000","last_clean":"2024-04-24T13:34:34.594248+0000","last_became_active":"2024-04-24T13:33:49.278105+0000","last_became_peered":"2024-04-24T13:33:49.278105+0000","last_unstale":"2024-04-24T13:34:34.594248+0000","last_undegraded":"2024-04-24T13:34:34.594248+0000","last_fullsized":"2024-04-24T13:34:34.594248+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:20.068883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"132'25","reported_seq":97,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669876+0000","last_change":"2024-04-24T13:33:53.103595+0000","last_active":"2024-04-24T13:34:35.669876+0000","last_peered":"2024-04-24T13:34:35.669876+0000","last_clean":"2024-04-24T13:34:35.669876+0000","last_became_active":"2024-04-24T13:33:49.297787+0000","last_became_peered":"2024-04-24T13:33:49.297787+0000","last_unstale":"2024-04-24T13:34:35.669876+0000","last_undegraded":"2024-04-24T13:34:35.669876+0000","last_fullsized":"2024-04-24T13:34:35.669876+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668999+0000","last_change":"2024-04-24T13:33:49.299431+0000","last_active":"2024-04-24T13:34:35.668999+0000","last_peered":"2024-04-24T13:34:35.668999+0000","last_clean":"2024-04-24T13:34:35.668999+0000","last_became_active":"2024-04-24T13:33:49.294593+0000","last_became_peered":"2024-04-24T13:33:49.294593+0000","last_unstale":"2024-04-24T13:34:35.668999+0000","last_undegraded":"2024-04-24T13:34:35.668999+0000","last_fullsized":"2024-04-24T13:34:35.668999+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:36.135388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"132'28","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592767+0000","last_change":"2024-04-24T13:33:10.421787+0000","last_active":"2024-04-24T13:34:34.592767+0000","last_peered":"2024-04-24T13:34:34.592767+0000","last_clean":"2024-04-24T13:34:34.592767+0000","last_became_active":"2024-04-24T13:33:08.733302+0000","last_became_peered":"2024-04-24T13:33:08.733302+0000","last_unstale":"2024-04-24T13:34:34.592767+0000","last_undegraded":"2024-04-24T13:34:34.592767+0000","last_fullsized":"2024-04-24T13:34:34.592767+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:10:16.339117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529307+0000","last_change":"2024-04-24T13:33:08.727357+0000","last_active":"2024-04-24T13:34:35.529307+0000","last_peered":"2024-04-24T13:34:35.529307+0000","last_clean":"2024-04-24T13:34:35.529307+0000","last_became_active":"2024-04-24T13:33:08.726787+0000","last_became_peered":"2024-04-24T13:33:08.726787+0000","last_unstale":"2024-04-24T13:34:35.529307+0000","last_undegraded":"2024-04-24T13:34:35.529307+0000","last_fullsized":"2024-04-24T13:34:35.529307+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:49.701435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"86'7","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594598+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:34:34.594598+0000","last_peered":"2024-04-24T13:34:34.594598+0000","last_clean":"2024-04-24T13:34:34.594598+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:34:34.594598+0000","last_undegraded":"2024-04-24T13:34:34.594598+0000","last_fullsized":"2024-04-24T13:34:34.594598+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"132'4","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588631+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:34:34.588631+0000","last_peered":"2024-04-24T13:34:34.588631+0000","last_clean":"2024-04-24T13:34:34.588631+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:34:34.588631+0000","last_undegraded":"2024-04-24T13:34:34.588631+0000","last_fullsized":"2024-04-24T13:34:34.588631+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"132'17","reported_seq":86,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669927+0000","last_change":"2024-04-24T13:33:50.539289+0000","last_active":"2024-04-24T13:34:35.669927+0000","last_peered":"2024-04-24T13:34:35.669927+0000","last_clean":"2024-04-24T13:34:35.669927+0000","last_became_active":"2024-04-24T13:33:49.284576+0000","last_became_peered":"2024-04-24T13:33:49.284576+0000","last_unstale":"2024-04-24T13:34:35.669927+0000","last_undegraded":"2024-04-24T13:34:35.669927+0000","last_fullsized":"2024-04-24T13:34:35.669927+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:20.287647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664846+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:34:35.664846+0000","last_peered":"2024-04-24T13:34:35.664846+0000","last_clean":"2024-04-24T13:34:35.664846+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:34:35.664846+0000","last_undegraded":"2024-04-24T13:34:35.664846+0000","last_fullsized":"2024-04-24T13:34:35.664846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"132'18","reported_seq":309,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555087+0000","last_change":"2024-04-24T13:33:52.751477+0000","last_active":"2024-04-24T13:34:35.555087+0000","last_peered":"2024-04-24T13:34:35.555087+0000","last_clean":"2024-04-24T13:34:35.555087+0000","last_became_active":"2024-04-24T13:33:49.308018+0000","last_became_peered":"2024-04-24T13:33:49.308018+0000","last_unstale":"2024-04-24T13:34:35.555087+0000","last_undegraded":"2024-04-24T13:34:35.555087+0000","last_fullsized":"2024-04-24T13:34:35.555087+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:29:49.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554059+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:34:35.554059+0000","last_peered":"2024-04-24T13:34:35.554059+0000","last_clean":"2024-04-24T13:34:35.554059+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:34:35.554059+0000","last_undegraded":"2024-04-24T13:34:35.554059+0000","last_fullsized":"2024-04-24T13:34:35.554059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":242,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667298+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:34:35.667298+0000","last_peered":"2024-04-24T13:34:35.667298+0000","last_clean":"2024-04-24T13:34:35.667298+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:34:35.667298+0000","last_undegraded":"2024-04-24T13:34:35.667298+0000","last_fullsized":"2024-04-24T13:34:35.667298+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"82'4","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667243+0000","last_change":"2024-04-24T13:32:01.548738+0000","last_active":"2024-04-24T13:34:35.667243+0000","last_peered":"2024-04-24T13:34:35.667243+0000","last_clean":"2024-04-24T13:34:35.667243+0000","last_became_active":"2024-04-24T13:32:01.548259+0000","last_became_peered":"2024-04-24T13:32:01.548259+0000","last_unstale":"2024-04-24T13:34:35.667243+0000","last_undegraded":"2024-04-24T13:34:35.667243+0000","last_fullsized":"2024-04-24T13:34:35.667243+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"131'26","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669452+0000","last_change":"2024-04-24T13:33:52.683024+0000","last_active":"2024-04-24T13:34:35.669452+0000","last_peered":"2024-04-24T13:34:35.669452+0000","last_clean":"2024-04-24T13:34:35.669452+0000","last_became_active":"2024-04-24T13:33:49.293373+0000","last_became_peered":"2024-04-24T13:33:49.293373+0000","last_unstale":"2024-04-24T13:34:35.669452+0000","last_undegraded":"2024-04-24T13:34:35.669452+0000","last_fullsized":"2024-04-24T13:34:35.669452+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:05:00.168247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665398+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:34:35.665398+0000","last_peered":"2024-04-24T13:34:35.665398+0000","last_clean":"2024-04-24T13:34:35.665398+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:34:35.665398+0000","last_undegraded":"2024-04-24T13:34:35.665398+0000","last_fullsized":"2024-04-24T13:34:35.665398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"132'23","reported_seq":74,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667835+0000","last_change":"2024-04-24T13:33:53.666421+0000","last_active":"2024-04-24T13:34:35.667835+0000","last_peered":"2024-04-24T13:34:35.667835+0000","last_clean":"2024-04-24T13:34:35.667835+0000","last_became_active":"2024-04-24T13:33:49.302140+0000","last_became_peered":"2024-04-24T13:33:49.302140+0000","last_unstale":"2024-04-24T13:34:35.667835+0000","last_undegraded":"2024-04-24T13:34:35.667835+0000","last_fullsized":"2024-04-24T13:34:35.667835+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.223797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"132'134","reported_seq":513,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665071+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:34:35.665071+0000","last_peered":"2024-04-24T13:34:35.665071+0000","last_clean":"2024-04-24T13:34:35.665071+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:34:35.665071+0000","last_undegraded":"2024-04-24T13:34:35.665071+0000","last_fullsized":"2024-04-24T13:34:35.665071+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"82'3","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667725+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:34:35.667725+0000","last_peered":"2024-04-24T13:34:35.667725+0000","last_clean":"2024-04-24T13:34:35.667725+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:34:35.667725+0000","last_undegraded":"2024-04-24T13:34:35.667725+0000","last_fullsized":"2024-04-24T13:34:35.667725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"132'10","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666648+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:34:35.666648+0000","last_peered":"2024-04-24T13:34:35.666648+0000","last_clean":"2024-04-24T13:34:35.666648+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:34:35.666648+0000","last_undegraded":"2024-04-24T13:34:35.666648+0000","last_fullsized":"2024-04-24T13:34:35.666648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"131'23","reported_seq":135,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594898+0000","last_change":"2024-04-24T13:33:10.787412+0000","last_active":"2024-04-24T13:34:34.594898+0000","last_peered":"2024-04-24T13:34:34.594898+0000","last_clean":"2024-04-24T13:34:34.594898+0000","last_became_active":"2024-04-24T13:33:08.718332+0000","last_became_peered":"2024-04-24T13:33:08.718332+0000","last_unstale":"2024-04-24T13:34:34.594898+0000","last_undegraded":"2024-04-24T13:34:34.594898+0000","last_fullsized":"2024-04-24T13:34:34.594898+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:11.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665188+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:34:35.665188+0000","last_peered":"2024-04-24T13:34:35.665188+0000","last_clean":"2024-04-24T13:34:35.665188+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:34:35.665188+0000","last_undegraded":"2024-04-24T13:34:35.665188+0000","last_fullsized":"2024-04-24T13:34:35.665188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"132'28","reported_seq":325,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665332+0000","last_change":"2024-04-24T13:33:51.156026+0000","last_active":"2024-04-24T13:34:35.665332+0000","last_peered":"2024-04-24T13:34:35.665332+0000","last_clean":"2024-04-24T13:34:35.665332+0000","last_became_active":"2024-04-24T13:33:49.292150+0000","last_became_peered":"2024-04-24T13:33:49.292150+0000","last_unstale":"2024-04-24T13:34:35.665332+0000","last_undegraded":"2024-04-24T13:34:35.665332+0000","last_fullsized":"2024-04-24T13:34:35.665332+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:42.853378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665105+0000","last_change":"2024-04-24T13:33:49.306397+0000","last_active":"2024-04-24T13:34:35.665105+0000","last_peered":"2024-04-24T13:34:35.665105+0000","last_clean":"2024-04-24T13:34:35.665105+0000","last_became_active":"2024-04-24T13:33:49.305572+0000","last_became_peered":"2024-04-24T13:33:49.305572+0000","last_unstale":"2024-04-24T13:34:35.665105+0000","last_undegraded":"2024-04-24T13:34:35.665105+0000","last_fullsized":"2024-04-24T13:34:35.665105+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:48.247418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"126'11","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529509+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:34:35.529509+0000","last_peered":"2024-04-24T13:34:35.529509+0000","last_clean":"2024-04-24T13:34:35.529509+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:34:35.529509+0000","last_undegraded":"2024-04-24T13:34:35.529509+0000","last_fullsized":"2024-04-24T13:34:35.529509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"132'8","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590413+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:34:34.590413+0000","last_peered":"2024-04-24T13:34:34.590413+0000","last_clean":"2024-04-24T13:34:34.590413+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:34:34.590413+0000","last_undegraded":"2024-04-24T13:34:34.590413+0000","last_fullsized":"2024-04-24T13:34:34.590413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"132'29","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554380+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:34:35.554380+0000","last_peered":"2024-04-24T13:34:35.554380+0000","last_clean":"2024-04-24T13:34:35.554380+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:34:35.554380+0000","last_undegraded":"2024-04-24T13:34:35.554380+0000","last_fullsized":"2024-04-24T13:34:35.554380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":275,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665339+0000","last_change":"2024-04-24T13:33:49.300767+0000","last_active":"2024-04-24T13:34:35.665339+0000","last_peered":"2024-04-24T13:34:35.665339+0000","last_clean":"2024-04-24T13:34:35.665339+0000","last_became_active":"2024-04-24T13:33:49.300030+0000","last_became_peered":"2024-04-24T13:33:49.300030+0000","last_unstale":"2024-04-24T13:34:35.665339+0000","last_undegraded":"2024-04-24T13:34:35.665339+0000","last_fullsized":"2024-04-24T13:34:35.665339+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:28.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"132'19","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590813+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:34:34.590813+0000","last_peered":"2024-04-24T13:34:34.590813+0000","last_clean":"2024-04-24T13:34:34.590813+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:34:34.590813+0000","last_undegraded":"2024-04-24T13:34:34.590813+0000","last_fullsized":"2024-04-24T13:34:34.590813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667965+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:34:35.667965+0000","last_peered":"2024-04-24T13:34:35.667965+0000","last_clean":"2024-04-24T13:34:35.667965+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:34:35.667965+0000","last_undegraded":"2024-04-24T13:34:35.667965+0000","last_fullsized":"2024-04-24T13:34:35.667965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554807+0000","last_change":"2024-04-24T13:33:08.720576+0000","last_active":"2024-04-24T13:34:35.554807+0000","last_peered":"2024-04-24T13:34:35.554807+0000","last_clean":"2024-04-24T13:34:35.554807+0000","last_became_active":"2024-04-24T13:33:08.720133+0000","last_became_peered":"2024-04-24T13:33:08.720133+0000","last_unstale":"2024-04-24T13:34:35.554807+0000","last_undegraded":"2024-04-24T13:34:35.554807+0000","last_fullsized":"2024-04-24T13:34:35.554807+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:16.254173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590861+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:34:34.590861+0000","last_peered":"2024-04-24T13:34:34.590861+0000","last_clean":"2024-04-24T13:34:34.590861+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:34:34.590861+0000","last_undegraded":"2024-04-24T13:34:34.590861+0000","last_fullsized":"2024-04-24T13:34:34.590861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"131'33","reported_seq":300,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667525+0000","last_change":"2024-04-24T13:31:00.986244+0000","last_active":"2024-04-24T13:34:35.667525+0000","last_peered":"2024-04-24T13:34:35.667525+0000","last_clean":"2024-04-24T13:34:35.667525+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:34:35.667525+0000","last_undegraded":"2024-04-24T13:34:35.667525+0000","last_fullsized":"2024-04-24T13:34:35.667525+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:23.355231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.524931+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:34:35.524931+0000","last_peered":"2024-04-24T13:34:35.524931+0000","last_clean":"2024-04-24T13:34:35.524931+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:34:35.524931+0000","last_undegraded":"2024-04-24T13:34:35.524931+0000","last_fullsized":"2024-04-24T13:34:35.524931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"132'25","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666099+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:34:35.666099+0000","last_peered":"2024-04-24T13:34:35.666099+0000","last_clean":"2024-04-24T13:34:35.666099+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:34:35.666099+0000","last_undegraded":"2024-04-24T13:34:35.666099+0000","last_fullsized":"2024-04-24T13:34:35.666099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"132'138","reported_seq":469,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665792+0000","last_change":"2024-04-24T13:33:11.710852+0000","last_active":"2024-04-24T13:34:35.665792+0000","last_peered":"2024-04-24T13:34:35.665792+0000","last_clean":"2024-04-24T13:34:35.665792+0000","last_became_active":"2024-04-24T13:33:11.709412+0000","last_became_peered":"2024-04-24T13:33:11.709412+0000","last_unstale":"2024-04-24T13:34:35.665792+0000","last_undegraded":"2024-04-24T13:34:35.665792+0000","last_fullsized":"2024-04-24T13:34:35.665792+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:22:40.670445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529004+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:34:35.529004+0000","last_peered":"2024-04-24T13:34:35.529004+0000","last_clean":"2024-04-24T13:34:35.529004+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:34:35.529004+0000","last_undegraded":"2024-04-24T13:34:35.529004+0000","last_fullsized":"2024-04-24T13:34:35.529004+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"114'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591312+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:34:34.591312+0000","last_peered":"2024-04-24T13:34:34.591312+0000","last_clean":"2024-04-24T13:34:34.591312+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:34:34.591312+0000","last_undegraded":"2024-04-24T13:34:34.591312+0000","last_fullsized":"2024-04-24T13:34:34.591312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"132'26","reported_seq":290,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587899+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:34:34.587899+0000","last_peered":"2024-04-24T13:34:34.587899+0000","last_clean":"2024-04-24T13:34:34.587899+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:34:34.587899+0000","last_undegraded":"2024-04-24T13:34:34.587899+0000","last_fullsized":"2024-04-24T13:34:34.587899+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":148,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595952+0000","last_change":"2024-04-24T13:33:09.912410+0000","last_active":"2024-04-24T13:34:34.595952+0000","last_peered":"2024-04-24T13:34:34.595952+0000","last_clean":"2024-04-24T13:34:34.595952+0000","last_became_active":"2024-04-24T13:33:08.724858+0000","last_became_peered":"2024-04-24T13:33:08.724858+0000","last_unstale":"2024-04-24T13:34:34.595952+0000","last_undegraded":"2024-04-24T13:34:34.595952+0000","last_fullsized":"2024-04-24T13:34:34.595952+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:26.760043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":176,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"82'11","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556099+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:34:35.556099+0000","last_peered":"2024-04-24T13:34:35.556099+0000","last_clean":"2024-04-24T13:34:35.556099+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:34:35.556099+0000","last_undegraded":"2024-04-24T13:34:35.556099+0000","last_fullsized":"2024-04-24T13:34:35.556099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"132'134","reported_seq":478,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667741+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:34:35.667741+0000","last_peered":"2024-04-24T13:34:35.667741+0000","last_clean":"2024-04-24T13:34:35.667741+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:34:35.667741+0000","last_undegraded":"2024-04-24T13:34:35.667741+0000","last_fullsized":"2024-04-24T13:34:35.667741+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"132'4","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588993+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:34:34.588993+0000","last_peered":"2024-04-24T13:34:34.588993+0000","last_clean":"2024-04-24T13:34:34.588993+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:34:34.588993+0000","last_undegraded":"2024-04-24T13:34:34.588993+0000","last_fullsized":"2024-04-24T13:34:34.588993+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"86'4","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529743+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:34:35.529743+0000","last_peered":"2024-04-24T13:34:35.529743+0000","last_clean":"2024-04-24T13:34:35.529743+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:34:35.529743+0000","last_undegraded":"2024-04-24T13:34:35.529743+0000","last_fullsized":"2024-04-24T13:34:35.529743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"132'35","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554056+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:34:35.554056+0000","last_peered":"2024-04-24T13:34:35.554056+0000","last_clean":"2024-04-24T13:34:35.554056+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:34:35.554056+0000","last_undegraded":"2024-04-24T13:34:35.554056+0000","last_fullsized":"2024-04-24T13:34:35.554056+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591102+0000","last_change":"2024-04-24T13:33:08.716879+0000","last_active":"2024-04-24T13:34:34.591102+0000","last_peered":"2024-04-24T13:34:34.591102+0000","last_clean":"2024-04-24T13:34:34.591102+0000","last_became_active":"2024-04-24T13:33:08.716585+0000","last_became_peered":"2024-04-24T13:33:08.716585+0000","last_unstale":"2024-04-24T13:34:34.591102+0000","last_undegraded":"2024-04-24T13:34:34.591102+0000","last_fullsized":"2024-04-24T13:34:34.591102+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:36.135388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"132'25","reported_seq":123,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595276+0000","last_change":"2024-04-24T13:33:10.818135+0000","last_active":"2024-04-24T13:34:34.595276+0000","last_peered":"2024-04-24T13:34:34.595276+0000","last_clean":"2024-04-24T13:34:34.595276+0000","last_became_active":"2024-04-24T13:33:08.736280+0000","last_became_peered":"2024-04-24T13:33:08.736280+0000","last_unstale":"2024-04-24T13:34:34.595276+0000","last_undegraded":"2024-04-24T13:34:34.595276+0000","last_fullsized":"2024-04-24T13:34:34.595276+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:41:16.005578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667479+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:34:35.667479+0000","last_peered":"2024-04-24T13:34:35.667479+0000","last_clean":"2024-04-24T13:34:35.667479+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:34:35.667479+0000","last_undegraded":"2024-04-24T13:34:35.667479+0000","last_fullsized":"2024-04-24T13:34:35.667479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"82'2","reported_seq":264,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529203+0000","last_change":"2024-04-24T13:33:09.338972+0000","last_active":"2024-04-24T13:34:35.529203+0000","last_peered":"2024-04-24T13:34:35.529203+0000","last_clean":"2024-04-24T13:34:35.529203+0000","last_became_active":"2024-04-24T13:33:08.727402+0000","last_became_peered":"2024-04-24T13:33:08.727402+0000","last_unstale":"2024-04-24T13:34:35.529203+0000","last_undegraded":"2024-04-24T13:34:35.529203+0000","last_fullsized":"2024-04-24T13:34:35.529203+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:34.956692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"105'4","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670731+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:34:35.670731+0000","last_peered":"2024-04-24T13:34:35.670731+0000","last_clean":"2024-04-24T13:34:35.670731+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:34:35.670731+0000","last_undegraded":"2024-04-24T13:34:35.670731+0000","last_fullsized":"2024-04-24T13:34:35.670731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":388,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668111+0000","last_change":"2024-04-24T13:33:54.557574+0000","last_active":"2024-04-24T13:34:35.668111+0000","last_peered":"2024-04-24T13:34:35.668111+0000","last_clean":"2024-04-24T13:34:35.668111+0000","last_became_active":"2024-04-24T13:33:54.557258+0000","last_became_peered":"2024-04-24T13:33:54.557258+0000","last_unstale":"2024-04-24T13:34:35.668111+0000","last_undegraded":"2024-04-24T13:34:35.668111+0000","last_fullsized":"2024-04-24T13:34:35.668111+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:14:04.108561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593434+0000","last_change":"2024-04-24T13:33:08.717037+0000","last_active":"2024-04-24T13:34:34.593434+0000","last_peered":"2024-04-24T13:34:34.593434+0000","last_clean":"2024-04-24T13:34:34.593434+0000","last_became_active":"2024-04-24T13:33:08.715914+0000","last_became_peered":"2024-04-24T13:33:08.715914+0000","last_unstale":"2024-04-24T13:34:34.593434+0000","last_undegraded":"2024-04-24T13:34:34.593434+0000","last_fullsized":"2024-04-24T13:34:34.593434+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:03.765941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"132'28","reported_seq":323,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554259+0000","last_change":"2024-04-24T13:33:09.529789+0000","last_active":"2024-04-24T13:34:35.554259+0000","last_peered":"2024-04-24T13:34:35.554259+0000","last_clean":"2024-04-24T13:34:35.554259+0000","last_became_active":"2024-04-24T13:33:08.725348+0000","last_became_peered":"2024-04-24T13:33:08.725348+0000","last_unstale":"2024-04-24T13:34:35.554259+0000","last_undegraded":"2024-04-24T13:34:35.554259+0000","last_fullsized":"2024-04-24T13:34:35.554259+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:18.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668973+0000","last_change":"2024-04-24T13:33:49.295687+0000","last_active":"2024-04-24T13:34:35.668973+0000","last_peered":"2024-04-24T13:34:35.668973+0000","last_clean":"2024-04-24T13:34:35.668973+0000","last_became_active":"2024-04-24T13:33:49.293916+0000","last_became_peered":"2024-04-24T13:33:49.293916+0000","last_unstale":"2024-04-24T13:34:35.668973+0000","last_undegraded":"2024-04-24T13:34:35.668973+0000","last_fullsized":"2024-04-24T13:34:35.668973+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:19.712676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"132'41","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.596147+0000","last_change":"2024-04-24T13:33:09.565111+0000","last_active":"2024-04-24T13:34:34.596147+0000","last_peered":"2024-04-24T13:34:34.596147+0000","last_clean":"2024-04-24T13:34:34.596147+0000","last_became_active":"2024-04-24T13:33:08.719950+0000","last_became_peered":"2024-04-24T13:33:08.719950+0000","last_unstale":"2024-04-24T13:34:34.596147+0000","last_undegraded":"2024-04-24T13:34:34.596147+0000","last_fullsized":"2024-04-24T13:34:34.596147+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:37.122088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179174,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":22,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":58868,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668132+0000","last_change":"2024-04-24T13:33:49.296153+0000","last_active":"2024-04-24T13:34:35.668132+0000","last_peered":"2024-04-24T13:34:35.668132+0000","last_clean":"2024-04-24T13:34:35.668132+0000","last_became_active":"2024-04-24T13:33:49.294098+0000","last_became_peered":"2024-04-24T13:33:49.294098+0000","last_unstale":"2024-04-24T13:34:35.668132+0000","last_undegraded":"2024-04-24T13:34:35.668132+0000","last_fullsized":"2024-04-24T13:34:35.668132+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:15.599045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666700+0000","last_change":"2024-04-24T13:33:08.727069+0000","last_active":"2024-04-24T13:34:35.666700+0000","last_peered":"2024-04-24T13:34:35.666700+0000","last_clean":"2024-04-24T13:34:35.666700+0000","last_became_active":"2024-04-24T13:33:08.726216+0000","last_became_peered":"2024-04-24T13:33:08.726216+0000","last_unstale":"2024-04-24T13:34:35.666700+0000","last_undegraded":"2024-04-24T13:34:35.666700+0000","last_fullsized":"2024-04-24T13:34:35.666700+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:59.675122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"105'6","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667365+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:34:35.667365+0000","last_peered":"2024-04-24T13:34:35.667365+0000","last_clean":"2024-04-24T13:34:35.667365+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:34:35.667365+0000","last_undegraded":"2024-04-24T13:34:35.667365+0000","last_fullsized":"2024-04-24T13:34:35.667365+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668713+0000","last_change":"2024-04-24T13:33:49.282926+0000","last_active":"2024-04-24T13:34:35.668713+0000","last_peered":"2024-04-24T13:34:35.668713+0000","last_clean":"2024-04-24T13:34:35.668713+0000","last_became_active":"2024-04-24T13:33:49.282517+0000","last_became_peered":"2024-04-24T13:33:49.282517+0000","last_unstale":"2024-04-24T13:34:35.668713+0000","last_undegraded":"2024-04-24T13:34:35.668713+0000","last_fullsized":"2024-04-24T13:34:35.668713+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:18.852308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"132'24","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665423+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:34:35.665423+0000","last_peered":"2024-04-24T13:34:35.665423+0000","last_clean":"2024-04-24T13:34:35.665423+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:34:35.665423+0000","last_undegraded":"2024-04-24T13:34:35.665423+0000","last_fullsized":"2024-04-24T13:34:35.665423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.596110+0000","last_change":"2024-04-24T13:33:08.734054+0000","last_active":"2024-04-24T13:34:34.596110+0000","last_peered":"2024-04-24T13:34:34.596110+0000","last_clean":"2024-04-24T13:34:34.596110+0000","last_became_active":"2024-04-24T13:33:08.728126+0000","last_became_peered":"2024-04-24T13:33:08.728126+0000","last_unstale":"2024-04-24T13:34:34.596110+0000","last_undegraded":"2024-04-24T13:34:34.596110+0000","last_fullsized":"2024-04-24T13:34:34.596110+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:48.542362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"132'136","reported_seq":503,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528541+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:34:35.528541+0000","last_peered":"2024-04-24T13:34:35.528541+0000","last_clean":"2024-04-24T13:34:35.528541+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:34:35.528541+0000","last_undegraded":"2024-04-24T13:34:35.528541+0000","last_fullsized":"2024-04-24T13:34:35.528541+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":136,"log_dups_size":0,"ondisk_log_size":136,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120994,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669391+0000","last_change":"2024-04-24T13:33:49.298292+0000","last_active":"2024-04-24T13:34:35.669391+0000","last_peered":"2024-04-24T13:34:35.669391+0000","last_clean":"2024-04-24T13:34:35.669391+0000","last_became_active":"2024-04-24T13:33:49.297450+0000","last_became_peered":"2024-04-24T13:33:49.297450+0000","last_unstale":"2024-04-24T13:34:35.669391+0000","last_undegraded":"2024-04-24T13:34:35.669391+0000","last_fullsized":"2024-04-24T13:34:35.669391+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:11.836268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.527757+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:34:35.527757+0000","last_peered":"2024-04-24T13:34:35.527757+0000","last_clean":"2024-04-24T13:34:35.527757+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:34:35.527757+0000","last_undegraded":"2024-04-24T13:34:35.527757+0000","last_fullsized":"2024-04-24T13:34:35.527757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"132'2","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529830+0000","last_change":"2024-04-24T13:33:08.745743+0000","last_active":"2024-04-24T13:34:35.529830+0000","last_peered":"2024-04-24T13:34:35.529830+0000","last_clean":"2024-04-24T13:34:35.529830+0000","last_became_active":"2024-04-24T13:33:08.745363+0000","last_became_peered":"2024-04-24T13:33:08.745363+0000","last_unstale":"2024-04-24T13:34:35.529830+0000","last_undegraded":"2024-04-24T13:34:35.529830+0000","last_fullsized":"2024-04-24T13:34:35.529830+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:23:38.852782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666100+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:34:35.666100+0000","last_peered":"2024-04-24T13:34:35.666100+0000","last_clean":"2024-04-24T13:34:35.666100+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:34:35.666100+0000","last_undegraded":"2024-04-24T13:34:35.666100+0000","last_fullsized":"2024-04-24T13:34:35.666100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"132'23","reported_seq":290,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.530696+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:34:35.530696+0000","last_peered":"2024-04-24T13:34:35.530696+0000","last_clean":"2024-04-24T13:34:35.530696+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:34:35.530696+0000","last_undegraded":"2024-04-24T13:34:35.530696+0000","last_fullsized":"2024-04-24T13:34:35.530696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":274,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665881+0000","last_change":"2024-04-24T13:33:09.537358+0000","last_active":"2024-04-24T13:34:35.665881+0000","last_peered":"2024-04-24T13:34:35.665881+0000","last_clean":"2024-04-24T13:34:35.665881+0000","last_became_active":"2024-04-24T13:33:08.726022+0000","last_became_peered":"2024-04-24T13:33:08.726022+0000","last_unstale":"2024-04-24T13:34:35.665881+0000","last_undegraded":"2024-04-24T13:34:35.665881+0000","last_fullsized":"2024-04-24T13:34:35.665881+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:53:29.132620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"126'18","reported_seq":86,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670196+0000","last_change":"2024-04-24T13:33:52.755369+0000","last_active":"2024-04-24T13:34:35.670196+0000","last_peered":"2024-04-24T13:34:35.670196+0000","last_clean":"2024-04-24T13:34:35.670196+0000","last_became_active":"2024-04-24T13:33:49.297296+0000","last_became_peered":"2024-04-24T13:33:49.297296+0000","last_unstale":"2024-04-24T13:34:35.670196+0000","last_undegraded":"2024-04-24T13:34:35.670196+0000","last_fullsized":"2024-04-24T13:34:35.670196+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:57.772686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666135+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:34:35.666135+0000","last_peered":"2024-04-24T13:34:35.666135+0000","last_clean":"2024-04-24T13:34:35.666135+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:34:35.666135+0000","last_undegraded":"2024-04-24T13:34:35.666135+0000","last_fullsized":"2024-04-24T13:34:35.666135+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554829+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:34:35.554829+0000","last_peered":"2024-04-24T13:34:35.554829+0000","last_clean":"2024-04-24T13:34:35.554829+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:34:35.554829+0000","last_undegraded":"2024-04-24T13:34:35.554829+0000","last_fullsized":"2024-04-24T13:34:35.554829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"132'4","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525116+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:34:35.525116+0000","last_peered":"2024-04-24T13:34:35.525116+0000","last_clean":"2024-04-24T13:34:35.525116+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:34:35.525116+0000","last_undegraded":"2024-04-24T13:34:35.525116+0000","last_fullsized":"2024-04-24T13:34:35.525116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592641+0000","last_change":"2024-04-24T13:33:08.727739+0000","last_active":"2024-04-24T13:34:34.592641+0000","last_peered":"2024-04-24T13:34:34.592641+0000","last_clean":"2024-04-24T13:34:34.592641+0000","last_became_active":"2024-04-24T13:33:08.727324+0000","last_became_peered":"2024-04-24T13:33:08.727324+0000","last_unstale":"2024-04-24T13:34:34.592641+0000","last_undegraded":"2024-04-24T13:34:34.592641+0000","last_fullsized":"2024-04-24T13:34:34.592641+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:23.918692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"132'22","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590105+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:34:34.590105+0000","last_peered":"2024-04-24T13:34:34.590105+0000","last_clean":"2024-04-24T13:34:34.590105+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:34:34.590105+0000","last_undegraded":"2024-04-24T13:34:34.590105+0000","last_fullsized":"2024-04-24T13:34:34.590105+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.760398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666115+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:34:35.666115+0000","last_peered":"2024-04-24T13:34:35.666115+0000","last_clean":"2024-04-24T13:34:35.666115+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:34:35.666115+0000","last_undegraded":"2024-04-24T13:34:35.666115+0000","last_fullsized":"2024-04-24T13:34:35.666115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":272,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.553929+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:34:35.553929+0000","last_peered":"2024-04-24T13:34:35.553929+0000","last_clean":"2024-04-24T13:34:35.553929+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:34:35.553929+0000","last_undegraded":"2024-04-24T13:34:35.553929+0000","last_fullsized":"2024-04-24T13:34:35.553929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671288+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:34:35.671288+0000","last_peered":"2024-04-24T13:34:35.671288+0000","last_clean":"2024-04-24T13:34:35.671288+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:34:35.671288+0000","last_undegraded":"2024-04-24T13:34:35.671288+0000","last_fullsized":"2024-04-24T13:34:35.671288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"81'4","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594411+0000","last_change":"2024-04-24T13:33:09.289060+0000","last_active":"2024-04-24T13:34:34.594411+0000","last_peered":"2024-04-24T13:34:34.594411+0000","last_clean":"2024-04-24T13:34:34.594411+0000","last_became_active":"2024-04-24T13:33:08.717929+0000","last_became_peered":"2024-04-24T13:33:08.717929+0000","last_unstale":"2024-04-24T13:34:34.594411+0000","last_undegraded":"2024-04-24T13:34:34.594411+0000","last_fullsized":"2024-04-24T13:34:34.594411+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:36.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528047+0000","last_change":"2024-04-24T13:33:08.738475+0000","last_active":"2024-04-24T13:34:35.528047+0000","last_peered":"2024-04-24T13:34:35.528047+0000","last_clean":"2024-04-24T13:34:35.528047+0000","last_became_active":"2024-04-24T13:33:08.738109+0000","last_became_peered":"2024-04-24T13:33:08.738109+0000","last_unstale":"2024-04-24T13:34:35.528047+0000","last_undegraded":"2024-04-24T13:34:35.528047+0000","last_fullsized":"2024-04-24T13:34:35.528047+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:14:49.386651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"132'27","reported_seq":137,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594648+0000","last_change":"2024-04-24T13:33:10.091580+0000","last_active":"2024-04-24T13:34:34.594648+0000","last_peered":"2024-04-24T13:34:34.594648+0000","last_clean":"2024-04-24T13:34:34.594648+0000","last_became_active":"2024-04-24T13:33:08.716808+0000","last_became_peered":"2024-04-24T13:33:08.716808+0000","last_unstale":"2024-04-24T13:34:34.594648+0000","last_undegraded":"2024-04-24T13:34:34.594648+0000","last_fullsized":"2024-04-24T13:34:34.594648+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:05:06.347329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525373+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:34:35.525373+0000","last_peered":"2024-04-24T13:34:35.525373+0000","last_clean":"2024-04-24T13:34:35.525373+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:34:35.525373+0000","last_undegraded":"2024-04-24T13:34:35.525373+0000","last_fullsized":"2024-04-24T13:34:35.525373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666247+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:34:35.666247+0000","last_peered":"2024-04-24T13:34:35.666247+0000","last_clean":"2024-04-24T13:34:35.666247+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:34:35.666247+0000","last_undegraded":"2024-04-24T13:34:35.666247+0000","last_fullsized":"2024-04-24T13:34:35.666247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"132'34","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664648+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:34:35.664648+0000","last_peered":"2024-04-24T13:34:35.664648+0000","last_clean":"2024-04-24T13:34:35.664648+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:34:35.664648+0000","last_undegraded":"2024-04-24T13:34:35.664648+0000","last_fullsized":"2024-04-24T13:34:35.664648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588983+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:34:34.588983+0000","last_peered":"2024-04-24T13:34:34.588983+0000","last_clean":"2024-04-24T13:34:34.588983+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:34:34.588983+0000","last_undegraded":"2024-04-24T13:34:34.588983+0000","last_fullsized":"2024-04-24T13:34:34.588983+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667952+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:34:35.667952+0000","last_peered":"2024-04-24T13:34:35.667952+0000","last_clean":"2024-04-24T13:34:35.667952+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:34:35.667952+0000","last_undegraded":"2024-04-24T13:34:35.667952+0000","last_fullsized":"2024-04-24T13:34:35.667952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"114'18","reported_seq":351,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666556+0000","last_change":"2024-04-24T13:33:09.335136+0000","last_active":"2024-04-24T13:34:35.666556+0000","last_peered":"2024-04-24T13:34:35.666556+0000","last_clean":"2024-04-24T13:34:35.666556+0000","last_became_active":"2024-04-24T13:33:08.705853+0000","last_became_peered":"2024-04-24T13:33:08.705853+0000","last_unstale":"2024-04-24T13:34:35.666556+0000","last_undegraded":"2024-04-24T13:34:35.666556+0000","last_fullsized":"2024-04-24T13:34:35.666556+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:53.758485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":86,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"132'14","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525205+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:34:35.525205+0000","last_peered":"2024-04-24T13:34:35.525205+0000","last_clean":"2024-04-24T13:34:35.525205+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:34:35.525205+0000","last_undegraded":"2024-04-24T13:34:35.525205+0000","last_fullsized":"2024-04-24T13:34:35.525205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669917+0000","last_change":"2024-04-24T13:33:49.288345+0000","last_active":"2024-04-24T13:34:35.669917+0000","last_peered":"2024-04-24T13:34:35.669917+0000","last_clean":"2024-04-24T13:34:35.669917+0000","last_became_active":"2024-04-24T13:33:49.287893+0000","last_became_peered":"2024-04-24T13:33:49.287893+0000","last_unstale":"2024-04-24T13:34:35.669917+0000","last_undegraded":"2024-04-24T13:34:35.669917+0000","last_fullsized":"2024-04-24T13:34:35.669917+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:59.559096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667933+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:34:35.667933+0000","last_peered":"2024-04-24T13:34:35.667933+0000","last_clean":"2024-04-24T13:34:35.667933+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:34:35.667933+0000","last_undegraded":"2024-04-24T13:34:35.667933+0000","last_fullsized":"2024-04-24T13:34:35.667933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"105'15","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528699+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:34:35.528699+0000","last_peered":"2024-04-24T13:34:35.528699+0000","last_clean":"2024-04-24T13:34:35.528699+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:34:35.528699+0000","last_undegraded":"2024-04-24T13:34:35.528699+0000","last_fullsized":"2024-04-24T13:34:35.528699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"132'137","reported_seq":350,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594088+0000","last_change":"2024-04-24T13:33:11.712104+0000","last_active":"2024-04-24T13:34:34.594088+0000","last_peered":"2024-04-24T13:34:34.594088+0000","last_clean":"2024-04-24T13:34:34.594088+0000","last_became_active":"2024-04-24T13:33:11.710310+0000","last_became_peered":"2024-04-24T13:33:11.710310+0000","last_unstale":"2024-04-24T13:34:34.594088+0000","last_undegraded":"2024-04-24T13:34:34.594088+0000","last_fullsized":"2024-04-24T13:34:34.594088+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:44.878043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"114'3","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556703+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:34:35.556703+0000","last_peered":"2024-04-24T13:34:35.556703+0000","last_clean":"2024-04-24T13:34:35.556703+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:34:35.556703+0000","last_undegraded":"2024-04-24T13:34:35.556703+0000","last_fullsized":"2024-04-24T13:34:35.556703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"82'2","reported_seq":228,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664673+0000","last_change":"2024-04-24T13:33:49.682866+0000","last_active":"2024-04-24T13:34:35.664673+0000","last_peered":"2024-04-24T13:34:35.664673+0000","last_clean":"2024-04-24T13:34:35.664673+0000","last_became_active":"2024-04-24T13:33:49.296844+0000","last_became_peered":"2024-04-24T13:33:49.296844+0000","last_unstale":"2024-04-24T13:34:35.664673+0000","last_undegraded":"2024-04-24T13:34:35.664673+0000","last_fullsized":"2024-04-24T13:34:35.664673+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:34.675704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"132'24","reported_seq":334,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555608+0000","last_change":"2024-04-24T13:33:51.134298+0000","last_active":"2024-04-24T13:34:35.555608+0000","last_peered":"2024-04-24T13:34:35.555608+0000","last_clean":"2024-04-24T13:34:35.555608+0000","last_became_active":"2024-04-24T13:33:49.300149+0000","last_became_peered":"2024-04-24T13:33:49.300149+0000","last_unstale":"2024-04-24T13:34:35.555608+0000","last_undegraded":"2024-04-24T13:34:35.555608+0000","last_fullsized":"2024-04-24T13:34:35.555608+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:46:34.323602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.531398+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:34:35.531398+0000","last_peered":"2024-04-24T13:34:35.531398+0000","last_clean":"2024-04-24T13:34:35.531398+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:34:35.531398+0000","last_undegraded":"2024-04-24T13:34:35.531398+0000","last_fullsized":"2024-04-24T13:34:35.531398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588762+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:34:34.588762+0000","last_peered":"2024-04-24T13:34:34.588762+0000","last_clean":"2024-04-24T13:34:34.588762+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:34:34.588762+0000","last_undegraded":"2024-04-24T13:34:34.588762+0000","last_fullsized":"2024-04-24T13:34:34.588762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589504+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:34:34.589504+0000","last_peered":"2024-04-24T13:34:34.589504+0000","last_clean":"2024-04-24T13:34:34.589504+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:34:34.589504+0000","last_undegraded":"2024-04-24T13:34:34.589504+0000","last_fullsized":"2024-04-24T13:34:34.589504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"132'134","reported_seq":434,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555359+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:34:35.555359+0000","last_peered":"2024-04-24T13:34:35.555359+0000","last_clean":"2024-04-24T13:34:35.555359+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:34:35.555359+0000","last_undegraded":"2024-04-24T13:34:35.555359+0000","last_fullsized":"2024-04-24T13:34:35.555359+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"82'6","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666218+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:34:35.666218+0000","last_peered":"2024-04-24T13:34:35.666218+0000","last_clean":"2024-04-24T13:34:35.666218+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:34:35.666218+0000","last_undegraded":"2024-04-24T13:34:35.666218+0000","last_fullsized":"2024-04-24T13:34:35.666218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"114'6","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588275+0000","last_change":"2024-04-24T13:33:08.753804+0000","last_active":"2024-04-24T13:34:34.588275+0000","last_peered":"2024-04-24T13:34:34.588275+0000","last_clean":"2024-04-24T13:34:34.588275+0000","last_became_active":"2024-04-24T13:33:08.707993+0000","last_became_peered":"2024-04-24T13:33:08.707993+0000","last_unstale":"2024-04-24T13:34:34.588275+0000","last_undegraded":"2024-04-24T13:34:34.588275+0000","last_fullsized":"2024-04-24T13:34:34.588275+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:02.680781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"131'22","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667050+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:34:35.667050+0000","last_peered":"2024-04-24T13:34:35.667050+0000","last_clean":"2024-04-24T13:34:35.667050+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:34:35.667050+0000","last_undegraded":"2024-04-24T13:34:35.667050+0000","last_fullsized":"2024-04-24T13:34:35.667050+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671777+0000","last_change":"2024-04-24T13:33:49.289245+0000","last_active":"2024-04-24T13:34:35.671777+0000","last_peered":"2024-04-24T13:34:35.671777+0000","last_clean":"2024-04-24T13:34:35.671777+0000","last_became_active":"2024-04-24T13:33:49.288766+0000","last_became_peered":"2024-04-24T13:33:49.288766+0000","last_unstale":"2024-04-24T13:34:35.671777+0000","last_undegraded":"2024-04-24T13:34:35.671777+0000","last_fullsized":"2024-04-24T13:34:35.671777+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:02:54.620974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554544+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:34:35.554544+0000","last_peered":"2024-04-24T13:34:35.554544+0000","last_clean":"2024-04-24T13:34:35.554544+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:34:35.554544+0000","last_undegraded":"2024-04-24T13:34:35.554544+0000","last_fullsized":"2024-04-24T13:34:35.554544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"132'43","reported_seq":78,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669147+0000","last_change":"2024-04-24T13:33:52.712739+0000","last_active":"2024-04-24T13:34:35.669147+0000","last_peered":"2024-04-24T13:34:35.669147+0000","last_clean":"2024-04-24T13:34:35.669147+0000","last_became_active":"2024-04-24T13:33:49.295935+0000","last_became_peered":"2024-04-24T13:33:49.295935+0000","last_unstale":"2024-04-24T13:34:35.669147+0000","last_undegraded":"2024-04-24T13:34:35.669147+0000","last_fullsized":"2024-04-24T13:34:35.669147+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:52.132391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554158+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:34:35.554158+0000","last_peered":"2024-04-24T13:34:35.554158+0000","last_clean":"2024-04-24T13:34:35.554158+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:34:35.554158+0000","last_undegraded":"2024-04-24T13:34:35.554158+0000","last_fullsized":"2024-04-24T13:34:35.554158+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"105'6","reported_seq":120,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594807+0000","last_change":"2024-04-24T13:33:51.141865+0000","last_active":"2024-04-24T13:34:34.594807+0000","last_peered":"2024-04-24T13:34:34.594807+0000","last_clean":"2024-04-24T13:34:34.594807+0000","last_became_active":"2024-04-24T13:33:49.289035+0000","last_became_peered":"2024-04-24T13:33:49.289035+0000","last_unstale":"2024-04-24T13:34:34.594807+0000","last_undegraded":"2024-04-24T13:34:34.594807+0000","last_fullsized":"2024-04-24T13:34:34.594807+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:08:46.400784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"82'2","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667806+0000","last_change":"2024-04-24T13:33:09.076639+0000","last_active":"2024-04-24T13:34:35.667806+0000","last_peered":"2024-04-24T13:34:35.667806+0000","last_clean":"2024-04-24T13:34:35.667806+0000","last_became_active":"2024-04-24T13:33:08.705821+0000","last_became_peered":"2024-04-24T13:33:08.705821+0000","last_unstale":"2024-04-24T13:34:35.667806+0000","last_undegraded":"2024-04-24T13:34:35.667806+0000","last_fullsized":"2024-04-24T13:34:35.667806+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:07:09.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589501+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:34:34.589501+0000","last_peered":"2024-04-24T13:34:34.589501+0000","last_clean":"2024-04-24T13:34:34.589501+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:34:34.589501+0000","last_undegraded":"2024-04-24T13:34:34.589501+0000","last_fullsized":"2024-04-24T13:34:34.589501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"132'33","reported_seq":298,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665221+0000","last_change":"2024-04-24T13:33:50.684508+0000","last_active":"2024-04-24T13:34:35.665221+0000","last_peered":"2024-04-24T13:34:35.665221+0000","last_clean":"2024-04-24T13:34:35.665221+0000","last_became_active":"2024-04-24T13:33:49.297002+0000","last_became_peered":"2024-04-24T13:33:49.297002+0000","last_unstale":"2024-04-24T13:34:35.665221+0000","last_undegraded":"2024-04-24T13:34:35.665221+0000","last_fullsized":"2024-04-24T13:34:35.665221+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:05.604339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":366,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528124+0000","last_change":"2024-04-24T13:33:09.553473+0000","last_active":"2024-04-24T13:34:35.528124+0000","last_peered":"2024-04-24T13:34:35.528124+0000","last_clean":"2024-04-24T13:34:35.528124+0000","last_became_active":"2024-04-24T13:33:08.738276+0000","last_became_peered":"2024-04-24T13:33:08.738276+0000","last_unstale":"2024-04-24T13:34:35.528124+0000","last_undegraded":"2024-04-24T13:34:35.528124+0000","last_fullsized":"2024-04-24T13:34:35.528124+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:44.215595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"132'20","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554042+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:34:35.554042+0000","last_peered":"2024-04-24T13:34:35.554042+0000","last_clean":"2024-04-24T13:34:35.554042+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:34:35.554042+0000","last_undegraded":"2024-04-24T13:34:35.554042+0000","last_fullsized":"2024-04-24T13:34:35.554042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554671+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:34:35.554671+0000","last_peered":"2024-04-24T13:34:35.554671+0000","last_clean":"2024-04-24T13:34:35.554671+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:34:35.554671+0000","last_undegraded":"2024-04-24T13:34:35.554671+0000","last_fullsized":"2024-04-24T13:34:35.554671+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555930+0000","last_change":"2024-04-24T13:33:49.302711+0000","last_active":"2024-04-24T13:34:35.555930+0000","last_peered":"2024-04-24T13:34:35.555930+0000","last_clean":"2024-04-24T13:34:35.555930+0000","last_became_active":"2024-04-24T13:33:49.302201+0000","last_became_peered":"2024-04-24T13:33:49.302201+0000","last_unstale":"2024-04-24T13:34:35.555930+0000","last_undegraded":"2024-04-24T13:34:35.555930+0000","last_fullsized":"2024-04-24T13:34:35.555930+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:21.125833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.527964+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:34:35.527964+0000","last_peered":"2024-04-24T13:34:35.527964+0000","last_clean":"2024-04-24T13:34:35.527964+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:34:35.527964+0000","last_undegraded":"2024-04-24T13:34:35.527964+0000","last_fullsized":"2024-04-24T13:34:35.527964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"132'20","reported_seq":88,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669042+0000","last_change":"2024-04-24T13:33:53.881731+0000","last_active":"2024-04-24T13:34:35.669042+0000","last_peered":"2024-04-24T13:34:35.669042+0000","last_clean":"2024-04-24T13:34:35.669042+0000","last_became_active":"2024-04-24T13:33:49.299864+0000","last_became_peered":"2024-04-24T13:33:49.299864+0000","last_unstale":"2024-04-24T13:34:35.669042+0000","last_undegraded":"2024-04-24T13:34:35.669042+0000","last_fullsized":"2024-04-24T13:34:35.669042+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:31.093323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554746+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:34:35.554746+0000","last_peered":"2024-04-24T13:34:35.554746+0000","last_clean":"2024-04-24T13:34:35.554746+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:34:35.554746+0000","last_undegraded":"2024-04-24T13:34:35.554746+0000","last_fullsized":"2024-04-24T13:34:35.554746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"132'9","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664756+0000","last_change":"2024-04-24T13:33:09.548972+0000","last_active":"2024-04-24T13:34:35.664756+0000","last_peered":"2024-04-24T13:34:35.664756+0000","last_clean":"2024-04-24T13:34:35.664756+0000","last_became_active":"2024-04-24T13:33:08.721855+0000","last_became_peered":"2024-04-24T13:33:08.721855+0000","last_unstale":"2024-04-24T13:34:35.664756+0000","last_undegraded":"2024-04-24T13:34:35.664756+0000","last_fullsized":"2024-04-24T13:34:35.664756+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:12.936976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669578+0000","last_change":"2024-04-24T13:33:49.302936+0000","last_active":"2024-04-24T13:34:35.669578+0000","last_peered":"2024-04-24T13:34:35.669578+0000","last_clean":"2024-04-24T13:34:35.669578+0000","last_became_active":"2024-04-24T13:33:49.297478+0000","last_became_peered":"2024-04-24T13:33:49.297478+0000","last_unstale":"2024-04-24T13:34:35.669578+0000","last_undegraded":"2024-04-24T13:34:35.669578+0000","last_fullsized":"2024-04-24T13:34:35.669578+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:39.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"132'6","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665975+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:34:35.665975+0000","last_peered":"2024-04-24T13:34:35.665975+0000","last_clean":"2024-04-24T13:34:35.665975+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:34:35.665975+0000","last_undegraded":"2024-04-24T13:34:35.665975+0000","last_fullsized":"2024-04-24T13:34:35.665975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"82'4","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554406+0000","last_change":"2024-04-24T13:33:49.688460+0000","last_active":"2024-04-24T13:34:35.554406+0000","last_peered":"2024-04-24T13:34:35.554406+0000","last_clean":"2024-04-24T13:34:35.554406+0000","last_became_active":"2024-04-24T13:33:49.292866+0000","last_became_peered":"2024-04-24T13:33:49.292866+0000","last_unstale":"2024-04-24T13:34:35.554406+0000","last_undegraded":"2024-04-24T13:34:35.554406+0000","last_fullsized":"2024-04-24T13:34:35.554406+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:38.839177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"131'22","reported_seq":172,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595276+0000","last_change":"2024-04-24T13:33:52.207013+0000","last_active":"2024-04-24T13:34:34.595276+0000","last_peered":"2024-04-24T13:34:34.595276+0000","last_clean":"2024-04-24T13:34:34.595276+0000","last_became_active":"2024-04-24T13:33:49.289650+0000","last_became_peered":"2024-04-24T13:33:49.289650+0000","last_unstale":"2024-04-24T13:34:34.595276+0000","last_undegraded":"2024-04-24T13:34:34.595276+0000","last_fullsized":"2024-04-24T13:34:34.595276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:15:45.985778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667585+0000","last_change":"2024-04-24T13:33:49.283767+0000","last_active":"2024-04-24T13:34:35.667585+0000","last_peered":"2024-04-24T13:34:35.667585+0000","last_clean":"2024-04-24T13:34:35.667585+0000","last_became_active":"2024-04-24T13:33:49.283342+0000","last_became_peered":"2024-04-24T13:33:49.283342+0000","last_unstale":"2024-04-24T13:34:35.667585+0000","last_undegraded":"2024-04-24T13:34:35.667585+0000","last_fullsized":"2024-04-24T13:34:35.667585+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:36.682746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"132'20","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554550+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:34:35.554550+0000","last_peered":"2024-04-24T13:34:35.554550+0000","last_clean":"2024-04-24T13:34:35.554550+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:34:35.554550+0000","last_undegraded":"2024-04-24T13:34:35.554550+0000","last_fullsized":"2024-04-24T13:34:35.554550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668177+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:34:35.668177+0000","last_peered":"2024-04-24T13:34:35.668177+0000","last_clean":"2024-04-24T13:34:35.668177+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:34:35.668177+0000","last_undegraded":"2024-04-24T13:34:35.668177+0000","last_fullsized":"2024-04-24T13:34:35.668177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"114'4","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594405+0000","last_change":"2024-04-24T13:33:50.241765+0000","last_active":"2024-04-24T13:34:34.594405+0000","last_peered":"2024-04-24T13:34:34.594405+0000","last_clean":"2024-04-24T13:34:34.594405+0000","last_became_active":"2024-04-24T13:33:49.288852+0000","last_became_peered":"2024-04-24T13:33:49.288852+0000","last_unstale":"2024-04-24T13:34:34.594405+0000","last_undegraded":"2024-04-24T13:34:34.594405+0000","last_fullsized":"2024-04-24T13:34:34.594405+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:53:23.401847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554397+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:34:35.554397+0000","last_peered":"2024-04-24T13:34:35.554397+0000","last_clean":"2024-04-24T13:34:35.554397+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:34:35.554397+0000","last_undegraded":"2024-04-24T13:34:35.554397+0000","last_fullsized":"2024-04-24T13:34:35.554397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"132'20","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668126+0000","last_change":"2024-04-24T13:33:09.773703+0000","last_active":"2024-04-24T13:34:35.668126+0000","last_peered":"2024-04-24T13:34:35.668126+0000","last_clean":"2024-04-24T13:34:35.668126+0000","last_became_active":"2024-04-24T13:33:08.722546+0000","last_became_peered":"2024-04-24T13:33:08.722546+0000","last_unstale":"2024-04-24T13:34:35.668126+0000","last_undegraded":"2024-04-24T13:34:35.668126+0000","last_fullsized":"2024-04-24T13:34:35.668126+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:26.369698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667888+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:34:35.667888+0000","last_peered":"2024-04-24T13:34:35.667888+0000","last_clean":"2024-04-24T13:34:35.667888+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:34:35.667888+0000","last_undegraded":"2024-04-24T13:34:35.667888+0000","last_fullsized":"2024-04-24T13:34:35.667888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"132'18","reported_seq":68,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668570+0000","last_change":"2024-04-24T13:33:52.735528+0000","last_active":"2024-04-24T13:34:35.668570+0000","last_peered":"2024-04-24T13:34:35.668570+0000","last_clean":"2024-04-24T13:34:35.668570+0000","last_became_active":"2024-04-24T13:33:49.297667+0000","last_became_peered":"2024-04-24T13:33:49.297667+0000","last_unstale":"2024-04-24T13:34:35.668570+0000","last_undegraded":"2024-04-24T13:34:35.668570+0000","last_fullsized":"2024-04-24T13:34:35.668570+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:07:05.200322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665270+0000","last_change":"2024-04-24T13:33:49.286645+0000","last_active":"2024-04-24T13:34:35.665270+0000","last_peered":"2024-04-24T13:34:35.665270+0000","last_clean":"2024-04-24T13:34:35.665270+0000","last_became_active":"2024-04-24T13:33:49.285495+0000","last_became_peered":"2024-04-24T13:33:49.285495+0000","last_unstale":"2024-04-24T13:34:35.665270+0000","last_undegraded":"2024-04-24T13:34:35.665270+0000","last_fullsized":"2024-04-24T13:34:35.665270+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:19.867685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"82'8","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671651+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:34:35.671651+0000","last_peered":"2024-04-24T13:34:35.671651+0000","last_clean":"2024-04-24T13:34:35.671651+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:34:35.671651+0000","last_undegraded":"2024-04-24T13:34:35.671651+0000","last_fullsized":"2024-04-24T13:34:35.671651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"131'27","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554147+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:34:35.554147+0000","last_peered":"2024-04-24T13:34:35.554147+0000","last_clean":"2024-04-24T13:34:35.554147+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:34:35.554147+0000","last_undegraded":"2024-04-24T13:34:35.554147+0000","last_fullsized":"2024-04-24T13:34:35.554147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667626+0000","last_change":"2024-04-24T13:33:49.296871+0000","last_active":"2024-04-24T13:34:35.667626+0000","last_peered":"2024-04-24T13:34:35.667626+0000","last_clean":"2024-04-24T13:34:35.667626+0000","last_became_active":"2024-04-24T13:33:49.295933+0000","last_became_peered":"2024-04-24T13:33:49.295933+0000","last_unstale":"2024-04-24T13:34:35.667626+0000","last_undegraded":"2024-04-24T13:34:35.667626+0000","last_fullsized":"2024-04-24T13:34:35.667626+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:48:25.451061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"132'29","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525465+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:34:35.525465+0000","last_peered":"2024-04-24T13:34:35.525465+0000","last_clean":"2024-04-24T13:34:35.525465+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:34:35.525465+0000","last_undegraded":"2024-04-24T13:34:35.525465+0000","last_fullsized":"2024-04-24T13:34:35.525465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62357,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594350+0000","last_change":"2024-04-24T13:33:08.717844+0000","last_active":"2024-04-24T13:34:34.594350+0000","last_peered":"2024-04-24T13:34:34.594350+0000","last_clean":"2024-04-24T13:34:34.594350+0000","last_became_active":"2024-04-24T13:33:08.716627+0000","last_became_peered":"2024-04-24T13:33:08.716627+0000","last_unstale":"2024-04-24T13:34:34.594350+0000","last_undegraded":"2024-04-24T13:34:34.594350+0000","last_fullsized":"2024-04-24T13:34:34.594350+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:43.447785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554266+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:34:35.554266+0000","last_peered":"2024-04-24T13:34:35.554266+0000","last_clean":"2024-04-24T13:34:35.554266+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:34:35.554266+0000","last_undegraded":"2024-04-24T13:34:35.554266+0000","last_fullsized":"2024-04-24T13:34:35.554266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"114'10","reported_seq":324,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667496+0000","last_change":"2024-04-24T13:33:50.254858+0000","last_active":"2024-04-24T13:34:35.667496+0000","last_peered":"2024-04-24T13:34:35.667496+0000","last_clean":"2024-04-24T13:34:35.667496+0000","last_became_active":"2024-04-24T13:33:49.285680+0000","last_became_peered":"2024-04-24T13:33:49.285680+0000","last_unstale":"2024-04-24T13:34:35.667496+0000","last_undegraded":"2024-04-24T13:34:35.667496+0000","last_fullsized":"2024-04-24T13:34:35.667496+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:13.081256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"132'20","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529452+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:34:35.529452+0000","last_peered":"2024-04-24T13:34:35.529452+0000","last_clean":"2024-04-24T13:34:35.529452+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:34:35.529452+0000","last_undegraded":"2024-04-24T13:34:35.529452+0000","last_fullsized":"2024-04-24T13:34:35.529452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671404+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:34:35.671404+0000","last_peered":"2024-04-24T13:34:35.671404+0000","last_clean":"2024-04-24T13:34:35.671404+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:34:35.671404+0000","last_undegraded":"2024-04-24T13:34:35.671404+0000","last_fullsized":"2024-04-24T13:34:35.671404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"132'23","reported_seq":74,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669198+0000","last_change":"2024-04-24T13:33:51.826433+0000","last_active":"2024-04-24T13:34:35.669198+0000","last_peered":"2024-04-24T13:34:35.669198+0000","last_clean":"2024-04-24T13:34:35.669198+0000","last_became_active":"2024-04-24T13:33:49.291994+0000","last_became_peered":"2024-04-24T13:33:49.291994+0000","last_unstale":"2024-04-24T13:34:35.669198+0000","last_undegraded":"2024-04-24T13:34:35.669198+0000","last_fullsized":"2024-04-24T13:34:35.669198+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:35.992700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525691+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:34:35.525691+0000","last_peered":"2024-04-24T13:34:35.525691+0000","last_clean":"2024-04-24T13:34:35.525691+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:34:35.525691+0000","last_undegraded":"2024-04-24T13:34:35.525691+0000","last_fullsized":"2024-04-24T13:34:35.525691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669486+0000","last_change":"2024-04-24T13:33:49.289138+0000","last_active":"2024-04-24T13:34:35.669486+0000","last_peered":"2024-04-24T13:34:35.669486+0000","last_clean":"2024-04-24T13:34:35.669486+0000","last_became_active":"2024-04-24T13:33:49.288760+0000","last_became_peered":"2024-04-24T13:33:49.288760+0000","last_unstale":"2024-04-24T13:34:35.669486+0000","last_undegraded":"2024-04-24T13:34:35.669486+0000","last_fullsized":"2024-04-24T13:34:35.669486+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:12:25.409700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554342+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:34:35.554342+0000","last_peered":"2024-04-24T13:34:35.554342+0000","last_clean":"2024-04-24T13:34:35.554342+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:34:35.554342+0000","last_undegraded":"2024-04-24T13:34:35.554342+0000","last_fullsized":"2024-04-24T13:34:35.554342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"132'17","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589695+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:34:34.589695+0000","last_peered":"2024-04-24T13:34:34.589695+0000","last_clean":"2024-04-24T13:34:34.589695+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:34:34.589695+0000","last_undegraded":"2024-04-24T13:34:34.589695+0000","last_fullsized":"2024-04-24T13:34:34.589695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590976+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:34:34.590976+0000","last_peered":"2024-04-24T13:34:34.590976+0000","last_clean":"2024-04-24T13:34:34.590976+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:34:34.590976+0000","last_undegraded":"2024-04-24T13:34:34.590976+0000","last_fullsized":"2024-04-24T13:34:34.590976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"132'20","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556866+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:34:35.556866+0000","last_peered":"2024-04-24T13:34:35.556866+0000","last_clean":"2024-04-24T13:34:35.556866+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:34:35.556866+0000","last_undegraded":"2024-04-24T13:34:35.556866+0000","last_fullsized":"2024-04-24T13:34:35.556866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.526370+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:34:35.526370+0000","last_peered":"2024-04-24T13:34:35.526370+0000","last_clean":"2024-04-24T13:34:35.526370+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:34:35.526370+0000","last_undegraded":"2024-04-24T13:34:35.526370+0000","last_fullsized":"2024-04-24T13:34:35.526370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592796+0000","last_change":"2024-04-24T13:33:49.289867+0000","last_active":"2024-04-24T13:34:34.592796+0000","last_peered":"2024-04-24T13:34:34.592796+0000","last_clean":"2024-04-24T13:34:34.592796+0000","last_became_active":"2024-04-24T13:33:49.289412+0000","last_became_peered":"2024-04-24T13:33:49.289412+0000","last_unstale":"2024-04-24T13:34:34.592796+0000","last_undegraded":"2024-04-24T13:34:34.592796+0000","last_fullsized":"2024-04-24T13:34:34.592796+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:24:50.051036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"114'2","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665605+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:34:35.665605+0000","last_peered":"2024-04-24T13:34:35.665605+0000","last_clean":"2024-04-24T13:34:35.665605+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:34:35.665605+0000","last_undegraded":"2024-04-24T13:34:35.665605+0000","last_fullsized":"2024-04-24T13:34:35.665605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"131'28","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665975+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:34:35.665975+0000","last_peered":"2024-04-24T13:34:35.665975+0000","last_clean":"2024-04-24T13:34:35.665975+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:34:35.665975+0000","last_undegraded":"2024-04-24T13:34:35.665975+0000","last_fullsized":"2024-04-24T13:34:35.665975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525943+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:34:35.525943+0000","last_peered":"2024-04-24T13:34:35.525943+0000","last_clean":"2024-04-24T13:34:35.525943+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:34:35.525943+0000","last_undegraded":"2024-04-24T13:34:35.525943+0000","last_fullsized":"2024-04-24T13:34:35.525943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590834+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:34:34.590834+0000","last_peered":"2024-04-24T13:34:34.590834+0000","last_clean":"2024-04-24T13:34:34.590834+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:34:34.590834+0000","last_undegraded":"2024-04-24T13:34:34.590834+0000","last_fullsized":"2024-04-24T13:34:34.590834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"132'134","reported_seq":430,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671103+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:34:35.671103+0000","last_peered":"2024-04-24T13:34:35.671103+0000","last_clean":"2024-04-24T13:34:35.671103+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:34:35.671103+0000","last_undegraded":"2024-04-24T13:34:35.671103+0000","last_fullsized":"2024-04-24T13:34:35.671103+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":134,"log_dups_size":0,"ondisk_log_size":134,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"82'6","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670479+0000","last_change":"2024-04-24T13:33:50.541311+0000","last_active":"2024-04-24T13:34:35.670479+0000","last_peered":"2024-04-24T13:34:35.670479+0000","last_clean":"2024-04-24T13:34:35.670479+0000","last_became_active":"2024-04-24T13:33:49.285594+0000","last_became_peered":"2024-04-24T13:33:49.285594+0000","last_unstale":"2024-04-24T13:34:35.670479+0000","last_undegraded":"2024-04-24T13:34:35.670479+0000","last_fullsized":"2024-04-24T13:34:35.670479+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:45.453497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"86'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589448+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:34:34.589448+0000","last_peered":"2024-04-24T13:34:34.589448+0000","last_clean":"2024-04-24T13:34:34.589448+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:34:34.589448+0000","last_undegraded":"2024-04-24T13:34:34.589448+0000","last_fullsized":"2024-04-24T13:34:34.589448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"131'28","reported_seq":143,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591594+0000","last_change":"2024-04-24T13:33:09.116807+0000","last_active":"2024-04-24T13:34:34.591594+0000","last_peered":"2024-04-24T13:34:34.591594+0000","last_clean":"2024-04-24T13:34:34.591594+0000","last_became_active":"2024-04-24T13:33:08.708911+0000","last_became_peered":"2024-04-24T13:33:08.708911+0000","last_unstale":"2024-04-24T13:34:34.591594+0000","last_undegraded":"2024-04-24T13:34:34.591594+0000","last_fullsized":"2024-04-24T13:34:34.591594+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:59.171558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":108544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669046+0000","last_change":"2024-04-24T13:33:49.283103+0000","last_active":"2024-04-24T13:34:35.669046+0000","last_peered":"2024-04-24T13:34:35.669046+0000","last_clean":"2024-04-24T13:34:35.669046+0000","last_became_active":"2024-04-24T13:33:49.282772+0000","last_became_peered":"2024-04-24T13:33:49.282772+0000","last_unstale":"2024-04-24T13:34:35.669046+0000","last_undegraded":"2024-04-24T13:34:35.669046+0000","last_fullsized":"2024-04-24T13:34:35.669046+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:44.215595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"132'25","reported_seq":121,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591993+0000","last_change":"2024-04-24T13:33:09.934600+0000","last_active":"2024-04-24T13:34:34.591993+0000","last_peered":"2024-04-24T13:34:34.591993+0000","last_clean":"2024-04-24T13:34:34.591993+0000","last_became_active":"2024-04-24T13:33:08.732254+0000","last_became_peered":"2024-04-24T13:33:08.732254+0000","last_unstale":"2024-04-24T13:34:34.591993+0000","last_undegraded":"2024-04-24T13:34:34.591993+0000","last_fullsized":"2024-04-24T13:34:34.591993+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:35.846866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664957+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:34:35.664957+0000","last_peered":"2024-04-24T13:34:35.664957+0000","last_clean":"2024-04-24T13:34:35.664957+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:34:35.664957+0000","last_undegraded":"2024-04-24T13:34:35.664957+0000","last_fullsized":"2024-04-24T13:34:35.664957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670236+0000","last_change":"2024-04-24T13:33:49.295971+0000","last_active":"2024-04-24T13:34:35.670236+0000","last_peered":"2024-04-24T13:34:35.670236+0000","last_clean":"2024-04-24T13:34:35.670236+0000","last_became_active":"2024-04-24T13:33:49.294486+0000","last_became_peered":"2024-04-24T13:33:49.294486+0000","last_unstale":"2024-04-24T13:34:35.670236+0000","last_undegraded":"2024-04-24T13:34:35.670236+0000","last_fullsized":"2024-04-24T13:34:35.670236+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:53:43.527494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"105'6","reported_seq":147,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667474+0000","last_change":"2024-04-24T13:32:32.751387+0000","last_active":"2024-04-24T13:34:35.667474+0000","last_peered":"2024-04-24T13:34:35.667474+0000","last_clean":"2024-04-24T13:34:35.667474+0000","last_became_active":"2024-04-24T13:32:32.741990+0000","last_became_peered":"2024-04-24T13:32:32.741990+0000","last_unstale":"2024-04-24T13:34:35.667474+0000","last_undegraded":"2024-04-24T13:34:35.667474+0000","last_fullsized":"2024-04-24T13:34:35.667474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:49.789798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"131'23","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595783+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:34:34.595783+0000","last_peered":"2024-04-24T13:34:34.595783+0000","last_clean":"2024-04-24T13:34:34.595783+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:34:34.595783+0000","last_undegraded":"2024-04-24T13:34:34.595783+0000","last_fullsized":"2024-04-24T13:34:34.595783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593550+0000","last_change":"2024-04-24T13:33:08.705125+0000","last_active":"2024-04-24T13:34:34.593550+0000","last_peered":"2024-04-24T13:34:34.593550+0000","last_clean":"2024-04-24T13:34:34.593550+0000","last_became_active":"2024-04-24T13:33:08.704735+0000","last_became_peered":"2024-04-24T13:33:08.704735+0000","last_unstale":"2024-04-24T13:34:34.593550+0000","last_undegraded":"2024-04-24T13:34:34.593550+0000","last_fullsized":"2024-04-24T13:34:34.593550+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:14.183681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"132'18","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664908+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:34:35.664908+0000","last_peered":"2024-04-24T13:34:35.664908+0000","last_clean":"2024-04-24T13:34:35.664908+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:34:35.664908+0000","last_undegraded":"2024-04-24T13:34:35.664908+0000","last_fullsized":"2024-04-24T13:34:35.664908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667249+0000","last_change":"2024-04-24T13:33:49.289409+0000","last_active":"2024-04-24T13:34:35.667249+0000","last_peered":"2024-04-24T13:34:35.667249+0000","last_clean":"2024-04-24T13:34:35.667249+0000","last_became_active":"2024-04-24T13:33:49.288970+0000","last_became_peered":"2024-04-24T13:33:49.288970+0000","last_unstale":"2024-04-24T13:34:35.667249+0000","last_undegraded":"2024-04-24T13:34:35.667249+0000","last_fullsized":"2024-04-24T13:34:35.667249+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:39.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556026+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:34:35.556026+0000","last_peered":"2024-04-24T13:34:35.556026+0000","last_clean":"2024-04-24T13:34:35.556026+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:34:35.556026+0000","last_undegraded":"2024-04-24T13:34:35.556026+0000","last_fullsized":"2024-04-24T13:34:35.556026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"105'10","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592552+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:34:34.592552+0000","last_peered":"2024-04-24T13:34:34.592552+0000","last_clean":"2024-04-24T13:34:34.592552+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:34:34.592552+0000","last_undegraded":"2024-04-24T13:34:34.592552+0000","last_fullsized":"2024-04-24T13:34:34.592552+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"131'19","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556282+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:34:35.556282+0000","last_peered":"2024-04-24T13:34:35.556282+0000","last_clean":"2024-04-24T13:34:35.556282+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:34:35.556282+0000","last_undegraded":"2024-04-24T13:34:35.556282+0000","last_fullsized":"2024-04-24T13:34:35.556282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587731+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:34:34.587731+0000","last_peered":"2024-04-24T13:34:34.587731+0000","last_clean":"2024-04-24T13:34:34.587731+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:34:34.587731+0000","last_undegraded":"2024-04-24T13:34:34.587731+0000","last_fullsized":"2024-04-24T13:34:34.587731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"132'13","reported_seq":181,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665742+0000","last_change":"2024-04-24T13:33:51.167111+0000","last_active":"2024-04-24T13:34:35.665742+0000","last_peered":"2024-04-24T13:34:35.665742+0000","last_clean":"2024-04-24T13:34:35.665742+0000","last_became_active":"2024-04-24T13:33:49.302159+0000","last_became_peered":"2024-04-24T13:33:49.302159+0000","last_unstale":"2024-04-24T13:34:35.665742+0000","last_undegraded":"2024-04-24T13:34:35.665742+0000","last_fullsized":"2024-04-24T13:34:35.665742+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:21.719835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588137+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:34:34.588137+0000","last_peered":"2024-04-24T13:34:34.588137+0000","last_clean":"2024-04-24T13:34:34.588137+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:34:34.588137+0000","last_undegraded":"2024-04-24T13:34:34.588137+0000","last_fullsized":"2024-04-24T13:34:34.588137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"82'2","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670276+0000","last_change":"2024-04-24T13:33:54.657281+0000","last_active":"2024-04-24T13:34:35.670276+0000","last_peered":"2024-04-24T13:34:35.670276+0000","last_clean":"2024-04-24T13:34:35.670276+0000","last_became_active":"2024-04-24T13:33:49.303239+0000","last_became_peered":"2024-04-24T13:33:49.303239+0000","last_unstale":"2024-04-24T13:34:35.670276+0000","last_undegraded":"2024-04-24T13:34:35.670276+0000","last_fullsized":"2024-04-24T13:34:35.670276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:32.797578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"82'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588230+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:34:34.588230+0000","last_peered":"2024-04-24T13:34:34.588230+0000","last_clean":"2024-04-24T13:34:34.588230+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:34:34.588230+0000","last_undegraded":"2024-04-24T13:34:34.588230+0000","last_fullsized":"2024-04-24T13:34:34.588230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"131'21","reported_seq":193,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665984+0000","last_change":"2024-04-24T13:33:09.073468+0000","last_active":"2024-04-24T13:34:35.665984+0000","last_peered":"2024-04-24T13:34:35.665984+0000","last_clean":"2024-04-24T13:34:35.665984+0000","last_became_active":"2024-04-24T13:33:08.725822+0000","last_became_peered":"2024-04-24T13:33:08.725822+0000","last_unstale":"2024-04-24T13:34:35.665984+0000","last_undegraded":"2024-04-24T13:34:35.665984+0000","last_fullsized":"2024-04-24T13:34:35.665984+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:24:41.185601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528798+0000","last_change":"2024-04-24T13:33:09.078708+0000","last_active":"2024-04-24T13:34:35.528798+0000","last_peered":"2024-04-24T13:34:35.528798+0000","last_clean":"2024-04-24T13:34:35.528798+0000","last_became_active":"2024-04-24T13:33:08.726873+0000","last_became_peered":"2024-04-24T13:33:08.726873+0000","last_unstale":"2024-04-24T13:34:35.528798+0000","last_undegraded":"2024-04-24T13:34:35.528798+0000","last_fullsized":"2024-04-24T13:34:35.528798+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:53:23.482374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"132'17","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588566+0000","last_change":"2024-04-24T13:33:09.087185+0000","last_active":"2024-04-24T13:34:34.588566+0000","last_peered":"2024-04-24T13:34:34.588566+0000","last_clean":"2024-04-24T13:34:34.588566+0000","last_became_active":"2024-04-24T13:33:08.726347+0000","last_became_peered":"2024-04-24T13:33:08.726347+0000","last_unstale":"2024-04-24T13:34:34.588566+0000","last_undegraded":"2024-04-24T13:34:34.588566+0000","last_fullsized":"2024-04-24T13:34:34.588566+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:37.412890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665180+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:34:35.665180+0000","last_peered":"2024-04-24T13:34:35.665180+0000","last_clean":"2024-04-24T13:34:35.665180+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:34:35.665180+0000","last_undegraded":"2024-04-24T13:34:35.665180+0000","last_fullsized":"2024-04-24T13:34:35.665180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589644+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:34:34.589644+0000","last_peered":"2024-04-24T13:34:34.589644+0000","last_clean":"2024-04-24T13:34:34.589644+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:34:34.589644+0000","last_undegraded":"2024-04-24T13:34:34.589644+0000","last_fullsized":"2024-04-24T13:34:34.589644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"132'10","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529653+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:34:35.529653+0000","last_peered":"2024-04-24T13:34:35.529653+0000","last_clean":"2024-04-24T13:34:35.529653+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:34:35.529653+0000","last_undegraded":"2024-04-24T13:34:35.529653+0000","last_fullsized":"2024-04-24T13:34:35.529653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"130'14","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666878+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:34:35.666878+0000","last_peered":"2024-04-24T13:34:35.666878+0000","last_clean":"2024-04-24T13:34:35.666878+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:34:35.666878+0000","last_undegraded":"2024-04-24T13:34:35.666878+0000","last_fullsized":"2024-04-24T13:34:35.666878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"105'12","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.526551+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:34:35.526551+0000","last_peered":"2024-04-24T13:34:35.526551+0000","last_clean":"2024-04-24T13:34:35.526551+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:34:35.526551+0000","last_undegraded":"2024-04-24T13:34:35.526551+0000","last_fullsized":"2024-04-24T13:34:35.526551+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"132'20","reported_seq":311,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665952+0000","last_change":"2024-04-24T13:33:09.324802+0000","last_active":"2024-04-24T13:34:35.665952+0000","last_peered":"2024-04-24T13:34:35.665952+0000","last_clean":"2024-04-24T13:34:35.665952+0000","last_became_active":"2024-04-24T13:33:08.725876+0000","last_became_peered":"2024-04-24T13:33:08.725876+0000","last_unstale":"2024-04-24T13:34:35.665952+0000","last_undegraded":"2024-04-24T13:34:35.665952+0000","last_fullsized":"2024-04-24T13:34:35.665952+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:21:58.951897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"82'2","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594991+0000","last_change":"2024-04-24T13:33:53.237778+0000","last_active":"2024-04-24T13:34:34.594991+0000","last_peered":"2024-04-24T13:34:34.594991+0000","last_clean":"2024-04-24T13:34:34.594991+0000","last_became_active":"2024-04-24T13:33:49.302722+0000","last_became_peered":"2024-04-24T13:33:49.302722+0000","last_unstale":"2024-04-24T13:34:34.594991+0000","last_undegraded":"2024-04-24T13:34:34.594991+0000","last_fullsized":"2024-04-24T13:34:34.594991+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:52:06.190295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"132'28","reported_seq":143,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592901+0000","last_change":"2024-04-24T13:33:09.548908+0000","last_active":"2024-04-24T13:34:34.592901+0000","last_peered":"2024-04-24T13:34:34.592901+0000","last_clean":"2024-04-24T13:34:34.592901+0000","last_became_active":"2024-04-24T13:33:08.720010+0000","last_became_peered":"2024-04-24T13:33:08.720010+0000","last_unstale":"2024-04-24T13:34:34.592901+0000","last_undegraded":"2024-04-24T13:34:34.592901+0000","last_fullsized":"2024-04-24T13:34:34.592901+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:06.195033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"114'12","reported_seq":319,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525288+0000","last_change":"2024-04-24T13:33:49.678468+0000","last_active":"2024-04-24T13:34:35.525288+0000","last_peered":"2024-04-24T13:34:35.525288+0000","last_clean":"2024-04-24T13:34:35.525288+0000","last_became_active":"2024-04-24T13:33:49.289642+0000","last_became_peered":"2024-04-24T13:33:49.289642+0000","last_unstale":"2024-04-24T13:34:35.525288+0000","last_undegraded":"2024-04-24T13:34:35.525288+0000","last_fullsized":"2024-04-24T13:34:35.525288+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:37.408920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"132'31","reported_seq":296,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666117+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:34:35.666117+0000","last_peered":"2024-04-24T13:34:35.666117+0000","last_clean":"2024-04-24T13:34:35.666117+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:34:35.666117+0000","last_undegraded":"2024-04-24T13:34:35.666117+0000","last_fullsized":"2024-04-24T13:34:35.666117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"132'4","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554985+0000","last_change":"2024-04-24T13:33:51.611283+0000","last_active":"2024-04-24T13:34:35.554985+0000","last_peered":"2024-04-24T13:34:35.554985+0000","last_clean":"2024-04-24T13:34:35.554985+0000","last_became_active":"2024-04-24T13:33:49.304888+0000","last_became_peered":"2024-04-24T13:33:49.304888+0000","last_unstale":"2024-04-24T13:34:35.554985+0000","last_undegraded":"2024-04-24T13:34:35.554985+0000","last_fullsized":"2024-04-24T13:34:35.554985+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:18.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"131'22","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556673+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:34:35.556673+0000","last_peered":"2024-04-24T13:34:35.556673+0000","last_clean":"2024-04-24T13:34:35.556673+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:34:35.556673+0000","last_undegraded":"2024-04-24T13:34:35.556673+0000","last_fullsized":"2024-04-24T13:34:35.556673+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"81'2","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589524+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:34:34.589524+0000","last_peered":"2024-04-24T13:34:34.589524+0000","last_clean":"2024-04-24T13:34:34.589524+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:34:34.589524+0000","last_undegraded":"2024-04-24T13:34:34.589524+0000","last_fullsized":"2024-04-24T13:34:34.589524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"131'18","reported_seq":284,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.526150+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:34:35.526150+0000","last_peered":"2024-04-24T13:34:35.526150+0000","last_clean":"2024-04-24T13:34:35.526150+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:34:35.526150+0000","last_undegraded":"2024-04-24T13:34:35.526150+0000","last_fullsized":"2024-04-24T13:34:35.526150+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"132'12","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554322+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:34:35.554322+0000","last_peered":"2024-04-24T13:34:35.554322+0000","last_clean":"2024-04-24T13:34:35.554322+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:34:35.554322+0000","last_undegraded":"2024-04-24T13:34:35.554322+0000","last_fullsized":"2024-04-24T13:34:35.554322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"131'29","reported_seq":339,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671524+0000","last_change":"2024-04-24T13:33:50.237368+0000","last_active":"2024-04-24T13:34:35.671524+0000","last_peered":"2024-04-24T13:34:35.671524+0000","last_clean":"2024-04-24T13:34:35.671524+0000","last_became_active":"2024-04-24T13:33:49.301145+0000","last_became_peered":"2024-04-24T13:33:49.301145+0000","last_unstale":"2024-04-24T13:34:35.671524+0000","last_undegraded":"2024-04-24T13:34:35.671524+0000","last_fullsized":"2024-04-24T13:34:35.671524+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:57:21.677851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666722+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:34:35.666722+0000","last_peered":"2024-04-24T13:34:35.666722+0000","last_clean":"2024-04-24T13:34:35.666722+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:34:35.666722+0000","last_undegraded":"2024-04-24T13:34:35.666722+0000","last_fullsized":"2024-04-24T13:34:35.666722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"131'16","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556607+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:34:35.556607+0000","last_peered":"2024-04-24T13:34:35.556607+0000","last_clean":"2024-04-24T13:34:35.556607+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:34:35.556607+0000","last_undegraded":"2024-04-24T13:34:35.556607+0000","last_fullsized":"2024-04-24T13:34:35.556607+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"105'8","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668052+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:34:35.668052+0000","last_peered":"2024-04-24T13:34:35.668052+0000","last_clean":"2024-04-24T13:34:35.668052+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:34:35.668052+0000","last_undegraded":"2024-04-24T13:34:35.668052+0000","last_fullsized":"2024-04-24T13:34:35.668052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"131'28","reported_seq":141,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593813+0000","last_change":"2024-04-24T13:33:09.287304+0000","last_active":"2024-04-24T13:34:34.593813+0000","last_peered":"2024-04-24T13:34:34.593813+0000","last_clean":"2024-04-24T13:34:34.593813+0000","last_became_active":"2024-04-24T13:33:08.716282+0000","last_became_peered":"2024-04-24T13:33:08.716282+0000","last_unstale":"2024-04-24T13:34:34.593813+0000","last_undegraded":"2024-04-24T13:34:34.593813+0000","last_fullsized":"2024-04-24T13:34:34.593813+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591204+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:34:34.591204+0000","last_peered":"2024-04-24T13:34:34.591204+0000","last_clean":"2024-04-24T13:34:34.591204+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:34:34.591204+0000","last_undegraded":"2024-04-24T13:34:34.591204+0000","last_fullsized":"2024-04-24T13:34:34.591204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"132'28","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554550+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:34:35.554550+0000","last_peered":"2024-04-24T13:34:35.554550+0000","last_clean":"2024-04-24T13:34:35.554550+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:34:35.554550+0000","last_undegraded":"2024-04-24T13:34:35.554550+0000","last_fullsized":"2024-04-24T13:34:35.554550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665527+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:34:35.665527+0000","last_peered":"2024-04-24T13:34:35.665527+0000","last_clean":"2024-04-24T13:34:35.665527+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:34:35.665527+0000","last_undegraded":"2024-04-24T13:34:35.665527+0000","last_fullsized":"2024-04-24T13:34:35.665527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"131'23","reported_seq":165,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592406+0000","last_change":"2024-04-24T13:33:51.593184+0000","last_active":"2024-04-24T13:34:34.592406+0000","last_peered":"2024-04-24T13:34:34.592406+0000","last_clean":"2024-04-24T13:34:34.592406+0000","last_became_active":"2024-04-24T13:33:49.289463+0000","last_became_peered":"2024-04-24T13:33:49.289463+0000","last_unstale":"2024-04-24T13:34:34.592406+0000","last_undegraded":"2024-04-24T13:34:34.592406+0000","last_fullsized":"2024-04-24T13:34:34.592406+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:42:20.618809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"82'6","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590679+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:34:34.590679+0000","last_peered":"2024-04-24T13:34:34.590679+0000","last_clean":"2024-04-24T13:34:34.590679+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:34:34.590679+0000","last_undegraded":"2024-04-24T13:34:34.590679+0000","last_fullsized":"2024-04-24T13:34:34.590679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"131'24","reported_seq":334,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666298+0000","last_change":"2024-04-24T13:33:52.627571+0000","last_active":"2024-04-24T13:34:35.666298+0000","last_peered":"2024-04-24T13:34:35.666298+0000","last_clean":"2024-04-24T13:34:35.666298+0000","last_became_active":"2024-04-24T13:33:49.302184+0000","last_became_peered":"2024-04-24T13:33:49.302184+0000","last_unstale":"2024-04-24T13:34:35.666298+0000","last_undegraded":"2024-04-24T13:34:35.666298+0000","last_fullsized":"2024-04-24T13:34:35.666298+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:16:24.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":69206016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"82'2","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669580+0000","last_change":"2024-04-24T13:33:53.884916+0000","last_active":"2024-04-24T13:34:35.669580+0000","last_peered":"2024-04-24T13:34:35.669580+0000","last_clean":"2024-04-24T13:34:35.669580+0000","last_became_active":"2024-04-24T13:33:49.300182+0000","last_became_peered":"2024-04-24T13:33:49.300182+0000","last_unstale":"2024-04-24T13:34:35.669580+0000","last_undegraded":"2024-04-24T13:34:35.669580+0000","last_fullsized":"2024-04-24T13:34:35.669580+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:30.442779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"132'30","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668550+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:34:35.668550+0000","last_peered":"2024-04-24T13:34:35.668550+0000","last_clean":"2024-04-24T13:34:35.668550+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:34:35.668550+0000","last_undegraded":"2024-04-24T13:34:35.668550+0000","last_fullsized":"2024-04-24T13:34:35.668550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"82'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665279+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:34:35.665279+0000","last_peered":"2024-04-24T13:34:35.665279+0000","last_clean":"2024-04-24T13:34:35.665279+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:34:35.665279+0000","last_undegraded":"2024-04-24T13:34:35.665279+0000","last_fullsized":"2024-04-24T13:34:35.665279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"131'17","reported_seq":89,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669962+0000","last_change":"2024-04-24T13:33:54.184096+0000","last_active":"2024-04-24T13:34:35.669962+0000","last_peered":"2024-04-24T13:34:35.669962+0000","last_clean":"2024-04-24T13:34:35.669962+0000","last_became_active":"2024-04-24T13:33:49.299554+0000","last_became_peered":"2024-04-24T13:33:49.299554+0000","last_unstale":"2024-04-24T13:34:35.669962+0000","last_undegraded":"2024-04-24T13:34:35.669962+0000","last_fullsized":"2024-04-24T13:34:35.669962+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:18.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69206016,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"82'2","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554228+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:34:35.554228+0000","last_peered":"2024-04-24T13:34:35.554228+0000","last_clean":"2024-04-24T13:34:35.554228+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:34:35.554228+0000","last_undegraded":"2024-04-24T13:34:35.554228+0000","last_fullsized":"2024-04-24T13:34:35.554228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"131'18","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666030+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:34:35.666030+0000","last_peered":"2024-04-24T13:34:35.666030+0000","last_clean":"2024-04-24T13:34:35.666030+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:34:35.666030+0000","last_undegraded":"2024-04-24T13:34:35.666030+0000","last_fullsized":"2024-04-24T13:34:35.666030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667336+0000","last_change":"2024-04-24T13:33:49.302008+0000","last_active":"2024-04-24T13:34:35.667336+0000","last_peered":"2024-04-24T13:34:35.667336+0000","last_clean":"2024-04-24T13:34:35.667336+0000","last_became_active":"2024-04-24T13:33:49.300135+0000","last_became_peered":"2024-04-24T13:33:49.300135+0000","last_unstale":"2024-04-24T13:34:35.667336+0000","last_undegraded":"2024-04-24T13:34:35.667336+0000","last_fullsized":"2024-04-24T13:34:35.667336+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:02.680781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"131'24","reported_seq":177,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595741+0000","last_change":"2024-04-24T13:33:53.222020+0000","last_active":"2024-04-24T13:34:34.595741+0000","last_peered":"2024-04-24T13:34:34.595741+0000","last_clean":"2024-04-24T13:34:34.595741+0000","last_became_active":"2024-04-24T13:33:49.292734+0000","last_became_peered":"2024-04-24T13:33:49.292734+0000","last_unstale":"2024-04-24T13:34:34.595741+0000","last_undegraded":"2024-04-24T13:34:34.595741+0000","last_fullsized":"2024-04-24T13:34:34.595741+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:13.333265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"131'25","reported_seq":139,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594450+0000","last_change":"2024-04-24T13:33:10.398117+0000","last_active":"2024-04-24T13:34:34.594450+0000","last_peered":"2024-04-24T13:34:34.594450+0000","last_clean":"2024-04-24T13:34:34.594450+0000","last_became_active":"2024-04-24T13:33:08.735696+0000","last_became_peered":"2024-04-24T13:33:08.735696+0000","last_unstale":"2024-04-24T13:34:34.594450+0000","last_undegraded":"2024-04-24T13:34:34.594450+0000","last_fullsized":"2024-04-24T13:34:34.594450+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:01:26.139144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668044+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:34:35.668044+0000","last_peered":"2024-04-24T13:34:35.668044+0000","last_clean":"2024-04-24T13:34:35.668044+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:34:35.668044+0000","last_undegraded":"2024-04-24T13:34:35.668044+0000","last_fullsized":"2024-04-24T13:34:35.668044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"132'17","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529204+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:34:35.529204+0000","last_peered":"2024-04-24T13:34:35.529204+0000","last_clean":"2024-04-24T13:34:35.529204+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:34:35.529204+0000","last_undegraded":"2024-04-24T13:34:35.529204+0000","last_fullsized":"2024-04-24T13:34:35.529204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"82'6","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595392+0000","last_change":"2024-04-24T13:33:09.917888+0000","last_active":"2024-04-24T13:34:34.595392+0000","last_peered":"2024-04-24T13:34:34.595392+0000","last_clean":"2024-04-24T13:34:34.595392+0000","last_became_active":"2024-04-24T13:33:08.732489+0000","last_became_peered":"2024-04-24T13:33:08.732489+0000","last_unstale":"2024-04-24T13:34:34.595392+0000","last_undegraded":"2024-04-24T13:34:34.595392+0000","last_fullsized":"2024-04-24T13:34:34.595392+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:16.213872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":342,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":194,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1083,"ondisk_log_size":1083,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":378948,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":842,"num_read_kb":607,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":143,"num_bytes_recovered":62549,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":758,"ondisk_log_size":758,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":339,"num_read_kb":339,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2233,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1458,"num_read_kb":1426,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":449,"num_bytes_recovered":1849688064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574906,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1887076,"kb_used_data":1851736,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92484764,"statfs":{"total":96636764160,"available":94704398336,"internally_reserved":0,"allocated":1896177664,"data_stored":1895415815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":2,"apply_latency_ms":2,"commit_latency_ns":2000000,"apply_latency_ns":2000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574906,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1192136,"kb_used_data":1160956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93179704,"statfs":{"total":96636764160,"available":95416016896,"internally_reserved":0,"allocated":1188818944,"data_stored":1188084563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574907,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2087588,"kb_used_data":2052240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92284252,"statfs":{"total":96636764160,"available":94499074048,"internally_reserved":0,"allocated":2101493760,"data_stored":2100698156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574907,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1542340,"kb_used_data":1511152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92829500,"statfs":{"total":96636764160,"available":95057408000,"internally_reserved":0,"allocated":1547419648,"data_stored":1546697053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574906,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2030032,"kb_used_data":1994692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92341808,"statfs":{"total":96636764160,"available":94558011392,"internally_reserved":0,"allocated":2042564608,"data_stored":2041802088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574907,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1169672,"kb_used_data":1134332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93202168,"statfs":{"total":96636764160,"available":95439020032,"internally_reserved":0,"allocated":1161555968,"data_stored":1160821827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574908,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":983516,"kb_used_data":948172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93388324,"statfs":{"total":96636764160,"available":95629643776,"internally_reserved":0,"allocated":970928128,"data_stored":970158184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574907,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1702740,"kb_used_data":1667400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92669100,"statfs":{"total":96636764160,"available":94893158400,"internally_reserved":0,"allocated":1707417600,"data_stored":1706672098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1704984576,"data_stored":1704984576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":968884224,"data_stored":968884224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1159725056,"data_stored":1159725056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2040528896,"data_stored":2040528896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1545601024,"data_stored":1545601024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2099249152,"data_stored":2099249152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1186988032,"data_stored":1186988032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1893728256,"data_stored":1893728256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":176376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":177072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":351674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:34:39.640 INFO:tasks.ceph.ceph_manager.ceph:recovered! 2024-04-24T13:34:39.640 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config rm mgr mgr_debug_aggressive_pg_num_changes 2024-04-24T13:34:39.986 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-04-24T13:34:39.997 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-04-24T13:34:39.997 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:34:39.998 INFO:tasks.rgw.client.0.smithi071.stdout:2024-04-24T13:34:39.993+0000 7f2a99609640 -1 received signal: Terminated from /usr/bin/python3 /usr/bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 31802) UID: 0 2024-04-24T13:34:39.998 INFO:tasks.rgw.client.0.smithi071.stdout:2024-04-24T13:34:39.993+0000 7f2a9ce51a40 -1 shutting down 2024-04-24T13:34:41.968 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-04-24T13:34:46.098 INFO:tasks.rgw.client.0:Stopped 2024-04-24T13:34:46.099 DEBUG:teuthology.orchestra.run.smithi071:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-04-24T13:34:46.105 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /etc/ceph/vault-root-token 2024-04-24T13:34:46.159 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-04-24T13:34:46.214 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-04-24T13:34:46.214 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-04-24T13:34:46.214 DEBUG:teuthology.orchestra.run.smithi071:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-04-24T13:34:47.666 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-04-24T13:34:47.675 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-04-24T13:34:47.675 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:34:48.016 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:34:48.023 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:34:48.037 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-04-24T13:34:47.329932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300815940,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3149,"num_read_kb":2838,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":669,"num_bytes_recovered":1850933776,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3912,"ondisk_log_size":3912,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12595064,"kb_used_data":12320680,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":742379656,"statfs":{"total":773094113280,"available":760196767744,"internally_reserved":0,"allocated":12616376320,"data_stored":12610349784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":280874545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007671"},"pg_stats":[{"pgid":"3.3f","version":"131'18","reported_seq":92,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669607+0000","last_change":"2024-04-24T13:33:52.298396+0000","last_active":"2024-04-24T13:34:35.669607+0000","last_peered":"2024-04-24T13:34:35.669607+0000","last_clean":"2024-04-24T13:34:35.669607+0000","last_became_active":"2024-04-24T13:33:49.293106+0000","last_became_peered":"2024-04-24T13:33:49.293106+0000","last_unstale":"2024-04-24T13:34:35.669607+0000","last_undegraded":"2024-04-24T13:34:35.669607+0000","last_fullsized":"2024-04-24T13:34:35.669607+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:44.520756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"82'14","reported_seq":309,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594851+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:34:34.594851+0000","last_peered":"2024-04-24T13:34:34.594851+0000","last_clean":"2024-04-24T13:34:34.594851+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:34:34.594851+0000","last_undegraded":"2024-04-24T13:34:34.594851+0000","last_fullsized":"2024-04-24T13:34:34.594851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"132'18","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.531293+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:34:35.531293+0000","last_peered":"2024-04-24T13:34:35.531293+0000","last_clean":"2024-04-24T13:34:35.531293+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:34:35.531293+0000","last_undegraded":"2024-04-24T13:34:35.531293+0000","last_fullsized":"2024-04-24T13:34:35.531293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"82'4","reported_seq":63,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669845+0000","last_change":"2024-04-24T13:33:52.687680+0000","last_active":"2024-04-24T13:34:35.669845+0000","last_peered":"2024-04-24T13:34:35.669845+0000","last_clean":"2024-04-24T13:34:35.669845+0000","last_became_active":"2024-04-24T13:33:49.293840+0000","last_became_peered":"2024-04-24T13:33:49.293840+0000","last_unstale":"2024-04-24T13:34:35.669845+0000","last_undegraded":"2024-04-24T13:34:35.669845+0000","last_fullsized":"2024-04-24T13:34:35.669845+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:13:31.744087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"131'17","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667042+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:34:35.667042+0000","last_peered":"2024-04-24T13:34:35.667042+0000","last_clean":"2024-04-24T13:34:35.667042+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:34:35.667042+0000","last_undegraded":"2024-04-24T13:34:35.667042+0000","last_fullsized":"2024-04-24T13:34:35.667042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":27,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589257+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:34:34.589257+0000","last_peered":"2024-04-24T13:34:34.589257+0000","last_clean":"2024-04-24T13:34:34.589257+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:34:34.589257+0000","last_undegraded":"2024-04-24T13:34:34.589257+0000","last_fullsized":"2024-04-24T13:34:34.589257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"132'25","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594720+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:34:34.594720+0000","last_peered":"2024-04-24T13:34:34.594720+0000","last_clean":"2024-04-24T13:34:34.594720+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:34:34.594720+0000","last_undegraded":"2024-04-24T13:34:34.594720+0000","last_fullsized":"2024-04-24T13:34:34.594720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"132'6","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666016+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:34:35.666016+0000","last_peered":"2024-04-24T13:34:35.666016+0000","last_clean":"2024-04-24T13:34:35.666016+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:34:35.666016+0000","last_undegraded":"2024-04-24T13:34:35.666016+0000","last_fullsized":"2024-04-24T13:34:35.666016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"132'34","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668947+0000","last_change":"2024-04-24T13:33:53.650464+0000","last_active":"2024-04-24T13:34:35.668947+0000","last_peered":"2024-04-24T13:34:35.668947+0000","last_clean":"2024-04-24T13:34:35.668947+0000","last_became_active":"2024-04-24T13:33:49.299781+0000","last_became_peered":"2024-04-24T13:33:49.299781+0000","last_unstale":"2024-04-24T13:34:35.668947+0000","last_undegraded":"2024-04-24T13:34:35.668947+0000","last_fullsized":"2024-04-24T13:34:35.668947+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:08.408193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"82'2","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668172+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:34:35.668172+0000","last_peered":"2024-04-24T13:34:35.668172+0000","last_clean":"2024-04-24T13:34:35.668172+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:34:35.668172+0000","last_undegraded":"2024-04-24T13:34:35.668172+0000","last_fullsized":"2024-04-24T13:34:35.668172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"131'30","reported_seq":298,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593034+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:34:34.593034+0000","last_peered":"2024-04-24T13:34:34.593034+0000","last_clean":"2024-04-24T13:34:34.593034+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:34:34.593034+0000","last_undegraded":"2024-04-24T13:34:34.593034+0000","last_fullsized":"2024-04-24T13:34:34.593034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"82'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590410+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:34:34.590410+0000","last_peered":"2024-04-24T13:34:34.590410+0000","last_clean":"2024-04-24T13:34:34.590410+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:34:34.590410+0000","last_undegraded":"2024-04-24T13:34:34.590410+0000","last_fullsized":"2024-04-24T13:34:34.590410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"131'29","reported_seq":109,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668747+0000","last_change":"2024-04-24T13:33:51.145800+0000","last_active":"2024-04-24T13:34:35.668747+0000","last_peered":"2024-04-24T13:34:35.668747+0000","last_clean":"2024-04-24T13:34:35.668747+0000","last_became_active":"2024-04-24T13:33:49.287926+0000","last_became_peered":"2024-04-24T13:33:49.287926+0000","last_unstale":"2024-04-24T13:34:35.668747+0000","last_undegraded":"2024-04-24T13:34:35.668747+0000","last_fullsized":"2024-04-24T13:34:35.668747+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:22.605125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"82'2","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595672+0000","last_change":"2024-04-24T13:33:09.792748+0000","last_active":"2024-04-24T13:34:34.595672+0000","last_peered":"2024-04-24T13:34:34.595672+0000","last_clean":"2024-04-24T13:34:34.595672+0000","last_became_active":"2024-04-24T13:33:08.725324+0000","last_became_peered":"2024-04-24T13:33:08.725324+0000","last_unstale":"2024-04-24T13:34:34.595672+0000","last_undegraded":"2024-04-24T13:34:34.595672+0000","last_fullsized":"2024-04-24T13:34:34.595672+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:20.696769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"131'18","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554234+0000","last_change":"2024-04-24T13:33:08.836525+0000","last_active":"2024-04-24T13:34:35.554234+0000","last_peered":"2024-04-24T13:34:35.554234+0000","last_clean":"2024-04-24T13:34:35.554234+0000","last_became_active":"2024-04-24T13:33:08.720200+0000","last_became_peered":"2024-04-24T13:33:08.720200+0000","last_unstale":"2024-04-24T13:34:35.554234+0000","last_undegraded":"2024-04-24T13:34:35.554234+0000","last_fullsized":"2024-04-24T13:34:35.554234+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:31.093323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"82'6","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666260+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:34:35.666260+0000","last_peered":"2024-04-24T13:34:35.666260+0000","last_clean":"2024-04-24T13:34:35.666260+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:34:35.666260+0000","last_undegraded":"2024-04-24T13:34:35.666260+0000","last_fullsized":"2024-04-24T13:34:35.666260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"86'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588496+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:34:34.588496+0000","last_peered":"2024-04-24T13:34:34.588496+0000","last_clean":"2024-04-24T13:34:34.588496+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:34:34.588496+0000","last_undegraded":"2024-04-24T13:34:34.588496+0000","last_fullsized":"2024-04-24T13:34:34.588496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"131'24","reported_seq":101,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670455+0000","last_change":"2024-04-24T13:33:51.801208+0000","last_active":"2024-04-24T13:34:35.670455+0000","last_peered":"2024-04-24T13:34:35.670455+0000","last_clean":"2024-04-24T13:34:35.670455+0000","last_became_active":"2024-04-24T13:33:49.287950+0000","last_became_peered":"2024-04-24T13:33:49.287950+0000","last_unstale":"2024-04-24T13:34:35.670455+0000","last_undegraded":"2024-04-24T13:34:35.670455+0000","last_fullsized":"2024-04-24T13:34:35.670455+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:09.811184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"82'4","reported_seq":63,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670154+0000","last_change":"2024-04-24T13:33:53.106900+0000","last_active":"2024-04-24T13:34:35.670154+0000","last_peered":"2024-04-24T13:34:35.670154+0000","last_clean":"2024-04-24T13:34:35.670154+0000","last_became_active":"2024-04-24T13:33:49.294597+0000","last_became_peered":"2024-04-24T13:33:49.294597+0000","last_unstale":"2024-04-24T13:34:35.670154+0000","last_undegraded":"2024-04-24T13:34:35.670154+0000","last_fullsized":"2024-04-24T13:34:35.670154+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:28.384262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"131'28","reported_seq":319,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671293+0000","last_change":"2024-04-24T13:33:08.998015+0000","last_active":"2024-04-24T13:34:35.671293+0000","last_peered":"2024-04-24T13:34:35.671293+0000","last_clean":"2024-04-24T13:34:35.671293+0000","last_became_active":"2024-04-24T13:33:08.726581+0000","last_became_peered":"2024-04-24T13:33:08.726581+0000","last_unstale":"2024-04-24T13:34:35.671293+0000","last_undegraded":"2024-04-24T13:34:35.671293+0000","last_fullsized":"2024-04-24T13:34:35.671293+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:03:25.814262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"86'6","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592134+0000","last_change":"2024-04-24T13:33:09.293808+0000","last_active":"2024-04-24T13:34:34.592134+0000","last_peered":"2024-04-24T13:34:34.592134+0000","last_clean":"2024-04-24T13:34:34.592134+0000","last_became_active":"2024-04-24T13:33:08.719391+0000","last_became_peered":"2024-04-24T13:33:08.719391+0000","last_unstale":"2024-04-24T13:34:34.592134+0000","last_undegraded":"2024-04-24T13:34:34.592134+0000","last_fullsized":"2024-04-24T13:34:34.592134+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:10.422756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"132'22","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670992+0000","last_change":"2024-04-24T13:33:09.199641+0000","last_active":"2024-04-24T13:34:35.670992+0000","last_peered":"2024-04-24T13:34:35.670992+0000","last_clean":"2024-04-24T13:34:35.670992+0000","last_became_active":"2024-04-24T13:33:08.737789+0000","last_became_peered":"2024-04-24T13:33:08.737789+0000","last_unstale":"2024-04-24T13:34:35.670992+0000","last_undegraded":"2024-04-24T13:34:35.670992+0000","last_fullsized":"2024-04-24T13:34:35.670992+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:41.648006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665653+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:34:35.665653+0000","last_peered":"2024-04-24T13:34:35.665653+0000","last_clean":"2024-04-24T13:34:35.665653+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:34:35.665653+0000","last_undegraded":"2024-04-24T13:34:35.665653+0000","last_fullsized":"2024-04-24T13:34:35.665653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"132'24","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590031+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:34:34.590031+0000","last_peered":"2024-04-24T13:34:34.590031+0000","last_clean":"2024-04-24T13:34:34.590031+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:34:34.590031+0000","last_undegraded":"2024-04-24T13:34:34.590031+0000","last_fullsized":"2024-04-24T13:34:34.590031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"132'6","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665503+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:34:35.665503+0000","last_peered":"2024-04-24T13:34:35.665503+0000","last_clean":"2024-04-24T13:34:35.665503+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:34:35.665503+0000","last_undegraded":"2024-04-24T13:34:35.665503+0000","last_fullsized":"2024-04-24T13:34:35.665503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"131'23","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554652+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:34:35.554652+0000","last_peered":"2024-04-24T13:34:35.554652+0000","last_clean":"2024-04-24T13:34:35.554652+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:34:35.554652+0000","last_undegraded":"2024-04-24T13:34:35.554652+0000","last_fullsized":"2024-04-24T13:34:35.554652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590560+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:34:34.590560+0000","last_peered":"2024-04-24T13:34:34.590560+0000","last_clean":"2024-04-24T13:34:34.590560+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:34:34.590560+0000","last_undegraded":"2024-04-24T13:34:34.590560+0000","last_fullsized":"2024-04-24T13:34:34.590560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"132'25","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665634+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:34:35.665634+0000","last_peered":"2024-04-24T13:34:35.665634+0000","last_clean":"2024-04-24T13:34:35.665634+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:34:35.665634+0000","last_undegraded":"2024-04-24T13:34:35.665634+0000","last_fullsized":"2024-04-24T13:34:35.665634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587703+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:34:34.587703+0000","last_peered":"2024-04-24T13:34:34.587703+0000","last_clean":"2024-04-24T13:34:34.587703+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:34:34.587703+0000","last_undegraded":"2024-04-24T13:34:34.587703+0000","last_fullsized":"2024-04-24T13:34:34.587703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"82'2","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556467+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:34:35.556467+0000","last_peered":"2024-04-24T13:34:35.556467+0000","last_clean":"2024-04-24T13:34:35.556467+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:34:35.556467+0000","last_undegraded":"2024-04-24T13:34:35.556467+0000","last_fullsized":"2024-04-24T13:34:35.556467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"132'27","reported_seq":105,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668651+0000","last_change":"2024-04-24T13:33:49.775824+0000","last_active":"2024-04-24T13:34:35.668651+0000","last_peered":"2024-04-24T13:34:35.668651+0000","last_clean":"2024-04-24T13:34:35.668651+0000","last_became_active":"2024-04-24T13:33:49.282849+0000","last_became_peered":"2024-04-24T13:33:49.282849+0000","last_unstale":"2024-04-24T13:34:35.668651+0000","last_undegraded":"2024-04-24T13:34:35.668651+0000","last_fullsized":"2024-04-24T13:34:35.668651+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:12:15.350559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595154+0000","last_change":"2024-04-24T13:33:10.797093+0000","last_active":"2024-04-24T13:34:34.595154+0000","last_peered":"2024-04-24T13:34:34.595154+0000","last_clean":"2024-04-24T13:34:34.595154+0000","last_became_active":"2024-04-24T13:33:08.736087+0000","last_became_peered":"2024-04-24T13:33:08.736087+0000","last_unstale":"2024-04-24T13:34:34.595154+0000","last_undegraded":"2024-04-24T13:34:34.595154+0000","last_fullsized":"2024-04-24T13:34:34.595154+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:49:31.056251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"132'17","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667818+0000","last_change":"2024-04-24T13:33:51.608371+0000","last_active":"2024-04-24T13:34:35.667818+0000","last_peered":"2024-04-24T13:34:35.667818+0000","last_clean":"2024-04-24T13:34:35.667818+0000","last_became_active":"2024-04-24T13:33:49.295172+0000","last_became_peered":"2024-04-24T13:33:49.295172+0000","last_unstale":"2024-04-24T13:34:35.667818+0000","last_undegraded":"2024-04-24T13:34:35.667818+0000","last_fullsized":"2024-04-24T13:34:35.667818+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:46:40.352367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670310+0000","last_change":"2024-04-24T13:33:49.295489+0000","last_active":"2024-04-24T13:34:35.670310+0000","last_peered":"2024-04-24T13:34:35.670310+0000","last_clean":"2024-04-24T13:34:35.670310+0000","last_became_active":"2024-04-24T13:33:49.292611+0000","last_became_peered":"2024-04-24T13:33:49.292611+0000","last_unstale":"2024-04-24T13:34:35.670310+0000","last_undegraded":"2024-04-24T13:34:35.670310+0000","last_fullsized":"2024-04-24T13:34:35.670310+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:52:22.537619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"132'48","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592278+0000","last_change":"2024-04-24T13:33:08.911162+0000","last_active":"2024-04-24T13:34:34.592278+0000","last_peered":"2024-04-24T13:34:34.592278+0000","last_clean":"2024-04-24T13:34:34.592278+0000","last_became_active":"2024-04-24T13:33:08.709158+0000","last_became_peered":"2024-04-24T13:33:08.709158+0000","last_unstale":"2024-04-24T13:34:34.592278+0000","last_undegraded":"2024-04-24T13:34:34.592278+0000","last_fullsized":"2024-04-24T13:34:34.592278+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:56.162767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"82'4","reported_seq":119,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595727+0000","last_change":"2024-04-24T13:33:53.234461+0000","last_active":"2024-04-24T13:34:34.595727+0000","last_peered":"2024-04-24T13:34:34.595727+0000","last_clean":"2024-04-24T13:34:34.595727+0000","last_became_active":"2024-04-24T13:33:49.302172+0000","last_became_peered":"2024-04-24T13:33:49.302172+0000","last_unstale":"2024-04-24T13:34:34.595727+0000","last_undegraded":"2024-04-24T13:34:34.595727+0000","last_fullsized":"2024-04-24T13:34:34.595727+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:55:38.136746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"131'19","reported_seq":323,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665731+0000","last_change":"2024-04-24T13:33:49.666596+0000","last_active":"2024-04-24T13:34:35.665731+0000","last_peered":"2024-04-24T13:34:35.665731+0000","last_clean":"2024-04-24T13:34:35.665731+0000","last_became_active":"2024-04-24T13:33:49.283461+0000","last_became_peered":"2024-04-24T13:33:49.283461+0000","last_unstale":"2024-04-24T13:34:35.665731+0000","last_undegraded":"2024-04-24T13:34:35.665731+0000","last_fullsized":"2024-04-24T13:34:35.665731+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:49:27.034645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556319+0000","last_change":"2024-04-24T13:33:49.301406+0000","last_active":"2024-04-24T13:34:35.556319+0000","last_peered":"2024-04-24T13:34:35.556319+0000","last_clean":"2024-04-24T13:34:35.556319+0000","last_became_active":"2024-04-24T13:33:49.300648+0000","last_became_peered":"2024-04-24T13:33:49.300648+0000","last_unstale":"2024-04-24T13:34:35.556319+0000","last_undegraded":"2024-04-24T13:34:35.556319+0000","last_fullsized":"2024-04-24T13:34:35.556319+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:41:13.998419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590838+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:34:34.590838+0000","last_peered":"2024-04-24T13:34:34.590838+0000","last_clean":"2024-04-24T13:34:34.590838+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:34:34.590838+0000","last_undegraded":"2024-04-24T13:34:34.590838+0000","last_fullsized":"2024-04-24T13:34:34.590838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590524+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:34:34.590524+0000","last_peered":"2024-04-24T13:34:34.590524+0000","last_clean":"2024-04-24T13:34:34.590524+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:34:34.590524+0000","last_undegraded":"2024-04-24T13:34:34.590524+0000","last_fullsized":"2024-04-24T13:34:34.590524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665370+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:34:35.665370+0000","last_peered":"2024-04-24T13:34:35.665370+0000","last_clean":"2024-04-24T13:34:35.665370+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:34:35.665370+0000","last_undegraded":"2024-04-24T13:34:35.665370+0000","last_fullsized":"2024-04-24T13:34:35.665370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"86'10","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667179+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:34:35.667179+0000","last_peered":"2024-04-24T13:34:35.667179+0000","last_clean":"2024-04-24T13:34:35.667179+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:34:35.667179+0000","last_undegraded":"2024-04-24T13:34:35.667179+0000","last_fullsized":"2024-04-24T13:34:35.667179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"132'24","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668571+0000","last_change":"2024-04-24T13:33:50.330934+0000","last_active":"2024-04-24T13:34:35.668571+0000","last_peered":"2024-04-24T13:34:35.668571+0000","last_clean":"2024-04-24T13:34:35.668571+0000","last_became_active":"2024-04-24T13:33:49.286157+0000","last_became_peered":"2024-04-24T13:33:49.286157+0000","last_unstale":"2024-04-24T13:34:35.668571+0000","last_undegraded":"2024-04-24T13:34:35.668571+0000","last_fullsized":"2024-04-24T13:34:35.668571+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:10.162075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.557008+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:34:35.557008+0000","last_peered":"2024-04-24T13:34:35.557008+0000","last_clean":"2024-04-24T13:34:35.557008+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:34:35.557008+0000","last_undegraded":"2024-04-24T13:34:35.557008+0000","last_fullsized":"2024-04-24T13:34:35.557008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664419+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:34:35.664419+0000","last_peered":"2024-04-24T13:34:35.664419+0000","last_clean":"2024-04-24T13:34:35.664419+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:34:35.664419+0000","last_undegraded":"2024-04-24T13:34:35.664419+0000","last_fullsized":"2024-04-24T13:34:35.664419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"150'139","reported_seq":426,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670684+0000","last_change":"2024-04-24T13:33:52.550604+0000","last_active":"2024-04-24T13:34:35.670684+0000","last_peered":"2024-04-24T13:34:35.670684+0000","last_clean":"2024-04-24T13:34:35.670684+0000","last_became_active":"2024-04-24T13:33:52.550123+0000","last_became_peered":"2024-04-24T13:33:52.550123+0000","last_unstale":"2024-04-24T13:34:35.670684+0000","last_undegraded":"2024-04-24T13:34:35.670684+0000","last_fullsized":"2024-04-24T13:34:35.670684+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:09:41.226875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"105'8","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588558+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:34:34.588558+0000","last_peered":"2024-04-24T13:34:34.588558+0000","last_clean":"2024-04-24T13:34:34.588558+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:34:34.588558+0000","last_undegraded":"2024-04-24T13:34:34.588558+0000","last_fullsized":"2024-04-24T13:34:34.588558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"132'4","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556508+0000","last_change":"2024-04-24T13:33:51.170660+0000","last_active":"2024-04-24T13:34:35.556508+0000","last_peered":"2024-04-24T13:34:35.556508+0000","last_clean":"2024-04-24T13:34:35.556508+0000","last_became_active":"2024-04-24T13:33:49.301591+0000","last_became_peered":"2024-04-24T13:33:49.301591+0000","last_unstale":"2024-04-24T13:34:35.556508+0000","last_undegraded":"2024-04-24T13:34:35.556508+0000","last_fullsized":"2024-04-24T13:34:35.556508+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:16:26.080736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"132'27","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667008+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:34:35.667008+0000","last_peered":"2024-04-24T13:34:35.667008+0000","last_clean":"2024-04-24T13:34:35.667008+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:34:35.667008+0000","last_undegraded":"2024-04-24T13:34:35.667008+0000","last_fullsized":"2024-04-24T13:34:35.667008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595591+0000","last_change":"2024-04-24T13:33:08.718010+0000","last_active":"2024-04-24T13:34:34.595591+0000","last_peered":"2024-04-24T13:34:34.595591+0000","last_clean":"2024-04-24T13:34:34.595591+0000","last_became_active":"2024-04-24T13:33:08.716072+0000","last_became_peered":"2024-04-24T13:33:08.716072+0000","last_unstale":"2024-04-24T13:34:34.595591+0000","last_undegraded":"2024-04-24T13:34:34.595591+0000","last_fullsized":"2024-04-24T13:34:34.595591+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:26.626730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"132'17","reported_seq":68,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669637+0000","last_change":"2024-04-24T13:33:52.725009+0000","last_active":"2024-04-24T13:34:35.669637+0000","last_peered":"2024-04-24T13:34:35.669637+0000","last_clean":"2024-04-24T13:34:35.669637+0000","last_became_active":"2024-04-24T13:33:49.294133+0000","last_became_peered":"2024-04-24T13:33:49.294133+0000","last_unstale":"2024-04-24T13:34:35.669637+0000","last_undegraded":"2024-04-24T13:34:35.669637+0000","last_fullsized":"2024-04-24T13:34:35.669637+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:51.462917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"150'135","reported_seq":465,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556045+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:34:35.556045+0000","last_peered":"2024-04-24T13:34:35.556045+0000","last_clean":"2024-04-24T13:34:35.556045+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:34:35.556045+0000","last_undegraded":"2024-04-24T13:34:35.556045+0000","last_fullsized":"2024-04-24T13:34:35.556045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"82'2","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594248+0000","last_change":"2024-04-24T13:33:49.308248+0000","last_active":"2024-04-24T13:34:34.594248+0000","last_peered":"2024-04-24T13:34:34.594248+0000","last_clean":"2024-04-24T13:34:34.594248+0000","last_became_active":"2024-04-24T13:33:49.278105+0000","last_became_peered":"2024-04-24T13:33:49.278105+0000","last_unstale":"2024-04-24T13:34:34.594248+0000","last_undegraded":"2024-04-24T13:34:34.594248+0000","last_fullsized":"2024-04-24T13:34:34.594248+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:20.068883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"132'25","reported_seq":97,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669876+0000","last_change":"2024-04-24T13:33:53.103595+0000","last_active":"2024-04-24T13:34:35.669876+0000","last_peered":"2024-04-24T13:34:35.669876+0000","last_clean":"2024-04-24T13:34:35.669876+0000","last_became_active":"2024-04-24T13:33:49.297787+0000","last_became_peered":"2024-04-24T13:33:49.297787+0000","last_unstale":"2024-04-24T13:34:35.669876+0000","last_undegraded":"2024-04-24T13:34:35.669876+0000","last_fullsized":"2024-04-24T13:34:35.669876+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668999+0000","last_change":"2024-04-24T13:33:49.299431+0000","last_active":"2024-04-24T13:34:35.668999+0000","last_peered":"2024-04-24T13:34:35.668999+0000","last_clean":"2024-04-24T13:34:35.668999+0000","last_became_active":"2024-04-24T13:33:49.294593+0000","last_became_peered":"2024-04-24T13:33:49.294593+0000","last_unstale":"2024-04-24T13:34:35.668999+0000","last_undegraded":"2024-04-24T13:34:35.668999+0000","last_fullsized":"2024-04-24T13:34:35.668999+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:36.135388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"132'28","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592767+0000","last_change":"2024-04-24T13:33:10.421787+0000","last_active":"2024-04-24T13:34:34.592767+0000","last_peered":"2024-04-24T13:34:34.592767+0000","last_clean":"2024-04-24T13:34:34.592767+0000","last_became_active":"2024-04-24T13:33:08.733302+0000","last_became_peered":"2024-04-24T13:33:08.733302+0000","last_unstale":"2024-04-24T13:34:34.592767+0000","last_undegraded":"2024-04-24T13:34:34.592767+0000","last_fullsized":"2024-04-24T13:34:34.592767+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:10:16.339117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529307+0000","last_change":"2024-04-24T13:33:08.727357+0000","last_active":"2024-04-24T13:34:35.529307+0000","last_peered":"2024-04-24T13:34:35.529307+0000","last_clean":"2024-04-24T13:34:35.529307+0000","last_became_active":"2024-04-24T13:33:08.726787+0000","last_became_peered":"2024-04-24T13:33:08.726787+0000","last_unstale":"2024-04-24T13:34:35.529307+0000","last_undegraded":"2024-04-24T13:34:35.529307+0000","last_fullsized":"2024-04-24T13:34:35.529307+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:49.701435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"86'7","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594758+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:34:34.594758+0000","last_peered":"2024-04-24T13:34:34.594758+0000","last_clean":"2024-04-24T13:34:34.594758+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:34:34.594758+0000","last_undegraded":"2024-04-24T13:34:34.594758+0000","last_fullsized":"2024-04-24T13:34:34.594758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"132'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588759+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:34:34.588759+0000","last_peered":"2024-04-24T13:34:34.588759+0000","last_clean":"2024-04-24T13:34:34.588759+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:34:34.588759+0000","last_undegraded":"2024-04-24T13:34:34.588759+0000","last_fullsized":"2024-04-24T13:34:34.588759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"132'17","reported_seq":86,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669927+0000","last_change":"2024-04-24T13:33:50.539289+0000","last_active":"2024-04-24T13:34:35.669927+0000","last_peered":"2024-04-24T13:34:35.669927+0000","last_clean":"2024-04-24T13:34:35.669927+0000","last_became_active":"2024-04-24T13:33:49.284576+0000","last_became_peered":"2024-04-24T13:33:49.284576+0000","last_unstale":"2024-04-24T13:34:35.669927+0000","last_undegraded":"2024-04-24T13:34:35.669927+0000","last_fullsized":"2024-04-24T13:34:35.669927+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:20.287647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664846+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:34:35.664846+0000","last_peered":"2024-04-24T13:34:35.664846+0000","last_clean":"2024-04-24T13:34:35.664846+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:34:35.664846+0000","last_undegraded":"2024-04-24T13:34:35.664846+0000","last_fullsized":"2024-04-24T13:34:35.664846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"132'18","reported_seq":309,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555087+0000","last_change":"2024-04-24T13:33:52.751477+0000","last_active":"2024-04-24T13:34:35.555087+0000","last_peered":"2024-04-24T13:34:35.555087+0000","last_clean":"2024-04-24T13:34:35.555087+0000","last_became_active":"2024-04-24T13:33:49.308018+0000","last_became_peered":"2024-04-24T13:33:49.308018+0000","last_unstale":"2024-04-24T13:34:35.555087+0000","last_undegraded":"2024-04-24T13:34:35.555087+0000","last_fullsized":"2024-04-24T13:34:35.555087+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:29:49.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554059+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:34:35.554059+0000","last_peered":"2024-04-24T13:34:35.554059+0000","last_clean":"2024-04-24T13:34:35.554059+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:34:35.554059+0000","last_undegraded":"2024-04-24T13:34:35.554059+0000","last_fullsized":"2024-04-24T13:34:35.554059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":243,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667433+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:34:35.667433+0000","last_peered":"2024-04-24T13:34:35.667433+0000","last_clean":"2024-04-24T13:34:35.667433+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:34:35.667433+0000","last_undegraded":"2024-04-24T13:34:35.667433+0000","last_fullsized":"2024-04-24T13:34:35.667433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"82'4","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667381+0000","last_change":"2024-04-24T13:32:01.548738+0000","last_active":"2024-04-24T13:34:35.667381+0000","last_peered":"2024-04-24T13:34:35.667381+0000","last_clean":"2024-04-24T13:34:35.667381+0000","last_became_active":"2024-04-24T13:32:01.548259+0000","last_became_peered":"2024-04-24T13:32:01.548259+0000","last_unstale":"2024-04-24T13:34:35.667381+0000","last_undegraded":"2024-04-24T13:34:35.667381+0000","last_fullsized":"2024-04-24T13:34:35.667381+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"131'26","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669452+0000","last_change":"2024-04-24T13:33:52.683024+0000","last_active":"2024-04-24T13:34:35.669452+0000","last_peered":"2024-04-24T13:34:35.669452+0000","last_clean":"2024-04-24T13:34:35.669452+0000","last_became_active":"2024-04-24T13:33:49.293373+0000","last_became_peered":"2024-04-24T13:33:49.293373+0000","last_unstale":"2024-04-24T13:34:35.669452+0000","last_undegraded":"2024-04-24T13:34:35.669452+0000","last_fullsized":"2024-04-24T13:34:35.669452+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:05:00.168247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665398+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:34:35.665398+0000","last_peered":"2024-04-24T13:34:35.665398+0000","last_clean":"2024-04-24T13:34:35.665398+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:34:35.665398+0000","last_undegraded":"2024-04-24T13:34:35.665398+0000","last_fullsized":"2024-04-24T13:34:35.665398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"132'23","reported_seq":74,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667835+0000","last_change":"2024-04-24T13:33:53.666421+0000","last_active":"2024-04-24T13:34:35.667835+0000","last_peered":"2024-04-24T13:34:35.667835+0000","last_clean":"2024-04-24T13:34:35.667835+0000","last_became_active":"2024-04-24T13:33:49.302140+0000","last_became_peered":"2024-04-24T13:33:49.302140+0000","last_unstale":"2024-04-24T13:34:35.667835+0000","last_undegraded":"2024-04-24T13:34:35.667835+0000","last_fullsized":"2024-04-24T13:34:35.667835+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.223797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"150'135","reported_seq":514,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665118+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:34:35.665118+0000","last_peered":"2024-04-24T13:34:35.665118+0000","last_clean":"2024-04-24T13:34:35.665118+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:34:35.665118+0000","last_undegraded":"2024-04-24T13:34:35.665118+0000","last_fullsized":"2024-04-24T13:34:35.665118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"82'3","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667725+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:34:35.667725+0000","last_peered":"2024-04-24T13:34:35.667725+0000","last_clean":"2024-04-24T13:34:35.667725+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:34:35.667725+0000","last_undegraded":"2024-04-24T13:34:35.667725+0000","last_fullsized":"2024-04-24T13:34:35.667725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"132'10","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666648+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:34:35.666648+0000","last_peered":"2024-04-24T13:34:35.666648+0000","last_clean":"2024-04-24T13:34:35.666648+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:34:35.666648+0000","last_undegraded":"2024-04-24T13:34:35.666648+0000","last_fullsized":"2024-04-24T13:34:35.666648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"131'23","reported_seq":135,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594898+0000","last_change":"2024-04-24T13:33:10.787412+0000","last_active":"2024-04-24T13:34:34.594898+0000","last_peered":"2024-04-24T13:34:34.594898+0000","last_clean":"2024-04-24T13:34:34.594898+0000","last_became_active":"2024-04-24T13:33:08.718332+0000","last_became_peered":"2024-04-24T13:33:08.718332+0000","last_unstale":"2024-04-24T13:34:34.594898+0000","last_undegraded":"2024-04-24T13:34:34.594898+0000","last_fullsized":"2024-04-24T13:34:34.594898+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:11.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665188+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:34:35.665188+0000","last_peered":"2024-04-24T13:34:35.665188+0000","last_clean":"2024-04-24T13:34:35.665188+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:34:35.665188+0000","last_undegraded":"2024-04-24T13:34:35.665188+0000","last_fullsized":"2024-04-24T13:34:35.665188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"132'28","reported_seq":325,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665332+0000","last_change":"2024-04-24T13:33:51.156026+0000","last_active":"2024-04-24T13:34:35.665332+0000","last_peered":"2024-04-24T13:34:35.665332+0000","last_clean":"2024-04-24T13:34:35.665332+0000","last_became_active":"2024-04-24T13:33:49.292150+0000","last_became_peered":"2024-04-24T13:33:49.292150+0000","last_unstale":"2024-04-24T13:34:35.665332+0000","last_undegraded":"2024-04-24T13:34:35.665332+0000","last_fullsized":"2024-04-24T13:34:35.665332+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:42.853378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665105+0000","last_change":"2024-04-24T13:33:49.306397+0000","last_active":"2024-04-24T13:34:35.665105+0000","last_peered":"2024-04-24T13:34:35.665105+0000","last_clean":"2024-04-24T13:34:35.665105+0000","last_became_active":"2024-04-24T13:33:49.305572+0000","last_became_peered":"2024-04-24T13:33:49.305572+0000","last_unstale":"2024-04-24T13:34:35.665105+0000","last_undegraded":"2024-04-24T13:34:35.665105+0000","last_fullsized":"2024-04-24T13:34:35.665105+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:48.247418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"126'11","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529509+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:34:35.529509+0000","last_peered":"2024-04-24T13:34:35.529509+0000","last_clean":"2024-04-24T13:34:35.529509+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:34:35.529509+0000","last_undegraded":"2024-04-24T13:34:35.529509+0000","last_fullsized":"2024-04-24T13:34:35.529509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"132'8","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590413+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:34:34.590413+0000","last_peered":"2024-04-24T13:34:34.590413+0000","last_clean":"2024-04-24T13:34:34.590413+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:34:34.590413+0000","last_undegraded":"2024-04-24T13:34:34.590413+0000","last_fullsized":"2024-04-24T13:34:34.590413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"132'29","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554380+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:34:35.554380+0000","last_peered":"2024-04-24T13:34:35.554380+0000","last_clean":"2024-04-24T13:34:35.554380+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:34:35.554380+0000","last_undegraded":"2024-04-24T13:34:35.554380+0000","last_fullsized":"2024-04-24T13:34:35.554380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":275,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665339+0000","last_change":"2024-04-24T13:33:49.300767+0000","last_active":"2024-04-24T13:34:35.665339+0000","last_peered":"2024-04-24T13:34:35.665339+0000","last_clean":"2024-04-24T13:34:35.665339+0000","last_became_active":"2024-04-24T13:33:49.300030+0000","last_became_peered":"2024-04-24T13:33:49.300030+0000","last_unstale":"2024-04-24T13:34:35.665339+0000","last_undegraded":"2024-04-24T13:34:35.665339+0000","last_fullsized":"2024-04-24T13:34:35.665339+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:28.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"132'19","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590813+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:34:34.590813+0000","last_peered":"2024-04-24T13:34:34.590813+0000","last_clean":"2024-04-24T13:34:34.590813+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:34:34.590813+0000","last_undegraded":"2024-04-24T13:34:34.590813+0000","last_fullsized":"2024-04-24T13:34:34.590813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667965+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:34:35.667965+0000","last_peered":"2024-04-24T13:34:35.667965+0000","last_clean":"2024-04-24T13:34:35.667965+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:34:35.667965+0000","last_undegraded":"2024-04-24T13:34:35.667965+0000","last_fullsized":"2024-04-24T13:34:35.667965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554807+0000","last_change":"2024-04-24T13:33:08.720576+0000","last_active":"2024-04-24T13:34:35.554807+0000","last_peered":"2024-04-24T13:34:35.554807+0000","last_clean":"2024-04-24T13:34:35.554807+0000","last_became_active":"2024-04-24T13:33:08.720133+0000","last_became_peered":"2024-04-24T13:33:08.720133+0000","last_unstale":"2024-04-24T13:34:35.554807+0000","last_undegraded":"2024-04-24T13:34:35.554807+0000","last_fullsized":"2024-04-24T13:34:35.554807+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:16.254173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590861+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:34:34.590861+0000","last_peered":"2024-04-24T13:34:34.590861+0000","last_clean":"2024-04-24T13:34:34.590861+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:34:34.590861+0000","last_undegraded":"2024-04-24T13:34:34.590861+0000","last_fullsized":"2024-04-24T13:34:34.590861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"131'33","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667642+0000","last_change":"2024-04-24T13:31:00.986244+0000","last_active":"2024-04-24T13:34:35.667642+0000","last_peered":"2024-04-24T13:34:35.667642+0000","last_clean":"2024-04-24T13:34:35.667642+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:34:35.667642+0000","last_undegraded":"2024-04-24T13:34:35.667642+0000","last_fullsized":"2024-04-24T13:34:35.667642+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:23.355231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.524931+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:34:35.524931+0000","last_peered":"2024-04-24T13:34:35.524931+0000","last_clean":"2024-04-24T13:34:35.524931+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:34:35.524931+0000","last_undegraded":"2024-04-24T13:34:35.524931+0000","last_fullsized":"2024-04-24T13:34:35.524931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"132'25","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666099+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:34:35.666099+0000","last_peered":"2024-04-24T13:34:35.666099+0000","last_clean":"2024-04-24T13:34:35.666099+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:34:35.666099+0000","last_undegraded":"2024-04-24T13:34:35.666099+0000","last_fullsized":"2024-04-24T13:34:35.666099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"150'139","reported_seq":470,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665834+0000","last_change":"2024-04-24T13:33:11.710852+0000","last_active":"2024-04-24T13:34:35.665834+0000","last_peered":"2024-04-24T13:34:35.665834+0000","last_clean":"2024-04-24T13:34:35.665834+0000","last_became_active":"2024-04-24T13:33:11.709412+0000","last_became_peered":"2024-04-24T13:33:11.709412+0000","last_unstale":"2024-04-24T13:34:35.665834+0000","last_undegraded":"2024-04-24T13:34:35.665834+0000","last_fullsized":"2024-04-24T13:34:35.665834+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:22:40.670445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":247,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529048+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:34:35.529048+0000","last_peered":"2024-04-24T13:34:35.529048+0000","last_clean":"2024-04-24T13:34:35.529048+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:34:35.529048+0000","last_undegraded":"2024-04-24T13:34:35.529048+0000","last_fullsized":"2024-04-24T13:34:35.529048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"114'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591312+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:34:34.591312+0000","last_peered":"2024-04-24T13:34:34.591312+0000","last_clean":"2024-04-24T13:34:34.591312+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:34:34.591312+0000","last_undegraded":"2024-04-24T13:34:34.591312+0000","last_fullsized":"2024-04-24T13:34:34.591312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"132'26","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588065+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:34:34.588065+0000","last_peered":"2024-04-24T13:34:34.588065+0000","last_clean":"2024-04-24T13:34:34.588065+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:34:34.588065+0000","last_undegraded":"2024-04-24T13:34:34.588065+0000","last_fullsized":"2024-04-24T13:34:34.588065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":148,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595952+0000","last_change":"2024-04-24T13:33:09.912410+0000","last_active":"2024-04-24T13:34:34.595952+0000","last_peered":"2024-04-24T13:34:34.595952+0000","last_clean":"2024-04-24T13:34:34.595952+0000","last_became_active":"2024-04-24T13:33:08.724858+0000","last_became_peered":"2024-04-24T13:33:08.724858+0000","last_unstale":"2024-04-24T13:34:34.595952+0000","last_undegraded":"2024-04-24T13:34:34.595952+0000","last_fullsized":"2024-04-24T13:34:34.595952+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:26.760043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":176,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"82'11","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556099+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:34:35.556099+0000","last_peered":"2024-04-24T13:34:35.556099+0000","last_clean":"2024-04-24T13:34:35.556099+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:34:35.556099+0000","last_undegraded":"2024-04-24T13:34:35.556099+0000","last_fullsized":"2024-04-24T13:34:35.556099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"150'135","reported_seq":479,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667871+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:34:35.667871+0000","last_peered":"2024-04-24T13:34:35.667871+0000","last_clean":"2024-04-24T13:34:35.667871+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:34:35.667871+0000","last_undegraded":"2024-04-24T13:34:35.667871+0000","last_fullsized":"2024-04-24T13:34:35.667871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"132'4","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589121+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:34:34.589121+0000","last_peered":"2024-04-24T13:34:34.589121+0000","last_clean":"2024-04-24T13:34:34.589121+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:34:34.589121+0000","last_undegraded":"2024-04-24T13:34:34.589121+0000","last_fullsized":"2024-04-24T13:34:34.589121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"86'4","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529743+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:34:35.529743+0000","last_peered":"2024-04-24T13:34:35.529743+0000","last_clean":"2024-04-24T13:34:35.529743+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:34:35.529743+0000","last_undegraded":"2024-04-24T13:34:35.529743+0000","last_fullsized":"2024-04-24T13:34:35.529743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"132'35","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554099+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:34:35.554099+0000","last_peered":"2024-04-24T13:34:35.554099+0000","last_clean":"2024-04-24T13:34:35.554099+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:34:35.554099+0000","last_undegraded":"2024-04-24T13:34:35.554099+0000","last_fullsized":"2024-04-24T13:34:35.554099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591102+0000","last_change":"2024-04-24T13:33:08.716879+0000","last_active":"2024-04-24T13:34:34.591102+0000","last_peered":"2024-04-24T13:34:34.591102+0000","last_clean":"2024-04-24T13:34:34.591102+0000","last_became_active":"2024-04-24T13:33:08.716585+0000","last_became_peered":"2024-04-24T13:33:08.716585+0000","last_unstale":"2024-04-24T13:34:34.591102+0000","last_undegraded":"2024-04-24T13:34:34.591102+0000","last_fullsized":"2024-04-24T13:34:34.591102+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:36.135388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"132'25","reported_seq":123,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595276+0000","last_change":"2024-04-24T13:33:10.818135+0000","last_active":"2024-04-24T13:34:34.595276+0000","last_peered":"2024-04-24T13:34:34.595276+0000","last_clean":"2024-04-24T13:34:34.595276+0000","last_became_active":"2024-04-24T13:33:08.736280+0000","last_became_peered":"2024-04-24T13:33:08.736280+0000","last_unstale":"2024-04-24T13:34:34.595276+0000","last_undegraded":"2024-04-24T13:34:34.595276+0000","last_fullsized":"2024-04-24T13:34:34.595276+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:41:16.005578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667479+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:34:35.667479+0000","last_peered":"2024-04-24T13:34:35.667479+0000","last_clean":"2024-04-24T13:34:35.667479+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:34:35.667479+0000","last_undegraded":"2024-04-24T13:34:35.667479+0000","last_fullsized":"2024-04-24T13:34:35.667479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"82'2","reported_seq":265,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529259+0000","last_change":"2024-04-24T13:33:09.338972+0000","last_active":"2024-04-24T13:34:35.529259+0000","last_peered":"2024-04-24T13:34:35.529259+0000","last_clean":"2024-04-24T13:34:35.529259+0000","last_became_active":"2024-04-24T13:33:08.727402+0000","last_became_peered":"2024-04-24T13:33:08.727402+0000","last_unstale":"2024-04-24T13:34:35.529259+0000","last_undegraded":"2024-04-24T13:34:35.529259+0000","last_fullsized":"2024-04-24T13:34:35.529259+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:34.956692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"105'4","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670731+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:34:35.670731+0000","last_peered":"2024-04-24T13:34:35.670731+0000","last_clean":"2024-04-24T13:34:35.670731+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:34:35.670731+0000","last_undegraded":"2024-04-24T13:34:35.670731+0000","last_fullsized":"2024-04-24T13:34:35.670731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":388,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668111+0000","last_change":"2024-04-24T13:33:54.557574+0000","last_active":"2024-04-24T13:34:35.668111+0000","last_peered":"2024-04-24T13:34:35.668111+0000","last_clean":"2024-04-24T13:34:35.668111+0000","last_became_active":"2024-04-24T13:33:54.557258+0000","last_became_peered":"2024-04-24T13:33:54.557258+0000","last_unstale":"2024-04-24T13:34:35.668111+0000","last_undegraded":"2024-04-24T13:34:35.668111+0000","last_fullsized":"2024-04-24T13:34:35.668111+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:14:04.108561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593434+0000","last_change":"2024-04-24T13:33:08.717037+0000","last_active":"2024-04-24T13:34:34.593434+0000","last_peered":"2024-04-24T13:34:34.593434+0000","last_clean":"2024-04-24T13:34:34.593434+0000","last_became_active":"2024-04-24T13:33:08.715914+0000","last_became_peered":"2024-04-24T13:33:08.715914+0000","last_unstale":"2024-04-24T13:34:34.593434+0000","last_undegraded":"2024-04-24T13:34:34.593434+0000","last_fullsized":"2024-04-24T13:34:34.593434+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:03.765941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"132'28","reported_seq":323,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554259+0000","last_change":"2024-04-24T13:33:09.529789+0000","last_active":"2024-04-24T13:34:35.554259+0000","last_peered":"2024-04-24T13:34:35.554259+0000","last_clean":"2024-04-24T13:34:35.554259+0000","last_became_active":"2024-04-24T13:33:08.725348+0000","last_became_peered":"2024-04-24T13:33:08.725348+0000","last_unstale":"2024-04-24T13:34:35.554259+0000","last_undegraded":"2024-04-24T13:34:35.554259+0000","last_fullsized":"2024-04-24T13:34:35.554259+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:18.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668973+0000","last_change":"2024-04-24T13:33:49.295687+0000","last_active":"2024-04-24T13:34:35.668973+0000","last_peered":"2024-04-24T13:34:35.668973+0000","last_clean":"2024-04-24T13:34:35.668973+0000","last_became_active":"2024-04-24T13:33:49.293916+0000","last_became_peered":"2024-04-24T13:33:49.293916+0000","last_unstale":"2024-04-24T13:34:35.668973+0000","last_undegraded":"2024-04-24T13:34:35.668973+0000","last_fullsized":"2024-04-24T13:34:35.668973+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:19.712676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"132'41","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.596147+0000","last_change":"2024-04-24T13:33:09.565111+0000","last_active":"2024-04-24T13:34:34.596147+0000","last_peered":"2024-04-24T13:34:34.596147+0000","last_clean":"2024-04-24T13:34:34.596147+0000","last_became_active":"2024-04-24T13:33:08.719950+0000","last_became_peered":"2024-04-24T13:33:08.719950+0000","last_unstale":"2024-04-24T13:34:34.596147+0000","last_undegraded":"2024-04-24T13:34:34.596147+0000","last_fullsized":"2024-04-24T13:34:34.596147+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:37.122088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179174,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":22,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":58868,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668132+0000","last_change":"2024-04-24T13:33:49.296153+0000","last_active":"2024-04-24T13:34:35.668132+0000","last_peered":"2024-04-24T13:34:35.668132+0000","last_clean":"2024-04-24T13:34:35.668132+0000","last_became_active":"2024-04-24T13:33:49.294098+0000","last_became_peered":"2024-04-24T13:33:49.294098+0000","last_unstale":"2024-04-24T13:34:35.668132+0000","last_undegraded":"2024-04-24T13:34:35.668132+0000","last_fullsized":"2024-04-24T13:34:35.668132+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:15.599045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666700+0000","last_change":"2024-04-24T13:33:08.727069+0000","last_active":"2024-04-24T13:34:35.666700+0000","last_peered":"2024-04-24T13:34:35.666700+0000","last_clean":"2024-04-24T13:34:35.666700+0000","last_became_active":"2024-04-24T13:33:08.726216+0000","last_became_peered":"2024-04-24T13:33:08.726216+0000","last_unstale":"2024-04-24T13:34:35.666700+0000","last_undegraded":"2024-04-24T13:34:35.666700+0000","last_fullsized":"2024-04-24T13:34:35.666700+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:59.675122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"105'6","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667409+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:34:35.667409+0000","last_peered":"2024-04-24T13:34:35.667409+0000","last_clean":"2024-04-24T13:34:35.667409+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:34:35.667409+0000","last_undegraded":"2024-04-24T13:34:35.667409+0000","last_fullsized":"2024-04-24T13:34:35.667409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668713+0000","last_change":"2024-04-24T13:33:49.282926+0000","last_active":"2024-04-24T13:34:35.668713+0000","last_peered":"2024-04-24T13:34:35.668713+0000","last_clean":"2024-04-24T13:34:35.668713+0000","last_became_active":"2024-04-24T13:33:49.282517+0000","last_became_peered":"2024-04-24T13:33:49.282517+0000","last_unstale":"2024-04-24T13:34:35.668713+0000","last_undegraded":"2024-04-24T13:34:35.668713+0000","last_fullsized":"2024-04-24T13:34:35.668713+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:18.852308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"132'24","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665423+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:34:35.665423+0000","last_peered":"2024-04-24T13:34:35.665423+0000","last_clean":"2024-04-24T13:34:35.665423+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:34:35.665423+0000","last_undegraded":"2024-04-24T13:34:35.665423+0000","last_fullsized":"2024-04-24T13:34:35.665423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.596110+0000","last_change":"2024-04-24T13:33:08.734054+0000","last_active":"2024-04-24T13:34:34.596110+0000","last_peered":"2024-04-24T13:34:34.596110+0000","last_clean":"2024-04-24T13:34:34.596110+0000","last_became_active":"2024-04-24T13:33:08.728126+0000","last_became_peered":"2024-04-24T13:33:08.728126+0000","last_unstale":"2024-04-24T13:34:34.596110+0000","last_undegraded":"2024-04-24T13:34:34.596110+0000","last_fullsized":"2024-04-24T13:34:34.596110+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:48.542362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"150'137","reported_seq":504,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:37.608916+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:34:37.608916+0000","last_peered":"2024-04-24T13:34:37.608916+0000","last_clean":"2024-04-24T13:34:37.608916+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:34:37.608916+0000","last_undegraded":"2024-04-24T13:34:37.608916+0000","last_fullsized":"2024-04-24T13:34:37.608916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120994,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669391+0000","last_change":"2024-04-24T13:33:49.298292+0000","last_active":"2024-04-24T13:34:35.669391+0000","last_peered":"2024-04-24T13:34:35.669391+0000","last_clean":"2024-04-24T13:34:35.669391+0000","last_became_active":"2024-04-24T13:33:49.297450+0000","last_became_peered":"2024-04-24T13:33:49.297450+0000","last_unstale":"2024-04-24T13:34:35.669391+0000","last_undegraded":"2024-04-24T13:34:35.669391+0000","last_fullsized":"2024-04-24T13:34:35.669391+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:11.836268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.527757+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:34:35.527757+0000","last_peered":"2024-04-24T13:34:35.527757+0000","last_clean":"2024-04-24T13:34:35.527757+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:34:35.527757+0000","last_undegraded":"2024-04-24T13:34:35.527757+0000","last_fullsized":"2024-04-24T13:34:35.527757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"132'2","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529868+0000","last_change":"2024-04-24T13:33:08.745743+0000","last_active":"2024-04-24T13:34:35.529868+0000","last_peered":"2024-04-24T13:34:35.529868+0000","last_clean":"2024-04-24T13:34:35.529868+0000","last_became_active":"2024-04-24T13:33:08.745363+0000","last_became_peered":"2024-04-24T13:33:08.745363+0000","last_unstale":"2024-04-24T13:34:35.529868+0000","last_undegraded":"2024-04-24T13:34:35.529868+0000","last_fullsized":"2024-04-24T13:34:35.529868+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:23:38.852782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666100+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:34:35.666100+0000","last_peered":"2024-04-24T13:34:35.666100+0000","last_clean":"2024-04-24T13:34:35.666100+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:34:35.666100+0000","last_undegraded":"2024-04-24T13:34:35.666100+0000","last_fullsized":"2024-04-24T13:34:35.666100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"132'23","reported_seq":290,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.530696+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:34:35.530696+0000","last_peered":"2024-04-24T13:34:35.530696+0000","last_clean":"2024-04-24T13:34:35.530696+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:34:35.530696+0000","last_undegraded":"2024-04-24T13:34:35.530696+0000","last_fullsized":"2024-04-24T13:34:35.530696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":274,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665881+0000","last_change":"2024-04-24T13:33:09.537358+0000","last_active":"2024-04-24T13:34:35.665881+0000","last_peered":"2024-04-24T13:34:35.665881+0000","last_clean":"2024-04-24T13:34:35.665881+0000","last_became_active":"2024-04-24T13:33:08.726022+0000","last_became_peered":"2024-04-24T13:33:08.726022+0000","last_unstale":"2024-04-24T13:34:35.665881+0000","last_undegraded":"2024-04-24T13:34:35.665881+0000","last_fullsized":"2024-04-24T13:34:35.665881+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:53:29.132620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"150'19","reported_seq":87,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670337+0000","last_change":"2024-04-24T13:33:52.755369+0000","last_active":"2024-04-24T13:34:35.670337+0000","last_peered":"2024-04-24T13:34:35.670337+0000","last_clean":"2024-04-24T13:34:35.670337+0000","last_became_active":"2024-04-24T13:33:49.297296+0000","last_became_peered":"2024-04-24T13:33:49.297296+0000","last_unstale":"2024-04-24T13:34:35.670337+0000","last_undegraded":"2024-04-24T13:34:35.670337+0000","last_fullsized":"2024-04-24T13:34:35.670337+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:57.772686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":249,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666168+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:34:35.666168+0000","last_peered":"2024-04-24T13:34:35.666168+0000","last_clean":"2024-04-24T13:34:35.666168+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:34:35.666168+0000","last_undegraded":"2024-04-24T13:34:35.666168+0000","last_fullsized":"2024-04-24T13:34:35.666168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554829+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:34:35.554829+0000","last_peered":"2024-04-24T13:34:35.554829+0000","last_clean":"2024-04-24T13:34:35.554829+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:34:35.554829+0000","last_undegraded":"2024-04-24T13:34:35.554829+0000","last_fullsized":"2024-04-24T13:34:35.554829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"132'4","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525116+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:34:35.525116+0000","last_peered":"2024-04-24T13:34:35.525116+0000","last_clean":"2024-04-24T13:34:35.525116+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:34:35.525116+0000","last_undegraded":"2024-04-24T13:34:35.525116+0000","last_fullsized":"2024-04-24T13:34:35.525116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592641+0000","last_change":"2024-04-24T13:33:08.727739+0000","last_active":"2024-04-24T13:34:34.592641+0000","last_peered":"2024-04-24T13:34:34.592641+0000","last_clean":"2024-04-24T13:34:34.592641+0000","last_became_active":"2024-04-24T13:33:08.727324+0000","last_became_peered":"2024-04-24T13:33:08.727324+0000","last_unstale":"2024-04-24T13:34:34.592641+0000","last_undegraded":"2024-04-24T13:34:34.592641+0000","last_fullsized":"2024-04-24T13:34:34.592641+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:23.918692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"132'22","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590105+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:34:34.590105+0000","last_peered":"2024-04-24T13:34:34.590105+0000","last_clean":"2024-04-24T13:34:34.590105+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:34:34.590105+0000","last_undegraded":"2024-04-24T13:34:34.590105+0000","last_fullsized":"2024-04-24T13:34:34.590105+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.760398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666115+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:34:35.666115+0000","last_peered":"2024-04-24T13:34:35.666115+0000","last_clean":"2024-04-24T13:34:35.666115+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:34:35.666115+0000","last_undegraded":"2024-04-24T13:34:35.666115+0000","last_fullsized":"2024-04-24T13:34:35.666115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":272,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.553929+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:34:35.553929+0000","last_peered":"2024-04-24T13:34:35.553929+0000","last_clean":"2024-04-24T13:34:35.553929+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:34:35.553929+0000","last_undegraded":"2024-04-24T13:34:35.553929+0000","last_fullsized":"2024-04-24T13:34:35.553929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671288+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:34:35.671288+0000","last_peered":"2024-04-24T13:34:35.671288+0000","last_clean":"2024-04-24T13:34:35.671288+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:34:35.671288+0000","last_undegraded":"2024-04-24T13:34:35.671288+0000","last_fullsized":"2024-04-24T13:34:35.671288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"81'4","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594411+0000","last_change":"2024-04-24T13:33:09.289060+0000","last_active":"2024-04-24T13:34:34.594411+0000","last_peered":"2024-04-24T13:34:34.594411+0000","last_clean":"2024-04-24T13:34:34.594411+0000","last_became_active":"2024-04-24T13:33:08.717929+0000","last_became_peered":"2024-04-24T13:33:08.717929+0000","last_unstale":"2024-04-24T13:34:34.594411+0000","last_undegraded":"2024-04-24T13:34:34.594411+0000","last_fullsized":"2024-04-24T13:34:34.594411+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:36.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528047+0000","last_change":"2024-04-24T13:33:08.738475+0000","last_active":"2024-04-24T13:34:35.528047+0000","last_peered":"2024-04-24T13:34:35.528047+0000","last_clean":"2024-04-24T13:34:35.528047+0000","last_became_active":"2024-04-24T13:33:08.738109+0000","last_became_peered":"2024-04-24T13:33:08.738109+0000","last_unstale":"2024-04-24T13:34:35.528047+0000","last_undegraded":"2024-04-24T13:34:35.528047+0000","last_fullsized":"2024-04-24T13:34:35.528047+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:14:49.386651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"132'27","reported_seq":137,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594648+0000","last_change":"2024-04-24T13:33:10.091580+0000","last_active":"2024-04-24T13:34:34.594648+0000","last_peered":"2024-04-24T13:34:34.594648+0000","last_clean":"2024-04-24T13:34:34.594648+0000","last_became_active":"2024-04-24T13:33:08.716808+0000","last_became_peered":"2024-04-24T13:33:08.716808+0000","last_unstale":"2024-04-24T13:34:34.594648+0000","last_undegraded":"2024-04-24T13:34:34.594648+0000","last_fullsized":"2024-04-24T13:34:34.594648+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:05:06.347329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525373+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:34:35.525373+0000","last_peered":"2024-04-24T13:34:35.525373+0000","last_clean":"2024-04-24T13:34:35.525373+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:34:35.525373+0000","last_undegraded":"2024-04-24T13:34:35.525373+0000","last_fullsized":"2024-04-24T13:34:35.525373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666247+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:34:35.666247+0000","last_peered":"2024-04-24T13:34:35.666247+0000","last_clean":"2024-04-24T13:34:35.666247+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:34:35.666247+0000","last_undegraded":"2024-04-24T13:34:35.666247+0000","last_fullsized":"2024-04-24T13:34:35.666247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"132'34","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664648+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:34:35.664648+0000","last_peered":"2024-04-24T13:34:35.664648+0000","last_clean":"2024-04-24T13:34:35.664648+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:34:35.664648+0000","last_undegraded":"2024-04-24T13:34:35.664648+0000","last_fullsized":"2024-04-24T13:34:35.664648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":249,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589043+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:34:34.589043+0000","last_peered":"2024-04-24T13:34:34.589043+0000","last_clean":"2024-04-24T13:34:34.589043+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:34:34.589043+0000","last_undegraded":"2024-04-24T13:34:34.589043+0000","last_fullsized":"2024-04-24T13:34:34.589043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667952+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:34:35.667952+0000","last_peered":"2024-04-24T13:34:35.667952+0000","last_clean":"2024-04-24T13:34:35.667952+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:34:35.667952+0000","last_undegraded":"2024-04-24T13:34:35.667952+0000","last_fullsized":"2024-04-24T13:34:35.667952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"114'18","reported_seq":351,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666556+0000","last_change":"2024-04-24T13:33:09.335136+0000","last_active":"2024-04-24T13:34:35.666556+0000","last_peered":"2024-04-24T13:34:35.666556+0000","last_clean":"2024-04-24T13:34:35.666556+0000","last_became_active":"2024-04-24T13:33:08.705853+0000","last_became_peered":"2024-04-24T13:33:08.705853+0000","last_unstale":"2024-04-24T13:34:35.666556+0000","last_undegraded":"2024-04-24T13:34:35.666556+0000","last_fullsized":"2024-04-24T13:34:35.666556+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:53.758485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":86,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"132'14","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525205+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:34:35.525205+0000","last_peered":"2024-04-24T13:34:35.525205+0000","last_clean":"2024-04-24T13:34:35.525205+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:34:35.525205+0000","last_undegraded":"2024-04-24T13:34:35.525205+0000","last_fullsized":"2024-04-24T13:34:35.525205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669917+0000","last_change":"2024-04-24T13:33:49.288345+0000","last_active":"2024-04-24T13:34:35.669917+0000","last_peered":"2024-04-24T13:34:35.669917+0000","last_clean":"2024-04-24T13:34:35.669917+0000","last_became_active":"2024-04-24T13:33:49.287893+0000","last_became_peered":"2024-04-24T13:33:49.287893+0000","last_unstale":"2024-04-24T13:34:35.669917+0000","last_undegraded":"2024-04-24T13:34:35.669917+0000","last_fullsized":"2024-04-24T13:34:35.669917+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:59.559096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667933+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:34:35.667933+0000","last_peered":"2024-04-24T13:34:35.667933+0000","last_clean":"2024-04-24T13:34:35.667933+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:34:35.667933+0000","last_undegraded":"2024-04-24T13:34:35.667933+0000","last_fullsized":"2024-04-24T13:34:35.667933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"105'15","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528699+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:34:35.528699+0000","last_peered":"2024-04-24T13:34:35.528699+0000","last_clean":"2024-04-24T13:34:35.528699+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:34:35.528699+0000","last_undegraded":"2024-04-24T13:34:35.528699+0000","last_fullsized":"2024-04-24T13:34:35.528699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"150'138","reported_seq":351,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529396+0000","last_change":"2024-04-24T13:33:11.712104+0000","last_active":"2024-04-24T13:34:35.529396+0000","last_peered":"2024-04-24T13:34:35.529396+0000","last_clean":"2024-04-24T13:34:35.529396+0000","last_became_active":"2024-04-24T13:33:11.710310+0000","last_became_peered":"2024-04-24T13:33:11.710310+0000","last_unstale":"2024-04-24T13:34:35.529396+0000","last_undegraded":"2024-04-24T13:34:35.529396+0000","last_fullsized":"2024-04-24T13:34:35.529396+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:44.878043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"114'3","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556703+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:34:35.556703+0000","last_peered":"2024-04-24T13:34:35.556703+0000","last_clean":"2024-04-24T13:34:35.556703+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:34:35.556703+0000","last_undegraded":"2024-04-24T13:34:35.556703+0000","last_fullsized":"2024-04-24T13:34:35.556703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"82'2","reported_seq":228,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664673+0000","last_change":"2024-04-24T13:33:49.682866+0000","last_active":"2024-04-24T13:34:35.664673+0000","last_peered":"2024-04-24T13:34:35.664673+0000","last_clean":"2024-04-24T13:34:35.664673+0000","last_became_active":"2024-04-24T13:33:49.296844+0000","last_became_peered":"2024-04-24T13:33:49.296844+0000","last_unstale":"2024-04-24T13:34:35.664673+0000","last_undegraded":"2024-04-24T13:34:35.664673+0000","last_fullsized":"2024-04-24T13:34:35.664673+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:34.675704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"132'24","reported_seq":335,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555654+0000","last_change":"2024-04-24T13:33:51.134298+0000","last_active":"2024-04-24T13:34:35.555654+0000","last_peered":"2024-04-24T13:34:35.555654+0000","last_clean":"2024-04-24T13:34:35.555654+0000","last_became_active":"2024-04-24T13:33:49.300149+0000","last_became_peered":"2024-04-24T13:33:49.300149+0000","last_unstale":"2024-04-24T13:34:35.555654+0000","last_undegraded":"2024-04-24T13:34:35.555654+0000","last_fullsized":"2024-04-24T13:34:35.555654+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:46:34.323602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.531398+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:34:35.531398+0000","last_peered":"2024-04-24T13:34:35.531398+0000","last_clean":"2024-04-24T13:34:35.531398+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:34:35.531398+0000","last_undegraded":"2024-04-24T13:34:35.531398+0000","last_fullsized":"2024-04-24T13:34:35.531398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588762+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:34:34.588762+0000","last_peered":"2024-04-24T13:34:34.588762+0000","last_clean":"2024-04-24T13:34:34.588762+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:34:34.588762+0000","last_undegraded":"2024-04-24T13:34:34.588762+0000","last_fullsized":"2024-04-24T13:34:34.588762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589504+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:34:34.589504+0000","last_peered":"2024-04-24T13:34:34.589504+0000","last_clean":"2024-04-24T13:34:34.589504+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:34:34.589504+0000","last_undegraded":"2024-04-24T13:34:34.589504+0000","last_fullsized":"2024-04-24T13:34:34.589504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"150'135","reported_seq":436,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:40.139335+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:34:40.139335+0000","last_peered":"2024-04-24T13:34:40.139335+0000","last_clean":"2024-04-24T13:34:40.139335+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:34:40.139335+0000","last_undegraded":"2024-04-24T13:34:40.139335+0000","last_fullsized":"2024-04-24T13:34:40.139335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"82'6","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666218+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:34:35.666218+0000","last_peered":"2024-04-24T13:34:35.666218+0000","last_clean":"2024-04-24T13:34:35.666218+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:34:35.666218+0000","last_undegraded":"2024-04-24T13:34:35.666218+0000","last_fullsized":"2024-04-24T13:34:35.666218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"114'6","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588275+0000","last_change":"2024-04-24T13:33:08.753804+0000","last_active":"2024-04-24T13:34:34.588275+0000","last_peered":"2024-04-24T13:34:34.588275+0000","last_clean":"2024-04-24T13:34:34.588275+0000","last_became_active":"2024-04-24T13:33:08.707993+0000","last_became_peered":"2024-04-24T13:33:08.707993+0000","last_unstale":"2024-04-24T13:34:34.588275+0000","last_undegraded":"2024-04-24T13:34:34.588275+0000","last_fullsized":"2024-04-24T13:34:34.588275+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:02.680781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"131'22","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667097+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:34:35.667097+0000","last_peered":"2024-04-24T13:34:35.667097+0000","last_clean":"2024-04-24T13:34:35.667097+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:34:35.667097+0000","last_undegraded":"2024-04-24T13:34:35.667097+0000","last_fullsized":"2024-04-24T13:34:35.667097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671777+0000","last_change":"2024-04-24T13:33:49.289245+0000","last_active":"2024-04-24T13:34:35.671777+0000","last_peered":"2024-04-24T13:34:35.671777+0000","last_clean":"2024-04-24T13:34:35.671777+0000","last_became_active":"2024-04-24T13:33:49.288766+0000","last_became_peered":"2024-04-24T13:33:49.288766+0000","last_unstale":"2024-04-24T13:34:35.671777+0000","last_undegraded":"2024-04-24T13:34:35.671777+0000","last_fullsized":"2024-04-24T13:34:35.671777+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:02:54.620974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554544+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:34:35.554544+0000","last_peered":"2024-04-24T13:34:35.554544+0000","last_clean":"2024-04-24T13:34:35.554544+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:34:35.554544+0000","last_undegraded":"2024-04-24T13:34:35.554544+0000","last_fullsized":"2024-04-24T13:34:35.554544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"132'43","reported_seq":78,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669147+0000","last_change":"2024-04-24T13:33:52.712739+0000","last_active":"2024-04-24T13:34:35.669147+0000","last_peered":"2024-04-24T13:34:35.669147+0000","last_clean":"2024-04-24T13:34:35.669147+0000","last_became_active":"2024-04-24T13:33:49.295935+0000","last_became_peered":"2024-04-24T13:33:49.295935+0000","last_unstale":"2024-04-24T13:34:35.669147+0000","last_undegraded":"2024-04-24T13:34:35.669147+0000","last_fullsized":"2024-04-24T13:34:35.669147+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:52.132391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554197+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:34:35.554197+0000","last_peered":"2024-04-24T13:34:35.554197+0000","last_clean":"2024-04-24T13:34:35.554197+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:34:35.554197+0000","last_undegraded":"2024-04-24T13:34:35.554197+0000","last_fullsized":"2024-04-24T13:34:35.554197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"105'6","reported_seq":120,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594807+0000","last_change":"2024-04-24T13:33:51.141865+0000","last_active":"2024-04-24T13:34:34.594807+0000","last_peered":"2024-04-24T13:34:34.594807+0000","last_clean":"2024-04-24T13:34:34.594807+0000","last_became_active":"2024-04-24T13:33:49.289035+0000","last_became_peered":"2024-04-24T13:33:49.289035+0000","last_unstale":"2024-04-24T13:34:34.594807+0000","last_undegraded":"2024-04-24T13:34:34.594807+0000","last_fullsized":"2024-04-24T13:34:34.594807+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:08:46.400784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"82'2","reported_seq":263,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667857+0000","last_change":"2024-04-24T13:33:09.076639+0000","last_active":"2024-04-24T13:34:35.667857+0000","last_peered":"2024-04-24T13:34:35.667857+0000","last_clean":"2024-04-24T13:34:35.667857+0000","last_became_active":"2024-04-24T13:33:08.705821+0000","last_became_peered":"2024-04-24T13:33:08.705821+0000","last_unstale":"2024-04-24T13:34:35.667857+0000","last_undegraded":"2024-04-24T13:34:35.667857+0000","last_fullsized":"2024-04-24T13:34:35.667857+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:07:09.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589501+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:34:34.589501+0000","last_peered":"2024-04-24T13:34:34.589501+0000","last_clean":"2024-04-24T13:34:34.589501+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:34:34.589501+0000","last_undegraded":"2024-04-24T13:34:34.589501+0000","last_fullsized":"2024-04-24T13:34:34.589501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"132'33","reported_seq":298,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665221+0000","last_change":"2024-04-24T13:33:50.684508+0000","last_active":"2024-04-24T13:34:35.665221+0000","last_peered":"2024-04-24T13:34:35.665221+0000","last_clean":"2024-04-24T13:34:35.665221+0000","last_became_active":"2024-04-24T13:33:49.297002+0000","last_became_peered":"2024-04-24T13:33:49.297002+0000","last_unstale":"2024-04-24T13:34:35.665221+0000","last_undegraded":"2024-04-24T13:34:35.665221+0000","last_fullsized":"2024-04-24T13:34:35.665221+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:05.604339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":366,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528124+0000","last_change":"2024-04-24T13:33:09.553473+0000","last_active":"2024-04-24T13:34:35.528124+0000","last_peered":"2024-04-24T13:34:35.528124+0000","last_clean":"2024-04-24T13:34:35.528124+0000","last_became_active":"2024-04-24T13:33:08.738276+0000","last_became_peered":"2024-04-24T13:33:08.738276+0000","last_unstale":"2024-04-24T13:34:35.528124+0000","last_undegraded":"2024-04-24T13:34:35.528124+0000","last_fullsized":"2024-04-24T13:34:35.528124+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:44.215595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"132'20","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554042+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:34:35.554042+0000","last_peered":"2024-04-24T13:34:35.554042+0000","last_clean":"2024-04-24T13:34:35.554042+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:34:35.554042+0000","last_undegraded":"2024-04-24T13:34:35.554042+0000","last_fullsized":"2024-04-24T13:34:35.554042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554671+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:34:35.554671+0000","last_peered":"2024-04-24T13:34:35.554671+0000","last_clean":"2024-04-24T13:34:35.554671+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:34:35.554671+0000","last_undegraded":"2024-04-24T13:34:35.554671+0000","last_fullsized":"2024-04-24T13:34:35.554671+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555930+0000","last_change":"2024-04-24T13:33:49.302711+0000","last_active":"2024-04-24T13:34:35.555930+0000","last_peered":"2024-04-24T13:34:35.555930+0000","last_clean":"2024-04-24T13:34:35.555930+0000","last_became_active":"2024-04-24T13:33:49.302201+0000","last_became_peered":"2024-04-24T13:33:49.302201+0000","last_unstale":"2024-04-24T13:34:35.555930+0000","last_undegraded":"2024-04-24T13:34:35.555930+0000","last_fullsized":"2024-04-24T13:34:35.555930+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:21.125833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.527964+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:34:35.527964+0000","last_peered":"2024-04-24T13:34:35.527964+0000","last_clean":"2024-04-24T13:34:35.527964+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:34:35.527964+0000","last_undegraded":"2024-04-24T13:34:35.527964+0000","last_fullsized":"2024-04-24T13:34:35.527964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"132'20","reported_seq":88,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669042+0000","last_change":"2024-04-24T13:33:53.881731+0000","last_active":"2024-04-24T13:34:35.669042+0000","last_peered":"2024-04-24T13:34:35.669042+0000","last_clean":"2024-04-24T13:34:35.669042+0000","last_became_active":"2024-04-24T13:33:49.299864+0000","last_became_peered":"2024-04-24T13:33:49.299864+0000","last_unstale":"2024-04-24T13:34:35.669042+0000","last_undegraded":"2024-04-24T13:34:35.669042+0000","last_fullsized":"2024-04-24T13:34:35.669042+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:31.093323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554746+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:34:35.554746+0000","last_peered":"2024-04-24T13:34:35.554746+0000","last_clean":"2024-04-24T13:34:35.554746+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:34:35.554746+0000","last_undegraded":"2024-04-24T13:34:35.554746+0000","last_fullsized":"2024-04-24T13:34:35.554746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"132'9","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664756+0000","last_change":"2024-04-24T13:33:09.548972+0000","last_active":"2024-04-24T13:34:35.664756+0000","last_peered":"2024-04-24T13:34:35.664756+0000","last_clean":"2024-04-24T13:34:35.664756+0000","last_became_active":"2024-04-24T13:33:08.721855+0000","last_became_peered":"2024-04-24T13:33:08.721855+0000","last_unstale":"2024-04-24T13:34:35.664756+0000","last_undegraded":"2024-04-24T13:34:35.664756+0000","last_fullsized":"2024-04-24T13:34:35.664756+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:12.936976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669578+0000","last_change":"2024-04-24T13:33:49.302936+0000","last_active":"2024-04-24T13:34:35.669578+0000","last_peered":"2024-04-24T13:34:35.669578+0000","last_clean":"2024-04-24T13:34:35.669578+0000","last_became_active":"2024-04-24T13:33:49.297478+0000","last_became_peered":"2024-04-24T13:33:49.297478+0000","last_unstale":"2024-04-24T13:34:35.669578+0000","last_undegraded":"2024-04-24T13:34:35.669578+0000","last_fullsized":"2024-04-24T13:34:35.669578+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:39.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"132'6","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665975+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:34:35.665975+0000","last_peered":"2024-04-24T13:34:35.665975+0000","last_clean":"2024-04-24T13:34:35.665975+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:34:35.665975+0000","last_undegraded":"2024-04-24T13:34:35.665975+0000","last_fullsized":"2024-04-24T13:34:35.665975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"82'4","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554406+0000","last_change":"2024-04-24T13:33:49.688460+0000","last_active":"2024-04-24T13:34:35.554406+0000","last_peered":"2024-04-24T13:34:35.554406+0000","last_clean":"2024-04-24T13:34:35.554406+0000","last_became_active":"2024-04-24T13:33:49.292866+0000","last_became_peered":"2024-04-24T13:33:49.292866+0000","last_unstale":"2024-04-24T13:34:35.554406+0000","last_undegraded":"2024-04-24T13:34:35.554406+0000","last_fullsized":"2024-04-24T13:34:35.554406+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:38.839177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"131'22","reported_seq":172,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595276+0000","last_change":"2024-04-24T13:33:52.207013+0000","last_active":"2024-04-24T13:34:34.595276+0000","last_peered":"2024-04-24T13:34:34.595276+0000","last_clean":"2024-04-24T13:34:34.595276+0000","last_became_active":"2024-04-24T13:33:49.289650+0000","last_became_peered":"2024-04-24T13:33:49.289650+0000","last_unstale":"2024-04-24T13:34:34.595276+0000","last_undegraded":"2024-04-24T13:34:34.595276+0000","last_fullsized":"2024-04-24T13:34:34.595276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:15:45.985778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667585+0000","last_change":"2024-04-24T13:33:49.283767+0000","last_active":"2024-04-24T13:34:35.667585+0000","last_peered":"2024-04-24T13:34:35.667585+0000","last_clean":"2024-04-24T13:34:35.667585+0000","last_became_active":"2024-04-24T13:33:49.283342+0000","last_became_peered":"2024-04-24T13:33:49.283342+0000","last_unstale":"2024-04-24T13:34:35.667585+0000","last_undegraded":"2024-04-24T13:34:35.667585+0000","last_fullsized":"2024-04-24T13:34:35.667585+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:36.682746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"132'20","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554550+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:34:35.554550+0000","last_peered":"2024-04-24T13:34:35.554550+0000","last_clean":"2024-04-24T13:34:35.554550+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:34:35.554550+0000","last_undegraded":"2024-04-24T13:34:35.554550+0000","last_fullsized":"2024-04-24T13:34:35.554550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668177+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:34:35.668177+0000","last_peered":"2024-04-24T13:34:35.668177+0000","last_clean":"2024-04-24T13:34:35.668177+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:34:35.668177+0000","last_undegraded":"2024-04-24T13:34:35.668177+0000","last_fullsized":"2024-04-24T13:34:35.668177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"114'4","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594405+0000","last_change":"2024-04-24T13:33:50.241765+0000","last_active":"2024-04-24T13:34:34.594405+0000","last_peered":"2024-04-24T13:34:34.594405+0000","last_clean":"2024-04-24T13:34:34.594405+0000","last_became_active":"2024-04-24T13:33:49.288852+0000","last_became_peered":"2024-04-24T13:33:49.288852+0000","last_unstale":"2024-04-24T13:34:34.594405+0000","last_undegraded":"2024-04-24T13:34:34.594405+0000","last_fullsized":"2024-04-24T13:34:34.594405+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:53:23.401847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554397+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:34:35.554397+0000","last_peered":"2024-04-24T13:34:35.554397+0000","last_clean":"2024-04-24T13:34:35.554397+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:34:35.554397+0000","last_undegraded":"2024-04-24T13:34:35.554397+0000","last_fullsized":"2024-04-24T13:34:35.554397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"132'20","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668126+0000","last_change":"2024-04-24T13:33:09.773703+0000","last_active":"2024-04-24T13:34:35.668126+0000","last_peered":"2024-04-24T13:34:35.668126+0000","last_clean":"2024-04-24T13:34:35.668126+0000","last_became_active":"2024-04-24T13:33:08.722546+0000","last_became_peered":"2024-04-24T13:33:08.722546+0000","last_unstale":"2024-04-24T13:34:35.668126+0000","last_undegraded":"2024-04-24T13:34:35.668126+0000","last_fullsized":"2024-04-24T13:34:35.668126+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:26.369698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667888+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:34:35.667888+0000","last_peered":"2024-04-24T13:34:35.667888+0000","last_clean":"2024-04-24T13:34:35.667888+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:34:35.667888+0000","last_undegraded":"2024-04-24T13:34:35.667888+0000","last_fullsized":"2024-04-24T13:34:35.667888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"132'18","reported_seq":68,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668570+0000","last_change":"2024-04-24T13:33:52.735528+0000","last_active":"2024-04-24T13:34:35.668570+0000","last_peered":"2024-04-24T13:34:35.668570+0000","last_clean":"2024-04-24T13:34:35.668570+0000","last_became_active":"2024-04-24T13:33:49.297667+0000","last_became_peered":"2024-04-24T13:33:49.297667+0000","last_unstale":"2024-04-24T13:34:35.668570+0000","last_undegraded":"2024-04-24T13:34:35.668570+0000","last_fullsized":"2024-04-24T13:34:35.668570+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:07:05.200322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665270+0000","last_change":"2024-04-24T13:33:49.286645+0000","last_active":"2024-04-24T13:34:35.665270+0000","last_peered":"2024-04-24T13:34:35.665270+0000","last_clean":"2024-04-24T13:34:35.665270+0000","last_became_active":"2024-04-24T13:33:49.285495+0000","last_became_peered":"2024-04-24T13:33:49.285495+0000","last_unstale":"2024-04-24T13:34:35.665270+0000","last_undegraded":"2024-04-24T13:34:35.665270+0000","last_fullsized":"2024-04-24T13:34:35.665270+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:19.867685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"82'8","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671651+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:34:35.671651+0000","last_peered":"2024-04-24T13:34:35.671651+0000","last_clean":"2024-04-24T13:34:35.671651+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:34:35.671651+0000","last_undegraded":"2024-04-24T13:34:35.671651+0000","last_fullsized":"2024-04-24T13:34:35.671651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"131'27","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554147+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:34:35.554147+0000","last_peered":"2024-04-24T13:34:35.554147+0000","last_clean":"2024-04-24T13:34:35.554147+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:34:35.554147+0000","last_undegraded":"2024-04-24T13:34:35.554147+0000","last_fullsized":"2024-04-24T13:34:35.554147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667626+0000","last_change":"2024-04-24T13:33:49.296871+0000","last_active":"2024-04-24T13:34:35.667626+0000","last_peered":"2024-04-24T13:34:35.667626+0000","last_clean":"2024-04-24T13:34:35.667626+0000","last_became_active":"2024-04-24T13:33:49.295933+0000","last_became_peered":"2024-04-24T13:33:49.295933+0000","last_unstale":"2024-04-24T13:34:35.667626+0000","last_undegraded":"2024-04-24T13:34:35.667626+0000","last_fullsized":"2024-04-24T13:34:35.667626+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:48:25.451061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"132'29","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525465+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:34:35.525465+0000","last_peered":"2024-04-24T13:34:35.525465+0000","last_clean":"2024-04-24T13:34:35.525465+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:34:35.525465+0000","last_undegraded":"2024-04-24T13:34:35.525465+0000","last_fullsized":"2024-04-24T13:34:35.525465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62357,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594350+0000","last_change":"2024-04-24T13:33:08.717844+0000","last_active":"2024-04-24T13:34:34.594350+0000","last_peered":"2024-04-24T13:34:34.594350+0000","last_clean":"2024-04-24T13:34:34.594350+0000","last_became_active":"2024-04-24T13:33:08.716627+0000","last_became_peered":"2024-04-24T13:33:08.716627+0000","last_unstale":"2024-04-24T13:34:34.594350+0000","last_undegraded":"2024-04-24T13:34:34.594350+0000","last_fullsized":"2024-04-24T13:34:34.594350+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:43.447785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554266+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:34:35.554266+0000","last_peered":"2024-04-24T13:34:35.554266+0000","last_clean":"2024-04-24T13:34:35.554266+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:34:35.554266+0000","last_undegraded":"2024-04-24T13:34:35.554266+0000","last_fullsized":"2024-04-24T13:34:35.554266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"114'10","reported_seq":324,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667496+0000","last_change":"2024-04-24T13:33:50.254858+0000","last_active":"2024-04-24T13:34:35.667496+0000","last_peered":"2024-04-24T13:34:35.667496+0000","last_clean":"2024-04-24T13:34:35.667496+0000","last_became_active":"2024-04-24T13:33:49.285680+0000","last_became_peered":"2024-04-24T13:33:49.285680+0000","last_unstale":"2024-04-24T13:34:35.667496+0000","last_undegraded":"2024-04-24T13:34:35.667496+0000","last_fullsized":"2024-04-24T13:34:35.667496+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:13.081256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"132'20","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529452+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:34:35.529452+0000","last_peered":"2024-04-24T13:34:35.529452+0000","last_clean":"2024-04-24T13:34:35.529452+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:34:35.529452+0000","last_undegraded":"2024-04-24T13:34:35.529452+0000","last_fullsized":"2024-04-24T13:34:35.529452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671404+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:34:35.671404+0000","last_peered":"2024-04-24T13:34:35.671404+0000","last_clean":"2024-04-24T13:34:35.671404+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:34:35.671404+0000","last_undegraded":"2024-04-24T13:34:35.671404+0000","last_fullsized":"2024-04-24T13:34:35.671404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"132'23","reported_seq":74,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669198+0000","last_change":"2024-04-24T13:33:51.826433+0000","last_active":"2024-04-24T13:34:35.669198+0000","last_peered":"2024-04-24T13:34:35.669198+0000","last_clean":"2024-04-24T13:34:35.669198+0000","last_became_active":"2024-04-24T13:33:49.291994+0000","last_became_peered":"2024-04-24T13:33:49.291994+0000","last_unstale":"2024-04-24T13:34:35.669198+0000","last_undegraded":"2024-04-24T13:34:35.669198+0000","last_fullsized":"2024-04-24T13:34:35.669198+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:35.992700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525691+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:34:35.525691+0000","last_peered":"2024-04-24T13:34:35.525691+0000","last_clean":"2024-04-24T13:34:35.525691+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:34:35.525691+0000","last_undegraded":"2024-04-24T13:34:35.525691+0000","last_fullsized":"2024-04-24T13:34:35.525691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669486+0000","last_change":"2024-04-24T13:33:49.289138+0000","last_active":"2024-04-24T13:34:35.669486+0000","last_peered":"2024-04-24T13:34:35.669486+0000","last_clean":"2024-04-24T13:34:35.669486+0000","last_became_active":"2024-04-24T13:33:49.288760+0000","last_became_peered":"2024-04-24T13:33:49.288760+0000","last_unstale":"2024-04-24T13:34:35.669486+0000","last_undegraded":"2024-04-24T13:34:35.669486+0000","last_fullsized":"2024-04-24T13:34:35.669486+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:12:25.409700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554342+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:34:35.554342+0000","last_peered":"2024-04-24T13:34:35.554342+0000","last_clean":"2024-04-24T13:34:35.554342+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:34:35.554342+0000","last_undegraded":"2024-04-24T13:34:35.554342+0000","last_fullsized":"2024-04-24T13:34:35.554342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"132'17","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589695+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:34:34.589695+0000","last_peered":"2024-04-24T13:34:34.589695+0000","last_clean":"2024-04-24T13:34:34.589695+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:34:34.589695+0000","last_undegraded":"2024-04-24T13:34:34.589695+0000","last_fullsized":"2024-04-24T13:34:34.589695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590976+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:34:34.590976+0000","last_peered":"2024-04-24T13:34:34.590976+0000","last_clean":"2024-04-24T13:34:34.590976+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:34:34.590976+0000","last_undegraded":"2024-04-24T13:34:34.590976+0000","last_fullsized":"2024-04-24T13:34:34.590976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"132'20","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556866+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:34:35.556866+0000","last_peered":"2024-04-24T13:34:35.556866+0000","last_clean":"2024-04-24T13:34:35.556866+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:34:35.556866+0000","last_undegraded":"2024-04-24T13:34:35.556866+0000","last_fullsized":"2024-04-24T13:34:35.556866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.526370+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:34:35.526370+0000","last_peered":"2024-04-24T13:34:35.526370+0000","last_clean":"2024-04-24T13:34:35.526370+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:34:35.526370+0000","last_undegraded":"2024-04-24T13:34:35.526370+0000","last_fullsized":"2024-04-24T13:34:35.526370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592796+0000","last_change":"2024-04-24T13:33:49.289867+0000","last_active":"2024-04-24T13:34:34.592796+0000","last_peered":"2024-04-24T13:34:34.592796+0000","last_clean":"2024-04-24T13:34:34.592796+0000","last_became_active":"2024-04-24T13:33:49.289412+0000","last_became_peered":"2024-04-24T13:33:49.289412+0000","last_unstale":"2024-04-24T13:34:34.592796+0000","last_undegraded":"2024-04-24T13:34:34.592796+0000","last_fullsized":"2024-04-24T13:34:34.592796+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:24:50.051036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"114'2","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665605+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:34:35.665605+0000","last_peered":"2024-04-24T13:34:35.665605+0000","last_clean":"2024-04-24T13:34:35.665605+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:34:35.665605+0000","last_undegraded":"2024-04-24T13:34:35.665605+0000","last_fullsized":"2024-04-24T13:34:35.665605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"131'28","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665975+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:34:35.665975+0000","last_peered":"2024-04-24T13:34:35.665975+0000","last_clean":"2024-04-24T13:34:35.665975+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:34:35.665975+0000","last_undegraded":"2024-04-24T13:34:35.665975+0000","last_fullsized":"2024-04-24T13:34:35.665975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525943+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:34:35.525943+0000","last_peered":"2024-04-24T13:34:35.525943+0000","last_clean":"2024-04-24T13:34:35.525943+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:34:35.525943+0000","last_undegraded":"2024-04-24T13:34:35.525943+0000","last_fullsized":"2024-04-24T13:34:35.525943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590834+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:34:34.590834+0000","last_peered":"2024-04-24T13:34:34.590834+0000","last_clean":"2024-04-24T13:34:34.590834+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:34:34.590834+0000","last_undegraded":"2024-04-24T13:34:34.590834+0000","last_fullsized":"2024-04-24T13:34:34.590834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"150'135","reported_seq":432,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:40.124551+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:34:40.124551+0000","last_peered":"2024-04-24T13:34:40.124551+0000","last_clean":"2024-04-24T13:34:40.124551+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:34:40.124551+0000","last_undegraded":"2024-04-24T13:34:40.124551+0000","last_fullsized":"2024-04-24T13:34:40.124551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"82'6","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670479+0000","last_change":"2024-04-24T13:33:50.541311+0000","last_active":"2024-04-24T13:34:35.670479+0000","last_peered":"2024-04-24T13:34:35.670479+0000","last_clean":"2024-04-24T13:34:35.670479+0000","last_became_active":"2024-04-24T13:33:49.285594+0000","last_became_peered":"2024-04-24T13:33:49.285594+0000","last_unstale":"2024-04-24T13:34:35.670479+0000","last_undegraded":"2024-04-24T13:34:35.670479+0000","last_fullsized":"2024-04-24T13:34:35.670479+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:45.453497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"86'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589448+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:34:34.589448+0000","last_peered":"2024-04-24T13:34:34.589448+0000","last_clean":"2024-04-24T13:34:34.589448+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:34:34.589448+0000","last_undegraded":"2024-04-24T13:34:34.589448+0000","last_fullsized":"2024-04-24T13:34:34.589448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"131'28","reported_seq":143,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591594+0000","last_change":"2024-04-24T13:33:09.116807+0000","last_active":"2024-04-24T13:34:34.591594+0000","last_peered":"2024-04-24T13:34:34.591594+0000","last_clean":"2024-04-24T13:34:34.591594+0000","last_became_active":"2024-04-24T13:33:08.708911+0000","last_became_peered":"2024-04-24T13:33:08.708911+0000","last_unstale":"2024-04-24T13:34:34.591594+0000","last_undegraded":"2024-04-24T13:34:34.591594+0000","last_fullsized":"2024-04-24T13:34:34.591594+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:59.171558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":108544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669046+0000","last_change":"2024-04-24T13:33:49.283103+0000","last_active":"2024-04-24T13:34:35.669046+0000","last_peered":"2024-04-24T13:34:35.669046+0000","last_clean":"2024-04-24T13:34:35.669046+0000","last_became_active":"2024-04-24T13:33:49.282772+0000","last_became_peered":"2024-04-24T13:33:49.282772+0000","last_unstale":"2024-04-24T13:34:35.669046+0000","last_undegraded":"2024-04-24T13:34:35.669046+0000","last_fullsized":"2024-04-24T13:34:35.669046+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:44.215595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"132'25","reported_seq":121,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591993+0000","last_change":"2024-04-24T13:33:09.934600+0000","last_active":"2024-04-24T13:34:34.591993+0000","last_peered":"2024-04-24T13:34:34.591993+0000","last_clean":"2024-04-24T13:34:34.591993+0000","last_became_active":"2024-04-24T13:33:08.732254+0000","last_became_peered":"2024-04-24T13:33:08.732254+0000","last_unstale":"2024-04-24T13:34:34.591993+0000","last_undegraded":"2024-04-24T13:34:34.591993+0000","last_fullsized":"2024-04-24T13:34:34.591993+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:35.846866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664957+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:34:35.664957+0000","last_peered":"2024-04-24T13:34:35.664957+0000","last_clean":"2024-04-24T13:34:35.664957+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:34:35.664957+0000","last_undegraded":"2024-04-24T13:34:35.664957+0000","last_fullsized":"2024-04-24T13:34:35.664957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670236+0000","last_change":"2024-04-24T13:33:49.295971+0000","last_active":"2024-04-24T13:34:35.670236+0000","last_peered":"2024-04-24T13:34:35.670236+0000","last_clean":"2024-04-24T13:34:35.670236+0000","last_became_active":"2024-04-24T13:33:49.294486+0000","last_became_peered":"2024-04-24T13:33:49.294486+0000","last_unstale":"2024-04-24T13:34:35.670236+0000","last_undegraded":"2024-04-24T13:34:35.670236+0000","last_fullsized":"2024-04-24T13:34:35.670236+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:53:43.527494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"105'6","reported_seq":147,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667474+0000","last_change":"2024-04-24T13:32:32.751387+0000","last_active":"2024-04-24T13:34:35.667474+0000","last_peered":"2024-04-24T13:34:35.667474+0000","last_clean":"2024-04-24T13:34:35.667474+0000","last_became_active":"2024-04-24T13:32:32.741990+0000","last_became_peered":"2024-04-24T13:32:32.741990+0000","last_unstale":"2024-04-24T13:34:35.667474+0000","last_undegraded":"2024-04-24T13:34:35.667474+0000","last_fullsized":"2024-04-24T13:34:35.667474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:49.789798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"131'23","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595783+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:34:34.595783+0000","last_peered":"2024-04-24T13:34:34.595783+0000","last_clean":"2024-04-24T13:34:34.595783+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:34:34.595783+0000","last_undegraded":"2024-04-24T13:34:34.595783+0000","last_fullsized":"2024-04-24T13:34:34.595783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593550+0000","last_change":"2024-04-24T13:33:08.705125+0000","last_active":"2024-04-24T13:34:34.593550+0000","last_peered":"2024-04-24T13:34:34.593550+0000","last_clean":"2024-04-24T13:34:34.593550+0000","last_became_active":"2024-04-24T13:33:08.704735+0000","last_became_peered":"2024-04-24T13:33:08.704735+0000","last_unstale":"2024-04-24T13:34:34.593550+0000","last_undegraded":"2024-04-24T13:34:34.593550+0000","last_fullsized":"2024-04-24T13:34:34.593550+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:14.183681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"132'18","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664908+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:34:35.664908+0000","last_peered":"2024-04-24T13:34:35.664908+0000","last_clean":"2024-04-24T13:34:35.664908+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:34:35.664908+0000","last_undegraded":"2024-04-24T13:34:35.664908+0000","last_fullsized":"2024-04-24T13:34:35.664908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667249+0000","last_change":"2024-04-24T13:33:49.289409+0000","last_active":"2024-04-24T13:34:35.667249+0000","last_peered":"2024-04-24T13:34:35.667249+0000","last_clean":"2024-04-24T13:34:35.667249+0000","last_became_active":"2024-04-24T13:33:49.288970+0000","last_became_peered":"2024-04-24T13:33:49.288970+0000","last_unstale":"2024-04-24T13:34:35.667249+0000","last_undegraded":"2024-04-24T13:34:35.667249+0000","last_fullsized":"2024-04-24T13:34:35.667249+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:39.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556026+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:34:35.556026+0000","last_peered":"2024-04-24T13:34:35.556026+0000","last_clean":"2024-04-24T13:34:35.556026+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:34:35.556026+0000","last_undegraded":"2024-04-24T13:34:35.556026+0000","last_fullsized":"2024-04-24T13:34:35.556026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"105'10","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592552+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:34:34.592552+0000","last_peered":"2024-04-24T13:34:34.592552+0000","last_clean":"2024-04-24T13:34:34.592552+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:34:34.592552+0000","last_undegraded":"2024-04-24T13:34:34.592552+0000","last_fullsized":"2024-04-24T13:34:34.592552+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"131'19","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556282+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:34:35.556282+0000","last_peered":"2024-04-24T13:34:35.556282+0000","last_clean":"2024-04-24T13:34:35.556282+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:34:35.556282+0000","last_undegraded":"2024-04-24T13:34:35.556282+0000","last_fullsized":"2024-04-24T13:34:35.556282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587731+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:34:34.587731+0000","last_peered":"2024-04-24T13:34:34.587731+0000","last_clean":"2024-04-24T13:34:34.587731+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:34:34.587731+0000","last_undegraded":"2024-04-24T13:34:34.587731+0000","last_fullsized":"2024-04-24T13:34:34.587731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"132'13","reported_seq":181,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665742+0000","last_change":"2024-04-24T13:33:51.167111+0000","last_active":"2024-04-24T13:34:35.665742+0000","last_peered":"2024-04-24T13:34:35.665742+0000","last_clean":"2024-04-24T13:34:35.665742+0000","last_became_active":"2024-04-24T13:33:49.302159+0000","last_became_peered":"2024-04-24T13:33:49.302159+0000","last_unstale":"2024-04-24T13:34:35.665742+0000","last_undegraded":"2024-04-24T13:34:35.665742+0000","last_fullsized":"2024-04-24T13:34:35.665742+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:21.719835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588137+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:34:34.588137+0000","last_peered":"2024-04-24T13:34:34.588137+0000","last_clean":"2024-04-24T13:34:34.588137+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:34:34.588137+0000","last_undegraded":"2024-04-24T13:34:34.588137+0000","last_fullsized":"2024-04-24T13:34:34.588137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"82'2","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670276+0000","last_change":"2024-04-24T13:33:54.657281+0000","last_active":"2024-04-24T13:34:35.670276+0000","last_peered":"2024-04-24T13:34:35.670276+0000","last_clean":"2024-04-24T13:34:35.670276+0000","last_became_active":"2024-04-24T13:33:49.303239+0000","last_became_peered":"2024-04-24T13:33:49.303239+0000","last_unstale":"2024-04-24T13:34:35.670276+0000","last_undegraded":"2024-04-24T13:34:35.670276+0000","last_fullsized":"2024-04-24T13:34:35.670276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:32.797578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"82'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588230+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:34:34.588230+0000","last_peered":"2024-04-24T13:34:34.588230+0000","last_clean":"2024-04-24T13:34:34.588230+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:34:34.588230+0000","last_undegraded":"2024-04-24T13:34:34.588230+0000","last_fullsized":"2024-04-24T13:34:34.588230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"131'21","reported_seq":193,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665984+0000","last_change":"2024-04-24T13:33:09.073468+0000","last_active":"2024-04-24T13:34:35.665984+0000","last_peered":"2024-04-24T13:34:35.665984+0000","last_clean":"2024-04-24T13:34:35.665984+0000","last_became_active":"2024-04-24T13:33:08.725822+0000","last_became_peered":"2024-04-24T13:33:08.725822+0000","last_unstale":"2024-04-24T13:34:35.665984+0000","last_undegraded":"2024-04-24T13:34:35.665984+0000","last_fullsized":"2024-04-24T13:34:35.665984+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:24:41.185601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528798+0000","last_change":"2024-04-24T13:33:09.078708+0000","last_active":"2024-04-24T13:34:35.528798+0000","last_peered":"2024-04-24T13:34:35.528798+0000","last_clean":"2024-04-24T13:34:35.528798+0000","last_became_active":"2024-04-24T13:33:08.726873+0000","last_became_peered":"2024-04-24T13:33:08.726873+0000","last_unstale":"2024-04-24T13:34:35.528798+0000","last_undegraded":"2024-04-24T13:34:35.528798+0000","last_fullsized":"2024-04-24T13:34:35.528798+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:53:23.482374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"132'17","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588566+0000","last_change":"2024-04-24T13:33:09.087185+0000","last_active":"2024-04-24T13:34:34.588566+0000","last_peered":"2024-04-24T13:34:34.588566+0000","last_clean":"2024-04-24T13:34:34.588566+0000","last_became_active":"2024-04-24T13:33:08.726347+0000","last_became_peered":"2024-04-24T13:33:08.726347+0000","last_unstale":"2024-04-24T13:34:34.588566+0000","last_undegraded":"2024-04-24T13:34:34.588566+0000","last_fullsized":"2024-04-24T13:34:34.588566+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:37.412890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665180+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:34:35.665180+0000","last_peered":"2024-04-24T13:34:35.665180+0000","last_clean":"2024-04-24T13:34:35.665180+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:34:35.665180+0000","last_undegraded":"2024-04-24T13:34:35.665180+0000","last_fullsized":"2024-04-24T13:34:35.665180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589644+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:34:34.589644+0000","last_peered":"2024-04-24T13:34:34.589644+0000","last_clean":"2024-04-24T13:34:34.589644+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:34:34.589644+0000","last_undegraded":"2024-04-24T13:34:34.589644+0000","last_fullsized":"2024-04-24T13:34:34.589644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"132'10","reported_seq":303,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529693+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:34:35.529693+0000","last_peered":"2024-04-24T13:34:35.529693+0000","last_clean":"2024-04-24T13:34:35.529693+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:34:35.529693+0000","last_undegraded":"2024-04-24T13:34:35.529693+0000","last_fullsized":"2024-04-24T13:34:35.529693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"130'14","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666878+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:34:35.666878+0000","last_peered":"2024-04-24T13:34:35.666878+0000","last_clean":"2024-04-24T13:34:35.666878+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:34:35.666878+0000","last_undegraded":"2024-04-24T13:34:35.666878+0000","last_fullsized":"2024-04-24T13:34:35.666878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"105'12","reported_seq":303,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.526585+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:34:35.526585+0000","last_peered":"2024-04-24T13:34:35.526585+0000","last_clean":"2024-04-24T13:34:35.526585+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:34:35.526585+0000","last_undegraded":"2024-04-24T13:34:35.526585+0000","last_fullsized":"2024-04-24T13:34:35.526585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"132'20","reported_seq":311,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665952+0000","last_change":"2024-04-24T13:33:09.324802+0000","last_active":"2024-04-24T13:34:35.665952+0000","last_peered":"2024-04-24T13:34:35.665952+0000","last_clean":"2024-04-24T13:34:35.665952+0000","last_became_active":"2024-04-24T13:33:08.725876+0000","last_became_peered":"2024-04-24T13:33:08.725876+0000","last_unstale":"2024-04-24T13:34:35.665952+0000","last_undegraded":"2024-04-24T13:34:35.665952+0000","last_fullsized":"2024-04-24T13:34:35.665952+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:21:58.951897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"82'2","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594991+0000","last_change":"2024-04-24T13:33:53.237778+0000","last_active":"2024-04-24T13:34:34.594991+0000","last_peered":"2024-04-24T13:34:34.594991+0000","last_clean":"2024-04-24T13:34:34.594991+0000","last_became_active":"2024-04-24T13:33:49.302722+0000","last_became_peered":"2024-04-24T13:33:49.302722+0000","last_unstale":"2024-04-24T13:34:34.594991+0000","last_undegraded":"2024-04-24T13:34:34.594991+0000","last_fullsized":"2024-04-24T13:34:34.594991+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:52:06.190295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"132'28","reported_seq":143,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592901+0000","last_change":"2024-04-24T13:33:09.548908+0000","last_active":"2024-04-24T13:34:34.592901+0000","last_peered":"2024-04-24T13:34:34.592901+0000","last_clean":"2024-04-24T13:34:34.592901+0000","last_became_active":"2024-04-24T13:33:08.720010+0000","last_became_peered":"2024-04-24T13:33:08.720010+0000","last_unstale":"2024-04-24T13:34:34.592901+0000","last_undegraded":"2024-04-24T13:34:34.592901+0000","last_fullsized":"2024-04-24T13:34:34.592901+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:06.195033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"114'12","reported_seq":320,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525327+0000","last_change":"2024-04-24T13:33:49.678468+0000","last_active":"2024-04-24T13:34:35.525327+0000","last_peered":"2024-04-24T13:34:35.525327+0000","last_clean":"2024-04-24T13:34:35.525327+0000","last_became_active":"2024-04-24T13:33:49.289642+0000","last_became_peered":"2024-04-24T13:33:49.289642+0000","last_unstale":"2024-04-24T13:34:35.525327+0000","last_undegraded":"2024-04-24T13:34:35.525327+0000","last_fullsized":"2024-04-24T13:34:35.525327+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:37.408920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"132'31","reported_seq":296,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666117+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:34:35.666117+0000","last_peered":"2024-04-24T13:34:35.666117+0000","last_clean":"2024-04-24T13:34:35.666117+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:34:35.666117+0000","last_undegraded":"2024-04-24T13:34:35.666117+0000","last_fullsized":"2024-04-24T13:34:35.666117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"132'4","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554985+0000","last_change":"2024-04-24T13:33:51.611283+0000","last_active":"2024-04-24T13:34:35.554985+0000","last_peered":"2024-04-24T13:34:35.554985+0000","last_clean":"2024-04-24T13:34:35.554985+0000","last_became_active":"2024-04-24T13:33:49.304888+0000","last_became_peered":"2024-04-24T13:33:49.304888+0000","last_unstale":"2024-04-24T13:34:35.554985+0000","last_undegraded":"2024-04-24T13:34:35.554985+0000","last_fullsized":"2024-04-24T13:34:35.554985+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:18.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"131'22","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556718+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:34:35.556718+0000","last_peered":"2024-04-24T13:34:35.556718+0000","last_clean":"2024-04-24T13:34:35.556718+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:34:35.556718+0000","last_undegraded":"2024-04-24T13:34:35.556718+0000","last_fullsized":"2024-04-24T13:34:35.556718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"81'2","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589524+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:34:34.589524+0000","last_peered":"2024-04-24T13:34:34.589524+0000","last_clean":"2024-04-24T13:34:34.589524+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:34:34.589524+0000","last_undegraded":"2024-04-24T13:34:34.589524+0000","last_fullsized":"2024-04-24T13:34:34.589524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"131'18","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.526189+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:34:35.526189+0000","last_peered":"2024-04-24T13:34:35.526189+0000","last_clean":"2024-04-24T13:34:35.526189+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:34:35.526189+0000","last_undegraded":"2024-04-24T13:34:35.526189+0000","last_fullsized":"2024-04-24T13:34:35.526189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"132'12","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554322+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:34:35.554322+0000","last_peered":"2024-04-24T13:34:35.554322+0000","last_clean":"2024-04-24T13:34:35.554322+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:34:35.554322+0000","last_undegraded":"2024-04-24T13:34:35.554322+0000","last_fullsized":"2024-04-24T13:34:35.554322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"131'29","reported_seq":340,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671592+0000","last_change":"2024-04-24T13:33:50.237368+0000","last_active":"2024-04-24T13:34:35.671592+0000","last_peered":"2024-04-24T13:34:35.671592+0000","last_clean":"2024-04-24T13:34:35.671592+0000","last_became_active":"2024-04-24T13:33:49.301145+0000","last_became_peered":"2024-04-24T13:33:49.301145+0000","last_unstale":"2024-04-24T13:34:35.671592+0000","last_undegraded":"2024-04-24T13:34:35.671592+0000","last_fullsized":"2024-04-24T13:34:35.671592+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:57:21.677851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666722+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:34:35.666722+0000","last_peered":"2024-04-24T13:34:35.666722+0000","last_clean":"2024-04-24T13:34:35.666722+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:34:35.666722+0000","last_undegraded":"2024-04-24T13:34:35.666722+0000","last_fullsized":"2024-04-24T13:34:35.666722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"131'16","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556649+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:34:35.556649+0000","last_peered":"2024-04-24T13:34:35.556649+0000","last_clean":"2024-04-24T13:34:35.556649+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:34:35.556649+0000","last_undegraded":"2024-04-24T13:34:35.556649+0000","last_fullsized":"2024-04-24T13:34:35.556649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"105'8","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668052+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:34:35.668052+0000","last_peered":"2024-04-24T13:34:35.668052+0000","last_clean":"2024-04-24T13:34:35.668052+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:34:35.668052+0000","last_undegraded":"2024-04-24T13:34:35.668052+0000","last_fullsized":"2024-04-24T13:34:35.668052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"131'28","reported_seq":141,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593813+0000","last_change":"2024-04-24T13:33:09.287304+0000","last_active":"2024-04-24T13:34:34.593813+0000","last_peered":"2024-04-24T13:34:34.593813+0000","last_clean":"2024-04-24T13:34:34.593813+0000","last_became_active":"2024-04-24T13:33:08.716282+0000","last_became_peered":"2024-04-24T13:33:08.716282+0000","last_unstale":"2024-04-24T13:34:34.593813+0000","last_undegraded":"2024-04-24T13:34:34.593813+0000","last_fullsized":"2024-04-24T13:34:34.593813+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591204+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:34:34.591204+0000","last_peered":"2024-04-24T13:34:34.591204+0000","last_clean":"2024-04-24T13:34:34.591204+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:34:34.591204+0000","last_undegraded":"2024-04-24T13:34:34.591204+0000","last_fullsized":"2024-04-24T13:34:34.591204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"132'28","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554550+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:34:35.554550+0000","last_peered":"2024-04-24T13:34:35.554550+0000","last_clean":"2024-04-24T13:34:35.554550+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:34:35.554550+0000","last_undegraded":"2024-04-24T13:34:35.554550+0000","last_fullsized":"2024-04-24T13:34:35.554550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665527+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:34:35.665527+0000","last_peered":"2024-04-24T13:34:35.665527+0000","last_clean":"2024-04-24T13:34:35.665527+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:34:35.665527+0000","last_undegraded":"2024-04-24T13:34:35.665527+0000","last_fullsized":"2024-04-24T13:34:35.665527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"131'23","reported_seq":165,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592406+0000","last_change":"2024-04-24T13:33:51.593184+0000","last_active":"2024-04-24T13:34:34.592406+0000","last_peered":"2024-04-24T13:34:34.592406+0000","last_clean":"2024-04-24T13:34:34.592406+0000","last_became_active":"2024-04-24T13:33:49.289463+0000","last_became_peered":"2024-04-24T13:33:49.289463+0000","last_unstale":"2024-04-24T13:34:34.592406+0000","last_undegraded":"2024-04-24T13:34:34.592406+0000","last_fullsized":"2024-04-24T13:34:34.592406+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:42:20.618809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"82'6","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590679+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:34:34.590679+0000","last_peered":"2024-04-24T13:34:34.590679+0000","last_clean":"2024-04-24T13:34:34.590679+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:34:34.590679+0000","last_undegraded":"2024-04-24T13:34:34.590679+0000","last_fullsized":"2024-04-24T13:34:34.590679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"131'24","reported_seq":334,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666298+0000","last_change":"2024-04-24T13:33:52.627571+0000","last_active":"2024-04-24T13:34:35.666298+0000","last_peered":"2024-04-24T13:34:35.666298+0000","last_clean":"2024-04-24T13:34:35.666298+0000","last_became_active":"2024-04-24T13:33:49.302184+0000","last_became_peered":"2024-04-24T13:33:49.302184+0000","last_unstale":"2024-04-24T13:34:35.666298+0000","last_undegraded":"2024-04-24T13:34:35.666298+0000","last_fullsized":"2024-04-24T13:34:35.666298+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:16:24.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":69206016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"82'2","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669580+0000","last_change":"2024-04-24T13:33:53.884916+0000","last_active":"2024-04-24T13:34:35.669580+0000","last_peered":"2024-04-24T13:34:35.669580+0000","last_clean":"2024-04-24T13:34:35.669580+0000","last_became_active":"2024-04-24T13:33:49.300182+0000","last_became_peered":"2024-04-24T13:33:49.300182+0000","last_unstale":"2024-04-24T13:34:35.669580+0000","last_undegraded":"2024-04-24T13:34:35.669580+0000","last_fullsized":"2024-04-24T13:34:35.669580+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:30.442779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"132'30","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668550+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:34:35.668550+0000","last_peered":"2024-04-24T13:34:35.668550+0000","last_clean":"2024-04-24T13:34:35.668550+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:34:35.668550+0000","last_undegraded":"2024-04-24T13:34:35.668550+0000","last_fullsized":"2024-04-24T13:34:35.668550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"82'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665279+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:34:35.665279+0000","last_peered":"2024-04-24T13:34:35.665279+0000","last_clean":"2024-04-24T13:34:35.665279+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:34:35.665279+0000","last_undegraded":"2024-04-24T13:34:35.665279+0000","last_fullsized":"2024-04-24T13:34:35.665279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"131'17","reported_seq":89,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669962+0000","last_change":"2024-04-24T13:33:54.184096+0000","last_active":"2024-04-24T13:34:35.669962+0000","last_peered":"2024-04-24T13:34:35.669962+0000","last_clean":"2024-04-24T13:34:35.669962+0000","last_became_active":"2024-04-24T13:33:49.299554+0000","last_became_peered":"2024-04-24T13:33:49.299554+0000","last_unstale":"2024-04-24T13:34:35.669962+0000","last_undegraded":"2024-04-24T13:34:35.669962+0000","last_fullsized":"2024-04-24T13:34:35.669962+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:18.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69206016,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"82'2","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554228+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:34:35.554228+0000","last_peered":"2024-04-24T13:34:35.554228+0000","last_clean":"2024-04-24T13:34:35.554228+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:34:35.554228+0000","last_undegraded":"2024-04-24T13:34:35.554228+0000","last_fullsized":"2024-04-24T13:34:35.554228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"131'18","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666030+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:34:35.666030+0000","last_peered":"2024-04-24T13:34:35.666030+0000","last_clean":"2024-04-24T13:34:35.666030+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:34:35.666030+0000","last_undegraded":"2024-04-24T13:34:35.666030+0000","last_fullsized":"2024-04-24T13:34:35.666030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667336+0000","last_change":"2024-04-24T13:33:49.302008+0000","last_active":"2024-04-24T13:34:35.667336+0000","last_peered":"2024-04-24T13:34:35.667336+0000","last_clean":"2024-04-24T13:34:35.667336+0000","last_became_active":"2024-04-24T13:33:49.300135+0000","last_became_peered":"2024-04-24T13:33:49.300135+0000","last_unstale":"2024-04-24T13:34:35.667336+0000","last_undegraded":"2024-04-24T13:34:35.667336+0000","last_fullsized":"2024-04-24T13:34:35.667336+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:02.680781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"131'24","reported_seq":177,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595741+0000","last_change":"2024-04-24T13:33:53.222020+0000","last_active":"2024-04-24T13:34:34.595741+0000","last_peered":"2024-04-24T13:34:34.595741+0000","last_clean":"2024-04-24T13:34:34.595741+0000","last_became_active":"2024-04-24T13:33:49.292734+0000","last_became_peered":"2024-04-24T13:33:49.292734+0000","last_unstale":"2024-04-24T13:34:34.595741+0000","last_undegraded":"2024-04-24T13:34:34.595741+0000","last_fullsized":"2024-04-24T13:34:34.595741+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:13.333265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"131'25","reported_seq":139,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594450+0000","last_change":"2024-04-24T13:33:10.398117+0000","last_active":"2024-04-24T13:34:34.594450+0000","last_peered":"2024-04-24T13:34:34.594450+0000","last_clean":"2024-04-24T13:34:34.594450+0000","last_became_active":"2024-04-24T13:33:08.735696+0000","last_became_peered":"2024-04-24T13:33:08.735696+0000","last_unstale":"2024-04-24T13:34:34.594450+0000","last_undegraded":"2024-04-24T13:34:34.594450+0000","last_fullsized":"2024-04-24T13:34:34.594450+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:01:26.139144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668044+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:34:35.668044+0000","last_peered":"2024-04-24T13:34:35.668044+0000","last_clean":"2024-04-24T13:34:35.668044+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:34:35.668044+0000","last_undegraded":"2024-04-24T13:34:35.668044+0000","last_fullsized":"2024-04-24T13:34:35.668044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"132'17","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529204+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:34:35.529204+0000","last_peered":"2024-04-24T13:34:35.529204+0000","last_clean":"2024-04-24T13:34:35.529204+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:34:35.529204+0000","last_undegraded":"2024-04-24T13:34:35.529204+0000","last_fullsized":"2024-04-24T13:34:35.529204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"82'6","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595392+0000","last_change":"2024-04-24T13:33:09.917888+0000","last_active":"2024-04-24T13:34:34.595392+0000","last_peered":"2024-04-24T13:34:34.595392+0000","last_clean":"2024-04-24T13:34:34.595392+0000","last_became_active":"2024-04-24T13:33:08.732489+0000","last_became_peered":"2024-04-24T13:33:08.732489+0000","last_unstale":"2024-04-24T13:34:34.595392+0000","last_undegraded":"2024-04-24T13:34:34.595392+0000","last_fullsized":"2024-04-24T13:34:34.595392+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:16.213872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":342,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":194,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1091,"ondisk_log_size":1091,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":378948,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":842,"num_read_kb":607,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":143,"num_bytes_recovered":62549,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":760,"ondisk_log_size":760,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":339,"num_read_kb":339,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2233,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1458,"num_read_kb":1426,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":449,"num_bytes_recovered":1849688064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1887072,"kb_used_data":1851736,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92484768,"statfs":{"total":96636764160,"available":94704402432,"internally_reserved":0,"allocated":1896177664,"data_stored":1895415815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1192132,"kb_used_data":1160956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93179708,"statfs":{"total":96636764160,"available":95416020992,"internally_reserved":0,"allocated":1188818944,"data_stored":1188084563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2087576,"kb_used_data":2052240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92284264,"statfs":{"total":96636764160,"available":94499086336,"internally_reserved":0,"allocated":2101493760,"data_stored":2100698156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1542340,"kb_used_data":1511152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92829500,"statfs":{"total":96636764160,"available":95057408000,"internally_reserved":0,"allocated":1547419648,"data_stored":1546697053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2030028,"kb_used_data":1994692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92341812,"statfs":{"total":96636764160,"available":94558015488,"internally_reserved":0,"allocated":2042564608,"data_stored":2041802088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1169668,"kb_used_data":1134332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93202172,"statfs":{"total":96636764160,"available":95439024128,"internally_reserved":0,"allocated":1161555968,"data_stored":1160821827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":983508,"kb_used_data":948172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93388332,"statfs":{"total":96636764160,"available":95629651968,"internally_reserved":0,"allocated":970928128,"data_stored":970158184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1702740,"kb_used_data":1667400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92669100,"statfs":{"total":96636764160,"available":94893158400,"internally_reserved":0,"allocated":1707417600,"data_stored":1706672098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1704984576,"data_stored":1704984576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":968884224,"data_stored":968884224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1159725056,"data_stored":1159725056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2040528896,"data_stored":2040528896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1545601024,"data_stored":1545601024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2099249152,"data_stored":2099249152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1186988032,"data_stored":1186988032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1893728256,"data_stored":1893728256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":176376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":177072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":351674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:34:48.046 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:34:48.279 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-04-24T13:34:48.425 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:34:48.437 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:34:48.454 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-04-24T13:34:47.329932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300815940,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3149,"num_read_kb":2838,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":669,"num_bytes_recovered":1850933776,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3912,"ondisk_log_size":3912,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12595064,"kb_used_data":12320680,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":742379656,"statfs":{"total":773094113280,"available":760196767744,"internally_reserved":0,"allocated":12616376320,"data_stored":12610349784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":280874545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007671"},"pg_stats":[{"pgid":"3.3f","version":"131'18","reported_seq":92,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669607+0000","last_change":"2024-04-24T13:33:52.298396+0000","last_active":"2024-04-24T13:34:35.669607+0000","last_peered":"2024-04-24T13:34:35.669607+0000","last_clean":"2024-04-24T13:34:35.669607+0000","last_became_active":"2024-04-24T13:33:49.293106+0000","last_became_peered":"2024-04-24T13:33:49.293106+0000","last_unstale":"2024-04-24T13:34:35.669607+0000","last_undegraded":"2024-04-24T13:34:35.669607+0000","last_fullsized":"2024-04-24T13:34:35.669607+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:44.520756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"82'14","reported_seq":309,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594851+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:34:34.594851+0000","last_peered":"2024-04-24T13:34:34.594851+0000","last_clean":"2024-04-24T13:34:34.594851+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:34:34.594851+0000","last_undegraded":"2024-04-24T13:34:34.594851+0000","last_fullsized":"2024-04-24T13:34:34.594851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"132'18","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.531293+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:34:35.531293+0000","last_peered":"2024-04-24T13:34:35.531293+0000","last_clean":"2024-04-24T13:34:35.531293+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:34:35.531293+0000","last_undegraded":"2024-04-24T13:34:35.531293+0000","last_fullsized":"2024-04-24T13:34:35.531293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"82'4","reported_seq":63,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669845+0000","last_change":"2024-04-24T13:33:52.687680+0000","last_active":"2024-04-24T13:34:35.669845+0000","last_peered":"2024-04-24T13:34:35.669845+0000","last_clean":"2024-04-24T13:34:35.669845+0000","last_became_active":"2024-04-24T13:33:49.293840+0000","last_became_peered":"2024-04-24T13:33:49.293840+0000","last_unstale":"2024-04-24T13:34:35.669845+0000","last_undegraded":"2024-04-24T13:34:35.669845+0000","last_fullsized":"2024-04-24T13:34:35.669845+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:13:31.744087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"131'17","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667042+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:34:35.667042+0000","last_peered":"2024-04-24T13:34:35.667042+0000","last_clean":"2024-04-24T13:34:35.667042+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:34:35.667042+0000","last_undegraded":"2024-04-24T13:34:35.667042+0000","last_fullsized":"2024-04-24T13:34:35.667042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":27,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589257+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:34:34.589257+0000","last_peered":"2024-04-24T13:34:34.589257+0000","last_clean":"2024-04-24T13:34:34.589257+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:34:34.589257+0000","last_undegraded":"2024-04-24T13:34:34.589257+0000","last_fullsized":"2024-04-24T13:34:34.589257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"132'25","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594720+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:34:34.594720+0000","last_peered":"2024-04-24T13:34:34.594720+0000","last_clean":"2024-04-24T13:34:34.594720+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:34:34.594720+0000","last_undegraded":"2024-04-24T13:34:34.594720+0000","last_fullsized":"2024-04-24T13:34:34.594720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"132'6","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666016+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:34:35.666016+0000","last_peered":"2024-04-24T13:34:35.666016+0000","last_clean":"2024-04-24T13:34:35.666016+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:34:35.666016+0000","last_undegraded":"2024-04-24T13:34:35.666016+0000","last_fullsized":"2024-04-24T13:34:35.666016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"132'34","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668947+0000","last_change":"2024-04-24T13:33:53.650464+0000","last_active":"2024-04-24T13:34:35.668947+0000","last_peered":"2024-04-24T13:34:35.668947+0000","last_clean":"2024-04-24T13:34:35.668947+0000","last_became_active":"2024-04-24T13:33:49.299781+0000","last_became_peered":"2024-04-24T13:33:49.299781+0000","last_unstale":"2024-04-24T13:34:35.668947+0000","last_undegraded":"2024-04-24T13:34:35.668947+0000","last_fullsized":"2024-04-24T13:34:35.668947+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:08.408193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"82'2","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668172+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:34:35.668172+0000","last_peered":"2024-04-24T13:34:35.668172+0000","last_clean":"2024-04-24T13:34:35.668172+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:34:35.668172+0000","last_undegraded":"2024-04-24T13:34:35.668172+0000","last_fullsized":"2024-04-24T13:34:35.668172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"131'30","reported_seq":298,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593034+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:34:34.593034+0000","last_peered":"2024-04-24T13:34:34.593034+0000","last_clean":"2024-04-24T13:34:34.593034+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:34:34.593034+0000","last_undegraded":"2024-04-24T13:34:34.593034+0000","last_fullsized":"2024-04-24T13:34:34.593034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"82'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590410+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:34:34.590410+0000","last_peered":"2024-04-24T13:34:34.590410+0000","last_clean":"2024-04-24T13:34:34.590410+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:34:34.590410+0000","last_undegraded":"2024-04-24T13:34:34.590410+0000","last_fullsized":"2024-04-24T13:34:34.590410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"131'29","reported_seq":109,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668747+0000","last_change":"2024-04-24T13:33:51.145800+0000","last_active":"2024-04-24T13:34:35.668747+0000","last_peered":"2024-04-24T13:34:35.668747+0000","last_clean":"2024-04-24T13:34:35.668747+0000","last_became_active":"2024-04-24T13:33:49.287926+0000","last_became_peered":"2024-04-24T13:33:49.287926+0000","last_unstale":"2024-04-24T13:34:35.668747+0000","last_undegraded":"2024-04-24T13:34:35.668747+0000","last_fullsized":"2024-04-24T13:34:35.668747+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:22.605125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"82'2","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595672+0000","last_change":"2024-04-24T13:33:09.792748+0000","last_active":"2024-04-24T13:34:34.595672+0000","last_peered":"2024-04-24T13:34:34.595672+0000","last_clean":"2024-04-24T13:34:34.595672+0000","last_became_active":"2024-04-24T13:33:08.725324+0000","last_became_peered":"2024-04-24T13:33:08.725324+0000","last_unstale":"2024-04-24T13:34:34.595672+0000","last_undegraded":"2024-04-24T13:34:34.595672+0000","last_fullsized":"2024-04-24T13:34:34.595672+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:20.696769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"131'18","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554234+0000","last_change":"2024-04-24T13:33:08.836525+0000","last_active":"2024-04-24T13:34:35.554234+0000","last_peered":"2024-04-24T13:34:35.554234+0000","last_clean":"2024-04-24T13:34:35.554234+0000","last_became_active":"2024-04-24T13:33:08.720200+0000","last_became_peered":"2024-04-24T13:33:08.720200+0000","last_unstale":"2024-04-24T13:34:35.554234+0000","last_undegraded":"2024-04-24T13:34:35.554234+0000","last_fullsized":"2024-04-24T13:34:35.554234+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:31.093323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"82'6","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666260+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:34:35.666260+0000","last_peered":"2024-04-24T13:34:35.666260+0000","last_clean":"2024-04-24T13:34:35.666260+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:34:35.666260+0000","last_undegraded":"2024-04-24T13:34:35.666260+0000","last_fullsized":"2024-04-24T13:34:35.666260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"86'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588496+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:34:34.588496+0000","last_peered":"2024-04-24T13:34:34.588496+0000","last_clean":"2024-04-24T13:34:34.588496+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:34:34.588496+0000","last_undegraded":"2024-04-24T13:34:34.588496+0000","last_fullsized":"2024-04-24T13:34:34.588496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"131'24","reported_seq":101,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670455+0000","last_change":"2024-04-24T13:33:51.801208+0000","last_active":"2024-04-24T13:34:35.670455+0000","last_peered":"2024-04-24T13:34:35.670455+0000","last_clean":"2024-04-24T13:34:35.670455+0000","last_became_active":"2024-04-24T13:33:49.287950+0000","last_became_peered":"2024-04-24T13:33:49.287950+0000","last_unstale":"2024-04-24T13:34:35.670455+0000","last_undegraded":"2024-04-24T13:34:35.670455+0000","last_fullsized":"2024-04-24T13:34:35.670455+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:09.811184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"82'4","reported_seq":63,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670154+0000","last_change":"2024-04-24T13:33:53.106900+0000","last_active":"2024-04-24T13:34:35.670154+0000","last_peered":"2024-04-24T13:34:35.670154+0000","last_clean":"2024-04-24T13:34:35.670154+0000","last_became_active":"2024-04-24T13:33:49.294597+0000","last_became_peered":"2024-04-24T13:33:49.294597+0000","last_unstale":"2024-04-24T13:34:35.670154+0000","last_undegraded":"2024-04-24T13:34:35.670154+0000","last_fullsized":"2024-04-24T13:34:35.670154+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:28.384262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"131'28","reported_seq":319,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671293+0000","last_change":"2024-04-24T13:33:08.998015+0000","last_active":"2024-04-24T13:34:35.671293+0000","last_peered":"2024-04-24T13:34:35.671293+0000","last_clean":"2024-04-24T13:34:35.671293+0000","last_became_active":"2024-04-24T13:33:08.726581+0000","last_became_peered":"2024-04-24T13:33:08.726581+0000","last_unstale":"2024-04-24T13:34:35.671293+0000","last_undegraded":"2024-04-24T13:34:35.671293+0000","last_fullsized":"2024-04-24T13:34:35.671293+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:03:25.814262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"86'6","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592134+0000","last_change":"2024-04-24T13:33:09.293808+0000","last_active":"2024-04-24T13:34:34.592134+0000","last_peered":"2024-04-24T13:34:34.592134+0000","last_clean":"2024-04-24T13:34:34.592134+0000","last_became_active":"2024-04-24T13:33:08.719391+0000","last_became_peered":"2024-04-24T13:33:08.719391+0000","last_unstale":"2024-04-24T13:34:34.592134+0000","last_undegraded":"2024-04-24T13:34:34.592134+0000","last_fullsized":"2024-04-24T13:34:34.592134+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:10.422756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"132'22","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670992+0000","last_change":"2024-04-24T13:33:09.199641+0000","last_active":"2024-04-24T13:34:35.670992+0000","last_peered":"2024-04-24T13:34:35.670992+0000","last_clean":"2024-04-24T13:34:35.670992+0000","last_became_active":"2024-04-24T13:33:08.737789+0000","last_became_peered":"2024-04-24T13:33:08.737789+0000","last_unstale":"2024-04-24T13:34:35.670992+0000","last_undegraded":"2024-04-24T13:34:35.670992+0000","last_fullsized":"2024-04-24T13:34:35.670992+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:41.648006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665653+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:34:35.665653+0000","last_peered":"2024-04-24T13:34:35.665653+0000","last_clean":"2024-04-24T13:34:35.665653+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:34:35.665653+0000","last_undegraded":"2024-04-24T13:34:35.665653+0000","last_fullsized":"2024-04-24T13:34:35.665653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"132'24","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590031+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:34:34.590031+0000","last_peered":"2024-04-24T13:34:34.590031+0000","last_clean":"2024-04-24T13:34:34.590031+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:34:34.590031+0000","last_undegraded":"2024-04-24T13:34:34.590031+0000","last_fullsized":"2024-04-24T13:34:34.590031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"132'6","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665503+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:34:35.665503+0000","last_peered":"2024-04-24T13:34:35.665503+0000","last_clean":"2024-04-24T13:34:35.665503+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:34:35.665503+0000","last_undegraded":"2024-04-24T13:34:35.665503+0000","last_fullsized":"2024-04-24T13:34:35.665503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"131'23","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554652+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:34:35.554652+0000","last_peered":"2024-04-24T13:34:35.554652+0000","last_clean":"2024-04-24T13:34:35.554652+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:34:35.554652+0000","last_undegraded":"2024-04-24T13:34:35.554652+0000","last_fullsized":"2024-04-24T13:34:35.554652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590560+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:34:34.590560+0000","last_peered":"2024-04-24T13:34:34.590560+0000","last_clean":"2024-04-24T13:34:34.590560+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:34:34.590560+0000","last_undegraded":"2024-04-24T13:34:34.590560+0000","last_fullsized":"2024-04-24T13:34:34.590560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"132'25","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665634+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:34:35.665634+0000","last_peered":"2024-04-24T13:34:35.665634+0000","last_clean":"2024-04-24T13:34:35.665634+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:34:35.665634+0000","last_undegraded":"2024-04-24T13:34:35.665634+0000","last_fullsized":"2024-04-24T13:34:35.665634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587703+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:34:34.587703+0000","last_peered":"2024-04-24T13:34:34.587703+0000","last_clean":"2024-04-24T13:34:34.587703+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:34:34.587703+0000","last_undegraded":"2024-04-24T13:34:34.587703+0000","last_fullsized":"2024-04-24T13:34:34.587703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"82'2","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556467+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:34:35.556467+0000","last_peered":"2024-04-24T13:34:35.556467+0000","last_clean":"2024-04-24T13:34:35.556467+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:34:35.556467+0000","last_undegraded":"2024-04-24T13:34:35.556467+0000","last_fullsized":"2024-04-24T13:34:35.556467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"132'27","reported_seq":105,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668651+0000","last_change":"2024-04-24T13:33:49.775824+0000","last_active":"2024-04-24T13:34:35.668651+0000","last_peered":"2024-04-24T13:34:35.668651+0000","last_clean":"2024-04-24T13:34:35.668651+0000","last_became_active":"2024-04-24T13:33:49.282849+0000","last_became_peered":"2024-04-24T13:33:49.282849+0000","last_unstale":"2024-04-24T13:34:35.668651+0000","last_undegraded":"2024-04-24T13:34:35.668651+0000","last_fullsized":"2024-04-24T13:34:35.668651+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:12:15.350559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595154+0000","last_change":"2024-04-24T13:33:10.797093+0000","last_active":"2024-04-24T13:34:34.595154+0000","last_peered":"2024-04-24T13:34:34.595154+0000","last_clean":"2024-04-24T13:34:34.595154+0000","last_became_active":"2024-04-24T13:33:08.736087+0000","last_became_peered":"2024-04-24T13:33:08.736087+0000","last_unstale":"2024-04-24T13:34:34.595154+0000","last_undegraded":"2024-04-24T13:34:34.595154+0000","last_fullsized":"2024-04-24T13:34:34.595154+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:49:31.056251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"132'17","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667818+0000","last_change":"2024-04-24T13:33:51.608371+0000","last_active":"2024-04-24T13:34:35.667818+0000","last_peered":"2024-04-24T13:34:35.667818+0000","last_clean":"2024-04-24T13:34:35.667818+0000","last_became_active":"2024-04-24T13:33:49.295172+0000","last_became_peered":"2024-04-24T13:33:49.295172+0000","last_unstale":"2024-04-24T13:34:35.667818+0000","last_undegraded":"2024-04-24T13:34:35.667818+0000","last_fullsized":"2024-04-24T13:34:35.667818+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:46:40.352367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670310+0000","last_change":"2024-04-24T13:33:49.295489+0000","last_active":"2024-04-24T13:34:35.670310+0000","last_peered":"2024-04-24T13:34:35.670310+0000","last_clean":"2024-04-24T13:34:35.670310+0000","last_became_active":"2024-04-24T13:33:49.292611+0000","last_became_peered":"2024-04-24T13:33:49.292611+0000","last_unstale":"2024-04-24T13:34:35.670310+0000","last_undegraded":"2024-04-24T13:34:35.670310+0000","last_fullsized":"2024-04-24T13:34:35.670310+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:52:22.537619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"132'48","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592278+0000","last_change":"2024-04-24T13:33:08.911162+0000","last_active":"2024-04-24T13:34:34.592278+0000","last_peered":"2024-04-24T13:34:34.592278+0000","last_clean":"2024-04-24T13:34:34.592278+0000","last_became_active":"2024-04-24T13:33:08.709158+0000","last_became_peered":"2024-04-24T13:33:08.709158+0000","last_unstale":"2024-04-24T13:34:34.592278+0000","last_undegraded":"2024-04-24T13:34:34.592278+0000","last_fullsized":"2024-04-24T13:34:34.592278+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:56.162767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"82'4","reported_seq":119,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595727+0000","last_change":"2024-04-24T13:33:53.234461+0000","last_active":"2024-04-24T13:34:34.595727+0000","last_peered":"2024-04-24T13:34:34.595727+0000","last_clean":"2024-04-24T13:34:34.595727+0000","last_became_active":"2024-04-24T13:33:49.302172+0000","last_became_peered":"2024-04-24T13:33:49.302172+0000","last_unstale":"2024-04-24T13:34:34.595727+0000","last_undegraded":"2024-04-24T13:34:34.595727+0000","last_fullsized":"2024-04-24T13:34:34.595727+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:55:38.136746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"131'19","reported_seq":323,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665731+0000","last_change":"2024-04-24T13:33:49.666596+0000","last_active":"2024-04-24T13:34:35.665731+0000","last_peered":"2024-04-24T13:34:35.665731+0000","last_clean":"2024-04-24T13:34:35.665731+0000","last_became_active":"2024-04-24T13:33:49.283461+0000","last_became_peered":"2024-04-24T13:33:49.283461+0000","last_unstale":"2024-04-24T13:34:35.665731+0000","last_undegraded":"2024-04-24T13:34:35.665731+0000","last_fullsized":"2024-04-24T13:34:35.665731+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:49:27.034645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556319+0000","last_change":"2024-04-24T13:33:49.301406+0000","last_active":"2024-04-24T13:34:35.556319+0000","last_peered":"2024-04-24T13:34:35.556319+0000","last_clean":"2024-04-24T13:34:35.556319+0000","last_became_active":"2024-04-24T13:33:49.300648+0000","last_became_peered":"2024-04-24T13:33:49.300648+0000","last_unstale":"2024-04-24T13:34:35.556319+0000","last_undegraded":"2024-04-24T13:34:35.556319+0000","last_fullsized":"2024-04-24T13:34:35.556319+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:41:13.998419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590838+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:34:34.590838+0000","last_peered":"2024-04-24T13:34:34.590838+0000","last_clean":"2024-04-24T13:34:34.590838+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:34:34.590838+0000","last_undegraded":"2024-04-24T13:34:34.590838+0000","last_fullsized":"2024-04-24T13:34:34.590838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590524+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:34:34.590524+0000","last_peered":"2024-04-24T13:34:34.590524+0000","last_clean":"2024-04-24T13:34:34.590524+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:34:34.590524+0000","last_undegraded":"2024-04-24T13:34:34.590524+0000","last_fullsized":"2024-04-24T13:34:34.590524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665370+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:34:35.665370+0000","last_peered":"2024-04-24T13:34:35.665370+0000","last_clean":"2024-04-24T13:34:35.665370+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:34:35.665370+0000","last_undegraded":"2024-04-24T13:34:35.665370+0000","last_fullsized":"2024-04-24T13:34:35.665370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"86'10","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667179+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:34:35.667179+0000","last_peered":"2024-04-24T13:34:35.667179+0000","last_clean":"2024-04-24T13:34:35.667179+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:34:35.667179+0000","last_undegraded":"2024-04-24T13:34:35.667179+0000","last_fullsized":"2024-04-24T13:34:35.667179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"132'24","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668571+0000","last_change":"2024-04-24T13:33:50.330934+0000","last_active":"2024-04-24T13:34:35.668571+0000","last_peered":"2024-04-24T13:34:35.668571+0000","last_clean":"2024-04-24T13:34:35.668571+0000","last_became_active":"2024-04-24T13:33:49.286157+0000","last_became_peered":"2024-04-24T13:33:49.286157+0000","last_unstale":"2024-04-24T13:34:35.668571+0000","last_undegraded":"2024-04-24T13:34:35.668571+0000","last_fullsized":"2024-04-24T13:34:35.668571+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:10.162075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.557008+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:34:35.557008+0000","last_peered":"2024-04-24T13:34:35.557008+0000","last_clean":"2024-04-24T13:34:35.557008+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:34:35.557008+0000","last_undegraded":"2024-04-24T13:34:35.557008+0000","last_fullsized":"2024-04-24T13:34:35.557008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664419+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:34:35.664419+0000","last_peered":"2024-04-24T13:34:35.664419+0000","last_clean":"2024-04-24T13:34:35.664419+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:34:35.664419+0000","last_undegraded":"2024-04-24T13:34:35.664419+0000","last_fullsized":"2024-04-24T13:34:35.664419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"150'139","reported_seq":426,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670684+0000","last_change":"2024-04-24T13:33:52.550604+0000","last_active":"2024-04-24T13:34:35.670684+0000","last_peered":"2024-04-24T13:34:35.670684+0000","last_clean":"2024-04-24T13:34:35.670684+0000","last_became_active":"2024-04-24T13:33:52.550123+0000","last_became_peered":"2024-04-24T13:33:52.550123+0000","last_unstale":"2024-04-24T13:34:35.670684+0000","last_undegraded":"2024-04-24T13:34:35.670684+0000","last_fullsized":"2024-04-24T13:34:35.670684+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:09:41.226875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"105'8","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588558+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:34:34.588558+0000","last_peered":"2024-04-24T13:34:34.588558+0000","last_clean":"2024-04-24T13:34:34.588558+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:34:34.588558+0000","last_undegraded":"2024-04-24T13:34:34.588558+0000","last_fullsized":"2024-04-24T13:34:34.588558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"132'4","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556508+0000","last_change":"2024-04-24T13:33:51.170660+0000","last_active":"2024-04-24T13:34:35.556508+0000","last_peered":"2024-04-24T13:34:35.556508+0000","last_clean":"2024-04-24T13:34:35.556508+0000","last_became_active":"2024-04-24T13:33:49.301591+0000","last_became_peered":"2024-04-24T13:33:49.301591+0000","last_unstale":"2024-04-24T13:34:35.556508+0000","last_undegraded":"2024-04-24T13:34:35.556508+0000","last_fullsized":"2024-04-24T13:34:35.556508+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:16:26.080736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"132'27","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667008+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:34:35.667008+0000","last_peered":"2024-04-24T13:34:35.667008+0000","last_clean":"2024-04-24T13:34:35.667008+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:34:35.667008+0000","last_undegraded":"2024-04-24T13:34:35.667008+0000","last_fullsized":"2024-04-24T13:34:35.667008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595591+0000","last_change":"2024-04-24T13:33:08.718010+0000","last_active":"2024-04-24T13:34:34.595591+0000","last_peered":"2024-04-24T13:34:34.595591+0000","last_clean":"2024-04-24T13:34:34.595591+0000","last_became_active":"2024-04-24T13:33:08.716072+0000","last_became_peered":"2024-04-24T13:33:08.716072+0000","last_unstale":"2024-04-24T13:34:34.595591+0000","last_undegraded":"2024-04-24T13:34:34.595591+0000","last_fullsized":"2024-04-24T13:34:34.595591+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:26.626730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"132'17","reported_seq":68,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669637+0000","last_change":"2024-04-24T13:33:52.725009+0000","last_active":"2024-04-24T13:34:35.669637+0000","last_peered":"2024-04-24T13:34:35.669637+0000","last_clean":"2024-04-24T13:34:35.669637+0000","last_became_active":"2024-04-24T13:33:49.294133+0000","last_became_peered":"2024-04-24T13:33:49.294133+0000","last_unstale":"2024-04-24T13:34:35.669637+0000","last_undegraded":"2024-04-24T13:34:35.669637+0000","last_fullsized":"2024-04-24T13:34:35.669637+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:51.462917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"150'135","reported_seq":465,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556045+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:34:35.556045+0000","last_peered":"2024-04-24T13:34:35.556045+0000","last_clean":"2024-04-24T13:34:35.556045+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:34:35.556045+0000","last_undegraded":"2024-04-24T13:34:35.556045+0000","last_fullsized":"2024-04-24T13:34:35.556045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"82'2","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594248+0000","last_change":"2024-04-24T13:33:49.308248+0000","last_active":"2024-04-24T13:34:34.594248+0000","last_peered":"2024-04-24T13:34:34.594248+0000","last_clean":"2024-04-24T13:34:34.594248+0000","last_became_active":"2024-04-24T13:33:49.278105+0000","last_became_peered":"2024-04-24T13:33:49.278105+0000","last_unstale":"2024-04-24T13:34:34.594248+0000","last_undegraded":"2024-04-24T13:34:34.594248+0000","last_fullsized":"2024-04-24T13:34:34.594248+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:20.068883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"132'25","reported_seq":97,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669876+0000","last_change":"2024-04-24T13:33:53.103595+0000","last_active":"2024-04-24T13:34:35.669876+0000","last_peered":"2024-04-24T13:34:35.669876+0000","last_clean":"2024-04-24T13:34:35.669876+0000","last_became_active":"2024-04-24T13:33:49.297787+0000","last_became_peered":"2024-04-24T13:33:49.297787+0000","last_unstale":"2024-04-24T13:34:35.669876+0000","last_undegraded":"2024-04-24T13:34:35.669876+0000","last_fullsized":"2024-04-24T13:34:35.669876+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668999+0000","last_change":"2024-04-24T13:33:49.299431+0000","last_active":"2024-04-24T13:34:35.668999+0000","last_peered":"2024-04-24T13:34:35.668999+0000","last_clean":"2024-04-24T13:34:35.668999+0000","last_became_active":"2024-04-24T13:33:49.294593+0000","last_became_peered":"2024-04-24T13:33:49.294593+0000","last_unstale":"2024-04-24T13:34:35.668999+0000","last_undegraded":"2024-04-24T13:34:35.668999+0000","last_fullsized":"2024-04-24T13:34:35.668999+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:36.135388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"132'28","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592767+0000","last_change":"2024-04-24T13:33:10.421787+0000","last_active":"2024-04-24T13:34:34.592767+0000","last_peered":"2024-04-24T13:34:34.592767+0000","last_clean":"2024-04-24T13:34:34.592767+0000","last_became_active":"2024-04-24T13:33:08.733302+0000","last_became_peered":"2024-04-24T13:33:08.733302+0000","last_unstale":"2024-04-24T13:34:34.592767+0000","last_undegraded":"2024-04-24T13:34:34.592767+0000","last_fullsized":"2024-04-24T13:34:34.592767+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:10:16.339117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529307+0000","last_change":"2024-04-24T13:33:08.727357+0000","last_active":"2024-04-24T13:34:35.529307+0000","last_peered":"2024-04-24T13:34:35.529307+0000","last_clean":"2024-04-24T13:34:35.529307+0000","last_became_active":"2024-04-24T13:33:08.726787+0000","last_became_peered":"2024-04-24T13:33:08.726787+0000","last_unstale":"2024-04-24T13:34:35.529307+0000","last_undegraded":"2024-04-24T13:34:35.529307+0000","last_fullsized":"2024-04-24T13:34:35.529307+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:49.701435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"86'7","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594758+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:34:34.594758+0000","last_peered":"2024-04-24T13:34:34.594758+0000","last_clean":"2024-04-24T13:34:34.594758+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:34:34.594758+0000","last_undegraded":"2024-04-24T13:34:34.594758+0000","last_fullsized":"2024-04-24T13:34:34.594758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"132'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588759+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:34:34.588759+0000","last_peered":"2024-04-24T13:34:34.588759+0000","last_clean":"2024-04-24T13:34:34.588759+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:34:34.588759+0000","last_undegraded":"2024-04-24T13:34:34.588759+0000","last_fullsized":"2024-04-24T13:34:34.588759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"132'17","reported_seq":86,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669927+0000","last_change":"2024-04-24T13:33:50.539289+0000","last_active":"2024-04-24T13:34:35.669927+0000","last_peered":"2024-04-24T13:34:35.669927+0000","last_clean":"2024-04-24T13:34:35.669927+0000","last_became_active":"2024-04-24T13:33:49.284576+0000","last_became_peered":"2024-04-24T13:33:49.284576+0000","last_unstale":"2024-04-24T13:34:35.669927+0000","last_undegraded":"2024-04-24T13:34:35.669927+0000","last_fullsized":"2024-04-24T13:34:35.669927+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:20.287647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664846+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:34:35.664846+0000","last_peered":"2024-04-24T13:34:35.664846+0000","last_clean":"2024-04-24T13:34:35.664846+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:34:35.664846+0000","last_undegraded":"2024-04-24T13:34:35.664846+0000","last_fullsized":"2024-04-24T13:34:35.664846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"132'18","reported_seq":309,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555087+0000","last_change":"2024-04-24T13:33:52.751477+0000","last_active":"2024-04-24T13:34:35.555087+0000","last_peered":"2024-04-24T13:34:35.555087+0000","last_clean":"2024-04-24T13:34:35.555087+0000","last_became_active":"2024-04-24T13:33:49.308018+0000","last_became_peered":"2024-04-24T13:33:49.308018+0000","last_unstale":"2024-04-24T13:34:35.555087+0000","last_undegraded":"2024-04-24T13:34:35.555087+0000","last_fullsized":"2024-04-24T13:34:35.555087+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:29:49.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554059+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:34:35.554059+0000","last_peered":"2024-04-24T13:34:35.554059+0000","last_clean":"2024-04-24T13:34:35.554059+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:34:35.554059+0000","last_undegraded":"2024-04-24T13:34:35.554059+0000","last_fullsized":"2024-04-24T13:34:35.554059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":243,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667433+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:34:35.667433+0000","last_peered":"2024-04-24T13:34:35.667433+0000","last_clean":"2024-04-24T13:34:35.667433+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:34:35.667433+0000","last_undegraded":"2024-04-24T13:34:35.667433+0000","last_fullsized":"2024-04-24T13:34:35.667433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"82'4","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667381+0000","last_change":"2024-04-24T13:32:01.548738+0000","last_active":"2024-04-24T13:34:35.667381+0000","last_peered":"2024-04-24T13:34:35.667381+0000","last_clean":"2024-04-24T13:34:35.667381+0000","last_became_active":"2024-04-24T13:32:01.548259+0000","last_became_peered":"2024-04-24T13:32:01.548259+0000","last_unstale":"2024-04-24T13:34:35.667381+0000","last_undegraded":"2024-04-24T13:34:35.667381+0000","last_fullsized":"2024-04-24T13:34:35.667381+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"131'26","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669452+0000","last_change":"2024-04-24T13:33:52.683024+0000","last_active":"2024-04-24T13:34:35.669452+0000","last_peered":"2024-04-24T13:34:35.669452+0000","last_clean":"2024-04-24T13:34:35.669452+0000","last_became_active":"2024-04-24T13:33:49.293373+0000","last_became_peered":"2024-04-24T13:33:49.293373+0000","last_unstale":"2024-04-24T13:34:35.669452+0000","last_undegraded":"2024-04-24T13:34:35.669452+0000","last_fullsized":"2024-04-24T13:34:35.669452+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:05:00.168247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665398+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:34:35.665398+0000","last_peered":"2024-04-24T13:34:35.665398+0000","last_clean":"2024-04-24T13:34:35.665398+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:34:35.665398+0000","last_undegraded":"2024-04-24T13:34:35.665398+0000","last_fullsized":"2024-04-24T13:34:35.665398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"132'23","reported_seq":74,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667835+0000","last_change":"2024-04-24T13:33:53.666421+0000","last_active":"2024-04-24T13:34:35.667835+0000","last_peered":"2024-04-24T13:34:35.667835+0000","last_clean":"2024-04-24T13:34:35.667835+0000","last_became_active":"2024-04-24T13:33:49.302140+0000","last_became_peered":"2024-04-24T13:33:49.302140+0000","last_unstale":"2024-04-24T13:34:35.667835+0000","last_undegraded":"2024-04-24T13:34:35.667835+0000","last_fullsized":"2024-04-24T13:34:35.667835+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.223797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"150'135","reported_seq":514,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665118+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:34:35.665118+0000","last_peered":"2024-04-24T13:34:35.665118+0000","last_clean":"2024-04-24T13:34:35.665118+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:34:35.665118+0000","last_undegraded":"2024-04-24T13:34:35.665118+0000","last_fullsized":"2024-04-24T13:34:35.665118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"82'3","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667725+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:34:35.667725+0000","last_peered":"2024-04-24T13:34:35.667725+0000","last_clean":"2024-04-24T13:34:35.667725+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:34:35.667725+0000","last_undegraded":"2024-04-24T13:34:35.667725+0000","last_fullsized":"2024-04-24T13:34:35.667725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"132'10","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666648+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:34:35.666648+0000","last_peered":"2024-04-24T13:34:35.666648+0000","last_clean":"2024-04-24T13:34:35.666648+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:34:35.666648+0000","last_undegraded":"2024-04-24T13:34:35.666648+0000","last_fullsized":"2024-04-24T13:34:35.666648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"131'23","reported_seq":135,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594898+0000","last_change":"2024-04-24T13:33:10.787412+0000","last_active":"2024-04-24T13:34:34.594898+0000","last_peered":"2024-04-24T13:34:34.594898+0000","last_clean":"2024-04-24T13:34:34.594898+0000","last_became_active":"2024-04-24T13:33:08.718332+0000","last_became_peered":"2024-04-24T13:33:08.718332+0000","last_unstale":"2024-04-24T13:34:34.594898+0000","last_undegraded":"2024-04-24T13:34:34.594898+0000","last_fullsized":"2024-04-24T13:34:34.594898+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:11.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665188+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:34:35.665188+0000","last_peered":"2024-04-24T13:34:35.665188+0000","last_clean":"2024-04-24T13:34:35.665188+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:34:35.665188+0000","last_undegraded":"2024-04-24T13:34:35.665188+0000","last_fullsized":"2024-04-24T13:34:35.665188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"132'28","reported_seq":325,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665332+0000","last_change":"2024-04-24T13:33:51.156026+0000","last_active":"2024-04-24T13:34:35.665332+0000","last_peered":"2024-04-24T13:34:35.665332+0000","last_clean":"2024-04-24T13:34:35.665332+0000","last_became_active":"2024-04-24T13:33:49.292150+0000","last_became_peered":"2024-04-24T13:33:49.292150+0000","last_unstale":"2024-04-24T13:34:35.665332+0000","last_undegraded":"2024-04-24T13:34:35.665332+0000","last_fullsized":"2024-04-24T13:34:35.665332+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:42.853378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665105+0000","last_change":"2024-04-24T13:33:49.306397+0000","last_active":"2024-04-24T13:34:35.665105+0000","last_peered":"2024-04-24T13:34:35.665105+0000","last_clean":"2024-04-24T13:34:35.665105+0000","last_became_active":"2024-04-24T13:33:49.305572+0000","last_became_peered":"2024-04-24T13:33:49.305572+0000","last_unstale":"2024-04-24T13:34:35.665105+0000","last_undegraded":"2024-04-24T13:34:35.665105+0000","last_fullsized":"2024-04-24T13:34:35.665105+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:48.247418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"126'11","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529509+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:34:35.529509+0000","last_peered":"2024-04-24T13:34:35.529509+0000","last_clean":"2024-04-24T13:34:35.529509+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:34:35.529509+0000","last_undegraded":"2024-04-24T13:34:35.529509+0000","last_fullsized":"2024-04-24T13:34:35.529509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"132'8","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590413+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:34:34.590413+0000","last_peered":"2024-04-24T13:34:34.590413+0000","last_clean":"2024-04-24T13:34:34.590413+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:34:34.590413+0000","last_undegraded":"2024-04-24T13:34:34.590413+0000","last_fullsized":"2024-04-24T13:34:34.590413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"132'29","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554380+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:34:35.554380+0000","last_peered":"2024-04-24T13:34:35.554380+0000","last_clean":"2024-04-24T13:34:35.554380+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:34:35.554380+0000","last_undegraded":"2024-04-24T13:34:35.554380+0000","last_fullsized":"2024-04-24T13:34:35.554380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":275,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665339+0000","last_change":"2024-04-24T13:33:49.300767+0000","last_active":"2024-04-24T13:34:35.665339+0000","last_peered":"2024-04-24T13:34:35.665339+0000","last_clean":"2024-04-24T13:34:35.665339+0000","last_became_active":"2024-04-24T13:33:49.300030+0000","last_became_peered":"2024-04-24T13:33:49.300030+0000","last_unstale":"2024-04-24T13:34:35.665339+0000","last_undegraded":"2024-04-24T13:34:35.665339+0000","last_fullsized":"2024-04-24T13:34:35.665339+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:28.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"132'19","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590813+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:34:34.590813+0000","last_peered":"2024-04-24T13:34:34.590813+0000","last_clean":"2024-04-24T13:34:34.590813+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:34:34.590813+0000","last_undegraded":"2024-04-24T13:34:34.590813+0000","last_fullsized":"2024-04-24T13:34:34.590813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667965+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:34:35.667965+0000","last_peered":"2024-04-24T13:34:35.667965+0000","last_clean":"2024-04-24T13:34:35.667965+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:34:35.667965+0000","last_undegraded":"2024-04-24T13:34:35.667965+0000","last_fullsized":"2024-04-24T13:34:35.667965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554807+0000","last_change":"2024-04-24T13:33:08.720576+0000","last_active":"2024-04-24T13:34:35.554807+0000","last_peered":"2024-04-24T13:34:35.554807+0000","last_clean":"2024-04-24T13:34:35.554807+0000","last_became_active":"2024-04-24T13:33:08.720133+0000","last_became_peered":"2024-04-24T13:33:08.720133+0000","last_unstale":"2024-04-24T13:34:35.554807+0000","last_undegraded":"2024-04-24T13:34:35.554807+0000","last_fullsized":"2024-04-24T13:34:35.554807+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:16.254173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590861+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:34:34.590861+0000","last_peered":"2024-04-24T13:34:34.590861+0000","last_clean":"2024-04-24T13:34:34.590861+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:34:34.590861+0000","last_undegraded":"2024-04-24T13:34:34.590861+0000","last_fullsized":"2024-04-24T13:34:34.590861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"131'33","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667642+0000","last_change":"2024-04-24T13:31:00.986244+0000","last_active":"2024-04-24T13:34:35.667642+0000","last_peered":"2024-04-24T13:34:35.667642+0000","last_clean":"2024-04-24T13:34:35.667642+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:34:35.667642+0000","last_undegraded":"2024-04-24T13:34:35.667642+0000","last_fullsized":"2024-04-24T13:34:35.667642+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:23.355231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.524931+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:34:35.524931+0000","last_peered":"2024-04-24T13:34:35.524931+0000","last_clean":"2024-04-24T13:34:35.524931+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:34:35.524931+0000","last_undegraded":"2024-04-24T13:34:35.524931+0000","last_fullsized":"2024-04-24T13:34:35.524931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"132'25","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666099+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:34:35.666099+0000","last_peered":"2024-04-24T13:34:35.666099+0000","last_clean":"2024-04-24T13:34:35.666099+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:34:35.666099+0000","last_undegraded":"2024-04-24T13:34:35.666099+0000","last_fullsized":"2024-04-24T13:34:35.666099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"150'139","reported_seq":470,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665834+0000","last_change":"2024-04-24T13:33:11.710852+0000","last_active":"2024-04-24T13:34:35.665834+0000","last_peered":"2024-04-24T13:34:35.665834+0000","last_clean":"2024-04-24T13:34:35.665834+0000","last_became_active":"2024-04-24T13:33:11.709412+0000","last_became_peered":"2024-04-24T13:33:11.709412+0000","last_unstale":"2024-04-24T13:34:35.665834+0000","last_undegraded":"2024-04-24T13:34:35.665834+0000","last_fullsized":"2024-04-24T13:34:35.665834+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:22:40.670445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":247,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529048+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:34:35.529048+0000","last_peered":"2024-04-24T13:34:35.529048+0000","last_clean":"2024-04-24T13:34:35.529048+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:34:35.529048+0000","last_undegraded":"2024-04-24T13:34:35.529048+0000","last_fullsized":"2024-04-24T13:34:35.529048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"114'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591312+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:34:34.591312+0000","last_peered":"2024-04-24T13:34:34.591312+0000","last_clean":"2024-04-24T13:34:34.591312+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:34:34.591312+0000","last_undegraded":"2024-04-24T13:34:34.591312+0000","last_fullsized":"2024-04-24T13:34:34.591312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"132'26","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588065+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:34:34.588065+0000","last_peered":"2024-04-24T13:34:34.588065+0000","last_clean":"2024-04-24T13:34:34.588065+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:34:34.588065+0000","last_undegraded":"2024-04-24T13:34:34.588065+0000","last_fullsized":"2024-04-24T13:34:34.588065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":148,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595952+0000","last_change":"2024-04-24T13:33:09.912410+0000","last_active":"2024-04-24T13:34:34.595952+0000","last_peered":"2024-04-24T13:34:34.595952+0000","last_clean":"2024-04-24T13:34:34.595952+0000","last_became_active":"2024-04-24T13:33:08.724858+0000","last_became_peered":"2024-04-24T13:33:08.724858+0000","last_unstale":"2024-04-24T13:34:34.595952+0000","last_undegraded":"2024-04-24T13:34:34.595952+0000","last_fullsized":"2024-04-24T13:34:34.595952+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:26.760043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":176,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"82'11","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556099+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:34:35.556099+0000","last_peered":"2024-04-24T13:34:35.556099+0000","last_clean":"2024-04-24T13:34:35.556099+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:34:35.556099+0000","last_undegraded":"2024-04-24T13:34:35.556099+0000","last_fullsized":"2024-04-24T13:34:35.556099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"150'135","reported_seq":479,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667871+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:34:35.667871+0000","last_peered":"2024-04-24T13:34:35.667871+0000","last_clean":"2024-04-24T13:34:35.667871+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:34:35.667871+0000","last_undegraded":"2024-04-24T13:34:35.667871+0000","last_fullsized":"2024-04-24T13:34:35.667871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"132'4","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589121+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:34:34.589121+0000","last_peered":"2024-04-24T13:34:34.589121+0000","last_clean":"2024-04-24T13:34:34.589121+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:34:34.589121+0000","last_undegraded":"2024-04-24T13:34:34.589121+0000","last_fullsized":"2024-04-24T13:34:34.589121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"86'4","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529743+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:34:35.529743+0000","last_peered":"2024-04-24T13:34:35.529743+0000","last_clean":"2024-04-24T13:34:35.529743+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:34:35.529743+0000","last_undegraded":"2024-04-24T13:34:35.529743+0000","last_fullsized":"2024-04-24T13:34:35.529743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"132'35","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554099+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:34:35.554099+0000","last_peered":"2024-04-24T13:34:35.554099+0000","last_clean":"2024-04-24T13:34:35.554099+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:34:35.554099+0000","last_undegraded":"2024-04-24T13:34:35.554099+0000","last_fullsized":"2024-04-24T13:34:35.554099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591102+0000","last_change":"2024-04-24T13:33:08.716879+0000","last_active":"2024-04-24T13:34:34.591102+0000","last_peered":"2024-04-24T13:34:34.591102+0000","last_clean":"2024-04-24T13:34:34.591102+0000","last_became_active":"2024-04-24T13:33:08.716585+0000","last_became_peered":"2024-04-24T13:33:08.716585+0000","last_unstale":"2024-04-24T13:34:34.591102+0000","last_undegraded":"2024-04-24T13:34:34.591102+0000","last_fullsized":"2024-04-24T13:34:34.591102+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:36.135388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"132'25","reported_seq":123,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595276+0000","last_change":"2024-04-24T13:33:10.818135+0000","last_active":"2024-04-24T13:34:34.595276+0000","last_peered":"2024-04-24T13:34:34.595276+0000","last_clean":"2024-04-24T13:34:34.595276+0000","last_became_active":"2024-04-24T13:33:08.736280+0000","last_became_peered":"2024-04-24T13:33:08.736280+0000","last_unstale":"2024-04-24T13:34:34.595276+0000","last_undegraded":"2024-04-24T13:34:34.595276+0000","last_fullsized":"2024-04-24T13:34:34.595276+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:41:16.005578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667479+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:34:35.667479+0000","last_peered":"2024-04-24T13:34:35.667479+0000","last_clean":"2024-04-24T13:34:35.667479+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:34:35.667479+0000","last_undegraded":"2024-04-24T13:34:35.667479+0000","last_fullsized":"2024-04-24T13:34:35.667479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"82'2","reported_seq":265,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529259+0000","last_change":"2024-04-24T13:33:09.338972+0000","last_active":"2024-04-24T13:34:35.529259+0000","last_peered":"2024-04-24T13:34:35.529259+0000","last_clean":"2024-04-24T13:34:35.529259+0000","last_became_active":"2024-04-24T13:33:08.727402+0000","last_became_peered":"2024-04-24T13:33:08.727402+0000","last_unstale":"2024-04-24T13:34:35.529259+0000","last_undegraded":"2024-04-24T13:34:35.529259+0000","last_fullsized":"2024-04-24T13:34:35.529259+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:34.956692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"105'4","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670731+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:34:35.670731+0000","last_peered":"2024-04-24T13:34:35.670731+0000","last_clean":"2024-04-24T13:34:35.670731+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:34:35.670731+0000","last_undegraded":"2024-04-24T13:34:35.670731+0000","last_fullsized":"2024-04-24T13:34:35.670731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":388,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668111+0000","last_change":"2024-04-24T13:33:54.557574+0000","last_active":"2024-04-24T13:34:35.668111+0000","last_peered":"2024-04-24T13:34:35.668111+0000","last_clean":"2024-04-24T13:34:35.668111+0000","last_became_active":"2024-04-24T13:33:54.557258+0000","last_became_peered":"2024-04-24T13:33:54.557258+0000","last_unstale":"2024-04-24T13:34:35.668111+0000","last_undegraded":"2024-04-24T13:34:35.668111+0000","last_fullsized":"2024-04-24T13:34:35.668111+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:14:04.108561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593434+0000","last_change":"2024-04-24T13:33:08.717037+0000","last_active":"2024-04-24T13:34:34.593434+0000","last_peered":"2024-04-24T13:34:34.593434+0000","last_clean":"2024-04-24T13:34:34.593434+0000","last_became_active":"2024-04-24T13:33:08.715914+0000","last_became_peered":"2024-04-24T13:33:08.715914+0000","last_unstale":"2024-04-24T13:34:34.593434+0000","last_undegraded":"2024-04-24T13:34:34.593434+0000","last_fullsized":"2024-04-24T13:34:34.593434+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:03.765941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"132'28","reported_seq":323,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554259+0000","last_change":"2024-04-24T13:33:09.529789+0000","last_active":"2024-04-24T13:34:35.554259+0000","last_peered":"2024-04-24T13:34:35.554259+0000","last_clean":"2024-04-24T13:34:35.554259+0000","last_became_active":"2024-04-24T13:33:08.725348+0000","last_became_peered":"2024-04-24T13:33:08.725348+0000","last_unstale":"2024-04-24T13:34:35.554259+0000","last_undegraded":"2024-04-24T13:34:35.554259+0000","last_fullsized":"2024-04-24T13:34:35.554259+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:18.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668973+0000","last_change":"2024-04-24T13:33:49.295687+0000","last_active":"2024-04-24T13:34:35.668973+0000","last_peered":"2024-04-24T13:34:35.668973+0000","last_clean":"2024-04-24T13:34:35.668973+0000","last_became_active":"2024-04-24T13:33:49.293916+0000","last_became_peered":"2024-04-24T13:33:49.293916+0000","last_unstale":"2024-04-24T13:34:35.668973+0000","last_undegraded":"2024-04-24T13:34:35.668973+0000","last_fullsized":"2024-04-24T13:34:35.668973+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:19.712676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"132'41","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.596147+0000","last_change":"2024-04-24T13:33:09.565111+0000","last_active":"2024-04-24T13:34:34.596147+0000","last_peered":"2024-04-24T13:34:34.596147+0000","last_clean":"2024-04-24T13:34:34.596147+0000","last_became_active":"2024-04-24T13:33:08.719950+0000","last_became_peered":"2024-04-24T13:33:08.719950+0000","last_unstale":"2024-04-24T13:34:34.596147+0000","last_undegraded":"2024-04-24T13:34:34.596147+0000","last_fullsized":"2024-04-24T13:34:34.596147+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:37.122088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179174,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":22,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":58868,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668132+0000","last_change":"2024-04-24T13:33:49.296153+0000","last_active":"2024-04-24T13:34:35.668132+0000","last_peered":"2024-04-24T13:34:35.668132+0000","last_clean":"2024-04-24T13:34:35.668132+0000","last_became_active":"2024-04-24T13:33:49.294098+0000","last_became_peered":"2024-04-24T13:33:49.294098+0000","last_unstale":"2024-04-24T13:34:35.668132+0000","last_undegraded":"2024-04-24T13:34:35.668132+0000","last_fullsized":"2024-04-24T13:34:35.668132+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:15.599045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666700+0000","last_change":"2024-04-24T13:33:08.727069+0000","last_active":"2024-04-24T13:34:35.666700+0000","last_peered":"2024-04-24T13:34:35.666700+0000","last_clean":"2024-04-24T13:34:35.666700+0000","last_became_active":"2024-04-24T13:33:08.726216+0000","last_became_peered":"2024-04-24T13:33:08.726216+0000","last_unstale":"2024-04-24T13:34:35.666700+0000","last_undegraded":"2024-04-24T13:34:35.666700+0000","last_fullsized":"2024-04-24T13:34:35.666700+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:59.675122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"105'6","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667409+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:34:35.667409+0000","last_peered":"2024-04-24T13:34:35.667409+0000","last_clean":"2024-04-24T13:34:35.667409+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:34:35.667409+0000","last_undegraded":"2024-04-24T13:34:35.667409+0000","last_fullsized":"2024-04-24T13:34:35.667409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668713+0000","last_change":"2024-04-24T13:33:49.282926+0000","last_active":"2024-04-24T13:34:35.668713+0000","last_peered":"2024-04-24T13:34:35.668713+0000","last_clean":"2024-04-24T13:34:35.668713+0000","last_became_active":"2024-04-24T13:33:49.282517+0000","last_became_peered":"2024-04-24T13:33:49.282517+0000","last_unstale":"2024-04-24T13:34:35.668713+0000","last_undegraded":"2024-04-24T13:34:35.668713+0000","last_fullsized":"2024-04-24T13:34:35.668713+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:18.852308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"132'24","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665423+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:34:35.665423+0000","last_peered":"2024-04-24T13:34:35.665423+0000","last_clean":"2024-04-24T13:34:35.665423+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:34:35.665423+0000","last_undegraded":"2024-04-24T13:34:35.665423+0000","last_fullsized":"2024-04-24T13:34:35.665423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.596110+0000","last_change":"2024-04-24T13:33:08.734054+0000","last_active":"2024-04-24T13:34:34.596110+0000","last_peered":"2024-04-24T13:34:34.596110+0000","last_clean":"2024-04-24T13:34:34.596110+0000","last_became_active":"2024-04-24T13:33:08.728126+0000","last_became_peered":"2024-04-24T13:33:08.728126+0000","last_unstale":"2024-04-24T13:34:34.596110+0000","last_undegraded":"2024-04-24T13:34:34.596110+0000","last_fullsized":"2024-04-24T13:34:34.596110+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:48.542362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"150'137","reported_seq":504,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:37.608916+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:34:37.608916+0000","last_peered":"2024-04-24T13:34:37.608916+0000","last_clean":"2024-04-24T13:34:37.608916+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:34:37.608916+0000","last_undegraded":"2024-04-24T13:34:37.608916+0000","last_fullsized":"2024-04-24T13:34:37.608916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120994,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669391+0000","last_change":"2024-04-24T13:33:49.298292+0000","last_active":"2024-04-24T13:34:35.669391+0000","last_peered":"2024-04-24T13:34:35.669391+0000","last_clean":"2024-04-24T13:34:35.669391+0000","last_became_active":"2024-04-24T13:33:49.297450+0000","last_became_peered":"2024-04-24T13:33:49.297450+0000","last_unstale":"2024-04-24T13:34:35.669391+0000","last_undegraded":"2024-04-24T13:34:35.669391+0000","last_fullsized":"2024-04-24T13:34:35.669391+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:11.836268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.527757+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:34:35.527757+0000","last_peered":"2024-04-24T13:34:35.527757+0000","last_clean":"2024-04-24T13:34:35.527757+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:34:35.527757+0000","last_undegraded":"2024-04-24T13:34:35.527757+0000","last_fullsized":"2024-04-24T13:34:35.527757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"132'2","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529868+0000","last_change":"2024-04-24T13:33:08.745743+0000","last_active":"2024-04-24T13:34:35.529868+0000","last_peered":"2024-04-24T13:34:35.529868+0000","last_clean":"2024-04-24T13:34:35.529868+0000","last_became_active":"2024-04-24T13:33:08.745363+0000","last_became_peered":"2024-04-24T13:33:08.745363+0000","last_unstale":"2024-04-24T13:34:35.529868+0000","last_undegraded":"2024-04-24T13:34:35.529868+0000","last_fullsized":"2024-04-24T13:34:35.529868+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:23:38.852782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666100+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:34:35.666100+0000","last_peered":"2024-04-24T13:34:35.666100+0000","last_clean":"2024-04-24T13:34:35.666100+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:34:35.666100+0000","last_undegraded":"2024-04-24T13:34:35.666100+0000","last_fullsized":"2024-04-24T13:34:35.666100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"132'23","reported_seq":290,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.530696+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:34:35.530696+0000","last_peered":"2024-04-24T13:34:35.530696+0000","last_clean":"2024-04-24T13:34:35.530696+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:34:35.530696+0000","last_undegraded":"2024-04-24T13:34:35.530696+0000","last_fullsized":"2024-04-24T13:34:35.530696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":274,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665881+0000","last_change":"2024-04-24T13:33:09.537358+0000","last_active":"2024-04-24T13:34:35.665881+0000","last_peered":"2024-04-24T13:34:35.665881+0000","last_clean":"2024-04-24T13:34:35.665881+0000","last_became_active":"2024-04-24T13:33:08.726022+0000","last_became_peered":"2024-04-24T13:33:08.726022+0000","last_unstale":"2024-04-24T13:34:35.665881+0000","last_undegraded":"2024-04-24T13:34:35.665881+0000","last_fullsized":"2024-04-24T13:34:35.665881+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:53:29.132620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"150'19","reported_seq":87,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670337+0000","last_change":"2024-04-24T13:33:52.755369+0000","last_active":"2024-04-24T13:34:35.670337+0000","last_peered":"2024-04-24T13:34:35.670337+0000","last_clean":"2024-04-24T13:34:35.670337+0000","last_became_active":"2024-04-24T13:33:49.297296+0000","last_became_peered":"2024-04-24T13:33:49.297296+0000","last_unstale":"2024-04-24T13:34:35.670337+0000","last_undegraded":"2024-04-24T13:34:35.670337+0000","last_fullsized":"2024-04-24T13:34:35.670337+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:57.772686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":249,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666168+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:34:35.666168+0000","last_peered":"2024-04-24T13:34:35.666168+0000","last_clean":"2024-04-24T13:34:35.666168+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:34:35.666168+0000","last_undegraded":"2024-04-24T13:34:35.666168+0000","last_fullsized":"2024-04-24T13:34:35.666168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554829+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:34:35.554829+0000","last_peered":"2024-04-24T13:34:35.554829+0000","last_clean":"2024-04-24T13:34:35.554829+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:34:35.554829+0000","last_undegraded":"2024-04-24T13:34:35.554829+0000","last_fullsized":"2024-04-24T13:34:35.554829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"132'4","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525116+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:34:35.525116+0000","last_peered":"2024-04-24T13:34:35.525116+0000","last_clean":"2024-04-24T13:34:35.525116+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:34:35.525116+0000","last_undegraded":"2024-04-24T13:34:35.525116+0000","last_fullsized":"2024-04-24T13:34:35.525116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592641+0000","last_change":"2024-04-24T13:33:08.727739+0000","last_active":"2024-04-24T13:34:34.592641+0000","last_peered":"2024-04-24T13:34:34.592641+0000","last_clean":"2024-04-24T13:34:34.592641+0000","last_became_active":"2024-04-24T13:33:08.727324+0000","last_became_peered":"2024-04-24T13:33:08.727324+0000","last_unstale":"2024-04-24T13:34:34.592641+0000","last_undegraded":"2024-04-24T13:34:34.592641+0000","last_fullsized":"2024-04-24T13:34:34.592641+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:23.918692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"132'22","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590105+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:34:34.590105+0000","last_peered":"2024-04-24T13:34:34.590105+0000","last_clean":"2024-04-24T13:34:34.590105+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:34:34.590105+0000","last_undegraded":"2024-04-24T13:34:34.590105+0000","last_fullsized":"2024-04-24T13:34:34.590105+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.760398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666115+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:34:35.666115+0000","last_peered":"2024-04-24T13:34:35.666115+0000","last_clean":"2024-04-24T13:34:35.666115+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:34:35.666115+0000","last_undegraded":"2024-04-24T13:34:35.666115+0000","last_fullsized":"2024-04-24T13:34:35.666115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":272,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.553929+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:34:35.553929+0000","last_peered":"2024-04-24T13:34:35.553929+0000","last_clean":"2024-04-24T13:34:35.553929+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:34:35.553929+0000","last_undegraded":"2024-04-24T13:34:35.553929+0000","last_fullsized":"2024-04-24T13:34:35.553929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671288+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:34:35.671288+0000","last_peered":"2024-04-24T13:34:35.671288+0000","last_clean":"2024-04-24T13:34:35.671288+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:34:35.671288+0000","last_undegraded":"2024-04-24T13:34:35.671288+0000","last_fullsized":"2024-04-24T13:34:35.671288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"81'4","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594411+0000","last_change":"2024-04-24T13:33:09.289060+0000","last_active":"2024-04-24T13:34:34.594411+0000","last_peered":"2024-04-24T13:34:34.594411+0000","last_clean":"2024-04-24T13:34:34.594411+0000","last_became_active":"2024-04-24T13:33:08.717929+0000","last_became_peered":"2024-04-24T13:33:08.717929+0000","last_unstale":"2024-04-24T13:34:34.594411+0000","last_undegraded":"2024-04-24T13:34:34.594411+0000","last_fullsized":"2024-04-24T13:34:34.594411+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:36.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528047+0000","last_change":"2024-04-24T13:33:08.738475+0000","last_active":"2024-04-24T13:34:35.528047+0000","last_peered":"2024-04-24T13:34:35.528047+0000","last_clean":"2024-04-24T13:34:35.528047+0000","last_became_active":"2024-04-24T13:33:08.738109+0000","last_became_peered":"2024-04-24T13:33:08.738109+0000","last_unstale":"2024-04-24T13:34:35.528047+0000","last_undegraded":"2024-04-24T13:34:35.528047+0000","last_fullsized":"2024-04-24T13:34:35.528047+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:14:49.386651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"132'27","reported_seq":137,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594648+0000","last_change":"2024-04-24T13:33:10.091580+0000","last_active":"2024-04-24T13:34:34.594648+0000","last_peered":"2024-04-24T13:34:34.594648+0000","last_clean":"2024-04-24T13:34:34.594648+0000","last_became_active":"2024-04-24T13:33:08.716808+0000","last_became_peered":"2024-04-24T13:33:08.716808+0000","last_unstale":"2024-04-24T13:34:34.594648+0000","last_undegraded":"2024-04-24T13:34:34.594648+0000","last_fullsized":"2024-04-24T13:34:34.594648+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:05:06.347329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525373+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:34:35.525373+0000","last_peered":"2024-04-24T13:34:35.525373+0000","last_clean":"2024-04-24T13:34:35.525373+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:34:35.525373+0000","last_undegraded":"2024-04-24T13:34:35.525373+0000","last_fullsized":"2024-04-24T13:34:35.525373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666247+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:34:35.666247+0000","last_peered":"2024-04-24T13:34:35.666247+0000","last_clean":"2024-04-24T13:34:35.666247+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:34:35.666247+0000","last_undegraded":"2024-04-24T13:34:35.666247+0000","last_fullsized":"2024-04-24T13:34:35.666247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"132'34","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664648+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:34:35.664648+0000","last_peered":"2024-04-24T13:34:35.664648+0000","last_clean":"2024-04-24T13:34:35.664648+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:34:35.664648+0000","last_undegraded":"2024-04-24T13:34:35.664648+0000","last_fullsized":"2024-04-24T13:34:35.664648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":249,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589043+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:34:34.589043+0000","last_peered":"2024-04-24T13:34:34.589043+0000","last_clean":"2024-04-24T13:34:34.589043+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:34:34.589043+0000","last_undegraded":"2024-04-24T13:34:34.589043+0000","last_fullsized":"2024-04-24T13:34:34.589043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667952+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:34:35.667952+0000","last_peered":"2024-04-24T13:34:35.667952+0000","last_clean":"2024-04-24T13:34:35.667952+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:34:35.667952+0000","last_undegraded":"2024-04-24T13:34:35.667952+0000","last_fullsized":"2024-04-24T13:34:35.667952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"114'18","reported_seq":351,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666556+0000","last_change":"2024-04-24T13:33:09.335136+0000","last_active":"2024-04-24T13:34:35.666556+0000","last_peered":"2024-04-24T13:34:35.666556+0000","last_clean":"2024-04-24T13:34:35.666556+0000","last_became_active":"2024-04-24T13:33:08.705853+0000","last_became_peered":"2024-04-24T13:33:08.705853+0000","last_unstale":"2024-04-24T13:34:35.666556+0000","last_undegraded":"2024-04-24T13:34:35.666556+0000","last_fullsized":"2024-04-24T13:34:35.666556+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:53.758485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":86,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"132'14","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525205+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:34:35.525205+0000","last_peered":"2024-04-24T13:34:35.525205+0000","last_clean":"2024-04-24T13:34:35.525205+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:34:35.525205+0000","last_undegraded":"2024-04-24T13:34:35.525205+0000","last_fullsized":"2024-04-24T13:34:35.525205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669917+0000","last_change":"2024-04-24T13:33:49.288345+0000","last_active":"2024-04-24T13:34:35.669917+0000","last_peered":"2024-04-24T13:34:35.669917+0000","last_clean":"2024-04-24T13:34:35.669917+0000","last_became_active":"2024-04-24T13:33:49.287893+0000","last_became_peered":"2024-04-24T13:33:49.287893+0000","last_unstale":"2024-04-24T13:34:35.669917+0000","last_undegraded":"2024-04-24T13:34:35.669917+0000","last_fullsized":"2024-04-24T13:34:35.669917+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:59.559096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667933+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:34:35.667933+0000","last_peered":"2024-04-24T13:34:35.667933+0000","last_clean":"2024-04-24T13:34:35.667933+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:34:35.667933+0000","last_undegraded":"2024-04-24T13:34:35.667933+0000","last_fullsized":"2024-04-24T13:34:35.667933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"105'15","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528699+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:34:35.528699+0000","last_peered":"2024-04-24T13:34:35.528699+0000","last_clean":"2024-04-24T13:34:35.528699+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:34:35.528699+0000","last_undegraded":"2024-04-24T13:34:35.528699+0000","last_fullsized":"2024-04-24T13:34:35.528699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"150'138","reported_seq":351,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529396+0000","last_change":"2024-04-24T13:33:11.712104+0000","last_active":"2024-04-24T13:34:35.529396+0000","last_peered":"2024-04-24T13:34:35.529396+0000","last_clean":"2024-04-24T13:34:35.529396+0000","last_became_active":"2024-04-24T13:33:11.710310+0000","last_became_peered":"2024-04-24T13:33:11.710310+0000","last_unstale":"2024-04-24T13:34:35.529396+0000","last_undegraded":"2024-04-24T13:34:35.529396+0000","last_fullsized":"2024-04-24T13:34:35.529396+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:44.878043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"114'3","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556703+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:34:35.556703+0000","last_peered":"2024-04-24T13:34:35.556703+0000","last_clean":"2024-04-24T13:34:35.556703+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:34:35.556703+0000","last_undegraded":"2024-04-24T13:34:35.556703+0000","last_fullsized":"2024-04-24T13:34:35.556703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"82'2","reported_seq":228,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664673+0000","last_change":"2024-04-24T13:33:49.682866+0000","last_active":"2024-04-24T13:34:35.664673+0000","last_peered":"2024-04-24T13:34:35.664673+0000","last_clean":"2024-04-24T13:34:35.664673+0000","last_became_active":"2024-04-24T13:33:49.296844+0000","last_became_peered":"2024-04-24T13:33:49.296844+0000","last_unstale":"2024-04-24T13:34:35.664673+0000","last_undegraded":"2024-04-24T13:34:35.664673+0000","last_fullsized":"2024-04-24T13:34:35.664673+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:34.675704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"132'24","reported_seq":335,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555654+0000","last_change":"2024-04-24T13:33:51.134298+0000","last_active":"2024-04-24T13:34:35.555654+0000","last_peered":"2024-04-24T13:34:35.555654+0000","last_clean":"2024-04-24T13:34:35.555654+0000","last_became_active":"2024-04-24T13:33:49.300149+0000","last_became_peered":"2024-04-24T13:33:49.300149+0000","last_unstale":"2024-04-24T13:34:35.555654+0000","last_undegraded":"2024-04-24T13:34:35.555654+0000","last_fullsized":"2024-04-24T13:34:35.555654+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:46:34.323602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.531398+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:34:35.531398+0000","last_peered":"2024-04-24T13:34:35.531398+0000","last_clean":"2024-04-24T13:34:35.531398+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:34:35.531398+0000","last_undegraded":"2024-04-24T13:34:35.531398+0000","last_fullsized":"2024-04-24T13:34:35.531398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588762+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:34:34.588762+0000","last_peered":"2024-04-24T13:34:34.588762+0000","last_clean":"2024-04-24T13:34:34.588762+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:34:34.588762+0000","last_undegraded":"2024-04-24T13:34:34.588762+0000","last_fullsized":"2024-04-24T13:34:34.588762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589504+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:34:34.589504+0000","last_peered":"2024-04-24T13:34:34.589504+0000","last_clean":"2024-04-24T13:34:34.589504+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:34:34.589504+0000","last_undegraded":"2024-04-24T13:34:34.589504+0000","last_fullsized":"2024-04-24T13:34:34.589504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"150'135","reported_seq":436,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:40.139335+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:34:40.139335+0000","last_peered":"2024-04-24T13:34:40.139335+0000","last_clean":"2024-04-24T13:34:40.139335+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:34:40.139335+0000","last_undegraded":"2024-04-24T13:34:40.139335+0000","last_fullsized":"2024-04-24T13:34:40.139335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"82'6","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666218+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:34:35.666218+0000","last_peered":"2024-04-24T13:34:35.666218+0000","last_clean":"2024-04-24T13:34:35.666218+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:34:35.666218+0000","last_undegraded":"2024-04-24T13:34:35.666218+0000","last_fullsized":"2024-04-24T13:34:35.666218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"114'6","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588275+0000","last_change":"2024-04-24T13:33:08.753804+0000","last_active":"2024-04-24T13:34:34.588275+0000","last_peered":"2024-04-24T13:34:34.588275+0000","last_clean":"2024-04-24T13:34:34.588275+0000","last_became_active":"2024-04-24T13:33:08.707993+0000","last_became_peered":"2024-04-24T13:33:08.707993+0000","last_unstale":"2024-04-24T13:34:34.588275+0000","last_undegraded":"2024-04-24T13:34:34.588275+0000","last_fullsized":"2024-04-24T13:34:34.588275+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:02.680781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"131'22","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667097+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:34:35.667097+0000","last_peered":"2024-04-24T13:34:35.667097+0000","last_clean":"2024-04-24T13:34:35.667097+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:34:35.667097+0000","last_undegraded":"2024-04-24T13:34:35.667097+0000","last_fullsized":"2024-04-24T13:34:35.667097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671777+0000","last_change":"2024-04-24T13:33:49.289245+0000","last_active":"2024-04-24T13:34:35.671777+0000","last_peered":"2024-04-24T13:34:35.671777+0000","last_clean":"2024-04-24T13:34:35.671777+0000","last_became_active":"2024-04-24T13:33:49.288766+0000","last_became_peered":"2024-04-24T13:33:49.288766+0000","last_unstale":"2024-04-24T13:34:35.671777+0000","last_undegraded":"2024-04-24T13:34:35.671777+0000","last_fullsized":"2024-04-24T13:34:35.671777+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:02:54.620974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554544+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:34:35.554544+0000","last_peered":"2024-04-24T13:34:35.554544+0000","last_clean":"2024-04-24T13:34:35.554544+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:34:35.554544+0000","last_undegraded":"2024-04-24T13:34:35.554544+0000","last_fullsized":"2024-04-24T13:34:35.554544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"132'43","reported_seq":78,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669147+0000","last_change":"2024-04-24T13:33:52.712739+0000","last_active":"2024-04-24T13:34:35.669147+0000","last_peered":"2024-04-24T13:34:35.669147+0000","last_clean":"2024-04-24T13:34:35.669147+0000","last_became_active":"2024-04-24T13:33:49.295935+0000","last_became_peered":"2024-04-24T13:33:49.295935+0000","last_unstale":"2024-04-24T13:34:35.669147+0000","last_undegraded":"2024-04-24T13:34:35.669147+0000","last_fullsized":"2024-04-24T13:34:35.669147+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:52.132391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554197+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:34:35.554197+0000","last_peered":"2024-04-24T13:34:35.554197+0000","last_clean":"2024-04-24T13:34:35.554197+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:34:35.554197+0000","last_undegraded":"2024-04-24T13:34:35.554197+0000","last_fullsized":"2024-04-24T13:34:35.554197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"105'6","reported_seq":120,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594807+0000","last_change":"2024-04-24T13:33:51.141865+0000","last_active":"2024-04-24T13:34:34.594807+0000","last_peered":"2024-04-24T13:34:34.594807+0000","last_clean":"2024-04-24T13:34:34.594807+0000","last_became_active":"2024-04-24T13:33:49.289035+0000","last_became_peered":"2024-04-24T13:33:49.289035+0000","last_unstale":"2024-04-24T13:34:34.594807+0000","last_undegraded":"2024-04-24T13:34:34.594807+0000","last_fullsized":"2024-04-24T13:34:34.594807+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:08:46.400784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"82'2","reported_seq":263,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667857+0000","last_change":"2024-04-24T13:33:09.076639+0000","last_active":"2024-04-24T13:34:35.667857+0000","last_peered":"2024-04-24T13:34:35.667857+0000","last_clean":"2024-04-24T13:34:35.667857+0000","last_became_active":"2024-04-24T13:33:08.705821+0000","last_became_peered":"2024-04-24T13:33:08.705821+0000","last_unstale":"2024-04-24T13:34:35.667857+0000","last_undegraded":"2024-04-24T13:34:35.667857+0000","last_fullsized":"2024-04-24T13:34:35.667857+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:07:09.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589501+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:34:34.589501+0000","last_peered":"2024-04-24T13:34:34.589501+0000","last_clean":"2024-04-24T13:34:34.589501+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:34:34.589501+0000","last_undegraded":"2024-04-24T13:34:34.589501+0000","last_fullsized":"2024-04-24T13:34:34.589501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"132'33","reported_seq":298,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665221+0000","last_change":"2024-04-24T13:33:50.684508+0000","last_active":"2024-04-24T13:34:35.665221+0000","last_peered":"2024-04-24T13:34:35.665221+0000","last_clean":"2024-04-24T13:34:35.665221+0000","last_became_active":"2024-04-24T13:33:49.297002+0000","last_became_peered":"2024-04-24T13:33:49.297002+0000","last_unstale":"2024-04-24T13:34:35.665221+0000","last_undegraded":"2024-04-24T13:34:35.665221+0000","last_fullsized":"2024-04-24T13:34:35.665221+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:05.604339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":366,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528124+0000","last_change":"2024-04-24T13:33:09.553473+0000","last_active":"2024-04-24T13:34:35.528124+0000","last_peered":"2024-04-24T13:34:35.528124+0000","last_clean":"2024-04-24T13:34:35.528124+0000","last_became_active":"2024-04-24T13:33:08.738276+0000","last_became_peered":"2024-04-24T13:33:08.738276+0000","last_unstale":"2024-04-24T13:34:35.528124+0000","last_undegraded":"2024-04-24T13:34:35.528124+0000","last_fullsized":"2024-04-24T13:34:35.528124+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:44.215595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"132'20","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554042+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:34:35.554042+0000","last_peered":"2024-04-24T13:34:35.554042+0000","last_clean":"2024-04-24T13:34:35.554042+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:34:35.554042+0000","last_undegraded":"2024-04-24T13:34:35.554042+0000","last_fullsized":"2024-04-24T13:34:35.554042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554671+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:34:35.554671+0000","last_peered":"2024-04-24T13:34:35.554671+0000","last_clean":"2024-04-24T13:34:35.554671+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:34:35.554671+0000","last_undegraded":"2024-04-24T13:34:35.554671+0000","last_fullsized":"2024-04-24T13:34:35.554671+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555930+0000","last_change":"2024-04-24T13:33:49.302711+0000","last_active":"2024-04-24T13:34:35.555930+0000","last_peered":"2024-04-24T13:34:35.555930+0000","last_clean":"2024-04-24T13:34:35.555930+0000","last_became_active":"2024-04-24T13:33:49.302201+0000","last_became_peered":"2024-04-24T13:33:49.302201+0000","last_unstale":"2024-04-24T13:34:35.555930+0000","last_undegraded":"2024-04-24T13:34:35.555930+0000","last_fullsized":"2024-04-24T13:34:35.555930+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:21.125833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.527964+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:34:35.527964+0000","last_peered":"2024-04-24T13:34:35.527964+0000","last_clean":"2024-04-24T13:34:35.527964+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:34:35.527964+0000","last_undegraded":"2024-04-24T13:34:35.527964+0000","last_fullsized":"2024-04-24T13:34:35.527964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"132'20","reported_seq":88,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669042+0000","last_change":"2024-04-24T13:33:53.881731+0000","last_active":"2024-04-24T13:34:35.669042+0000","last_peered":"2024-04-24T13:34:35.669042+0000","last_clean":"2024-04-24T13:34:35.669042+0000","last_became_active":"2024-04-24T13:33:49.299864+0000","last_became_peered":"2024-04-24T13:33:49.299864+0000","last_unstale":"2024-04-24T13:34:35.669042+0000","last_undegraded":"2024-04-24T13:34:35.669042+0000","last_fullsized":"2024-04-24T13:34:35.669042+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:31.093323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554746+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:34:35.554746+0000","last_peered":"2024-04-24T13:34:35.554746+0000","last_clean":"2024-04-24T13:34:35.554746+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:34:35.554746+0000","last_undegraded":"2024-04-24T13:34:35.554746+0000","last_fullsized":"2024-04-24T13:34:35.554746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"132'9","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664756+0000","last_change":"2024-04-24T13:33:09.548972+0000","last_active":"2024-04-24T13:34:35.664756+0000","last_peered":"2024-04-24T13:34:35.664756+0000","last_clean":"2024-04-24T13:34:35.664756+0000","last_became_active":"2024-04-24T13:33:08.721855+0000","last_became_peered":"2024-04-24T13:33:08.721855+0000","last_unstale":"2024-04-24T13:34:35.664756+0000","last_undegraded":"2024-04-24T13:34:35.664756+0000","last_fullsized":"2024-04-24T13:34:35.664756+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:12.936976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669578+0000","last_change":"2024-04-24T13:33:49.302936+0000","last_active":"2024-04-24T13:34:35.669578+0000","last_peered":"2024-04-24T13:34:35.669578+0000","last_clean":"2024-04-24T13:34:35.669578+0000","last_became_active":"2024-04-24T13:33:49.297478+0000","last_became_peered":"2024-04-24T13:33:49.297478+0000","last_unstale":"2024-04-24T13:34:35.669578+0000","last_undegraded":"2024-04-24T13:34:35.669578+0000","last_fullsized":"2024-04-24T13:34:35.669578+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:39.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"132'6","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665975+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:34:35.665975+0000","last_peered":"2024-04-24T13:34:35.665975+0000","last_clean":"2024-04-24T13:34:35.665975+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:34:35.665975+0000","last_undegraded":"2024-04-24T13:34:35.665975+0000","last_fullsized":"2024-04-24T13:34:35.665975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"82'4","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554406+0000","last_change":"2024-04-24T13:33:49.688460+0000","last_active":"2024-04-24T13:34:35.554406+0000","last_peered":"2024-04-24T13:34:35.554406+0000","last_clean":"2024-04-24T13:34:35.554406+0000","last_became_active":"2024-04-24T13:33:49.292866+0000","last_became_peered":"2024-04-24T13:33:49.292866+0000","last_unstale":"2024-04-24T13:34:35.554406+0000","last_undegraded":"2024-04-24T13:34:35.554406+0000","last_fullsized":"2024-04-24T13:34:35.554406+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:38.839177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"131'22","reported_seq":172,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595276+0000","last_change":"2024-04-24T13:33:52.207013+0000","last_active":"2024-04-24T13:34:34.595276+0000","last_peered":"2024-04-24T13:34:34.595276+0000","last_clean":"2024-04-24T13:34:34.595276+0000","last_became_active":"2024-04-24T13:33:49.289650+0000","last_became_peered":"2024-04-24T13:33:49.289650+0000","last_unstale":"2024-04-24T13:34:34.595276+0000","last_undegraded":"2024-04-24T13:34:34.595276+0000","last_fullsized":"2024-04-24T13:34:34.595276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:15:45.985778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667585+0000","last_change":"2024-04-24T13:33:49.283767+0000","last_active":"2024-04-24T13:34:35.667585+0000","last_peered":"2024-04-24T13:34:35.667585+0000","last_clean":"2024-04-24T13:34:35.667585+0000","last_became_active":"2024-04-24T13:33:49.283342+0000","last_became_peered":"2024-04-24T13:33:49.283342+0000","last_unstale":"2024-04-24T13:34:35.667585+0000","last_undegraded":"2024-04-24T13:34:35.667585+0000","last_fullsized":"2024-04-24T13:34:35.667585+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:36.682746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"132'20","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554550+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:34:35.554550+0000","last_peered":"2024-04-24T13:34:35.554550+0000","last_clean":"2024-04-24T13:34:35.554550+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:34:35.554550+0000","last_undegraded":"2024-04-24T13:34:35.554550+0000","last_fullsized":"2024-04-24T13:34:35.554550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668177+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:34:35.668177+0000","last_peered":"2024-04-24T13:34:35.668177+0000","last_clean":"2024-04-24T13:34:35.668177+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:34:35.668177+0000","last_undegraded":"2024-04-24T13:34:35.668177+0000","last_fullsized":"2024-04-24T13:34:35.668177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"114'4","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594405+0000","last_change":"2024-04-24T13:33:50.241765+0000","last_active":"2024-04-24T13:34:34.594405+0000","last_peered":"2024-04-24T13:34:34.594405+0000","last_clean":"2024-04-24T13:34:34.594405+0000","last_became_active":"2024-04-24T13:33:49.288852+0000","last_became_peered":"2024-04-24T13:33:49.288852+0000","last_unstale":"2024-04-24T13:34:34.594405+0000","last_undegraded":"2024-04-24T13:34:34.594405+0000","last_fullsized":"2024-04-24T13:34:34.594405+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:53:23.401847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554397+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:34:35.554397+0000","last_peered":"2024-04-24T13:34:35.554397+0000","last_clean":"2024-04-24T13:34:35.554397+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:34:35.554397+0000","last_undegraded":"2024-04-24T13:34:35.554397+0000","last_fullsized":"2024-04-24T13:34:35.554397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"132'20","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668126+0000","last_change":"2024-04-24T13:33:09.773703+0000","last_active":"2024-04-24T13:34:35.668126+0000","last_peered":"2024-04-24T13:34:35.668126+0000","last_clean":"2024-04-24T13:34:35.668126+0000","last_became_active":"2024-04-24T13:33:08.722546+0000","last_became_peered":"2024-04-24T13:33:08.722546+0000","last_unstale":"2024-04-24T13:34:35.668126+0000","last_undegraded":"2024-04-24T13:34:35.668126+0000","last_fullsized":"2024-04-24T13:34:35.668126+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:26.369698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667888+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:34:35.667888+0000","last_peered":"2024-04-24T13:34:35.667888+0000","last_clean":"2024-04-24T13:34:35.667888+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:34:35.667888+0000","last_undegraded":"2024-04-24T13:34:35.667888+0000","last_fullsized":"2024-04-24T13:34:35.667888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"132'18","reported_seq":68,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668570+0000","last_change":"2024-04-24T13:33:52.735528+0000","last_active":"2024-04-24T13:34:35.668570+0000","last_peered":"2024-04-24T13:34:35.668570+0000","last_clean":"2024-04-24T13:34:35.668570+0000","last_became_active":"2024-04-24T13:33:49.297667+0000","last_became_peered":"2024-04-24T13:33:49.297667+0000","last_unstale":"2024-04-24T13:34:35.668570+0000","last_undegraded":"2024-04-24T13:34:35.668570+0000","last_fullsized":"2024-04-24T13:34:35.668570+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:07:05.200322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665270+0000","last_change":"2024-04-24T13:33:49.286645+0000","last_active":"2024-04-24T13:34:35.665270+0000","last_peered":"2024-04-24T13:34:35.665270+0000","last_clean":"2024-04-24T13:34:35.665270+0000","last_became_active":"2024-04-24T13:33:49.285495+0000","last_became_peered":"2024-04-24T13:33:49.285495+0000","last_unstale":"2024-04-24T13:34:35.665270+0000","last_undegraded":"2024-04-24T13:34:35.665270+0000","last_fullsized":"2024-04-24T13:34:35.665270+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:19.867685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"82'8","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671651+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:34:35.671651+0000","last_peered":"2024-04-24T13:34:35.671651+0000","last_clean":"2024-04-24T13:34:35.671651+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:34:35.671651+0000","last_undegraded":"2024-04-24T13:34:35.671651+0000","last_fullsized":"2024-04-24T13:34:35.671651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"131'27","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554147+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:34:35.554147+0000","last_peered":"2024-04-24T13:34:35.554147+0000","last_clean":"2024-04-24T13:34:35.554147+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:34:35.554147+0000","last_undegraded":"2024-04-24T13:34:35.554147+0000","last_fullsized":"2024-04-24T13:34:35.554147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667626+0000","last_change":"2024-04-24T13:33:49.296871+0000","last_active":"2024-04-24T13:34:35.667626+0000","last_peered":"2024-04-24T13:34:35.667626+0000","last_clean":"2024-04-24T13:34:35.667626+0000","last_became_active":"2024-04-24T13:33:49.295933+0000","last_became_peered":"2024-04-24T13:33:49.295933+0000","last_unstale":"2024-04-24T13:34:35.667626+0000","last_undegraded":"2024-04-24T13:34:35.667626+0000","last_fullsized":"2024-04-24T13:34:35.667626+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:48:25.451061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"132'29","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525465+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:34:35.525465+0000","last_peered":"2024-04-24T13:34:35.525465+0000","last_clean":"2024-04-24T13:34:35.525465+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:34:35.525465+0000","last_undegraded":"2024-04-24T13:34:35.525465+0000","last_fullsized":"2024-04-24T13:34:35.525465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62357,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594350+0000","last_change":"2024-04-24T13:33:08.717844+0000","last_active":"2024-04-24T13:34:34.594350+0000","last_peered":"2024-04-24T13:34:34.594350+0000","last_clean":"2024-04-24T13:34:34.594350+0000","last_became_active":"2024-04-24T13:33:08.716627+0000","last_became_peered":"2024-04-24T13:33:08.716627+0000","last_unstale":"2024-04-24T13:34:34.594350+0000","last_undegraded":"2024-04-24T13:34:34.594350+0000","last_fullsized":"2024-04-24T13:34:34.594350+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:43.447785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554266+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:34:35.554266+0000","last_peered":"2024-04-24T13:34:35.554266+0000","last_clean":"2024-04-24T13:34:35.554266+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:34:35.554266+0000","last_undegraded":"2024-04-24T13:34:35.554266+0000","last_fullsized":"2024-04-24T13:34:35.554266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"114'10","reported_seq":324,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667496+0000","last_change":"2024-04-24T13:33:50.254858+0000","last_active":"2024-04-24T13:34:35.667496+0000","last_peered":"2024-04-24T13:34:35.667496+0000","last_clean":"2024-04-24T13:34:35.667496+0000","last_became_active":"2024-04-24T13:33:49.285680+0000","last_became_peered":"2024-04-24T13:33:49.285680+0000","last_unstale":"2024-04-24T13:34:35.667496+0000","last_undegraded":"2024-04-24T13:34:35.667496+0000","last_fullsized":"2024-04-24T13:34:35.667496+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:13.081256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"132'20","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529452+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:34:35.529452+0000","last_peered":"2024-04-24T13:34:35.529452+0000","last_clean":"2024-04-24T13:34:35.529452+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:34:35.529452+0000","last_undegraded":"2024-04-24T13:34:35.529452+0000","last_fullsized":"2024-04-24T13:34:35.529452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671404+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:34:35.671404+0000","last_peered":"2024-04-24T13:34:35.671404+0000","last_clean":"2024-04-24T13:34:35.671404+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:34:35.671404+0000","last_undegraded":"2024-04-24T13:34:35.671404+0000","last_fullsized":"2024-04-24T13:34:35.671404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"132'23","reported_seq":74,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669198+0000","last_change":"2024-04-24T13:33:51.826433+0000","last_active":"2024-04-24T13:34:35.669198+0000","last_peered":"2024-04-24T13:34:35.669198+0000","last_clean":"2024-04-24T13:34:35.669198+0000","last_became_active":"2024-04-24T13:33:49.291994+0000","last_became_peered":"2024-04-24T13:33:49.291994+0000","last_unstale":"2024-04-24T13:34:35.669198+0000","last_undegraded":"2024-04-24T13:34:35.669198+0000","last_fullsized":"2024-04-24T13:34:35.669198+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:35.992700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525691+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:34:35.525691+0000","last_peered":"2024-04-24T13:34:35.525691+0000","last_clean":"2024-04-24T13:34:35.525691+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:34:35.525691+0000","last_undegraded":"2024-04-24T13:34:35.525691+0000","last_fullsized":"2024-04-24T13:34:35.525691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669486+0000","last_change":"2024-04-24T13:33:49.289138+0000","last_active":"2024-04-24T13:34:35.669486+0000","last_peered":"2024-04-24T13:34:35.669486+0000","last_clean":"2024-04-24T13:34:35.669486+0000","last_became_active":"2024-04-24T13:33:49.288760+0000","last_became_peered":"2024-04-24T13:33:49.288760+0000","last_unstale":"2024-04-24T13:34:35.669486+0000","last_undegraded":"2024-04-24T13:34:35.669486+0000","last_fullsized":"2024-04-24T13:34:35.669486+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:12:25.409700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554342+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:34:35.554342+0000","last_peered":"2024-04-24T13:34:35.554342+0000","last_clean":"2024-04-24T13:34:35.554342+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:34:35.554342+0000","last_undegraded":"2024-04-24T13:34:35.554342+0000","last_fullsized":"2024-04-24T13:34:35.554342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"132'17","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589695+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:34:34.589695+0000","last_peered":"2024-04-24T13:34:34.589695+0000","last_clean":"2024-04-24T13:34:34.589695+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:34:34.589695+0000","last_undegraded":"2024-04-24T13:34:34.589695+0000","last_fullsized":"2024-04-24T13:34:34.589695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590976+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:34:34.590976+0000","last_peered":"2024-04-24T13:34:34.590976+0000","last_clean":"2024-04-24T13:34:34.590976+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:34:34.590976+0000","last_undegraded":"2024-04-24T13:34:34.590976+0000","last_fullsized":"2024-04-24T13:34:34.590976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"132'20","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556866+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:34:35.556866+0000","last_peered":"2024-04-24T13:34:35.556866+0000","last_clean":"2024-04-24T13:34:35.556866+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:34:35.556866+0000","last_undegraded":"2024-04-24T13:34:35.556866+0000","last_fullsized":"2024-04-24T13:34:35.556866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.526370+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:34:35.526370+0000","last_peered":"2024-04-24T13:34:35.526370+0000","last_clean":"2024-04-24T13:34:35.526370+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:34:35.526370+0000","last_undegraded":"2024-04-24T13:34:35.526370+0000","last_fullsized":"2024-04-24T13:34:35.526370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592796+0000","last_change":"2024-04-24T13:33:49.289867+0000","last_active":"2024-04-24T13:34:34.592796+0000","last_peered":"2024-04-24T13:34:34.592796+0000","last_clean":"2024-04-24T13:34:34.592796+0000","last_became_active":"2024-04-24T13:33:49.289412+0000","last_became_peered":"2024-04-24T13:33:49.289412+0000","last_unstale":"2024-04-24T13:34:34.592796+0000","last_undegraded":"2024-04-24T13:34:34.592796+0000","last_fullsized":"2024-04-24T13:34:34.592796+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:24:50.051036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"114'2","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665605+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:34:35.665605+0000","last_peered":"2024-04-24T13:34:35.665605+0000","last_clean":"2024-04-24T13:34:35.665605+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:34:35.665605+0000","last_undegraded":"2024-04-24T13:34:35.665605+0000","last_fullsized":"2024-04-24T13:34:35.665605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"131'28","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665975+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:34:35.665975+0000","last_peered":"2024-04-24T13:34:35.665975+0000","last_clean":"2024-04-24T13:34:35.665975+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:34:35.665975+0000","last_undegraded":"2024-04-24T13:34:35.665975+0000","last_fullsized":"2024-04-24T13:34:35.665975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525943+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:34:35.525943+0000","last_peered":"2024-04-24T13:34:35.525943+0000","last_clean":"2024-04-24T13:34:35.525943+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:34:35.525943+0000","last_undegraded":"2024-04-24T13:34:35.525943+0000","last_fullsized":"2024-04-24T13:34:35.525943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590834+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:34:34.590834+0000","last_peered":"2024-04-24T13:34:34.590834+0000","last_clean":"2024-04-24T13:34:34.590834+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:34:34.590834+0000","last_undegraded":"2024-04-24T13:34:34.590834+0000","last_fullsized":"2024-04-24T13:34:34.590834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"150'135","reported_seq":432,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:40.124551+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:34:40.124551+0000","last_peered":"2024-04-24T13:34:40.124551+0000","last_clean":"2024-04-24T13:34:40.124551+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:34:40.124551+0000","last_undegraded":"2024-04-24T13:34:40.124551+0000","last_fullsized":"2024-04-24T13:34:40.124551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"82'6","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670479+0000","last_change":"2024-04-24T13:33:50.541311+0000","last_active":"2024-04-24T13:34:35.670479+0000","last_peered":"2024-04-24T13:34:35.670479+0000","last_clean":"2024-04-24T13:34:35.670479+0000","last_became_active":"2024-04-24T13:33:49.285594+0000","last_became_peered":"2024-04-24T13:33:49.285594+0000","last_unstale":"2024-04-24T13:34:35.670479+0000","last_undegraded":"2024-04-24T13:34:35.670479+0000","last_fullsized":"2024-04-24T13:34:35.670479+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:45.453497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"86'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589448+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:34:34.589448+0000","last_peered":"2024-04-24T13:34:34.589448+0000","last_clean":"2024-04-24T13:34:34.589448+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:34:34.589448+0000","last_undegraded":"2024-04-24T13:34:34.589448+0000","last_fullsized":"2024-04-24T13:34:34.589448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"131'28","reported_seq":143,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591594+0000","last_change":"2024-04-24T13:33:09.116807+0000","last_active":"2024-04-24T13:34:34.591594+0000","last_peered":"2024-04-24T13:34:34.591594+0000","last_clean":"2024-04-24T13:34:34.591594+0000","last_became_active":"2024-04-24T13:33:08.708911+0000","last_became_peered":"2024-04-24T13:33:08.708911+0000","last_unstale":"2024-04-24T13:34:34.591594+0000","last_undegraded":"2024-04-24T13:34:34.591594+0000","last_fullsized":"2024-04-24T13:34:34.591594+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:59.171558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":108544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669046+0000","last_change":"2024-04-24T13:33:49.283103+0000","last_active":"2024-04-24T13:34:35.669046+0000","last_peered":"2024-04-24T13:34:35.669046+0000","last_clean":"2024-04-24T13:34:35.669046+0000","last_became_active":"2024-04-24T13:33:49.282772+0000","last_became_peered":"2024-04-24T13:33:49.282772+0000","last_unstale":"2024-04-24T13:34:35.669046+0000","last_undegraded":"2024-04-24T13:34:35.669046+0000","last_fullsized":"2024-04-24T13:34:35.669046+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:44.215595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"132'25","reported_seq":121,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591993+0000","last_change":"2024-04-24T13:33:09.934600+0000","last_active":"2024-04-24T13:34:34.591993+0000","last_peered":"2024-04-24T13:34:34.591993+0000","last_clean":"2024-04-24T13:34:34.591993+0000","last_became_active":"2024-04-24T13:33:08.732254+0000","last_became_peered":"2024-04-24T13:33:08.732254+0000","last_unstale":"2024-04-24T13:34:34.591993+0000","last_undegraded":"2024-04-24T13:34:34.591993+0000","last_fullsized":"2024-04-24T13:34:34.591993+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:35.846866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664957+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:34:35.664957+0000","last_peered":"2024-04-24T13:34:35.664957+0000","last_clean":"2024-04-24T13:34:35.664957+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:34:35.664957+0000","last_undegraded":"2024-04-24T13:34:35.664957+0000","last_fullsized":"2024-04-24T13:34:35.664957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670236+0000","last_change":"2024-04-24T13:33:49.295971+0000","last_active":"2024-04-24T13:34:35.670236+0000","last_peered":"2024-04-24T13:34:35.670236+0000","last_clean":"2024-04-24T13:34:35.670236+0000","last_became_active":"2024-04-24T13:33:49.294486+0000","last_became_peered":"2024-04-24T13:33:49.294486+0000","last_unstale":"2024-04-24T13:34:35.670236+0000","last_undegraded":"2024-04-24T13:34:35.670236+0000","last_fullsized":"2024-04-24T13:34:35.670236+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:53:43.527494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"105'6","reported_seq":147,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667474+0000","last_change":"2024-04-24T13:32:32.751387+0000","last_active":"2024-04-24T13:34:35.667474+0000","last_peered":"2024-04-24T13:34:35.667474+0000","last_clean":"2024-04-24T13:34:35.667474+0000","last_became_active":"2024-04-24T13:32:32.741990+0000","last_became_peered":"2024-04-24T13:32:32.741990+0000","last_unstale":"2024-04-24T13:34:35.667474+0000","last_undegraded":"2024-04-24T13:34:35.667474+0000","last_fullsized":"2024-04-24T13:34:35.667474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:49.789798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"131'23","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595783+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:34:34.595783+0000","last_peered":"2024-04-24T13:34:34.595783+0000","last_clean":"2024-04-24T13:34:34.595783+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:34:34.595783+0000","last_undegraded":"2024-04-24T13:34:34.595783+0000","last_fullsized":"2024-04-24T13:34:34.595783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593550+0000","last_change":"2024-04-24T13:33:08.705125+0000","last_active":"2024-04-24T13:34:34.593550+0000","last_peered":"2024-04-24T13:34:34.593550+0000","last_clean":"2024-04-24T13:34:34.593550+0000","last_became_active":"2024-04-24T13:33:08.704735+0000","last_became_peered":"2024-04-24T13:33:08.704735+0000","last_unstale":"2024-04-24T13:34:34.593550+0000","last_undegraded":"2024-04-24T13:34:34.593550+0000","last_fullsized":"2024-04-24T13:34:34.593550+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:14.183681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"132'18","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664908+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:34:35.664908+0000","last_peered":"2024-04-24T13:34:35.664908+0000","last_clean":"2024-04-24T13:34:35.664908+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:34:35.664908+0000","last_undegraded":"2024-04-24T13:34:35.664908+0000","last_fullsized":"2024-04-24T13:34:35.664908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667249+0000","last_change":"2024-04-24T13:33:49.289409+0000","last_active":"2024-04-24T13:34:35.667249+0000","last_peered":"2024-04-24T13:34:35.667249+0000","last_clean":"2024-04-24T13:34:35.667249+0000","last_became_active":"2024-04-24T13:33:49.288970+0000","last_became_peered":"2024-04-24T13:33:49.288970+0000","last_unstale":"2024-04-24T13:34:35.667249+0000","last_undegraded":"2024-04-24T13:34:35.667249+0000","last_fullsized":"2024-04-24T13:34:35.667249+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:39.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556026+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:34:35.556026+0000","last_peered":"2024-04-24T13:34:35.556026+0000","last_clean":"2024-04-24T13:34:35.556026+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:34:35.556026+0000","last_undegraded":"2024-04-24T13:34:35.556026+0000","last_fullsized":"2024-04-24T13:34:35.556026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"105'10","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592552+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:34:34.592552+0000","last_peered":"2024-04-24T13:34:34.592552+0000","last_clean":"2024-04-24T13:34:34.592552+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:34:34.592552+0000","last_undegraded":"2024-04-24T13:34:34.592552+0000","last_fullsized":"2024-04-24T13:34:34.592552+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"131'19","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556282+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:34:35.556282+0000","last_peered":"2024-04-24T13:34:35.556282+0000","last_clean":"2024-04-24T13:34:35.556282+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:34:35.556282+0000","last_undegraded":"2024-04-24T13:34:35.556282+0000","last_fullsized":"2024-04-24T13:34:35.556282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587731+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:34:34.587731+0000","last_peered":"2024-04-24T13:34:34.587731+0000","last_clean":"2024-04-24T13:34:34.587731+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:34:34.587731+0000","last_undegraded":"2024-04-24T13:34:34.587731+0000","last_fullsized":"2024-04-24T13:34:34.587731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"132'13","reported_seq":181,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665742+0000","last_change":"2024-04-24T13:33:51.167111+0000","last_active":"2024-04-24T13:34:35.665742+0000","last_peered":"2024-04-24T13:34:35.665742+0000","last_clean":"2024-04-24T13:34:35.665742+0000","last_became_active":"2024-04-24T13:33:49.302159+0000","last_became_peered":"2024-04-24T13:33:49.302159+0000","last_unstale":"2024-04-24T13:34:35.665742+0000","last_undegraded":"2024-04-24T13:34:35.665742+0000","last_fullsized":"2024-04-24T13:34:35.665742+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:21.719835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588137+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:34:34.588137+0000","last_peered":"2024-04-24T13:34:34.588137+0000","last_clean":"2024-04-24T13:34:34.588137+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:34:34.588137+0000","last_undegraded":"2024-04-24T13:34:34.588137+0000","last_fullsized":"2024-04-24T13:34:34.588137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"82'2","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670276+0000","last_change":"2024-04-24T13:33:54.657281+0000","last_active":"2024-04-24T13:34:35.670276+0000","last_peered":"2024-04-24T13:34:35.670276+0000","last_clean":"2024-04-24T13:34:35.670276+0000","last_became_active":"2024-04-24T13:33:49.303239+0000","last_became_peered":"2024-04-24T13:33:49.303239+0000","last_unstale":"2024-04-24T13:34:35.670276+0000","last_undegraded":"2024-04-24T13:34:35.670276+0000","last_fullsized":"2024-04-24T13:34:35.670276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:32.797578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"82'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588230+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:34:34.588230+0000","last_peered":"2024-04-24T13:34:34.588230+0000","last_clean":"2024-04-24T13:34:34.588230+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:34:34.588230+0000","last_undegraded":"2024-04-24T13:34:34.588230+0000","last_fullsized":"2024-04-24T13:34:34.588230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"131'21","reported_seq":193,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665984+0000","last_change":"2024-04-24T13:33:09.073468+0000","last_active":"2024-04-24T13:34:35.665984+0000","last_peered":"2024-04-24T13:34:35.665984+0000","last_clean":"2024-04-24T13:34:35.665984+0000","last_became_active":"2024-04-24T13:33:08.725822+0000","last_became_peered":"2024-04-24T13:33:08.725822+0000","last_unstale":"2024-04-24T13:34:35.665984+0000","last_undegraded":"2024-04-24T13:34:35.665984+0000","last_fullsized":"2024-04-24T13:34:35.665984+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:24:41.185601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528798+0000","last_change":"2024-04-24T13:33:09.078708+0000","last_active":"2024-04-24T13:34:35.528798+0000","last_peered":"2024-04-24T13:34:35.528798+0000","last_clean":"2024-04-24T13:34:35.528798+0000","last_became_active":"2024-04-24T13:33:08.726873+0000","last_became_peered":"2024-04-24T13:33:08.726873+0000","last_unstale":"2024-04-24T13:34:35.528798+0000","last_undegraded":"2024-04-24T13:34:35.528798+0000","last_fullsized":"2024-04-24T13:34:35.528798+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:53:23.482374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"132'17","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588566+0000","last_change":"2024-04-24T13:33:09.087185+0000","last_active":"2024-04-24T13:34:34.588566+0000","last_peered":"2024-04-24T13:34:34.588566+0000","last_clean":"2024-04-24T13:34:34.588566+0000","last_became_active":"2024-04-24T13:33:08.726347+0000","last_became_peered":"2024-04-24T13:33:08.726347+0000","last_unstale":"2024-04-24T13:34:34.588566+0000","last_undegraded":"2024-04-24T13:34:34.588566+0000","last_fullsized":"2024-04-24T13:34:34.588566+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:37.412890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665180+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:34:35.665180+0000","last_peered":"2024-04-24T13:34:35.665180+0000","last_clean":"2024-04-24T13:34:35.665180+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:34:35.665180+0000","last_undegraded":"2024-04-24T13:34:35.665180+0000","last_fullsized":"2024-04-24T13:34:35.665180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589644+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:34:34.589644+0000","last_peered":"2024-04-24T13:34:34.589644+0000","last_clean":"2024-04-24T13:34:34.589644+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:34:34.589644+0000","last_undegraded":"2024-04-24T13:34:34.589644+0000","last_fullsized":"2024-04-24T13:34:34.589644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"132'10","reported_seq":303,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529693+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:34:35.529693+0000","last_peered":"2024-04-24T13:34:35.529693+0000","last_clean":"2024-04-24T13:34:35.529693+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:34:35.529693+0000","last_undegraded":"2024-04-24T13:34:35.529693+0000","last_fullsized":"2024-04-24T13:34:35.529693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"130'14","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666878+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:34:35.666878+0000","last_peered":"2024-04-24T13:34:35.666878+0000","last_clean":"2024-04-24T13:34:35.666878+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:34:35.666878+0000","last_undegraded":"2024-04-24T13:34:35.666878+0000","last_fullsized":"2024-04-24T13:34:35.666878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"105'12","reported_seq":303,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.526585+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:34:35.526585+0000","last_peered":"2024-04-24T13:34:35.526585+0000","last_clean":"2024-04-24T13:34:35.526585+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:34:35.526585+0000","last_undegraded":"2024-04-24T13:34:35.526585+0000","last_fullsized":"2024-04-24T13:34:35.526585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"132'20","reported_seq":311,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665952+0000","last_change":"2024-04-24T13:33:09.324802+0000","last_active":"2024-04-24T13:34:35.665952+0000","last_peered":"2024-04-24T13:34:35.665952+0000","last_clean":"2024-04-24T13:34:35.665952+0000","last_became_active":"2024-04-24T13:33:08.725876+0000","last_became_peered":"2024-04-24T13:33:08.725876+0000","last_unstale":"2024-04-24T13:34:35.665952+0000","last_undegraded":"2024-04-24T13:34:35.665952+0000","last_fullsized":"2024-04-24T13:34:35.665952+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:21:58.951897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"82'2","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594991+0000","last_change":"2024-04-24T13:33:53.237778+0000","last_active":"2024-04-24T13:34:34.594991+0000","last_peered":"2024-04-24T13:34:34.594991+0000","last_clean":"2024-04-24T13:34:34.594991+0000","last_became_active":"2024-04-24T13:33:49.302722+0000","last_became_peered":"2024-04-24T13:33:49.302722+0000","last_unstale":"2024-04-24T13:34:34.594991+0000","last_undegraded":"2024-04-24T13:34:34.594991+0000","last_fullsized":"2024-04-24T13:34:34.594991+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:52:06.190295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"132'28","reported_seq":143,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592901+0000","last_change":"2024-04-24T13:33:09.548908+0000","last_active":"2024-04-24T13:34:34.592901+0000","last_peered":"2024-04-24T13:34:34.592901+0000","last_clean":"2024-04-24T13:34:34.592901+0000","last_became_active":"2024-04-24T13:33:08.720010+0000","last_became_peered":"2024-04-24T13:33:08.720010+0000","last_unstale":"2024-04-24T13:34:34.592901+0000","last_undegraded":"2024-04-24T13:34:34.592901+0000","last_fullsized":"2024-04-24T13:34:34.592901+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:06.195033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"114'12","reported_seq":320,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525327+0000","last_change":"2024-04-24T13:33:49.678468+0000","last_active":"2024-04-24T13:34:35.525327+0000","last_peered":"2024-04-24T13:34:35.525327+0000","last_clean":"2024-04-24T13:34:35.525327+0000","last_became_active":"2024-04-24T13:33:49.289642+0000","last_became_peered":"2024-04-24T13:33:49.289642+0000","last_unstale":"2024-04-24T13:34:35.525327+0000","last_undegraded":"2024-04-24T13:34:35.525327+0000","last_fullsized":"2024-04-24T13:34:35.525327+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:37.408920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"132'31","reported_seq":296,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666117+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:34:35.666117+0000","last_peered":"2024-04-24T13:34:35.666117+0000","last_clean":"2024-04-24T13:34:35.666117+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:34:35.666117+0000","last_undegraded":"2024-04-24T13:34:35.666117+0000","last_fullsized":"2024-04-24T13:34:35.666117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"132'4","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554985+0000","last_change":"2024-04-24T13:33:51.611283+0000","last_active":"2024-04-24T13:34:35.554985+0000","last_peered":"2024-04-24T13:34:35.554985+0000","last_clean":"2024-04-24T13:34:35.554985+0000","last_became_active":"2024-04-24T13:33:49.304888+0000","last_became_peered":"2024-04-24T13:33:49.304888+0000","last_unstale":"2024-04-24T13:34:35.554985+0000","last_undegraded":"2024-04-24T13:34:35.554985+0000","last_fullsized":"2024-04-24T13:34:35.554985+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:18.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"131'22","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556718+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:34:35.556718+0000","last_peered":"2024-04-24T13:34:35.556718+0000","last_clean":"2024-04-24T13:34:35.556718+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:34:35.556718+0000","last_undegraded":"2024-04-24T13:34:35.556718+0000","last_fullsized":"2024-04-24T13:34:35.556718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"81'2","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589524+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:34:34.589524+0000","last_peered":"2024-04-24T13:34:34.589524+0000","last_clean":"2024-04-24T13:34:34.589524+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:34:34.589524+0000","last_undegraded":"2024-04-24T13:34:34.589524+0000","last_fullsized":"2024-04-24T13:34:34.589524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"131'18","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.526189+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:34:35.526189+0000","last_peered":"2024-04-24T13:34:35.526189+0000","last_clean":"2024-04-24T13:34:35.526189+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:34:35.526189+0000","last_undegraded":"2024-04-24T13:34:35.526189+0000","last_fullsized":"2024-04-24T13:34:35.526189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"132'12","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554322+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:34:35.554322+0000","last_peered":"2024-04-24T13:34:35.554322+0000","last_clean":"2024-04-24T13:34:35.554322+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:34:35.554322+0000","last_undegraded":"2024-04-24T13:34:35.554322+0000","last_fullsized":"2024-04-24T13:34:35.554322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"131'29","reported_seq":340,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671592+0000","last_change":"2024-04-24T13:33:50.237368+0000","last_active":"2024-04-24T13:34:35.671592+0000","last_peered":"2024-04-24T13:34:35.671592+0000","last_clean":"2024-04-24T13:34:35.671592+0000","last_became_active":"2024-04-24T13:33:49.301145+0000","last_became_peered":"2024-04-24T13:33:49.301145+0000","last_unstale":"2024-04-24T13:34:35.671592+0000","last_undegraded":"2024-04-24T13:34:35.671592+0000","last_fullsized":"2024-04-24T13:34:35.671592+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:57:21.677851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666722+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:34:35.666722+0000","last_peered":"2024-04-24T13:34:35.666722+0000","last_clean":"2024-04-24T13:34:35.666722+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:34:35.666722+0000","last_undegraded":"2024-04-24T13:34:35.666722+0000","last_fullsized":"2024-04-24T13:34:35.666722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"131'16","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556649+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:34:35.556649+0000","last_peered":"2024-04-24T13:34:35.556649+0000","last_clean":"2024-04-24T13:34:35.556649+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:34:35.556649+0000","last_undegraded":"2024-04-24T13:34:35.556649+0000","last_fullsized":"2024-04-24T13:34:35.556649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"105'8","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668052+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:34:35.668052+0000","last_peered":"2024-04-24T13:34:35.668052+0000","last_clean":"2024-04-24T13:34:35.668052+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:34:35.668052+0000","last_undegraded":"2024-04-24T13:34:35.668052+0000","last_fullsized":"2024-04-24T13:34:35.668052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"131'28","reported_seq":141,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593813+0000","last_change":"2024-04-24T13:33:09.287304+0000","last_active":"2024-04-24T13:34:34.593813+0000","last_peered":"2024-04-24T13:34:34.593813+0000","last_clean":"2024-04-24T13:34:34.593813+0000","last_became_active":"2024-04-24T13:33:08.716282+0000","last_became_peered":"2024-04-24T13:33:08.716282+0000","last_unstale":"2024-04-24T13:34:34.593813+0000","last_undegraded":"2024-04-24T13:34:34.593813+0000","last_fullsized":"2024-04-24T13:34:34.593813+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591204+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:34:34.591204+0000","last_peered":"2024-04-24T13:34:34.591204+0000","last_clean":"2024-04-24T13:34:34.591204+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:34:34.591204+0000","last_undegraded":"2024-04-24T13:34:34.591204+0000","last_fullsized":"2024-04-24T13:34:34.591204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"132'28","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554550+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:34:35.554550+0000","last_peered":"2024-04-24T13:34:35.554550+0000","last_clean":"2024-04-24T13:34:35.554550+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:34:35.554550+0000","last_undegraded":"2024-04-24T13:34:35.554550+0000","last_fullsized":"2024-04-24T13:34:35.554550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665527+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:34:35.665527+0000","last_peered":"2024-04-24T13:34:35.665527+0000","last_clean":"2024-04-24T13:34:35.665527+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:34:35.665527+0000","last_undegraded":"2024-04-24T13:34:35.665527+0000","last_fullsized":"2024-04-24T13:34:35.665527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"131'23","reported_seq":165,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592406+0000","last_change":"2024-04-24T13:33:51.593184+0000","last_active":"2024-04-24T13:34:34.592406+0000","last_peered":"2024-04-24T13:34:34.592406+0000","last_clean":"2024-04-24T13:34:34.592406+0000","last_became_active":"2024-04-24T13:33:49.289463+0000","last_became_peered":"2024-04-24T13:33:49.289463+0000","last_unstale":"2024-04-24T13:34:34.592406+0000","last_undegraded":"2024-04-24T13:34:34.592406+0000","last_fullsized":"2024-04-24T13:34:34.592406+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:42:20.618809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"82'6","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590679+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:34:34.590679+0000","last_peered":"2024-04-24T13:34:34.590679+0000","last_clean":"2024-04-24T13:34:34.590679+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:34:34.590679+0000","last_undegraded":"2024-04-24T13:34:34.590679+0000","last_fullsized":"2024-04-24T13:34:34.590679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"131'24","reported_seq":334,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666298+0000","last_change":"2024-04-24T13:33:52.627571+0000","last_active":"2024-04-24T13:34:35.666298+0000","last_peered":"2024-04-24T13:34:35.666298+0000","last_clean":"2024-04-24T13:34:35.666298+0000","last_became_active":"2024-04-24T13:33:49.302184+0000","last_became_peered":"2024-04-24T13:33:49.302184+0000","last_unstale":"2024-04-24T13:34:35.666298+0000","last_undegraded":"2024-04-24T13:34:35.666298+0000","last_fullsized":"2024-04-24T13:34:35.666298+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:16:24.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":69206016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"82'2","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669580+0000","last_change":"2024-04-24T13:33:53.884916+0000","last_active":"2024-04-24T13:34:35.669580+0000","last_peered":"2024-04-24T13:34:35.669580+0000","last_clean":"2024-04-24T13:34:35.669580+0000","last_became_active":"2024-04-24T13:33:49.300182+0000","last_became_peered":"2024-04-24T13:33:49.300182+0000","last_unstale":"2024-04-24T13:34:35.669580+0000","last_undegraded":"2024-04-24T13:34:35.669580+0000","last_fullsized":"2024-04-24T13:34:35.669580+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:30.442779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"132'30","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668550+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:34:35.668550+0000","last_peered":"2024-04-24T13:34:35.668550+0000","last_clean":"2024-04-24T13:34:35.668550+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:34:35.668550+0000","last_undegraded":"2024-04-24T13:34:35.668550+0000","last_fullsized":"2024-04-24T13:34:35.668550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"82'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665279+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:34:35.665279+0000","last_peered":"2024-04-24T13:34:35.665279+0000","last_clean":"2024-04-24T13:34:35.665279+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:34:35.665279+0000","last_undegraded":"2024-04-24T13:34:35.665279+0000","last_fullsized":"2024-04-24T13:34:35.665279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"131'17","reported_seq":89,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669962+0000","last_change":"2024-04-24T13:33:54.184096+0000","last_active":"2024-04-24T13:34:35.669962+0000","last_peered":"2024-04-24T13:34:35.669962+0000","last_clean":"2024-04-24T13:34:35.669962+0000","last_became_active":"2024-04-24T13:33:49.299554+0000","last_became_peered":"2024-04-24T13:33:49.299554+0000","last_unstale":"2024-04-24T13:34:35.669962+0000","last_undegraded":"2024-04-24T13:34:35.669962+0000","last_fullsized":"2024-04-24T13:34:35.669962+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:18.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69206016,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"82'2","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554228+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:34:35.554228+0000","last_peered":"2024-04-24T13:34:35.554228+0000","last_clean":"2024-04-24T13:34:35.554228+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:34:35.554228+0000","last_undegraded":"2024-04-24T13:34:35.554228+0000","last_fullsized":"2024-04-24T13:34:35.554228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"131'18","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666030+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:34:35.666030+0000","last_peered":"2024-04-24T13:34:35.666030+0000","last_clean":"2024-04-24T13:34:35.666030+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:34:35.666030+0000","last_undegraded":"2024-04-24T13:34:35.666030+0000","last_fullsized":"2024-04-24T13:34:35.666030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667336+0000","last_change":"2024-04-24T13:33:49.302008+0000","last_active":"2024-04-24T13:34:35.667336+0000","last_peered":"2024-04-24T13:34:35.667336+0000","last_clean":"2024-04-24T13:34:35.667336+0000","last_became_active":"2024-04-24T13:33:49.300135+0000","last_became_peered":"2024-04-24T13:33:49.300135+0000","last_unstale":"2024-04-24T13:34:35.667336+0000","last_undegraded":"2024-04-24T13:34:35.667336+0000","last_fullsized":"2024-04-24T13:34:35.667336+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:02.680781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"131'24","reported_seq":177,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595741+0000","last_change":"2024-04-24T13:33:53.222020+0000","last_active":"2024-04-24T13:34:34.595741+0000","last_peered":"2024-04-24T13:34:34.595741+0000","last_clean":"2024-04-24T13:34:34.595741+0000","last_became_active":"2024-04-24T13:33:49.292734+0000","last_became_peered":"2024-04-24T13:33:49.292734+0000","last_unstale":"2024-04-24T13:34:34.595741+0000","last_undegraded":"2024-04-24T13:34:34.595741+0000","last_fullsized":"2024-04-24T13:34:34.595741+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:13.333265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"131'25","reported_seq":139,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594450+0000","last_change":"2024-04-24T13:33:10.398117+0000","last_active":"2024-04-24T13:34:34.594450+0000","last_peered":"2024-04-24T13:34:34.594450+0000","last_clean":"2024-04-24T13:34:34.594450+0000","last_became_active":"2024-04-24T13:33:08.735696+0000","last_became_peered":"2024-04-24T13:33:08.735696+0000","last_unstale":"2024-04-24T13:34:34.594450+0000","last_undegraded":"2024-04-24T13:34:34.594450+0000","last_fullsized":"2024-04-24T13:34:34.594450+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:01:26.139144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668044+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:34:35.668044+0000","last_peered":"2024-04-24T13:34:35.668044+0000","last_clean":"2024-04-24T13:34:35.668044+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:34:35.668044+0000","last_undegraded":"2024-04-24T13:34:35.668044+0000","last_fullsized":"2024-04-24T13:34:35.668044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"132'17","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529204+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:34:35.529204+0000","last_peered":"2024-04-24T13:34:35.529204+0000","last_clean":"2024-04-24T13:34:35.529204+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:34:35.529204+0000","last_undegraded":"2024-04-24T13:34:35.529204+0000","last_fullsized":"2024-04-24T13:34:35.529204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"82'6","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595392+0000","last_change":"2024-04-24T13:33:09.917888+0000","last_active":"2024-04-24T13:34:34.595392+0000","last_peered":"2024-04-24T13:34:34.595392+0000","last_clean":"2024-04-24T13:34:34.595392+0000","last_became_active":"2024-04-24T13:33:08.732489+0000","last_became_peered":"2024-04-24T13:33:08.732489+0000","last_unstale":"2024-04-24T13:34:34.595392+0000","last_undegraded":"2024-04-24T13:34:34.595392+0000","last_fullsized":"2024-04-24T13:34:34.595392+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:16.213872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":342,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":194,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1091,"ondisk_log_size":1091,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":378948,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":842,"num_read_kb":607,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":143,"num_bytes_recovered":62549,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":760,"ondisk_log_size":760,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":339,"num_read_kb":339,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2233,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1458,"num_read_kb":1426,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":449,"num_bytes_recovered":1849688064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1887072,"kb_used_data":1851736,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92484768,"statfs":{"total":96636764160,"available":94704402432,"internally_reserved":0,"allocated":1896177664,"data_stored":1895415815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1192132,"kb_used_data":1160956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93179708,"statfs":{"total":96636764160,"available":95416020992,"internally_reserved":0,"allocated":1188818944,"data_stored":1188084563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2087576,"kb_used_data":2052240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92284264,"statfs":{"total":96636764160,"available":94499086336,"internally_reserved":0,"allocated":2101493760,"data_stored":2100698156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1542340,"kb_used_data":1511152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92829500,"statfs":{"total":96636764160,"available":95057408000,"internally_reserved":0,"allocated":1547419648,"data_stored":1546697053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2030028,"kb_used_data":1994692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92341812,"statfs":{"total":96636764160,"available":94558015488,"internally_reserved":0,"allocated":2042564608,"data_stored":2041802088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1169668,"kb_used_data":1134332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93202172,"statfs":{"total":96636764160,"available":95439024128,"internally_reserved":0,"allocated":1161555968,"data_stored":1160821827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":983508,"kb_used_data":948172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93388332,"statfs":{"total":96636764160,"available":95629651968,"internally_reserved":0,"allocated":970928128,"data_stored":970158184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1702740,"kb_used_data":1667400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92669100,"statfs":{"total":96636764160,"available":94893158400,"internally_reserved":0,"allocated":1707417600,"data_stored":1706672098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1704984576,"data_stored":1704984576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":968884224,"data_stored":968884224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1159725056,"data_stored":1159725056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2040528896,"data_stored":2040528896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1545601024,"data_stored":1545601024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2099249152,"data_stored":2099249152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1186988032,"data_stored":1186988032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1893728256,"data_stored":1893728256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":176376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":177072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":351674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:34:48.463 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-04-24T13:34:48.464 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:34:48.838 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:34:48.850 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:34:48.866 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":283,"stamp":"2024-04-24T13:34:47.329932+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":6300815940,"num_objects":1702,"num_object_clones":0,"num_object_copies":3404,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1702,"num_whiteouts":0,"num_read":3149,"num_read_kb":2838,"num_write":2845,"num_write_kb":6187912,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":669,"num_bytes_recovered":1850933776,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3912,"ondisk_log_size":3912,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":12595064,"kb_used_data":12320680,"kb_used_omap":12,"kb_used_meta":274291,"kb_avail":742379656,"statfs":{"total":773094113280,"available":760196767744,"internally_reserved":0,"allocated":12616376320,"data_stored":12610349784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":280874545},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.007671"},"pg_stats":[{"pgid":"3.3f","version":"131'18","reported_seq":92,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669607+0000","last_change":"2024-04-24T13:33:52.298396+0000","last_active":"2024-04-24T13:34:35.669607+0000","last_peered":"2024-04-24T13:34:35.669607+0000","last_clean":"2024-04-24T13:34:35.669607+0000","last_became_active":"2024-04-24T13:33:49.293106+0000","last_became_peered":"2024-04-24T13:33:49.293106+0000","last_unstale":"2024-04-24T13:34:35.669607+0000","last_undegraded":"2024-04-24T13:34:35.669607+0000","last_fullsized":"2024-04-24T13:34:35.669607+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:44.520756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"82'14","reported_seq":309,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594851+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:34:34.594851+0000","last_peered":"2024-04-24T13:34:34.594851+0000","last_clean":"2024-04-24T13:34:34.594851+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:34:34.594851+0000","last_undegraded":"2024-04-24T13:34:34.594851+0000","last_fullsized":"2024-04-24T13:34:34.594851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"132'18","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.531293+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:34:35.531293+0000","last_peered":"2024-04-24T13:34:35.531293+0000","last_clean":"2024-04-24T13:34:35.531293+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:34:35.531293+0000","last_undegraded":"2024-04-24T13:34:35.531293+0000","last_fullsized":"2024-04-24T13:34:35.531293+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"82'4","reported_seq":63,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669845+0000","last_change":"2024-04-24T13:33:52.687680+0000","last_active":"2024-04-24T13:34:35.669845+0000","last_peered":"2024-04-24T13:34:35.669845+0000","last_clean":"2024-04-24T13:34:35.669845+0000","last_became_active":"2024-04-24T13:33:49.293840+0000","last_became_peered":"2024-04-24T13:33:49.293840+0000","last_unstale":"2024-04-24T13:34:35.669845+0000","last_undegraded":"2024-04-24T13:34:35.669845+0000","last_fullsized":"2024-04-24T13:34:35.669845+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:13:31.744087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"131'17","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667042+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:34:35.667042+0000","last_peered":"2024-04-24T13:34:35.667042+0000","last_clean":"2024-04-24T13:34:35.667042+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:34:35.667042+0000","last_undegraded":"2024-04-24T13:34:35.667042+0000","last_fullsized":"2024-04-24T13:34:35.667042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62914560,"num_objects":15,"num_object_clones":0,"num_object_copies":30,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":15,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":27,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589257+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:34:34.589257+0000","last_peered":"2024-04-24T13:34:34.589257+0000","last_clean":"2024-04-24T13:34:34.589257+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:34:34.589257+0000","last_undegraded":"2024-04-24T13:34:34.589257+0000","last_fullsized":"2024-04-24T13:34:34.589257+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"132'25","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594720+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:34:34.594720+0000","last_peered":"2024-04-24T13:34:34.594720+0000","last_clean":"2024-04-24T13:34:34.594720+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:34:34.594720+0000","last_undegraded":"2024-04-24T13:34:34.594720+0000","last_fullsized":"2024-04-24T13:34:34.594720+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"132'6","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666016+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:34:35.666016+0000","last_peered":"2024-04-24T13:34:35.666016+0000","last_clean":"2024-04-24T13:34:35.666016+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:34:35.666016+0000","last_undegraded":"2024-04-24T13:34:35.666016+0000","last_fullsized":"2024-04-24T13:34:35.666016+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"132'34","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668947+0000","last_change":"2024-04-24T13:33:53.650464+0000","last_active":"2024-04-24T13:34:35.668947+0000","last_peered":"2024-04-24T13:34:35.668947+0000","last_clean":"2024-04-24T13:34:35.668947+0000","last_became_active":"2024-04-24T13:33:49.299781+0000","last_became_peered":"2024-04-24T13:33:49.299781+0000","last_unstale":"2024-04-24T13:34:35.668947+0000","last_undegraded":"2024-04-24T13:34:35.668947+0000","last_fullsized":"2024-04-24T13:34:35.668947+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:08.408193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":142606336,"num_objects":34,"num_object_clones":0,"num_object_copies":68,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":34,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":34,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"82'2","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668172+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:34:35.668172+0000","last_peered":"2024-04-24T13:34:35.668172+0000","last_clean":"2024-04-24T13:34:35.668172+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:34:35.668172+0000","last_undegraded":"2024-04-24T13:34:35.668172+0000","last_fullsized":"2024-04-24T13:34:35.668172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"131'30","reported_seq":298,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593034+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:34:34.593034+0000","last_peered":"2024-04-24T13:34:34.593034+0000","last_clean":"2024-04-24T13:34:34.593034+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:34:34.593034+0000","last_undegraded":"2024-04-24T13:34:34.593034+0000","last_fullsized":"2024-04-24T13:34:34.593034+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"82'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590410+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:34:34.590410+0000","last_peered":"2024-04-24T13:34:34.590410+0000","last_clean":"2024-04-24T13:34:34.590410+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:34:34.590410+0000","last_undegraded":"2024-04-24T13:34:34.590410+0000","last_fullsized":"2024-04-24T13:34:34.590410+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"131'29","reported_seq":109,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668747+0000","last_change":"2024-04-24T13:33:51.145800+0000","last_active":"2024-04-24T13:34:35.668747+0000","last_peered":"2024-04-24T13:34:35.668747+0000","last_clean":"2024-04-24T13:34:35.668747+0000","last_became_active":"2024-04-24T13:33:49.287926+0000","last_became_peered":"2024-04-24T13:33:49.287926+0000","last_unstale":"2024-04-24T13:34:35.668747+0000","last_undegraded":"2024-04-24T13:34:35.668747+0000","last_fullsized":"2024-04-24T13:34:35.668747+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:22.605125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"82'2","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595672+0000","last_change":"2024-04-24T13:33:09.792748+0000","last_active":"2024-04-24T13:34:34.595672+0000","last_peered":"2024-04-24T13:34:34.595672+0000","last_clean":"2024-04-24T13:34:34.595672+0000","last_became_active":"2024-04-24T13:33:08.725324+0000","last_became_peered":"2024-04-24T13:33:08.725324+0000","last_unstale":"2024-04-24T13:34:34.595672+0000","last_undegraded":"2024-04-24T13:34:34.595672+0000","last_fullsized":"2024-04-24T13:34:34.595672+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:20.696769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"131'18","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554234+0000","last_change":"2024-04-24T13:33:08.836525+0000","last_active":"2024-04-24T13:34:35.554234+0000","last_peered":"2024-04-24T13:34:35.554234+0000","last_clean":"2024-04-24T13:34:35.554234+0000","last_became_active":"2024-04-24T13:33:08.720200+0000","last_became_peered":"2024-04-24T13:33:08.720200+0000","last_unstale":"2024-04-24T13:34:35.554234+0000","last_undegraded":"2024-04-24T13:34:35.554234+0000","last_fullsized":"2024-04-24T13:34:35.554234+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:31.093323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"82'6","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666260+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:34:35.666260+0000","last_peered":"2024-04-24T13:34:35.666260+0000","last_clean":"2024-04-24T13:34:35.666260+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:34:35.666260+0000","last_undegraded":"2024-04-24T13:34:35.666260+0000","last_fullsized":"2024-04-24T13:34:35.666260+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:19.353856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"86'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588496+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:34:34.588496+0000","last_peered":"2024-04-24T13:34:34.588496+0000","last_clean":"2024-04-24T13:34:34.588496+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:34:34.588496+0000","last_undegraded":"2024-04-24T13:34:34.588496+0000","last_fullsized":"2024-04-24T13:34:34.588496+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"131'24","reported_seq":101,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670455+0000","last_change":"2024-04-24T13:33:51.801208+0000","last_active":"2024-04-24T13:34:35.670455+0000","last_peered":"2024-04-24T13:34:35.670455+0000","last_clean":"2024-04-24T13:34:35.670455+0000","last_became_active":"2024-04-24T13:33:49.287950+0000","last_became_peered":"2024-04-24T13:33:49.287950+0000","last_unstale":"2024-04-24T13:34:35.670455+0000","last_undegraded":"2024-04-24T13:34:35.670455+0000","last_fullsized":"2024-04-24T13:34:35.670455+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:09.811184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"82'4","reported_seq":63,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670154+0000","last_change":"2024-04-24T13:33:53.106900+0000","last_active":"2024-04-24T13:34:35.670154+0000","last_peered":"2024-04-24T13:34:35.670154+0000","last_clean":"2024-04-24T13:34:35.670154+0000","last_became_active":"2024-04-24T13:33:49.294597+0000","last_became_peered":"2024-04-24T13:33:49.294597+0000","last_unstale":"2024-04-24T13:34:35.670154+0000","last_undegraded":"2024-04-24T13:34:35.670154+0000","last_fullsized":"2024-04-24T13:34:35.670154+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:28.384262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"131'28","reported_seq":319,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671293+0000","last_change":"2024-04-24T13:33:08.998015+0000","last_active":"2024-04-24T13:34:35.671293+0000","last_peered":"2024-04-24T13:34:35.671293+0000","last_clean":"2024-04-24T13:34:35.671293+0000","last_became_active":"2024-04-24T13:33:08.726581+0000","last_became_peered":"2024-04-24T13:33:08.726581+0000","last_unstale":"2024-04-24T13:34:35.671293+0000","last_undegraded":"2024-04-24T13:34:35.671293+0000","last_fullsized":"2024-04-24T13:34:35.671293+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:03:25.814262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"86'6","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592134+0000","last_change":"2024-04-24T13:33:09.293808+0000","last_active":"2024-04-24T13:34:34.592134+0000","last_peered":"2024-04-24T13:34:34.592134+0000","last_clean":"2024-04-24T13:34:34.592134+0000","last_became_active":"2024-04-24T13:33:08.719391+0000","last_became_peered":"2024-04-24T13:33:08.719391+0000","last_unstale":"2024-04-24T13:34:34.592134+0000","last_undegraded":"2024-04-24T13:34:34.592134+0000","last_fullsized":"2024-04-24T13:34:34.592134+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:10.422756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"132'22","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670992+0000","last_change":"2024-04-24T13:33:09.199641+0000","last_active":"2024-04-24T13:34:35.670992+0000","last_peered":"2024-04-24T13:34:35.670992+0000","last_clean":"2024-04-24T13:34:35.670992+0000","last_became_active":"2024-04-24T13:33:08.737789+0000","last_became_peered":"2024-04-24T13:33:08.737789+0000","last_unstale":"2024-04-24T13:34:35.670992+0000","last_undegraded":"2024-04-24T13:34:35.670992+0000","last_fullsized":"2024-04-24T13:34:35.670992+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:41.648006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665653+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:34:35.665653+0000","last_peered":"2024-04-24T13:34:35.665653+0000","last_clean":"2024-04-24T13:34:35.665653+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:34:35.665653+0000","last_undegraded":"2024-04-24T13:34:35.665653+0000","last_fullsized":"2024-04-24T13:34:35.665653+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:41.035085+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"132'24","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590031+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:34:34.590031+0000","last_peered":"2024-04-24T13:34:34.590031+0000","last_clean":"2024-04-24T13:34:34.590031+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:34:34.590031+0000","last_undegraded":"2024-04-24T13:34:34.590031+0000","last_fullsized":"2024-04-24T13:34:34.590031+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:46:47.932325+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"132'6","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665503+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:34:35.665503+0000","last_peered":"2024-04-24T13:34:35.665503+0000","last_clean":"2024-04-24T13:34:35.665503+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:34:35.665503+0000","last_undegraded":"2024-04-24T13:34:35.665503+0000","last_fullsized":"2024-04-24T13:34:35.665503+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:15.513543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"131'23","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554652+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:34:35.554652+0000","last_peered":"2024-04-24T13:34:35.554652+0000","last_clean":"2024-04-24T13:34:35.554652+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:34:35.554652+0000","last_undegraded":"2024-04-24T13:34:35.554652+0000","last_fullsized":"2024-04-24T13:34:35.554652+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590560+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:34:34.590560+0000","last_peered":"2024-04-24T13:34:34.590560+0000","last_clean":"2024-04-24T13:34:34.590560+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:34:34.590560+0000","last_undegraded":"2024-04-24T13:34:34.590560+0000","last_fullsized":"2024-04-24T13:34:34.590560+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:02.646500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"132'25","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665634+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:34:35.665634+0000","last_peered":"2024-04-24T13:34:35.665634+0000","last_clean":"2024-04-24T13:34:35.665634+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:34:35.665634+0000","last_undegraded":"2024-04-24T13:34:35.665634+0000","last_fullsized":"2024-04-24T13:34:35.665634+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587703+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:34:34.587703+0000","last_peered":"2024-04-24T13:34:34.587703+0000","last_clean":"2024-04-24T13:34:34.587703+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:34:34.587703+0000","last_undegraded":"2024-04-24T13:34:34.587703+0000","last_fullsized":"2024-04-24T13:34:34.587703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:10.002486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"82'2","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556467+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:34:35.556467+0000","last_peered":"2024-04-24T13:34:35.556467+0000","last_clean":"2024-04-24T13:34:35.556467+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:34:35.556467+0000","last_undegraded":"2024-04-24T13:34:35.556467+0000","last_fullsized":"2024-04-24T13:34:35.556467+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"132'27","reported_seq":105,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668651+0000","last_change":"2024-04-24T13:33:49.775824+0000","last_active":"2024-04-24T13:34:35.668651+0000","last_peered":"2024-04-24T13:34:35.668651+0000","last_clean":"2024-04-24T13:34:35.668651+0000","last_became_active":"2024-04-24T13:33:49.282849+0000","last_became_peered":"2024-04-24T13:33:49.282849+0000","last_unstale":"2024-04-24T13:34:35.668651+0000","last_undegraded":"2024-04-24T13:34:35.668651+0000","last_fullsized":"2024-04-24T13:34:35.668651+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:12:15.350559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595154+0000","last_change":"2024-04-24T13:33:10.797093+0000","last_active":"2024-04-24T13:34:34.595154+0000","last_peered":"2024-04-24T13:34:34.595154+0000","last_clean":"2024-04-24T13:34:34.595154+0000","last_became_active":"2024-04-24T13:33:08.736087+0000","last_became_peered":"2024-04-24T13:33:08.736087+0000","last_unstale":"2024-04-24T13:34:34.595154+0000","last_undegraded":"2024-04-24T13:34:34.595154+0000","last_fullsized":"2024-04-24T13:34:34.595154+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:49:31.056251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"132'17","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667818+0000","last_change":"2024-04-24T13:33:51.608371+0000","last_active":"2024-04-24T13:34:35.667818+0000","last_peered":"2024-04-24T13:34:35.667818+0000","last_clean":"2024-04-24T13:34:35.667818+0000","last_became_active":"2024-04-24T13:33:49.295172+0000","last_became_peered":"2024-04-24T13:33:49.295172+0000","last_unstale":"2024-04-24T13:34:35.667818+0000","last_undegraded":"2024-04-24T13:34:35.667818+0000","last_fullsized":"2024-04-24T13:34:35.667818+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:46:40.352367+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670310+0000","last_change":"2024-04-24T13:33:49.295489+0000","last_active":"2024-04-24T13:34:35.670310+0000","last_peered":"2024-04-24T13:34:35.670310+0000","last_clean":"2024-04-24T13:34:35.670310+0000","last_became_active":"2024-04-24T13:33:49.292611+0000","last_became_peered":"2024-04-24T13:33:49.292611+0000","last_unstale":"2024-04-24T13:34:35.670310+0000","last_undegraded":"2024-04-24T13:34:35.670310+0000","last_fullsized":"2024-04-24T13:34:35.670310+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:52:22.537619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"132'48","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592278+0000","last_change":"2024-04-24T13:33:08.911162+0000","last_active":"2024-04-24T13:34:34.592278+0000","last_peered":"2024-04-24T13:34:34.592278+0000","last_clean":"2024-04-24T13:34:34.592278+0000","last_became_active":"2024-04-24T13:33:08.709158+0000","last_became_peered":"2024-04-24T13:33:08.709158+0000","last_unstale":"2024-04-24T13:34:34.592278+0000","last_undegraded":"2024-04-24T13:34:34.592278+0000","last_fullsized":"2024-04-24T13:34:34.592278+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:56.162767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"82'4","reported_seq":119,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595727+0000","last_change":"2024-04-24T13:33:53.234461+0000","last_active":"2024-04-24T13:34:34.595727+0000","last_peered":"2024-04-24T13:34:34.595727+0000","last_clean":"2024-04-24T13:34:34.595727+0000","last_became_active":"2024-04-24T13:33:49.302172+0000","last_became_peered":"2024-04-24T13:33:49.302172+0000","last_unstale":"2024-04-24T13:34:34.595727+0000","last_undegraded":"2024-04-24T13:34:34.595727+0000","last_fullsized":"2024-04-24T13:34:34.595727+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:55:38.136746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"131'19","reported_seq":323,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665731+0000","last_change":"2024-04-24T13:33:49.666596+0000","last_active":"2024-04-24T13:34:35.665731+0000","last_peered":"2024-04-24T13:34:35.665731+0000","last_clean":"2024-04-24T13:34:35.665731+0000","last_became_active":"2024-04-24T13:33:49.283461+0000","last_became_peered":"2024-04-24T13:33:49.283461+0000","last_unstale":"2024-04-24T13:34:35.665731+0000","last_undegraded":"2024-04-24T13:34:35.665731+0000","last_fullsized":"2024-04-24T13:34:35.665731+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:49:27.034645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556319+0000","last_change":"2024-04-24T13:33:49.301406+0000","last_active":"2024-04-24T13:34:35.556319+0000","last_peered":"2024-04-24T13:34:35.556319+0000","last_clean":"2024-04-24T13:34:35.556319+0000","last_became_active":"2024-04-24T13:33:49.300648+0000","last_became_peered":"2024-04-24T13:33:49.300648+0000","last_unstale":"2024-04-24T13:34:35.556319+0000","last_undegraded":"2024-04-24T13:34:35.556319+0000","last_fullsized":"2024-04-24T13:34:35.556319+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:41:13.998419+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590838+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:34:34.590838+0000","last_peered":"2024-04-24T13:34:34.590838+0000","last_clean":"2024-04-24T13:34:34.590838+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:34:34.590838+0000","last_undegraded":"2024-04-24T13:34:34.590838+0000","last_fullsized":"2024-04-24T13:34:34.590838+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590524+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:34:34.590524+0000","last_peered":"2024-04-24T13:34:34.590524+0000","last_clean":"2024-04-24T13:34:34.590524+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:34:34.590524+0000","last_undegraded":"2024-04-24T13:34:34.590524+0000","last_fullsized":"2024-04-24T13:34:34.590524+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.369654+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665370+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:34:35.665370+0000","last_peered":"2024-04-24T13:34:35.665370+0000","last_clean":"2024-04-24T13:34:35.665370+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:34:35.665370+0000","last_undegraded":"2024-04-24T13:34:35.665370+0000","last_fullsized":"2024-04-24T13:34:35.665370+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:01.167536+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"86'10","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667179+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:34:35.667179+0000","last_peered":"2024-04-24T13:34:35.667179+0000","last_clean":"2024-04-24T13:34:35.667179+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:34:35.667179+0000","last_undegraded":"2024-04-24T13:34:35.667179+0000","last_fullsized":"2024-04-24T13:34:35.667179+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"132'24","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668571+0000","last_change":"2024-04-24T13:33:50.330934+0000","last_active":"2024-04-24T13:34:35.668571+0000","last_peered":"2024-04-24T13:34:35.668571+0000","last_clean":"2024-04-24T13:34:35.668571+0000","last_became_active":"2024-04-24T13:33:49.286157+0000","last_became_peered":"2024-04-24T13:33:49.286157+0000","last_unstale":"2024-04-24T13:34:35.668571+0000","last_undegraded":"2024-04-24T13:34:35.668571+0000","last_fullsized":"2024-04-24T13:34:35.668571+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:10.162075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.557008+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:34:35.557008+0000","last_peered":"2024-04-24T13:34:35.557008+0000","last_clean":"2024-04-24T13:34:35.557008+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:34:35.557008+0000","last_undegraded":"2024-04-24T13:34:35.557008+0000","last_fullsized":"2024-04-24T13:34:35.557008+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:36.372157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664419+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:34:35.664419+0000","last_peered":"2024-04-24T13:34:35.664419+0000","last_clean":"2024-04-24T13:34:35.664419+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:34:35.664419+0000","last_undegraded":"2024-04-24T13:34:35.664419+0000","last_fullsized":"2024-04-24T13:34:35.664419+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:52.568845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"150'139","reported_seq":426,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670684+0000","last_change":"2024-04-24T13:33:52.550604+0000","last_active":"2024-04-24T13:34:35.670684+0000","last_peered":"2024-04-24T13:34:35.670684+0000","last_clean":"2024-04-24T13:34:35.670684+0000","last_became_active":"2024-04-24T13:33:52.550123+0000","last_became_peered":"2024-04-24T13:33:52.550123+0000","last_unstale":"2024-04-24T13:34:35.670684+0000","last_undegraded":"2024-04-24T13:34:35.670684+0000","last_fullsized":"2024-04-24T13:34:35.670684+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:09:41.226875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"105'8","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588558+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:34:34.588558+0000","last_peered":"2024-04-24T13:34:34.588558+0000","last_clean":"2024-04-24T13:34:34.588558+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:34:34.588558+0000","last_undegraded":"2024-04-24T13:34:34.588558+0000","last_fullsized":"2024-04-24T13:34:34.588558+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"132'4","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556508+0000","last_change":"2024-04-24T13:33:51.170660+0000","last_active":"2024-04-24T13:34:35.556508+0000","last_peered":"2024-04-24T13:34:35.556508+0000","last_clean":"2024-04-24T13:34:35.556508+0000","last_became_active":"2024-04-24T13:33:49.301591+0000","last_became_peered":"2024-04-24T13:33:49.301591+0000","last_unstale":"2024-04-24T13:34:35.556508+0000","last_undegraded":"2024-04-24T13:34:35.556508+0000","last_fullsized":"2024-04-24T13:34:35.556508+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:16:26.080736+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"132'27","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667008+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:34:35.667008+0000","last_peered":"2024-04-24T13:34:35.667008+0000","last_clean":"2024-04-24T13:34:35.667008+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:34:35.667008+0000","last_undegraded":"2024-04-24T13:34:35.667008+0000","last_fullsized":"2024-04-24T13:34:35.667008+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595591+0000","last_change":"2024-04-24T13:33:08.718010+0000","last_active":"2024-04-24T13:34:34.595591+0000","last_peered":"2024-04-24T13:34:34.595591+0000","last_clean":"2024-04-24T13:34:34.595591+0000","last_became_active":"2024-04-24T13:33:08.716072+0000","last_became_peered":"2024-04-24T13:33:08.716072+0000","last_unstale":"2024-04-24T13:34:34.595591+0000","last_undegraded":"2024-04-24T13:34:34.595591+0000","last_fullsized":"2024-04-24T13:34:34.595591+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:26.626730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"132'17","reported_seq":68,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669637+0000","last_change":"2024-04-24T13:33:52.725009+0000","last_active":"2024-04-24T13:34:35.669637+0000","last_peered":"2024-04-24T13:34:35.669637+0000","last_clean":"2024-04-24T13:34:35.669637+0000","last_became_active":"2024-04-24T13:33:49.294133+0000","last_became_peered":"2024-04-24T13:33:49.294133+0000","last_unstale":"2024-04-24T13:34:35.669637+0000","last_undegraded":"2024-04-24T13:34:35.669637+0000","last_fullsized":"2024-04-24T13:34:35.669637+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:51.462917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"150'135","reported_seq":465,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556045+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:34:35.556045+0000","last_peered":"2024-04-24T13:34:35.556045+0000","last_clean":"2024-04-24T13:34:35.556045+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:34:35.556045+0000","last_undegraded":"2024-04-24T13:34:35.556045+0000","last_fullsized":"2024-04-24T13:34:35.556045+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:20.559212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"82'2","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594248+0000","last_change":"2024-04-24T13:33:49.308248+0000","last_active":"2024-04-24T13:34:34.594248+0000","last_peered":"2024-04-24T13:34:34.594248+0000","last_clean":"2024-04-24T13:34:34.594248+0000","last_became_active":"2024-04-24T13:33:49.278105+0000","last_became_peered":"2024-04-24T13:33:49.278105+0000","last_unstale":"2024-04-24T13:34:34.594248+0000","last_undegraded":"2024-04-24T13:34:34.594248+0000","last_fullsized":"2024-04-24T13:34:34.594248+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:20.068883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"132'25","reported_seq":97,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669876+0000","last_change":"2024-04-24T13:33:53.103595+0000","last_active":"2024-04-24T13:34:35.669876+0000","last_peered":"2024-04-24T13:34:35.669876+0000","last_clean":"2024-04-24T13:34:35.669876+0000","last_became_active":"2024-04-24T13:33:49.297787+0000","last_became_peered":"2024-04-24T13:33:49.297787+0000","last_unstale":"2024-04-24T13:34:35.669876+0000","last_undegraded":"2024-04-24T13:34:35.669876+0000","last_fullsized":"2024-04-24T13:34:35.669876+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668999+0000","last_change":"2024-04-24T13:33:49.299431+0000","last_active":"2024-04-24T13:34:35.668999+0000","last_peered":"2024-04-24T13:34:35.668999+0000","last_clean":"2024-04-24T13:34:35.668999+0000","last_became_active":"2024-04-24T13:33:49.294593+0000","last_became_peered":"2024-04-24T13:33:49.294593+0000","last_unstale":"2024-04-24T13:34:35.668999+0000","last_undegraded":"2024-04-24T13:34:35.668999+0000","last_fullsized":"2024-04-24T13:34:35.668999+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:36.135388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"132'28","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592767+0000","last_change":"2024-04-24T13:33:10.421787+0000","last_active":"2024-04-24T13:34:34.592767+0000","last_peered":"2024-04-24T13:34:34.592767+0000","last_clean":"2024-04-24T13:34:34.592767+0000","last_became_active":"2024-04-24T13:33:08.733302+0000","last_became_peered":"2024-04-24T13:33:08.733302+0000","last_unstale":"2024-04-24T13:34:34.592767+0000","last_undegraded":"2024-04-24T13:34:34.592767+0000","last_fullsized":"2024-04-24T13:34:34.592767+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:10:16.339117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":31,"num_read_kb":20,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529307+0000","last_change":"2024-04-24T13:33:08.727357+0000","last_active":"2024-04-24T13:34:35.529307+0000","last_peered":"2024-04-24T13:34:35.529307+0000","last_clean":"2024-04-24T13:34:35.529307+0000","last_became_active":"2024-04-24T13:33:08.726787+0000","last_became_peered":"2024-04-24T13:33:08.726787+0000","last_unstale":"2024-04-24T13:34:35.529307+0000","last_undegraded":"2024-04-24T13:34:35.529307+0000","last_fullsized":"2024-04-24T13:34:35.529307+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:49.701435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"86'7","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594758+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:34:34.594758+0000","last_peered":"2024-04-24T13:34:34.594758+0000","last_clean":"2024-04-24T13:34:34.594758+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:34:34.594758+0000","last_undegraded":"2024-04-24T13:34:34.594758+0000","last_fullsized":"2024-04-24T13:34:34.594758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"132'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588759+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:34:34.588759+0000","last_peered":"2024-04-24T13:34:34.588759+0000","last_clean":"2024-04-24T13:34:34.588759+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:34:34.588759+0000","last_undegraded":"2024-04-24T13:34:34.588759+0000","last_fullsized":"2024-04-24T13:34:34.588759+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"132'17","reported_seq":86,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669927+0000","last_change":"2024-04-24T13:33:50.539289+0000","last_active":"2024-04-24T13:34:35.669927+0000","last_peered":"2024-04-24T13:34:35.669927+0000","last_clean":"2024-04-24T13:34:35.669927+0000","last_became_active":"2024-04-24T13:33:49.284576+0000","last_became_peered":"2024-04-24T13:33:49.284576+0000","last_unstale":"2024-04-24T13:34:35.669927+0000","last_undegraded":"2024-04-24T13:34:35.669927+0000","last_fullsized":"2024-04-24T13:34:35.669927+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:20.287647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664846+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:34:35.664846+0000","last_peered":"2024-04-24T13:34:35.664846+0000","last_clean":"2024-04-24T13:34:35.664846+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:34:35.664846+0000","last_undegraded":"2024-04-24T13:34:35.664846+0000","last_fullsized":"2024-04-24T13:34:35.664846+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:25.660615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"132'18","reported_seq":309,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555087+0000","last_change":"2024-04-24T13:33:52.751477+0000","last_active":"2024-04-24T13:34:35.555087+0000","last_peered":"2024-04-24T13:34:35.555087+0000","last_clean":"2024-04-24T13:34:35.555087+0000","last_became_active":"2024-04-24T13:33:49.308018+0000","last_became_peered":"2024-04-24T13:33:49.308018+0000","last_unstale":"2024-04-24T13:34:35.555087+0000","last_undegraded":"2024-04-24T13:34:35.555087+0000","last_fullsized":"2024-04-24T13:34:35.555087+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:29:49.907943+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554059+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:34:35.554059+0000","last_peered":"2024-04-24T13:34:35.554059+0000","last_clean":"2024-04-24T13:34:35.554059+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:34:35.554059+0000","last_undegraded":"2024-04-24T13:34:35.554059+0000","last_fullsized":"2024-04-24T13:34:35.554059+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:03.614986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":243,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667433+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:34:35.667433+0000","last_peered":"2024-04-24T13:34:35.667433+0000","last_clean":"2024-04-24T13:34:35.667433+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:34:35.667433+0000","last_undegraded":"2024-04-24T13:34:35.667433+0000","last_fullsized":"2024-04-24T13:34:35.667433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"82'4","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667381+0000","last_change":"2024-04-24T13:32:01.548738+0000","last_active":"2024-04-24T13:34:35.667381+0000","last_peered":"2024-04-24T13:34:35.667381+0000","last_clean":"2024-04-24T13:34:35.667381+0000","last_became_active":"2024-04-24T13:32:01.548259+0000","last_became_peered":"2024-04-24T13:32:01.548259+0000","last_unstale":"2024-04-24T13:34:35.667381+0000","last_undegraded":"2024-04-24T13:34:35.667381+0000","last_fullsized":"2024-04-24T13:34:35.667381+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"131'26","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669452+0000","last_change":"2024-04-24T13:33:52.683024+0000","last_active":"2024-04-24T13:34:35.669452+0000","last_peered":"2024-04-24T13:34:35.669452+0000","last_clean":"2024-04-24T13:34:35.669452+0000","last_became_active":"2024-04-24T13:33:49.293373+0000","last_became_peered":"2024-04-24T13:33:49.293373+0000","last_unstale":"2024-04-24T13:34:35.669452+0000","last_undegraded":"2024-04-24T13:34:35.669452+0000","last_fullsized":"2024-04-24T13:34:35.669452+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:05:00.168247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":36,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665398+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:34:35.665398+0000","last_peered":"2024-04-24T13:34:35.665398+0000","last_clean":"2024-04-24T13:34:35.665398+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:34:35.665398+0000","last_undegraded":"2024-04-24T13:34:35.665398+0000","last_fullsized":"2024-04-24T13:34:35.665398+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:06.498888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"132'23","reported_seq":74,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667835+0000","last_change":"2024-04-24T13:33:53.666421+0000","last_active":"2024-04-24T13:34:35.667835+0000","last_peered":"2024-04-24T13:34:35.667835+0000","last_clean":"2024-04-24T13:34:35.667835+0000","last_became_active":"2024-04-24T13:33:49.302140+0000","last_became_peered":"2024-04-24T13:33:49.302140+0000","last_unstale":"2024-04-24T13:34:35.667835+0000","last_undegraded":"2024-04-24T13:34:35.667835+0000","last_fullsized":"2024-04-24T13:34:35.667835+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.223797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"150'135","reported_seq":514,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665118+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:34:35.665118+0000","last_peered":"2024-04-24T13:34:35.665118+0000","last_clean":"2024-04-24T13:34:35.665118+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:34:35.665118+0000","last_undegraded":"2024-04-24T13:34:35.665118+0000","last_fullsized":"2024-04-24T13:34:35.665118+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:05:41.750194+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"82'3","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667725+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:34:35.667725+0000","last_peered":"2024-04-24T13:34:35.667725+0000","last_clean":"2024-04-24T13:34:35.667725+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:34:35.667725+0000","last_undegraded":"2024-04-24T13:34:35.667725+0000","last_fullsized":"2024-04-24T13:34:35.667725+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:29.566938+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"132'10","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666648+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:34:35.666648+0000","last_peered":"2024-04-24T13:34:35.666648+0000","last_clean":"2024-04-24T13:34:35.666648+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:34:35.666648+0000","last_undegraded":"2024-04-24T13:34:35.666648+0000","last_fullsized":"2024-04-24T13:34:35.666648+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"131'23","reported_seq":135,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594898+0000","last_change":"2024-04-24T13:33:10.787412+0000","last_active":"2024-04-24T13:34:34.594898+0000","last_peered":"2024-04-24T13:34:34.594898+0000","last_clean":"2024-04-24T13:34:34.594898+0000","last_became_active":"2024-04-24T13:33:08.718332+0000","last_became_peered":"2024-04-24T13:33:08.718332+0000","last_unstale":"2024-04-24T13:34:34.594898+0000","last_undegraded":"2024-04-24T13:34:34.594898+0000","last_fullsized":"2024-04-24T13:34:34.594898+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:11.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665188+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:34:35.665188+0000","last_peered":"2024-04-24T13:34:35.665188+0000","last_clean":"2024-04-24T13:34:35.665188+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:34:35.665188+0000","last_undegraded":"2024-04-24T13:34:35.665188+0000","last_fullsized":"2024-04-24T13:34:35.665188+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:28.606695+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"132'28","reported_seq":325,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665332+0000","last_change":"2024-04-24T13:33:51.156026+0000","last_active":"2024-04-24T13:34:35.665332+0000","last_peered":"2024-04-24T13:34:35.665332+0000","last_clean":"2024-04-24T13:34:35.665332+0000","last_became_active":"2024-04-24T13:33:49.292150+0000","last_became_peered":"2024-04-24T13:33:49.292150+0000","last_unstale":"2024-04-24T13:34:35.665332+0000","last_undegraded":"2024-04-24T13:34:35.665332+0000","last_fullsized":"2024-04-24T13:34:35.665332+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:42.853378+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665105+0000","last_change":"2024-04-24T13:33:49.306397+0000","last_active":"2024-04-24T13:34:35.665105+0000","last_peered":"2024-04-24T13:34:35.665105+0000","last_clean":"2024-04-24T13:34:35.665105+0000","last_became_active":"2024-04-24T13:33:49.305572+0000","last_became_peered":"2024-04-24T13:33:49.305572+0000","last_unstale":"2024-04-24T13:34:35.665105+0000","last_undegraded":"2024-04-24T13:34:35.665105+0000","last_fullsized":"2024-04-24T13:34:35.665105+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:48.247418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"126'11","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529509+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:34:35.529509+0000","last_peered":"2024-04-24T13:34:35.529509+0000","last_clean":"2024-04-24T13:34:35.529509+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:34:35.529509+0000","last_undegraded":"2024-04-24T13:34:35.529509+0000","last_fullsized":"2024-04-24T13:34:35.529509+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:19.485382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"132'8","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590413+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:34:34.590413+0000","last_peered":"2024-04-24T13:34:34.590413+0000","last_clean":"2024-04-24T13:34:34.590413+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:34:34.590413+0000","last_undegraded":"2024-04-24T13:34:34.590413+0000","last_fullsized":"2024-04-24T13:34:34.590413+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:06:14.771215+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"132'29","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554380+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:34:35.554380+0000","last_peered":"2024-04-24T13:34:35.554380+0000","last_clean":"2024-04-24T13:34:35.554380+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:34:35.554380+0000","last_undegraded":"2024-04-24T13:34:35.554380+0000","last_fullsized":"2024-04-24T13:34:35.554380+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":275,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665339+0000","last_change":"2024-04-24T13:33:49.300767+0000","last_active":"2024-04-24T13:34:35.665339+0000","last_peered":"2024-04-24T13:34:35.665339+0000","last_clean":"2024-04-24T13:34:35.665339+0000","last_became_active":"2024-04-24T13:33:49.300030+0000","last_became_peered":"2024-04-24T13:33:49.300030+0000","last_unstale":"2024-04-24T13:34:35.665339+0000","last_undegraded":"2024-04-24T13:34:35.665339+0000","last_fullsized":"2024-04-24T13:34:35.665339+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:28.919157+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"132'19","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590813+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:34:34.590813+0000","last_peered":"2024-04-24T13:34:34.590813+0000","last_clean":"2024-04-24T13:34:34.590813+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:34:34.590813+0000","last_undegraded":"2024-04-24T13:34:34.590813+0000","last_fullsized":"2024-04-24T13:34:34.590813+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:14.350956+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667965+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:34:35.667965+0000","last_peered":"2024-04-24T13:34:35.667965+0000","last_clean":"2024-04-24T13:34:35.667965+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:34:35.667965+0000","last_undegraded":"2024-04-24T13:34:35.667965+0000","last_fullsized":"2024-04-24T13:34:35.667965+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:56:49.373996+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554807+0000","last_change":"2024-04-24T13:33:08.720576+0000","last_active":"2024-04-24T13:34:35.554807+0000","last_peered":"2024-04-24T13:34:35.554807+0000","last_clean":"2024-04-24T13:34:35.554807+0000","last_became_active":"2024-04-24T13:33:08.720133+0000","last_became_peered":"2024-04-24T13:33:08.720133+0000","last_unstale":"2024-04-24T13:34:35.554807+0000","last_undegraded":"2024-04-24T13:34:35.554807+0000","last_fullsized":"2024-04-24T13:34:35.554807+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:16.254173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590861+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:34:34.590861+0000","last_peered":"2024-04-24T13:34:34.590861+0000","last_clean":"2024-04-24T13:34:34.590861+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:34:34.590861+0000","last_undegraded":"2024-04-24T13:34:34.590861+0000","last_fullsized":"2024-04-24T13:34:34.590861+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:37.360013+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"131'33","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667642+0000","last_change":"2024-04-24T13:31:00.986244+0000","last_active":"2024-04-24T13:34:35.667642+0000","last_peered":"2024-04-24T13:34:35.667642+0000","last_clean":"2024-04-24T13:34:35.667642+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:34:35.667642+0000","last_undegraded":"2024-04-24T13:34:35.667642+0000","last_fullsized":"2024-04-24T13:34:35.667642+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:23.355231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.524931+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:34:35.524931+0000","last_peered":"2024-04-24T13:34:35.524931+0000","last_clean":"2024-04-24T13:34:35.524931+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:34:35.524931+0000","last_undegraded":"2024-04-24T13:34:35.524931+0000","last_fullsized":"2024-04-24T13:34:35.524931+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:05.915330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"132'25","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666099+0000","last_change":"2024-04-24T13:30:27.244111+0000","last_active":"2024-04-24T13:34:35.666099+0000","last_peered":"2024-04-24T13:34:35.666099+0000","last_clean":"2024-04-24T13:34:35.666099+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:34:35.666099+0000","last_undegraded":"2024-04-24T13:34:35.666099+0000","last_fullsized":"2024-04-24T13:34:35.666099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:32.836124+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":28,"num_read_kb":19,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"150'139","reported_seq":470,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665834+0000","last_change":"2024-04-24T13:33:11.710852+0000","last_active":"2024-04-24T13:34:35.665834+0000","last_peered":"2024-04-24T13:34:35.665834+0000","last_clean":"2024-04-24T13:34:35.665834+0000","last_became_active":"2024-04-24T13:33:11.709412+0000","last_became_peered":"2024-04-24T13:33:11.709412+0000","last_unstale":"2024-04-24T13:34:35.665834+0000","last_undegraded":"2024-04-24T13:34:35.665834+0000","last_fullsized":"2024-04-24T13:34:35.665834+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:22:40.670445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":247,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529048+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:34:35.529048+0000","last_peered":"2024-04-24T13:34:35.529048+0000","last_clean":"2024-04-24T13:34:35.529048+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:34:35.529048+0000","last_undegraded":"2024-04-24T13:34:35.529048+0000","last_fullsized":"2024-04-24T13:34:35.529048+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:06.040551+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"114'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591312+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:34:34.591312+0000","last_peered":"2024-04-24T13:34:34.591312+0000","last_clean":"2024-04-24T13:34:34.591312+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:34:34.591312+0000","last_undegraded":"2024-04-24T13:34:34.591312+0000","last_fullsized":"2024-04-24T13:34:34.591312+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"132'26","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588065+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:34:34.588065+0000","last_peered":"2024-04-24T13:34:34.588065+0000","last_clean":"2024-04-24T13:34:34.588065+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:34:34.588065+0000","last_undegraded":"2024-04-24T13:34:34.588065+0000","last_fullsized":"2024-04-24T13:34:34.588065+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":109051904,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":26,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":148,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595952+0000","last_change":"2024-04-24T13:33:09.912410+0000","last_active":"2024-04-24T13:34:34.595952+0000","last_peered":"2024-04-24T13:34:34.595952+0000","last_clean":"2024-04-24T13:34:34.595952+0000","last_became_active":"2024-04-24T13:33:08.724858+0000","last_became_peered":"2024-04-24T13:33:08.724858+0000","last_unstale":"2024-04-24T13:34:34.595952+0000","last_undegraded":"2024-04-24T13:34:34.595952+0000","last_fullsized":"2024-04-24T13:34:34.595952+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:26.760043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":176,"num_read_kb":176,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"82'11","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556099+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:34:35.556099+0000","last_peered":"2024-04-24T13:34:35.556099+0000","last_clean":"2024-04-24T13:34:35.556099+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:34:35.556099+0000","last_undegraded":"2024-04-24T13:34:35.556099+0000","last_fullsized":"2024-04-24T13:34:35.556099+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"150'135","reported_seq":479,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667871+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:34:35.667871+0000","last_peered":"2024-04-24T13:34:35.667871+0000","last_clean":"2024-04-24T13:34:35.667871+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:34:35.667871+0000","last_undegraded":"2024-04-24T13:34:35.667871+0000","last_fullsized":"2024-04-24T13:34:35.667871+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"132'4","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589121+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:34:34.589121+0000","last_peered":"2024-04-24T13:34:34.589121+0000","last_clean":"2024-04-24T13:34:34.589121+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:34:34.589121+0000","last_undegraded":"2024-04-24T13:34:34.589121+0000","last_fullsized":"2024-04-24T13:34:34.589121+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:18:05.620697+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"86'4","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529743+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:34:35.529743+0000","last_peered":"2024-04-24T13:34:35.529743+0000","last_clean":"2024-04-24T13:34:35.529743+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:34:35.529743+0000","last_undegraded":"2024-04-24T13:34:35.529743+0000","last_fullsized":"2024-04-24T13:34:35.529743+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"132'35","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554099+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:34:35.554099+0000","last_peered":"2024-04-24T13:34:35.554099+0000","last_clean":"2024-04-24T13:34:35.554099+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:34:35.554099+0000","last_undegraded":"2024-04-24T13:34:35.554099+0000","last_fullsized":"2024-04-24T13:34:35.554099+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":146800640,"num_objects":35,"num_object_clones":0,"num_object_copies":70,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":35,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":35,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591102+0000","last_change":"2024-04-24T13:33:08.716879+0000","last_active":"2024-04-24T13:34:34.591102+0000","last_peered":"2024-04-24T13:34:34.591102+0000","last_clean":"2024-04-24T13:34:34.591102+0000","last_became_active":"2024-04-24T13:33:08.716585+0000","last_became_peered":"2024-04-24T13:33:08.716585+0000","last_unstale":"2024-04-24T13:34:34.591102+0000","last_undegraded":"2024-04-24T13:34:34.591102+0000","last_fullsized":"2024-04-24T13:34:34.591102+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:36.135388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"132'25","reported_seq":123,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595276+0000","last_change":"2024-04-24T13:33:10.818135+0000","last_active":"2024-04-24T13:34:34.595276+0000","last_peered":"2024-04-24T13:34:34.595276+0000","last_clean":"2024-04-24T13:34:34.595276+0000","last_became_active":"2024-04-24T13:33:08.736280+0000","last_became_peered":"2024-04-24T13:33:08.736280+0000","last_unstale":"2024-04-24T13:34:34.595276+0000","last_undegraded":"2024-04-24T13:34:34.595276+0000","last_fullsized":"2024-04-24T13:34:34.595276+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:41:16.005578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":28,"num_read_kb":18,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667479+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:34:35.667479+0000","last_peered":"2024-04-24T13:34:35.667479+0000","last_clean":"2024-04-24T13:34:35.667479+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:34:35.667479+0000","last_undegraded":"2024-04-24T13:34:35.667479+0000","last_fullsized":"2024-04-24T13:34:35.667479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"82'2","reported_seq":265,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529259+0000","last_change":"2024-04-24T13:33:09.338972+0000","last_active":"2024-04-24T13:34:35.529259+0000","last_peered":"2024-04-24T13:34:35.529259+0000","last_clean":"2024-04-24T13:34:35.529259+0000","last_became_active":"2024-04-24T13:33:08.727402+0000","last_became_peered":"2024-04-24T13:33:08.727402+0000","last_unstale":"2024-04-24T13:34:35.529259+0000","last_undegraded":"2024-04-24T13:34:35.529259+0000","last_fullsized":"2024-04-24T13:34:35.529259+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:34.956692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"105'4","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670731+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:34:35.670731+0000","last_peered":"2024-04-24T13:34:35.670731+0000","last_clean":"2024-04-24T13:34:35.670731+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:34:35.670731+0000","last_undegraded":"2024-04-24T13:34:35.670731+0000","last_fullsized":"2024-04-24T13:34:35.670731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":388,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668111+0000","last_change":"2024-04-24T13:33:54.557574+0000","last_active":"2024-04-24T13:34:35.668111+0000","last_peered":"2024-04-24T13:34:35.668111+0000","last_clean":"2024-04-24T13:34:35.668111+0000","last_became_active":"2024-04-24T13:33:54.557258+0000","last_became_peered":"2024-04-24T13:33:54.557258+0000","last_unstale":"2024-04-24T13:34:35.668111+0000","last_undegraded":"2024-04-24T13:34:35.668111+0000","last_fullsized":"2024-04-24T13:34:35.668111+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:14:04.108561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593434+0000","last_change":"2024-04-24T13:33:08.717037+0000","last_active":"2024-04-24T13:34:34.593434+0000","last_peered":"2024-04-24T13:34:34.593434+0000","last_clean":"2024-04-24T13:34:34.593434+0000","last_became_active":"2024-04-24T13:33:08.715914+0000","last_became_peered":"2024-04-24T13:33:08.715914+0000","last_unstale":"2024-04-24T13:34:34.593434+0000","last_undegraded":"2024-04-24T13:34:34.593434+0000","last_fullsized":"2024-04-24T13:34:34.593434+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:03.765941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"132'28","reported_seq":323,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554259+0000","last_change":"2024-04-24T13:33:09.529789+0000","last_active":"2024-04-24T13:34:35.554259+0000","last_peered":"2024-04-24T13:34:35.554259+0000","last_clean":"2024-04-24T13:34:35.554259+0000","last_became_active":"2024-04-24T13:33:08.725348+0000","last_became_peered":"2024-04-24T13:33:08.725348+0000","last_unstale":"2024-04-24T13:34:35.554259+0000","last_undegraded":"2024-04-24T13:34:35.554259+0000","last_fullsized":"2024-04-24T13:34:35.554259+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:18.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668973+0000","last_change":"2024-04-24T13:33:49.295687+0000","last_active":"2024-04-24T13:34:35.668973+0000","last_peered":"2024-04-24T13:34:35.668973+0000","last_clean":"2024-04-24T13:34:35.668973+0000","last_became_active":"2024-04-24T13:33:49.293916+0000","last_became_peered":"2024-04-24T13:33:49.293916+0000","last_unstale":"2024-04-24T13:34:35.668973+0000","last_undegraded":"2024-04-24T13:34:35.668973+0000","last_fullsized":"2024-04-24T13:34:35.668973+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:19.712676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"132'41","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.596147+0000","last_change":"2024-04-24T13:33:09.565111+0000","last_active":"2024-04-24T13:34:34.596147+0000","last_peered":"2024-04-24T13:34:34.596147+0000","last_clean":"2024-04-24T13:34:34.596147+0000","last_became_active":"2024-04-24T13:33:08.719950+0000","last_became_peered":"2024-04-24T13:33:08.719950+0000","last_unstale":"2024-04-24T13:34:34.596147+0000","last_undegraded":"2024-04-24T13:34:34.596147+0000","last_fullsized":"2024-04-24T13:34:34.596147+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:37.122088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":179174,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":35,"num_read_kb":30,"num_write":22,"num_write_kb":178,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":58868,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668132+0000","last_change":"2024-04-24T13:33:49.296153+0000","last_active":"2024-04-24T13:34:35.668132+0000","last_peered":"2024-04-24T13:34:35.668132+0000","last_clean":"2024-04-24T13:34:35.668132+0000","last_became_active":"2024-04-24T13:33:49.294098+0000","last_became_peered":"2024-04-24T13:33:49.294098+0000","last_unstale":"2024-04-24T13:34:35.668132+0000","last_undegraded":"2024-04-24T13:34:35.668132+0000","last_fullsized":"2024-04-24T13:34:35.668132+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:57:15.599045+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666700+0000","last_change":"2024-04-24T13:33:08.727069+0000","last_active":"2024-04-24T13:34:35.666700+0000","last_peered":"2024-04-24T13:34:35.666700+0000","last_clean":"2024-04-24T13:34:35.666700+0000","last_became_active":"2024-04-24T13:33:08.726216+0000","last_became_peered":"2024-04-24T13:33:08.726216+0000","last_unstale":"2024-04-24T13:34:35.666700+0000","last_undegraded":"2024-04-24T13:34:35.666700+0000","last_fullsized":"2024-04-24T13:34:35.666700+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:59.675122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"105'6","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667409+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:34:35.667409+0000","last_peered":"2024-04-24T13:34:35.667409+0000","last_clean":"2024-04-24T13:34:35.667409+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:34:35.667409+0000","last_undegraded":"2024-04-24T13:34:35.667409+0000","last_fullsized":"2024-04-24T13:34:35.667409+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668713+0000","last_change":"2024-04-24T13:33:49.282926+0000","last_active":"2024-04-24T13:34:35.668713+0000","last_peered":"2024-04-24T13:34:35.668713+0000","last_clean":"2024-04-24T13:34:35.668713+0000","last_became_active":"2024-04-24T13:33:49.282517+0000","last_became_peered":"2024-04-24T13:33:49.282517+0000","last_unstale":"2024-04-24T13:34:35.668713+0000","last_undegraded":"2024-04-24T13:34:35.668713+0000","last_fullsized":"2024-04-24T13:34:35.668713+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:18.852308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"132'24","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665423+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:34:35.665423+0000","last_peered":"2024-04-24T13:34:35.665423+0000","last_clean":"2024-04-24T13:34:35.665423+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:34:35.665423+0000","last_undegraded":"2024-04-24T13:34:35.665423+0000","last_fullsized":"2024-04-24T13:34:35.665423+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.596110+0000","last_change":"2024-04-24T13:33:08.734054+0000","last_active":"2024-04-24T13:34:34.596110+0000","last_peered":"2024-04-24T13:34:34.596110+0000","last_clean":"2024-04-24T13:34:34.596110+0000","last_became_active":"2024-04-24T13:33:08.728126+0000","last_became_peered":"2024-04-24T13:33:08.728126+0000","last_unstale":"2024-04-24T13:34:34.596110+0000","last_undegraded":"2024-04-24T13:34:34.596110+0000","last_fullsized":"2024-04-24T13:34:34.596110+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:48.542362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"150'137","reported_seq":504,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:37.608916+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:34:37.608916+0000","last_peered":"2024-04-24T13:34:37.608916+0000","last_clean":"2024-04-24T13:34:37.608916+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:34:37.608916+0000","last_undegraded":"2024-04-24T13:34:37.608916+0000","last_fullsized":"2024-04-24T13:34:37.608916+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":137,"log_dups_size":0,"ondisk_log_size":137,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:04.805305+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":120994,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":176,"num_read_kb":161,"num_write":28,"num_write_kb":119,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669391+0000","last_change":"2024-04-24T13:33:49.298292+0000","last_active":"2024-04-24T13:34:35.669391+0000","last_peered":"2024-04-24T13:34:35.669391+0000","last_clean":"2024-04-24T13:34:35.669391+0000","last_became_active":"2024-04-24T13:33:49.297450+0000","last_became_peered":"2024-04-24T13:33:49.297450+0000","last_unstale":"2024-04-24T13:34:35.669391+0000","last_undegraded":"2024-04-24T13:34:35.669391+0000","last_fullsized":"2024-04-24T13:34:35.669391+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:11.836268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.527757+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:34:35.527757+0000","last_peered":"2024-04-24T13:34:35.527757+0000","last_clean":"2024-04-24T13:34:35.527757+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:34:35.527757+0000","last_undegraded":"2024-04-24T13:34:35.527757+0000","last_fullsized":"2024-04-24T13:34:35.527757+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:53.119248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"132'2","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529868+0000","last_change":"2024-04-24T13:33:08.745743+0000","last_active":"2024-04-24T13:34:35.529868+0000","last_peered":"2024-04-24T13:34:35.529868+0000","last_clean":"2024-04-24T13:34:35.529868+0000","last_became_active":"2024-04-24T13:33:08.745363+0000","last_became_peered":"2024-04-24T13:33:08.745363+0000","last_unstale":"2024-04-24T13:34:35.529868+0000","last_undegraded":"2024-04-24T13:34:35.529868+0000","last_fullsized":"2024-04-24T13:34:35.529868+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:23:38.852782+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666100+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:34:35.666100+0000","last_peered":"2024-04-24T13:34:35.666100+0000","last_clean":"2024-04-24T13:34:35.666100+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:34:35.666100+0000","last_undegraded":"2024-04-24T13:34:35.666100+0000","last_fullsized":"2024-04-24T13:34:35.666100+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:48:12.494962+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"132'23","reported_seq":290,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.530696+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:34:35.530696+0000","last_peered":"2024-04-24T13:34:35.530696+0000","last_clean":"2024-04-24T13:34:35.530696+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:34:35.530696+0000","last_undegraded":"2024-04-24T13:34:35.530696+0000","last_fullsized":"2024-04-24T13:34:35.530696+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":274,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665881+0000","last_change":"2024-04-24T13:33:09.537358+0000","last_active":"2024-04-24T13:34:35.665881+0000","last_peered":"2024-04-24T13:34:35.665881+0000","last_clean":"2024-04-24T13:34:35.665881+0000","last_became_active":"2024-04-24T13:33:08.726022+0000","last_became_peered":"2024-04-24T13:33:08.726022+0000","last_unstale":"2024-04-24T13:34:35.665881+0000","last_undegraded":"2024-04-24T13:34:35.665881+0000","last_fullsized":"2024-04-24T13:34:35.665881+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:53:29.132620+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"150'19","reported_seq":87,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670337+0000","last_change":"2024-04-24T13:33:52.755369+0000","last_active":"2024-04-24T13:34:35.670337+0000","last_peered":"2024-04-24T13:34:35.670337+0000","last_clean":"2024-04-24T13:34:35.670337+0000","last_became_active":"2024-04-24T13:33:49.297296+0000","last_became_peered":"2024-04-24T13:33:49.297296+0000","last_unstale":"2024-04-24T13:34:35.670337+0000","last_undegraded":"2024-04-24T13:34:35.670337+0000","last_fullsized":"2024-04-24T13:34:35.670337+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:57.772686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":249,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666168+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:34:35.666168+0000","last_peered":"2024-04-24T13:34:35.666168+0000","last_clean":"2024-04-24T13:34:35.666168+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:34:35.666168+0000","last_undegraded":"2024-04-24T13:34:35.666168+0000","last_fullsized":"2024-04-24T13:34:35.666168+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:43.956529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554829+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:34:35.554829+0000","last_peered":"2024-04-24T13:34:35.554829+0000","last_clean":"2024-04-24T13:34:35.554829+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:34:35.554829+0000","last_undegraded":"2024-04-24T13:34:35.554829+0000","last_fullsized":"2024-04-24T13:34:35.554829+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:04:41.409750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"132'4","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525116+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:34:35.525116+0000","last_peered":"2024-04-24T13:34:35.525116+0000","last_clean":"2024-04-24T13:34:35.525116+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:34:35.525116+0000","last_undegraded":"2024-04-24T13:34:35.525116+0000","last_fullsized":"2024-04-24T13:34:35.525116+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:11.802963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592641+0000","last_change":"2024-04-24T13:33:08.727739+0000","last_active":"2024-04-24T13:34:34.592641+0000","last_peered":"2024-04-24T13:34:34.592641+0000","last_clean":"2024-04-24T13:34:34.592641+0000","last_became_active":"2024-04-24T13:33:08.727324+0000","last_became_peered":"2024-04-24T13:33:08.727324+0000","last_unstale":"2024-04-24T13:34:34.592641+0000","last_undegraded":"2024-04-24T13:34:34.592641+0000","last_fullsized":"2024-04-24T13:34:34.592641+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:23.918692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"132'22","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590105+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:34:34.590105+0000","last_peered":"2024-04-24T13:34:34.590105+0000","last_clean":"2024-04-24T13:34:34.590105+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:34:34.590105+0000","last_undegraded":"2024-04-24T13:34:34.590105+0000","last_fullsized":"2024-04-24T13:34:34.590105+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:04.760398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666115+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:34:35.666115+0000","last_peered":"2024-04-24T13:34:35.666115+0000","last_clean":"2024-04-24T13:34:35.666115+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:34:35.666115+0000","last_undegraded":"2024-04-24T13:34:35.666115+0000","last_fullsized":"2024-04-24T13:34:35.666115+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:58.213629+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":272,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.553929+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:34:35.553929+0000","last_peered":"2024-04-24T13:34:35.553929+0000","last_clean":"2024-04-24T13:34:35.553929+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:34:35.553929+0000","last_undegraded":"2024-04-24T13:34:35.553929+0000","last_fullsized":"2024-04-24T13:34:35.553929+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:40.023284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671288+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:34:35.671288+0000","last_peered":"2024-04-24T13:34:35.671288+0000","last_clean":"2024-04-24T13:34:35.671288+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:34:35.671288+0000","last_undegraded":"2024-04-24T13:34:35.671288+0000","last_fullsized":"2024-04-24T13:34:35.671288+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"81'4","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594411+0000","last_change":"2024-04-24T13:33:09.289060+0000","last_active":"2024-04-24T13:34:34.594411+0000","last_peered":"2024-04-24T13:34:34.594411+0000","last_clean":"2024-04-24T13:34:34.594411+0000","last_became_active":"2024-04-24T13:33:08.717929+0000","last_became_peered":"2024-04-24T13:33:08.717929+0000","last_unstale":"2024-04-24T13:34:34.594411+0000","last_undegraded":"2024-04-24T13:34:34.594411+0000","last_fullsized":"2024-04-24T13:34:34.594411+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:36.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528047+0000","last_change":"2024-04-24T13:33:08.738475+0000","last_active":"2024-04-24T13:34:35.528047+0000","last_peered":"2024-04-24T13:34:35.528047+0000","last_clean":"2024-04-24T13:34:35.528047+0000","last_became_active":"2024-04-24T13:33:08.738109+0000","last_became_peered":"2024-04-24T13:33:08.738109+0000","last_unstale":"2024-04-24T13:34:35.528047+0000","last_undegraded":"2024-04-24T13:34:35.528047+0000","last_fullsized":"2024-04-24T13:34:35.528047+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:14:49.386651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"132'27","reported_seq":137,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594648+0000","last_change":"2024-04-24T13:33:10.091580+0000","last_active":"2024-04-24T13:34:34.594648+0000","last_peered":"2024-04-24T13:34:34.594648+0000","last_clean":"2024-04-24T13:34:34.594648+0000","last_became_active":"2024-04-24T13:33:08.716808+0000","last_became_peered":"2024-04-24T13:33:08.716808+0000","last_unstale":"2024-04-24T13:34:34.594648+0000","last_undegraded":"2024-04-24T13:34:34.594648+0000","last_fullsized":"2024-04-24T13:34:34.594648+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:05:06.347329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":37,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525373+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:34:35.525373+0000","last_peered":"2024-04-24T13:34:35.525373+0000","last_clean":"2024-04-24T13:34:35.525373+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:34:35.525373+0000","last_undegraded":"2024-04-24T13:34:35.525373+0000","last_fullsized":"2024-04-24T13:34:35.525373+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:38.822847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666247+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:34:35.666247+0000","last_peered":"2024-04-24T13:34:35.666247+0000","last_clean":"2024-04-24T13:34:35.666247+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:34:35.666247+0000","last_undegraded":"2024-04-24T13:34:35.666247+0000","last_fullsized":"2024-04-24T13:34:35.666247+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:47.607459+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"132'34","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664648+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:34:35.664648+0000","last_peered":"2024-04-24T13:34:35.664648+0000","last_clean":"2024-04-24T13:34:35.664648+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:34:35.664648+0000","last_undegraded":"2024-04-24T13:34:35.664648+0000","last_fullsized":"2024-04-24T13:34:35.664648+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:07:59.076737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":22,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":249,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589043+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:34:34.589043+0000","last_peered":"2024-04-24T13:34:34.589043+0000","last_clean":"2024-04-24T13:34:34.589043+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:34:34.589043+0000","last_undegraded":"2024-04-24T13:34:34.589043+0000","last_fullsized":"2024-04-24T13:34:34.589043+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667952+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:34:35.667952+0000","last_peered":"2024-04-24T13:34:35.667952+0000","last_clean":"2024-04-24T13:34:35.667952+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:34:35.667952+0000","last_undegraded":"2024-04-24T13:34:35.667952+0000","last_fullsized":"2024-04-24T13:34:35.667952+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:28:03.625890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"114'18","reported_seq":351,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666556+0000","last_change":"2024-04-24T13:33:09.335136+0000","last_active":"2024-04-24T13:34:35.666556+0000","last_peered":"2024-04-24T13:34:35.666556+0000","last_clean":"2024-04-24T13:34:35.666556+0000","last_became_active":"2024-04-24T13:33:08.705853+0000","last_became_peered":"2024-04-24T13:33:08.705853+0000","last_unstale":"2024-04-24T13:34:35.666556+0000","last_undegraded":"2024-04-24T13:34:35.666556+0000","last_fullsized":"2024-04-24T13:34:35.666556+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:53.758485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":86,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"132'14","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525205+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:34:35.525205+0000","last_peered":"2024-04-24T13:34:35.525205+0000","last_clean":"2024-04-24T13:34:35.525205+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:34:35.525205+0000","last_undegraded":"2024-04-24T13:34:35.525205+0000","last_fullsized":"2024-04-24T13:34:35.525205+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669917+0000","last_change":"2024-04-24T13:33:49.288345+0000","last_active":"2024-04-24T13:34:35.669917+0000","last_peered":"2024-04-24T13:34:35.669917+0000","last_clean":"2024-04-24T13:34:35.669917+0000","last_became_active":"2024-04-24T13:33:49.287893+0000","last_became_peered":"2024-04-24T13:33:49.287893+0000","last_unstale":"2024-04-24T13:34:35.669917+0000","last_undegraded":"2024-04-24T13:34:35.669917+0000","last_fullsized":"2024-04-24T13:34:35.669917+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:59.559096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667933+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:34:35.667933+0000","last_peered":"2024-04-24T13:34:35.667933+0000","last_clean":"2024-04-24T13:34:35.667933+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:34:35.667933+0000","last_undegraded":"2024-04-24T13:34:35.667933+0000","last_fullsized":"2024-04-24T13:34:35.667933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"105'15","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528699+0000","last_change":"2024-04-24T13:30:27.228735+0000","last_active":"2024-04-24T13:34:35.528699+0000","last_peered":"2024-04-24T13:34:35.528699+0000","last_clean":"2024-04-24T13:34:35.528699+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:34:35.528699+0000","last_undegraded":"2024-04-24T13:34:35.528699+0000","last_fullsized":"2024-04-24T13:34:35.528699+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:49.614618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"150'138","reported_seq":351,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529396+0000","last_change":"2024-04-24T13:33:11.712104+0000","last_active":"2024-04-24T13:34:35.529396+0000","last_peered":"2024-04-24T13:34:35.529396+0000","last_clean":"2024-04-24T13:34:35.529396+0000","last_became_active":"2024-04-24T13:33:11.710310+0000","last_became_peered":"2024-04-24T13:33:11.710310+0000","last_unstale":"2024-04-24T13:34:35.529396+0000","last_undegraded":"2024-04-24T13:34:35.529396+0000","last_fullsized":"2024-04-24T13:34:35.529396+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:44.878043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"114'3","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556703+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:34:35.556703+0000","last_peered":"2024-04-24T13:34:35.556703+0000","last_clean":"2024-04-24T13:34:35.556703+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:34:35.556703+0000","last_undegraded":"2024-04-24T13:34:35.556703+0000","last_fullsized":"2024-04-24T13:34:35.556703+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:31:03.898207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"82'2","reported_seq":228,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664673+0000","last_change":"2024-04-24T13:33:49.682866+0000","last_active":"2024-04-24T13:34:35.664673+0000","last_peered":"2024-04-24T13:34:35.664673+0000","last_clean":"2024-04-24T13:34:35.664673+0000","last_became_active":"2024-04-24T13:33:49.296844+0000","last_became_peered":"2024-04-24T13:33:49.296844+0000","last_unstale":"2024-04-24T13:34:35.664673+0000","last_undegraded":"2024-04-24T13:34:35.664673+0000","last_fullsized":"2024-04-24T13:34:35.664673+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:34.675704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"132'24","reported_seq":335,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555654+0000","last_change":"2024-04-24T13:33:51.134298+0000","last_active":"2024-04-24T13:34:35.555654+0000","last_peered":"2024-04-24T13:34:35.555654+0000","last_clean":"2024-04-24T13:34:35.555654+0000","last_became_active":"2024-04-24T13:33:49.300149+0000","last_became_peered":"2024-04-24T13:33:49.300149+0000","last_unstale":"2024-04-24T13:34:35.555654+0000","last_undegraded":"2024-04-24T13:34:35.555654+0000","last_fullsized":"2024-04-24T13:34:35.555654+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:46:34.323602+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.531398+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:34:35.531398+0000","last_peered":"2024-04-24T13:34:35.531398+0000","last_clean":"2024-04-24T13:34:35.531398+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:34:35.531398+0000","last_undegraded":"2024-04-24T13:34:35.531398+0000","last_fullsized":"2024-04-24T13:34:35.531398+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:41:31.504953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588762+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:34:34.588762+0000","last_peered":"2024-04-24T13:34:34.588762+0000","last_clean":"2024-04-24T13:34:34.588762+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:34:34.588762+0000","last_undegraded":"2024-04-24T13:34:34.588762+0000","last_fullsized":"2024-04-24T13:34:34.588762+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589504+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:34:34.589504+0000","last_peered":"2024-04-24T13:34:34.589504+0000","last_clean":"2024-04-24T13:34:34.589504+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:34:34.589504+0000","last_undegraded":"2024-04-24T13:34:34.589504+0000","last_fullsized":"2024-04-24T13:34:34.589504+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:48.691169+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"150'135","reported_seq":436,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:40.139335+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:34:40.139335+0000","last_peered":"2024-04-24T13:34:40.139335+0000","last_clean":"2024-04-24T13:34:40.139335+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:34:40.139335+0000","last_undegraded":"2024-04-24T13:34:40.139335+0000","last_fullsized":"2024-04-24T13:34:40.139335+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:31.408660+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"82'6","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666218+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:34:35.666218+0000","last_peered":"2024-04-24T13:34:35.666218+0000","last_clean":"2024-04-24T13:34:35.666218+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:34:35.666218+0000","last_undegraded":"2024-04-24T13:34:35.666218+0000","last_fullsized":"2024-04-24T13:34:35.666218+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:56:17.390334+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"114'6","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588275+0000","last_change":"2024-04-24T13:33:08.753804+0000","last_active":"2024-04-24T13:34:34.588275+0000","last_peered":"2024-04-24T13:34:34.588275+0000","last_clean":"2024-04-24T13:34:34.588275+0000","last_became_active":"2024-04-24T13:33:08.707993+0000","last_became_peered":"2024-04-24T13:33:08.707993+0000","last_unstale":"2024-04-24T13:34:34.588275+0000","last_undegraded":"2024-04-24T13:34:34.588275+0000","last_fullsized":"2024-04-24T13:34:34.588275+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:02.680781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"131'22","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667097+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:34:35.667097+0000","last_peered":"2024-04-24T13:34:35.667097+0000","last_clean":"2024-04-24T13:34:35.667097+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:34:35.667097+0000","last_undegraded":"2024-04-24T13:34:35.667097+0000","last_fullsized":"2024-04-24T13:34:35.667097+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671777+0000","last_change":"2024-04-24T13:33:49.289245+0000","last_active":"2024-04-24T13:34:35.671777+0000","last_peered":"2024-04-24T13:34:35.671777+0000","last_clean":"2024-04-24T13:34:35.671777+0000","last_became_active":"2024-04-24T13:33:49.288766+0000","last_became_peered":"2024-04-24T13:33:49.288766+0000","last_unstale":"2024-04-24T13:34:35.671777+0000","last_undegraded":"2024-04-24T13:34:35.671777+0000","last_fullsized":"2024-04-24T13:34:35.671777+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:02:54.620974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554544+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:34:35.554544+0000","last_peered":"2024-04-24T13:34:35.554544+0000","last_clean":"2024-04-24T13:34:35.554544+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:34:35.554544+0000","last_undegraded":"2024-04-24T13:34:35.554544+0000","last_fullsized":"2024-04-24T13:34:35.554544+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"132'43","reported_seq":78,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669147+0000","last_change":"2024-04-24T13:33:52.712739+0000","last_active":"2024-04-24T13:34:35.669147+0000","last_peered":"2024-04-24T13:34:35.669147+0000","last_clean":"2024-04-24T13:34:35.669147+0000","last_became_active":"2024-04-24T13:33:49.295935+0000","last_became_peered":"2024-04-24T13:33:49.295935+0000","last_unstale":"2024-04-24T13:34:35.669147+0000","last_undegraded":"2024-04-24T13:34:35.669147+0000","last_fullsized":"2024-04-24T13:34:35.669147+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:52.132391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":38,"num_read_kb":24,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554197+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:34:35.554197+0000","last_peered":"2024-04-24T13:34:35.554197+0000","last_clean":"2024-04-24T13:34:35.554197+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:34:35.554197+0000","last_undegraded":"2024-04-24T13:34:35.554197+0000","last_fullsized":"2024-04-24T13:34:35.554197+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:07.996774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"105'6","reported_seq":120,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594807+0000","last_change":"2024-04-24T13:33:51.141865+0000","last_active":"2024-04-24T13:34:34.594807+0000","last_peered":"2024-04-24T13:34:34.594807+0000","last_clean":"2024-04-24T13:34:34.594807+0000","last_became_active":"2024-04-24T13:33:49.289035+0000","last_became_peered":"2024-04-24T13:33:49.289035+0000","last_unstale":"2024-04-24T13:34:34.594807+0000","last_undegraded":"2024-04-24T13:34:34.594807+0000","last_fullsized":"2024-04-24T13:34:34.594807+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:08:46.400784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"82'2","reported_seq":263,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667857+0000","last_change":"2024-04-24T13:33:09.076639+0000","last_active":"2024-04-24T13:34:35.667857+0000","last_peered":"2024-04-24T13:34:35.667857+0000","last_clean":"2024-04-24T13:34:35.667857+0000","last_became_active":"2024-04-24T13:33:08.705821+0000","last_became_peered":"2024-04-24T13:33:08.705821+0000","last_unstale":"2024-04-24T13:34:35.667857+0000","last_undegraded":"2024-04-24T13:34:35.667857+0000","last_fullsized":"2024-04-24T13:34:35.667857+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:07:09.230698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589501+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:34:34.589501+0000","last_peered":"2024-04-24T13:34:34.589501+0000","last_clean":"2024-04-24T13:34:34.589501+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:34:34.589501+0000","last_undegraded":"2024-04-24T13:34:34.589501+0000","last_fullsized":"2024-04-24T13:34:34.589501+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"132'33","reported_seq":298,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665221+0000","last_change":"2024-04-24T13:33:50.684508+0000","last_active":"2024-04-24T13:34:35.665221+0000","last_peered":"2024-04-24T13:34:35.665221+0000","last_clean":"2024-04-24T13:34:35.665221+0000","last_became_active":"2024-04-24T13:33:49.297002+0000","last_became_peered":"2024-04-24T13:33:49.297002+0000","last_unstale":"2024-04-24T13:34:35.665221+0000","last_undegraded":"2024-04-24T13:34:35.665221+0000","last_fullsized":"2024-04-24T13:34:35.665221+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:05.604339+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":138412032,"num_objects":33,"num_object_clones":0,"num_object_copies":66,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":33,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":33,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":366,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528124+0000","last_change":"2024-04-24T13:33:09.553473+0000","last_active":"2024-04-24T13:34:35.528124+0000","last_peered":"2024-04-24T13:34:35.528124+0000","last_clean":"2024-04-24T13:34:35.528124+0000","last_became_active":"2024-04-24T13:33:08.738276+0000","last_became_peered":"2024-04-24T13:33:08.738276+0000","last_unstale":"2024-04-24T13:34:35.528124+0000","last_undegraded":"2024-04-24T13:34:35.528124+0000","last_fullsized":"2024-04-24T13:34:35.528124+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:44.215595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":133,"num_read_kb":133,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"132'20","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554042+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:34:35.554042+0000","last_peered":"2024-04-24T13:34:35.554042+0000","last_clean":"2024-04-24T13:34:35.554042+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:34:35.554042+0000","last_undegraded":"2024-04-24T13:34:35.554042+0000","last_fullsized":"2024-04-24T13:34:35.554042+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:43:49.088872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":22,"num_read_kb":15,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554671+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:34:35.554671+0000","last_peered":"2024-04-24T13:34:35.554671+0000","last_clean":"2024-04-24T13:34:35.554671+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:34:35.554671+0000","last_undegraded":"2024-04-24T13:34:35.554671+0000","last_fullsized":"2024-04-24T13:34:35.554671+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:19:29.831985+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555930+0000","last_change":"2024-04-24T13:33:49.302711+0000","last_active":"2024-04-24T13:34:35.555930+0000","last_peered":"2024-04-24T13:34:35.555930+0000","last_clean":"2024-04-24T13:34:35.555930+0000","last_became_active":"2024-04-24T13:33:49.302201+0000","last_became_peered":"2024-04-24T13:33:49.302201+0000","last_unstale":"2024-04-24T13:34:35.555930+0000","last_undegraded":"2024-04-24T13:34:35.555930+0000","last_fullsized":"2024-04-24T13:34:35.555930+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:21.125833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.527964+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:34:35.527964+0000","last_peered":"2024-04-24T13:34:35.527964+0000","last_clean":"2024-04-24T13:34:35.527964+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:34:35.527964+0000","last_undegraded":"2024-04-24T13:34:35.527964+0000","last_fullsized":"2024-04-24T13:34:35.527964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:18:23.653573+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"132'20","reported_seq":88,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669042+0000","last_change":"2024-04-24T13:33:53.881731+0000","last_active":"2024-04-24T13:34:35.669042+0000","last_peered":"2024-04-24T13:34:35.669042+0000","last_clean":"2024-04-24T13:34:35.669042+0000","last_became_active":"2024-04-24T13:33:49.299864+0000","last_became_peered":"2024-04-24T13:33:49.299864+0000","last_unstale":"2024-04-24T13:34:35.669042+0000","last_undegraded":"2024-04-24T13:34:35.669042+0000","last_fullsized":"2024-04-24T13:34:35.669042+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:31.093323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554746+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:34:35.554746+0000","last_peered":"2024-04-24T13:34:35.554746+0000","last_clean":"2024-04-24T13:34:35.554746+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:34:35.554746+0000","last_undegraded":"2024-04-24T13:34:35.554746+0000","last_fullsized":"2024-04-24T13:34:35.554746+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:21:08.269553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"132'9","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664756+0000","last_change":"2024-04-24T13:33:09.548972+0000","last_active":"2024-04-24T13:34:35.664756+0000","last_peered":"2024-04-24T13:34:35.664756+0000","last_clean":"2024-04-24T13:34:35.664756+0000","last_became_active":"2024-04-24T13:33:08.721855+0000","last_became_peered":"2024-04-24T13:33:08.721855+0000","last_unstale":"2024-04-24T13:34:35.664756+0000","last_undegraded":"2024-04-24T13:34:35.664756+0000","last_fullsized":"2024-04-24T13:34:35.664756+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:12.936976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669578+0000","last_change":"2024-04-24T13:33:49.302936+0000","last_active":"2024-04-24T13:34:35.669578+0000","last_peered":"2024-04-24T13:34:35.669578+0000","last_clean":"2024-04-24T13:34:35.669578+0000","last_became_active":"2024-04-24T13:33:49.297478+0000","last_became_peered":"2024-04-24T13:33:49.297478+0000","last_unstale":"2024-04-24T13:34:35.669578+0000","last_undegraded":"2024-04-24T13:34:35.669578+0000","last_fullsized":"2024-04-24T13:34:35.669578+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:39.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"132'6","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665975+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:34:35.665975+0000","last_peered":"2024-04-24T13:34:35.665975+0000","last_clean":"2024-04-24T13:34:35.665975+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:34:35.665975+0000","last_undegraded":"2024-04-24T13:34:35.665975+0000","last_fullsized":"2024-04-24T13:34:35.665975+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:00.062645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"82'4","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554406+0000","last_change":"2024-04-24T13:33:49.688460+0000","last_active":"2024-04-24T13:34:35.554406+0000","last_peered":"2024-04-24T13:34:35.554406+0000","last_clean":"2024-04-24T13:34:35.554406+0000","last_became_active":"2024-04-24T13:33:49.292866+0000","last_became_peered":"2024-04-24T13:33:49.292866+0000","last_unstale":"2024-04-24T13:34:35.554406+0000","last_undegraded":"2024-04-24T13:34:35.554406+0000","last_fullsized":"2024-04-24T13:34:35.554406+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:38.839177+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"131'22","reported_seq":172,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595276+0000","last_change":"2024-04-24T13:33:52.207013+0000","last_active":"2024-04-24T13:34:34.595276+0000","last_peered":"2024-04-24T13:34:34.595276+0000","last_clean":"2024-04-24T13:34:34.595276+0000","last_became_active":"2024-04-24T13:33:49.289650+0000","last_became_peered":"2024-04-24T13:33:49.289650+0000","last_unstale":"2024-04-24T13:34:34.595276+0000","last_undegraded":"2024-04-24T13:34:34.595276+0000","last_fullsized":"2024-04-24T13:34:34.595276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:15:45.985778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667585+0000","last_change":"2024-04-24T13:33:49.283767+0000","last_active":"2024-04-24T13:34:35.667585+0000","last_peered":"2024-04-24T13:34:35.667585+0000","last_clean":"2024-04-24T13:34:35.667585+0000","last_became_active":"2024-04-24T13:33:49.283342+0000","last_became_peered":"2024-04-24T13:33:49.283342+0000","last_unstale":"2024-04-24T13:34:35.667585+0000","last_undegraded":"2024-04-24T13:34:35.667585+0000","last_fullsized":"2024-04-24T13:34:35.667585+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:36.682746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"132'20","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554550+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:34:35.554550+0000","last_peered":"2024-04-24T13:34:35.554550+0000","last_clean":"2024-04-24T13:34:35.554550+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:34:35.554550+0000","last_undegraded":"2024-04-24T13:34:35.554550+0000","last_fullsized":"2024-04-24T13:34:35.554550+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:05:20.984368+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668177+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:34:35.668177+0000","last_peered":"2024-04-24T13:34:35.668177+0000","last_clean":"2024-04-24T13:34:35.668177+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:34:35.668177+0000","last_undegraded":"2024-04-24T13:34:35.668177+0000","last_fullsized":"2024-04-24T13:34:35.668177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"114'4","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594405+0000","last_change":"2024-04-24T13:33:50.241765+0000","last_active":"2024-04-24T13:34:34.594405+0000","last_peered":"2024-04-24T13:34:34.594405+0000","last_clean":"2024-04-24T13:34:34.594405+0000","last_became_active":"2024-04-24T13:33:49.288852+0000","last_became_peered":"2024-04-24T13:33:49.288852+0000","last_unstale":"2024-04-24T13:34:34.594405+0000","last_undegraded":"2024-04-24T13:34:34.594405+0000","last_fullsized":"2024-04-24T13:34:34.594405+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:53:23.401847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554397+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:34:35.554397+0000","last_peered":"2024-04-24T13:34:35.554397+0000","last_clean":"2024-04-24T13:34:35.554397+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:34:35.554397+0000","last_undegraded":"2024-04-24T13:34:35.554397+0000","last_fullsized":"2024-04-24T13:34:35.554397+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:49:48.665390+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"132'20","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668126+0000","last_change":"2024-04-24T13:33:09.773703+0000","last_active":"2024-04-24T13:34:35.668126+0000","last_peered":"2024-04-24T13:34:35.668126+0000","last_clean":"2024-04-24T13:34:35.668126+0000","last_became_active":"2024-04-24T13:33:08.722546+0000","last_became_peered":"2024-04-24T13:33:08.722546+0000","last_unstale":"2024-04-24T13:34:35.668126+0000","last_undegraded":"2024-04-24T13:34:35.668126+0000","last_fullsized":"2024-04-24T13:34:35.668126+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:26.369698+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667888+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:34:35.667888+0000","last_peered":"2024-04-24T13:34:35.667888+0000","last_clean":"2024-04-24T13:34:35.667888+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:34:35.667888+0000","last_undegraded":"2024-04-24T13:34:35.667888+0000","last_fullsized":"2024-04-24T13:34:35.667888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"132'18","reported_seq":68,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668570+0000","last_change":"2024-04-24T13:33:52.735528+0000","last_active":"2024-04-24T13:34:35.668570+0000","last_peered":"2024-04-24T13:34:35.668570+0000","last_clean":"2024-04-24T13:34:35.668570+0000","last_became_active":"2024-04-24T13:33:49.297667+0000","last_became_peered":"2024-04-24T13:33:49.297667+0000","last_unstale":"2024-04-24T13:34:35.668570+0000","last_undegraded":"2024-04-24T13:34:35.668570+0000","last_fullsized":"2024-04-24T13:34:35.668570+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:07:05.200322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":16,"num_read_kb":10,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665270+0000","last_change":"2024-04-24T13:33:49.286645+0000","last_active":"2024-04-24T13:34:35.665270+0000","last_peered":"2024-04-24T13:34:35.665270+0000","last_clean":"2024-04-24T13:34:35.665270+0000","last_became_active":"2024-04-24T13:33:49.285495+0000","last_became_peered":"2024-04-24T13:33:49.285495+0000","last_unstale":"2024-04-24T13:34:35.665270+0000","last_undegraded":"2024-04-24T13:34:35.665270+0000","last_fullsized":"2024-04-24T13:34:35.665270+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:19.867685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"82'8","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671651+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:34:35.671651+0000","last_peered":"2024-04-24T13:34:35.671651+0000","last_clean":"2024-04-24T13:34:35.671651+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:34:35.671651+0000","last_undegraded":"2024-04-24T13:34:35.671651+0000","last_fullsized":"2024-04-24T13:34:35.671651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"131'27","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554147+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:34:35.554147+0000","last_peered":"2024-04-24T13:34:35.554147+0000","last_clean":"2024-04-24T13:34:35.554147+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:34:35.554147+0000","last_undegraded":"2024-04-24T13:34:35.554147+0000","last_fullsized":"2024-04-24T13:34:35.554147+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:13.498980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":113246208,"num_objects":27,"num_object_clones":0,"num_object_copies":54,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":27,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":27,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667626+0000","last_change":"2024-04-24T13:33:49.296871+0000","last_active":"2024-04-24T13:34:35.667626+0000","last_peered":"2024-04-24T13:34:35.667626+0000","last_clean":"2024-04-24T13:34:35.667626+0000","last_became_active":"2024-04-24T13:33:49.295933+0000","last_became_peered":"2024-04-24T13:33:49.295933+0000","last_unstale":"2024-04-24T13:34:35.667626+0000","last_undegraded":"2024-04-24T13:34:35.667626+0000","last_fullsized":"2024-04-24T13:34:35.667626+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:48:25.451061+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"132'29","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525465+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:34:35.525465+0000","last_peered":"2024-04-24T13:34:35.525465+0000","last_clean":"2024-04-24T13:34:35.525465+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:34:35.525465+0000","last_undegraded":"2024-04-24T13:34:35.525465+0000","last_fullsized":"2024-04-24T13:34:35.525465+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:20.644680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":62357,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":16,"num_write_kb":60,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594350+0000","last_change":"2024-04-24T13:33:08.717844+0000","last_active":"2024-04-24T13:34:34.594350+0000","last_peered":"2024-04-24T13:34:34.594350+0000","last_clean":"2024-04-24T13:34:34.594350+0000","last_became_active":"2024-04-24T13:33:08.716627+0000","last_became_peered":"2024-04-24T13:33:08.716627+0000","last_unstale":"2024-04-24T13:34:34.594350+0000","last_undegraded":"2024-04-24T13:34:34.594350+0000","last_fullsized":"2024-04-24T13:34:34.594350+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:43.447785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554266+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:34:35.554266+0000","last_peered":"2024-04-24T13:34:35.554266+0000","last_clean":"2024-04-24T13:34:35.554266+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:34:35.554266+0000","last_undegraded":"2024-04-24T13:34:35.554266+0000","last_fullsized":"2024-04-24T13:34:35.554266+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:15:24.046877+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"114'10","reported_seq":324,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667496+0000","last_change":"2024-04-24T13:33:50.254858+0000","last_active":"2024-04-24T13:34:35.667496+0000","last_peered":"2024-04-24T13:34:35.667496+0000","last_clean":"2024-04-24T13:34:35.667496+0000","last_became_active":"2024-04-24T13:33:49.285680+0000","last_became_peered":"2024-04-24T13:33:49.285680+0000","last_unstale":"2024-04-24T13:34:35.667496+0000","last_undegraded":"2024-04-24T13:34:35.667496+0000","last_fullsized":"2024-04-24T13:34:35.667496+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:13.081256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"132'20","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529452+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:34:35.529452+0000","last_peered":"2024-04-24T13:34:35.529452+0000","last_clean":"2024-04-24T13:34:35.529452+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:34:35.529452+0000","last_undegraded":"2024-04-24T13:34:35.529452+0000","last_fullsized":"2024-04-24T13:34:35.529452+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":83886080,"num_objects":20,"num_object_clones":0,"num_object_copies":40,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":20,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":20,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671404+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:34:35.671404+0000","last_peered":"2024-04-24T13:34:35.671404+0000","last_clean":"2024-04-24T13:34:35.671404+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:34:35.671404+0000","last_undegraded":"2024-04-24T13:34:35.671404+0000","last_fullsized":"2024-04-24T13:34:35.671404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"132'23","reported_seq":74,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669198+0000","last_change":"2024-04-24T13:33:51.826433+0000","last_active":"2024-04-24T13:34:35.669198+0000","last_peered":"2024-04-24T13:34:35.669198+0000","last_clean":"2024-04-24T13:34:35.669198+0000","last_became_active":"2024-04-24T13:33:49.291994+0000","last_became_peered":"2024-04-24T13:33:49.291994+0000","last_unstale":"2024-04-24T13:34:35.669198+0000","last_undegraded":"2024-04-24T13:34:35.669198+0000","last_fullsized":"2024-04-24T13:34:35.669198+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:35.992700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":25,"num_read_kb":16,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525691+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:34:35.525691+0000","last_peered":"2024-04-24T13:34:35.525691+0000","last_clean":"2024-04-24T13:34:35.525691+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:34:35.525691+0000","last_undegraded":"2024-04-24T13:34:35.525691+0000","last_fullsized":"2024-04-24T13:34:35.525691+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:22.707315+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669486+0000","last_change":"2024-04-24T13:33:49.289138+0000","last_active":"2024-04-24T13:34:35.669486+0000","last_peered":"2024-04-24T13:34:35.669486+0000","last_clean":"2024-04-24T13:34:35.669486+0000","last_became_active":"2024-04-24T13:33:49.288760+0000","last_became_peered":"2024-04-24T13:33:49.288760+0000","last_unstale":"2024-04-24T13:34:35.669486+0000","last_undegraded":"2024-04-24T13:34:35.669486+0000","last_fullsized":"2024-04-24T13:34:35.669486+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:12:25.409700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554342+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:34:35.554342+0000","last_peered":"2024-04-24T13:34:35.554342+0000","last_clean":"2024-04-24T13:34:35.554342+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:34:35.554342+0000","last_undegraded":"2024-04-24T13:34:35.554342+0000","last_fullsized":"2024-04-24T13:34:35.554342+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:48.435071+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"132'17","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589695+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:34:34.589695+0000","last_peered":"2024-04-24T13:34:34.589695+0000","last_clean":"2024-04-24T13:34:34.589695+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:34:34.589695+0000","last_undegraded":"2024-04-24T13:34:34.589695+0000","last_fullsized":"2024-04-24T13:34:34.589695+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:26:17.248558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590976+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:34:34.590976+0000","last_peered":"2024-04-24T13:34:34.590976+0000","last_clean":"2024-04-24T13:34:34.590976+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:34:34.590976+0000","last_undegraded":"2024-04-24T13:34:34.590976+0000","last_fullsized":"2024-04-24T13:34:34.590976+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:04:27.758797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"132'20","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556866+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:34:35.556866+0000","last_peered":"2024-04-24T13:34:35.556866+0000","last_clean":"2024-04-24T13:34:35.556866+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:34:35.556866+0000","last_undegraded":"2024-04-24T13:34:35.556866+0000","last_fullsized":"2024-04-24T13:34:35.556866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:41.931865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":20,"num_read_kb":13,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.526370+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:34:35.526370+0000","last_peered":"2024-04-24T13:34:35.526370+0000","last_clean":"2024-04-24T13:34:35.526370+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:34:35.526370+0000","last_undegraded":"2024-04-24T13:34:35.526370+0000","last_fullsized":"2024-04-24T13:34:35.526370+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:21.648619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592796+0000","last_change":"2024-04-24T13:33:49.289867+0000","last_active":"2024-04-24T13:34:34.592796+0000","last_peered":"2024-04-24T13:34:34.592796+0000","last_clean":"2024-04-24T13:34:34.592796+0000","last_became_active":"2024-04-24T13:33:49.289412+0000","last_became_peered":"2024-04-24T13:33:49.289412+0000","last_unstale":"2024-04-24T13:34:34.592796+0000","last_undegraded":"2024-04-24T13:34:34.592796+0000","last_fullsized":"2024-04-24T13:34:34.592796+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:24:50.051036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"114'2","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665605+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:34:35.665605+0000","last_peered":"2024-04-24T13:34:35.665605+0000","last_clean":"2024-04-24T13:34:35.665605+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:34:35.665605+0000","last_undegraded":"2024-04-24T13:34:35.665605+0000","last_fullsized":"2024-04-24T13:34:35.665605+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:42.847457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"131'28","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665975+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:34:35.665975+0000","last_peered":"2024-04-24T13:34:35.665975+0000","last_clean":"2024-04-24T13:34:35.665975+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:34:35.665975+0000","last_undegraded":"2024-04-24T13:34:35.665975+0000","last_fullsized":"2024-04-24T13:34:35.665975+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525943+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:34:35.525943+0000","last_peered":"2024-04-24T13:34:35.525943+0000","last_clean":"2024-04-24T13:34:35.525943+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:34:35.525943+0000","last_undegraded":"2024-04-24T13:34:35.525943+0000","last_fullsized":"2024-04-24T13:34:35.525943+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:00:39.367055+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590834+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:34:34.590834+0000","last_peered":"2024-04-24T13:34:34.590834+0000","last_clean":"2024-04-24T13:34:34.590834+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:34:34.590834+0000","last_undegraded":"2024-04-24T13:34:34.590834+0000","last_fullsized":"2024-04-24T13:34:34.590834+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:59:02.010175+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"150'135","reported_seq":432,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:40.124551+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:34:40.124551+0000","last_peered":"2024-04-24T13:34:40.124551+0000","last_clean":"2024-04-24T13:34:40.124551+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:34:40.124551+0000","last_undegraded":"2024-04-24T13:34:40.124551+0000","last_fullsized":"2024-04-24T13:34:40.124551+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":135,"log_dups_size":0,"ondisk_log_size":135,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"82'6","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670479+0000","last_change":"2024-04-24T13:33:50.541311+0000","last_active":"2024-04-24T13:34:35.670479+0000","last_peered":"2024-04-24T13:34:35.670479+0000","last_clean":"2024-04-24T13:34:35.670479+0000","last_became_active":"2024-04-24T13:33:49.285594+0000","last_became_peered":"2024-04-24T13:33:49.285594+0000","last_unstale":"2024-04-24T13:34:35.670479+0000","last_undegraded":"2024-04-24T13:34:35.670479+0000","last_fullsized":"2024-04-24T13:34:35.670479+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:45.453497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"86'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589448+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:34:34.589448+0000","last_peered":"2024-04-24T13:34:34.589448+0000","last_clean":"2024-04-24T13:34:34.589448+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:34:34.589448+0000","last_undegraded":"2024-04-24T13:34:34.589448+0000","last_fullsized":"2024-04-24T13:34:34.589448+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:48.554644+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"131'28","reported_seq":143,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591594+0000","last_change":"2024-04-24T13:33:09.116807+0000","last_active":"2024-04-24T13:34:34.591594+0000","last_peered":"2024-04-24T13:34:34.591594+0000","last_clean":"2024-04-24T13:34:34.591594+0000","last_became_active":"2024-04-24T13:33:08.708911+0000","last_became_peered":"2024-04-24T13:33:08.708911+0000","last_unstale":"2024-04-24T13:34:34.591594+0000","last_undegraded":"2024-04-24T13:34:34.591594+0000","last_fullsized":"2024-04-24T13:34:34.591594+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:59.171558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":106954752,"num_objects":26,"num_object_clones":0,"num_object_copies":52,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":26,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":38,"num_write_kb":108544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669046+0000","last_change":"2024-04-24T13:33:49.283103+0000","last_active":"2024-04-24T13:34:35.669046+0000","last_peered":"2024-04-24T13:34:35.669046+0000","last_clean":"2024-04-24T13:34:35.669046+0000","last_became_active":"2024-04-24T13:33:49.282772+0000","last_became_peered":"2024-04-24T13:33:49.282772+0000","last_unstale":"2024-04-24T13:34:35.669046+0000","last_undegraded":"2024-04-24T13:34:35.669046+0000","last_fullsized":"2024-04-24T13:34:35.669046+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:44.215595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"132'25","reported_seq":121,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591993+0000","last_change":"2024-04-24T13:33:09.934600+0000","last_active":"2024-04-24T13:34:34.591993+0000","last_peered":"2024-04-24T13:34:34.591993+0000","last_clean":"2024-04-24T13:34:34.591993+0000","last_became_active":"2024-04-24T13:33:08.732254+0000","last_became_peered":"2024-04-24T13:33:08.732254+0000","last_unstale":"2024-04-24T13:34:34.591993+0000","last_undegraded":"2024-04-24T13:34:34.591993+0000","last_fullsized":"2024-04-24T13:34:34.591993+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:35.846866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4653,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":27,"num_read_kb":18,"num_write":18,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664957+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:34:35.664957+0000","last_peered":"2024-04-24T13:34:35.664957+0000","last_clean":"2024-04-24T13:34:35.664957+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:34:35.664957+0000","last_undegraded":"2024-04-24T13:34:35.664957+0000","last_fullsized":"2024-04-24T13:34:35.664957+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:17:42.047948+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670236+0000","last_change":"2024-04-24T13:33:49.295971+0000","last_active":"2024-04-24T13:34:35.670236+0000","last_peered":"2024-04-24T13:34:35.670236+0000","last_clean":"2024-04-24T13:34:35.670236+0000","last_became_active":"2024-04-24T13:33:49.294486+0000","last_became_peered":"2024-04-24T13:33:49.294486+0000","last_unstale":"2024-04-24T13:34:35.670236+0000","last_undegraded":"2024-04-24T13:34:35.670236+0000","last_fullsized":"2024-04-24T13:34:35.670236+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:53:43.527494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"105'6","reported_seq":147,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667474+0000","last_change":"2024-04-24T13:32:32.751387+0000","last_active":"2024-04-24T13:34:35.667474+0000","last_peered":"2024-04-24T13:34:35.667474+0000","last_clean":"2024-04-24T13:34:35.667474+0000","last_became_active":"2024-04-24T13:32:32.741990+0000","last_became_peered":"2024-04-24T13:32:32.741990+0000","last_unstale":"2024-04-24T13:34:35.667474+0000","last_undegraded":"2024-04-24T13:34:35.667474+0000","last_fullsized":"2024-04-24T13:34:35.667474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:49.789798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"131'23","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595783+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:34:34.595783+0000","last_peered":"2024-04-24T13:34:34.595783+0000","last_clean":"2024-04-24T13:34:34.595783+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:34:34.595783+0000","last_undegraded":"2024-04-24T13:34:34.595783+0000","last_fullsized":"2024-04-24T13:34:34.595783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":96468992,"num_objects":23,"num_object_clones":0,"num_object_copies":46,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":23,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":23,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593550+0000","last_change":"2024-04-24T13:33:08.705125+0000","last_active":"2024-04-24T13:34:34.593550+0000","last_peered":"2024-04-24T13:34:34.593550+0000","last_clean":"2024-04-24T13:34:34.593550+0000","last_became_active":"2024-04-24T13:33:08.704735+0000","last_became_peered":"2024-04-24T13:33:08.704735+0000","last_unstale":"2024-04-24T13:34:34.593550+0000","last_undegraded":"2024-04-24T13:34:34.593550+0000","last_fullsized":"2024-04-24T13:34:34.593550+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:14.183681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"132'18","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664908+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:34:35.664908+0000","last_peered":"2024-04-24T13:34:35.664908+0000","last_clean":"2024-04-24T13:34:35.664908+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:34:35.664908+0000","last_undegraded":"2024-04-24T13:34:35.664908+0000","last_fullsized":"2024-04-24T13:34:35.664908+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:49.496921+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667249+0000","last_change":"2024-04-24T13:33:49.289409+0000","last_active":"2024-04-24T13:34:35.667249+0000","last_peered":"2024-04-24T13:34:35.667249+0000","last_clean":"2024-04-24T13:34:35.667249+0000","last_became_active":"2024-04-24T13:33:49.288970+0000","last_became_peered":"2024-04-24T13:33:49.288970+0000","last_unstale":"2024-04-24T13:34:35.667249+0000","last_undegraded":"2024-04-24T13:34:35.667249+0000","last_fullsized":"2024-04-24T13:34:35.667249+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:39.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556026+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:34:35.556026+0000","last_peered":"2024-04-24T13:34:35.556026+0000","last_clean":"2024-04-24T13:34:35.556026+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:34:35.556026+0000","last_undegraded":"2024-04-24T13:34:35.556026+0000","last_fullsized":"2024-04-24T13:34:35.556026+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:37:51.933398+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"105'10","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592552+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:34:34.592552+0000","last_peered":"2024-04-24T13:34:34.592552+0000","last_clean":"2024-04-24T13:34:34.592552+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:34:34.592552+0000","last_undegraded":"2024-04-24T13:34:34.592552+0000","last_fullsized":"2024-04-24T13:34:34.592552+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"131'19","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556282+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:34:35.556282+0000","last_peered":"2024-04-24T13:34:35.556282+0000","last_clean":"2024-04-24T13:34:35.556282+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:34:35.556282+0000","last_undegraded":"2024-04-24T13:34:35.556282+0000","last_fullsized":"2024-04-24T13:34:35.556282+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:30:48.374609+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":79691776,"num_objects":19,"num_object_clones":0,"num_object_copies":38,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":19,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":19,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587731+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:34:34.587731+0000","last_peered":"2024-04-24T13:34:34.587731+0000","last_clean":"2024-04-24T13:34:34.587731+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:34:34.587731+0000","last_undegraded":"2024-04-24T13:34:34.587731+0000","last_fullsized":"2024-04-24T13:34:34.587731+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:37:08.171495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"132'13","reported_seq":181,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665742+0000","last_change":"2024-04-24T13:33:51.167111+0000","last_active":"2024-04-24T13:34:35.665742+0000","last_peered":"2024-04-24T13:34:35.665742+0000","last_clean":"2024-04-24T13:34:35.665742+0000","last_became_active":"2024-04-24T13:33:49.302159+0000","last_became_peered":"2024-04-24T13:33:49.302159+0000","last_unstale":"2024-04-24T13:34:35.665742+0000","last_undegraded":"2024-04-24T13:34:35.665742+0000","last_fullsized":"2024-04-24T13:34:35.665742+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":13,"log_dups_size":0,"ondisk_log_size":13,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:21.719835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":11,"num_read_kb":7,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588137+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:34:34.588137+0000","last_peered":"2024-04-24T13:34:34.588137+0000","last_clean":"2024-04-24T13:34:34.588137+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:34:34.588137+0000","last_undegraded":"2024-04-24T13:34:34.588137+0000","last_fullsized":"2024-04-24T13:34:34.588137+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:49.167509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"82'2","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670276+0000","last_change":"2024-04-24T13:33:54.657281+0000","last_active":"2024-04-24T13:34:35.670276+0000","last_peered":"2024-04-24T13:34:35.670276+0000","last_clean":"2024-04-24T13:34:35.670276+0000","last_became_active":"2024-04-24T13:33:49.303239+0000","last_became_peered":"2024-04-24T13:33:49.303239+0000","last_unstale":"2024-04-24T13:34:35.670276+0000","last_undegraded":"2024-04-24T13:34:35.670276+0000","last_fullsized":"2024-04-24T13:34:35.670276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:32.797578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"82'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588230+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:34:34.588230+0000","last_peered":"2024-04-24T13:34:34.588230+0000","last_clean":"2024-04-24T13:34:34.588230+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:34:34.588230+0000","last_undegraded":"2024-04-24T13:34:34.588230+0000","last_fullsized":"2024-04-24T13:34:34.588230+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:44:50.188386+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"131'21","reported_seq":193,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665984+0000","last_change":"2024-04-24T13:33:09.073468+0000","last_active":"2024-04-24T13:34:35.665984+0000","last_peered":"2024-04-24T13:34:35.665984+0000","last_clean":"2024-04-24T13:34:35.665984+0000","last_became_active":"2024-04-24T13:33:08.725822+0000","last_became_peered":"2024-04-24T13:33:08.725822+0000","last_unstale":"2024-04-24T13:34:35.665984+0000","last_undegraded":"2024-04-24T13:34:35.665984+0000","last_fullsized":"2024-04-24T13:34:35.665984+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:24:41.185601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":21,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528798+0000","last_change":"2024-04-24T13:33:09.078708+0000","last_active":"2024-04-24T13:34:35.528798+0000","last_peered":"2024-04-24T13:34:35.528798+0000","last_clean":"2024-04-24T13:34:35.528798+0000","last_became_active":"2024-04-24T13:33:08.726873+0000","last_became_peered":"2024-04-24T13:33:08.726873+0000","last_unstale":"2024-04-24T13:34:35.528798+0000","last_undegraded":"2024-04-24T13:34:35.528798+0000","last_fullsized":"2024-04-24T13:34:35.528798+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:53:23.482374+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"132'17","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588566+0000","last_change":"2024-04-24T13:33:09.087185+0000","last_active":"2024-04-24T13:34:34.588566+0000","last_peered":"2024-04-24T13:34:34.588566+0000","last_clean":"2024-04-24T13:34:34.588566+0000","last_became_active":"2024-04-24T13:33:08.726347+0000","last_became_peered":"2024-04-24T13:33:08.726347+0000","last_unstale":"2024-04-24T13:34:34.588566+0000","last_undegraded":"2024-04-24T13:34:34.588566+0000","last_fullsized":"2024-04-24T13:34:34.588566+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:37.412890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":17,"num_read_kb":11,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665180+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:34:35.665180+0000","last_peered":"2024-04-24T13:34:35.665180+0000","last_clean":"2024-04-24T13:34:35.665180+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:34:35.665180+0000","last_undegraded":"2024-04-24T13:34:35.665180+0000","last_fullsized":"2024-04-24T13:34:35.665180+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:33:07.654199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589644+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:34:34.589644+0000","last_peered":"2024-04-24T13:34:34.589644+0000","last_clean":"2024-04-24T13:34:34.589644+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:34:34.589644+0000","last_undegraded":"2024-04-24T13:34:34.589644+0000","last_fullsized":"2024-04-24T13:34:34.589644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:39:22.564923+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"132'10","reported_seq":303,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529693+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:34:35.529693+0000","last_peered":"2024-04-24T13:34:35.529693+0000","last_clean":"2024-04-24T13:34:35.529693+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:34:35.529693+0000","last_undegraded":"2024-04-24T13:34:35.529693+0000","last_fullsized":"2024-04-24T13:34:35.529693+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"130'14","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666878+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:34:35.666878+0000","last_peered":"2024-04-24T13:34:35.666878+0000","last_clean":"2024-04-24T13:34:35.666878+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:34:35.666878+0000","last_undegraded":"2024-04-24T13:34:35.666878+0000","last_fullsized":"2024-04-24T13:34:35.666878+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":58720256,"num_objects":14,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":14,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":14,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"105'12","reported_seq":303,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.526585+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:34:35.526585+0000","last_peered":"2024-04-24T13:34:35.526585+0000","last_clean":"2024-04-24T13:34:35.526585+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:34:35.526585+0000","last_undegraded":"2024-04-24T13:34:35.526585+0000","last_fullsized":"2024-04-24T13:34:35.526585+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:39:11.445674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"132'20","reported_seq":311,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665952+0000","last_change":"2024-04-24T13:33:09.324802+0000","last_active":"2024-04-24T13:34:35.665952+0000","last_peered":"2024-04-24T13:34:35.665952+0000","last_clean":"2024-04-24T13:34:35.665952+0000","last_became_active":"2024-04-24T13:33:08.725876+0000","last_became_peered":"2024-04-24T13:33:08.725876+0000","last_unstale":"2024-04-24T13:34:35.665952+0000","last_undegraded":"2024-04-24T13:34:35.665952+0000","last_fullsized":"2024-04-24T13:34:35.665952+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:21:58.951897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":30,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"82'2","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594991+0000","last_change":"2024-04-24T13:33:53.237778+0000","last_active":"2024-04-24T13:34:34.594991+0000","last_peered":"2024-04-24T13:34:34.594991+0000","last_clean":"2024-04-24T13:34:34.594991+0000","last_became_active":"2024-04-24T13:33:49.302722+0000","last_became_peered":"2024-04-24T13:33:49.302722+0000","last_unstale":"2024-04-24T13:34:34.594991+0000","last_undegraded":"2024-04-24T13:34:34.594991+0000","last_fullsized":"2024-04-24T13:34:34.594991+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:52:06.190295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"132'28","reported_seq":143,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592901+0000","last_change":"2024-04-24T13:33:09.548908+0000","last_active":"2024-04-24T13:34:34.592901+0000","last_peered":"2024-04-24T13:34:34.592901+0000","last_clean":"2024-04-24T13:34:34.592901+0000","last_became_active":"2024-04-24T13:33:08.720010+0000","last_became_peered":"2024-04-24T13:33:08.720010+0000","last_unstale":"2024-04-24T13:34:34.592901+0000","last_undegraded":"2024-04-24T13:34:34.592901+0000","last_fullsized":"2024-04-24T13:34:34.592901+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:06.195033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"114'12","reported_seq":320,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525327+0000","last_change":"2024-04-24T13:33:49.678468+0000","last_active":"2024-04-24T13:34:35.525327+0000","last_peered":"2024-04-24T13:34:35.525327+0000","last_clean":"2024-04-24T13:34:35.525327+0000","last_became_active":"2024-04-24T13:33:49.289642+0000","last_became_peered":"2024-04-24T13:33:49.289642+0000","last_unstale":"2024-04-24T13:34:35.525327+0000","last_undegraded":"2024-04-24T13:34:35.525327+0000","last_fullsized":"2024-04-24T13:34:35.525327+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:37.408920+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"132'31","reported_seq":296,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666117+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:34:35.666117+0000","last_peered":"2024-04-24T13:34:35.666117+0000","last_clean":"2024-04-24T13:34:35.666117+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:34:35.666117+0000","last_undegraded":"2024-04-24T13:34:35.666117+0000","last_fullsized":"2024-04-24T13:34:35.666117+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:18:40.738003+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":130023424,"num_objects":31,"num_object_clones":0,"num_object_copies":62,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":31,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":31,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"132'4","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554985+0000","last_change":"2024-04-24T13:33:51.611283+0000","last_active":"2024-04-24T13:34:35.554985+0000","last_peered":"2024-04-24T13:34:35.554985+0000","last_clean":"2024-04-24T13:34:35.554985+0000","last_became_active":"2024-04-24T13:33:49.304888+0000","last_became_peered":"2024-04-24T13:33:49.304888+0000","last_unstale":"2024-04-24T13:34:35.554985+0000","last_undegraded":"2024-04-24T13:34:35.554985+0000","last_fullsized":"2024-04-24T13:34:35.554985+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:27:18.833477+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"131'22","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556718+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:34:35.556718+0000","last_peered":"2024-04-24T13:34:35.556718+0000","last_clean":"2024-04-24T13:34:35.556718+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:34:35.556718+0000","last_undegraded":"2024-04-24T13:34:35.556718+0000","last_fullsized":"2024-04-24T13:34:35.556718+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:59:25.645354+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92274688,"num_objects":22,"num_object_clones":0,"num_object_copies":44,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":22,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":22,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"81'2","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589524+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:34:34.589524+0000","last_peered":"2024-04-24T13:34:34.589524+0000","last_clean":"2024-04-24T13:34:34.589524+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:34:34.589524+0000","last_undegraded":"2024-04-24T13:34:34.589524+0000","last_fullsized":"2024-04-24T13:34:34.589524+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:00.201640+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"131'18","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.526189+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:34:35.526189+0000","last_peered":"2024-04-24T13:34:35.526189+0000","last_clean":"2024-04-24T13:34:35.526189+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:34:35.526189+0000","last_undegraded":"2024-04-24T13:34:35.526189+0000","last_fullsized":"2024-04-24T13:34:35.526189+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:24.758484+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"132'12","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554322+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:34:35.554322+0000","last_peered":"2024-04-24T13:34:35.554322+0000","last_clean":"2024-04-24T13:34:35.554322+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:34:35.554322+0000","last_undegraded":"2024-04-24T13:34:35.554322+0000","last_fullsized":"2024-04-24T13:34:35.554322+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"131'29","reported_seq":340,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671592+0000","last_change":"2024-04-24T13:33:50.237368+0000","last_active":"2024-04-24T13:34:35.671592+0000","last_peered":"2024-04-24T13:34:35.671592+0000","last_clean":"2024-04-24T13:34:35.671592+0000","last_became_active":"2024-04-24T13:33:49.301145+0000","last_became_peered":"2024-04-24T13:33:49.301145+0000","last_unstale":"2024-04-24T13:34:35.671592+0000","last_undegraded":"2024-04-24T13:34:35.671592+0000","last_fullsized":"2024-04-24T13:34:35.671592+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:57:21.677851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":121634816,"num_objects":29,"num_object_clones":0,"num_object_copies":58,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":29,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":29,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666722+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:34:35.666722+0000","last_peered":"2024-04-24T13:34:35.666722+0000","last_clean":"2024-04-24T13:34:35.666722+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:34:35.666722+0000","last_undegraded":"2024-04-24T13:34:35.666722+0000","last_fullsized":"2024-04-24T13:34:35.666722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"131'16","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556649+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:34:35.556649+0000","last_peered":"2024-04-24T13:34:35.556649+0000","last_clean":"2024-04-24T13:34:35.556649+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:34:35.556649+0000","last_undegraded":"2024-04-24T13:34:35.556649+0000","last_fullsized":"2024-04-24T13:34:35.556649+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:29.295243+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":67108864,"num_objects":16,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":16,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":16,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"105'8","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668052+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:34:35.668052+0000","last_peered":"2024-04-24T13:34:35.668052+0000","last_clean":"2024-04-24T13:34:35.668052+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:34:35.668052+0000","last_undegraded":"2024-04-24T13:34:35.668052+0000","last_fullsized":"2024-04-24T13:34:35.668052+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"131'28","reported_seq":141,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593813+0000","last_change":"2024-04-24T13:33:09.287304+0000","last_active":"2024-04-24T13:34:34.593813+0000","last_peered":"2024-04-24T13:34:34.593813+0000","last_clean":"2024-04-24T13:34:34.593813+0000","last_became_active":"2024-04-24T13:33:08.716282+0000","last_became_peered":"2024-04-24T13:33:08.716282+0000","last_unstale":"2024-04-24T13:34:34.593813+0000","last_undegraded":"2024-04-24T13:34:34.593813+0000","last_fullsized":"2024-04-24T13:34:34.593813+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591204+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:34:34.591204+0000","last_peered":"2024-04-24T13:34:34.591204+0000","last_clean":"2024-04-24T13:34:34.591204+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:34:34.591204+0000","last_undegraded":"2024-04-24T13:34:34.591204+0000","last_fullsized":"2024-04-24T13:34:34.591204+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:54:03.908288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"132'28","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554550+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:34:35.554550+0000","last_peered":"2024-04-24T13:34:35.554550+0000","last_clean":"2024-04-24T13:34:35.554550+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:34:35.554550+0000","last_undegraded":"2024-04-24T13:34:35.554550+0000","last_fullsized":"2024-04-24T13:34:35.554550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:10.031946+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":117440512,"num_objects":28,"num_object_clones":0,"num_object_copies":56,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":28,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":28,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665527+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:34:35.665527+0000","last_peered":"2024-04-24T13:34:35.665527+0000","last_clean":"2024-04-24T13:34:35.665527+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:34:35.665527+0000","last_undegraded":"2024-04-24T13:34:35.665527+0000","last_fullsized":"2024-04-24T13:34:35.665527+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:26.773048+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"131'23","reported_seq":165,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592406+0000","last_change":"2024-04-24T13:33:51.593184+0000","last_active":"2024-04-24T13:34:34.592406+0000","last_peered":"2024-04-24T13:34:34.592406+0000","last_clean":"2024-04-24T13:34:34.592406+0000","last_became_active":"2024-04-24T13:33:49.289463+0000","last_became_peered":"2024-04-24T13:33:49.289463+0000","last_unstale":"2024-04-24T13:34:34.592406+0000","last_undegraded":"2024-04-24T13:34:34.592406+0000","last_fullsized":"2024-04-24T13:34:34.592406+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:42:20.618809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":88080384,"num_objects":21,"num_object_clones":0,"num_object_copies":42,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":21,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":33,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"82'6","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590679+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:34:34.590679+0000","last_peered":"2024-04-24T13:34:34.590679+0000","last_clean":"2024-04-24T13:34:34.590679+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:34:34.590679+0000","last_undegraded":"2024-04-24T13:34:34.590679+0000","last_fullsized":"2024-04-24T13:34:34.590679+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"131'24","reported_seq":334,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666298+0000","last_change":"2024-04-24T13:33:52.627571+0000","last_active":"2024-04-24T13:34:35.666298+0000","last_peered":"2024-04-24T13:34:35.666298+0000","last_clean":"2024-04-24T13:34:35.666298+0000","last_became_active":"2024-04-24T13:33:49.302184+0000","last_became_peered":"2024-04-24T13:33:49.302184+0000","last_unstale":"2024-04-24T13:34:35.666298+0000","last_undegraded":"2024-04-24T13:34:35.666298+0000","last_fullsized":"2024-04-24T13:34:35.666298+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:16:24.066172+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":98566144,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":69206016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"82'2","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669580+0000","last_change":"2024-04-24T13:33:53.884916+0000","last_active":"2024-04-24T13:34:35.669580+0000","last_peered":"2024-04-24T13:34:35.669580+0000","last_clean":"2024-04-24T13:34:35.669580+0000","last_became_active":"2024-04-24T13:33:49.300182+0000","last_became_peered":"2024-04-24T13:33:49.300182+0000","last_unstale":"2024-04-24T13:34:35.669580+0000","last_undegraded":"2024-04-24T13:34:35.669580+0000","last_fullsized":"2024-04-24T13:34:35.669580+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:30.442779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"132'30","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668550+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:34:35.668550+0000","last_peered":"2024-04-24T13:34:35.668550+0000","last_clean":"2024-04-24T13:34:35.668550+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:34:35.668550+0000","last_undegraded":"2024-04-24T13:34:35.668550+0000","last_fullsized":"2024-04-24T13:34:35.668550+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":125829120,"num_objects":30,"num_object_clones":0,"num_object_copies":60,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":30,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":30,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"82'4","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665279+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:34:35.665279+0000","last_peered":"2024-04-24T13:34:35.665279+0000","last_clean":"2024-04-24T13:34:35.665279+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:34:35.665279+0000","last_undegraded":"2024-04-24T13:34:35.665279+0000","last_fullsized":"2024-04-24T13:34:35.665279+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:32:35.507517+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"131'17","reported_seq":89,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669962+0000","last_change":"2024-04-24T13:33:54.184096+0000","last_active":"2024-04-24T13:34:35.669962+0000","last_peered":"2024-04-24T13:34:35.669962+0000","last_clean":"2024-04-24T13:34:35.669962+0000","last_became_active":"2024-04-24T13:33:49.299554+0000","last_became_peered":"2024-04-24T13:33:49.299554+0000","last_unstale":"2024-04-24T13:34:35.669962+0000","last_undegraded":"2024-04-24T13:34:35.669962+0000","last_fullsized":"2024-04-24T13:34:35.669962+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:18.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":69206016,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"82'2","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554228+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:34:35.554228+0000","last_peered":"2024-04-24T13:34:35.554228+0000","last_clean":"2024-04-24T13:34:35.554228+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:34:35.554228+0000","last_undegraded":"2024-04-24T13:34:35.554228+0000","last_fullsized":"2024-04-24T13:34:35.554228+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:58:06.833677+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"131'18","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666030+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:34:35.666030+0000","last_peered":"2024-04-24T13:34:35.666030+0000","last_clean":"2024-04-24T13:34:35.666030+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:34:35.666030+0000","last_undegraded":"2024-04-24T13:34:35.666030+0000","last_fullsized":"2024-04-24T13:34:35.666030+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:41.110212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":75497472,"num_objects":18,"num_object_clones":0,"num_object_copies":36,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":18,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":18,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667336+0000","last_change":"2024-04-24T13:33:49.302008+0000","last_active":"2024-04-24T13:34:35.667336+0000","last_peered":"2024-04-24T13:34:35.667336+0000","last_clean":"2024-04-24T13:34:35.667336+0000","last_became_active":"2024-04-24T13:33:49.300135+0000","last_became_peered":"2024-04-24T13:33:49.300135+0000","last_unstale":"2024-04-24T13:34:35.667336+0000","last_undegraded":"2024-04-24T13:34:35.667336+0000","last_fullsized":"2024-04-24T13:34:35.667336+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:02.680781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"131'24","reported_seq":177,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595741+0000","last_change":"2024-04-24T13:33:53.222020+0000","last_active":"2024-04-24T13:34:34.595741+0000","last_peered":"2024-04-24T13:34:34.595741+0000","last_clean":"2024-04-24T13:34:34.595741+0000","last_became_active":"2024-04-24T13:33:49.292734+0000","last_became_peered":"2024-04-24T13:33:49.292734+0000","last_unstale":"2024-04-24T13:34:34.595741+0000","last_undegraded":"2024-04-24T13:34:34.595741+0000","last_fullsized":"2024-04-24T13:34:34.595741+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:13.333265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":100663296,"num_objects":24,"num_object_clones":0,"num_object_copies":48,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":24,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":24,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"131'25","reported_seq":139,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594450+0000","last_change":"2024-04-24T13:33:10.398117+0000","last_active":"2024-04-24T13:34:34.594450+0000","last_peered":"2024-04-24T13:34:34.594450+0000","last_clean":"2024-04-24T13:34:34.594450+0000","last_became_active":"2024-04-24T13:33:08.735696+0000","last_became_peered":"2024-04-24T13:33:08.735696+0000","last_unstale":"2024-04-24T13:34:34.594450+0000","last_undegraded":"2024-04-24T13:34:34.594450+0000","last_fullsized":"2024-04-24T13:34:34.594450+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:01:26.139144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":104857600,"num_objects":25,"num_object_clones":0,"num_object_copies":50,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":25,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":25,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"82'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668044+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:34:35.668044+0000","last_peered":"2024-04-24T13:34:35.668044+0000","last_clean":"2024-04-24T13:34:35.668044+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:34:35.668044+0000","last_undegraded":"2024-04-24T13:34:35.668044+0000","last_fullsized":"2024-04-24T13:34:35.668044+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:09.601635+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"132'17","reported_seq":283,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529204+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:34:35.529204+0000","last_peered":"2024-04-24T13:34:35.529204+0000","last_clean":"2024-04-24T13:34:35.529204+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:34:35.529204+0000","last_undegraded":"2024-04-24T13:34:35.529204+0000","last_fullsized":"2024-04-24T13:34:35.529204+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:19:53.837823+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":71303168,"num_objects":17,"num_object_clones":0,"num_object_copies":34,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":17,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":17,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"82'6","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595392+0000","last_change":"2024-04-24T13:33:09.917888+0000","last_active":"2024-04-24T13:34:34.595392+0000","last_peered":"2024-04-24T13:34:34.595392+0000","last_clean":"2024-04-24T13:34:34.595392+0000","last_became_active":"2024-04-24T13:33:08.732489+0000","last_became_peered":"2024-04-24T13:33:08.732489+0000","last_unstale":"2024-04-24T13:34:34.595392+0000","last_undegraded":"2024-04-24T13:34:34.595392+0000","last_fullsized":"2024-04-24T13:34:34.595392+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:16.213872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":342,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":194,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1091,"ondisk_log_size":1091,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":378948,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":842,"num_read_kb":607,"num_write":465,"num_write_kb":420,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":143,"num_bytes_recovered":62549,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1015808,"data_stored":710064,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":760,"ondisk_log_size":760,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":339,"num_read_kb":339,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2233,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1458,"num_read_kb":1426,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":6299844608,"num_objects":1504,"num_object_clones":0,"num_object_copies":3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1504,"num_whiteouts":0,"num_read":32,"num_read_kb":24,"num_write":1600,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":449,"num_bytes_recovered":1849688064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":12599689216,"data_stored":12599689216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1520,"ondisk_log_size":1520,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574907,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1887072,"kb_used_data":1851736,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92484768,"statfs":{"total":96636764160,"available":94704402432,"internally_reserved":0,"allocated":1896177664,"data_stored":1895415815,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":36174282},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574907,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1192132,"kb_used_data":1160956,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":93179708,"statfs":{"total":96636764160,"available":95416020992,"internally_reserved":0,"allocated":1188818944,"data_stored":1188084563,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":31914438},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574908,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2087576,"kb_used_data":2052240,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92284264,"statfs":{"total":96636764160,"available":94499086336,"internally_reserved":0,"allocated":2101493760,"data_stored":2100698156,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574908,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1542340,"kb_used_data":1511152,"kb_used_omap":1,"kb_used_meta":31166,"kb_avail":92829500,"statfs":{"total":96636764160,"available":95057408000,"internally_reserved":0,"allocated":1547419648,"data_stored":1546697053,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":31914437},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574907,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":2030028,"kb_used_data":1994692,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92341812,"statfs":{"total":96636764160,"available":94558015488,"internally_reserved":0,"allocated":2042564608,"data_stored":2041802088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574908,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1169668,"kb_used_data":1134332,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93202172,"statfs":{"total":96636764160,"available":95439024128,"internally_reserved":0,"allocated":1161555968,"data_stored":1160821827,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574909,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":983508,"kb_used_data":948172,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":93388332,"statfs":{"total":96636764160,"available":95629651968,"internally_reserved":0,"allocated":970928128,"data_stored":970158184,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574908,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":1702740,"kb_used_data":1667400,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":92669100,"statfs":{"total":96636764160,"available":94893158400,"internally_reserved":0,"allocated":1707417600,"data_stored":1706672098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":1704984576,"data_stored":1704984576,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":968884224,"data_stored":968884224,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":1159725056,"data_stored":1159725056,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":2040528896,"data_stored":2040528896,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":1545601024,"data_stored":1545601024,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":2099249152,"data_stored":2099249152,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":1186988032,"data_stored":1186988032,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":1893728256,"data_stored":1893728256,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":36864,"data_stored":1437,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":176376,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":997,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":225280,"data_stored":177072,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":417792,"data_stored":351674,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:34:48.876 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-04-24T13:34:49.219 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:34:49.219 INFO:teuthology.orchestra.run.smithi071.stdout:{"epoch":150,"fsid":"6c1fd1bb-bd7e-4ae7-9c5d-7d4b0afbc5c8","created":"2024-04-24T13:29:54.500837+0000","modified":"2024-04-24T13:34:34.578879+0000","last_up_change":"2024-04-24T13:30:06.614065+0000","last_in_change":"2024-04-24T13:33:48.485877+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":4,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-04-24T13:30:07.251223+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"16","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":8,"score_stable":8,"optimal_score":0.25,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-04-24T13:30:13.385113+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.9900000095367432,"score_stable":1.9900000095367432,"optimal_score":0.87999999523162842,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-04-24T13:30:20.167043+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-04-24T13:30:21.533214+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"24","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.8799999952316284,"score_stable":1.8799999952316284,"optimal_score":1,"raw_score_acting":1.8799999952316284,"raw_score_stable":1.8799999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-04-24T13:30:23.455631+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"26","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-04-24T13:30:25.363907+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"28","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-04-24T13:30:27.261843+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"30","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.75,"score_stable":1.75,"optimal_score":1,"raw_score_acting":1.75,"raw_score_stable":1.75,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-04-24T13:30:29.393640+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"32","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"dcf17737-d21a-4731-8a14-4b008f82e1b8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":128,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6800","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6801","nonce":1371554644}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6802","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6803","nonce":1371554644}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6809","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6812","nonce":1371554644}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6804","nonce":1371554644},{"type":"v1","addr":"172.21.15.71:6806","nonce":1371554644}]},"public_addr":"172.21.15.71:6801/1371554644","cluster_addr":"172.21.15.71:6803/1371554644","heartbeat_back_addr":"172.21.15.71:6812/1371554644","heartbeat_front_addr":"172.21.15.71:6806/1371554644","state":["exists","up"]},{"osd":1,"uuid":"559511d8-704f-48ae-a330-331a8a18486a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":126,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6824","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6825","nonce":2907970623}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6826","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6827","nonce":2907970623}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6830","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6831","nonce":2907970623}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6828","nonce":2907970623},{"type":"v1","addr":"172.21.15.71:6829","nonce":2907970623}]},"public_addr":"172.21.15.71:6825/2907970623","cluster_addr":"172.21.15.71:6827/2907970623","heartbeat_back_addr":"172.21.15.71:6831/2907970623","heartbeat_front_addr":"172.21.15.71:6829/2907970623","state":["exists","up"]},{"osd":2,"uuid":"496cf95c-01c4-4537-ba79-35c2ad152201","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6805","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6808","nonce":747727017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6811","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6813","nonce":747727017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6822","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6823","nonce":747727017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6816","nonce":747727017},{"type":"v1","addr":"172.21.15.71:6819","nonce":747727017}]},"public_addr":"172.21.15.71:6808/747727017","cluster_addr":"172.21.15.71:6813/747727017","heartbeat_back_addr":"172.21.15.71:6823/747727017","heartbeat_front_addr":"172.21.15.71:6819/747727017","state":["exists","up"]},{"osd":3,"uuid":"5ce9d307-23e5-4bb9-8035-0827520a6d80","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6807","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6810","nonce":2258589678}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6814","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6815","nonce":2258589678}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6820","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6821","nonce":2258589678}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.71:6817","nonce":2258589678},{"type":"v1","addr":"172.21.15.71:6818","nonce":2258589678}]},"public_addr":"172.21.15.71:6810/2258589678","cluster_addr":"172.21.15.71:6815/2258589678","heartbeat_back_addr":"172.21.15.71:6821/2258589678","heartbeat_front_addr":"172.21.15.71:6818/2258589678","state":["exists","up"]},{"osd":4,"uuid":"6d6e5b3c-301d-4b2c-996f-17d13224f780","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":103,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6810","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6814","nonce":2264053969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6817","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6821","nonce":2264053969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6828","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6830","nonce":2264053969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6824","nonce":2264053969},{"type":"v1","addr":"172.21.15.138:6826","nonce":2264053969}]},"public_addr":"172.21.15.138:6814/2264053969","cluster_addr":"172.21.15.138:6821/2264053969","heartbeat_back_addr":"172.21.15.138:6830/2264053969","heartbeat_front_addr":"172.21.15.138:6826/2264053969","state":["exists","up"]},{"osd":5,"uuid":"b3d18c54-5a9a-4215-8b40-3e796ac2fed4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6812","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6815","nonce":942955714}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6819","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6822","nonce":942955714}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6829","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6831","nonce":942955714}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6825","nonce":942955714},{"type":"v1","addr":"172.21.15.138:6827","nonce":942955714}]},"public_addr":"172.21.15.138:6815/942955714","cluster_addr":"172.21.15.138:6822/942955714","heartbeat_back_addr":"172.21.15.138:6831/942955714","heartbeat_front_addr":"172.21.15.138:6827/942955714","state":["exists","up"]},{"osd":6,"uuid":"12d21ba0-8670-470b-8fd5-a02349ecb4d4","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":124,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6808","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6809","nonce":889830629}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6811","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6813","nonce":889830629}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6820","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6823","nonce":889830629}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6816","nonce":889830629},{"type":"v1","addr":"172.21.15.138:6818","nonce":889830629}]},"public_addr":"172.21.15.138:6809/889830629","cluster_addr":"172.21.15.138:6813/889830629","heartbeat_back_addr":"172.21.15.138:6823/889830629","heartbeat_front_addr":"172.21.15.138:6818/889830629","state":["exists","up"]},{"osd":7,"uuid":"dc7df6bb-ed8f-49f6-aa0a-ca522e19f5ce","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":129,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6800","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6801","nonce":2015291049}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6802","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6803","nonce":2015291049}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6806","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6807","nonce":2015291049}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.138:6804","nonce":2015291049},{"type":"v1","addr":"172.21.15.138:6805","nonce":2015291049}]},"public_addr":"172.21.15.138:6801/2015291049","cluster_addr":"172.21.15.138:6803/2015291049","heartbeat_back_addr":"172.21.15.138:6807/2015291049","heartbeat_front_addr":"172.21.15.138:6805/2015291049","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.268101+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.247572+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.186485+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.184532+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.157242+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.126293+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.118991+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540701547738038271,"old_weight":0,"last_purged_snaps_scrub":"2024-04-24T13:30:03.213395+0000","dead_epoch":0}],"pg_upmap":[{"pgid":"4.1a","osds":[6,2]}],"pg_upmap_items":[{"pgid":"3.3","mappings":[{"from":0,"to":1}]},{"pgid":"3.a","mappings":[{"from":4,"to":2}]},{"pgid":"3.f","mappings":[{"from":4,"to":2}]},{"pgid":"3.14","mappings":[{"from":4,"to":2}]},{"pgid":"3.1f","mappings":[{"from":0,"to":2}]},{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.a","mappings":[{"from":1,"to":2}]},{"pgid":"4.19","mappings":[{"from":3,"to":5}]},{"pgid":"6.1b","mappings":[{"from":3,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-04-24T13:34:50.239 INFO:tasks.ceph:Scrubbing osd.0 2024-04-24T13:34:50.239 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-04-24T13:34:50.400 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:50.400 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T13:34:50.400 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:50.418 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-04-24T13:34:50.702 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 0 to deep-scrub 2024-04-24T13:34:50.720 INFO:tasks.ceph:Scrubbing osd.1 2024-04-24T13:34:50.721 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-04-24T13:34:50.867 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:50.867 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T13:34:50.867 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:50.882 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-04-24T13:34:51.157 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 1 to deep-scrub 2024-04-24T13:34:51.176 INFO:tasks.ceph:Scrubbing osd.2 2024-04-24T13:34:51.176 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-04-24T13:34:51.318 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:51.318 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T13:34:51.318 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:51.334 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-04-24T13:34:51.602 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 2 to deep-scrub 2024-04-24T13:34:51.619 INFO:tasks.ceph:Scrubbing osd.3 2024-04-24T13:34:51.619 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-04-24T13:34:51.760 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:51.760 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T13:34:51.760 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:51.774 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-04-24T13:34:52.057 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 3 to deep-scrub 2024-04-24T13:34:52.076 INFO:tasks.ceph:Scrubbing osd.4 2024-04-24T13:34:52.076 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.4 config set osd_debug_deep_scrub_sleep 0 2024-04-24T13:34:52.224 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:52.225 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T13:34:52.225 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:52.241 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 4 2024-04-24T13:34:52.536 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 4 to deep-scrub 2024-04-24T13:34:52.555 INFO:tasks.ceph:Scrubbing osd.5 2024-04-24T13:34:52.555 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.5 config set osd_debug_deep_scrub_sleep 0 2024-04-24T13:34:52.695 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:52.695 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T13:34:52.695 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:52.710 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 5 2024-04-24T13:34:52.977 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 5 to deep-scrub 2024-04-24T13:34:52.996 INFO:tasks.ceph:Scrubbing osd.6 2024-04-24T13:34:52.996 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.6 config set osd_debug_deep_scrub_sleep 0 2024-04-24T13:34:53.138 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:53.138 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T13:34:53.138 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:53.151 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 6 2024-04-24T13:34:53.430 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 6 to deep-scrub 2024-04-24T13:34:53.447 INFO:tasks.ceph:Scrubbing osd.7 2024-04-24T13:34:53.447 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.7 config set osd_debug_deep_scrub_sleep 0 2024-04-24T13:34:53.585 INFO:teuthology.orchestra.run.smithi071.stdout:{ 2024-04-24T13:34:53.585 INFO:teuthology.orchestra.run.smithi071.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-04-24T13:34:53.585 INFO:teuthology.orchestra.run.smithi071.stdout:} 2024-04-24T13:34:53.600 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 7 2024-04-24T13:34:53.875 INFO:teuthology.orchestra.run.smithi071.stderr:instructed osd(s) 7 to deep-scrub 2024-04-24T13:34:53.893 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:34:54.227 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:34:54.234 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:34:54.245 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":286,"stamp":"2024-04-24T13:34:53.332788+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620002,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4876,"num_read_kb":3775,"num_write":4425,"num_write_kb":6187918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":669,"num_bytes_recovered":1850933776,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5560,"ondisk_log_size":5560,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302608,"kb_used_data":15576,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754672112,"statfs":{"total":773094113280,"available":772784242688,"internally_reserved":0,"allocated":15949824,"data_stored":9957908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":293654065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":-6300195938,"num_objects":-1504,"num_object_clones":0,"num_object_copies":-3008,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":-1504,"num_whiteouts":0,"num_read":1727,"num_read_kb":937,"num_write":1580,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.006686"},"pg_stats":[{"pgid":"3.3f","version":"150'36","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.462212+0000","last_change":"2024-04-24T13:33:52.298396+0000","last_active":"2024-04-24T13:34:47.462212+0000","last_peered":"2024-04-24T13:34:47.462212+0000","last_clean":"2024-04-24T13:34:47.462212+0000","last_became_active":"2024-04-24T13:33:49.293106+0000","last_became_peered":"2024-04-24T13:33:49.293106+0000","last_unstale":"2024-04-24T13:34:47.462212+0000","last_undegraded":"2024-04-24T13:34:47.462212+0000","last_fullsized":"2024-04-24T13:34:47.462212+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:44.520756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"82'14","reported_seq":309,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594851+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:34:34.594851+0000","last_peered":"2024-04-24T13:34:34.594851+0000","last_clean":"2024-04-24T13:34:34.594851+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:34:34.594851+0000","last_undegraded":"2024-04-24T13:34:34.594851+0000","last_fullsized":"2024-04-24T13:34:34.594851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:42:29.308072+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"150'36","reported_seq":304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.573783+0000","last_change":"2024-04-24T13:30:21.213075+0000","last_active":"2024-04-24T13:34:47.573783+0000","last_peered":"2024-04-24T13:34:47.573783+0000","last_clean":"2024-04-24T13:34:47.573783+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:34:47.573783+0000","last_undegraded":"2024-04-24T13:34:47.573783+0000","last_fullsized":"2024-04-24T13:34:47.573783+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"82'4","reported_seq":63,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669845+0000","last_change":"2024-04-24T13:33:52.687680+0000","last_active":"2024-04-24T13:34:35.669845+0000","last_peered":"2024-04-24T13:34:35.669845+0000","last_clean":"2024-04-24T13:34:35.669845+0000","last_became_active":"2024-04-24T13:33:49.293840+0000","last_became_peered":"2024-04-24T13:33:49.293840+0000","last_unstale":"2024-04-24T13:34:35.669845+0000","last_undegraded":"2024-04-24T13:34:35.669845+0000","last_fullsized":"2024-04-24T13:34:35.669845+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:13:31.744087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"150'32","reported_seq":299,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.570146+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:34:47.570146+0000","last_peered":"2024-04-24T13:34:47.570146+0000","last_clean":"2024-04-24T13:34:47.570146+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:34:47.570146+0000","last_undegraded":"2024-04-24T13:34:47.570146+0000","last_fullsized":"2024-04-24T13:34:47.570146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":42,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589359+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:34:34.589359+0000","last_peered":"2024-04-24T13:34:34.589359+0000","last_clean":"2024-04-24T13:34:34.589359+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:34:34.589359+0000","last_undegraded":"2024-04-24T13:34:34.589359+0000","last_fullsized":"2024-04-24T13:34:34.589359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"150'50","reported_seq":319,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.547106+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:34:47.547106+0000","last_peered":"2024-04-24T13:34:47.547106+0000","last_clean":"2024-04-24T13:34:47.547106+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:34:47.547106+0000","last_undegraded":"2024-04-24T13:34:47.547106+0000","last_fullsized":"2024-04-24T13:34:47.547106+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:29.753763+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"132'6","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666062+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:34:35.666062+0000","last_peered":"2024-04-24T13:34:35.666062+0000","last_clean":"2024-04-24T13:34:35.666062+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:34:35.666062+0000","last_undegraded":"2024-04-24T13:34:35.666062+0000","last_fullsized":"2024-04-24T13:34:35.666062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"150'68","reported_seq":151,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.584841+0000","last_change":"2024-04-24T13:33:53.650464+0000","last_active":"2024-04-24T13:34:47.584841+0000","last_peered":"2024-04-24T13:34:47.584841+0000","last_clean":"2024-04-24T13:34:47.584841+0000","last_became_active":"2024-04-24T13:33:49.299781+0000","last_became_peered":"2024-04-24T13:33:49.299781+0000","last_unstale":"2024-04-24T13:34:47.584841+0000","last_undegraded":"2024-04-24T13:34:47.584841+0000","last_fullsized":"2024-04-24T13:34:47.584841+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:08.408193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"82'2","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668172+0000","last_change":"2024-04-24T13:30:23.239121+0000","last_active":"2024-04-24T13:34:35.668172+0000","last_peered":"2024-04-24T13:34:35.668172+0000","last_clean":"2024-04-24T13:34:35.668172+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:34:35.668172+0000","last_undegraded":"2024-04-24T13:34:35.668172+0000","last_fullsized":"2024-04-24T13:34:35.668172+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:04.491846+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"150'60","reported_seq":328,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.565136+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:34:47.565136+0000","last_peered":"2024-04-24T13:34:47.565136+0000","last_clean":"2024-04-24T13:34:47.565136+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:34:47.565136+0000","last_undegraded":"2024-04-24T13:34:47.565136+0000","last_fullsized":"2024-04-24T13:34:47.565136+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:07:40.832894+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"82'4","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591183+0000","last_change":"2024-04-24T13:30:23.225382+0000","last_active":"2024-04-24T13:34:34.591183+0000","last_peered":"2024-04-24T13:34:34.591183+0000","last_clean":"2024-04-24T13:34:34.591183+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:34:34.591183+0000","last_undegraded":"2024-04-24T13:34:34.591183+0000","last_fullsized":"2024-04-24T13:34:34.591183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"150'58","reported_seq":138,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.533286+0000","last_change":"2024-04-24T13:33:51.145800+0000","last_active":"2024-04-24T13:34:47.533286+0000","last_peered":"2024-04-24T13:34:47.533286+0000","last_clean":"2024-04-24T13:34:47.533286+0000","last_became_active":"2024-04-24T13:33:49.287926+0000","last_became_peered":"2024-04-24T13:33:49.287926+0000","last_unstale":"2024-04-24T13:34:47.533286+0000","last_undegraded":"2024-04-24T13:34:47.533286+0000","last_fullsized":"2024-04-24T13:34:47.533286+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:22.605125+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"82'2","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595672+0000","last_change":"2024-04-24T13:33:09.792748+0000","last_active":"2024-04-24T13:34:34.595672+0000","last_peered":"2024-04-24T13:34:34.595672+0000","last_clean":"2024-04-24T13:34:34.595672+0000","last_became_active":"2024-04-24T13:33:08.725324+0000","last_became_peered":"2024-04-24T13:33:08.725324+0000","last_unstale":"2024-04-24T13:34:34.595672+0000","last_undegraded":"2024-04-24T13:34:34.595672+0000","last_fullsized":"2024-04-24T13:34:34.595672+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:20.696769+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"150'36","reported_seq":321,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.546718+0000","last_change":"2024-04-24T13:33:08.836525+0000","last_active":"2024-04-24T13:34:47.546718+0000","last_peered":"2024-04-24T13:34:47.546718+0000","last_clean":"2024-04-24T13:34:47.546718+0000","last_became_active":"2024-04-24T13:33:08.720200+0000","last_became_peered":"2024-04-24T13:33:08.720200+0000","last_unstale":"2024-04-24T13:34:47.546718+0000","last_undegraded":"2024-04-24T13:34:47.546718+0000","last_fullsized":"2024-04-24T13:34:47.546718+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"82'6","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666302+0000","last_change":"2024-04-24T13:30:23.221858+0000","last_active":"2024-04-24T13:34:35.666302+0000","last_peered":"2024-04-24T13:34:35.666302+0000","last_clean":"2024-04-24T13:34:35.666302+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:34:35.666302+0000","last_undegraded":"2024-04-24T13:34:35.666302+0000","last_fullsized":"2024-04-24T13:34:35.666302+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"86'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588611+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:34:34.588611+0000","last_peered":"2024-04-24T13:34:34.588611+0000","last_clean":"2024-04-24T13:34:34.588611+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:34:34.588611+0000","last_undegraded":"2024-04-24T13:34:34.588611+0000","last_fullsized":"2024-04-24T13:34:34.588611+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"150'48","reported_seq":125,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.567006+0000","last_change":"2024-04-24T13:33:51.801208+0000","last_active":"2024-04-24T13:34:47.567006+0000","last_peered":"2024-04-24T13:34:47.567006+0000","last_clean":"2024-04-24T13:34:47.567006+0000","last_became_active":"2024-04-24T13:33:49.287950+0000","last_became_peered":"2024-04-24T13:33:49.287950+0000","last_unstale":"2024-04-24T13:34:47.567006+0000","last_undegraded":"2024-04-24T13:34:47.567006+0000","last_fullsized":"2024-04-24T13:34:47.567006+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:09.811184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"82'4","reported_seq":63,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670154+0000","last_change":"2024-04-24T13:33:53.106900+0000","last_active":"2024-04-24T13:34:35.670154+0000","last_peered":"2024-04-24T13:34:35.670154+0000","last_clean":"2024-04-24T13:34:35.670154+0000","last_became_active":"2024-04-24T13:33:49.294597+0000","last_became_peered":"2024-04-24T13:33:49.294597+0000","last_unstale":"2024-04-24T13:34:35.670154+0000","last_undegraded":"2024-04-24T13:34:35.670154+0000","last_fullsized":"2024-04-24T13:34:35.670154+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:28.384262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"150'54","reported_seq":345,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.550928+0000","last_change":"2024-04-24T13:33:08.998015+0000","last_active":"2024-04-24T13:34:47.550928+0000","last_peered":"2024-04-24T13:34:47.550928+0000","last_clean":"2024-04-24T13:34:47.550928+0000","last_became_active":"2024-04-24T13:33:08.726581+0000","last_became_peered":"2024-04-24T13:33:08.726581+0000","last_unstale":"2024-04-24T13:34:47.550928+0000","last_undegraded":"2024-04-24T13:34:47.550928+0000","last_fullsized":"2024-04-24T13:34:47.550928+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:03:25.814262+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"86'6","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592134+0000","last_change":"2024-04-24T13:33:09.293808+0000","last_active":"2024-04-24T13:34:34.592134+0000","last_peered":"2024-04-24T13:34:34.592134+0000","last_clean":"2024-04-24T13:34:34.592134+0000","last_became_active":"2024-04-24T13:33:08.719391+0000","last_became_peered":"2024-04-24T13:33:08.719391+0000","last_unstale":"2024-04-24T13:34:34.592134+0000","last_undegraded":"2024-04-24T13:34:34.592134+0000","last_fullsized":"2024-04-24T13:34:34.592134+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:10.422756+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"150'44","reported_seq":328,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.495055+0000","last_change":"2024-04-24T13:33:09.199641+0000","last_active":"2024-04-24T13:34:47.495055+0000","last_peered":"2024-04-24T13:34:47.495055+0000","last_clean":"2024-04-24T13:34:47.495055+0000","last_became_active":"2024-04-24T13:33:08.737789+0000","last_became_peered":"2024-04-24T13:33:08.737789+0000","last_unstale":"2024-04-24T13:34:47.495055+0000","last_undegraded":"2024-04-24T13:34:47.495055+0000","last_fullsized":"2024-04-24T13:34:47.495055+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:41.648006+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665691+0000","last_change":"2024-04-24T13:30:23.213617+0000","last_active":"2024-04-24T13:34:35.665691+0000","last_peered":"2024-04-24T13:34:35.665691+0000","last_clean":"2024-04-24T13:34:35.665691+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:34:35.665691+0000","last_undegraded":"2024-04-24T13:34:35.665691+0000","last_fullsized":"2024-04-24T13:34:35.665691+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"150'48","reported_seq":313,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.564490+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:34:47.564490+0000","last_peered":"2024-04-24T13:34:47.564490+0000","last_clean":"2024-04-24T13:34:47.564490+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:34:47.564490+0000","last_undegraded":"2024-04-24T13:34:47.564490+0000","last_fullsized":"2024-04-24T13:34:47.564490+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"132'6","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665556+0000","last_change":"2024-04-24T13:30:23.223846+0000","last_active":"2024-04-24T13:34:35.665556+0000","last_peered":"2024-04-24T13:34:35.665556+0000","last_clean":"2024-04-24T13:34:35.665556+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:34:35.665556+0000","last_undegraded":"2024-04-24T13:34:35.665556+0000","last_fullsized":"2024-04-24T13:34:35.665556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"150'46","reported_seq":313,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.525326+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:34:47.525326+0000","last_peered":"2024-04-24T13:34:47.525326+0000","last_clean":"2024-04-24T13:34:47.525326+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:34:47.525326+0000","last_undegraded":"2024-04-24T13:34:47.525326+0000","last_fullsized":"2024-04-24T13:34:47.525326+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"82'2","reported_seq":269,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590681+0000","last_change":"2024-04-24T13:30:23.225845+0000","last_active":"2024-04-24T13:34:34.590681+0000","last_peered":"2024-04-24T13:34:34.590681+0000","last_clean":"2024-04-24T13:34:34.590681+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:34:34.590681+0000","last_undegraded":"2024-04-24T13:34:34.590681+0000","last_fullsized":"2024-04-24T13:34:34.590681+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"150'50","reported_seq":315,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.558235+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:34:47.558235+0000","last_peered":"2024-04-24T13:34:47.558235+0000","last_clean":"2024-04-24T13:34:47.558235+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:34:47.558235+0000","last_undegraded":"2024-04-24T13:34:47.558235+0000","last_fullsized":"2024-04-24T13:34:47.558235+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":245,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587848+0000","last_change":"2024-04-24T13:30:31.281271+0000","last_active":"2024-04-24T13:34:34.587848+0000","last_peered":"2024-04-24T13:34:34.587848+0000","last_clean":"2024-04-24T13:34:34.587848+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:34:34.587848+0000","last_undegraded":"2024-04-24T13:34:34.587848+0000","last_fullsized":"2024-04-24T13:34:34.587848+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"82'2","reported_seq":272,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556512+0000","last_change":"2024-04-24T13:30:23.227626+0000","last_active":"2024-04-24T13:34:35.556512+0000","last_peered":"2024-04-24T13:34:35.556512+0000","last_clean":"2024-04-24T13:34:35.556512+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:34:35.556512+0000","last_undegraded":"2024-04-24T13:34:35.556512+0000","last_fullsized":"2024-04-24T13:34:35.556512+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"150'52","reported_seq":130,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.541239+0000","last_change":"2024-04-24T13:33:49.775824+0000","last_active":"2024-04-24T13:34:47.541239+0000","last_peered":"2024-04-24T13:34:47.541239+0000","last_clean":"2024-04-24T13:34:47.541239+0000","last_became_active":"2024-04-24T13:33:49.282849+0000","last_became_peered":"2024-04-24T13:33:49.282849+0000","last_unstale":"2024-04-24T13:34:47.541239+0000","last_undegraded":"2024-04-24T13:34:47.541239+0000","last_fullsized":"2024-04-24T13:34:47.541239+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:12:15.350559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"25'1","reported_seq":128,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.328503+0000","last_change":"2024-04-24T13:33:10.797093+0000","last_active":"2024-04-24T13:34:46.328503+0000","last_peered":"2024-04-24T13:34:46.328503+0000","last_clean":"2024-04-24T13:34:46.328503+0000","last_became_active":"2024-04-24T13:33:08.736087+0000","last_became_peered":"2024-04-24T13:33:08.736087+0000","last_unstale":"2024-04-24T13:34:46.328503+0000","last_undegraded":"2024-04-24T13:34:46.328503+0000","last_fullsized":"2024-04-24T13:34:46.328503+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:49:31.056251+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"150'20","reported_seq":314,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.630239+0000","last_change":"2024-04-24T13:33:51.608371+0000","last_active":"2024-04-24T13:34:47.630239+0000","last_peered":"2024-04-24T13:34:47.630239+0000","last_clean":"2024-04-24T13:34:47.630239+0000","last_became_active":"2024-04-24T13:33:49.295172+0000","last_became_peered":"2024-04-24T13:33:49.295172+0000","last_unstale":"2024-04-24T13:34:47.630239+0000","last_undegraded":"2024-04-24T13:34:47.630239+0000","last_fullsized":"2024-04-24T13:34:47.630239+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670310+0000","last_change":"2024-04-24T13:33:49.295489+0000","last_active":"2024-04-24T13:34:35.670310+0000","last_peered":"2024-04-24T13:34:35.670310+0000","last_clean":"2024-04-24T13:34:35.670310+0000","last_became_active":"2024-04-24T13:33:49.292611+0000","last_became_peered":"2024-04-24T13:33:49.292611+0000","last_unstale":"2024-04-24T13:34:35.670310+0000","last_undegraded":"2024-04-24T13:34:35.670310+0000","last_fullsized":"2024-04-24T13:34:35.670310+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:52:22.537619+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"132'48","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592278+0000","last_change":"2024-04-24T13:33:08.911162+0000","last_active":"2024-04-24T13:34:34.592278+0000","last_peered":"2024-04-24T13:34:34.592278+0000","last_clean":"2024-04-24T13:34:34.592278+0000","last_became_active":"2024-04-24T13:33:08.709158+0000","last_became_peered":"2024-04-24T13:33:08.709158+0000","last_unstale":"2024-04-24T13:34:34.592278+0000","last_undegraded":"2024-04-24T13:34:34.592278+0000","last_fullsized":"2024-04-24T13:34:34.592278+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:56.162767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"82'4","reported_seq":119,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595727+0000","last_change":"2024-04-24T13:33:53.234461+0000","last_active":"2024-04-24T13:34:34.595727+0000","last_peered":"2024-04-24T13:34:34.595727+0000","last_clean":"2024-04-24T13:34:34.595727+0000","last_became_active":"2024-04-24T13:33:49.302172+0000","last_became_peered":"2024-04-24T13:33:49.302172+0000","last_unstale":"2024-04-24T13:34:34.595727+0000","last_undegraded":"2024-04-24T13:34:34.595727+0000","last_fullsized":"2024-04-24T13:34:34.595727+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:55:38.136746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"150'38","reported_seq":343,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.474421+0000","last_change":"2024-04-24T13:33:49.666596+0000","last_active":"2024-04-24T13:34:47.474421+0000","last_peered":"2024-04-24T13:34:47.474421+0000","last_clean":"2024-04-24T13:34:47.474421+0000","last_became_active":"2024-04-24T13:33:49.283461+0000","last_became_peered":"2024-04-24T13:33:49.283461+0000","last_unstale":"2024-04-24T13:34:47.474421+0000","last_undegraded":"2024-04-24T13:34:47.474421+0000","last_fullsized":"2024-04-24T13:34:47.474421+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":269,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556358+0000","last_change":"2024-04-24T13:33:49.301406+0000","last_active":"2024-04-24T13:34:35.556358+0000","last_peered":"2024-04-24T13:34:35.556358+0000","last_clean":"2024-04-24T13:34:35.556358+0000","last_became_active":"2024-04-24T13:33:49.300648+0000","last_became_peered":"2024-04-24T13:33:49.300648+0000","last_unstale":"2024-04-24T13:34:35.556358+0000","last_undegraded":"2024-04-24T13:34:35.556358+0000","last_fullsized":"2024-04-24T13:34:35.556358+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"32'6","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591967+0000","last_change":"2024-04-24T13:30:27.246802+0000","last_active":"2024-04-24T13:34:34.591967+0000","last_peered":"2024-04-24T13:34:34.591967+0000","last_clean":"2024-04-24T13:34:34.591967+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:34:34.591967+0000","last_undegraded":"2024-04-24T13:34:34.591967+0000","last_fullsized":"2024-04-24T13:34:34.591967+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":249,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590644+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:34:34.590644+0000","last_peered":"2024-04-24T13:34:34.590644+0000","last_clean":"2024-04-24T13:34:34.590644+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:34:34.590644+0000","last_undegraded":"2024-04-24T13:34:34.590644+0000","last_fullsized":"2024-04-24T13:34:34.590644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":245,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665412+0000","last_change":"2024-04-24T13:30:31.263830+0000","last_active":"2024-04-24T13:34:35.665412+0000","last_peered":"2024-04-24T13:34:35.665412+0000","last_clean":"2024-04-24T13:34:35.665412+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:34:35.665412+0000","last_undegraded":"2024-04-24T13:34:35.665412+0000","last_fullsized":"2024-04-24T13:34:35.665412+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"86'10","reported_seq":292,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667235+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:34:35.667235+0000","last_peered":"2024-04-24T13:34:35.667235+0000","last_clean":"2024-04-24T13:34:35.667235+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:34:35.667235+0000","last_undegraded":"2024-04-24T13:34:35.667235+0000","last_fullsized":"2024-04-24T13:34:35.667235+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"150'48","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.597343+0000","last_change":"2024-04-24T13:33:50.330934+0000","last_active":"2024-04-24T13:34:47.597343+0000","last_peered":"2024-04-24T13:34:47.597343+0000","last_clean":"2024-04-24T13:34:47.597343+0000","last_became_active":"2024-04-24T13:33:49.286157+0000","last_became_peered":"2024-04-24T13:33:49.286157+0000","last_unstale":"2024-04-24T13:34:47.597343+0000","last_undegraded":"2024-04-24T13:34:47.597343+0000","last_fullsized":"2024-04-24T13:34:47.597343+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:10.162075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.557043+0000","last_change":"2024-04-24T13:30:25.231834+0000","last_active":"2024-04-24T13:34:35.557043+0000","last_peered":"2024-04-24T13:34:35.557043+0000","last_clean":"2024-04-24T13:34:35.557043+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:34:35.557043+0000","last_undegraded":"2024-04-24T13:34:35.557043+0000","last_fullsized":"2024-04-24T13:34:35.557043+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"32'10","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664474+0000","last_change":"2024-04-24T13:30:27.249036+0000","last_active":"2024-04-24T13:34:35.664474+0000","last_peered":"2024-04-24T13:34:35.664474+0000","last_clean":"2024-04-24T13:34:35.664474+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:34:35.664474+0000","last_undegraded":"2024-04-24T13:34:35.664474+0000","last_fullsized":"2024-04-24T13:34:35.664474+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"150'142","reported_seq":429,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.376605+0000","last_change":"2024-04-24T13:33:52.550604+0000","last_active":"2024-04-24T13:34:46.376605+0000","last_peered":"2024-04-24T13:34:46.376605+0000","last_clean":"2024-04-24T13:34:46.376605+0000","last_became_active":"2024-04-24T13:33:52.550123+0000","last_became_peered":"2024-04-24T13:33:52.550123+0000","last_unstale":"2024-04-24T13:34:46.376605+0000","last_undegraded":"2024-04-24T13:34:46.376605+0000","last_fullsized":"2024-04-24T13:34:46.376605+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:09:41.226875+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"105'8","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588694+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:34:34.588694+0000","last_peered":"2024-04-24T13:34:34.588694+0000","last_clean":"2024-04-24T13:34:34.588694+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:34:34.588694+0000","last_undegraded":"2024-04-24T13:34:34.588694+0000","last_fullsized":"2024-04-24T13:34:34.588694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"132'4","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556553+0000","last_change":"2024-04-24T13:33:51.170660+0000","last_active":"2024-04-24T13:34:35.556553+0000","last_peered":"2024-04-24T13:34:35.556553+0000","last_clean":"2024-04-24T13:34:35.556553+0000","last_became_active":"2024-04-24T13:33:49.301591+0000","last_became_peered":"2024-04-24T13:33:49.301591+0000","last_unstale":"2024-04-24T13:34:35.556553+0000","last_undegraded":"2024-04-24T13:34:35.556553+0000","last_fullsized":"2024-04-24T13:34:35.556553+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"150'54","reported_seq":316,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.554830+0000","last_change":"2024-04-24T13:30:21.232914+0000","last_active":"2024-04-24T13:34:47.554830+0000","last_peered":"2024-04-24T13:34:47.554830+0000","last_clean":"2024-04-24T13:34:47.554830+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:34:47.554830+0000","last_undegraded":"2024-04-24T13:34:47.554830+0000","last_fullsized":"2024-04-24T13:34:47.554830+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:39.020521+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595591+0000","last_change":"2024-04-24T13:33:08.718010+0000","last_active":"2024-04-24T13:34:34.595591+0000","last_peered":"2024-04-24T13:34:34.595591+0000","last_clean":"2024-04-24T13:34:34.595591+0000","last_became_active":"2024-04-24T13:33:08.716072+0000","last_became_peered":"2024-04-24T13:33:08.716072+0000","last_unstale":"2024-04-24T13:34:34.595591+0000","last_undegraded":"2024-04-24T13:34:34.595591+0000","last_fullsized":"2024-04-24T13:34:34.595591+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:14:26.626730+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"150'20","reported_seq":75,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.293741+0000","last_change":"2024-04-24T13:33:52.725009+0000","last_active":"2024-04-24T13:34:47.293741+0000","last_peered":"2024-04-24T13:34:47.293741+0000","last_clean":"2024-04-24T13:34:47.293741+0000","last_became_active":"2024-04-24T13:33:49.294133+0000","last_became_peered":"2024-04-24T13:33:49.294133+0000","last_unstale":"2024-04-24T13:34:47.293741+0000","last_undegraded":"2024-04-24T13:34:47.293741+0000","last_fullsized":"2024-04-24T13:34:47.293741+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:51.462917+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"150'138","reported_seq":469,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.650507+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:34:47.650507+0000","last_peered":"2024-04-24T13:34:47.650507+0000","last_clean":"2024-04-24T13:34:47.650507+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:34:47.650507+0000","last_undegraded":"2024-04-24T13:34:47.650507+0000","last_fullsized":"2024-04-24T13:34:47.650507+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"82'2","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594248+0000","last_change":"2024-04-24T13:33:49.308248+0000","last_active":"2024-04-24T13:34:34.594248+0000","last_peered":"2024-04-24T13:34:34.594248+0000","last_clean":"2024-04-24T13:34:34.594248+0000","last_became_active":"2024-04-24T13:33:49.278105+0000","last_became_peered":"2024-04-24T13:33:49.278105+0000","last_unstale":"2024-04-24T13:34:34.594248+0000","last_undegraded":"2024-04-24T13:34:34.594248+0000","last_fullsized":"2024-04-24T13:34:34.594248+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:20.068883+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"150'50","reported_seq":122,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.522601+0000","last_change":"2024-04-24T13:33:53.103595+0000","last_active":"2024-04-24T13:34:47.522601+0000","last_peered":"2024-04-24T13:34:47.522601+0000","last_clean":"2024-04-24T13:34:47.522601+0000","last_became_active":"2024-04-24T13:33:49.297787+0000","last_became_peered":"2024-04-24T13:33:49.297787+0000","last_unstale":"2024-04-24T13:34:47.522601+0000","last_undegraded":"2024-04-24T13:34:47.522601+0000","last_fullsized":"2024-04-24T13:34:47.522601+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668999+0000","last_change":"2024-04-24T13:33:49.299431+0000","last_active":"2024-04-24T13:34:35.668999+0000","last_peered":"2024-04-24T13:34:35.668999+0000","last_clean":"2024-04-24T13:34:35.668999+0000","last_became_active":"2024-04-24T13:33:49.294593+0000","last_became_peered":"2024-04-24T13:33:49.294593+0000","last_unstale":"2024-04-24T13:34:35.668999+0000","last_undegraded":"2024-04-24T13:34:35.668999+0000","last_fullsized":"2024-04-24T13:34:35.668999+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:56:36.135388+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"150'31","reported_seq":133,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.485692+0000","last_change":"2024-04-24T13:33:10.421787+0000","last_active":"2024-04-24T13:34:46.485692+0000","last_peered":"2024-04-24T13:34:46.485692+0000","last_clean":"2024-04-24T13:34:46.485692+0000","last_became_active":"2024-04-24T13:33:08.733302+0000","last_became_peered":"2024-04-24T13:33:08.733302+0000","last_unstale":"2024-04-24T13:34:46.485692+0000","last_undegraded":"2024-04-24T13:34:46.485692+0000","last_fullsized":"2024-04-24T13:34:46.485692+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:10:16.339117+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":37,"num_read_kb":26,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.529341+0000","last_change":"2024-04-24T13:33:08.727357+0000","last_active":"2024-04-24T13:34:35.529341+0000","last_peered":"2024-04-24T13:34:35.529341+0000","last_clean":"2024-04-24T13:34:35.529341+0000","last_became_active":"2024-04-24T13:33:08.726787+0000","last_became_peered":"2024-04-24T13:33:08.726787+0000","last_unstale":"2024-04-24T13:34:35.529341+0000","last_undegraded":"2024-04-24T13:34:35.529341+0000","last_fullsized":"2024-04-24T13:34:35.529341+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"86'7","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594758+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:34:34.594758+0000","last_peered":"2024-04-24T13:34:34.594758+0000","last_clean":"2024-04-24T13:34:34.594758+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:34:34.594758+0000","last_undegraded":"2024-04-24T13:34:34.594758+0000","last_fullsized":"2024-04-24T13:34:34.594758+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:33.414371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"132'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.625488+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:34:42.625488+0000","last_peered":"2024-04-24T13:34:42.625488+0000","last_clean":"2024-04-24T13:34:42.625488+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:34:42.625488+0000","last_undegraded":"2024-04-24T13:34:42.625488+0000","last_fullsized":"2024-04-24T13:34:42.625488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"150'34","reported_seq":103,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.582211+0000","last_change":"2024-04-24T13:33:50.539289+0000","last_active":"2024-04-24T13:34:47.582211+0000","last_peered":"2024-04-24T13:34:47.582211+0000","last_clean":"2024-04-24T13:34:47.582211+0000","last_became_active":"2024-04-24T13:33:49.284576+0000","last_became_peered":"2024-04-24T13:33:49.284576+0000","last_unstale":"2024-04-24T13:34:47.582211+0000","last_undegraded":"2024-04-24T13:34:47.582211+0000","last_fullsized":"2024-04-24T13:34:47.582211+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:35:20.287647+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.608622+0000","last_change":"2024-04-24T13:30:25.233142+0000","last_active":"2024-04-24T13:34:47.608622+0000","last_peered":"2024-04-24T13:34:47.608622+0000","last_clean":"2024-04-24T13:34:47.608622+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:34:47.608622+0000","last_undegraded":"2024-04-24T13:34:47.608622+0000","last_fullsized":"2024-04-24T13:34:47.608622+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"150'21","reported_seq":317,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.088352+0000","last_change":"2024-04-24T13:33:52.751477+0000","last_active":"2024-04-24T13:34:47.088352+0000","last_peered":"2024-04-24T13:34:47.088352+0000","last_clean":"2024-04-24T13:34:47.088352+0000","last_became_active":"2024-04-24T13:33:49.308018+0000","last_became_peered":"2024-04-24T13:33:49.308018+0000","last_unstale":"2024-04-24T13:34:47.088352+0000","last_undegraded":"2024-04-24T13:34:47.088352+0000","last_fullsized":"2024-04-24T13:34:47.088352+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.059176+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:34:52.059176+0000","last_peered":"2024-04-24T13:34:52.059176+0000","last_clean":"2024-04-24T13:34:52.059176+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:34:52.059176+0000","last_undegraded":"2024-04-24T13:34:52.059176+0000","last_fullsized":"2024-04-24T13:34:52.059176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":243,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667433+0000","last_change":"2024-04-24T13:30:31.283731+0000","last_active":"2024-04-24T13:34:35.667433+0000","last_peered":"2024-04-24T13:34:35.667433+0000","last_clean":"2024-04-24T13:34:35.667433+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:34:35.667433+0000","last_undegraded":"2024-04-24T13:34:35.667433+0000","last_fullsized":"2024-04-24T13:34:35.667433+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:05:53.527297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"82'4","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667381+0000","last_change":"2024-04-24T13:32:01.548738+0000","last_active":"2024-04-24T13:34:35.667381+0000","last_peered":"2024-04-24T13:34:35.667381+0000","last_clean":"2024-04-24T13:34:35.667381+0000","last_became_active":"2024-04-24T13:32:01.548259+0000","last_became_peered":"2024-04-24T13:32:01.548259+0000","last_unstale":"2024-04-24T13:34:35.667381+0000","last_undegraded":"2024-04-24T13:34:35.667381+0000","last_fullsized":"2024-04-24T13:34:35.667381+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:39:58.396685+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"150'50","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.579220+0000","last_change":"2024-04-24T13:33:52.683024+0000","last_active":"2024-04-24T13:34:47.579220+0000","last_peered":"2024-04-24T13:34:47.579220+0000","last_clean":"2024-04-24T13:34:47.579220+0000","last_became_active":"2024-04-24T13:33:49.293373+0000","last_became_peered":"2024-04-24T13:33:49.293373+0000","last_unstale":"2024-04-24T13:34:47.579220+0000","last_undegraded":"2024-04-24T13:34:47.579220+0000","last_fullsized":"2024-04-24T13:34:47.579220+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:05:00.168247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665438+0000","last_change":"2024-04-24T13:30:25.237000+0000","last_active":"2024-04-24T13:34:35.665438+0000","last_peered":"2024-04-24T13:34:35.665438+0000","last_clean":"2024-04-24T13:34:35.665438+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:34:35.665438+0000","last_undegraded":"2024-04-24T13:34:35.665438+0000","last_fullsized":"2024-04-24T13:34:35.665438+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"150'26","reported_seq":81,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.503893+0000","last_change":"2024-04-24T13:33:53.666421+0000","last_active":"2024-04-24T13:34:46.503893+0000","last_peered":"2024-04-24T13:34:46.503893+0000","last_clean":"2024-04-24T13:34:46.503893+0000","last_became_active":"2024-04-24T13:33:49.302140+0000","last_became_peered":"2024-04-24T13:33:49.302140+0000","last_unstale":"2024-04-24T13:34:46.503893+0000","last_undegraded":"2024-04-24T13:34:46.503893+0000","last_fullsized":"2024-04-24T13:34:46.503893+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.223797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"150'138","reported_seq":519,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:50.704615+0000","last_change":"2024-04-24T13:30:29.281641+0000","last_active":"2024-04-24T13:34:50.704615+0000","last_peered":"2024-04-24T13:34:50.704615+0000","last_clean":"2024-04-24T13:34:50.704615+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:34:50.704615+0000","last_undegraded":"2024-04-24T13:34:50.704615+0000","last_fullsized":"2024-04-24T13:34:50.704615+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"82'3","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:50.704737+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:34:50.704737+0000","last_peered":"2024-04-24T13:34:50.704737+0000","last_clean":"2024-04-24T13:34:50.704737+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:34:50.704737+0000","last_undegraded":"2024-04-24T13:34:50.704737+0000","last_fullsized":"2024-04-24T13:34:50.704737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"132'10","reported_seq":304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:50.704398+0000","last_change":"2024-04-24T13:30:23.227347+0000","last_active":"2024-04-24T13:34:50.704398+0000","last_peered":"2024-04-24T13:34:50.704398+0000","last_clean":"2024-04-24T13:34:50.704398+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:34:50.704398+0000","last_undegraded":"2024-04-24T13:34:50.704398+0000","last_fullsized":"2024-04-24T13:34:50.704398+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"150'46","reported_seq":158,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.536494+0000","last_change":"2024-04-24T13:33:10.787412+0000","last_active":"2024-04-24T13:34:47.536494+0000","last_peered":"2024-04-24T13:34:47.536494+0000","last_clean":"2024-04-24T13:34:47.536494+0000","last_became_active":"2024-04-24T13:33:08.718332+0000","last_became_peered":"2024-04-24T13:33:08.718332+0000","last_unstale":"2024-04-24T13:34:47.536494+0000","last_undegraded":"2024-04-24T13:34:47.536494+0000","last_fullsized":"2024-04-24T13:34:47.536494+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:11.814256+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.608641+0000","last_change":"2024-04-24T13:30:25.228790+0000","last_active":"2024-04-24T13:34:47.608641+0000","last_peered":"2024-04-24T13:34:47.608641+0000","last_clean":"2024-04-24T13:34:47.608641+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:34:47.608641+0000","last_undegraded":"2024-04-24T13:34:47.608641+0000","last_fullsized":"2024-04-24T13:34:47.608641+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"150'34","reported_seq":341,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.616085+0000","last_change":"2024-04-24T13:33:51.156026+0000","last_active":"2024-04-24T13:34:47.616085+0000","last_peered":"2024-04-24T13:34:47.616085+0000","last_clean":"2024-04-24T13:34:47.616085+0000","last_became_active":"2024-04-24T13:33:49.292150+0000","last_became_peered":"2024-04-24T13:33:49.292150+0000","last_unstale":"2024-04-24T13:34:47.616085+0000","last_undegraded":"2024-04-24T13:34:47.616085+0000","last_fullsized":"2024-04-24T13:34:47.616085+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.604169+0000","last_change":"2024-04-24T13:33:49.306397+0000","last_active":"2024-04-24T13:34:51.604169+0000","last_peered":"2024-04-24T13:34:51.604169+0000","last_clean":"2024-04-24T13:34:51.604169+0000","last_became_active":"2024-04-24T13:33:49.305572+0000","last_became_peered":"2024-04-24T13:33:49.305572+0000","last_unstale":"2024-04-24T13:34:51.604169+0000","last_undegraded":"2024-04-24T13:34:51.604169+0000","last_fullsized":"2024-04-24T13:34:51.604169+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"126'11","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.159452+0000","last_change":"2024-04-24T13:30:31.256031+0000","last_active":"2024-04-24T13:34:51.159452+0000","last_peered":"2024-04-24T13:34:51.159452+0000","last_clean":"2024-04-24T13:34:51.159452+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:34:51.159452+0000","last_undegraded":"2024-04-24T13:34:51.159452+0000","last_fullsized":"2024-04-24T13:34:51.159452+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"132'8","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.537978+0000","last_change":"2024-04-24T13:30:23.225568+0000","last_active":"2024-04-24T13:34:52.537978+0000","last_peered":"2024-04-24T13:34:52.537978+0000","last_clean":"2024-04-24T13:34:52.537978+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:34:52.537978+0000","last_undegraded":"2024-04-24T13:34:52.537978+0000","last_fullsized":"2024-04-24T13:34:52.537978+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"150'58","reported_seq":326,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.058617+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:34:52.058617+0000","last_peered":"2024-04-24T13:34:52.058617+0000","last_clean":"2024-04-24T13:34:52.058617+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:34:52.058617+0000","last_undegraded":"2024-04-24T13:34:52.058617+0000","last_fullsized":"2024-04-24T13:34:52.058617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665378+0000","last_change":"2024-04-24T13:33:49.300767+0000","last_active":"2024-04-24T13:34:35.665378+0000","last_peered":"2024-04-24T13:34:35.665378+0000","last_clean":"2024-04-24T13:34:35.665378+0000","last_became_active":"2024-04-24T13:33:49.300030+0000","last_became_peered":"2024-04-24T13:33:49.300030+0000","last_unstale":"2024-04-24T13:34:35.665378+0000","last_undegraded":"2024-04-24T13:34:35.665378+0000","last_fullsized":"2024-04-24T13:34:35.665378+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"150'22","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.109953+0000","last_change":"2024-04-24T13:30:27.247684+0000","last_active":"2024-04-24T13:34:47.109953+0000","last_peered":"2024-04-24T13:34:47.109953+0000","last_clean":"2024-04-24T13:34:47.109953+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:34:47.109953+0000","last_undegraded":"2024-04-24T13:34:47.109953+0000","last_fullsized":"2024-04-24T13:34:47.109953+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":249,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668003+0000","last_change":"2024-04-24T13:30:29.271872+0000","last_active":"2024-04-24T13:34:35.668003+0000","last_peered":"2024-04-24T13:34:35.668003+0000","last_clean":"2024-04-24T13:34:35.668003+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:34:35.668003+0000","last_undegraded":"2024-04-24T13:34:35.668003+0000","last_fullsized":"2024-04-24T13:34:35.668003+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.529344+0000","last_change":"2024-04-24T13:34:52.529402+0000","last_active":"2024-04-24T13:34:52.529344+0000","last_peered":"2024-04-24T13:34:52.529344+0000","last_clean":"2024-04-24T13:34:52.529344+0000","last_became_active":"2024-04-24T13:33:08.720133+0000","last_became_peered":"2024-04-24T13:33:08.720133+0000","last_unstale":"2024-04-24T13:34:52.529344+0000","last_undegraded":"2024-04-24T13:34:52.529344+0000","last_fullsized":"2024-04-24T13:34:52.529344+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:52.529140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:52.529140+0000","last_clean_scrub_stamp":"2024-04-24T13:34:52.529140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:07:00.117664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.538115+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:34:52.538115+0000","last_peered":"2024-04-24T13:34:52.538115+0000","last_clean":"2024-04-24T13:34:52.538115+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:34:52.538115+0000","last_undegraded":"2024-04-24T13:34:52.538115+0000","last_fullsized":"2024-04-24T13:34:52.538115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"150'66","reported_seq":334,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.552574+0000","last_change":"2024-04-24T13:31:00.986244+0000","last_active":"2024-04-24T13:34:47.552574+0000","last_peered":"2024-04-24T13:34:47.552574+0000","last_clean":"2024-04-24T13:34:47.552574+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:34:47.552574+0000","last_undegraded":"2024-04-24T13:34:47.552574+0000","last_fullsized":"2024-04-24T13:34:47.552574+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:49:23.355231+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.524965+0000","last_change":"2024-04-24T13:30:25.233475+0000","last_active":"2024-04-24T13:34:35.524965+0000","last_peered":"2024-04-24T13:34:35.524965+0000","last_clean":"2024-04-24T13:34:35.524965+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:34:35.524965+0000","last_undegraded":"2024-04-24T13:34:35.524965+0000","last_fullsized":"2024-04-24T13:34:35.524965+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"150'35","reported_seq":309,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.956208+0000","last_change":"2024-04-24T13:34:51.956366+0000","last_active":"2024-04-24T13:34:51.956208+0000","last_peered":"2024-04-24T13:34:51.956208+0000","last_clean":"2024-04-24T13:34:51.956208+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:34:51.956208+0000","last_undegraded":"2024-04-24T13:34:51.956208+0000","last_fullsized":"2024-04-24T13:34:51.956208+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'35","last_scrub_stamp":"2024-04-24T13:34:51.955957+0000","last_deep_scrub":"150'35","last_deep_scrub_stamp":"2024-04-24T13:34:51.955957+0000","last_clean_scrub_stamp":"2024-04-24T13:34:51.955957+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:48:38.690221+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"150'142","reported_seq":474,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.644903+0000","last_change":"2024-04-24T13:33:11.710852+0000","last_active":"2024-04-24T13:34:47.644903+0000","last_peered":"2024-04-24T13:34:47.644903+0000","last_clean":"2024-04-24T13:34:47.644903+0000","last_became_active":"2024-04-24T13:33:11.709412+0000","last_became_peered":"2024-04-24T13:33:11.709412+0000","last_unstale":"2024-04-24T13:34:47.644903+0000","last_undegraded":"2024-04-24T13:34:47.644903+0000","last_fullsized":"2024-04-24T13:34:47.644903+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.609659+0000","last_change":"2024-04-24T13:30:31.264211+0000","last_active":"2024-04-24T13:34:42.609659+0000","last_peered":"2024-04-24T13:34:42.609659+0000","last_clean":"2024-04-24T13:34:42.609659+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:34:42.609659+0000","last_undegraded":"2024-04-24T13:34:42.609659+0000","last_fullsized":"2024-04-24T13:34:42.609659+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"114'2","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.538110+0000","last_change":"2024-04-24T13:30:23.247017+0000","last_active":"2024-04-24T13:34:52.538110+0000","last_peered":"2024-04-24T13:34:52.538110+0000","last_clean":"2024-04-24T13:34:52.538110+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:34:52.538110+0000","last_undegraded":"2024-04-24T13:34:52.538110+0000","last_fullsized":"2024-04-24T13:34:52.538110+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"150'52","reported_seq":318,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.538592+0000","last_change":"2024-04-24T13:30:21.212757+0000","last_active":"2024-04-24T13:34:47.538592+0000","last_peered":"2024-04-24T13:34:47.538592+0000","last_clean":"2024-04-24T13:34:47.538592+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:34:47.538592+0000","last_undegraded":"2024-04-24T13:34:47.538592+0000","last_fullsized":"2024-04-24T13:34:47.538592+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"25'2","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.341690+0000","last_change":"2024-04-24T13:33:09.912410+0000","last_active":"2024-04-24T13:34:46.341690+0000","last_peered":"2024-04-24T13:34:46.341690+0000","last_clean":"2024-04-24T13:34:46.341690+0000","last_became_active":"2024-04-24T13:33:08.724858+0000","last_became_peered":"2024-04-24T13:33:08.724858+0000","last_unstale":"2024-04-24T13:34:46.341690+0000","last_undegraded":"2024-04-24T13:34:46.341690+0000","last_fullsized":"2024-04-24T13:34:46.341690+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:26.760043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":180,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"82'11","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556147+0000","last_change":"2024-04-24T13:30:27.243059+0000","last_active":"2024-04-24T13:34:35.556147+0000","last_peered":"2024-04-24T13:34:35.556147+0000","last_clean":"2024-04-24T13:34:35.556147+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:34:35.556147+0000","last_undegraded":"2024-04-24T13:34:35.556147+0000","last_fullsized":"2024-04-24T13:34:35.556147+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"150'138","reported_seq":482,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.380201+0000","last_change":"2024-04-24T13:30:29.285693+0000","last_active":"2024-04-24T13:34:46.380201+0000","last_peered":"2024-04-24T13:34:46.380201+0000","last_clean":"2024-04-24T13:34:46.380201+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:34:46.380201+0000","last_undegraded":"2024-04-24T13:34:46.380201+0000","last_fullsized":"2024-04-24T13:34:46.380201+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:48:51.639282+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"132'4","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.625586+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:34:42.625586+0000","last_peered":"2024-04-24T13:34:42.625586+0000","last_clean":"2024-04-24T13:34:42.625586+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:34:42.625586+0000","last_undegraded":"2024-04-24T13:34:42.625586+0000","last_fullsized":"2024-04-24T13:34:42.625586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"86'4","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.159012+0000","last_change":"2024-04-24T13:30:23.222430+0000","last_active":"2024-04-24T13:34:51.159012+0000","last_peered":"2024-04-24T13:34:51.159012+0000","last_clean":"2024-04-24T13:34:51.159012+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:34:51.159012+0000","last_undegraded":"2024-04-24T13:34:51.159012+0000","last_fullsized":"2024-04-24T13:34:51.159012+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"150'70","reported_seq":338,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.561937+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:34:47.561937+0000","last_peered":"2024-04-24T13:34:47.561937+0000","last_clean":"2024-04-24T13:34:47.561937+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:34:47.561937+0000","last_undegraded":"2024-04-24T13:34:47.561937+0000","last_fullsized":"2024-04-24T13:34:47.561937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591202+0000","last_change":"2024-04-24T13:33:08.716879+0000","last_active":"2024-04-24T13:34:34.591202+0000","last_peered":"2024-04-24T13:34:34.591202+0000","last_clean":"2024-04-24T13:34:34.591202+0000","last_became_active":"2024-04-24T13:33:08.716585+0000","last_became_peered":"2024-04-24T13:33:08.716585+0000","last_unstale":"2024-04-24T13:34:34.591202+0000","last_undegraded":"2024-04-24T13:34:34.591202+0000","last_fullsized":"2024-04-24T13:34:34.591202+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"150'28","reported_seq":130,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.633232+0000","last_change":"2024-04-24T13:33:10.818135+0000","last_active":"2024-04-24T13:34:47.633232+0000","last_peered":"2024-04-24T13:34:47.633232+0000","last_clean":"2024-04-24T13:34:47.633232+0000","last_became_active":"2024-04-24T13:33:08.736280+0000","last_became_peered":"2024-04-24T13:33:08.736280+0000","last_unstale":"2024-04-24T13:34:47.633232+0000","last_undegraded":"2024-04-24T13:34:47.633232+0000","last_fullsized":"2024-04-24T13:34:47.633232+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:41:16.005578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667479+0000","last_change":"2024-04-24T13:30:29.275671+0000","last_active":"2024-04-24T13:34:35.667479+0000","last_peered":"2024-04-24T13:34:35.667479+0000","last_clean":"2024-04-24T13:34:35.667479+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:34:35.667479+0000","last_undegraded":"2024-04-24T13:34:35.667479+0000","last_fullsized":"2024-04-24T13:34:35.667479+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:53:08.685365+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"82'2","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.609718+0000","last_change":"2024-04-24T13:33:09.338972+0000","last_active":"2024-04-24T13:34:42.609718+0000","last_peered":"2024-04-24T13:34:42.609718+0000","last_clean":"2024-04-24T13:34:42.609718+0000","last_became_active":"2024-04-24T13:33:08.727402+0000","last_became_peered":"2024-04-24T13:33:08.727402+0000","last_unstale":"2024-04-24T13:34:42.609718+0000","last_undegraded":"2024-04-24T13:34:42.609718+0000","last_fullsized":"2024-04-24T13:34:42.609718+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"105'4","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670731+0000","last_change":"2024-04-24T13:30:23.245140+0000","last_active":"2024-04-24T13:34:35.670731+0000","last_peered":"2024-04-24T13:34:35.670731+0000","last_clean":"2024-04-24T13:34:35.670731+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:34:35.670731+0000","last_undegraded":"2024-04-24T13:34:35.670731+0000","last_fullsized":"2024-04-24T13:34:35.670731+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:32:31.768327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":388,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668111+0000","last_change":"2024-04-24T13:33:54.557574+0000","last_active":"2024-04-24T13:34:35.668111+0000","last_peered":"2024-04-24T13:34:35.668111+0000","last_clean":"2024-04-24T13:34:35.668111+0000","last_became_active":"2024-04-24T13:33:54.557258+0000","last_became_peered":"2024-04-24T13:33:54.557258+0000","last_unstale":"2024-04-24T13:34:35.668111+0000","last_undegraded":"2024-04-24T13:34:35.668111+0000","last_fullsized":"2024-04-24T13:34:35.668111+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:14:04.108561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593434+0000","last_change":"2024-04-24T13:33:08.717037+0000","last_active":"2024-04-24T13:34:34.593434+0000","last_peered":"2024-04-24T13:34:34.593434+0000","last_clean":"2024-04-24T13:34:34.593434+0000","last_became_active":"2024-04-24T13:33:08.715914+0000","last_became_peered":"2024-04-24T13:33:08.715914+0000","last_unstale":"2024-04-24T13:34:34.593434+0000","last_undegraded":"2024-04-24T13:34:34.593434+0000","last_fullsized":"2024-04-24T13:34:34.593434+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:19:03.765941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"150'56","reported_seq":352,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.582091+0000","last_change":"2024-04-24T13:33:09.529789+0000","last_active":"2024-04-24T13:34:47.582091+0000","last_peered":"2024-04-24T13:34:47.582091+0000","last_clean":"2024-04-24T13:34:47.582091+0000","last_became_active":"2024-04-24T13:33:08.725348+0000","last_became_peered":"2024-04-24T13:33:08.725348+0000","last_unstale":"2024-04-24T13:34:47.582091+0000","last_undegraded":"2024-04-24T13:34:47.582091+0000","last_fullsized":"2024-04-24T13:34:47.582091+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668973+0000","last_change":"2024-04-24T13:33:49.295687+0000","last_active":"2024-04-24T13:34:35.668973+0000","last_peered":"2024-04-24T13:34:35.668973+0000","last_clean":"2024-04-24T13:34:35.668973+0000","last_became_active":"2024-04-24T13:33:49.293916+0000","last_became_peered":"2024-04-24T13:33:49.293916+0000","last_unstale":"2024-04-24T13:34:35.668973+0000","last_undegraded":"2024-04-24T13:34:35.668973+0000","last_fullsized":"2024-04-24T13:34:35.668973+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:49:19.712676+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"150'51","reported_seq":146,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.618001+0000","last_change":"2024-04-24T13:33:09.565111+0000","last_active":"2024-04-24T13:34:47.618001+0000","last_peered":"2024-04-24T13:34:47.618001+0000","last_clean":"2024-04-24T13:34:47.618001+0000","last_became_active":"2024-04-24T13:33:08.719950+0000","last_became_peered":"2024-04-24T13:33:08.719950+0000","last_unstale":"2024-04-24T13:34:47.618001+0000","last_undegraded":"2024-04-24T13:34:47.618001+0000","last_fullsized":"2024-04-24T13:34:47.618001+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":51,"log_dups_size":0,"ondisk_log_size":51,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:37.122088+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":397,"num_write":30,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":58868,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:50.704608+0000","last_change":"2024-04-24T13:33:49.296153+0000","last_active":"2024-04-24T13:34:50.704608+0000","last_peered":"2024-04-24T13:34:50.704608+0000","last_clean":"2024-04-24T13:34:50.704608+0000","last_became_active":"2024-04-24T13:33:49.294098+0000","last_became_peered":"2024-04-24T13:33:49.294098+0000","last_unstale":"2024-04-24T13:34:50.704608+0000","last_undegraded":"2024-04-24T13:34:50.704608+0000","last_fullsized":"2024-04-24T13:34:50.704608+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":253,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666840+0000","last_change":"2024-04-24T13:33:08.727069+0000","last_active":"2024-04-24T13:34:35.666840+0000","last_peered":"2024-04-24T13:34:35.666840+0000","last_clean":"2024-04-24T13:34:35.666840+0000","last_became_active":"2024-04-24T13:33:08.726216+0000","last_became_peered":"2024-04-24T13:33:08.726216+0000","last_unstale":"2024-04-24T13:34:35.666840+0000","last_undegraded":"2024-04-24T13:34:35.666840+0000","last_fullsized":"2024-04-24T13:34:35.666840+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:59.675122+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"105'6","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.615529+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:34:42.615529+0000","last_peered":"2024-04-24T13:34:42.615529+0000","last_clean":"2024-04-24T13:34:42.615529+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:34:42.615529+0000","last_undegraded":"2024-04-24T13:34:42.615529+0000","last_fullsized":"2024-04-24T13:34:42.615529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668713+0000","last_change":"2024-04-24T13:33:49.282926+0000","last_active":"2024-04-24T13:34:35.668713+0000","last_peered":"2024-04-24T13:34:35.668713+0000","last_clean":"2024-04-24T13:34:35.668713+0000","last_became_active":"2024-04-24T13:33:49.282517+0000","last_became_peered":"2024-04-24T13:33:49.282517+0000","last_unstale":"2024-04-24T13:34:35.668713+0000","last_undegraded":"2024-04-24T13:34:35.668713+0000","last_fullsized":"2024-04-24T13:34:35.668713+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:06:18.852308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"150'48","reported_seq":314,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.599455+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:34:47.599455+0000","last_peered":"2024-04-24T13:34:47.599455+0000","last_clean":"2024-04-24T13:34:47.599455+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:34:47.599455+0000","last_undegraded":"2024-04-24T13:34:47.599455+0000","last_fullsized":"2024-04-24T13:34:47.599455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.596110+0000","last_change":"2024-04-24T13:33:08.734054+0000","last_active":"2024-04-24T13:34:34.596110+0000","last_peered":"2024-04-24T13:34:34.596110+0000","last_clean":"2024-04-24T13:34:34.596110+0000","last_became_active":"2024-04-24T13:33:08.728126+0000","last_became_peered":"2024-04-24T13:33:08.728126+0000","last_unstale":"2024-04-24T13:34:34.596110+0000","last_undegraded":"2024-04-24T13:34:34.596110+0000","last_fullsized":"2024-04-24T13:34:34.596110+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:35:48.542362+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"150'149","reported_seq":530,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.637280+0000","last_change":"2024-04-24T13:30:27.258109+0000","last_active":"2024-04-24T13:34:47.637280+0000","last_peered":"2024-04-24T13:34:47.637280+0000","last_clean":"2024-04-24T13:34:47.637280+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:34:47.637280+0000","last_undegraded":"2024-04-24T13:34:47.637280+0000","last_fullsized":"2024-04-24T13:34:47.637280+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":149,"log_dups_size":0,"ondisk_log_size":149,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":200,"num_read_kb":417,"num_write":36,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669391+0000","last_change":"2024-04-24T13:33:49.298292+0000","last_active":"2024-04-24T13:34:35.669391+0000","last_peered":"2024-04-24T13:34:35.669391+0000","last_clean":"2024-04-24T13:34:35.669391+0000","last_became_active":"2024-04-24T13:33:49.297450+0000","last_became_peered":"2024-04-24T13:33:49.297450+0000","last_unstale":"2024-04-24T13:34:35.669391+0000","last_undegraded":"2024-04-24T13:34:35.669391+0000","last_fullsized":"2024-04-24T13:34:35.669391+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:13:11.836268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.159366+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:34:51.159366+0000","last_peered":"2024-04-24T13:34:51.159366+0000","last_clean":"2024-04-24T13:34:51.159366+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:34:51.159366+0000","last_undegraded":"2024-04-24T13:34:51.159366+0000","last_fullsized":"2024-04-24T13:34:51.159366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"132'2","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.609883+0000","last_change":"2024-04-24T13:33:08.745743+0000","last_active":"2024-04-24T13:34:42.609883+0000","last_peered":"2024-04-24T13:34:42.609883+0000","last_clean":"2024-04-24T13:34:42.609883+0000","last_became_active":"2024-04-24T13:33:08.745363+0000","last_became_peered":"2024-04-24T13:33:08.745363+0000","last_unstale":"2024-04-24T13:34:42.609883+0000","last_undegraded":"2024-04-24T13:34:42.609883+0000","last_fullsized":"2024-04-24T13:34:42.609883+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666144+0000","last_change":"2024-04-24T13:30:15.235561+0000","last_active":"2024-04-24T13:34:35.666144+0000","last_peered":"2024-04-24T13:34:35.666144+0000","last_clean":"2024-04-24T13:34:35.666144+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:34:35.666144+0000","last_undegraded":"2024-04-24T13:34:35.666144+0000","last_fullsized":"2024-04-24T13:34:35.666144+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"150'46","reported_seq":314,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.583208+0000","last_change":"2024-04-24T13:30:21.206416+0000","last_active":"2024-04-24T13:34:47.583208+0000","last_peered":"2024-04-24T13:34:47.583208+0000","last_clean":"2024-04-24T13:34:47.583208+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:34:47.583208+0000","last_undegraded":"2024-04-24T13:34:47.583208+0000","last_fullsized":"2024-04-24T13:34:47.583208+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"25'1","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.608669+0000","last_change":"2024-04-24T13:33:09.537358+0000","last_active":"2024-04-24T13:34:47.608669+0000","last_peered":"2024-04-24T13:34:47.608669+0000","last_clean":"2024-04-24T13:34:47.608669+0000","last_became_active":"2024-04-24T13:33:08.726022+0000","last_became_peered":"2024-04-24T13:33:08.726022+0000","last_unstale":"2024-04-24T13:34:47.608669+0000","last_undegraded":"2024-04-24T13:34:47.608669+0000","last_fullsized":"2024-04-24T13:34:47.608669+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"150'19","reported_seq":87,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670337+0000","last_change":"2024-04-24T13:33:52.755369+0000","last_active":"2024-04-24T13:34:35.670337+0000","last_peered":"2024-04-24T13:34:35.670337+0000","last_clean":"2024-04-24T13:34:35.670337+0000","last_became_active":"2024-04-24T13:33:49.297296+0000","last_became_peered":"2024-04-24T13:33:49.297296+0000","last_unstale":"2024-04-24T13:34:35.670337+0000","last_undegraded":"2024-04-24T13:34:35.670337+0000","last_fullsized":"2024-04-24T13:34:35.670337+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:44:57.772686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.615447+0000","last_change":"2024-04-24T13:30:29.266908+0000","last_active":"2024-04-24T13:34:42.615447+0000","last_peered":"2024-04-24T13:34:42.615447+0000","last_clean":"2024-04-24T13:34:42.615447+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:34:42.615447+0000","last_undegraded":"2024-04-24T13:34:42.615447+0000","last_fullsized":"2024-04-24T13:34:42.615447+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":247,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554872+0000","last_change":"2024-04-24T13:30:31.266264+0000","last_active":"2024-04-24T13:34:35.554872+0000","last_peered":"2024-04-24T13:34:35.554872+0000","last_clean":"2024-04-24T13:34:35.554872+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:34:35.554872+0000","last_undegraded":"2024-04-24T13:34:35.554872+0000","last_fullsized":"2024-04-24T13:34:35.554872+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"132'4","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525157+0000","last_change":"2024-04-24T13:30:23.218909+0000","last_active":"2024-04-24T13:34:35.525157+0000","last_peered":"2024-04-24T13:34:35.525157+0000","last_clean":"2024-04-24T13:34:35.525157+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:34:35.525157+0000","last_undegraded":"2024-04-24T13:34:35.525157+0000","last_fullsized":"2024-04-24T13:34:35.525157+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592641+0000","last_change":"2024-04-24T13:33:08.727739+0000","last_active":"2024-04-24T13:34:34.592641+0000","last_peered":"2024-04-24T13:34:34.592641+0000","last_clean":"2024-04-24T13:34:34.592641+0000","last_became_active":"2024-04-24T13:33:08.727324+0000","last_became_peered":"2024-04-24T13:33:08.727324+0000","last_unstale":"2024-04-24T13:34:34.592641+0000","last_undegraded":"2024-04-24T13:34:34.592641+0000","last_fullsized":"2024-04-24T13:34:34.592641+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:23.918692+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"150'44","reported_seq":315,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.554701+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:34:47.554701+0000","last_peered":"2024-04-24T13:34:47.554701+0000","last_clean":"2024-04-24T13:34:47.554701+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:34:47.554701+0000","last_undegraded":"2024-04-24T13:34:47.554701+0000","last_fullsized":"2024-04-24T13:34:47.554701+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:37.614601+0000","last_change":"2024-04-24T13:30:25.232124+0000","last_active":"2024-04-24T13:34:37.614601+0000","last_peered":"2024-04-24T13:34:37.614601+0000","last_clean":"2024-04-24T13:34:37.614601+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:34:37.614601+0000","last_undegraded":"2024-04-24T13:34:37.614601+0000","last_fullsized":"2024-04-24T13:34:37.614601+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"32'12","reported_seq":274,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.607000+0000","last_change":"2024-04-24T13:30:27.250097+0000","last_active":"2024-04-24T13:34:47.607000+0000","last_peered":"2024-04-24T13:34:47.607000+0000","last_clean":"2024-04-24T13:34:47.607000+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:34:47.607000+0000","last_undegraded":"2024-04-24T13:34:47.607000+0000","last_fullsized":"2024-04-24T13:34:47.607000+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":247,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671408+0000","last_change":"2024-04-24T13:30:29.265206+0000","last_active":"2024-04-24T13:34:35.671408+0000","last_peered":"2024-04-24T13:34:35.671408+0000","last_clean":"2024-04-24T13:34:35.671408+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:34:35.671408+0000","last_undegraded":"2024-04-24T13:34:35.671408+0000","last_fullsized":"2024-04-24T13:34:35.671408+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:02.010397+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"81'4","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594411+0000","last_change":"2024-04-24T13:33:09.289060+0000","last_active":"2024-04-24T13:34:34.594411+0000","last_peered":"2024-04-24T13:34:34.594411+0000","last_clean":"2024-04-24T13:34:34.594411+0000","last_became_active":"2024-04-24T13:33:08.717929+0000","last_became_peered":"2024-04-24T13:33:08.717929+0000","last_unstale":"2024-04-24T13:34:34.594411+0000","last_undegraded":"2024-04-24T13:34:34.594411+0000","last_fullsized":"2024-04-24T13:34:34.594411+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:51:36.428839+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":274,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528080+0000","last_change":"2024-04-24T13:33:08.738475+0000","last_active":"2024-04-24T13:34:35.528080+0000","last_peered":"2024-04-24T13:34:35.528080+0000","last_clean":"2024-04-24T13:34:35.528080+0000","last_became_active":"2024-04-24T13:33:08.738109+0000","last_became_peered":"2024-04-24T13:33:08.738109+0000","last_unstale":"2024-04-24T13:34:35.528080+0000","last_undegraded":"2024-04-24T13:34:35.528080+0000","last_fullsized":"2024-04-24T13:34:35.528080+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"150'52","reported_seq":162,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.533527+0000","last_change":"2024-04-24T13:33:10.091580+0000","last_active":"2024-04-24T13:34:47.533527+0000","last_peered":"2024-04-24T13:34:47.533527+0000","last_clean":"2024-04-24T13:34:47.533527+0000","last_became_active":"2024-04-24T13:33:08.716808+0000","last_became_peered":"2024-04-24T13:33:08.716808+0000","last_unstale":"2024-04-24T13:34:47.533527+0000","last_undegraded":"2024-04-24T13:34:47.533527+0000","last_fullsized":"2024-04-24T13:34:47.533527+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:05:06.347329+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":274,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525407+0000","last_change":"2024-04-24T13:30:16.056992+0000","last_active":"2024-04-24T13:34:35.525407+0000","last_peered":"2024-04-24T13:34:35.525407+0000","last_clean":"2024-04-24T13:34:35.525407+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:34:35.525407+0000","last_undegraded":"2024-04-24T13:34:35.525407+0000","last_fullsized":"2024-04-24T13:34:35.525407+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:37.614559+0000","last_change":"2024-04-24T13:30:25.235318+0000","last_active":"2024-04-24T13:34:37.614559+0000","last_peered":"2024-04-24T13:34:37.614559+0000","last_clean":"2024-04-24T13:34:37.614559+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:34:37.614559+0000","last_undegraded":"2024-04-24T13:34:37.614559+0000","last_fullsized":"2024-04-24T13:34:37.614559+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"150'40","reported_seq":316,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.297824+0000","last_change":"2024-04-24T13:30:27.244247+0000","last_active":"2024-04-24T13:34:47.297824+0000","last_peered":"2024-04-24T13:34:47.297824+0000","last_clean":"2024-04-24T13:34:47.297824+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:34:47.297824+0000","last_undegraded":"2024-04-24T13:34:47.297824+0000","last_fullsized":"2024-04-24T13:34:47.297824+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.625537+0000","last_change":"2024-04-24T13:30:29.277607+0000","last_active":"2024-04-24T13:34:42.625537+0000","last_peered":"2024-04-24T13:34:42.625537+0000","last_clean":"2024-04-24T13:34:42.625537+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:34:42.625537+0000","last_undegraded":"2024-04-24T13:34:42.625537+0000","last_fullsized":"2024-04-24T13:34:42.625537+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":245,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667990+0000","last_change":"2024-04-24T13:30:31.993667+0000","last_active":"2024-04-24T13:34:35.667990+0000","last_peered":"2024-04-24T13:34:35.667990+0000","last_clean":"2024-04-24T13:34:35.667990+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:34:35.667990+0000","last_undegraded":"2024-04-24T13:34:35.667990+0000","last_fullsized":"2024-04-24T13:34:35.667990+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"114'18","reported_seq":352,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666598+0000","last_change":"2024-04-24T13:33:09.335136+0000","last_active":"2024-04-24T13:34:35.666598+0000","last_peered":"2024-04-24T13:34:35.666598+0000","last_clean":"2024-04-24T13:34:35.666598+0000","last_became_active":"2024-04-24T13:33:08.705853+0000","last_became_peered":"2024-04-24T13:33:08.705853+0000","last_unstale":"2024-04-24T13:34:35.666598+0000","last_undegraded":"2024-04-24T13:34:35.666598+0000","last_fullsized":"2024-04-24T13:34:35.666598+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":86,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"150'28","reported_seq":296,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.362705+0000","last_change":"2024-04-24T13:30:21.208463+0000","last_active":"2024-04-24T13:34:47.362705+0000","last_peered":"2024-04-24T13:34:47.362705+0000","last_clean":"2024-04-24T13:34:47.362705+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:34:47.362705+0000","last_undegraded":"2024-04-24T13:34:47.362705+0000","last_fullsized":"2024-04-24T13:34:47.362705+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669917+0000","last_change":"2024-04-24T13:33:49.288345+0000","last_active":"2024-04-24T13:34:35.669917+0000","last_peered":"2024-04-24T13:34:35.669917+0000","last_clean":"2024-04-24T13:34:35.669917+0000","last_became_active":"2024-04-24T13:33:49.287893+0000","last_became_peered":"2024-04-24T13:33:49.287893+0000","last_unstale":"2024-04-24T13:34:35.669917+0000","last_undegraded":"2024-04-24T13:34:35.669917+0000","last_fullsized":"2024-04-24T13:34:35.669917+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:16:59.559096+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667933+0000","last_change":"2024-04-24T13:30:25.234690+0000","last_active":"2024-04-24T13:34:35.667933+0000","last_peered":"2024-04-24T13:34:35.667933+0000","last_clean":"2024-04-24T13:34:35.667933+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:34:35.667933+0000","last_undegraded":"2024-04-24T13:34:35.667933+0000","last_fullsized":"2024-04-24T13:34:35.667933+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:50.561686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"150'22","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.680269+0000","last_change":"2024-04-24T13:34:51.680325+0000","last_active":"2024-04-24T13:34:51.680269+0000","last_peered":"2024-04-24T13:34:51.680269+0000","last_clean":"2024-04-24T13:34:51.680269+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:34:51.680269+0000","last_undegraded":"2024-04-24T13:34:51.680269+0000","last_fullsized":"2024-04-24T13:34:51.680269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'22","last_scrub_stamp":"2024-04-24T13:34:51.680185+0000","last_deep_scrub":"150'22","last_deep_scrub_stamp":"2024-04-24T13:34:51.680185+0000","last_clean_scrub_stamp":"2024-04-24T13:34:51.680185+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:20:50.188444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"150'141","reported_seq":354,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.373654+0000","last_change":"2024-04-24T13:33:11.712104+0000","last_active":"2024-04-24T13:34:46.373654+0000","last_peered":"2024-04-24T13:34:46.373654+0000","last_clean":"2024-04-24T13:34:46.373654+0000","last_became_active":"2024-04-24T13:33:11.710310+0000","last_became_peered":"2024-04-24T13:33:11.710310+0000","last_unstale":"2024-04-24T13:34:46.373654+0000","last_undegraded":"2024-04-24T13:34:46.373654+0000","last_fullsized":"2024-04-24T13:34:46.373654+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:44.878043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"114'3","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556751+0000","last_change":"2024-04-24T13:30:31.991626+0000","last_active":"2024-04-24T13:34:35.556751+0000","last_peered":"2024-04-24T13:34:35.556751+0000","last_clean":"2024-04-24T13:34:35.556751+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:34:35.556751+0000","last_undegraded":"2024-04-24T13:34:35.556751+0000","last_fullsized":"2024-04-24T13:34:35.556751+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"82'2","reported_seq":229,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664723+0000","last_change":"2024-04-24T13:33:49.682866+0000","last_active":"2024-04-24T13:34:35.664723+0000","last_peered":"2024-04-24T13:34:35.664723+0000","last_clean":"2024-04-24T13:34:35.664723+0000","last_became_active":"2024-04-24T13:33:49.296844+0000","last_became_peered":"2024-04-24T13:33:49.296844+0000","last_unstale":"2024-04-24T13:34:35.664723+0000","last_undegraded":"2024-04-24T13:34:35.664723+0000","last_fullsized":"2024-04-24T13:34:35.664723+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"150'48","reported_seq":360,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.590928+0000","last_change":"2024-04-24T13:33:51.134298+0000","last_active":"2024-04-24T13:34:47.590928+0000","last_peered":"2024-04-24T13:34:47.590928+0000","last_clean":"2024-04-24T13:34:47.590928+0000","last_became_active":"2024-04-24T13:33:49.300149+0000","last_became_peered":"2024-04-24T13:33:49.300149+0000","last_unstale":"2024-04-24T13:34:47.590928+0000","last_undegraded":"2024-04-24T13:34:47.590928+0000","last_fullsized":"2024-04-24T13:34:47.590928+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":274,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.531437+0000","last_change":"2024-04-24T13:30:15.154731+0000","last_active":"2024-04-24T13:34:35.531437+0000","last_peered":"2024-04-24T13:34:35.531437+0000","last_clean":"2024-04-24T13:34:35.531437+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:34:35.531437+0000","last_undegraded":"2024-04-24T13:34:35.531437+0000","last_fullsized":"2024-04-24T13:34:35.531437+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.492905+0000","last_change":"2024-04-24T13:30:25.232720+0000","last_active":"2024-04-24T13:34:35.492905+0000","last_peered":"2024-04-24T13:34:35.492905+0000","last_clean":"2024-04-24T13:34:35.492905+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:34:35.492905+0000","last_undegraded":"2024-04-24T13:34:35.492905+0000","last_fullsized":"2024-04-24T13:34:35.492905+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"32'10","reported_seq":269,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.492973+0000","last_change":"2024-04-24T13:30:27.246662+0000","last_active":"2024-04-24T13:34:35.492973+0000","last_peered":"2024-04-24T13:34:35.492973+0000","last_clean":"2024-04-24T13:34:35.492973+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:34:35.492973+0000","last_undegraded":"2024-04-24T13:34:35.492973+0000","last_fullsized":"2024-04-24T13:34:35.492973+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"150'138","reported_seq":440,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.647734+0000","last_change":"2024-04-24T13:30:29.272140+0000","last_active":"2024-04-24T13:34:47.647734+0000","last_peered":"2024-04-24T13:34:47.647734+0000","last_clean":"2024-04-24T13:34:47.647734+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:34:47.647734+0000","last_undegraded":"2024-04-24T13:34:47.647734+0000","last_fullsized":"2024-04-24T13:34:47.647734+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"82'6","reported_seq":253,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666265+0000","last_change":"2024-04-24T13:30:31.262439+0000","last_active":"2024-04-24T13:34:35.666265+0000","last_peered":"2024-04-24T13:34:35.666265+0000","last_clean":"2024-04-24T13:34:35.666265+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:34:35.666265+0000","last_undegraded":"2024-04-24T13:34:35.666265+0000","last_fullsized":"2024-04-24T13:34:35.666265+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"114'6","reported_seq":303,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588419+0000","last_change":"2024-04-24T13:33:08.753804+0000","last_active":"2024-04-24T13:34:34.588419+0000","last_peered":"2024-04-24T13:34:34.588419+0000","last_clean":"2024-04-24T13:34:34.588419+0000","last_became_active":"2024-04-24T13:33:08.707993+0000","last_became_peered":"2024-04-24T13:33:08.707993+0000","last_unstale":"2024-04-24T13:34:34.588419+0000","last_undegraded":"2024-04-24T13:34:34.588419+0000","last_fullsized":"2024-04-24T13:34:34.588419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"150'44","reported_seq":310,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.541007+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:34:47.541007+0000","last_peered":"2024-04-24T13:34:47.541007+0000","last_clean":"2024-04-24T13:34:47.541007+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:34:47.541007+0000","last_undegraded":"2024-04-24T13:34:47.541007+0000","last_fullsized":"2024-04-24T13:34:47.541007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671777+0000","last_change":"2024-04-24T13:33:49.289245+0000","last_active":"2024-04-24T13:34:35.671777+0000","last_peered":"2024-04-24T13:34:35.671777+0000","last_clean":"2024-04-24T13:34:35.671777+0000","last_became_active":"2024-04-24T13:33:49.288766+0000","last_became_peered":"2024-04-24T13:33:49.288766+0000","last_unstale":"2024-04-24T13:34:35.671777+0000","last_undegraded":"2024-04-24T13:34:35.671777+0000","last_fullsized":"2024-04-24T13:34:35.671777+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:02:54.620974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554578+0000","last_change":"2024-04-24T13:30:25.231949+0000","last_active":"2024-04-24T13:34:35.554578+0000","last_peered":"2024-04-24T13:34:35.554578+0000","last_clean":"2024-04-24T13:34:35.554578+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:34:35.554578+0000","last_undegraded":"2024-04-24T13:34:35.554578+0000","last_fullsized":"2024-04-24T13:34:35.554578+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"150'52","reported_seq":99,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.624209+0000","last_change":"2024-04-24T13:33:52.712739+0000","last_active":"2024-04-24T13:34:47.624209+0000","last_peered":"2024-04-24T13:34:47.624209+0000","last_clean":"2024-04-24T13:34:47.624209+0000","last_became_active":"2024-04-24T13:33:49.295935+0000","last_became_peered":"2024-04-24T13:33:49.295935+0000","last_unstale":"2024-04-24T13:34:47.624209+0000","last_undegraded":"2024-04-24T13:34:47.624209+0000","last_fullsized":"2024-04-24T13:34:47.624209+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:52.132391+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":56,"num_read_kb":42,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.606340+0000","last_change":"2024-04-24T13:30:29.284047+0000","last_active":"2024-04-24T13:34:42.606340+0000","last_peered":"2024-04-24T13:34:42.606340+0000","last_clean":"2024-04-24T13:34:42.606340+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:34:42.606340+0000","last_undegraded":"2024-04-24T13:34:42.606340+0000","last_fullsized":"2024-04-24T13:34:42.606340+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"105'6","reported_seq":120,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594807+0000","last_change":"2024-04-24T13:33:51.141865+0000","last_active":"2024-04-24T13:34:34.594807+0000","last_peered":"2024-04-24T13:34:34.594807+0000","last_clean":"2024-04-24T13:34:34.594807+0000","last_became_active":"2024-04-24T13:33:49.289035+0000","last_became_peered":"2024-04-24T13:33:49.289035+0000","last_unstale":"2024-04-24T13:34:34.594807+0000","last_undegraded":"2024-04-24T13:34:34.594807+0000","last_fullsized":"2024-04-24T13:34:34.594807+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:08:46.400784+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"82'2","reported_seq":264,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.615572+0000","last_change":"2024-04-24T13:33:09.076639+0000","last_active":"2024-04-24T13:34:42.615572+0000","last_peered":"2024-04-24T13:34:42.615572+0000","last_clean":"2024-04-24T13:34:42.615572+0000","last_became_active":"2024-04-24T13:33:08.705821+0000","last_became_peered":"2024-04-24T13:33:08.705821+0000","last_unstale":"2024-04-24T13:34:42.615572+0000","last_undegraded":"2024-04-24T13:34:42.615572+0000","last_fullsized":"2024-04-24T13:34:42.615572+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"82'2","reported_seq":269,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589644+0000","last_change":"2024-04-24T13:30:23.249334+0000","last_active":"2024-04-24T13:34:34.589644+0000","last_peered":"2024-04-24T13:34:34.589644+0000","last_clean":"2024-04-24T13:34:34.589644+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:34:34.589644+0000","last_undegraded":"2024-04-24T13:34:34.589644+0000","last_fullsized":"2024-04-24T13:34:34.589644+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"150'66","reported_seq":332,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.579068+0000","last_change":"2024-04-24T13:33:50.684508+0000","last_active":"2024-04-24T13:34:47.579068+0000","last_peered":"2024-04-24T13:34:47.579068+0000","last_clean":"2024-04-24T13:34:47.579068+0000","last_became_active":"2024-04-24T13:33:49.297002+0000","last_became_peered":"2024-04-24T13:33:49.297002+0000","last_unstale":"2024-04-24T13:34:47.579068+0000","last_undegraded":"2024-04-24T13:34:47.579068+0000","last_fullsized":"2024-04-24T13:34:47.579068+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":369,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.363378+0000","last_change":"2024-04-24T13:33:09.553473+0000","last_active":"2024-04-24T13:34:46.363378+0000","last_peered":"2024-04-24T13:34:46.363378+0000","last_clean":"2024-04-24T13:34:46.363378+0000","last_became_active":"2024-04-24T13:33:08.738276+0000","last_became_peered":"2024-04-24T13:33:08.738276+0000","last_unstale":"2024-04-24T13:34:46.363378+0000","last_undegraded":"2024-04-24T13:34:46.363378+0000","last_fullsized":"2024-04-24T13:34:46.363378+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"150'24","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.498473+0000","last_change":"2024-04-24T13:30:27.240961+0000","last_active":"2024-04-24T13:34:46.498473+0000","last_peered":"2024-04-24T13:34:46.498473+0000","last_clean":"2024-04-24T13:34:46.498473+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:34:46.498473+0000","last_undegraded":"2024-04-24T13:34:46.498473+0000","last_fullsized":"2024-04-24T13:34:46.498473+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554706+0000","last_change":"2024-04-24T13:30:29.270119+0000","last_active":"2024-04-24T13:34:35.554706+0000","last_peered":"2024-04-24T13:34:35.554706+0000","last_clean":"2024-04-24T13:34:35.554706+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:34:35.554706+0000","last_undegraded":"2024-04-24T13:34:35.554706+0000","last_fullsized":"2024-04-24T13:34:35.554706+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555976+0000","last_change":"2024-04-24T13:33:49.302711+0000","last_active":"2024-04-24T13:34:35.555976+0000","last_peered":"2024-04-24T13:34:35.555976+0000","last_clean":"2024-04-24T13:34:35.555976+0000","last_became_active":"2024-04-24T13:33:49.302201+0000","last_became_peered":"2024-04-24T13:33:49.302201+0000","last_unstale":"2024-04-24T13:34:35.555976+0000","last_undegraded":"2024-04-24T13:34:35.555976+0000","last_fullsized":"2024-04-24T13:34:35.555976+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":263,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528003+0000","last_change":"2024-04-24T13:30:23.237308+0000","last_active":"2024-04-24T13:34:35.528003+0000","last_peered":"2024-04-24T13:34:35.528003+0000","last_clean":"2024-04-24T13:34:35.528003+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:34:35.528003+0000","last_undegraded":"2024-04-24T13:34:35.528003+0000","last_fullsized":"2024-04-24T13:34:35.528003+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"150'40","reported_seq":108,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.412622+0000","last_change":"2024-04-24T13:33:53.881731+0000","last_active":"2024-04-24T13:34:47.412622+0000","last_peered":"2024-04-24T13:34:47.412622+0000","last_clean":"2024-04-24T13:34:47.412622+0000","last_became_active":"2024-04-24T13:33:49.299864+0000","last_became_peered":"2024-04-24T13:33:49.299864+0000","last_unstale":"2024-04-24T13:34:47.412622+0000","last_undegraded":"2024-04-24T13:34:47.412622+0000","last_fullsized":"2024-04-24T13:34:47.412622+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:27:31.093323+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554783+0000","last_change":"2024-04-24T13:30:25.235962+0000","last_active":"2024-04-24T13:34:35.554783+0000","last_peered":"2024-04-24T13:34:35.554783+0000","last_clean":"2024-04-24T13:34:35.554783+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:34:35.554783+0000","last_undegraded":"2024-04-24T13:34:35.554783+0000","last_fullsized":"2024-04-24T13:34:35.554783+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"150'12","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.595958+0000","last_change":"2024-04-24T13:34:51.596038+0000","last_active":"2024-04-24T13:34:51.595958+0000","last_peered":"2024-04-24T13:34:51.595958+0000","last_clean":"2024-04-24T13:34:51.595958+0000","last_became_active":"2024-04-24T13:33:08.721855+0000","last_became_peered":"2024-04-24T13:33:08.721855+0000","last_unstale":"2024-04-24T13:34:51.595958+0000","last_undegraded":"2024-04-24T13:34:51.595958+0000","last_fullsized":"2024-04-24T13:34:51.595958+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'12","last_scrub_stamp":"2024-04-24T13:34:51.595741+0000","last_deep_scrub":"150'12","last_deep_scrub_stamp":"2024-04-24T13:34:51.595741+0000","last_clean_scrub_stamp":"2024-04-24T13:34:51.595741+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:00:07.543976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669578+0000","last_change":"2024-04-24T13:33:49.302936+0000","last_active":"2024-04-24T13:34:35.669578+0000","last_peered":"2024-04-24T13:34:35.669578+0000","last_clean":"2024-04-24T13:34:35.669578+0000","last_became_active":"2024-04-24T13:33:49.297478+0000","last_became_peered":"2024-04-24T13:33:49.297478+0000","last_unstale":"2024-04-24T13:34:35.669578+0000","last_undegraded":"2024-04-24T13:34:35.669578+0000","last_fullsized":"2024-04-24T13:34:35.669578+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:39.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"132'6","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666030+0000","last_change":"2024-04-24T13:30:31.271834+0000","last_active":"2024-04-24T13:34:35.666030+0000","last_peered":"2024-04-24T13:34:35.666030+0000","last_clean":"2024-04-24T13:34:35.666030+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:34:35.666030+0000","last_undegraded":"2024-04-24T13:34:35.666030+0000","last_fullsized":"2024-04-24T13:34:35.666030+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"82'4","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554448+0000","last_change":"2024-04-24T13:33:49.688460+0000","last_active":"2024-04-24T13:34:35.554448+0000","last_peered":"2024-04-24T13:34:35.554448+0000","last_clean":"2024-04-24T13:34:35.554448+0000","last_became_active":"2024-04-24T13:33:49.292866+0000","last_became_peered":"2024-04-24T13:33:49.292866+0000","last_unstale":"2024-04-24T13:34:35.554448+0000","last_undegraded":"2024-04-24T13:34:35.554448+0000","last_fullsized":"2024-04-24T13:34:35.554448+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"150'44","reported_seq":194,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.584722+0000","last_change":"2024-04-24T13:33:52.207013+0000","last_active":"2024-04-24T13:34:47.584722+0000","last_peered":"2024-04-24T13:34:47.584722+0000","last_clean":"2024-04-24T13:34:47.584722+0000","last_became_active":"2024-04-24T13:33:49.289650+0000","last_became_peered":"2024-04-24T13:33:49.289650+0000","last_unstale":"2024-04-24T13:34:47.584722+0000","last_undegraded":"2024-04-24T13:34:47.584722+0000","last_fullsized":"2024-04-24T13:34:47.584722+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:15:45.985778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667585+0000","last_change":"2024-04-24T13:33:49.283767+0000","last_active":"2024-04-24T13:34:35.667585+0000","last_peered":"2024-04-24T13:34:35.667585+0000","last_clean":"2024-04-24T13:34:35.667585+0000","last_became_active":"2024-04-24T13:33:49.283342+0000","last_became_peered":"2024-04-24T13:33:49.283342+0000","last_unstale":"2024-04-24T13:34:35.667585+0000","last_undegraded":"2024-04-24T13:34:35.667585+0000","last_fullsized":"2024-04-24T13:34:35.667585+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:39:36.682746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"150'23","reported_seq":290,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.291153+0000","last_change":"2024-04-24T13:30:27.242789+0000","last_active":"2024-04-24T13:34:47.291153+0000","last_peered":"2024-04-24T13:34:47.291153+0000","last_clean":"2024-04-24T13:34:47.291153+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:34:47.291153+0000","last_undegraded":"2024-04-24T13:34:47.291153+0000","last_fullsized":"2024-04-24T13:34:47.291153+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668177+0000","last_change":"2024-04-24T13:30:29.265393+0000","last_active":"2024-04-24T13:34:35.668177+0000","last_peered":"2024-04-24T13:34:35.668177+0000","last_clean":"2024-04-24T13:34:35.668177+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:34:35.668177+0000","last_undegraded":"2024-04-24T13:34:35.668177+0000","last_fullsized":"2024-04-24T13:34:35.668177+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:55:54.473936+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"114'4","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594405+0000","last_change":"2024-04-24T13:33:50.241765+0000","last_active":"2024-04-24T13:34:34.594405+0000","last_peered":"2024-04-24T13:34:34.594405+0000","last_clean":"2024-04-24T13:34:34.594405+0000","last_became_active":"2024-04-24T13:33:49.288852+0000","last_became_peered":"2024-04-24T13:33:49.288852+0000","last_unstale":"2024-04-24T13:34:34.594405+0000","last_undegraded":"2024-04-24T13:34:34.594405+0000","last_fullsized":"2024-04-24T13:34:34.594405+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:53:23.401847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":272,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554939+0000","last_change":"2024-04-24T13:30:23.224426+0000","last_active":"2024-04-24T13:34:35.554939+0000","last_peered":"2024-04-24T13:34:35.554939+0000","last_clean":"2024-04-24T13:34:35.554939+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:34:35.554939+0000","last_undegraded":"2024-04-24T13:34:35.554939+0000","last_fullsized":"2024-04-24T13:34:35.554939+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"150'40","reported_seq":333,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.585204+0000","last_change":"2024-04-24T13:33:09.773703+0000","last_active":"2024-04-24T13:34:47.585204+0000","last_peered":"2024-04-24T13:34:47.585204+0000","last_clean":"2024-04-24T13:34:47.585204+0000","last_became_active":"2024-04-24T13:33:08.722546+0000","last_became_peered":"2024-04-24T13:33:08.722546+0000","last_unstale":"2024-04-24T13:34:47.585204+0000","last_undegraded":"2024-04-24T13:34:47.585204+0000","last_fullsized":"2024-04-24T13:34:47.585204+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667888+0000","last_change":"2024-04-24T13:30:25.236948+0000","last_active":"2024-04-24T13:34:35.667888+0000","last_peered":"2024-04-24T13:34:35.667888+0000","last_clean":"2024-04-24T13:34:35.667888+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:34:35.667888+0000","last_undegraded":"2024-04-24T13:34:35.667888+0000","last_fullsized":"2024-04-24T13:34:35.667888+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:50:30.828965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"150'21","reported_seq":75,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.279852+0000","last_change":"2024-04-24T13:33:52.735528+0000","last_active":"2024-04-24T13:34:47.279852+0000","last_peered":"2024-04-24T13:34:47.279852+0000","last_clean":"2024-04-24T13:34:47.279852+0000","last_became_active":"2024-04-24T13:33:49.297667+0000","last_became_peered":"2024-04-24T13:33:49.297667+0000","last_unstale":"2024-04-24T13:34:47.279852+0000","last_undegraded":"2024-04-24T13:34:47.279852+0000","last_fullsized":"2024-04-24T13:34:47.279852+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:07:05.200322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665308+0000","last_change":"2024-04-24T13:33:49.286645+0000","last_active":"2024-04-24T13:34:35.665308+0000","last_peered":"2024-04-24T13:34:35.665308+0000","last_clean":"2024-04-24T13:34:35.665308+0000","last_became_active":"2024-04-24T13:33:49.285495+0000","last_became_peered":"2024-04-24T13:33:49.285495+0000","last_unstale":"2024-04-24T13:34:35.665308+0000","last_undegraded":"2024-04-24T13:34:35.665308+0000","last_fullsized":"2024-04-24T13:34:35.665308+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"82'8","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671651+0000","last_change":"2024-04-24T13:30:23.243446+0000","last_active":"2024-04-24T13:34:35.671651+0000","last_peered":"2024-04-24T13:34:35.671651+0000","last_clean":"2024-04-24T13:34:35.671651+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:34:35.671651+0000","last_undegraded":"2024-04-24T13:34:35.671651+0000","last_fullsized":"2024-04-24T13:34:35.671651+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:24:26.599653+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"150'54","reported_seq":321,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.540415+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:34:47.540415+0000","last_peered":"2024-04-24T13:34:47.540415+0000","last_clean":"2024-04-24T13:34:47.540415+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:34:47.540415+0000","last_undegraded":"2024-04-24T13:34:47.540415+0000","last_fullsized":"2024-04-24T13:34:47.540415+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667662+0000","last_change":"2024-04-24T13:33:49.296871+0000","last_active":"2024-04-24T13:34:35.667662+0000","last_peered":"2024-04-24T13:34:35.667662+0000","last_clean":"2024-04-24T13:34:35.667662+0000","last_became_active":"2024-04-24T13:33:49.295933+0000","last_became_peered":"2024-04-24T13:33:49.295933+0000","last_unstale":"2024-04-24T13:34:35.667662+0000","last_undegraded":"2024-04-24T13:34:35.667662+0000","last_fullsized":"2024-04-24T13:34:35.667662+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"150'36","reported_seq":310,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.277216+0000","last_change":"2024-04-24T13:30:27.257964+0000","last_active":"2024-04-24T13:34:47.277216+0000","last_peered":"2024-04-24T13:34:47.277216+0000","last_clean":"2024-04-24T13:34:47.277216+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:34:47.277216+0000","last_undegraded":"2024-04-24T13:34:47.277216+0000","last_fullsized":"2024-04-24T13:34:47.277216+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594350+0000","last_change":"2024-04-24T13:33:08.717844+0000","last_active":"2024-04-24T13:34:34.594350+0000","last_peered":"2024-04-24T13:34:34.594350+0000","last_clean":"2024-04-24T13:34:34.594350+0000","last_became_active":"2024-04-24T13:33:08.716627+0000","last_became_peered":"2024-04-24T13:33:08.716627+0000","last_unstale":"2024-04-24T13:34:34.594350+0000","last_undegraded":"2024-04-24T13:34:34.594350+0000","last_fullsized":"2024-04-24T13:34:34.594350+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:43.447785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":247,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554319+0000","last_change":"2024-04-24T13:30:31.991486+0000","last_active":"2024-04-24T13:34:35.554319+0000","last_peered":"2024-04-24T13:34:35.554319+0000","last_clean":"2024-04-24T13:34:35.554319+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:34:35.554319+0000","last_undegraded":"2024-04-24T13:34:35.554319+0000","last_fullsized":"2024-04-24T13:34:35.554319+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"114'10","reported_seq":325,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667538+0000","last_change":"2024-04-24T13:33:50.254858+0000","last_active":"2024-04-24T13:34:35.667538+0000","last_peered":"2024-04-24T13:34:35.667538+0000","last_clean":"2024-04-24T13:34:35.667538+0000","last_became_active":"2024-04-24T13:33:49.285680+0000","last_became_peered":"2024-04-24T13:33:49.285680+0000","last_unstale":"2024-04-24T13:34:35.667538+0000","last_undegraded":"2024-04-24T13:34:35.667538+0000","last_fullsized":"2024-04-24T13:34:35.667538+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"150'40","reported_seq":307,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.558889+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:34:47.558889+0000","last_peered":"2024-04-24T13:34:47.558889+0000","last_clean":"2024-04-24T13:34:47.558889+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:34:47.558889+0000","last_undegraded":"2024-04-24T13:34:47.558889+0000","last_fullsized":"2024-04-24T13:34:47.558889+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671404+0000","last_change":"2024-04-24T13:30:25.237604+0000","last_active":"2024-04-24T13:34:35.671404+0000","last_peered":"2024-04-24T13:34:35.671404+0000","last_clean":"2024-04-24T13:34:35.671404+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:34:35.671404+0000","last_undegraded":"2024-04-24T13:34:35.671404+0000","last_fullsized":"2024-04-24T13:34:35.671404+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:49:02.208682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"150'26","reported_seq":81,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.283217+0000","last_change":"2024-04-24T13:33:51.826433+0000","last_active":"2024-04-24T13:34:47.283217+0000","last_peered":"2024-04-24T13:34:47.283217+0000","last_clean":"2024-04-24T13:34:47.283217+0000","last_became_active":"2024-04-24T13:33:49.291994+0000","last_became_peered":"2024-04-24T13:33:49.291994+0000","last_unstale":"2024-04-24T13:34:47.283217+0000","last_undegraded":"2024-04-24T13:34:47.283217+0000","last_fullsized":"2024-04-24T13:34:47.283217+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:33:35.992700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":251,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525723+0000","last_change":"2024-04-24T13:30:29.281296+0000","last_active":"2024-04-24T13:34:35.525723+0000","last_peered":"2024-04-24T13:34:35.525723+0000","last_clean":"2024-04-24T13:34:35.525723+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:34:35.525723+0000","last_undegraded":"2024-04-24T13:34:35.525723+0000","last_fullsized":"2024-04-24T13:34:35.525723+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669486+0000","last_change":"2024-04-24T13:33:49.289138+0000","last_active":"2024-04-24T13:34:35.669486+0000","last_peered":"2024-04-24T13:34:35.669486+0000","last_clean":"2024-04-24T13:34:35.669486+0000","last_became_active":"2024-04-24T13:33:49.288760+0000","last_became_peered":"2024-04-24T13:33:49.288760+0000","last_unstale":"2024-04-24T13:34:35.669486+0000","last_undegraded":"2024-04-24T13:34:35.669486+0000","last_fullsized":"2024-04-24T13:34:35.669486+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:12:25.409700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":263,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554389+0000","last_change":"2024-04-24T13:30:23.224538+0000","last_active":"2024-04-24T13:34:35.554389+0000","last_peered":"2024-04-24T13:34:35.554389+0000","last_clean":"2024-04-24T13:34:35.554389+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:34:35.554389+0000","last_undegraded":"2024-04-24T13:34:35.554389+0000","last_fullsized":"2024-04-24T13:34:35.554389+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"150'34","reported_seq":299,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.567470+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:34:47.567470+0000","last_peered":"2024-04-24T13:34:47.567470+0000","last_clean":"2024-04-24T13:34:47.567470+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:34:47.567470+0000","last_undegraded":"2024-04-24T13:34:47.567470+0000","last_fullsized":"2024-04-24T13:34:47.567470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591107+0000","last_change":"2024-04-24T13:30:25.232563+0000","last_active":"2024-04-24T13:34:34.591107+0000","last_peered":"2024-04-24T13:34:34.591107+0000","last_clean":"2024-04-24T13:34:34.591107+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:34:34.591107+0000","last_undegraded":"2024-04-24T13:34:34.591107+0000","last_fullsized":"2024-04-24T13:34:34.591107+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"150'23","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.523122+0000","last_change":"2024-04-24T13:30:27.243493+0000","last_active":"2024-04-24T13:34:46.523122+0000","last_peered":"2024-04-24T13:34:46.523122+0000","last_clean":"2024-04-24T13:34:46.523122+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:34:46.523122+0000","last_undegraded":"2024-04-24T13:34:46.523122+0000","last_fullsized":"2024-04-24T13:34:46.523122+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.526402+0000","last_change":"2024-04-24T13:30:29.282018+0000","last_active":"2024-04-24T13:34:35.526402+0000","last_peered":"2024-04-24T13:34:35.526402+0000","last_clean":"2024-04-24T13:34:35.526402+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:34:35.526402+0000","last_undegraded":"2024-04-24T13:34:35.526402+0000","last_fullsized":"2024-04-24T13:34:35.526402+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592796+0000","last_change":"2024-04-24T13:33:49.289867+0000","last_active":"2024-04-24T13:34:34.592796+0000","last_peered":"2024-04-24T13:34:34.592796+0000","last_clean":"2024-04-24T13:34:34.592796+0000","last_became_active":"2024-04-24T13:33:49.289412+0000","last_became_peered":"2024-04-24T13:33:49.289412+0000","last_unstale":"2024-04-24T13:34:34.592796+0000","last_undegraded":"2024-04-24T13:34:34.592796+0000","last_fullsized":"2024-04-24T13:34:34.592796+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:24:50.051036+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"114'2","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665643+0000","last_change":"2024-04-24T13:30:23.219171+0000","last_active":"2024-04-24T13:34:35.665643+0000","last_peered":"2024-04-24T13:34:35.665643+0000","last_clean":"2024-04-24T13:34:35.665643+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:34:35.665643+0000","last_undegraded":"2024-04-24T13:34:35.665643+0000","last_fullsized":"2024-04-24T13:34:35.665643+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"150'56","reported_seq":321,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.596859+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:34:47.596859+0000","last_peered":"2024-04-24T13:34:47.596859+0000","last_clean":"2024-04-24T13:34:47.596859+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:34:47.596859+0000","last_undegraded":"2024-04-24T13:34:47.596859+0000","last_fullsized":"2024-04-24T13:34:47.596859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.525971+0000","last_change":"2024-04-24T13:30:25.230626+0000","last_active":"2024-04-24T13:34:35.525971+0000","last_peered":"2024-04-24T13:34:35.525971+0000","last_clean":"2024-04-24T13:34:35.525971+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:34:35.525971+0000","last_undegraded":"2024-04-24T13:34:35.525971+0000","last_fullsized":"2024-04-24T13:34:35.525971+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"32'10","reported_seq":269,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590978+0000","last_change":"2024-04-24T13:30:27.246000+0000","last_active":"2024-04-24T13:34:34.590978+0000","last_peered":"2024-04-24T13:34:34.590978+0000","last_clean":"2024-04-24T13:34:34.590978+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:34:34.590978+0000","last_undegraded":"2024-04-24T13:34:34.590978+0000","last_fullsized":"2024-04-24T13:34:34.590978+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"150'138","reported_seq":435,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.371253+0000","last_change":"2024-04-24T13:30:29.264868+0000","last_active":"2024-04-24T13:34:46.371253+0000","last_peered":"2024-04-24T13:34:46.371253+0000","last_clean":"2024-04-24T13:34:46.371253+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:34:46.371253+0000","last_undegraded":"2024-04-24T13:34:46.371253+0000","last_fullsized":"2024-04-24T13:34:46.371253+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:50:02.245452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"82'6","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670479+0000","last_change":"2024-04-24T13:33:50.541311+0000","last_active":"2024-04-24T13:34:35.670479+0000","last_peered":"2024-04-24T13:34:35.670479+0000","last_clean":"2024-04-24T13:34:35.670479+0000","last_became_active":"2024-04-24T13:33:49.285594+0000","last_became_peered":"2024-04-24T13:33:49.285594+0000","last_unstale":"2024-04-24T13:34:35.670479+0000","last_undegraded":"2024-04-24T13:34:35.670479+0000","last_fullsized":"2024-04-24T13:34:35.670479+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:42:45.453497+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"86'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589580+0000","last_change":"2024-04-24T13:30:23.224787+0000","last_active":"2024-04-24T13:34:34.589580+0000","last_peered":"2024-04-24T13:34:34.589580+0000","last_clean":"2024-04-24T13:34:34.589580+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:34:34.589580+0000","last_undegraded":"2024-04-24T13:34:34.589580+0000","last_fullsized":"2024-04-24T13:34:34.589580+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"150'54","reported_seq":169,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.582259+0000","last_change":"2024-04-24T13:33:09.116807+0000","last_active":"2024-04-24T13:34:47.582259+0000","last_peered":"2024-04-24T13:34:47.582259+0000","last_clean":"2024-04-24T13:34:47.582259+0000","last_became_active":"2024-04-24T13:33:08.708911+0000","last_became_peered":"2024-04-24T13:33:08.708911+0000","last_unstale":"2024-04-24T13:34:47.582259+0000","last_undegraded":"2024-04-24T13:34:47.582259+0000","last_fullsized":"2024-04-24T13:34:47.582259+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:06:59.171558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":108544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669046+0000","last_change":"2024-04-24T13:33:49.283103+0000","last_active":"2024-04-24T13:34:35.669046+0000","last_peered":"2024-04-24T13:34:35.669046+0000","last_clean":"2024-04-24T13:34:35.669046+0000","last_became_active":"2024-04-24T13:33:49.282772+0000","last_became_peered":"2024-04-24T13:33:49.282772+0000","last_unstale":"2024-04-24T13:34:35.669046+0000","last_undegraded":"2024-04-24T13:34:35.669046+0000","last_fullsized":"2024-04-24T13:34:35.669046+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:52:44.215595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"150'29","reported_seq":129,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.079241+0000","last_change":"2024-04-24T13:33:09.934600+0000","last_active":"2024-04-24T13:34:47.079241+0000","last_peered":"2024-04-24T13:34:47.079241+0000","last_clean":"2024-04-24T13:34:47.079241+0000","last_became_active":"2024-04-24T13:33:08.732254+0000","last_became_peered":"2024-04-24T13:33:08.732254+0000","last_unstale":"2024-04-24T13:34:47.079241+0000","last_undegraded":"2024-04-24T13:34:47.079241+0000","last_fullsized":"2024-04-24T13:34:47.079241+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:37:35.846866+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":249,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.664996+0000","last_change":"2024-04-24T13:30:29.265270+0000","last_active":"2024-04-24T13:34:35.664996+0000","last_peered":"2024-04-24T13:34:35.664996+0000","last_clean":"2024-04-24T13:34:35.664996+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:34:35.664996+0000","last_undegraded":"2024-04-24T13:34:35.664996+0000","last_fullsized":"2024-04-24T13:34:35.664996+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670236+0000","last_change":"2024-04-24T13:33:49.295971+0000","last_active":"2024-04-24T13:34:35.670236+0000","last_peered":"2024-04-24T13:34:35.670236+0000","last_clean":"2024-04-24T13:34:35.670236+0000","last_became_active":"2024-04-24T13:33:49.294486+0000","last_became_peered":"2024-04-24T13:33:49.294486+0000","last_unstale":"2024-04-24T13:34:35.670236+0000","last_undegraded":"2024-04-24T13:34:35.670236+0000","last_fullsized":"2024-04-24T13:34:35.670236+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:53:43.527494+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"105'6","reported_seq":147,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667474+0000","last_change":"2024-04-24T13:32:32.751387+0000","last_active":"2024-04-24T13:34:35.667474+0000","last_peered":"2024-04-24T13:34:35.667474+0000","last_clean":"2024-04-24T13:34:35.667474+0000","last_became_active":"2024-04-24T13:32:32.741990+0000","last_became_peered":"2024-04-24T13:32:32.741990+0000","last_unstale":"2024-04-24T13:34:35.667474+0000","last_undegraded":"2024-04-24T13:34:35.667474+0000","last_fullsized":"2024-04-24T13:34:35.667474+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:49.789798+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"150'46","reported_seq":314,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.574446+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:34:47.574446+0000","last_peered":"2024-04-24T13:34:47.574446+0000","last_clean":"2024-04-24T13:34:47.574446+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:34:47.574446+0000","last_undegraded":"2024-04-24T13:34:47.574446+0000","last_fullsized":"2024-04-24T13:34:47.574446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:14:59.394156+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":102,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593550+0000","last_change":"2024-04-24T13:33:08.705125+0000","last_active":"2024-04-24T13:34:34.593550+0000","last_peered":"2024-04-24T13:34:34.593550+0000","last_clean":"2024-04-24T13:34:34.593550+0000","last_became_active":"2024-04-24T13:33:08.704735+0000","last_became_peered":"2024-04-24T13:33:08.704735+0000","last_unstale":"2024-04-24T13:34:34.593550+0000","last_undegraded":"2024-04-24T13:34:34.593550+0000","last_fullsized":"2024-04-24T13:34:34.593550+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:22:14.183681+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"150'21","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.085061+0000","last_change":"2024-04-24T13:30:27.246825+0000","last_active":"2024-04-24T13:34:47.085061+0000","last_peered":"2024-04-24T13:34:47.085061+0000","last_clean":"2024-04-24T13:34:47.085061+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:34:47.085061+0000","last_undegraded":"2024-04-24T13:34:47.085061+0000","last_fullsized":"2024-04-24T13:34:47.085061+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667249+0000","last_change":"2024-04-24T13:33:49.289409+0000","last_active":"2024-04-24T13:34:35.667249+0000","last_peered":"2024-04-24T13:34:35.667249+0000","last_clean":"2024-04-24T13:34:35.667249+0000","last_became_active":"2024-04-24T13:33:49.288970+0000","last_became_peered":"2024-04-24T13:33:49.288970+0000","last_unstale":"2024-04-24T13:34:35.667249+0000","last_undegraded":"2024-04-24T13:34:35.667249+0000","last_fullsized":"2024-04-24T13:34:35.667249+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:30:39.437555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":247,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.556066+0000","last_change":"2024-04-24T13:30:31.994240+0000","last_active":"2024-04-24T13:34:35.556066+0000","last_peered":"2024-04-24T13:34:35.556066+0000","last_clean":"2024-04-24T13:34:35.556066+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:34:35.556066+0000","last_undegraded":"2024-04-24T13:34:35.556066+0000","last_fullsized":"2024-04-24T13:34:35.556066+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"105'10","reported_seq":244,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592552+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:34:34.592552+0000","last_peered":"2024-04-24T13:34:34.592552+0000","last_clean":"2024-04-24T13:34:34.592552+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:34:34.592552+0000","last_undegraded":"2024-04-24T13:34:34.592552+0000","last_fullsized":"2024-04-24T13:34:34.592552+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:01:14.898686+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"150'38","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.590308+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:34:47.590308+0000","last_peered":"2024-04-24T13:34:47.590308+0000","last_clean":"2024-04-24T13:34:47.590308+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:34:47.590308+0000","last_undegraded":"2024-04-24T13:34:47.590308+0000","last_fullsized":"2024-04-24T13:34:47.590308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.587853+0000","last_change":"2024-04-24T13:30:25.231452+0000","last_active":"2024-04-24T13:34:34.587853+0000","last_peered":"2024-04-24T13:34:34.587853+0000","last_clean":"2024-04-24T13:34:34.587853+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:34:34.587853+0000","last_undegraded":"2024-04-24T13:34:34.587853+0000","last_fullsized":"2024-04-24T13:34:34.587853+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"150'16","reported_seq":189,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.510996+0000","last_change":"2024-04-24T13:33:51.167111+0000","last_active":"2024-04-24T13:34:46.510996+0000","last_peered":"2024-04-24T13:34:46.510996+0000","last_clean":"2024-04-24T13:34:46.510996+0000","last_became_active":"2024-04-24T13:33:49.302159+0000","last_became_peered":"2024-04-24T13:33:49.302159+0000","last_unstale":"2024-04-24T13:34:46.510996+0000","last_undegraded":"2024-04-24T13:34:46.510996+0000","last_fullsized":"2024-04-24T13:34:46.510996+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":249,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588214+0000","last_change":"2024-04-24T13:30:29.279964+0000","last_active":"2024-04-24T13:34:34.588214+0000","last_peered":"2024-04-24T13:34:34.588214+0000","last_clean":"2024-04-24T13:34:34.588214+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:34:34.588214+0000","last_undegraded":"2024-04-24T13:34:34.588214+0000","last_fullsized":"2024-04-24T13:34:34.588214+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"82'2","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670276+0000","last_change":"2024-04-24T13:33:54.657281+0000","last_active":"2024-04-24T13:34:35.670276+0000","last_peered":"2024-04-24T13:34:35.670276+0000","last_clean":"2024-04-24T13:34:35.670276+0000","last_became_active":"2024-04-24T13:33:49.303239+0000","last_became_peered":"2024-04-24T13:33:49.303239+0000","last_unstale":"2024-04-24T13:34:35.670276+0000","last_undegraded":"2024-04-24T13:34:35.670276+0000","last_fullsized":"2024-04-24T13:34:35.670276+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:22:32.797578+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"82'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588363+0000","last_change":"2024-04-24T13:30:23.237883+0000","last_active":"2024-04-24T13:34:34.588363+0000","last_peered":"2024-04-24T13:34:34.588363+0000","last_clean":"2024-04-24T13:34:34.588363+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:34:34.588363+0000","last_undegraded":"2024-04-24T13:34:34.588363+0000","last_fullsized":"2024-04-24T13:34:34.588363+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"150'42","reported_seq":215,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.602215+0000","last_change":"2024-04-24T13:33:09.073468+0000","last_active":"2024-04-24T13:34:47.602215+0000","last_peered":"2024-04-24T13:34:47.602215+0000","last_clean":"2024-04-24T13:34:47.602215+0000","last_became_active":"2024-04-24T13:33:08.725822+0000","last_became_peered":"2024-04-24T13:33:08.725822+0000","last_unstale":"2024-04-24T13:34:47.602215+0000","last_undegraded":"2024-04-24T13:34:47.602215+0000","last_fullsized":"2024-04-24T13:34:47.602215+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528841+0000","last_change":"2024-04-24T13:33:09.078708+0000","last_active":"2024-04-24T13:34:35.528841+0000","last_peered":"2024-04-24T13:34:35.528841+0000","last_clean":"2024-04-24T13:34:35.528841+0000","last_became_active":"2024-04-24T13:33:08.726873+0000","last_became_peered":"2024-04-24T13:33:08.726873+0000","last_unstale":"2024-04-24T13:34:35.528841+0000","last_undegraded":"2024-04-24T13:34:35.528841+0000","last_fullsized":"2024-04-24T13:34:35.528841+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"150'20","reported_seq":314,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.531797+0000","last_change":"2024-04-24T13:33:09.087185+0000","last_active":"2024-04-24T13:34:46.531797+0000","last_peered":"2024-04-24T13:34:46.531797+0000","last_clean":"2024-04-24T13:34:46.531797+0000","last_became_active":"2024-04-24T13:33:08.726347+0000","last_became_peered":"2024-04-24T13:33:08.726347+0000","last_unstale":"2024-04-24T13:34:46.531797+0000","last_undegraded":"2024-04-24T13:34:46.531797+0000","last_fullsized":"2024-04-24T13:34:46.531797+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":249,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.665220+0000","last_change":"2024-04-24T13:30:29.259474+0000","last_active":"2024-04-24T13:34:35.665220+0000","last_peered":"2024-04-24T13:34:35.665220+0000","last_clean":"2024-04-24T13:34:35.665220+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:34:35.665220+0000","last_undegraded":"2024-04-24T13:34:35.665220+0000","last_fullsized":"2024-04-24T13:34:35.665220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":245,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589840+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:34:34.589840+0000","last_peered":"2024-04-24T13:34:34.589840+0000","last_clean":"2024-04-24T13:34:34.589840+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:34:34.589840+0000","last_undegraded":"2024-04-24T13:34:34.589840+0000","last_fullsized":"2024-04-24T13:34:34.589840+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"132'10","reported_seq":304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.609858+0000","last_change":"2024-04-24T13:30:23.239396+0000","last_active":"2024-04-24T13:34:42.609858+0000","last_peered":"2024-04-24T13:34:42.609858+0000","last_clean":"2024-04-24T13:34:42.609858+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:34:42.609858+0000","last_undegraded":"2024-04-24T13:34:42.609858+0000","last_fullsized":"2024-04-24T13:34:42.609858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"150'28","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.466344+0000","last_change":"2024-04-24T13:30:21.236962+0000","last_active":"2024-04-24T13:34:47.466344+0000","last_peered":"2024-04-24T13:34:47.466344+0000","last_clean":"2024-04-24T13:34:47.466344+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:34:47.466344+0000","last_undegraded":"2024-04-24T13:34:47.466344+0000","last_fullsized":"2024-04-24T13:34:47.466344+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:18.912159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"105'12","reported_seq":304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.609824+0000","last_change":"2024-04-24T13:30:23.219097+0000","last_active":"2024-04-24T13:34:42.609824+0000","last_peered":"2024-04-24T13:34:42.609824+0000","last_clean":"2024-04-24T13:34:42.609824+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:34:42.609824+0000","last_undegraded":"2024-04-24T13:34:42.609824+0000","last_fullsized":"2024-04-24T13:34:42.609824+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"150'38","reported_seq":330,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.504807+0000","last_change":"2024-04-24T13:33:09.324802+0000","last_active":"2024-04-24T13:34:47.504807+0000","last_peered":"2024-04-24T13:34:47.504807+0000","last_clean":"2024-04-24T13:34:47.504807+0000","last_became_active":"2024-04-24T13:33:08.725876+0000","last_became_peered":"2024-04-24T13:33:08.725876+0000","last_unstale":"2024-04-24T13:34:47.504807+0000","last_undegraded":"2024-04-24T13:34:47.504807+0000","last_fullsized":"2024-04-24T13:34:47.504807+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"82'2","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594991+0000","last_change":"2024-04-24T13:33:53.237778+0000","last_active":"2024-04-24T13:34:34.594991+0000","last_peered":"2024-04-24T13:34:34.594991+0000","last_clean":"2024-04-24T13:34:34.594991+0000","last_became_active":"2024-04-24T13:33:49.302722+0000","last_became_peered":"2024-04-24T13:33:49.302722+0000","last_unstale":"2024-04-24T13:34:34.594991+0000","last_undegraded":"2024-04-24T13:34:34.594991+0000","last_fullsized":"2024-04-24T13:34:34.594991+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:52:06.190295+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"150'56","reported_seq":171,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.597852+0000","last_change":"2024-04-24T13:33:09.548908+0000","last_active":"2024-04-24T13:34:47.597852+0000","last_peered":"2024-04-24T13:34:47.597852+0000","last_clean":"2024-04-24T13:34:47.597852+0000","last_became_active":"2024-04-24T13:33:08.720010+0000","last_became_peered":"2024-04-24T13:33:08.720010+0000","last_unstale":"2024-04-24T13:34:47.597852+0000","last_undegraded":"2024-04-24T13:34:47.597852+0000","last_fullsized":"2024-04-24T13:34:47.597852+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:06.195033+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"114'12","reported_seq":321,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.609762+0000","last_change":"2024-04-24T13:33:49.678468+0000","last_active":"2024-04-24T13:34:42.609762+0000","last_peered":"2024-04-24T13:34:42.609762+0000","last_clean":"2024-04-24T13:34:42.609762+0000","last_became_active":"2024-04-24T13:33:49.289642+0000","last_became_peered":"2024-04-24T13:33:49.289642+0000","last_unstale":"2024-04-24T13:34:42.609762+0000","last_undegraded":"2024-04-24T13:34:42.609762+0000","last_fullsized":"2024-04-24T13:34:42.609762+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"150'62","reported_seq":328,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.588702+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:34:47.588702+0000","last_peered":"2024-04-24T13:34:47.588702+0000","last_clean":"2024-04-24T13:34:47.588702+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:34:47.588702+0000","last_undegraded":"2024-04-24T13:34:47.588702+0000","last_fullsized":"2024-04-24T13:34:47.588702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"132'4","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555032+0000","last_change":"2024-04-24T13:33:51.611283+0000","last_active":"2024-04-24T13:34:35.555032+0000","last_peered":"2024-04-24T13:34:35.555032+0000","last_clean":"2024-04-24T13:34:35.555032+0000","last_became_active":"2024-04-24T13:33:49.304888+0000","last_became_peered":"2024-04-24T13:33:49.304888+0000","last_unstale":"2024-04-24T13:34:35.555032+0000","last_undegraded":"2024-04-24T13:34:35.555032+0000","last_fullsized":"2024-04-24T13:34:35.555032+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"150'44","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.590729+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:34:47.590729+0000","last_peered":"2024-04-24T13:34:47.590729+0000","last_clean":"2024-04-24T13:34:47.590729+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:34:47.590729+0000","last_undegraded":"2024-04-24T13:34:47.590729+0000","last_fullsized":"2024-04-24T13:34:47.590729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"81'2","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589647+0000","last_change":"2024-04-24T13:30:23.241130+0000","last_active":"2024-04-24T13:34:34.589647+0000","last_peered":"2024-04-24T13:34:34.589647+0000","last_clean":"2024-04-24T13:34:34.589647+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:34:34.589647+0000","last_undegraded":"2024-04-24T13:34:34.589647+0000","last_fullsized":"2024-04-24T13:34:34.589647+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"150'36","reported_seq":304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.604166+0000","last_change":"2024-04-24T13:30:21.226001+0000","last_active":"2024-04-24T13:34:47.604166+0000","last_peered":"2024-04-24T13:34:47.604166+0000","last_clean":"2024-04-24T13:34:47.604166+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:34:47.604166+0000","last_undegraded":"2024-04-24T13:34:47.604166+0000","last_fullsized":"2024-04-24T13:34:47.604166+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"132'12","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554573+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:34:35.554573+0000","last_peered":"2024-04-24T13:34:35.554573+0000","last_clean":"2024-04-24T13:34:35.554573+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:34:35.554573+0000","last_undegraded":"2024-04-24T13:34:35.554573+0000","last_fullsized":"2024-04-24T13:34:35.554573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"150'58","reported_seq":369,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.576630+0000","last_change":"2024-04-24T13:33:50.237368+0000","last_active":"2024-04-24T13:34:47.576630+0000","last_peered":"2024-04-24T13:34:47.576630+0000","last_clean":"2024-04-24T13:34:47.576630+0000","last_became_active":"2024-04-24T13:33:49.301145+0000","last_became_peered":"2024-04-24T13:33:49.301145+0000","last_unstale":"2024-04-24T13:34:47.576630+0000","last_undegraded":"2024-04-24T13:34:47.576630+0000","last_fullsized":"2024-04-24T13:34:47.576630+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:57:21.677851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666722+0000","last_change":"2024-04-24T13:30:23.244874+0000","last_active":"2024-04-24T13:34:35.666722+0000","last_peered":"2024-04-24T13:34:35.666722+0000","last_clean":"2024-04-24T13:34:35.666722+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:34:35.666722+0000","last_undegraded":"2024-04-24T13:34:35.666722+0000","last_fullsized":"2024-04-24T13:34:35.666722+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:07:12.046510+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"150'32","reported_seq":300,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.462038+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:34:47.462038+0000","last_peered":"2024-04-24T13:34:47.462038+0000","last_clean":"2024-04-24T13:34:47.462038+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:34:47.462038+0000","last_undegraded":"2024-04-24T13:34:47.462038+0000","last_fullsized":"2024-04-24T13:34:47.462038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"105'8","reported_seq":296,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668093+0000","last_change":"2024-04-24T13:30:23.222616+0000","last_active":"2024-04-24T13:34:35.668093+0000","last_peered":"2024-04-24T13:34:35.668093+0000","last_clean":"2024-04-24T13:34:35.668093+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:34:35.668093+0000","last_undegraded":"2024-04-24T13:34:35.668093+0000","last_fullsized":"2024-04-24T13:34:35.668093+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"150'56","reported_seq":169,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.481315+0000","last_change":"2024-04-24T13:33:09.287304+0000","last_active":"2024-04-24T13:34:47.481315+0000","last_peered":"2024-04-24T13:34:47.481315+0000","last_clean":"2024-04-24T13:34:47.481315+0000","last_became_active":"2024-04-24T13:33:08.716282+0000","last_became_peered":"2024-04-24T13:33:08.716282+0000","last_unstale":"2024-04-24T13:34:47.481315+0000","last_undegraded":"2024-04-24T13:34:47.481315+0000","last_fullsized":"2024-04-24T13:34:47.481315+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:44:06.908211+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.591330+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:34:34.591330+0000","last_peered":"2024-04-24T13:34:34.591330+0000","last_clean":"2024-04-24T13:34:34.591330+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:34:34.591330+0000","last_undegraded":"2024-04-24T13:34:34.591330+0000","last_fullsized":"2024-04-24T13:34:34.591330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"150'56","reported_seq":324,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.058840+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:34:52.058840+0000","last_peered":"2024-04-24T13:34:52.058840+0000","last_clean":"2024-04-24T13:34:52.058840+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:34:52.058840+0000","last_undegraded":"2024-04-24T13:34:52.058840+0000","last_fullsized":"2024-04-24T13:34:52.058840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.603899+0000","last_change":"2024-04-24T13:30:23.237079+0000","last_active":"2024-04-24T13:34:51.603899+0000","last_peered":"2024-04-24T13:34:51.603899+0000","last_clean":"2024-04-24T13:34:51.603899+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:34:51.603899+0000","last_undegraded":"2024-04-24T13:34:51.603899+0000","last_fullsized":"2024-04-24T13:34:51.603899+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"150'44","reported_seq":186,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.490428+0000","last_change":"2024-04-24T13:33:51.593184+0000","last_active":"2024-04-24T13:34:47.490428+0000","last_peered":"2024-04-24T13:34:47.490428+0000","last_clean":"2024-04-24T13:34:47.490428+0000","last_became_active":"2024-04-24T13:33:49.289463+0000","last_became_peered":"2024-04-24T13:33:49.289463+0000","last_unstale":"2024-04-24T13:34:47.490428+0000","last_undegraded":"2024-04-24T13:34:47.490428+0000","last_fullsized":"2024-04-24T13:34:47.490428+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:42:20.618809+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"82'6","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.538248+0000","last_change":"2024-04-24T13:30:23.240904+0000","last_active":"2024-04-24T13:34:52.538248+0000","last_peered":"2024-04-24T13:34:52.538248+0000","last_clean":"2024-04-24T13:34:52.538248+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:34:52.538248+0000","last_undegraded":"2024-04-24T13:34:52.538248+0000","last_fullsized":"2024-04-24T13:34:52.538248+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"150'48","reported_seq":360,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:50.704305+0000","last_change":"2024-04-24T13:33:52.627571+0000","last_active":"2024-04-24T13:34:50.704305+0000","last_peered":"2024-04-24T13:34:50.704305+0000","last_clean":"2024-04-24T13:34:50.704305+0000","last_became_active":"2024-04-24T13:33:49.302184+0000","last_became_peered":"2024-04-24T13:33:49.302184+0000","last_unstale":"2024-04-24T13:34:50.704305+0000","last_undegraded":"2024-04-24T13:34:50.704305+0000","last_fullsized":"2024-04-24T13:34:50.704305+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":69206016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"82'2","reported_seq":61,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669580+0000","last_change":"2024-04-24T13:33:53.884916+0000","last_active":"2024-04-24T13:34:35.669580+0000","last_peered":"2024-04-24T13:34:35.669580+0000","last_clean":"2024-04-24T13:34:35.669580+0000","last_became_active":"2024-04-24T13:33:49.300182+0000","last_became_peered":"2024-04-24T13:33:49.300182+0000","last_unstale":"2024-04-24T13:34:35.669580+0000","last_undegraded":"2024-04-24T13:34:35.669580+0000","last_fullsized":"2024-04-24T13:34:35.669580+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:00:30.442779+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"150'60","reported_seq":323,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.585228+0000","last_change":"2024-04-24T13:30:21.235291+0000","last_active":"2024-04-24T13:34:47.585228+0000","last_peered":"2024-04-24T13:34:47.585228+0000","last_clean":"2024-04-24T13:34:47.585228+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:34:47.585228+0000","last_undegraded":"2024-04-24T13:34:47.585228+0000","last_fullsized":"2024-04-24T13:34:47.585228+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:23:17.339293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"82'4","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:50.703902+0000","last_change":"2024-04-24T13:30:23.224062+0000","last_active":"2024-04-24T13:34:50.703902+0000","last_peered":"2024-04-24T13:34:50.703902+0000","last_clean":"2024-04-24T13:34:50.703902+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:34:50.703902+0000","last_undegraded":"2024-04-24T13:34:50.703902+0000","last_fullsized":"2024-04-24T13:34:50.703902+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"150'34","reported_seq":106,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.584734+0000","last_change":"2024-04-24T13:33:54.184096+0000","last_active":"2024-04-24T13:34:47.584734+0000","last_peered":"2024-04-24T13:34:47.584734+0000","last_clean":"2024-04-24T13:34:47.584734+0000","last_became_active":"2024-04-24T13:33:49.299554+0000","last_became_peered":"2024-04-24T13:33:49.299554+0000","last_unstale":"2024-04-24T13:34:47.584734+0000","last_undegraded":"2024-04-24T13:34:47.584734+0000","last_fullsized":"2024-04-24T13:34:47.584734+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:16:18.682206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"82'2","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.058976+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:34:52.058976+0000","last_peered":"2024-04-24T13:34:52.058976+0000","last_clean":"2024-04-24T13:34:52.058976+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:34:52.058976+0000","last_undegraded":"2024-04-24T13:34:52.058976+0000","last_fullsized":"2024-04-24T13:34:52.058976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"150'36","reported_seq":300,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.587774+0000","last_change":"2024-04-24T13:30:21.216067+0000","last_active":"2024-04-24T13:34:47.587774+0000","last_peered":"2024-04-24T13:34:47.587774+0000","last_clean":"2024-04-24T13:34:47.587774+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:34:47.587774+0000","last_undegraded":"2024-04-24T13:34:47.587774+0000","last_fullsized":"2024-04-24T13:34:47.587774+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":57,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667336+0000","last_change":"2024-04-24T13:33:49.302008+0000","last_active":"2024-04-24T13:34:35.667336+0000","last_peered":"2024-04-24T13:34:35.667336+0000","last_clean":"2024-04-24T13:34:35.667336+0000","last_became_active":"2024-04-24T13:33:49.300135+0000","last_became_peered":"2024-04-24T13:33:49.300135+0000","last_unstale":"2024-04-24T13:34:35.667336+0000","last_undegraded":"2024-04-24T13:34:35.667336+0000","last_fullsized":"2024-04-24T13:34:35.667336+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:03:02.680781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"150'48","reported_seq":201,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.590732+0000","last_change":"2024-04-24T13:33:53.222020+0000","last_active":"2024-04-24T13:34:47.590732+0000","last_peered":"2024-04-24T13:34:47.590732+0000","last_clean":"2024-04-24T13:34:47.590732+0000","last_became_active":"2024-04-24T13:33:49.292734+0000","last_became_peered":"2024-04-24T13:33:49.292734+0000","last_unstale":"2024-04-24T13:34:47.590732+0000","last_undegraded":"2024-04-24T13:34:47.590732+0000","last_fullsized":"2024-04-24T13:34:47.590732+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:29:13.333265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"150'50","reported_seq":164,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.339966+0000","last_change":"2024-04-24T13:33:10.398117+0000","last_active":"2024-04-24T13:34:47.339966+0000","last_peered":"2024-04-24T13:34:47.339966+0000","last_clean":"2024-04-24T13:34:47.339966+0000","last_became_active":"2024-04-24T13:33:08.735696+0000","last_became_peered":"2024-04-24T13:33:08.735696+0000","last_unstale":"2024-04-24T13:34:47.339966+0000","last_undegraded":"2024-04-24T13:34:47.339966+0000","last_fullsized":"2024-04-24T13:34:47.339966+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:01:26.139144+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"82'2","reported_seq":269,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668081+0000","last_change":"2024-04-24T13:30:23.221933+0000","last_active":"2024-04-24T13:34:35.668081+0000","last_peered":"2024-04-24T13:34:35.668081+0000","last_clean":"2024-04-24T13:34:35.668081+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:34:35.668081+0000","last_undegraded":"2024-04-24T13:34:35.668081+0000","last_fullsized":"2024-04-24T13:34:35.668081+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"150'34","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.582387+0000","last_change":"2024-04-24T13:30:21.217264+0000","last_active":"2024-04-24T13:34:47.582387+0000","last_peered":"2024-04-24T13:34:47.582387+0000","last_clean":"2024-04-24T13:34:47.582387+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:34:47.582387+0000","last_undegraded":"2024-04-24T13:34:47.582387+0000","last_fullsized":"2024-04-24T13:34:47.582387+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"82'6","reported_seq":110,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595392+0000","last_change":"2024-04-24T13:33:09.917888+0000","last_active":"2024-04-24T13:34:34.595392+0000","last_peered":"2024-04-24T13:34:34.595392+0000","last_clean":"2024-04-24T13:34:34.595392+0000","last_became_active":"2024-04-24T13:33:08.732489+0000","last_became_peered":"2024-04-24T13:33:08.732489+0000","last_unstale":"2024-04-24T13:34:34.595392+0000","last_undegraded":"2024-04-24T13:34:34.595392+0000","last_fullsized":"2024-04-24T13:34:34.595392+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:35:16.213872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":342,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":194,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":122,"ondisk_log_size":122,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1115,"ondisk_log_size":1115,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":27618,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1055,"num_read_kb":1534,"num_write":541,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":143,"num_bytes_recovered":62549,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":880,"ondisk_log_size":880,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":349,"num_read_kb":349,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2233,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":6,"ondisk_log_size":6,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1458,"num_read_kb":1426,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":449,"num_bytes_recovered":1849688064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574909,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41888,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329952,"statfs":{"total":96636764160,"available":96593870848,"internally_reserved":0,"allocated":2449408,"data_stored":1687559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574909,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37124,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334716,"statfs":{"total":96636764160,"available":96598749184,"internally_reserved":0,"allocated":1830912,"data_stored":1096531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574910,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37176,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334664,"statfs":{"total":96636764160,"available":96598695936,"internally_reserved":0,"allocated":1884160,"data_stored":1098788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574910,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37112,"kb_used_data":1776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334728,"statfs":{"total":96636764160,"available":96598761472,"internally_reserved":0,"allocated":1818624,"data_stored":1096029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574909,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37144,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334696,"statfs":{"total":96636764160,"available":96598728704,"internally_reserved":0,"allocated":1851392,"data_stored":1097220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574910,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37124,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334716,"statfs":{"total":96636764160,"available":96598749184,"internally_reserved":0,"allocated":1826816,"data_stored":1096214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574911,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37332,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334508,"statfs":{"total":96636764160,"available":96598536192,"internally_reserved":0,"allocated":1859584,"data_stored":1098602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574910,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37708,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334132,"statfs":{"total":96636764160,"available":96598151168,"internally_reserved":0,"allocated":2428928,"data_stored":1686965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:34:54.260 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.260 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.260 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.261 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.261 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.261 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.261 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.262 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.262 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.262 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.262 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.262 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.262 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.262 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.262 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.263 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.263 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.263 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.263 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.263 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.263 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.263 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.263 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.263 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.264 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.264 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.264 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.264 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.264 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.264 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.264 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.264 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.264 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.264 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.265 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.265 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.265 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.265 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.265 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.265 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.265 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.265 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.265 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.266 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.266 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.266 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.266 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.266 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.266 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.266 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.266 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.266 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.267 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.267 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.267 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.267 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.267 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.267 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.267 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.267 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.267 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.267 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.268 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.268 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.268 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.268 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.268 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.268 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.268 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.268 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.268 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.269 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.269 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.269 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.269 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.269 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.269 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.269 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.269 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.269 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.270 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.270 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.270 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.270 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.270 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.270 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.270 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.270 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.270 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.271 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.271 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.271 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.271 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.271 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.271 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.271 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.271 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.272 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.272 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.272 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T13:30:07.758813+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.272 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-04-24T13:30:14.128704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.272 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.272 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.272 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.272 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.272 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.273 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.273 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T13:30:14.128704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.273 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.273 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.273 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.273 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.273 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.273 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.273 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-04-24T13:30:14.128704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.274 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.274 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.274 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.274 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.274 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.274 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.274 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-04-24T13:30:14.128704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.274 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.274 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.275 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.275 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.275 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.275 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.275 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.275 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-04-24T13:30:14.128704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.275 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.275 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.275 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.275 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.276 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.276 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.276 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T13:30:14.128704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.276 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.276 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.276 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.276 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.276 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.277 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-04-24T13:30:14.128704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.277 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.277 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.277 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.277 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.277 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.277 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.277 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T13:30:14.128704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.277 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.277 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.278 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.278 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.278 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.278 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.278 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.278 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.278 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.278 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.278 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.279 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.279 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.279 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.279 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.279 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.279 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.279 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.279 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.279 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.280 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.280 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.280 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.280 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.280 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.280 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.280 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.280 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.280 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.281 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.281 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.281 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.281 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.281 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.281 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.281 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.281 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.281 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.281 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.282 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.282 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.282 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.282 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.282 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.282 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.282 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.282 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.282 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.283 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.283 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.283 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.283 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.283 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.283 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.283 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.283 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.283 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.284 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.284 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.284 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.284 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.284 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.284 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.284 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.284 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.284 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.284 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.285 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.285 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.285 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.285 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.285 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.285 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.285 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.285 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.285 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.286 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.286 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.286 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.286 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.286 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.286 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.286 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.286 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.286 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.287 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.287 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.287 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.287 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.287 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.287 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.288 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.288 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.288 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.288 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.288 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.288 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.288 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.288 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.289 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.289 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.289 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.289 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.289 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.289 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.289 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.289 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.289 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.289 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.290 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.290 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:34:54.290 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T13:35:14.290 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:35:14.651 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:35:14.657 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:35:14.668 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":296,"stamp":"2024-04-24T13:35:13.343528+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620002,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4876,"num_read_kb":3775,"num_write":4425,"num_write_kb":6187918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":669,"num_bytes_recovered":1850933776,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5669,"ondisk_log_size":5669,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302424,"kb_used_data":15576,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754672296,"statfs":{"total":773094113280,"available":772784431104,"internally_reserved":0,"allocated":15949824,"data_stored":9957908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":293654065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":4,"apply_latency_ms":4,"commit_latency_ns":4000000,"apply_latency_ns":4000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005967"},"pg_stats":[{"pgid":"3.3f","version":"150'36","reported_seq":119,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.226168+0000","last_change":"2024-04-24T13:35:01.226314+0000","last_active":"2024-04-24T13:35:01.226168+0000","last_peered":"2024-04-24T13:35:01.226168+0000","last_clean":"2024-04-24T13:35:01.226168+0000","last_became_active":"2024-04-24T13:33:49.293106+0000","last_became_peered":"2024-04-24T13:33:49.293106+0000","last_unstale":"2024-04-24T13:35:01.226168+0000","last_undegraded":"2024-04-24T13:35:01.226168+0000","last_fullsized":"2024-04-24T13:35:01.226168+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'36","last_scrub_stamp":"2024-04-24T13:35:01.225933+0000","last_deep_scrub":"150'36","last_deep_scrub_stamp":"2024-04-24T13:35:01.225933+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.225933+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:56:45.227717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"82'14","reported_seq":310,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594979+0000","last_change":"2024-04-24T13:30:23.226232+0000","last_active":"2024-04-24T13:34:34.594979+0000","last_peered":"2024-04-24T13:34:34.594979+0000","last_clean":"2024-04-24T13:34:34.594979+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:34:34.594979+0000","last_undegraded":"2024-04-24T13:34:34.594979+0000","last_fullsized":"2024-04-24T13:34:34.594979+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"150'36","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.008461+0000","last_change":"2024-04-24T13:35:10.008487+0000","last_active":"2024-04-24T13:35:10.008461+0000","last_peered":"2024-04-24T13:35:10.008461+0000","last_clean":"2024-04-24T13:35:10.008461+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:35:10.008461+0000","last_undegraded":"2024-04-24T13:35:10.008461+0000","last_fullsized":"2024-04-24T13:35:10.008461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'36","last_scrub_stamp":"2024-04-24T13:35:10.008378+0000","last_deep_scrub":"150'36","last_deep_scrub_stamp":"2024-04-24T13:35:10.008378+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.008378+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:05:05.565013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"82'4","reported_seq":72,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.294798+0000","last_change":"2024-04-24T13:35:07.294860+0000","last_active":"2024-04-24T13:35:07.294798+0000","last_peered":"2024-04-24T13:35:07.294798+0000","last_clean":"2024-04-24T13:35:07.294798+0000","last_became_active":"2024-04-24T13:33:49.293840+0000","last_became_peered":"2024-04-24T13:33:49.293840+0000","last_unstale":"2024-04-24T13:35:07.294798+0000","last_undegraded":"2024-04-24T13:35:07.294798+0000","last_fullsized":"2024-04-24T13:35:07.294798+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:35:07.294597+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:35:07.294597+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.294597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:56.944623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"150'32","reported_seq":299,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.570146+0000","last_change":"2024-04-24T13:30:21.212045+0000","last_active":"2024-04-24T13:34:47.570146+0000","last_peered":"2024-04-24T13:34:47.570146+0000","last_clean":"2024-04-24T13:34:47.570146+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:34:47.570146+0000","last_undegraded":"2024-04-24T13:34:47.570146+0000","last_fullsized":"2024-04-24T13:34:47.570146+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":42,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":261,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.589359+0000","last_change":"2024-04-24T13:30:23.220659+0000","last_active":"2024-04-24T13:34:34.589359+0000","last_peered":"2024-04-24T13:34:34.589359+0000","last_clean":"2024-04-24T13:34:34.589359+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:34:34.589359+0000","last_undegraded":"2024-04-24T13:34:34.589359+0000","last_fullsized":"2024-04-24T13:34:34.589359+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"150'50","reported_seq":320,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.605270+0000","last_change":"2024-04-24T13:30:21.231584+0000","last_active":"2024-04-24T13:34:47.605270+0000","last_peered":"2024-04-24T13:34:47.605270+0000","last_clean":"2024-04-24T13:34:47.605270+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:34:47.605270+0000","last_undegraded":"2024-04-24T13:34:47.605270+0000","last_fullsized":"2024-04-24T13:34:47.605270+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"132'6","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.666062+0000","last_change":"2024-04-24T13:30:23.215582+0000","last_active":"2024-04-24T13:34:35.666062+0000","last_peered":"2024-04-24T13:34:35.666062+0000","last_clean":"2024-04-24T13:34:35.666062+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:34:35.666062+0000","last_undegraded":"2024-04-24T13:34:35.666062+0000","last_fullsized":"2024-04-24T13:34:35.666062+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"150'68","reported_seq":152,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.601169+0000","last_change":"2024-04-24T13:33:53.650464+0000","last_active":"2024-04-24T13:34:47.601169+0000","last_peered":"2024-04-24T13:34:47.601169+0000","last_clean":"2024-04-24T13:34:47.601169+0000","last_became_active":"2024-04-24T13:33:49.299781+0000","last_became_peered":"2024-04-24T13:33:49.299781+0000","last_unstale":"2024-04-24T13:34:47.601169+0000","last_undegraded":"2024-04-24T13:34:47.601169+0000","last_fullsized":"2024-04-24T13:34:47.601169+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"82'2","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.996180+0000","last_change":"2024-04-24T13:35:06.996241+0000","last_active":"2024-04-24T13:35:06.996180+0000","last_peered":"2024-04-24T13:35:06.996180+0000","last_clean":"2024-04-24T13:35:06.996180+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:35:06.996180+0000","last_undegraded":"2024-04-24T13:35:06.996180+0000","last_fullsized":"2024-04-24T13:35:06.996180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:06.995954+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:06.995954+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.995954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:01.656475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"150'60","reported_seq":329,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.575892+0000","last_change":"2024-04-24T13:30:21.220261+0000","last_active":"2024-04-24T13:34:47.575892+0000","last_peered":"2024-04-24T13:34:47.575892+0000","last_clean":"2024-04-24T13:34:47.575892+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:34:47.575892+0000","last_undegraded":"2024-04-24T13:34:47.575892+0000","last_fullsized":"2024-04-24T13:34:47.575892+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"82'4","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.563925+0000","last_change":"2024-04-24T13:35:09.563988+0000","last_active":"2024-04-24T13:35:09.563925+0000","last_peered":"2024-04-24T13:35:09.563925+0000","last_clean":"2024-04-24T13:35:09.563925+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:35:09.563925+0000","last_undegraded":"2024-04-24T13:35:09.563925+0000","last_fullsized":"2024-04-24T13:35:09.563925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:35:09.563714+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:35:09.563714+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.563714+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:44.889708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"150'58","reported_seq":147,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.219206+0000","last_change":"2024-04-24T13:34:58.219270+0000","last_active":"2024-04-24T13:34:58.219206+0000","last_peered":"2024-04-24T13:34:58.219206+0000","last_clean":"2024-04-24T13:34:58.219206+0000","last_became_active":"2024-04-24T13:33:49.287926+0000","last_became_peered":"2024-04-24T13:33:49.287926+0000","last_unstale":"2024-04-24T13:34:58.219206+0000","last_undegraded":"2024-04-24T13:34:58.219206+0000","last_fullsized":"2024-04-24T13:34:58.219206+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'58","last_scrub_stamp":"2024-04-24T13:34:58.218984+0000","last_deep_scrub":"150'58","last_deep_scrub_stamp":"2024-04-24T13:34:58.218984+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.218984+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:57:51.387743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"82'2","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.366630+0000","last_change":"2024-04-24T13:35:10.366691+0000","last_active":"2024-04-24T13:35:10.366630+0000","last_peered":"2024-04-24T13:35:10.366630+0000","last_clean":"2024-04-24T13:35:10.366630+0000","last_became_active":"2024-04-24T13:33:08.725324+0000","last_became_peered":"2024-04-24T13:33:08.725324+0000","last_unstale":"2024-04-24T13:35:10.366630+0000","last_undegraded":"2024-04-24T13:35:10.366630+0000","last_fullsized":"2024-04-24T13:35:10.366630+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:10.366411+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:10.366411+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.366411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:41:47.193558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"150'36","reported_seq":329,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.450223+0000","last_change":"2024-04-24T13:34:54.450367+0000","last_active":"2024-04-24T13:34:54.450223+0000","last_peered":"2024-04-24T13:34:54.450223+0000","last_clean":"2024-04-24T13:34:54.450223+0000","last_became_active":"2024-04-24T13:33:08.720200+0000","last_became_peered":"2024-04-24T13:33:08.720200+0000","last_unstale":"2024-04-24T13:34:54.450223+0000","last_undegraded":"2024-04-24T13:34:54.450223+0000","last_fullsized":"2024-04-24T13:34:54.450223+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'36","last_scrub_stamp":"2024-04-24T13:34:54.449991+0000","last_deep_scrub":"150'36","last_deep_scrub_stamp":"2024-04-24T13:34:54.449991+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.449991+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:40.899372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"82'6","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.925183+0000","last_change":"2024-04-24T13:35:00.925256+0000","last_active":"2024-04-24T13:35:00.925183+0000","last_peered":"2024-04-24T13:35:00.925183+0000","last_clean":"2024-04-24T13:35:00.925183+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:35:00.925183+0000","last_undegraded":"2024-04-24T13:35:00.925183+0000","last_fullsized":"2024-04-24T13:35:00.925183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-24T13:35:00.924973+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-24T13:35:00.924973+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.924973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:50.727839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"86'4","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.538330+0000","last_change":"2024-04-24T13:30:23.222803+0000","last_active":"2024-04-24T13:34:52.538330+0000","last_peered":"2024-04-24T13:34:52.538330+0000","last_clean":"2024-04-24T13:34:52.538330+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:34:52.538330+0000","last_undegraded":"2024-04-24T13:34:52.538330+0000","last_fullsized":"2024-04-24T13:34:52.538330+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"150'48","reported_seq":134,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.174566+0000","last_change":"2024-04-24T13:34:57.174625+0000","last_active":"2024-04-24T13:34:57.174566+0000","last_peered":"2024-04-24T13:34:57.174566+0000","last_clean":"2024-04-24T13:34:57.174566+0000","last_became_active":"2024-04-24T13:33:49.287950+0000","last_became_peered":"2024-04-24T13:33:49.287950+0000","last_unstale":"2024-04-24T13:34:57.174566+0000","last_undegraded":"2024-04-24T13:34:57.174566+0000","last_fullsized":"2024-04-24T13:34:57.174566+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'48","last_scrub_stamp":"2024-04-24T13:34:57.174382+0000","last_deep_scrub":"150'48","last_deep_scrub_stamp":"2024-04-24T13:34:57.174382+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.174382+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:16.992330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"82'4","reported_seq":72,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.176987+0000","last_change":"2024-04-24T13:34:55.177051+0000","last_active":"2024-04-24T13:34:55.176987+0000","last_peered":"2024-04-24T13:34:55.176987+0000","last_clean":"2024-04-24T13:34:55.176987+0000","last_became_active":"2024-04-24T13:33:49.294597+0000","last_became_peered":"2024-04-24T13:33:49.294597+0000","last_unstale":"2024-04-24T13:34:55.176987+0000","last_undegraded":"2024-04-24T13:34:55.176987+0000","last_fullsized":"2024-04-24T13:34:55.176987+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:34:55.176787+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:34:55.176787+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.176787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:35:03.816222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"150'54","reported_seq":347,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.432197+0000","last_change":"2024-04-24T13:33:08.998015+0000","last_active":"2024-04-24T13:34:53.432197+0000","last_peered":"2024-04-24T13:34:53.432197+0000","last_clean":"2024-04-24T13:34:53.432197+0000","last_became_active":"2024-04-24T13:33:08.726581+0000","last_became_peered":"2024-04-24T13:33:08.726581+0000","last_unstale":"2024-04-24T13:34:53.432197+0000","last_undegraded":"2024-04-24T13:34:53.432197+0000","last_fullsized":"2024-04-24T13:34:53.432197+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"86'6","reported_seq":119,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.331507+0000","last_change":"2024-04-24T13:35:04.331568+0000","last_active":"2024-04-24T13:35:04.331507+0000","last_peered":"2024-04-24T13:35:04.331507+0000","last_clean":"2024-04-24T13:35:04.331507+0000","last_became_active":"2024-04-24T13:33:08.719391+0000","last_became_peered":"2024-04-24T13:33:08.719391+0000","last_unstale":"2024-04-24T13:35:04.331507+0000","last_undegraded":"2024-04-24T13:35:04.331507+0000","last_fullsized":"2024-04-24T13:35:04.331507+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'6","last_scrub_stamp":"2024-04-24T13:35:04.331308+0000","last_deep_scrub":"86'6","last_deep_scrub_stamp":"2024-04-24T13:35:04.331308+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.331308+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:35:23.731759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"150'44","reported_seq":330,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.431950+0000","last_change":"2024-04-24T13:33:09.199641+0000","last_active":"2024-04-24T13:34:53.431950+0000","last_peered":"2024-04-24T13:34:53.431950+0000","last_clean":"2024-04-24T13:34:53.431950+0000","last_became_active":"2024-04-24T13:33:08.737789+0000","last_became_peered":"2024-04-24T13:33:08.737789+0000","last_unstale":"2024-04-24T13:34:53.431950+0000","last_undegraded":"2024-04-24T13:34:53.431950+0000","last_fullsized":"2024-04-24T13:34:53.431950+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":269,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.871846+0000","last_change":"2024-04-24T13:34:58.871846+0000","last_active":"2024-04-24T13:34:58.871846+0000","last_peered":"2024-04-24T13:34:58.871846+0000","last_clean":"2024-04-24T13:34:58.871846+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:34:58.871846+0000","last_undegraded":"2024-04-24T13:34:58.871846+0000","last_fullsized":"2024-04-24T13:34:58.871846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:58.871425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:58.871425+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.871425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:41:50.511735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"150'48","reported_seq":314,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.537866+0000","last_change":"2024-04-24T13:30:21.228342+0000","last_active":"2024-04-24T13:34:52.537866+0000","last_peered":"2024-04-24T13:34:52.537866+0000","last_clean":"2024-04-24T13:34:52.537866+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:34:52.537866+0000","last_undegraded":"2024-04-24T13:34:52.537866+0000","last_fullsized":"2024-04-24T13:34:52.537866+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"132'6","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.945654+0000","last_change":"2024-04-24T13:35:01.945654+0000","last_active":"2024-04-24T13:35:01.945654+0000","last_peered":"2024-04-24T13:35:01.945654+0000","last_clean":"2024-04-24T13:35:01.945654+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:35:01.945654+0000","last_undegraded":"2024-04-24T13:35:01.945654+0000","last_fullsized":"2024-04-24T13:35:01.945654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'6","last_scrub_stamp":"2024-04-24T13:35:01.945211+0000","last_deep_scrub":"132'6","last_deep_scrub_stamp":"2024-04-24T13:35:01.945211+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.945211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:16.094866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"150'46","reported_seq":314,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.058721+0000","last_change":"2024-04-24T13:30:21.225330+0000","last_active":"2024-04-24T13:34:52.058721+0000","last_peered":"2024-04-24T13:34:52.058721+0000","last_clean":"2024-04-24T13:34:52.058721+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:34:52.058721+0000","last_undegraded":"2024-04-24T13:34:52.058721+0000","last_fullsized":"2024-04-24T13:34:52.058721+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"82'2","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.482405+0000","last_change":"2024-04-24T13:35:05.482405+0000","last_active":"2024-04-24T13:35:05.482405+0000","last_peered":"2024-04-24T13:35:05.482405+0000","last_clean":"2024-04-24T13:35:05.482405+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:35:05.482405+0000","last_undegraded":"2024-04-24T13:35:05.482405+0000","last_fullsized":"2024-04-24T13:35:05.482405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:05.482094+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:05.482094+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.482094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:56:49.483878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"150'50","reported_seq":316,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:50.703902+0000","last_change":"2024-04-24T13:30:21.216483+0000","last_active":"2024-04-24T13:34:50.703902+0000","last_peered":"2024-04-24T13:34:50.703902+0000","last_clean":"2024-04-24T13:34:50.703902+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:34:50.703902+0000","last_undegraded":"2024-04-24T13:34:50.703902+0000","last_fullsized":"2024-04-24T13:34:50.703902+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":253,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.373578+0000","last_change":"2024-04-24T13:34:54.373644+0000","last_active":"2024-04-24T13:34:54.373578+0000","last_peered":"2024-04-24T13:34:54.373578+0000","last_clean":"2024-04-24T13:34:54.373578+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:34:54.373578+0000","last_undegraded":"2024-04-24T13:34:54.373578+0000","last_fullsized":"2024-04-24T13:34:54.373578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:54.373367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:54.373367+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.373367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:01.234065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"82'2","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.474127+0000","last_change":"2024-04-24T13:35:07.474185+0000","last_active":"2024-04-24T13:35:07.474127+0000","last_peered":"2024-04-24T13:35:07.474127+0000","last_clean":"2024-04-24T13:35:07.474127+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:35:07.474127+0000","last_undegraded":"2024-04-24T13:35:07.474127+0000","last_fullsized":"2024-04-24T13:35:07.474127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:07.473931+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:07.473931+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.473931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:17:10.253234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"150'52","reported_seq":139,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.280361+0000","last_change":"2024-04-24T13:35:06.280420+0000","last_active":"2024-04-24T13:35:06.280361+0000","last_peered":"2024-04-24T13:35:06.280361+0000","last_clean":"2024-04-24T13:35:06.280361+0000","last_became_active":"2024-04-24T13:33:49.282849+0000","last_became_peered":"2024-04-24T13:33:49.282849+0000","last_unstale":"2024-04-24T13:35:06.280361+0000","last_undegraded":"2024-04-24T13:35:06.280361+0000","last_fullsized":"2024-04-24T13:35:06.280361+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'52","last_scrub_stamp":"2024-04-24T13:35:06.280140+0000","last_deep_scrub":"150'52","last_deep_scrub_stamp":"2024-04-24T13:35:06.280140+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.280140+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:45:34.024975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"150'2","reported_seq":138,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.482658+0000","last_change":"2024-04-24T13:34:53.482789+0000","last_active":"2024-04-24T13:34:53.482658+0000","last_peered":"2024-04-24T13:34:53.482658+0000","last_clean":"2024-04-24T13:34:53.482658+0000","last_became_active":"2024-04-24T13:33:08.736087+0000","last_became_peered":"2024-04-24T13:33:08.736087+0000","last_unstale":"2024-04-24T13:34:53.482658+0000","last_undegraded":"2024-04-24T13:34:53.482658+0000","last_fullsized":"2024-04-24T13:34:53.482658+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2024-04-24T13:34:53.482424+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2024-04-24T13:34:53.482424+0000","last_clean_scrub_stamp":"2024-04-24T13:34:53.482424+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:29:02.989111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"150'20","reported_seq":314,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.630239+0000","last_change":"2024-04-24T13:33:51.608371+0000","last_active":"2024-04-24T13:34:47.630239+0000","last_peered":"2024-04-24T13:34:47.630239+0000","last_clean":"2024-04-24T13:34:47.630239+0000","last_became_active":"2024-04-24T13:33:49.295172+0000","last_became_peered":"2024-04-24T13:33:49.295172+0000","last_unstale":"2024-04-24T13:34:47.630239+0000","last_undegraded":"2024-04-24T13:34:47.630239+0000","last_fullsized":"2024-04-24T13:34:47.630239+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":58,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670421+0000","last_change":"2024-04-24T13:33:49.295489+0000","last_active":"2024-04-24T13:34:35.670421+0000","last_peered":"2024-04-24T13:34:35.670421+0000","last_clean":"2024-04-24T13:34:35.670421+0000","last_became_active":"2024-04-24T13:33:49.292611+0000","last_became_peered":"2024-04-24T13:33:49.292611+0000","last_unstale":"2024-04-24T13:34:35.670421+0000","last_undegraded":"2024-04-24T13:34:35.670421+0000","last_fullsized":"2024-04-24T13:34:35.670421+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"150'49","reported_seq":132,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.364455+0000","last_change":"2024-04-24T13:35:05.364524+0000","last_active":"2024-04-24T13:35:05.364455+0000","last_peered":"2024-04-24T13:35:05.364455+0000","last_clean":"2024-04-24T13:35:05.364455+0000","last_became_active":"2024-04-24T13:33:08.709158+0000","last_became_peered":"2024-04-24T13:33:08.709158+0000","last_unstale":"2024-04-24T13:35:05.364455+0000","last_undegraded":"2024-04-24T13:35:05.364455+0000","last_fullsized":"2024-04-24T13:35:05.364455+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'49","last_scrub_stamp":"2024-04-24T13:35:05.364256+0000","last_deep_scrub":"150'49","last_deep_scrub_stamp":"2024-04-24T13:35:05.364256+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.364256+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:17:55.215315+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"82'4","reported_seq":120,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595859+0000","last_change":"2024-04-24T13:33:53.234461+0000","last_active":"2024-04-24T13:34:34.595859+0000","last_peered":"2024-04-24T13:34:34.595859+0000","last_clean":"2024-04-24T13:34:34.595859+0000","last_became_active":"2024-04-24T13:33:49.302172+0000","last_became_peered":"2024-04-24T13:33:49.302172+0000","last_unstale":"2024-04-24T13:34:34.595859+0000","last_undegraded":"2024-04-24T13:34:34.595859+0000","last_fullsized":"2024-04-24T13:34:34.595859+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"150'38","reported_seq":344,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:50.703821+0000","last_change":"2024-04-24T13:33:49.666596+0000","last_active":"2024-04-24T13:34:50.703821+0000","last_peered":"2024-04-24T13:34:50.703821+0000","last_clean":"2024-04-24T13:34:50.703821+0000","last_became_active":"2024-04-24T13:33:49.283461+0000","last_became_peered":"2024-04-24T13:33:49.283461+0000","last_unstale":"2024-04-24T13:34:50.703821+0000","last_undegraded":"2024-04-24T13:34:50.703821+0000","last_fullsized":"2024-04-24T13:34:50.703821+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.059193+0000","last_change":"2024-04-24T13:33:49.301406+0000","last_active":"2024-04-24T13:34:52.059193+0000","last_peered":"2024-04-24T13:34:52.059193+0000","last_clean":"2024-04-24T13:34:52.059193+0000","last_became_active":"2024-04-24T13:33:49.300648+0000","last_became_peered":"2024-04-24T13:33:49.300648+0000","last_unstale":"2024-04-24T13:34:52.059193+0000","last_undegraded":"2024-04-24T13:34:52.059193+0000","last_fullsized":"2024-04-24T13:34:52.059193+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"150'9","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.555522+0000","last_change":"2024-04-24T13:35:08.555594+0000","last_active":"2024-04-24T13:35:08.555522+0000","last_peered":"2024-04-24T13:35:08.555522+0000","last_clean":"2024-04-24T13:35:08.555522+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:35:08.555522+0000","last_undegraded":"2024-04-24T13:35:08.555522+0000","last_fullsized":"2024-04-24T13:35:08.555522+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'9","last_scrub_stamp":"2024-04-24T13:35:08.555322+0000","last_deep_scrub":"150'9","last_deep_scrub_stamp":"2024-04-24T13:35:08.555322+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.555322+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:55.004703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":249,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.590644+0000","last_change":"2024-04-24T13:30:29.267529+0000","last_active":"2024-04-24T13:34:34.590644+0000","last_peered":"2024-04-24T13:34:34.590644+0000","last_clean":"2024-04-24T13:34:34.590644+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:34:34.590644+0000","last_undegraded":"2024-04-24T13:34:34.590644+0000","last_fullsized":"2024-04-24T13:34:34.590644+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":253,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:12.585372+0000","last_change":"2024-04-24T13:35:12.585437+0000","last_active":"2024-04-24T13:35:12.585372+0000","last_peered":"2024-04-24T13:35:12.585372+0000","last_clean":"2024-04-24T13:35:12.585372+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:35:12.585372+0000","last_undegraded":"2024-04-24T13:35:12.585372+0000","last_fullsized":"2024-04-24T13:35:12.585372+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:12.585161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:12.585161+0000","last_clean_scrub_stamp":"2024-04-24T13:35:12.585161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:49.785431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"86'10","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:50.704181+0000","last_change":"2024-04-24T13:30:23.219221+0000","last_active":"2024-04-24T13:34:50.704181+0000","last_peered":"2024-04-24T13:34:50.704181+0000","last_clean":"2024-04-24T13:34:50.704181+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:34:50.704181+0000","last_undegraded":"2024-04-24T13:34:50.704181+0000","last_fullsized":"2024-04-24T13:34:50.704181+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"150'48","reported_seq":135,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.237654+0000","last_change":"2024-04-24T13:35:04.237722+0000","last_active":"2024-04-24T13:35:04.237654+0000","last_peered":"2024-04-24T13:35:04.237654+0000","last_clean":"2024-04-24T13:35:04.237654+0000","last_became_active":"2024-04-24T13:33:49.286157+0000","last_became_peered":"2024-04-24T13:33:49.286157+0000","last_unstale":"2024-04-24T13:35:04.237654+0000","last_undegraded":"2024-04-24T13:35:04.237654+0000","last_fullsized":"2024-04-24T13:35:04.237654+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'48","last_scrub_stamp":"2024-04-24T13:35:04.237448+0000","last_deep_scrub":"150'48","last_deep_scrub_stamp":"2024-04-24T13:35:04.237448+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.237448+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:50.686829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.495042+0000","last_change":"2024-04-24T13:35:05.495104+0000","last_active":"2024-04-24T13:35:05.495042+0000","last_peered":"2024-04-24T13:35:05.495042+0000","last_clean":"2024-04-24T13:35:05.495042+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:35:05.495042+0000","last_undegraded":"2024-04-24T13:35:05.495042+0000","last_fullsized":"2024-04-24T13:35:05.495042+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:05.494837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:05.494837+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.494837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:41.461732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"150'15","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.920434+0000","last_change":"2024-04-24T13:34:52.920434+0000","last_active":"2024-04-24T13:34:52.920434+0000","last_peered":"2024-04-24T13:34:52.920434+0000","last_clean":"2024-04-24T13:34:52.920434+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:34:52.920434+0000","last_undegraded":"2024-04-24T13:34:52.920434+0000","last_fullsized":"2024-04-24T13:34:52.920434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'15","last_scrub_stamp":"2024-04-24T13:34:52.920291+0000","last_deep_scrub":"150'15","last_deep_scrub_stamp":"2024-04-24T13:34:52.920291+0000","last_clean_scrub_stamp":"2024-04-24T13:34:52.920291+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:42:41.154537+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"150'142","reported_seq":438,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.224437+0000","last_change":"2024-04-24T13:35:03.224501+0000","last_active":"2024-04-24T13:35:03.224437+0000","last_peered":"2024-04-24T13:35:03.224437+0000","last_clean":"2024-04-24T13:35:03.224437+0000","last_became_active":"2024-04-24T13:33:52.550123+0000","last_became_peered":"2024-04-24T13:33:52.550123+0000","last_unstale":"2024-04-24T13:35:03.224437+0000","last_undegraded":"2024-04-24T13:35:03.224437+0000","last_fullsized":"2024-04-24T13:35:03.224437+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'142","last_scrub_stamp":"2024-04-24T13:35:03.224232+0000","last_deep_scrub":"150'142","last_deep_scrub_stamp":"2024-04-24T13:35:03.224232+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.224232+0000","objects_scrubbed":1,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:04:58.780867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"105'8","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588694+0000","last_change":"2024-04-24T13:30:31.996214+0000","last_active":"2024-04-24T13:34:34.588694+0000","last_peered":"2024-04-24T13:34:34.588694+0000","last_clean":"2024-04-24T13:34:34.588694+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:34:34.588694+0000","last_undegraded":"2024-04-24T13:34:34.588694+0000","last_fullsized":"2024-04-24T13:34:34.588694+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"132'4","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.058963+0000","last_change":"2024-04-24T13:33:51.170660+0000","last_active":"2024-04-24T13:34:52.058963+0000","last_peered":"2024-04-24T13:34:52.058963+0000","last_clean":"2024-04-24T13:34:52.058963+0000","last_became_active":"2024-04-24T13:33:49.301591+0000","last_became_peered":"2024-04-24T13:33:49.301591+0000","last_unstale":"2024-04-24T13:34:52.058963+0000","last_undegraded":"2024-04-24T13:34:52.058963+0000","last_fullsized":"2024-04-24T13:34:52.058963+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"150'54","reported_seq":326,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.061881+0000","last_change":"2024-04-24T13:35:04.061947+0000","last_active":"2024-04-24T13:35:04.061881+0000","last_peered":"2024-04-24T13:35:04.061881+0000","last_clean":"2024-04-24T13:35:04.061881+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:35:04.061881+0000","last_undegraded":"2024-04-24T13:35:04.061881+0000","last_fullsized":"2024-04-24T13:35:04.061881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'54","last_scrub_stamp":"2024-04-24T13:35:04.061683+0000","last_deep_scrub":"150'54","last_deep_scrub_stamp":"2024-04-24T13:35:04.061683+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.061683+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:02:33.883567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":103,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595709+0000","last_change":"2024-04-24T13:33:08.718010+0000","last_active":"2024-04-24T13:34:34.595709+0000","last_peered":"2024-04-24T13:34:34.595709+0000","last_clean":"2024-04-24T13:34:34.595709+0000","last_became_active":"2024-04-24T13:33:08.716072+0000","last_became_peered":"2024-04-24T13:33:08.716072+0000","last_unstale":"2024-04-24T13:34:34.595709+0000","last_undegraded":"2024-04-24T13:34:34.595709+0000","last_fullsized":"2024-04-24T13:34:34.595709+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"150'23","reported_seq":87,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.334809+0000","last_change":"2024-04-24T13:35:11.334883+0000","last_active":"2024-04-24T13:35:11.334809+0000","last_peered":"2024-04-24T13:35:11.334809+0000","last_clean":"2024-04-24T13:35:11.334809+0000","last_became_active":"2024-04-24T13:33:49.294133+0000","last_became_peered":"2024-04-24T13:33:49.294133+0000","last_unstale":"2024-04-24T13:35:11.334809+0000","last_undegraded":"2024-04-24T13:35:11.334809+0000","last_fullsized":"2024-04-24T13:35:11.334809+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'23","last_scrub_stamp":"2024-04-24T13:35:11.334595+0000","last_deep_scrub":"150'23","last_deep_scrub_stamp":"2024-04-24T13:35:11.334595+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.334595+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:31:57.453297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"150'138","reported_seq":470,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.059321+0000","last_change":"2024-04-24T13:30:29.281379+0000","last_active":"2024-04-24T13:34:52.059321+0000","last_peered":"2024-04-24T13:34:52.059321+0000","last_clean":"2024-04-24T13:34:52.059321+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:34:52.059321+0000","last_undegraded":"2024-04-24T13:34:52.059321+0000","last_fullsized":"2024-04-24T13:34:52.059321+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"82'2","reported_seq":124,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.311979+0000","last_change":"2024-04-24T13:35:03.312045+0000","last_active":"2024-04-24T13:35:03.311979+0000","last_peered":"2024-04-24T13:35:03.311979+0000","last_clean":"2024-04-24T13:35:03.311979+0000","last_became_active":"2024-04-24T13:33:49.278105+0000","last_became_peered":"2024-04-24T13:33:49.278105+0000","last_unstale":"2024-04-24T13:35:03.311979+0000","last_undegraded":"2024-04-24T13:35:03.311979+0000","last_fullsized":"2024-04-24T13:35:03.311979+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:03.311781+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:03.311781+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.311781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:02:38.151508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"150'50","reported_seq":131,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.191586+0000","last_change":"2024-04-24T13:34:54.191722+0000","last_active":"2024-04-24T13:34:54.191586+0000","last_peered":"2024-04-24T13:34:54.191586+0000","last_clean":"2024-04-24T13:34:54.191586+0000","last_became_active":"2024-04-24T13:33:49.297787+0000","last_became_peered":"2024-04-24T13:33:49.297787+0000","last_unstale":"2024-04-24T13:34:54.191586+0000","last_undegraded":"2024-04-24T13:34:54.191586+0000","last_fullsized":"2024-04-24T13:34:54.191586+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'50","last_scrub_stamp":"2024-04-24T13:34:54.191263+0000","last_deep_scrub":"150'50","last_deep_scrub_stamp":"2024-04-24T13:34:54.191263+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.191263+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:21:16.096435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:12.301062+0000","last_change":"2024-04-24T13:35:12.301121+0000","last_active":"2024-04-24T13:35:12.301062+0000","last_peered":"2024-04-24T13:35:12.301062+0000","last_clean":"2024-04-24T13:35:12.301062+0000","last_became_active":"2024-04-24T13:33:49.294593+0000","last_became_peered":"2024-04-24T13:33:49.294593+0000","last_unstale":"2024-04-24T13:35:12.301062+0000","last_undegraded":"2024-04-24T13:35:12.301062+0000","last_fullsized":"2024-04-24T13:35:12.301062+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:12.300862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:12.300862+0000","last_clean_scrub_stamp":"2024-04-24T13:35:12.300862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:29:21.807549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"150'39","reported_seq":150,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.453594+0000","last_change":"2024-04-24T13:34:56.453689+0000","last_active":"2024-04-24T13:34:56.453594+0000","last_peered":"2024-04-24T13:34:56.453594+0000","last_clean":"2024-04-24T13:34:56.453594+0000","last_became_active":"2024-04-24T13:33:08.733302+0000","last_became_peered":"2024-04-24T13:33:08.733302+0000","last_unstale":"2024-04-24T13:34:56.453594+0000","last_undegraded":"2024-04-24T13:34:56.453594+0000","last_fullsized":"2024-04-24T13:34:56.453594+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'39","last_scrub_stamp":"2024-04-24T13:34:56.453395+0000","last_deep_scrub":"150'39","last_deep_scrub_stamp":"2024-04-24T13:34:56.453395+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.453395+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:36.580110+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":37,"num_read_kb":26,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.159220+0000","last_change":"2024-04-24T13:33:08.727357+0000","last_active":"2024-04-24T13:34:51.159220+0000","last_peered":"2024-04-24T13:34:51.159220+0000","last_clean":"2024-04-24T13:34:51.159220+0000","last_became_active":"2024-04-24T13:33:08.726787+0000","last_became_peered":"2024-04-24T13:33:08.726787+0000","last_unstale":"2024-04-24T13:34:51.159220+0000","last_undegraded":"2024-04-24T13:34:51.159220+0000","last_fullsized":"2024-04-24T13:34:51.159220+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"86'7","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.614272+0000","last_change":"2024-04-24T13:30:31.268705+0000","last_active":"2024-04-24T13:34:42.614272+0000","last_peered":"2024-04-24T13:34:42.614272+0000","last_clean":"2024-04-24T13:34:42.614272+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:34:42.614272+0000","last_undegraded":"2024-04-24T13:34:42.614272+0000","last_fullsized":"2024-04-24T13:34:42.614272+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"132'4","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.625488+0000","last_change":"2024-04-24T13:30:23.218998+0000","last_active":"2024-04-24T13:34:42.625488+0000","last_peered":"2024-04-24T13:34:42.625488+0000","last_clean":"2024-04-24T13:34:42.625488+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:34:42.625488+0000","last_undegraded":"2024-04-24T13:34:42.625488+0000","last_fullsized":"2024-04-24T13:34:42.625488+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"150'34","reported_seq":112,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.179354+0000","last_change":"2024-04-24T13:35:02.179420+0000","last_active":"2024-04-24T13:35:02.179354+0000","last_peered":"2024-04-24T13:35:02.179354+0000","last_clean":"2024-04-24T13:35:02.179354+0000","last_became_active":"2024-04-24T13:33:49.284576+0000","last_became_peered":"2024-04-24T13:33:49.284576+0000","last_unstale":"2024-04-24T13:35:02.179354+0000","last_undegraded":"2024-04-24T13:35:02.179354+0000","last_fullsized":"2024-04-24T13:35:02.179354+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'34","last_scrub_stamp":"2024-04-24T13:35:02.179133+0000","last_deep_scrub":"150'34","last_deep_scrub_stamp":"2024-04-24T13:35:02.179133+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.179133+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:07:09.767658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":265,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.865276+0000","last_change":"2024-04-24T13:34:55.865333+0000","last_active":"2024-04-24T13:34:55.865276+0000","last_peered":"2024-04-24T13:34:55.865276+0000","last_clean":"2024-04-24T13:34:55.865276+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:34:55.865276+0000","last_undegraded":"2024-04-24T13:34:55.865276+0000","last_fullsized":"2024-04-24T13:34:55.865276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:55.865060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:55.865060+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.865060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:49.890422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"150'21","reported_seq":318,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.059122+0000","last_change":"2024-04-24T13:33:52.751477+0000","last_active":"2024-04-24T13:34:52.059122+0000","last_peered":"2024-04-24T13:34:52.059122+0000","last_clean":"2024-04-24T13:34:52.059122+0000","last_became_active":"2024-04-24T13:33:49.308018+0000","last_became_peered":"2024-04-24T13:33:49.308018+0000","last_unstale":"2024-04-24T13:34:52.059122+0000","last_undegraded":"2024-04-24T13:34:52.059122+0000","last_fullsized":"2024-04-24T13:34:52.059122+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.059176+0000","last_change":"2024-04-24T13:30:29.275957+0000","last_active":"2024-04-24T13:34:52.059176+0000","last_peered":"2024-04-24T13:34:52.059176+0000","last_clean":"2024-04-24T13:34:52.059176+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:34:52.059176+0000","last_undegraded":"2024-04-24T13:34:52.059176+0000","last_fullsized":"2024-04-24T13:34:52.059176+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.042192+0000","last_change":"2024-04-24T13:34:58.042253+0000","last_active":"2024-04-24T13:34:58.042192+0000","last_peered":"2024-04-24T13:34:58.042192+0000","last_clean":"2024-04-24T13:34:58.042192+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:34:58.042192+0000","last_undegraded":"2024-04-24T13:34:58.042192+0000","last_fullsized":"2024-04-24T13:34:58.042192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:58.042001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:58.042001+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.042001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:14:48.178406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"82'4","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.053295+0000","last_change":"2024-04-24T13:35:02.053359+0000","last_active":"2024-04-24T13:35:02.053295+0000","last_peered":"2024-04-24T13:35:02.053295+0000","last_clean":"2024-04-24T13:35:02.053295+0000","last_became_active":"2024-04-24T13:32:01.548259+0000","last_became_peered":"2024-04-24T13:32:01.548259+0000","last_unstale":"2024-04-24T13:35:02.053295+0000","last_undegraded":"2024-04-24T13:35:02.053295+0000","last_fullsized":"2024-04-24T13:35:02.053295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:35:02.053096+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:35:02.053096+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.053096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:16.202751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"150'50","reported_seq":135,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.261907+0000","last_change":"2024-04-24T13:35:05.261976+0000","last_active":"2024-04-24T13:35:05.261907+0000","last_peered":"2024-04-24T13:35:05.261907+0000","last_clean":"2024-04-24T13:35:05.261907+0000","last_became_active":"2024-04-24T13:33:49.293373+0000","last_became_peered":"2024-04-24T13:33:49.293373+0000","last_unstale":"2024-04-24T13:35:05.261907+0000","last_undegraded":"2024-04-24T13:35:05.261907+0000","last_fullsized":"2024-04-24T13:35:05.261907+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'50","last_scrub_stamp":"2024-04-24T13:35:05.261684+0000","last_deep_scrub":"150'50","last_deep_scrub_stamp":"2024-04-24T13:35:05.261684+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.261684+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:40.587678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":265,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.872381+0000","last_change":"2024-04-24T13:34:53.872381+0000","last_active":"2024-04-24T13:34:53.872381+0000","last_peered":"2024-04-24T13:34:53.872381+0000","last_clean":"2024-04-24T13:34:53.872381+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:34:53.872381+0000","last_undegraded":"2024-04-24T13:34:53.872381+0000","last_fullsized":"2024-04-24T13:34:53.872381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:53.872137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:53.872137+0000","last_clean_scrub_stamp":"2024-04-24T13:34:53.872137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:05:02.126405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"150'26","reported_seq":82,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.505945+0000","last_change":"2024-04-24T13:33:53.666421+0000","last_active":"2024-04-24T13:34:46.505945+0000","last_peered":"2024-04-24T13:34:46.505945+0000","last_clean":"2024-04-24T13:34:46.505945+0000","last_became_active":"2024-04-24T13:33:49.302140+0000","last_became_peered":"2024-04-24T13:33:49.302140+0000","last_unstale":"2024-04-24T13:34:46.505945+0000","last_undegraded":"2024-04-24T13:34:46.505945+0000","last_fullsized":"2024-04-24T13:34:46.505945+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"150'138","reported_seq":527,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.525227+0000","last_change":"2024-04-24T13:35:08.525370+0000","last_active":"2024-04-24T13:35:08.525227+0000","last_peered":"2024-04-24T13:35:08.525227+0000","last_clean":"2024-04-24T13:35:08.525227+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:35:08.525227+0000","last_undegraded":"2024-04-24T13:35:08.525227+0000","last_fullsized":"2024-04-24T13:35:08.525227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'138","last_scrub_stamp":"2024-04-24T13:35:08.524900+0000","last_deep_scrub":"150'138","last_deep_scrub_stamp":"2024-04-24T13:35:08.524900+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.524900+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:43:30.040867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"82'3","reported_seq":250,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:50.704737+0000","last_change":"2024-04-24T13:30:31.271032+0000","last_active":"2024-04-24T13:34:50.704737+0000","last_peered":"2024-04-24T13:34:50.704737+0000","last_clean":"2024-04-24T13:34:50.704737+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:34:50.704737+0000","last_undegraded":"2024-04-24T13:34:50.704737+0000","last_fullsized":"2024-04-24T13:34:50.704737+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"132'10","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.541420+0000","last_change":"2024-04-24T13:35:05.541542+0000","last_active":"2024-04-24T13:35:05.541420+0000","last_peered":"2024-04-24T13:35:05.541420+0000","last_clean":"2024-04-24T13:35:05.541420+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:35:05.541420+0000","last_undegraded":"2024-04-24T13:35:05.541420+0000","last_fullsized":"2024-04-24T13:35:05.541420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'10","last_scrub_stamp":"2024-04-24T13:35:05.541126+0000","last_deep_scrub":"132'10","last_deep_scrub_stamp":"2024-04-24T13:35:05.541126+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.541126+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:10:26.314414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"150'46","reported_seq":167,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.458615+0000","last_change":"2024-04-24T13:34:55.458681+0000","last_active":"2024-04-24T13:34:55.458615+0000","last_peered":"2024-04-24T13:34:55.458615+0000","last_clean":"2024-04-24T13:34:55.458615+0000","last_became_active":"2024-04-24T13:33:08.718332+0000","last_became_peered":"2024-04-24T13:33:08.718332+0000","last_unstale":"2024-04-24T13:34:55.458615+0000","last_undegraded":"2024-04-24T13:34:55.458615+0000","last_fullsized":"2024-04-24T13:34:55.458615+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'46","last_scrub_stamp":"2024-04-24T13:34:55.458413+0000","last_deep_scrub":"150'46","last_deep_scrub_stamp":"2024-04-24T13:34:55.458413+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.458413+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:58:21.930554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":265,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.970774+0000","last_change":"2024-04-24T13:35:03.970894+0000","last_active":"2024-04-24T13:35:03.970774+0000","last_peered":"2024-04-24T13:35:03.970774+0000","last_clean":"2024-04-24T13:35:03.970774+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:35:03.970774+0000","last_undegraded":"2024-04-24T13:35:03.970774+0000","last_fullsized":"2024-04-24T13:35:03.970774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:03.970457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:03.970457+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.970457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:02:33.792341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"150'34","reported_seq":341,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.616085+0000","last_change":"2024-04-24T13:33:51.156026+0000","last_active":"2024-04-24T13:34:47.616085+0000","last_peered":"2024-04-24T13:34:47.616085+0000","last_clean":"2024-04-24T13:34:47.616085+0000","last_became_active":"2024-04-24T13:33:49.292150+0000","last_became_peered":"2024-04-24T13:33:49.292150+0000","last_unstale":"2024-04-24T13:34:47.616085+0000","last_undegraded":"2024-04-24T13:34:47.616085+0000","last_fullsized":"2024-04-24T13:34:47.616085+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.036896+0000","last_change":"2024-04-24T13:35:09.036952+0000","last_active":"2024-04-24T13:35:09.036896+0000","last_peered":"2024-04-24T13:35:09.036896+0000","last_clean":"2024-04-24T13:35:09.036896+0000","last_became_active":"2024-04-24T13:33:49.305572+0000","last_became_peered":"2024-04-24T13:33:49.305572+0000","last_unstale":"2024-04-24T13:35:09.036896+0000","last_undegraded":"2024-04-24T13:35:09.036896+0000","last_fullsized":"2024-04-24T13:35:09.036896+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:09.036734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:09.036734+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.036734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:13:25.204430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"150'12","reported_seq":297,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.825991+0000","last_change":"2024-04-24T13:35:01.826057+0000","last_active":"2024-04-24T13:35:01.825991+0000","last_peered":"2024-04-24T13:35:01.825991+0000","last_clean":"2024-04-24T13:35:01.825991+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:35:01.825991+0000","last_undegraded":"2024-04-24T13:35:01.825991+0000","last_fullsized":"2024-04-24T13:35:01.825991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'12","last_scrub_stamp":"2024-04-24T13:35:01.825796+0000","last_deep_scrub":"150'12","last_deep_scrub_stamp":"2024-04-24T13:35:01.825796+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.825796+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:11:04.528658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"132'8","reported_seq":290,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.530146+0000","last_change":"2024-04-24T13:35:07.530337+0000","last_active":"2024-04-24T13:35:07.530146+0000","last_peered":"2024-04-24T13:35:07.530146+0000","last_clean":"2024-04-24T13:35:07.530146+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:35:07.530146+0000","last_undegraded":"2024-04-24T13:35:07.530146+0000","last_fullsized":"2024-04-24T13:35:07.530146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'8","last_scrub_stamp":"2024-04-24T13:35:07.529907+0000","last_deep_scrub":"132'8","last_deep_scrub_stamp":"2024-04-24T13:35:07.529907+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.529907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:05:03.086542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"150'58","reported_seq":326,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.058617+0000","last_change":"2024-04-24T13:30:21.228105+0000","last_active":"2024-04-24T13:34:52.058617+0000","last_peered":"2024-04-24T13:34:52.058617+0000","last_clean":"2024-04-24T13:34:52.058617+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:34:52.058617+0000","last_undegraded":"2024-04-24T13:34:52.058617+0000","last_fullsized":"2024-04-24T13:34:52.058617+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.989794+0000","last_change":"2024-04-24T13:35:07.989847+0000","last_active":"2024-04-24T13:35:07.989794+0000","last_peered":"2024-04-24T13:35:07.989794+0000","last_clean":"2024-04-24T13:35:07.989794+0000","last_became_active":"2024-04-24T13:33:49.300030+0000","last_became_peered":"2024-04-24T13:33:49.300030+0000","last_unstale":"2024-04-24T13:35:07.989794+0000","last_undegraded":"2024-04-24T13:35:07.989794+0000","last_fullsized":"2024-04-24T13:35:07.989794+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:07.989597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:07.989597+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.989597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:55:05.869969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"150'26","reported_seq":300,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.595999+0000","last_change":"2024-04-24T13:35:10.596075+0000","last_active":"2024-04-24T13:35:10.595999+0000","last_peered":"2024-04-24T13:35:10.595999+0000","last_clean":"2024-04-24T13:35:10.595999+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:35:10.595999+0000","last_undegraded":"2024-04-24T13:35:10.595999+0000","last_fullsized":"2024-04-24T13:35:10.595999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'26","last_scrub_stamp":"2024-04-24T13:35:10.595769+0000","last_deep_scrub":"150'26","last_deep_scrub_stamp":"2024-04-24T13:35:10.595769+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.595769+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:45:38.340604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.581368+0000","last_change":"2024-04-24T13:35:06.581435+0000","last_active":"2024-04-24T13:35:06.581368+0000","last_peered":"2024-04-24T13:35:06.581368+0000","last_clean":"2024-04-24T13:35:06.581368+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:35:06.581368+0000","last_undegraded":"2024-04-24T13:35:06.581368+0000","last_fullsized":"2024-04-24T13:35:06.581368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:06.581152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:06.581152+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.581152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:26:18.081319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.529344+0000","last_change":"2024-04-24T13:34:52.529402+0000","last_active":"2024-04-24T13:34:52.529344+0000","last_peered":"2024-04-24T13:34:52.529344+0000","last_clean":"2024-04-24T13:34:52.529344+0000","last_became_active":"2024-04-24T13:33:08.720133+0000","last_became_peered":"2024-04-24T13:33:08.720133+0000","last_unstale":"2024-04-24T13:34:52.529344+0000","last_undegraded":"2024-04-24T13:34:52.529344+0000","last_fullsized":"2024-04-24T13:34:52.529344+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:52.529140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:52.529140+0000","last_clean_scrub_stamp":"2024-04-24T13:34:52.529140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:07:00.117664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.538115+0000","last_change":"2024-04-24T13:30:23.223789+0000","last_active":"2024-04-24T13:34:52.538115+0000","last_peered":"2024-04-24T13:34:52.538115+0000","last_clean":"2024-04-24T13:34:52.538115+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:34:52.538115+0000","last_undegraded":"2024-04-24T13:34:52.538115+0000","last_fullsized":"2024-04-24T13:34:52.538115+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"150'66","reported_seq":343,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.053745+0000","last_change":"2024-04-24T13:35:00.053810+0000","last_active":"2024-04-24T13:35:00.053745+0000","last_peered":"2024-04-24T13:35:00.053745+0000","last_clean":"2024-04-24T13:35:00.053745+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:35:00.053745+0000","last_undegraded":"2024-04-24T13:35:00.053745+0000","last_fullsized":"2024-04-24T13:35:00.053745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'66","last_scrub_stamp":"2024-04-24T13:35:00.053542+0000","last_deep_scrub":"150'66","last_deep_scrub_stamp":"2024-04-24T13:35:00.053542+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.053542+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:53:01.309050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.724260+0000","last_change":"2024-04-24T13:34:52.724260+0000","last_active":"2024-04-24T13:34:52.724260+0000","last_peered":"2024-04-24T13:34:52.724260+0000","last_clean":"2024-04-24T13:34:52.724260+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:34:52.724260+0000","last_undegraded":"2024-04-24T13:34:52.724260+0000","last_fullsized":"2024-04-24T13:34:52.724260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:52.724169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:52.724169+0000","last_clean_scrub_stamp":"2024-04-24T13:34:52.724169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:46.749531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"150'35","reported_seq":310,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.956366+0000","last_change":"2024-04-24T13:34:51.956366+0000","last_active":"2024-04-24T13:34:51.956366+0000","last_peered":"2024-04-24T13:34:51.956366+0000","last_clean":"2024-04-24T13:34:51.956366+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:34:51.956366+0000","last_undegraded":"2024-04-24T13:34:51.956366+0000","last_fullsized":"2024-04-24T13:34:51.956366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'35","last_scrub_stamp":"2024-04-24T13:34:51.955957+0000","last_deep_scrub":"150'35","last_deep_scrub_stamp":"2024-04-24T13:34:51.955957+0000","last_clean_scrub_stamp":"2024-04-24T13:34:51.955957+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:48:38.690221+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"150'142","reported_seq":483,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.007620+0000","last_change":"2024-04-24T13:35:07.007712+0000","last_active":"2024-04-24T13:35:07.007620+0000","last_peered":"2024-04-24T13:35:07.007620+0000","last_clean":"2024-04-24T13:35:07.007620+0000","last_became_active":"2024-04-24T13:33:11.709412+0000","last_became_peered":"2024-04-24T13:33:11.709412+0000","last_unstale":"2024-04-24T13:35:07.007620+0000","last_undegraded":"2024-04-24T13:35:07.007620+0000","last_fullsized":"2024-04-24T13:35:07.007620+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'142","last_scrub_stamp":"2024-04-24T13:35:07.007403+0000","last_deep_scrub":"150'142","last_deep_scrub_stamp":"2024-04-24T13:35:07.007403+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.007403+0000","objects_scrubbed":1,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:01.667924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.875369+0000","last_change":"2024-04-24T13:35:03.875427+0000","last_active":"2024-04-24T13:35:03.875369+0000","last_peered":"2024-04-24T13:35:03.875369+0000","last_clean":"2024-04-24T13:35:03.875369+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:35:03.875369+0000","last_undegraded":"2024-04-24T13:35:03.875369+0000","last_fullsized":"2024-04-24T13:35:03.875369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:03.875179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:03.875179+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.875179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:58.535700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"114'2","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.396583+0000","last_change":"2024-04-24T13:34:57.396728+0000","last_active":"2024-04-24T13:34:57.396583+0000","last_peered":"2024-04-24T13:34:57.396583+0000","last_clean":"2024-04-24T13:34:57.396583+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:34:57.396583+0000","last_undegraded":"2024-04-24T13:34:57.396583+0000","last_fullsized":"2024-04-24T13:34:57.396583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'2","last_scrub_stamp":"2024-04-24T13:34:57.396321+0000","last_deep_scrub":"114'2","last_deep_scrub_stamp":"2024-04-24T13:34:57.396321+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.396321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:34:21.101552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"150'52","reported_seq":326,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:12.531446+0000","last_change":"2024-04-24T13:35:12.531510+0000","last_active":"2024-04-24T13:35:12.531446+0000","last_peered":"2024-04-24T13:35:12.531446+0000","last_clean":"2024-04-24T13:35:12.531446+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:35:12.531446+0000","last_undegraded":"2024-04-24T13:35:12.531446+0000","last_fullsized":"2024-04-24T13:35:12.531446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'52","last_scrub_stamp":"2024-04-24T13:35:12.531241+0000","last_deep_scrub":"150'52","last_deep_scrub_stamp":"2024-04-24T13:35:12.531241+0000","last_clean_scrub_stamp":"2024-04-24T13:35:12.531241+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:07:34.086589+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"150'4","reported_seq":163,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:12.362308+0000","last_change":"2024-04-24T13:35:12.362381+0000","last_active":"2024-04-24T13:35:12.362308+0000","last_peered":"2024-04-24T13:35:12.362308+0000","last_clean":"2024-04-24T13:35:12.362308+0000","last_became_active":"2024-04-24T13:33:08.724858+0000","last_became_peered":"2024-04-24T13:33:08.724858+0000","last_unstale":"2024-04-24T13:35:12.362308+0000","last_undegraded":"2024-04-24T13:35:12.362308+0000","last_fullsized":"2024-04-24T13:35:12.362308+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'4","last_scrub_stamp":"2024-04-24T13:35:12.362097+0000","last_deep_scrub":"150'4","last_deep_scrub_stamp":"2024-04-24T13:35:12.362097+0000","last_clean_scrub_stamp":"2024-04-24T13:35:12.362097+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:26:37.380109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":180,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"150'16","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.509175+0000","last_change":"2024-04-24T13:35:04.509328+0000","last_active":"2024-04-24T13:35:04.509175+0000","last_peered":"2024-04-24T13:35:04.509175+0000","last_clean":"2024-04-24T13:35:04.509175+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:35:04.509175+0000","last_undegraded":"2024-04-24T13:35:04.509175+0000","last_fullsized":"2024-04-24T13:35:04.509175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'16","last_scrub_stamp":"2024-04-24T13:35:04.508930+0000","last_deep_scrub":"150'16","last_deep_scrub_stamp":"2024-04-24T13:35:04.508930+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.508930+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:44.635645+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"150'138","reported_seq":492,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.075907+0000","last_change":"2024-04-24T13:34:56.075907+0000","last_active":"2024-04-24T13:34:56.075907+0000","last_peered":"2024-04-24T13:34:56.075907+0000","last_clean":"2024-04-24T13:34:56.075907+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:34:56.075907+0000","last_undegraded":"2024-04-24T13:34:56.075907+0000","last_fullsized":"2024-04-24T13:34:56.075907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'138","last_scrub_stamp":"2024-04-24T13:34:56.075651+0000","last_deep_scrub":"150'138","last_deep_scrub_stamp":"2024-04-24T13:34:56.075651+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.075651+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:50.101013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"132'4","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.625586+0000","last_change":"2024-04-24T13:30:31.282052+0000","last_active":"2024-04-24T13:34:42.625586+0000","last_peered":"2024-04-24T13:34:42.625586+0000","last_clean":"2024-04-24T13:34:42.625586+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:34:42.625586+0000","last_undegraded":"2024-04-24T13:34:42.625586+0000","last_fullsized":"2024-04-24T13:34:42.625586+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"86'4","reported_seq":290,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.822023+0000","last_change":"2024-04-24T13:35:00.822081+0000","last_active":"2024-04-24T13:35:00.822023+0000","last_peered":"2024-04-24T13:35:00.822023+0000","last_clean":"2024-04-24T13:35:00.822023+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:35:00.822023+0000","last_undegraded":"2024-04-24T13:35:00.822023+0000","last_fullsized":"2024-04-24T13:35:00.822023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'4","last_scrub_stamp":"2024-04-24T13:35:00.821825+0000","last_deep_scrub":"86'4","last_deep_scrub_stamp":"2024-04-24T13:35:00.821825+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.821825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:02:30.643710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"150'70","reported_seq":338,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.561937+0000","last_change":"2024-04-24T13:30:21.219317+0000","last_active":"2024-04-24T13:34:47.561937+0000","last_peered":"2024-04-24T13:34:47.561937+0000","last_clean":"2024-04-24T13:34:47.561937+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:34:47.561937+0000","last_undegraded":"2024-04-24T13:34:47.561937+0000","last_fullsized":"2024-04-24T13:34:47.561937+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.538452+0000","last_change":"2024-04-24T13:33:08.716879+0000","last_active":"2024-04-24T13:34:52.538452+0000","last_peered":"2024-04-24T13:34:52.538452+0000","last_clean":"2024-04-24T13:34:52.538452+0000","last_became_active":"2024-04-24T13:33:08.716585+0000","last_became_peered":"2024-04-24T13:33:08.716585+0000","last_unstale":"2024-04-24T13:34:52.538452+0000","last_undegraded":"2024-04-24T13:34:52.538452+0000","last_fullsized":"2024-04-24T13:34:52.538452+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"150'35","reported_seq":146,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.473043+0000","last_change":"2024-04-24T13:34:54.473126+0000","last_active":"2024-04-24T13:34:54.473043+0000","last_peered":"2024-04-24T13:34:54.473043+0000","last_clean":"2024-04-24T13:34:54.473043+0000","last_became_active":"2024-04-24T13:33:08.736280+0000","last_became_peered":"2024-04-24T13:33:08.736280+0000","last_unstale":"2024-04-24T13:34:54.473043+0000","last_undegraded":"2024-04-24T13:34:54.473043+0000","last_fullsized":"2024-04-24T13:34:54.473043+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'35","last_scrub_stamp":"2024-04-24T13:34:54.472852+0000","last_deep_scrub":"150'35","last_deep_scrub_stamp":"2024-04-24T13:34:54.472852+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.472852+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:41:06.902987+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.089719+0000","last_change":"2024-04-24T13:34:54.089719+0000","last_active":"2024-04-24T13:34:54.089719+0000","last_peered":"2024-04-24T13:34:54.089719+0000","last_clean":"2024-04-24T13:34:54.089719+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:34:54.089719+0000","last_undegraded":"2024-04-24T13:34:54.089719+0000","last_fullsized":"2024-04-24T13:34:54.089719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:54.089378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:54.089378+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.089378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:05:02.343646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"82'2","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.609718+0000","last_change":"2024-04-24T13:33:09.338972+0000","last_active":"2024-04-24T13:34:42.609718+0000","last_peered":"2024-04-24T13:34:42.609718+0000","last_clean":"2024-04-24T13:34:42.609718+0000","last_became_active":"2024-04-24T13:33:08.727402+0000","last_became_peered":"2024-04-24T13:33:08.727402+0000","last_unstale":"2024-04-24T13:34:42.609718+0000","last_undegraded":"2024-04-24T13:34:42.609718+0000","last_fullsized":"2024-04-24T13:34:42.609718+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"105'4","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.982042+0000","last_change":"2024-04-24T13:35:09.982102+0000","last_active":"2024-04-24T13:35:09.982042+0000","last_peered":"2024-04-24T13:35:09.982042+0000","last_clean":"2024-04-24T13:35:09.982042+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:35:09.982042+0000","last_undegraded":"2024-04-24T13:35:09.982042+0000","last_fullsized":"2024-04-24T13:35:09.982042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'4","last_scrub_stamp":"2024-04-24T13:35:09.981844+0000","last_deep_scrub":"105'4","last_deep_scrub_stamp":"2024-04-24T13:35:09.981844+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.981844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:57.175965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"15'117","reported_seq":389,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668252+0000","last_change":"2024-04-24T13:33:54.557574+0000","last_active":"2024-04-24T13:34:35.668252+0000","last_peered":"2024-04-24T13:34:35.668252+0000","last_clean":"2024-04-24T13:34:35.668252+0000","last_became_active":"2024-04-24T13:33:54.557258+0000","last_became_peered":"2024-04-24T13:33:54.557258+0000","last_unstale":"2024-04-24T13:34:35.668252+0000","last_undegraded":"2024-04-24T13:34:35.668252+0000","last_fullsized":"2024-04-24T13:34:35.668252+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:07.758813+0000","last_clean_scrub_stamp":"2024-04-24T13:30:07.758813+0000","objects_scrubbed":0,"log_size":117,"log_dups_size":0,"ondisk_log_size":117,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.404959+0000","last_change":"2024-04-24T13:35:11.405021+0000","last_active":"2024-04-24T13:35:11.404959+0000","last_peered":"2024-04-24T13:35:11.404959+0000","last_clean":"2024-04-24T13:35:11.404959+0000","last_became_active":"2024-04-24T13:33:08.715914+0000","last_became_peered":"2024-04-24T13:33:08.715914+0000","last_unstale":"2024-04-24T13:35:11.404959+0000","last_undegraded":"2024-04-24T13:35:11.404959+0000","last_fullsized":"2024-04-24T13:35:11.404959+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:11.404742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:11.404742+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.404742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:47:04.561793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"150'56","reported_seq":360,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.514338+0000","last_change":"2024-04-24T13:34:58.514492+0000","last_active":"2024-04-24T13:34:58.514338+0000","last_peered":"2024-04-24T13:34:58.514338+0000","last_clean":"2024-04-24T13:34:58.514338+0000","last_became_active":"2024-04-24T13:33:08.725348+0000","last_became_peered":"2024-04-24T13:33:08.725348+0000","last_unstale":"2024-04-24T13:34:58.514338+0000","last_undegraded":"2024-04-24T13:34:58.514338+0000","last_fullsized":"2024-04-24T13:34:58.514338+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'56","last_scrub_stamp":"2024-04-24T13:34:58.514107+0000","last_deep_scrub":"150'56","last_deep_scrub_stamp":"2024-04-24T13:34:58.514107+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.514107+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:09.146766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":58,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669078+0000","last_change":"2024-04-24T13:33:49.295687+0000","last_active":"2024-04-24T13:34:35.669078+0000","last_peered":"2024-04-24T13:34:35.669078+0000","last_clean":"2024-04-24T13:34:35.669078+0000","last_became_active":"2024-04-24T13:33:49.293916+0000","last_became_peered":"2024-04-24T13:33:49.293916+0000","last_unstale":"2024-04-24T13:34:35.669078+0000","last_undegraded":"2024-04-24T13:34:35.669078+0000","last_fullsized":"2024-04-24T13:34:35.669078+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"150'53","reported_seq":157,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.445423+0000","last_change":"2024-04-24T13:35:08.445502+0000","last_active":"2024-04-24T13:35:08.445423+0000","last_peered":"2024-04-24T13:35:08.445423+0000","last_clean":"2024-04-24T13:35:08.445423+0000","last_became_active":"2024-04-24T13:33:08.719950+0000","last_became_peered":"2024-04-24T13:33:08.719950+0000","last_unstale":"2024-04-24T13:35:08.445423+0000","last_undegraded":"2024-04-24T13:35:08.445423+0000","last_fullsized":"2024-04-24T13:35:08.445423+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'53","last_scrub_stamp":"2024-04-24T13:35:08.445233+0000","last_deep_scrub":"150'53","last_deep_scrub_stamp":"2024-04-24T13:35:08.445233+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.445233+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:42:09.159856+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":397,"num_write":30,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":58868,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:50.704608+0000","last_change":"2024-04-24T13:33:49.296153+0000","last_active":"2024-04-24T13:34:50.704608+0000","last_peered":"2024-04-24T13:34:50.704608+0000","last_clean":"2024-04-24T13:34:50.704608+0000","last_became_active":"2024-04-24T13:33:49.294098+0000","last_became_peered":"2024-04-24T13:33:49.294098+0000","last_unstale":"2024-04-24T13:34:50.704608+0000","last_undegraded":"2024-04-24T13:34:50.704608+0000","last_fullsized":"2024-04-24T13:34:50.704608+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.615284+0000","last_change":"2024-04-24T13:33:08.727069+0000","last_active":"2024-04-24T13:34:52.615284+0000","last_peered":"2024-04-24T13:34:52.615284+0000","last_clean":"2024-04-24T13:34:52.615284+0000","last_became_active":"2024-04-24T13:33:08.726216+0000","last_became_peered":"2024-04-24T13:33:08.726216+0000","last_unstale":"2024-04-24T13:34:52.615284+0000","last_undegraded":"2024-04-24T13:34:52.615284+0000","last_fullsized":"2024-04-24T13:34:52.615284+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"105'6","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.615529+0000","last_change":"2024-04-24T13:30:23.219585+0000","last_active":"2024-04-24T13:34:42.615529+0000","last_peered":"2024-04-24T13:34:42.615529+0000","last_clean":"2024-04-24T13:34:42.615529+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:34:42.615529+0000","last_undegraded":"2024-04-24T13:34:42.615529+0000","last_fullsized":"2024-04-24T13:34:42.615529+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":58,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.668837+0000","last_change":"2024-04-24T13:33:49.282926+0000","last_active":"2024-04-24T13:34:35.668837+0000","last_peered":"2024-04-24T13:34:35.668837+0000","last_clean":"2024-04-24T13:34:35.668837+0000","last_became_active":"2024-04-24T13:33:49.282517+0000","last_became_peered":"2024-04-24T13:33:49.282517+0000","last_unstale":"2024-04-24T13:34:35.668837+0000","last_undegraded":"2024-04-24T13:34:35.668837+0000","last_fullsized":"2024-04-24T13:34:35.668837+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"150'48","reported_seq":314,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.599455+0000","last_change":"2024-04-24T13:30:21.213339+0000","last_active":"2024-04-24T13:34:47.599455+0000","last_peered":"2024-04-24T13:34:47.599455+0000","last_clean":"2024-04-24T13:34:47.599455+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:34:47.599455+0000","last_undegraded":"2024-04-24T13:34:47.599455+0000","last_fullsized":"2024-04-24T13:34:47.599455+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.399943+0000","last_change":"2024-04-24T13:35:07.400000+0000","last_active":"2024-04-24T13:35:07.399943+0000","last_peered":"2024-04-24T13:35:07.399943+0000","last_clean":"2024-04-24T13:35:07.399943+0000","last_became_active":"2024-04-24T13:33:08.728126+0000","last_became_peered":"2024-04-24T13:33:08.728126+0000","last_unstale":"2024-04-24T13:35:07.399943+0000","last_undegraded":"2024-04-24T13:35:07.399943+0000","last_fullsized":"2024-04-24T13:35:07.399943+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:07.399742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:07.399742+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.399742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:01:11.989434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"150'155","reported_seq":544,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.793736+0000","last_change":"2024-04-24T13:34:55.793825+0000","last_active":"2024-04-24T13:34:55.793736+0000","last_peered":"2024-04-24T13:34:55.793736+0000","last_clean":"2024-04-24T13:34:55.793736+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:34:55.793736+0000","last_undegraded":"2024-04-24T13:34:55.793736+0000","last_fullsized":"2024-04-24T13:34:55.793736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'155","last_scrub_stamp":"2024-04-24T13:34:55.793548+0000","last_deep_scrub":"150'155","last_deep_scrub_stamp":"2024-04-24T13:34:55.793548+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.793548+0000","objects_scrubbed":10,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:41:47.433857+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":200,"num_read_kb":417,"num_write":36,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":58,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669502+0000","last_change":"2024-04-24T13:33:49.298292+0000","last_active":"2024-04-24T13:34:35.669502+0000","last_peered":"2024-04-24T13:34:35.669502+0000","last_clean":"2024-04-24T13:34:35.669502+0000","last_became_active":"2024-04-24T13:33:49.297450+0000","last_became_peered":"2024-04-24T13:33:49.297450+0000","last_unstale":"2024-04-24T13:34:35.669502+0000","last_undegraded":"2024-04-24T13:34:35.669502+0000","last_fullsized":"2024-04-24T13:34:35.669502+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":248,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.159366+0000","last_change":"2024-04-24T13:30:31.991605+0000","last_active":"2024-04-24T13:34:51.159366+0000","last_peered":"2024-04-24T13:34:51.159366+0000","last_clean":"2024-04-24T13:34:51.159366+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:34:51.159366+0000","last_undegraded":"2024-04-24T13:34:51.159366+0000","last_fullsized":"2024-04-24T13:34:51.159366+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"132'2","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.609883+0000","last_change":"2024-04-24T13:33:08.745743+0000","last_active":"2024-04-24T13:34:42.609883+0000","last_peered":"2024-04-24T13:34:42.609883+0000","last_clean":"2024-04-24T13:34:42.609883+0000","last_became_active":"2024-04-24T13:33:08.745363+0000","last_became_peered":"2024-04-24T13:33:08.745363+0000","last_unstale":"2024-04-24T13:34:42.609883+0000","last_undegraded":"2024-04-24T13:34:42.609883+0000","last_fullsized":"2024-04-24T13:34:42.609883+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.818246+0000","last_change":"2024-04-24T13:34:56.818315+0000","last_active":"2024-04-24T13:34:56.818246+0000","last_peered":"2024-04-24T13:34:56.818246+0000","last_clean":"2024-04-24T13:34:56.818246+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:34:56.818246+0000","last_undegraded":"2024-04-24T13:34:56.818246+0000","last_fullsized":"2024-04-24T13:34:56.818246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:56.817999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:56.817999+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.817999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:09:42.991381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"150'46","reported_seq":322,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.004311+0000","last_change":"2024-04-24T13:35:08.004373+0000","last_active":"2024-04-24T13:35:08.004311+0000","last_peered":"2024-04-24T13:35:08.004311+0000","last_clean":"2024-04-24T13:35:08.004311+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:35:08.004311+0000","last_undegraded":"2024-04-24T13:35:08.004311+0000","last_fullsized":"2024-04-24T13:35:08.004311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'46","last_scrub_stamp":"2024-04-24T13:35:08.004122+0000","last_deep_scrub":"150'46","last_deep_scrub_stamp":"2024-04-24T13:35:08.004122+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.004122+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:56:52.005906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"150'2","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.967504+0000","last_change":"2024-04-24T13:35:05.967567+0000","last_active":"2024-04-24T13:35:05.967504+0000","last_peered":"2024-04-24T13:35:05.967504+0000","last_clean":"2024-04-24T13:35:05.967504+0000","last_became_active":"2024-04-24T13:33:08.726022+0000","last_became_peered":"2024-04-24T13:33:08.726022+0000","last_unstale":"2024-04-24T13:35:05.967504+0000","last_undegraded":"2024-04-24T13:35:05.967504+0000","last_fullsized":"2024-04-24T13:35:05.967504+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2024-04-24T13:35:05.967287+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2024-04-24T13:35:05.967287+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.967287+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:14.865880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"150'26","reported_seq":103,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.210343+0000","last_change":"2024-04-24T13:34:56.210432+0000","last_active":"2024-04-24T13:34:56.210343+0000","last_peered":"2024-04-24T13:34:56.210343+0000","last_clean":"2024-04-24T13:34:56.210343+0000","last_became_active":"2024-04-24T13:33:49.297296+0000","last_became_peered":"2024-04-24T13:33:49.297296+0000","last_unstale":"2024-04-24T13:34:56.210343+0000","last_undegraded":"2024-04-24T13:34:56.210343+0000","last_fullsized":"2024-04-24T13:34:56.210343+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'26","last_scrub_stamp":"2024-04-24T13:34:56.210139+0000","last_deep_scrub":"150'26","last_deep_scrub_stamp":"2024-04-24T13:34:56.210139+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.210139+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:24:45.836243+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.496972+0000","last_change":"2024-04-24T13:35:04.497029+0000","last_active":"2024-04-24T13:35:04.496972+0000","last_peered":"2024-04-24T13:35:04.496972+0000","last_clean":"2024-04-24T13:35:04.496972+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:35:04.496972+0000","last_undegraded":"2024-04-24T13:35:04.496972+0000","last_fullsized":"2024-04-24T13:35:04.496972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:04.496766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:04.496766+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.496766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:32.875137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.505656+0000","last_change":"2024-04-24T13:34:57.505656+0000","last_active":"2024-04-24T13:34:57.505656+0000","last_peered":"2024-04-24T13:34:57.505656+0000","last_clean":"2024-04-24T13:34:57.505656+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:34:57.505656+0000","last_undegraded":"2024-04-24T13:34:57.505656+0000","last_fullsized":"2024-04-24T13:34:57.505656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:57.505376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:57.505376+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.505376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:07:19.060724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"132'4","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.891458+0000","last_change":"2024-04-24T13:35:04.891517+0000","last_active":"2024-04-24T13:35:04.891458+0000","last_peered":"2024-04-24T13:35:04.891458+0000","last_clean":"2024-04-24T13:35:04.891458+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:35:04.891458+0000","last_undegraded":"2024-04-24T13:35:04.891458+0000","last_fullsized":"2024-04-24T13:35:04.891458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'4","last_scrub_stamp":"2024-04-24T13:35:04.891253+0000","last_deep_scrub":"132'4","last_deep_scrub_stamp":"2024-04-24T13:35:04.891253+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.891253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:57:58.060012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.412382+0000","last_change":"2024-04-24T13:35:09.412422+0000","last_active":"2024-04-24T13:35:09.412382+0000","last_peered":"2024-04-24T13:35:09.412382+0000","last_clean":"2024-04-24T13:35:09.412382+0000","last_became_active":"2024-04-24T13:33:08.727324+0000","last_became_peered":"2024-04-24T13:33:08.727324+0000","last_unstale":"2024-04-24T13:35:09.412382+0000","last_undegraded":"2024-04-24T13:35:09.412382+0000","last_fullsized":"2024-04-24T13:35:09.412382+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:09.412260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:09.412260+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.412260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:26.690128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"150'44","reported_seq":315,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.554701+0000","last_change":"2024-04-24T13:31:00.987810+0000","last_active":"2024-04-24T13:34:47.554701+0000","last_peered":"2024-04-24T13:34:47.554701+0000","last_clean":"2024-04-24T13:34:47.554701+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:34:47.554701+0000","last_undegraded":"2024-04-24T13:34:47.554701+0000","last_fullsized":"2024-04-24T13:34:47.554701+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.487882+0000","last_change":"2024-04-24T13:35:03.487940+0000","last_active":"2024-04-24T13:35:03.487882+0000","last_peered":"2024-04-24T13:35:03.487882+0000","last_clean":"2024-04-24T13:35:03.487882+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:35:03.487882+0000","last_undegraded":"2024-04-24T13:35:03.487882+0000","last_fullsized":"2024-04-24T13:35:03.487882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:03.487639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:03.487639+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.487639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:41:15.917774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"150'18","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.440119+0000","last_change":"2024-04-24T13:35:08.440236+0000","last_active":"2024-04-24T13:35:08.440119+0000","last_peered":"2024-04-24T13:35:08.440119+0000","last_clean":"2024-04-24T13:35:08.440119+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:35:08.440119+0000","last_undegraded":"2024-04-24T13:35:08.440119+0000","last_fullsized":"2024-04-24T13:35:08.440119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'18","last_scrub_stamp":"2024-04-24T13:35:08.439912+0000","last_deep_scrub":"150'18","last_deep_scrub_stamp":"2024-04-24T13:35:08.439912+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.439912+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:41:16.442413+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.063220+0000","last_change":"2024-04-24T13:34:57.063281+0000","last_active":"2024-04-24T13:34:57.063220+0000","last_peered":"2024-04-24T13:34:57.063220+0000","last_clean":"2024-04-24T13:34:57.063220+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:34:57.063220+0000","last_undegraded":"2024-04-24T13:34:57.063220+0000","last_fullsized":"2024-04-24T13:34:57.063220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:57.063010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:57.063010+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.063010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:09:43.236392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"81'4","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.309135+0000","last_change":"2024-04-24T13:35:02.309202+0000","last_active":"2024-04-24T13:35:02.309135+0000","last_peered":"2024-04-24T13:35:02.309135+0000","last_clean":"2024-04-24T13:35:02.309135+0000","last_became_active":"2024-04-24T13:33:08.717929+0000","last_became_peered":"2024-04-24T13:33:08.717929+0000","last_unstale":"2024-04-24T13:35:02.309135+0000","last_undegraded":"2024-04-24T13:35:02.309135+0000","last_fullsized":"2024-04-24T13:35:02.309135+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-04-24T13:35:02.308927+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-04-24T13:35:02.308927+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.308927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:50:41.219735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":274,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528080+0000","last_change":"2024-04-24T13:33:08.738475+0000","last_active":"2024-04-24T13:34:35.528080+0000","last_peered":"2024-04-24T13:34:35.528080+0000","last_clean":"2024-04-24T13:34:35.528080+0000","last_became_active":"2024-04-24T13:33:08.738109+0000","last_became_peered":"2024-04-24T13:33:08.738109+0000","last_unstale":"2024-04-24T13:34:35.528080+0000","last_undegraded":"2024-04-24T13:34:35.528080+0000","last_fullsized":"2024-04-24T13:34:35.528080+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"150'52","reported_seq":171,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.413276+0000","last_change":"2024-04-24T13:34:59.413346+0000","last_active":"2024-04-24T13:34:59.413276+0000","last_peered":"2024-04-24T13:34:59.413276+0000","last_clean":"2024-04-24T13:34:59.413276+0000","last_became_active":"2024-04-24T13:33:08.716808+0000","last_became_peered":"2024-04-24T13:33:08.716808+0000","last_unstale":"2024-04-24T13:34:59.413276+0000","last_undegraded":"2024-04-24T13:34:59.413276+0000","last_fullsized":"2024-04-24T13:34:59.413276+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'52","last_scrub_stamp":"2024-04-24T13:34:59.413060+0000","last_deep_scrub":"150'52","last_deep_scrub_stamp":"2024-04-24T13:34:59.413060+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.413060+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:17:02.192363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.987772+0000","last_change":"2024-04-24T13:35:06.987831+0000","last_active":"2024-04-24T13:35:06.987772+0000","last_peered":"2024-04-24T13:35:06.987772+0000","last_clean":"2024-04-24T13:35:06.987772+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:35:06.987772+0000","last_undegraded":"2024-04-24T13:35:06.987772+0000","last_fullsized":"2024-04-24T13:35:06.987772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:06.987542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:06.987542+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.987542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:21:53.605786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.513869+0000","last_change":"2024-04-24T13:35:01.514001+0000","last_active":"2024-04-24T13:35:01.513869+0000","last_peered":"2024-04-24T13:35:01.513869+0000","last_clean":"2024-04-24T13:35:01.513869+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:35:01.513869+0000","last_undegraded":"2024-04-24T13:35:01.513869+0000","last_fullsized":"2024-04-24T13:35:01.513869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:01.513635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:01.513635+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.513635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:31:47.632337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"150'46","reported_seq":330,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.563440+0000","last_change":"2024-04-24T13:34:59.563542+0000","last_active":"2024-04-24T13:34:59.563440+0000","last_peered":"2024-04-24T13:34:59.563440+0000","last_clean":"2024-04-24T13:34:59.563440+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:34:59.563440+0000","last_undegraded":"2024-04-24T13:34:59.563440+0000","last_fullsized":"2024-04-24T13:34:59.563440+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'46","last_scrub_stamp":"2024-04-24T13:34:59.563228+0000","last_deep_scrub":"150'46","last_deep_scrub_stamp":"2024-04-24T13:34:59.563228+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.563228+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:10.195887+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.343986+0000","last_change":"2024-04-24T13:34:55.344039+0000","last_active":"2024-04-24T13:34:55.343986+0000","last_peered":"2024-04-24T13:34:55.343986+0000","last_clean":"2024-04-24T13:34:55.343986+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:34:55.343986+0000","last_undegraded":"2024-04-24T13:34:55.343986+0000","last_fullsized":"2024-04-24T13:34:55.343986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:55.343785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:55.343785+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.343785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:46.236531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.523529+0000","last_change":"2024-04-24T13:34:55.523529+0000","last_active":"2024-04-24T13:34:55.523529+0000","last_peered":"2024-04-24T13:34:55.523529+0000","last_clean":"2024-04-24T13:34:55.523529+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:34:55.523529+0000","last_undegraded":"2024-04-24T13:34:55.523529+0000","last_fullsized":"2024-04-24T13:34:55.523529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:55.523244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:55.523244+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.523244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:30.849238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"114'18","reported_seq":360,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.592088+0000","last_change":"2024-04-24T13:34:53.592138+0000","last_active":"2024-04-24T13:34:53.592088+0000","last_peered":"2024-04-24T13:34:53.592088+0000","last_clean":"2024-04-24T13:34:53.592088+0000","last_became_active":"2024-04-24T13:33:08.705853+0000","last_became_peered":"2024-04-24T13:33:08.705853+0000","last_unstale":"2024-04-24T13:34:53.592088+0000","last_undegraded":"2024-04-24T13:34:53.592088+0000","last_fullsized":"2024-04-24T13:34:53.592088+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'18","last_scrub_stamp":"2024-04-24T13:34:53.591991+0000","last_deep_scrub":"114'18","last_deep_scrub_stamp":"2024-04-24T13:34:53.591991+0000","last_clean_scrub_stamp":"2024-04-24T13:34:53.591991+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:04:49.148626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":86,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"150'28","reported_seq":304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.038597+0000","last_change":"2024-04-24T13:35:09.038663+0000","last_active":"2024-04-24T13:35:09.038597+0000","last_peered":"2024-04-24T13:35:09.038597+0000","last_clean":"2024-04-24T13:35:09.038597+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:35:09.038597+0000","last_undegraded":"2024-04-24T13:35:09.038597+0000","last_fullsized":"2024-04-24T13:35:09.038597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'28","last_scrub_stamp":"2024-04-24T13:35:09.038390+0000","last_deep_scrub":"150'28","last_deep_scrub_stamp":"2024-04-24T13:35:09.038390+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.038390+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:07:16.626915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":58,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670031+0000","last_change":"2024-04-24T13:33:49.288345+0000","last_active":"2024-04-24T13:34:35.670031+0000","last_peered":"2024-04-24T13:34:35.670031+0000","last_clean":"2024-04-24T13:34:35.670031+0000","last_became_active":"2024-04-24T13:33:49.287893+0000","last_became_peered":"2024-04-24T13:33:49.287893+0000","last_unstale":"2024-04-24T13:34:35.670031+0000","last_undegraded":"2024-04-24T13:34:35.670031+0000","last_fullsized":"2024-04-24T13:34:35.670031+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":264,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.987492+0000","last_change":"2024-04-24T13:35:10.987544+0000","last_active":"2024-04-24T13:35:10.987492+0000","last_peered":"2024-04-24T13:35:10.987492+0000","last_clean":"2024-04-24T13:35:10.987492+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:35:10.987492+0000","last_undegraded":"2024-04-24T13:35:10.987492+0000","last_fullsized":"2024-04-24T13:35:10.987492+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:10.987298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:10.987298+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.987298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:34:04.146616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"150'22","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.680269+0000","last_change":"2024-04-24T13:34:51.680325+0000","last_active":"2024-04-24T13:34:51.680269+0000","last_peered":"2024-04-24T13:34:51.680269+0000","last_clean":"2024-04-24T13:34:51.680269+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:34:51.680269+0000","last_undegraded":"2024-04-24T13:34:51.680269+0000","last_fullsized":"2024-04-24T13:34:51.680269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'22","last_scrub_stamp":"2024-04-24T13:34:51.680185+0000","last_deep_scrub":"150'22","last_deep_scrub_stamp":"2024-04-24T13:34:51.680185+0000","last_clean_scrub_stamp":"2024-04-24T13:34:51.680185+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:20:50.188444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"150'141","reported_seq":364,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.414116+0000","last_change":"2024-04-24T13:34:58.414116+0000","last_active":"2024-04-24T13:34:58.414116+0000","last_peered":"2024-04-24T13:34:58.414116+0000","last_clean":"2024-04-24T13:34:58.414116+0000","last_became_active":"2024-04-24T13:33:11.710310+0000","last_became_peered":"2024-04-24T13:33:11.710310+0000","last_unstale":"2024-04-24T13:34:58.414116+0000","last_undegraded":"2024-04-24T13:34:58.414116+0000","last_fullsized":"2024-04-24T13:34:58.414116+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'141","last_scrub_stamp":"2024-04-24T13:34:58.413723+0000","last_deep_scrub":"150'141","last_deep_scrub_stamp":"2024-04-24T13:34:58.413723+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.413723+0000","objects_scrubbed":1,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:48.829821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"150'4","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.499881+0000","last_change":"2024-04-24T13:34:55.499881+0000","last_active":"2024-04-24T13:34:55.499881+0000","last_peered":"2024-04-24T13:34:55.499881+0000","last_clean":"2024-04-24T13:34:55.499881+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:34:55.499881+0000","last_undegraded":"2024-04-24T13:34:55.499881+0000","last_fullsized":"2024-04-24T13:34:55.499881+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'4","last_scrub_stamp":"2024-04-24T13:34:55.499435+0000","last_deep_scrub":"150'4","last_deep_scrub_stamp":"2024-04-24T13:34:55.499435+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.499435+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:45:23.244270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"82'2","reported_seq":238,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.015563+0000","last_change":"2024-04-24T13:35:10.015633+0000","last_active":"2024-04-24T13:35:10.015563+0000","last_peered":"2024-04-24T13:35:10.015563+0000","last_clean":"2024-04-24T13:35:10.015563+0000","last_became_active":"2024-04-24T13:33:49.296844+0000","last_became_peered":"2024-04-24T13:33:49.296844+0000","last_unstale":"2024-04-24T13:35:10.015563+0000","last_undegraded":"2024-04-24T13:35:10.015563+0000","last_fullsized":"2024-04-24T13:35:10.015563+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:10.015340+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:10.015340+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.015340+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:57.209461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"150'48","reported_seq":360,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.590928+0000","last_change":"2024-04-24T13:33:51.134298+0000","last_active":"2024-04-24T13:34:47.590928+0000","last_peered":"2024-04-24T13:34:47.590928+0000","last_clean":"2024-04-24T13:34:47.590928+0000","last_became_active":"2024-04-24T13:33:49.300149+0000","last_became_peered":"2024-04-24T13:33:49.300149+0000","last_unstale":"2024-04-24T13:34:47.590928+0000","last_undegraded":"2024-04-24T13:34:47.590928+0000","last_fullsized":"2024-04-24T13:34:47.590928+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.939023+0000","last_change":"2024-04-24T13:35:05.939144+0000","last_active":"2024-04-24T13:35:05.939023+0000","last_peered":"2024-04-24T13:35:05.939023+0000","last_clean":"2024-04-24T13:35:05.939023+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:35:05.939023+0000","last_undegraded":"2024-04-24T13:35:05.939023+0000","last_fullsized":"2024-04-24T13:35:05.939023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:05.938783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:05.938783+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.938783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:47:06.383645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.453880+0000","last_change":"2024-04-24T13:35:02.453935+0000","last_active":"2024-04-24T13:35:02.453880+0000","last_peered":"2024-04-24T13:35:02.453880+0000","last_clean":"2024-04-24T13:35:02.453880+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:35:02.453880+0000","last_undegraded":"2024-04-24T13:35:02.453880+0000","last_fullsized":"2024-04-24T13:35:02.453880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:02.453679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:02.453679+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.453679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:57:55.622438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"150'15","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.505466+0000","last_change":"2024-04-24T13:35:06.505545+0000","last_active":"2024-04-24T13:35:06.505466+0000","last_peered":"2024-04-24T13:35:06.505466+0000","last_clean":"2024-04-24T13:35:06.505466+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:35:06.505466+0000","last_undegraded":"2024-04-24T13:35:06.505466+0000","last_fullsized":"2024-04-24T13:35:06.505466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'15","last_scrub_stamp":"2024-04-24T13:35:06.505272+0000","last_deep_scrub":"150'15","last_deep_scrub_stamp":"2024-04-24T13:35:06.505272+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.505272+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:07:14.093797+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"150'138","reported_seq":448,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:12.387654+0000","last_change":"2024-04-24T13:35:12.387811+0000","last_active":"2024-04-24T13:35:12.387654+0000","last_peered":"2024-04-24T13:35:12.387654+0000","last_clean":"2024-04-24T13:35:12.387654+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:35:12.387654+0000","last_undegraded":"2024-04-24T13:35:12.387654+0000","last_fullsized":"2024-04-24T13:35:12.387654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'138","last_scrub_stamp":"2024-04-24T13:35:12.387362+0000","last_deep_scrub":"150'138","last_deep_scrub_stamp":"2024-04-24T13:35:12.387362+0000","last_clean_scrub_stamp":"2024-04-24T13:35:12.387362+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:58.408562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"82'6","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.567149+0000","last_change":"2024-04-24T13:35:10.567221+0000","last_active":"2024-04-24T13:35:10.567149+0000","last_peered":"2024-04-24T13:35:10.567149+0000","last_clean":"2024-04-24T13:35:10.567149+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:35:10.567149+0000","last_undegraded":"2024-04-24T13:35:10.567149+0000","last_fullsized":"2024-04-24T13:35:10.567149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-24T13:35:10.566935+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-24T13:35:10.566935+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.566935+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:23.851314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"114'6","reported_seq":303,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.588419+0000","last_change":"2024-04-24T13:33:08.753804+0000","last_active":"2024-04-24T13:34:34.588419+0000","last_peered":"2024-04-24T13:34:34.588419+0000","last_clean":"2024-04-24T13:34:34.588419+0000","last_became_active":"2024-04-24T13:33:08.707993+0000","last_became_peered":"2024-04-24T13:33:08.707993+0000","last_unstale":"2024-04-24T13:34:34.588419+0000","last_undegraded":"2024-04-24T13:34:34.588419+0000","last_fullsized":"2024-04-24T13:34:34.588419+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"150'44","reported_seq":310,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.541007+0000","last_change":"2024-04-24T13:30:21.212475+0000","last_active":"2024-04-24T13:34:47.541007+0000","last_peered":"2024-04-24T13:34:47.541007+0000","last_clean":"2024-04-24T13:34:47.541007+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:34:47.541007+0000","last_undegraded":"2024-04-24T13:34:47.541007+0000","last_fullsized":"2024-04-24T13:34:47.541007+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.671845+0000","last_change":"2024-04-24T13:33:49.289245+0000","last_active":"2024-04-24T13:34:35.671845+0000","last_peered":"2024-04-24T13:34:35.671845+0000","last_clean":"2024-04-24T13:34:35.671845+0000","last_became_active":"2024-04-24T13:33:49.288766+0000","last_became_peered":"2024-04-24T13:33:49.288766+0000","last_unstale":"2024-04-24T13:34:35.671845+0000","last_undegraded":"2024-04-24T13:34:35.671845+0000","last_fullsized":"2024-04-24T13:34:35.671845+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:14.128704+0000","last_clean_scrub_stamp":"2024-04-24T13:30:14.128704+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.459164+0000","last_change":"2024-04-24T13:35:03.459222+0000","last_active":"2024-04-24T13:35:03.459164+0000","last_peered":"2024-04-24T13:35:03.459164+0000","last_clean":"2024-04-24T13:35:03.459164+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:35:03.459164+0000","last_undegraded":"2024-04-24T13:35:03.459164+0000","last_fullsized":"2024-04-24T13:35:03.459164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:03.458957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:03.458957+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.458957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:58:29.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"150'57","reported_seq":113,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.358823+0000","last_change":"2024-04-24T13:35:09.358982+0000","last_active":"2024-04-24T13:35:09.358823+0000","last_peered":"2024-04-24T13:35:09.358823+0000","last_clean":"2024-04-24T13:35:09.358823+0000","last_became_active":"2024-04-24T13:33:49.295935+0000","last_became_peered":"2024-04-24T13:33:49.295935+0000","last_unstale":"2024-04-24T13:35:09.358823+0000","last_undegraded":"2024-04-24T13:35:09.358823+0000","last_fullsized":"2024-04-24T13:35:09.358823+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'57","last_scrub_stamp":"2024-04-24T13:35:09.358537+0000","last_deep_scrub":"150'57","last_deep_scrub_stamp":"2024-04-24T13:35:09.358537+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.358537+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:57:20.540010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":56,"num_read_kb":42,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.558215+0000","last_change":"2024-04-24T13:34:59.558322+0000","last_active":"2024-04-24T13:34:59.558215+0000","last_peered":"2024-04-24T13:34:59.558215+0000","last_clean":"2024-04-24T13:34:59.558215+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:34:59.558215+0000","last_undegraded":"2024-04-24T13:34:59.558215+0000","last_fullsized":"2024-04-24T13:34:59.558215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:59.557910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:59.557910+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.557910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:08:52.507873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"105'6","reported_seq":121,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594963+0000","last_change":"2024-04-24T13:33:51.141865+0000","last_active":"2024-04-24T13:34:34.594963+0000","last_peered":"2024-04-24T13:34:34.594963+0000","last_clean":"2024-04-24T13:34:34.594963+0000","last_became_active":"2024-04-24T13:33:49.289035+0000","last_became_peered":"2024-04-24T13:33:49.289035+0000","last_unstale":"2024-04-24T13:34:34.594963+0000","last_undegraded":"2024-04-24T13:34:34.594963+0000","last_fullsized":"2024-04-24T13:34:34.594963+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"82'2","reported_seq":272,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.566308+0000","last_change":"2024-04-24T13:34:54.566446+0000","last_active":"2024-04-24T13:34:54.566308+0000","last_peered":"2024-04-24T13:34:54.566308+0000","last_clean":"2024-04-24T13:34:54.566308+0000","last_became_active":"2024-04-24T13:33:08.705821+0000","last_became_peered":"2024-04-24T13:33:08.705821+0000","last_unstale":"2024-04-24T13:34:54.566308+0000","last_undegraded":"2024-04-24T13:34:54.566308+0000","last_fullsized":"2024-04-24T13:34:54.566308+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:34:54.566075+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:34:54.566075+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.566075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:41.015456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"82'2","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.363507+0000","last_change":"2024-04-24T13:34:56.363507+0000","last_active":"2024-04-24T13:34:56.363507+0000","last_peered":"2024-04-24T13:34:56.363507+0000","last_clean":"2024-04-24T13:34:56.363507+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:34:56.363507+0000","last_undegraded":"2024-04-24T13:34:56.363507+0000","last_fullsized":"2024-04-24T13:34:56.363507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:34:56.363214+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:34:56.363214+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.363214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:21:00.255439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"150'66","reported_seq":340,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.992029+0000","last_change":"2024-04-24T13:35:10.992095+0000","last_active":"2024-04-24T13:35:10.992029+0000","last_peered":"2024-04-24T13:35:10.992029+0000","last_clean":"2024-04-24T13:35:10.992029+0000","last_became_active":"2024-04-24T13:33:49.297002+0000","last_became_peered":"2024-04-24T13:33:49.297002+0000","last_unstale":"2024-04-24T13:35:10.992029+0000","last_undegraded":"2024-04-24T13:35:10.992029+0000","last_fullsized":"2024-04-24T13:35:10.992029+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'66","last_scrub_stamp":"2024-04-24T13:35:10.991829+0000","last_deep_scrub":"150'66","last_deep_scrub_stamp":"2024-04-24T13:35:10.991829+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.991829+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:34:04.151147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"25'1","reported_seq":370,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.159168+0000","last_change":"2024-04-24T13:33:09.553473+0000","last_active":"2024-04-24T13:34:51.159168+0000","last_peered":"2024-04-24T13:34:51.159168+0000","last_clean":"2024-04-24T13:34:51.159168+0000","last_became_active":"2024-04-24T13:33:08.738276+0000","last_became_peered":"2024-04-24T13:33:08.738276+0000","last_unstale":"2024-04-24T13:34:51.159168+0000","last_undegraded":"2024-04-24T13:34:51.159168+0000","last_fullsized":"2024-04-24T13:34:51.159168+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"150'28","reported_seq":304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.531587+0000","last_change":"2024-04-24T13:35:00.531587+0000","last_active":"2024-04-24T13:35:00.531587+0000","last_peered":"2024-04-24T13:35:00.531587+0000","last_clean":"2024-04-24T13:35:00.531587+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:35:00.531587+0000","last_undegraded":"2024-04-24T13:35:00.531587+0000","last_fullsized":"2024-04-24T13:35:00.531587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'28","last_scrub_stamp":"2024-04-24T13:35:00.531426+0000","last_deep_scrub":"150'28","last_deep_scrub_stamp":"2024-04-24T13:35:00.531426+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.531426+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:09.593271+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.389820+0000","last_change":"2024-04-24T13:35:10.389820+0000","last_active":"2024-04-24T13:35:10.389820+0000","last_peered":"2024-04-24T13:35:10.389820+0000","last_clean":"2024-04-24T13:35:10.389820+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:35:10.389820+0000","last_undegraded":"2024-04-24T13:35:10.389820+0000","last_fullsized":"2024-04-24T13:35:10.389820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:10.389571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:10.389571+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.389571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:23.673949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555976+0000","last_change":"2024-04-24T13:33:49.302711+0000","last_active":"2024-04-24T13:34:35.555976+0000","last_peered":"2024-04-24T13:34:35.555976+0000","last_clean":"2024-04-24T13:34:35.555976+0000","last_became_active":"2024-04-24T13:33:49.302201+0000","last_became_peered":"2024-04-24T13:33:49.302201+0000","last_unstale":"2024-04-24T13:34:35.555976+0000","last_undegraded":"2024-04-24T13:34:35.555976+0000","last_fullsized":"2024-04-24T13:34:35.555976+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":272,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.851700+0000","last_change":"2024-04-24T13:34:58.851700+0000","last_active":"2024-04-24T13:34:58.851700+0000","last_peered":"2024-04-24T13:34:58.851700+0000","last_clean":"2024-04-24T13:34:58.851700+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:34:58.851700+0000","last_undegraded":"2024-04-24T13:34:58.851700+0000","last_fullsized":"2024-04-24T13:34:58.851700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:58.851267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:58.851267+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.851267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:13.000922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"150'40","reported_seq":109,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.423368+0000","last_change":"2024-04-24T13:33:53.881731+0000","last_active":"2024-04-24T13:34:47.423368+0000","last_peered":"2024-04-24T13:34:47.423368+0000","last_clean":"2024-04-24T13:34:47.423368+0000","last_became_active":"2024-04-24T13:33:49.299864+0000","last_became_peered":"2024-04-24T13:33:49.299864+0000","last_unstale":"2024-04-24T13:34:47.423368+0000","last_undegraded":"2024-04-24T13:34:47.423368+0000","last_fullsized":"2024-04-24T13:34:47.423368+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.527935+0000","last_change":"2024-04-24T13:35:01.527935+0000","last_active":"2024-04-24T13:35:01.527935+0000","last_peered":"2024-04-24T13:35:01.527935+0000","last_clean":"2024-04-24T13:35:01.527935+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:35:01.527935+0000","last_undegraded":"2024-04-24T13:35:01.527935+0000","last_fullsized":"2024-04-24T13:35:01.527935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:01.527643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:01.527643+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.527643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:29:11.034330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"150'12","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.596038+0000","last_change":"2024-04-24T13:34:51.596038+0000","last_active":"2024-04-24T13:34:51.596038+0000","last_peered":"2024-04-24T13:34:51.596038+0000","last_clean":"2024-04-24T13:34:51.596038+0000","last_became_active":"2024-04-24T13:33:08.721855+0000","last_became_peered":"2024-04-24T13:33:08.721855+0000","last_unstale":"2024-04-24T13:34:51.596038+0000","last_undegraded":"2024-04-24T13:34:51.596038+0000","last_fullsized":"2024-04-24T13:34:51.596038+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'12","last_scrub_stamp":"2024-04-24T13:34:51.595741+0000","last_deep_scrub":"150'12","last_deep_scrub_stamp":"2024-04-24T13:34:51.595741+0000","last_clean_scrub_stamp":"2024-04-24T13:34:51.595741+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:00:07.543976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.301941+0000","last_change":"2024-04-24T13:35:08.301996+0000","last_active":"2024-04-24T13:35:08.301941+0000","last_peered":"2024-04-24T13:35:08.301941+0000","last_clean":"2024-04-24T13:35:08.301941+0000","last_became_active":"2024-04-24T13:33:49.297478+0000","last_became_peered":"2024-04-24T13:33:49.297478+0000","last_unstale":"2024-04-24T13:35:08.301941+0000","last_undegraded":"2024-04-24T13:35:08.301941+0000","last_fullsized":"2024-04-24T13:35:08.301941+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:08.301731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:08.301731+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.301731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:07:29.857080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"132'6","reported_seq":263,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.490578+0000","last_change":"2024-04-24T13:34:57.490640+0000","last_active":"2024-04-24T13:34:57.490578+0000","last_peered":"2024-04-24T13:34:57.490578+0000","last_clean":"2024-04-24T13:34:57.490578+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:34:57.490578+0000","last_undegraded":"2024-04-24T13:34:57.490578+0000","last_fullsized":"2024-04-24T13:34:57.490578+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'6","last_scrub_stamp":"2024-04-24T13:34:57.490383+0000","last_deep_scrub":"132'6","last_deep_scrub_stamp":"2024-04-24T13:34:57.490383+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.490383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:25:17.653873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"82'4","reported_seq":296,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.058764+0000","last_change":"2024-04-24T13:33:49.688460+0000","last_active":"2024-04-24T13:34:52.058764+0000","last_peered":"2024-04-24T13:34:52.058764+0000","last_clean":"2024-04-24T13:34:52.058764+0000","last_became_active":"2024-04-24T13:33:49.292866+0000","last_became_peered":"2024-04-24T13:33:49.292866+0000","last_unstale":"2024-04-24T13:34:52.058764+0000","last_undegraded":"2024-04-24T13:34:52.058764+0000","last_fullsized":"2024-04-24T13:34:52.058764+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"150'44","reported_seq":195,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.601646+0000","last_change":"2024-04-24T13:33:52.207013+0000","last_active":"2024-04-24T13:34:47.601646+0000","last_peered":"2024-04-24T13:34:47.601646+0000","last_clean":"2024-04-24T13:34:47.601646+0000","last_became_active":"2024-04-24T13:33:49.289650+0000","last_became_peered":"2024-04-24T13:33:49.289650+0000","last_unstale":"2024-04-24T13:34:47.601646+0000","last_undegraded":"2024-04-24T13:34:47.601646+0000","last_fullsized":"2024-04-24T13:34:47.601646+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":58,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667698+0000","last_change":"2024-04-24T13:33:49.283767+0000","last_active":"2024-04-24T13:34:35.667698+0000","last_peered":"2024-04-24T13:34:35.667698+0000","last_clean":"2024-04-24T13:34:35.667698+0000","last_became_active":"2024-04-24T13:33:49.283342+0000","last_became_peered":"2024-04-24T13:33:49.283342+0000","last_unstale":"2024-04-24T13:34:35.667698+0000","last_undegraded":"2024-04-24T13:34:35.667698+0000","last_fullsized":"2024-04-24T13:34:35.667698+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"150'27","reported_seq":303,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.490715+0000","last_change":"2024-04-24T13:35:02.490715+0000","last_active":"2024-04-24T13:35:02.490715+0000","last_peered":"2024-04-24T13:35:02.490715+0000","last_clean":"2024-04-24T13:35:02.490715+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:35:02.490715+0000","last_undegraded":"2024-04-24T13:35:02.490715+0000","last_fullsized":"2024-04-24T13:35:02.490715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'27","last_scrub_stamp":"2024-04-24T13:35:02.490330+0000","last_deep_scrub":"150'27","last_deep_scrub_stamp":"2024-04-24T13:35:02.490330+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.490330+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:41:14.920465+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.093548+0000","last_change":"2024-04-24T13:34:55.093548+0000","last_active":"2024-04-24T13:34:55.093548+0000","last_peered":"2024-04-24T13:34:55.093548+0000","last_clean":"2024-04-24T13:34:55.093548+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:34:55.093548+0000","last_undegraded":"2024-04-24T13:34:55.093548+0000","last_fullsized":"2024-04-24T13:34:55.093548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:55.093265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:55.093265+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.093265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:18:51.443013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"114'4","reported_seq":118,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594566+0000","last_change":"2024-04-24T13:33:50.241765+0000","last_active":"2024-04-24T13:34:34.594566+0000","last_peered":"2024-04-24T13:34:34.594566+0000","last_clean":"2024-04-24T13:34:34.594566+0000","last_became_active":"2024-04-24T13:33:49.288852+0000","last_became_peered":"2024-04-24T13:33:49.288852+0000","last_unstale":"2024-04-24T13:34:34.594566+0000","last_undegraded":"2024-04-24T13:34:34.594566+0000","last_fullsized":"2024-04-24T13:34:34.594566+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.399852+0000","last_change":"2024-04-24T13:35:11.399915+0000","last_active":"2024-04-24T13:35:11.399852+0000","last_peered":"2024-04-24T13:35:11.399852+0000","last_clean":"2024-04-24T13:35:11.399852+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:35:11.399852+0000","last_undegraded":"2024-04-24T13:35:11.399852+0000","last_fullsized":"2024-04-24T13:35:11.399852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-04-24T13:35:11.399622+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-04-24T13:35:11.399622+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.399622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:48.599892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"150'40","reported_seq":342,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.626761+0000","last_change":"2024-04-24T13:34:52.626761+0000","last_active":"2024-04-24T13:34:52.626761+0000","last_peered":"2024-04-24T13:34:52.626761+0000","last_clean":"2024-04-24T13:34:52.626761+0000","last_became_active":"2024-04-24T13:33:08.722546+0000","last_became_peered":"2024-04-24T13:33:08.722546+0000","last_unstale":"2024-04-24T13:34:52.626761+0000","last_undegraded":"2024-04-24T13:34:52.626761+0000","last_fullsized":"2024-04-24T13:34:52.626761+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'40","last_scrub_stamp":"2024-04-24T13:34:52.626581+0000","last_deep_scrub":"150'40","last_deep_scrub_stamp":"2024-04-24T13:34:52.626581+0000","last_clean_scrub_stamp":"2024-04-24T13:34:52.626581+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:07:00.215106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":264,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.016018+0000","last_change":"2024-04-24T13:35:03.016018+0000","last_active":"2024-04-24T13:35:03.016018+0000","last_peered":"2024-04-24T13:35:03.016018+0000","last_clean":"2024-04-24T13:35:03.016018+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:35:03.016018+0000","last_undegraded":"2024-04-24T13:35:03.016018+0000","last_fullsized":"2024-04-24T13:35:03.016018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:03.015761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:03.015761+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.015761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:31:59.660728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"150'21","reported_seq":76,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.280869+0000","last_change":"2024-04-24T13:33:52.735528+0000","last_active":"2024-04-24T13:34:47.280869+0000","last_peered":"2024-04-24T13:34:47.280869+0000","last_clean":"2024-04-24T13:34:47.280869+0000","last_became_active":"2024-04-24T13:33:49.297667+0000","last_became_peered":"2024-04-24T13:33:49.297667+0000","last_unstale":"2024-04-24T13:34:47.280869+0000","last_undegraded":"2024-04-24T13:34:47.280869+0000","last_fullsized":"2024-04-24T13:34:47.280869+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.527318+0000","last_change":"2024-04-24T13:34:56.527318+0000","last_active":"2024-04-24T13:34:56.527318+0000","last_peered":"2024-04-24T13:34:56.527318+0000","last_clean":"2024-04-24T13:34:56.527318+0000","last_became_active":"2024-04-24T13:33:49.285495+0000","last_became_peered":"2024-04-24T13:33:49.285495+0000","last_unstale":"2024-04-24T13:34:56.527318+0000","last_undegraded":"2024-04-24T13:34:56.527318+0000","last_fullsized":"2024-04-24T13:34:56.527318+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:56.527057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:56.527057+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.527057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:45:24.271892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"82'8","reported_seq":304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.017013+0000","last_change":"2024-04-24T13:35:08.017080+0000","last_active":"2024-04-24T13:35:08.017013+0000","last_peered":"2024-04-24T13:35:08.017013+0000","last_clean":"2024-04-24T13:35:08.017013+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:35:08.017013+0000","last_undegraded":"2024-04-24T13:35:08.017013+0000","last_fullsized":"2024-04-24T13:35:08.017013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'8","last_scrub_stamp":"2024-04-24T13:35:08.016746+0000","last_deep_scrub":"82'8","last_deep_scrub_stamp":"2024-04-24T13:35:08.016746+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.016746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:55:05.897118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"150'54","reported_seq":322,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.058556+0000","last_change":"2024-04-24T13:30:21.224569+0000","last_active":"2024-04-24T13:34:52.058556+0000","last_peered":"2024-04-24T13:34:52.058556+0000","last_clean":"2024-04-24T13:34:52.058556+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:34:52.058556+0000","last_undegraded":"2024-04-24T13:34:52.058556+0000","last_fullsized":"2024-04-24T13:34:52.058556+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667662+0000","last_change":"2024-04-24T13:33:49.296871+0000","last_active":"2024-04-24T13:34:35.667662+0000","last_peered":"2024-04-24T13:34:35.667662+0000","last_clean":"2024-04-24T13:34:35.667662+0000","last_became_active":"2024-04-24T13:33:49.295933+0000","last_became_peered":"2024-04-24T13:33:49.295933+0000","last_unstale":"2024-04-24T13:34:35.667662+0000","last_undegraded":"2024-04-24T13:34:35.667662+0000","last_fullsized":"2024-04-24T13:34:35.667662+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"150'39","reported_seq":321,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.784701+0000","last_change":"2024-04-24T13:34:53.784866+0000","last_active":"2024-04-24T13:34:53.784701+0000","last_peered":"2024-04-24T13:34:53.784701+0000","last_clean":"2024-04-24T13:34:53.784701+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:34:53.784701+0000","last_undegraded":"2024-04-24T13:34:53.784701+0000","last_fullsized":"2024-04-24T13:34:53.784701+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'39","last_scrub_stamp":"2024-04-24T13:34:53.784486+0000","last_deep_scrub":"150'39","last_deep_scrub_stamp":"2024-04-24T13:34:53.784486+0000","last_clean_scrub_stamp":"2024-04-24T13:34:53.784486+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:09:39.957868+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":103,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.594470+0000","last_change":"2024-04-24T13:33:08.717844+0000","last_active":"2024-04-24T13:34:34.594470+0000","last_peered":"2024-04-24T13:34:34.594470+0000","last_clean":"2024-04-24T13:34:34.594470+0000","last_became_active":"2024-04-24T13:33:08.716627+0000","last_became_peered":"2024-04-24T13:33:08.716627+0000","last_unstale":"2024-04-24T13:34:34.594470+0000","last_undegraded":"2024-04-24T13:34:34.594470+0000","last_fullsized":"2024-04-24T13:34:34.594470+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.501822+0000","last_change":"2024-04-24T13:34:56.501822+0000","last_active":"2024-04-24T13:34:56.501822+0000","last_peered":"2024-04-24T13:34:56.501822+0000","last_clean":"2024-04-24T13:34:56.501822+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:34:56.501822+0000","last_undegraded":"2024-04-24T13:34:56.501822+0000","last_fullsized":"2024-04-24T13:34:56.501822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:56.501492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:56.501492+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.501492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:25:16.664982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"114'10","reported_seq":325,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.667538+0000","last_change":"2024-04-24T13:33:50.254858+0000","last_active":"2024-04-24T13:34:35.667538+0000","last_peered":"2024-04-24T13:34:35.667538+0000","last_clean":"2024-04-24T13:34:35.667538+0000","last_became_active":"2024-04-24T13:33:49.285680+0000","last_became_peered":"2024-04-24T13:33:49.285680+0000","last_unstale":"2024-04-24T13:34:35.667538+0000","last_undegraded":"2024-04-24T13:34:35.667538+0000","last_fullsized":"2024-04-24T13:34:35.667538+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"150'40","reported_seq":308,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.158829+0000","last_change":"2024-04-24T13:30:21.230598+0000","last_active":"2024-04-24T13:34:51.158829+0000","last_peered":"2024-04-24T13:34:51.158829+0000","last_clean":"2024-04-24T13:34:51.158829+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:34:51.158829+0000","last_undegraded":"2024-04-24T13:34:51.158829+0000","last_fullsized":"2024-04-24T13:34:51.158829+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":264,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.022881+0000","last_change":"2024-04-24T13:35:01.022947+0000","last_active":"2024-04-24T13:35:01.022881+0000","last_peered":"2024-04-24T13:35:01.022881+0000","last_clean":"2024-04-24T13:35:01.022881+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:35:01.022881+0000","last_undegraded":"2024-04-24T13:35:01.022881+0000","last_fullsized":"2024-04-24T13:35:01.022881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:01.022634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:01.022634+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.022634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:50.825500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"150'32","reported_seq":96,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.216934+0000","last_change":"2024-04-24T13:34:59.217022+0000","last_active":"2024-04-24T13:34:59.216934+0000","last_peered":"2024-04-24T13:34:59.216934+0000","last_clean":"2024-04-24T13:34:59.216934+0000","last_became_active":"2024-04-24T13:33:49.291994+0000","last_became_peered":"2024-04-24T13:33:49.291994+0000","last_unstale":"2024-04-24T13:34:59.216934+0000","last_undegraded":"2024-04-24T13:34:59.216934+0000","last_fullsized":"2024-04-24T13:34:59.216934+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'32","last_scrub_stamp":"2024-04-24T13:34:59.216747+0000","last_deep_scrub":"150'32","last_deep_scrub_stamp":"2024-04-24T13:34:59.216747+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.216747+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:59.661609+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":259,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.853194+0000","last_change":"2024-04-24T13:34:57.853257+0000","last_active":"2024-04-24T13:34:57.853194+0000","last_peered":"2024-04-24T13:34:57.853194+0000","last_clean":"2024-04-24T13:34:57.853194+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:34:57.853194+0000","last_undegraded":"2024-04-24T13:34:57.853194+0000","last_fullsized":"2024-04-24T13:34:57.853194+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:57.852957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:57.852957+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.852957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:48.745703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.432930+0000","last_change":"2024-04-24T13:33:49.289138+0000","last_active":"2024-04-24T13:34:53.432930+0000","last_peered":"2024-04-24T13:34:53.432930+0000","last_clean":"2024-04-24T13:34:53.432930+0000","last_became_active":"2024-04-24T13:33:49.288760+0000","last_became_peered":"2024-04-24T13:33:49.288760+0000","last_unstale":"2024-04-24T13:34:53.432930+0000","last_undegraded":"2024-04-24T13:34:53.432930+0000","last_fullsized":"2024-04-24T13:34:53.432930+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":271,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.405850+0000","last_change":"2024-04-24T13:35:09.405901+0000","last_active":"2024-04-24T13:35:09.405850+0000","last_peered":"2024-04-24T13:35:09.405850+0000","last_clean":"2024-04-24T13:35:09.405850+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:35:09.405850+0000","last_undegraded":"2024-04-24T13:35:09.405850+0000","last_fullsized":"2024-04-24T13:35:09.405850+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:09.405654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:09.405654+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.405654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:53:58.666456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"150'34","reported_seq":299,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.567470+0000","last_change":"2024-04-24T13:30:21.216625+0000","last_active":"2024-04-24T13:34:47.567470+0000","last_peered":"2024-04-24T13:34:47.567470+0000","last_clean":"2024-04-24T13:34:47.567470+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:34:47.567470+0000","last_undegraded":"2024-04-24T13:34:47.567470+0000","last_fullsized":"2024-04-24T13:34:47.567470+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":265,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.455291+0000","last_change":"2024-04-24T13:35:00.455345+0000","last_active":"2024-04-24T13:35:00.455291+0000","last_peered":"2024-04-24T13:35:00.455291+0000","last_clean":"2024-04-24T13:35:00.455291+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:35:00.455291+0000","last_undegraded":"2024-04-24T13:35:00.455291+0000","last_fullsized":"2024-04-24T13:35:00.455291+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:00.455056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:00.455056+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.455056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:24:50.081161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"150'27","reported_seq":303,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.453442+0000","last_change":"2024-04-24T13:35:06.453519+0000","last_active":"2024-04-24T13:35:06.453442+0000","last_peered":"2024-04-24T13:35:06.453442+0000","last_clean":"2024-04-24T13:35:06.453442+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:35:06.453442+0000","last_undegraded":"2024-04-24T13:35:06.453442+0000","last_fullsized":"2024-04-24T13:35:06.453442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'27","last_scrub_stamp":"2024-04-24T13:35:06.453263+0000","last_deep_scrub":"150'27","last_deep_scrub_stamp":"2024-04-24T13:35:06.453263+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.453263+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:40:22.783186+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.868233+0000","last_change":"2024-04-24T13:34:59.868294+0000","last_active":"2024-04-24T13:34:59.868233+0000","last_peered":"2024-04-24T13:34:59.868233+0000","last_clean":"2024-04-24T13:34:59.868233+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:34:59.868233+0000","last_undegraded":"2024-04-24T13:34:59.868233+0000","last_fullsized":"2024-04-24T13:34:59.868233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:59.868034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:59.868034+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.868034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:31:56.513000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.980804+0000","last_change":"2024-04-24T13:33:49.289867+0000","last_active":"2024-04-24T13:34:52.980804+0000","last_peered":"2024-04-24T13:34:52.980804+0000","last_clean":"2024-04-24T13:34:52.980804+0000","last_became_active":"2024-04-24T13:33:49.289412+0000","last_became_peered":"2024-04-24T13:33:49.289412+0000","last_unstale":"2024-04-24T13:34:52.980804+0000","last_undegraded":"2024-04-24T13:34:52.980804+0000","last_fullsized":"2024-04-24T13:34:52.980804+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"114'2","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.892274+0000","last_change":"2024-04-24T13:34:59.892339+0000","last_active":"2024-04-24T13:34:59.892274+0000","last_peered":"2024-04-24T13:34:59.892274+0000","last_clean":"2024-04-24T13:34:59.892274+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:34:59.892274+0000","last_undegraded":"2024-04-24T13:34:59.892274+0000","last_fullsized":"2024-04-24T13:34:59.892274+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'2","last_scrub_stamp":"2024-04-24T13:34:59.892059+0000","last_deep_scrub":"114'2","last_deep_scrub_stamp":"2024-04-24T13:34:59.892059+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.892059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:53:01.147568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"150'56","reported_seq":321,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.596859+0000","last_change":"2024-04-24T13:30:21.215067+0000","last_active":"2024-04-24T13:34:47.596859+0000","last_peered":"2024-04-24T13:34:47.596859+0000","last_clean":"2024-04-24T13:34:47.596859+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:34:47.596859+0000","last_undegraded":"2024-04-24T13:34:47.596859+0000","last_fullsized":"2024-04-24T13:34:47.596859+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.752260+0000","last_change":"2024-04-24T13:34:54.752402+0000","last_active":"2024-04-24T13:34:54.752260+0000","last_peered":"2024-04-24T13:34:54.752260+0000","last_clean":"2024-04-24T13:34:54.752260+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:34:54.752260+0000","last_undegraded":"2024-04-24T13:34:54.752260+0000","last_fullsized":"2024-04-24T13:34:54.752260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:54.752034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:54.752034+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.752034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:09:52.135595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"150'15","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.470026+0000","last_change":"2024-04-24T13:35:04.470107+0000","last_active":"2024-04-24T13:35:04.470026+0000","last_peered":"2024-04-24T13:35:04.470026+0000","last_clean":"2024-04-24T13:35:04.470026+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:35:04.470026+0000","last_undegraded":"2024-04-24T13:35:04.470026+0000","last_fullsized":"2024-04-24T13:35:04.470026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'15","last_scrub_stamp":"2024-04-24T13:35:04.469827+0000","last_deep_scrub":"150'15","last_deep_scrub_stamp":"2024-04-24T13:35:04.469827+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.469827+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:21:51.088071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"150'138","reported_seq":444,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.051522+0000","last_change":"2024-04-24T13:34:59.051583+0000","last_active":"2024-04-24T13:34:59.051522+0000","last_peered":"2024-04-24T13:34:59.051522+0000","last_clean":"2024-04-24T13:34:59.051522+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:34:59.051522+0000","last_undegraded":"2024-04-24T13:34:59.051522+0000","last_fullsized":"2024-04-24T13:34:59.051522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'138","last_scrub_stamp":"2024-04-24T13:34:59.051338+0000","last_deep_scrub":"150'138","last_deep_scrub_stamp":"2024-04-24T13:34:59.051338+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.051338+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:41:50.691647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"82'6","reported_seq":70,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.221035+0000","last_change":"2024-04-24T13:35:00.221206+0000","last_active":"2024-04-24T13:35:00.221035+0000","last_peered":"2024-04-24T13:35:00.221035+0000","last_clean":"2024-04-24T13:35:00.221035+0000","last_became_active":"2024-04-24T13:33:49.285594+0000","last_became_peered":"2024-04-24T13:33:49.285594+0000","last_unstale":"2024-04-24T13:35:00.221035+0000","last_undegraded":"2024-04-24T13:35:00.221035+0000","last_fullsized":"2024-04-24T13:35:00.221035+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-24T13:35:00.220755+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-24T13:35:00.220755+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.220755+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:21:46.838999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"86'4","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.541328+0000","last_change":"2024-04-24T13:35:11.541391+0000","last_active":"2024-04-24T13:35:11.541328+0000","last_peered":"2024-04-24T13:35:11.541328+0000","last_clean":"2024-04-24T13:35:11.541328+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:35:11.541328+0000","last_undegraded":"2024-04-24T13:35:11.541328+0000","last_fullsized":"2024-04-24T13:35:11.541328+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'4","last_scrub_stamp":"2024-04-24T13:35:11.541122+0000","last_deep_scrub":"86'4","last_deep_scrub_stamp":"2024-04-24T13:35:11.541122+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.541122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:32:01.191149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"150'54","reported_seq":178,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.334196+0000","last_change":"2024-04-24T13:35:01.334253+0000","last_active":"2024-04-24T13:35:01.334196+0000","last_peered":"2024-04-24T13:35:01.334196+0000","last_clean":"2024-04-24T13:35:01.334196+0000","last_became_active":"2024-04-24T13:33:08.708911+0000","last_became_peered":"2024-04-24T13:33:08.708911+0000","last_unstale":"2024-04-24T13:35:01.334196+0000","last_undegraded":"2024-04-24T13:35:01.334196+0000","last_fullsized":"2024-04-24T13:35:01.334196+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'54","last_scrub_stamp":"2024-04-24T13:35:01.334022+0000","last_deep_scrub":"150'54","last_deep_scrub_stamp":"2024-04-24T13:35:01.334022+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.334022+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:56:08.367748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":108544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":58,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669205+0000","last_change":"2024-04-24T13:33:49.283103+0000","last_active":"2024-04-24T13:34:35.669205+0000","last_peered":"2024-04-24T13:34:35.669205+0000","last_clean":"2024-04-24T13:34:35.669205+0000","last_became_active":"2024-04-24T13:33:49.282772+0000","last_became_peered":"2024-04-24T13:33:49.282772+0000","last_unstale":"2024-04-24T13:34:35.669205+0000","last_undegraded":"2024-04-24T13:34:35.669205+0000","last_fullsized":"2024-04-24T13:34:35.669205+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"150'29","reported_seq":130,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.080392+0000","last_change":"2024-04-24T13:33:09.934600+0000","last_active":"2024-04-24T13:34:47.080392+0000","last_peered":"2024-04-24T13:34:47.080392+0000","last_clean":"2024-04-24T13:34:47.080392+0000","last_became_active":"2024-04-24T13:33:08.732254+0000","last_became_peered":"2024-04-24T13:33:08.732254+0000","last_unstale":"2024-04-24T13:34:47.080392+0000","last_undegraded":"2024-04-24T13:34:47.080392+0000","last_fullsized":"2024-04-24T13:34:47.080392+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.502511+0000","last_change":"2024-04-24T13:35:02.502612+0000","last_active":"2024-04-24T13:35:02.502511+0000","last_peered":"2024-04-24T13:35:02.502511+0000","last_clean":"2024-04-24T13:35:02.502511+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:35:02.502511+0000","last_undegraded":"2024-04-24T13:35:02.502511+0000","last_fullsized":"2024-04-24T13:35:02.502511+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:02.502212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:02.502212+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.502212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:29:12.008899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":58,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670344+0000","last_change":"2024-04-24T13:33:49.295971+0000","last_active":"2024-04-24T13:34:35.670344+0000","last_peered":"2024-04-24T13:34:35.670344+0000","last_clean":"2024-04-24T13:34:35.670344+0000","last_became_active":"2024-04-24T13:33:49.294486+0000","last_became_peered":"2024-04-24T13:33:49.294486+0000","last_unstale":"2024-04-24T13:34:35.670344+0000","last_undegraded":"2024-04-24T13:34:35.670344+0000","last_fullsized":"2024-04-24T13:34:35.670344+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"105'6","reported_seq":157,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:12.019390+0000","last_change":"2024-04-24T13:35:12.019530+0000","last_active":"2024-04-24T13:35:12.019390+0000","last_peered":"2024-04-24T13:35:12.019390+0000","last_clean":"2024-04-24T13:35:12.019390+0000","last_became_active":"2024-04-24T13:32:32.741990+0000","last_became_peered":"2024-04-24T13:32:32.741990+0000","last_unstale":"2024-04-24T13:35:12.019390+0000","last_undegraded":"2024-04-24T13:35:12.019390+0000","last_fullsized":"2024-04-24T13:35:12.019390+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'6","last_scrub_stamp":"2024-04-24T13:35:12.019073+0000","last_deep_scrub":"105'6","last_deep_scrub_stamp":"2024-04-24T13:35:12.019073+0000","last_clean_scrub_stamp":"2024-04-24T13:35:12.019073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:06.320220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"150'46","reported_seq":315,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.582301+0000","last_change":"2024-04-24T13:30:21.216943+0000","last_active":"2024-04-24T13:34:47.582301+0000","last_peered":"2024-04-24T13:34:47.582301+0000","last_clean":"2024-04-24T13:34:47.582301+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:34:47.582301+0000","last_undegraded":"2024-04-24T13:34:47.582301+0000","last_fullsized":"2024-04-24T13:34:47.582301+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":103,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.593599+0000","last_change":"2024-04-24T13:33:08.705125+0000","last_active":"2024-04-24T13:34:34.593599+0000","last_peered":"2024-04-24T13:34:34.593599+0000","last_clean":"2024-04-24T13:34:34.593599+0000","last_became_active":"2024-04-24T13:33:08.704735+0000","last_became_peered":"2024-04-24T13:33:08.704735+0000","last_unstale":"2024-04-24T13:34:34.593599+0000","last_undegraded":"2024-04-24T13:34:34.593599+0000","last_fullsized":"2024-04-24T13:34:34.593599+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"150'24","reported_seq":296,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.525794+0000","last_change":"2024-04-24T13:34:58.525879+0000","last_active":"2024-04-24T13:34:58.525794+0000","last_peered":"2024-04-24T13:34:58.525794+0000","last_clean":"2024-04-24T13:34:58.525794+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:34:58.525794+0000","last_undegraded":"2024-04-24T13:34:58.525794+0000","last_fullsized":"2024-04-24T13:34:58.525794+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'24","last_scrub_stamp":"2024-04-24T13:34:58.525589+0000","last_deep_scrub":"150'24","last_deep_scrub_stamp":"2024-04-24T13:34:58.525589+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.525589+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:07:20.080937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670601+0000","last_change":"2024-04-24T13:33:49.289409+0000","last_active":"2024-04-24T13:34:35.670601+0000","last_peered":"2024-04-24T13:34:35.670601+0000","last_clean":"2024-04-24T13:34:35.670601+0000","last_became_active":"2024-04-24T13:33:49.288970+0000","last_became_peered":"2024-04-24T13:33:49.288970+0000","last_unstale":"2024-04-24T13:34:35.670601+0000","last_undegraded":"2024-04-24T13:34:35.670601+0000","last_fullsized":"2024-04-24T13:34:35.670601+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:28.227376+0000","last_clean_scrub_stamp":"2024-04-24T13:30:28.227376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":255,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.485353+0000","last_change":"2024-04-24T13:34:53.485376+0000","last_active":"2024-04-24T13:34:53.485353+0000","last_peered":"2024-04-24T13:34:53.485353+0000","last_clean":"2024-04-24T13:34:53.485353+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:34:53.485353+0000","last_undegraded":"2024-04-24T13:34:53.485353+0000","last_fullsized":"2024-04-24T13:34:53.485353+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:53.485251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:53.485251+0000","last_clean_scrub_stamp":"2024-04-24T13:34:53.485251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:26:07.934474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"105'10","reported_seq":245,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.592669+0000","last_change":"2024-04-24T13:31:00.983263+0000","last_active":"2024-04-24T13:34:34.592669+0000","last_peered":"2024-04-24T13:34:34.592669+0000","last_clean":"2024-04-24T13:34:34.592669+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:34:34.592669+0000","last_undegraded":"2024-04-24T13:34:34.592669+0000","last_fullsized":"2024-04-24T13:34:34.592669+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"150'38","reported_seq":306,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.590308+0000","last_change":"2024-04-24T13:30:21.224713+0000","last_active":"2024-04-24T13:34:47.590308+0000","last_peered":"2024-04-24T13:34:47.590308+0000","last_clean":"2024-04-24T13:34:47.590308+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:34:47.590308+0000","last_undegraded":"2024-04-24T13:34:47.590308+0000","last_fullsized":"2024-04-24T13:34:47.590308+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":265,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.409146+0000","last_change":"2024-04-24T13:34:58.409201+0000","last_active":"2024-04-24T13:34:58.409146+0000","last_peered":"2024-04-24T13:34:58.409146+0000","last_clean":"2024-04-24T13:34:58.409146+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:34:58.409146+0000","last_undegraded":"2024-04-24T13:34:58.409146+0000","last_fullsized":"2024-04-24T13:34:58.409146+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:58.408926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:58.408926+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.408926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:21:20.314097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"150'17","reported_seq":198,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.959012+0000","last_change":"2024-04-24T13:35:11.959089+0000","last_active":"2024-04-24T13:35:11.959012+0000","last_peered":"2024-04-24T13:35:11.959012+0000","last_clean":"2024-04-24T13:35:11.959012+0000","last_became_active":"2024-04-24T13:33:49.302159+0000","last_became_peered":"2024-04-24T13:33:49.302159+0000","last_unstale":"2024-04-24T13:35:11.959012+0000","last_undegraded":"2024-04-24T13:35:11.959012+0000","last_fullsized":"2024-04-24T13:35:11.959012+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'17","last_scrub_stamp":"2024-04-24T13:35:11.958799+0000","last_deep_scrub":"150'17","last_deep_scrub_stamp":"2024-04-24T13:35:11.958799+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.958799+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:06.259946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.352763+0000","last_change":"2024-04-24T13:34:53.352817+0000","last_active":"2024-04-24T13:34:53.352763+0000","last_peered":"2024-04-24T13:34:53.352763+0000","last_clean":"2024-04-24T13:34:53.352763+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:34:53.352763+0000","last_undegraded":"2024-04-24T13:34:53.352763+0000","last_fullsized":"2024-04-24T13:34:53.352763+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:53.352544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:53.352544+0000","last_clean_scrub_stamp":"2024-04-24T13:34:53.352544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:01:40.724213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"82'2","reported_seq":62,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.670415+0000","last_change":"2024-04-24T13:33:54.657281+0000","last_active":"2024-04-24T13:34:35.670415+0000","last_peered":"2024-04-24T13:34:35.670415+0000","last_clean":"2024-04-24T13:34:35.670415+0000","last_became_active":"2024-04-24T13:33:49.303239+0000","last_became_peered":"2024-04-24T13:33:49.303239+0000","last_unstale":"2024-04-24T13:34:35.670415+0000","last_undegraded":"2024-04-24T13:34:35.670415+0000","last_fullsized":"2024-04-24T13:34:35.670415+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"82'4","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.471851+0000","last_change":"2024-04-24T13:35:03.471851+0000","last_active":"2024-04-24T13:35:03.471851+0000","last_peered":"2024-04-24T13:35:03.471851+0000","last_clean":"2024-04-24T13:35:03.471851+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:35:03.471851+0000","last_undegraded":"2024-04-24T13:35:03.471851+0000","last_fullsized":"2024-04-24T13:35:03.471851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:35:03.471604+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:35:03.471604+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.471604+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:47:03.916467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"150'42","reported_seq":223,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.912242+0000","last_change":"2024-04-24T13:34:54.912368+0000","last_active":"2024-04-24T13:34:54.912242+0000","last_peered":"2024-04-24T13:34:54.912242+0000","last_clean":"2024-04-24T13:34:54.912242+0000","last_became_active":"2024-04-24T13:33:08.725822+0000","last_became_peered":"2024-04-24T13:33:08.725822+0000","last_unstale":"2024-04-24T13:34:54.912242+0000","last_undegraded":"2024-04-24T13:34:54.912242+0000","last_fullsized":"2024-04-24T13:34:54.912242+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'42","last_scrub_stamp":"2024-04-24T13:34:54.911965+0000","last_deep_scrub":"150'42","last_deep_scrub_stamp":"2024-04-24T13:34:54.911965+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.911965+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:18:51.261713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"25'1","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.528841+0000","last_change":"2024-04-24T13:33:09.078708+0000","last_active":"2024-04-24T13:34:35.528841+0000","last_peered":"2024-04-24T13:34:35.528841+0000","last_clean":"2024-04-24T13:34:35.528841+0000","last_became_active":"2024-04-24T13:33:08.726873+0000","last_became_peered":"2024-04-24T13:33:08.726873+0000","last_unstale":"2024-04-24T13:34:35.528841+0000","last_undegraded":"2024-04-24T13:34:35.528841+0000","last_fullsized":"2024-04-24T13:34:35.528841+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:24.195553+0000","last_clean_scrub_stamp":"2024-04-24T13:30:24.195553+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"150'20","reported_seq":314,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:46.531797+0000","last_change":"2024-04-24T13:33:09.087185+0000","last_active":"2024-04-24T13:34:46.531797+0000","last_peered":"2024-04-24T13:34:46.531797+0000","last_clean":"2024-04-24T13:34:46.531797+0000","last_became_active":"2024-04-24T13:33:08.726347+0000","last_became_peered":"2024-04-24T13:33:08.726347+0000","last_unstale":"2024-04-24T13:34:46.531797+0000","last_undegraded":"2024-04-24T13:34:46.531797+0000","last_fullsized":"2024-04-24T13:34:46.531797+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:26.202712+0000","last_clean_scrub_stamp":"2024-04-24T13:30:26.202712+0000","objects_scrubbed":0,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":257,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.526950+0000","last_change":"2024-04-24T13:35:00.527005+0000","last_active":"2024-04-24T13:35:00.526950+0000","last_peered":"2024-04-24T13:35:00.526950+0000","last_clean":"2024-04-24T13:35:00.526950+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:35:00.526950+0000","last_undegraded":"2024-04-24T13:35:00.526950+0000","last_fullsized":"2024-04-24T13:35:00.526950+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:00.526778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:00.526778+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.526778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:08:53.476741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":246,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.538998+0000","last_change":"2024-04-24T13:30:31.282351+0000","last_active":"2024-04-24T13:34:52.538998+0000","last_peered":"2024-04-24T13:34:52.538998+0000","last_clean":"2024-04-24T13:34:52.538998+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:34:52.538998+0000","last_undegraded":"2024-04-24T13:34:52.538998+0000","last_fullsized":"2024-04-24T13:34:52.538998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:30.233088+0000","last_clean_scrub_stamp":"2024-04-24T13:30:30.233088+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"132'10","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.810472+0000","last_change":"2024-04-24T13:34:56.810533+0000","last_active":"2024-04-24T13:34:56.810472+0000","last_peered":"2024-04-24T13:34:56.810472+0000","last_clean":"2024-04-24T13:34:56.810472+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:34:56.810472+0000","last_undegraded":"2024-04-24T13:34:56.810472+0000","last_fullsized":"2024-04-24T13:34:56.810472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'10","last_scrub_stamp":"2024-04-24T13:34:56.810265+0000","last_deep_scrub":"132'10","last_deep_scrub_stamp":"2024-04-24T13:34:56.810265+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.810265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:03.670963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"150'28","reported_seq":300,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.987843+0000","last_change":"2024-04-24T13:35:05.987906+0000","last_active":"2024-04-24T13:35:05.987843+0000","last_peered":"2024-04-24T13:35:05.987843+0000","last_clean":"2024-04-24T13:35:05.987843+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:35:05.987843+0000","last_undegraded":"2024-04-24T13:35:05.987843+0000","last_fullsized":"2024-04-24T13:35:05.987843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'28","last_scrub_stamp":"2024-04-24T13:35:05.987646+0000","last_deep_scrub":"150'28","last_deep_scrub_stamp":"2024-04-24T13:35:05.987646+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.987646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:14.886239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"105'12","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.867022+0000","last_change":"2024-04-24T13:35:02.867086+0000","last_active":"2024-04-24T13:35:02.867022+0000","last_peered":"2024-04-24T13:35:02.867022+0000","last_clean":"2024-04-24T13:35:02.867022+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:35:02.867022+0000","last_undegraded":"2024-04-24T13:35:02.867022+0000","last_fullsized":"2024-04-24T13:35:02.867022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'12","last_scrub_stamp":"2024-04-24T13:35:02.866811+0000","last_deep_scrub":"105'12","last_deep_scrub_stamp":"2024-04-24T13:35:02.866811+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.866811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:11.765404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"150'38","reported_seq":338,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.013467+0000","last_change":"2024-04-24T13:35:05.013527+0000","last_active":"2024-04-24T13:35:05.013467+0000","last_peered":"2024-04-24T13:35:05.013467+0000","last_clean":"2024-04-24T13:35:05.013467+0000","last_became_active":"2024-04-24T13:33:08.725876+0000","last_became_peered":"2024-04-24T13:33:08.725876+0000","last_unstale":"2024-04-24T13:35:05.013467+0000","last_undegraded":"2024-04-24T13:35:05.013467+0000","last_fullsized":"2024-04-24T13:35:05.013467+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'38","last_scrub_stamp":"2024-04-24T13:35:05.013276+0000","last_deep_scrub":"150'38","last_deep_scrub_stamp":"2024-04-24T13:35:05.013276+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.013276+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:17:06.405155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"82'2","reported_seq":116,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595134+0000","last_change":"2024-04-24T13:33:53.237778+0000","last_active":"2024-04-24T13:34:34.595134+0000","last_peered":"2024-04-24T13:34:34.595134+0000","last_clean":"2024-04-24T13:34:34.595134+0000","last_became_active":"2024-04-24T13:33:49.302722+0000","last_became_peered":"2024-04-24T13:33:49.302722+0000","last_unstale":"2024-04-24T13:34:34.595134+0000","last_undegraded":"2024-04-24T13:34:34.595134+0000","last_fullsized":"2024-04-24T13:34:34.595134+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"150'56","reported_seq":180,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.391139+0000","last_change":"2024-04-24T13:35:06.391204+0000","last_active":"2024-04-24T13:35:06.391139+0000","last_peered":"2024-04-24T13:35:06.391139+0000","last_clean":"2024-04-24T13:35:06.391139+0000","last_became_active":"2024-04-24T13:33:08.720010+0000","last_became_peered":"2024-04-24T13:33:08.720010+0000","last_unstale":"2024-04-24T13:35:06.391139+0000","last_undegraded":"2024-04-24T13:35:06.391139+0000","last_fullsized":"2024-04-24T13:35:06.391139+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'56","last_scrub_stamp":"2024-04-24T13:35:06.390920+0000","last_deep_scrub":"150'56","last_deep_scrub_stamp":"2024-04-24T13:35:06.390920+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.390920+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:18:22.659835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"114'12","reported_seq":321,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:42.609762+0000","last_change":"2024-04-24T13:33:49.678468+0000","last_active":"2024-04-24T13:34:42.609762+0000","last_peered":"2024-04-24T13:34:42.609762+0000","last_clean":"2024-04-24T13:34:42.609762+0000","last_became_active":"2024-04-24T13:33:49.289642+0000","last_became_peered":"2024-04-24T13:33:49.289642+0000","last_unstale":"2024-04-24T13:34:42.609762+0000","last_undegraded":"2024-04-24T13:34:42.609762+0000","last_fullsized":"2024-04-24T13:34:42.609762+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"150'62","reported_seq":328,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.588702+0000","last_change":"2024-04-24T13:30:21.230615+0000","last_active":"2024-04-24T13:34:47.588702+0000","last_peered":"2024-04-24T13:34:47.588702+0000","last_clean":"2024-04-24T13:34:47.588702+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:34:47.588702+0000","last_undegraded":"2024-04-24T13:34:47.588702+0000","last_fullsized":"2024-04-24T13:34:47.588702+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"132'4","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.555032+0000","last_change":"2024-04-24T13:33:51.611283+0000","last_active":"2024-04-24T13:34:35.555032+0000","last_peered":"2024-04-24T13:34:35.555032+0000","last_clean":"2024-04-24T13:34:35.555032+0000","last_became_active":"2024-04-24T13:33:49.304888+0000","last_became_peered":"2024-04-24T13:33:49.304888+0000","last_unstale":"2024-04-24T13:34:35.555032+0000","last_undegraded":"2024-04-24T13:34:35.555032+0000","last_fullsized":"2024-04-24T13:34:35.555032+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"150'44","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.590729+0000","last_change":"2024-04-24T13:30:21.233642+0000","last_active":"2024-04-24T13:34:47.590729+0000","last_peered":"2024-04-24T13:34:47.590729+0000","last_clean":"2024-04-24T13:34:47.590729+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:34:47.590729+0000","last_undegraded":"2024-04-24T13:34:47.590729+0000","last_fullsized":"2024-04-24T13:34:47.590729+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"81'2","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.417354+0000","last_change":"2024-04-24T13:34:59.417419+0000","last_active":"2024-04-24T13:34:59.417354+0000","last_peered":"2024-04-24T13:34:59.417354+0000","last_clean":"2024-04-24T13:34:59.417354+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:34:59.417354+0000","last_undegraded":"2024-04-24T13:34:59.417354+0000","last_fullsized":"2024-04-24T13:34:59.417354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-04-24T13:34:59.417126+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-04-24T13:34:59.417126+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.417126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:35:08.056561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"150'36","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.985072+0000","last_change":"2024-04-24T13:35:11.985132+0000","last_active":"2024-04-24T13:35:11.985072+0000","last_peered":"2024-04-24T13:35:11.985072+0000","last_clean":"2024-04-24T13:35:11.985072+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:35:11.985072+0000","last_undegraded":"2024-04-24T13:35:11.985072+0000","last_fullsized":"2024-04-24T13:35:11.985072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'36","last_scrub_stamp":"2024-04-24T13:35:11.984874+0000","last_deep_scrub":"150'36","last_deep_scrub_stamp":"2024-04-24T13:35:11.984874+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.984874+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:47.310868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"132'12","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.554573+0000","last_change":"2024-04-24T13:30:23.224251+0000","last_active":"2024-04-24T13:34:35.554573+0000","last_peered":"2024-04-24T13:34:35.554573+0000","last_clean":"2024-04-24T13:34:35.554573+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:34:35.554573+0000","last_undegraded":"2024-04-24T13:34:35.554573+0000","last_fullsized":"2024-04-24T13:34:35.554573+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"150'58","reported_seq":370,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.607619+0000","last_change":"2024-04-24T13:33:50.237368+0000","last_active":"2024-04-24T13:34:47.607619+0000","last_peered":"2024-04-24T13:34:47.607619+0000","last_clean":"2024-04-24T13:34:47.607619+0000","last_became_active":"2024-04-24T13:33:49.301145+0000","last_became_peered":"2024-04-24T13:33:49.301145+0000","last_unstale":"2024-04-24T13:34:47.607619+0000","last_undegraded":"2024-04-24T13:34:47.607619+0000","last_fullsized":"2024-04-24T13:34:47.607619+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.026788+0000","last_change":"2024-04-24T13:35:09.026842+0000","last_active":"2024-04-24T13:35:09.026788+0000","last_peered":"2024-04-24T13:35:09.026788+0000","last_clean":"2024-04-24T13:35:09.026788+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:35:09.026788+0000","last_undegraded":"2024-04-24T13:35:09.026788+0000","last_fullsized":"2024-04-24T13:35:09.026788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:09.026590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:09.026590+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.026590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:13:25.194287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"150'32","reported_seq":300,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.462038+0000","last_change":"2024-04-24T13:30:21.229473+0000","last_active":"2024-04-24T13:34:47.462038+0000","last_peered":"2024-04-24T13:34:47.462038+0000","last_clean":"2024-04-24T13:34:47.462038+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:34:47.462038+0000","last_undegraded":"2024-04-24T13:34:47.462038+0000","last_fullsized":"2024-04-24T13:34:47.462038+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"105'8","reported_seq":305,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.544556+0000","last_change":"2024-04-24T13:35:09.544616+0000","last_active":"2024-04-24T13:35:09.544556+0000","last_peered":"2024-04-24T13:35:09.544556+0000","last_clean":"2024-04-24T13:35:09.544556+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:35:09.544556+0000","last_undegraded":"2024-04-24T13:35:09.544556+0000","last_fullsized":"2024-04-24T13:35:09.544556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'8","last_scrub_stamp":"2024-04-24T13:35:09.544356+0000","last_deep_scrub":"105'8","last_deep_scrub_stamp":"2024-04-24T13:35:09.544356+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.544356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:53:58.805158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"150'56","reported_seq":178,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.383364+0000","last_change":"2024-04-24T13:35:00.383434+0000","last_active":"2024-04-24T13:35:00.383364+0000","last_peered":"2024-04-24T13:35:00.383364+0000","last_clean":"2024-04-24T13:35:00.383364+0000","last_became_active":"2024-04-24T13:33:08.716282+0000","last_became_peered":"2024-04-24T13:33:08.716282+0000","last_unstale":"2024-04-24T13:35:00.383364+0000","last_undegraded":"2024-04-24T13:35:00.383364+0000","last_fullsized":"2024-04-24T13:35:00.383364+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'56","last_scrub_stamp":"2024-04-24T13:35:00.383169+0000","last_deep_scrub":"150'56","last_deep_scrub_stamp":"2024-04-24T13:35:00.383169+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.383169+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:39:53.504058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":280,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.538100+0000","last_change":"2024-04-24T13:30:23.219200+0000","last_active":"2024-04-24T13:34:52.538100+0000","last_peered":"2024-04-24T13:34:52.538100+0000","last_clean":"2024-04-24T13:34:52.538100+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:34:52.538100+0000","last_undegraded":"2024-04-24T13:34:52.538100+0000","last_fullsized":"2024-04-24T13:34:52.538100+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"150'56","reported_seq":324,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.058840+0000","last_change":"2024-04-24T13:30:21.228535+0000","last_active":"2024-04-24T13:34:52.058840+0000","last_peered":"2024-04-24T13:34:52.058840+0000","last_clean":"2024-04-24T13:34:52.058840+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:34:52.058840+0000","last_undegraded":"2024-04-24T13:34:52.058840+0000","last_fullsized":"2024-04-24T13:34:52.058840+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":269,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.952879+0000","last_change":"2024-04-24T13:35:02.952936+0000","last_active":"2024-04-24T13:35:02.952879+0000","last_peered":"2024-04-24T13:35:02.952879+0000","last_clean":"2024-04-24T13:35:02.952879+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:35:02.952879+0000","last_undegraded":"2024-04-24T13:35:02.952879+0000","last_fullsized":"2024-04-24T13:35:02.952879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:02.952675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:02.952675+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.952675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:31:59.597641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"150'44","reported_seq":187,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.573335+0000","last_change":"2024-04-24T13:33:51.593184+0000","last_active":"2024-04-24T13:34:47.573335+0000","last_peered":"2024-04-24T13:34:47.573335+0000","last_clean":"2024-04-24T13:34:47.573335+0000","last_became_active":"2024-04-24T13:33:49.289463+0000","last_became_peered":"2024-04-24T13:33:49.289463+0000","last_unstale":"2024-04-24T13:34:47.573335+0000","last_undegraded":"2024-04-24T13:34:47.573335+0000","last_fullsized":"2024-04-24T13:34:47.573335+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"82'6","reported_seq":296,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.470726+0000","last_change":"2024-04-24T13:35:01.470796+0000","last_active":"2024-04-24T13:35:01.470726+0000","last_peered":"2024-04-24T13:35:01.470726+0000","last_clean":"2024-04-24T13:35:01.470726+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:35:01.470726+0000","last_undegraded":"2024-04-24T13:35:01.470726+0000","last_fullsized":"2024-04-24T13:35:01.470726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-24T13:35:01.470497+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-24T13:35:01.470497+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.470497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:21.288445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"150'48","reported_seq":360,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:50.704305+0000","last_change":"2024-04-24T13:33:52.627571+0000","last_active":"2024-04-24T13:34:50.704305+0000","last_peered":"2024-04-24T13:34:50.704305+0000","last_clean":"2024-04-24T13:34:50.704305+0000","last_became_active":"2024-04-24T13:33:49.302184+0000","last_became_peered":"2024-04-24T13:33:49.302184+0000","last_unstale":"2024-04-24T13:34:50.704305+0000","last_undegraded":"2024-04-24T13:34:50.704305+0000","last_fullsized":"2024-04-24T13:34:50.704305+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":69206016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"82'2","reported_seq":62,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:35.669750+0000","last_change":"2024-04-24T13:33:53.884916+0000","last_active":"2024-04-24T13:34:35.669750+0000","last_peered":"2024-04-24T13:34:35.669750+0000","last_clean":"2024-04-24T13:34:35.669750+0000","last_became_active":"2024-04-24T13:33:49.300182+0000","last_became_peered":"2024-04-24T13:33:49.300182+0000","last_unstale":"2024-04-24T13:34:35.669750+0000","last_undegraded":"2024-04-24T13:34:35.669750+0000","last_fullsized":"2024-04-24T13:34:35.669750+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"150'60","reported_seq":332,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.029060+0000","last_change":"2024-04-24T13:35:05.029124+0000","last_active":"2024-04-24T13:35:05.029060+0000","last_peered":"2024-04-24T13:35:05.029060+0000","last_clean":"2024-04-24T13:35:05.029060+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:35:05.029060+0000","last_undegraded":"2024-04-24T13:35:05.029060+0000","last_fullsized":"2024-04-24T13:35:05.029060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'60","last_scrub_stamp":"2024-04-24T13:35:05.028864+0000","last_deep_scrub":"150'60","last_deep_scrub_stamp":"2024-04-24T13:35:05.028864+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.028864+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:17:06.420743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"82'4","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.572499+0000","last_change":"2024-04-24T13:35:07.572562+0000","last_active":"2024-04-24T13:35:07.572499+0000","last_peered":"2024-04-24T13:35:07.572499+0000","last_clean":"2024-04-24T13:35:07.572499+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:35:07.572499+0000","last_undegraded":"2024-04-24T13:35:07.572499+0000","last_fullsized":"2024-04-24T13:35:07.572499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:35:07.572291+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:35:07.572291+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.572291+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:57.988388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"150'34","reported_seq":107,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.597124+0000","last_change":"2024-04-24T13:33:54.184096+0000","last_active":"2024-04-24T13:34:47.597124+0000","last_peered":"2024-04-24T13:34:47.597124+0000","last_clean":"2024-04-24T13:34:47.597124+0000","last_became_active":"2024-04-24T13:33:49.299554+0000","last_became_peered":"2024-04-24T13:33:49.299554+0000","last_unstale":"2024-04-24T13:34:47.597124+0000","last_undegraded":"2024-04-24T13:34:47.597124+0000","last_fullsized":"2024-04-24T13:34:47.597124+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"82'2","reported_seq":273,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.058976+0000","last_change":"2024-04-24T13:30:23.213821+0000","last_active":"2024-04-24T13:34:52.058976+0000","last_peered":"2024-04-24T13:34:52.058976+0000","last_clean":"2024-04-24T13:34:52.058976+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:34:52.058976+0000","last_undegraded":"2024-04-24T13:34:52.058976+0000","last_fullsized":"2024-04-24T13:34:52.058976+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"150'36","reported_seq":309,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.852719+0000","last_change":"2024-04-24T13:34:57.852719+0000","last_active":"2024-04-24T13:34:57.852719+0000","last_peered":"2024-04-24T13:34:57.852719+0000","last_clean":"2024-04-24T13:34:57.852719+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:34:57.852719+0000","last_undegraded":"2024-04-24T13:34:57.852719+0000","last_fullsized":"2024-04-24T13:34:57.852719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'36","last_scrub_stamp":"2024-04-24T13:34:57.852461+0000","last_deep_scrub":"150'36","last_deep_scrub_stamp":"2024-04-24T13:34:57.852461+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.852461+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:14:47.988866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.370227+0000","last_change":"2024-04-24T13:35:10.370291+0000","last_active":"2024-04-24T13:35:10.370227+0000","last_peered":"2024-04-24T13:35:10.370227+0000","last_clean":"2024-04-24T13:35:10.370227+0000","last_became_active":"2024-04-24T13:33:49.300135+0000","last_became_peered":"2024-04-24T13:33:49.300135+0000","last_unstale":"2024-04-24T13:35:10.370227+0000","last_undegraded":"2024-04-24T13:35:10.370227+0000","last_fullsized":"2024-04-24T13:35:10.370227+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:10.370024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:10.370024+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.370024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:17:40.820652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"150'48","reported_seq":202,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:47.601674+0000","last_change":"2024-04-24T13:33:53.222020+0000","last_active":"2024-04-24T13:34:47.601674+0000","last_peered":"2024-04-24T13:34:47.601674+0000","last_clean":"2024-04-24T13:34:47.601674+0000","last_became_active":"2024-04-24T13:33:49.292734+0000","last_became_peered":"2024-04-24T13:33:49.292734+0000","last_unstale":"2024-04-24T13:34:47.601674+0000","last_undegraded":"2024-04-24T13:34:47.601674+0000","last_fullsized":"2024-04-24T13:34:47.601674+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:20.173947+0000","last_clean_scrub_stamp":"2024-04-24T13:30:20.173947+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"150'50","reported_seq":173,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.431409+0000","last_change":"2024-04-24T13:34:57.431582+0000","last_active":"2024-04-24T13:34:57.431409+0000","last_peered":"2024-04-24T13:34:57.431409+0000","last_clean":"2024-04-24T13:34:57.431409+0000","last_became_active":"2024-04-24T13:33:08.735696+0000","last_became_peered":"2024-04-24T13:33:08.735696+0000","last_unstale":"2024-04-24T13:34:57.431409+0000","last_undegraded":"2024-04-24T13:34:57.431409+0000","last_fullsized":"2024-04-24T13:34:57.431409+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'50","last_scrub_stamp":"2024-04-24T13:34:57.431130+0000","last_deep_scrub":"150'50","last_deep_scrub_stamp":"2024-04-24T13:34:57.431130+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.431130+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:33.398026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"82'2","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.594971+0000","last_change":"2024-04-24T13:35:11.594971+0000","last_active":"2024-04-24T13:35:11.594971+0000","last_peered":"2024-04-24T13:35:11.594971+0000","last_clean":"2024-04-24T13:35:11.594971+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:35:11.594971+0000","last_undegraded":"2024-04-24T13:35:11.594971+0000","last_fullsized":"2024-04-24T13:35:11.594971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:11.594694+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:11.594694+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.594694+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:20.362486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"150'34","reported_seq":310,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.966613+0000","last_change":"2024-04-24T13:35:10.966745+0000","last_active":"2024-04-24T13:35:10.966613+0000","last_peered":"2024-04-24T13:35:10.966613+0000","last_clean":"2024-04-24T13:35:10.966613+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:35:10.966613+0000","last_undegraded":"2024-04-24T13:35:10.966613+0000","last_fullsized":"2024-04-24T13:35:10.966613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'34","last_scrub_stamp":"2024-04-24T13:35:10.966383+0000","last_deep_scrub":"150'34","last_deep_scrub_stamp":"2024-04-24T13:35:10.966383+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.966383+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:57.415764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"82'6","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:34.595532+0000","last_change":"2024-04-24T13:33:09.917888+0000","last_active":"2024-04-24T13:34:34.595532+0000","last_peered":"2024-04-24T13:34:34.595532+0000","last_clean":"2024-04-24T13:34:34.595532+0000","last_became_active":"2024-04-24T13:33:08.732489+0000","last_became_peered":"2024-04-24T13:33:08.732489+0000","last_unstale":"2024-04-24T13:34:34.595532+0000","last_undegraded":"2024-04-24T13:34:34.595532+0000","last_fullsized":"2024-04-24T13:34:34.595532+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:30:22.188511+0000","last_clean_scrub_stamp":"2024-04-24T13:30:22.188511+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":342,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":194,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1115,"ondisk_log_size":1115,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":27618,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1055,"num_read_kb":1534,"num_write":541,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":143,"num_bytes_recovered":62549,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":982,"ondisk_log_size":982,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":349,"num_read_kb":349,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2233,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":10,"ondisk_log_size":10,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1458,"num_read_kb":1426,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":449,"num_bytes_recovered":1849688064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":117,"ondisk_log_size":117,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574913,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41888,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329952,"statfs":{"total":96636764160,"available":96593870848,"internally_reserved":0,"allocated":2449408,"data_stored":1687559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574913,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37124,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334716,"statfs":{"total":96636764160,"available":96598749184,"internally_reserved":0,"allocated":1830912,"data_stored":1096531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574914,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37176,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334664,"statfs":{"total":96636764160,"available":96598695936,"internally_reserved":0,"allocated":1884160,"data_stored":1098788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574914,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37112,"kb_used_data":1776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334728,"statfs":{"total":96636764160,"available":96598761472,"internally_reserved":0,"allocated":1818624,"data_stored":1096029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574913,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37144,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334696,"statfs":{"total":96636764160,"available":96598728704,"internally_reserved":0,"allocated":1851392,"data_stored":1097220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574914,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37120,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334720,"statfs":{"total":96636764160,"available":96598753280,"internally_reserved":0,"allocated":1826816,"data_stored":1096214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574915,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37152,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334688,"statfs":{"total":96636764160,"available":96598720512,"internally_reserved":0,"allocated":1859584,"data_stored":1098602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574914,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37708,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334132,"statfs":{"total":96636764160,"available":96598151168,"internally_reserved":0,"allocated":2428928,"data_stored":1686965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:35:14.680 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.680 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.680 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.680 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.680 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.680 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.680 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.681 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.681 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.681 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.681 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.681 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.681 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.681 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.682 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.682 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.682 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.682 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.682 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.682 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.682 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.682 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.682 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.683 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.683 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.683 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.683 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.683 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.683 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.683 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.684 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.684 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.684 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.684 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.684 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.684 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.685 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.685 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.685 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-04-24T13:30:07.758813+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=7, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.685 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.685 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.685 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.685 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.685 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-04-24T13:30:14.128704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.686 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.686 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.686 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.686 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.686 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.686 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.687 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-04-24T13:30:14.128704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.687 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.687 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.687 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.687 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-04-24T13:30:14.128704+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=14, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.687 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.687 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.687 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.688 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.688 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.688 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.688 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.688 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.688 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.688 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.688 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.689 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.689 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.689 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.689 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.689 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.689 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.689 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.690 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.690 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.690 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.690 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.690 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.690 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-04-24T13:30:28.227376+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=28, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.690 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.691 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.691 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.691 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-04-24T13:30:24.195553+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=24, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.691 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-04-24T13:30:26.202712+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=26, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.691 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-04-24T13:30:30.233088+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=30, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.692 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.692 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.692 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.692 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.692 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.692 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.692 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.692 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.692 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.693 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.693 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.693 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.693 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.693 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.693 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.693 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-04-24T13:30:20.173947+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=20, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.693 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-04-24T13:30:22.188511+0000 time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=30, tm_sec=22, tm_wday=2, tm_yday=115, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=4, tm_mday=24, tm_hour=13, tm_min=34, tm_sec=49, tm_wday=2, tm_yday=115, tm_isdst=0) 2024-04-24T13:35:14.693 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-04-24T13:35:34.694 DEBUG:teuthology.orchestra.run.smithi071:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-04-24T13:35:35.054 INFO:teuthology.orchestra.run.smithi071.stdout: 2024-04-24T13:35:35.061 INFO:teuthology.orchestra.run.smithi071.stderr:dumped all 2024-04-24T13:35:35.070 INFO:teuthology.orchestra.run.smithi071.stdout:{"pg_ready":true,"pg_map":{"version":306,"stamp":"2024-04-24T13:35:33.354133+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":620002,"num_objects":198,"num_object_clones":0,"num_object_copies":396,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":198,"num_whiteouts":0,"num_read":4876,"num_read_kb":3775,"num_write":4425,"num_write_kb":6187918,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":669,"num_bytes_recovered":1850933776,"num_keys_recovered":21,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5709,"ondisk_log_size":5709,"up":530,"acting":530,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":530,"num_osds":8,"num_per_pool_osds":8,"num_per_pool_omap_osds":8,"kb":754974720,"kb_used":302424,"kb_used_data":15576,"kb_used_omap":12,"kb_used_meta":286771,"kb_avail":754672296,"statfs":{"total":773094113280,"available":772784431104,"internally_reserved":0,"allocated":15949824,"data_stored":9957908,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":12751,"internal_metadata":293654065},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.005894"},"pg_stats":[{"pgid":"3.3f","version":"150'36","reported_seq":119,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.226168+0000","last_change":"2024-04-24T13:35:01.226314+0000","last_active":"2024-04-24T13:35:01.226168+0000","last_peered":"2024-04-24T13:35:01.226168+0000","last_clean":"2024-04-24T13:35:01.226168+0000","last_became_active":"2024-04-24T13:33:49.293106+0000","last_became_peered":"2024-04-24T13:33:49.293106+0000","last_unstale":"2024-04-24T13:35:01.226168+0000","last_undegraded":"2024-04-24T13:35:01.226168+0000","last_fullsized":"2024-04-24T13:35:01.226168+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'36","last_scrub_stamp":"2024-04-24T13:35:01.225933+0000","last_deep_scrub":"150'36","last_deep_scrub_stamp":"2024-04-24T13:35:01.225933+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.225933+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:56:45.227717+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":15,"num_bytes_recovered":62914560,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.38","version":"82'14","reported_seq":319,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:19.434726+0000","last_change":"2024-04-24T13:35:19.434726+0000","last_active":"2024-04-24T13:35:19.434726+0000","last_peered":"2024-04-24T13:35:19.434726+0000","last_clean":"2024-04-24T13:35:19.434726+0000","last_became_active":"2024-04-24T13:30:23.225294+0000","last_became_peered":"2024-04-24T13:30:23.225294+0000","last_unstale":"2024-04-24T13:35:19.434726+0000","last_undegraded":"2024-04-24T13:35:19.434726+0000","last_fullsized":"2024-04-24T13:35:19.434726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'14","last_scrub_stamp":"2024-04-24T13:35:19.434456+0000","last_deep_scrub":"82'14","last_deep_scrub_stamp":"2024-04-24T13:35:19.434456+0000","last_clean_scrub_stamp":"2024-04-24T13:35:19.434456+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:18:37.719990+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":65,"num_read_kb":61,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3e","version":"150'36","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.008461+0000","last_change":"2024-04-24T13:35:10.008487+0000","last_active":"2024-04-24T13:35:10.008461+0000","last_peered":"2024-04-24T13:35:10.008461+0000","last_clean":"2024-04-24T13:35:10.008461+0000","last_became_active":"2024-04-24T13:30:21.212767+0000","last_became_peered":"2024-04-24T13:30:21.212767+0000","last_unstale":"2024-04-24T13:35:10.008461+0000","last_undegraded":"2024-04-24T13:35:10.008461+0000","last_fullsized":"2024-04-24T13:35:10.008461+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'36","last_scrub_stamp":"2024-04-24T13:35:10.008378+0000","last_deep_scrub":"150'36","last_deep_scrub_stamp":"2024-04-24T13:35:10.008378+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.008378+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:05:05.565013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.39","version":"82'4","reported_seq":72,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.294798+0000","last_change":"2024-04-24T13:35:07.294860+0000","last_active":"2024-04-24T13:35:07.294798+0000","last_peered":"2024-04-24T13:35:07.294798+0000","last_clean":"2024-04-24T13:35:07.294798+0000","last_became_active":"2024-04-24T13:33:49.293840+0000","last_became_peered":"2024-04-24T13:33:49.293840+0000","last_unstale":"2024-04-24T13:35:07.294798+0000","last_undegraded":"2024-04-24T13:35:07.294798+0000","last_fullsized":"2024-04-24T13:35:07.294798+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:35:07.294597+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:35:07.294597+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.294597+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:31:56.944623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.3d","version":"150'32","reported_seq":307,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:14.592736+0000","last_change":"2024-04-24T13:35:14.592884+0000","last_active":"2024-04-24T13:35:14.592736+0000","last_peered":"2024-04-24T13:35:14.592736+0000","last_clean":"2024-04-24T13:35:14.592736+0000","last_became_active":"2024-04-24T13:30:21.211772+0000","last_became_peered":"2024-04-24T13:30:21.211772+0000","last_unstale":"2024-04-24T13:35:14.592736+0000","last_undegraded":"2024-04-24T13:35:14.592736+0000","last_fullsized":"2024-04-24T13:35:14.592736+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'32","last_scrub_stamp":"2024-04-24T13:35:14.592512+0000","last_deep_scrub":"150'32","last_deep_scrub_stamp":"2024-04-24T13:35:14.592512+0000","last_clean_scrub_stamp":"2024-04-24T13:35:14.592512+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:07:09.675537+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":3,"num_write":42,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3a","version":"0'0","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:17.557440+0000","last_change":"2024-04-24T13:35:17.557440+0000","last_active":"2024-04-24T13:35:17.557440+0000","last_peered":"2024-04-24T13:35:17.557440+0000","last_clean":"2024-04-24T13:35:17.557440+0000","last_became_active":"2024-04-24T13:30:23.219873+0000","last_became_peered":"2024-04-24T13:30:23.219873+0000","last_unstale":"2024-04-24T13:35:17.557440+0000","last_undegraded":"2024-04-24T13:35:17.557440+0000","last_fullsized":"2024-04-24T13:35:17.557440+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:17.557194+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:17.557194+0000","last_clean_scrub_stamp":"2024-04-24T13:35:17.557194+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:16:13.682124+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.3c","version":"150'50","reported_seq":328,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:18.407997+0000","last_change":"2024-04-24T13:35:18.408063+0000","last_active":"2024-04-24T13:35:18.407997+0000","last_peered":"2024-04-24T13:35:18.407997+0000","last_clean":"2024-04-24T13:35:18.407997+0000","last_became_active":"2024-04-24T13:30:21.229245+0000","last_became_peered":"2024-04-24T13:30:21.229245+0000","last_unstale":"2024-04-24T13:35:18.407997+0000","last_undegraded":"2024-04-24T13:35:18.407997+0000","last_fullsized":"2024-04-24T13:35:18.407997+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'50","last_scrub_stamp":"2024-04-24T13:35:18.407742+0000","last_deep_scrub":"150'50","last_deep_scrub_stamp":"2024-04-24T13:35:18.407742+0000","last_clean_scrub_stamp":"2024-04-24T13:35:18.407742+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:56:59.106604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3b","version":"132'6","reported_seq":296,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:20.502132+0000","last_change":"2024-04-24T13:35:20.502132+0000","last_active":"2024-04-24T13:35:20.502132+0000","last_peered":"2024-04-24T13:35:20.502132+0000","last_clean":"2024-04-24T13:35:20.502132+0000","last_became_active":"2024-04-24T13:30:23.215317+0000","last_became_peered":"2024-04-24T13:30:23.215317+0000","last_unstale":"2024-04-24T13:35:20.502132+0000","last_undegraded":"2024-04-24T13:35:20.502132+0000","last_fullsized":"2024-04-24T13:35:20.502132+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'6","last_scrub_stamp":"2024-04-24T13:35:20.501656+0000","last_deep_scrub":"132'6","last_deep_scrub_stamp":"2024-04-24T13:35:20.501656+0000","last_clean_scrub_stamp":"2024-04-24T13:35:20.501656+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:15:04.162478+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3b","version":"150'68","reported_seq":160,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:22.276528+0000","last_change":"2024-04-24T13:35:22.276595+0000","last_active":"2024-04-24T13:35:22.276528+0000","last_peered":"2024-04-24T13:35:22.276528+0000","last_clean":"2024-04-24T13:35:22.276528+0000","last_became_active":"2024-04-24T13:33:49.299781+0000","last_became_peered":"2024-04-24T13:33:49.299781+0000","last_unstale":"2024-04-24T13:35:22.276528+0000","last_undegraded":"2024-04-24T13:35:22.276528+0000","last_fullsized":"2024-04-24T13:35:22.276528+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'68","last_scrub_stamp":"2024-04-24T13:35:22.276335+0000","last_deep_scrub":"150'68","last_deep_scrub_stamp":"2024-04-24T13:35:22.276335+0000","last_clean_scrub_stamp":"2024-04-24T13:35:22.276335+0000","objects_scrubbed":0,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:21:52.426548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":0,"num_write":68,"num_write_kb":139264,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3c","version":"82'2","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.996180+0000","last_change":"2024-04-24T13:35:06.996241+0000","last_active":"2024-04-24T13:35:06.996180+0000","last_peered":"2024-04-24T13:35:06.996180+0000","last_clean":"2024-04-24T13:35:06.996180+0000","last_became_active":"2024-04-24T13:30:23.238275+0000","last_became_peered":"2024-04-24T13:30:23.238275+0000","last_unstale":"2024-04-24T13:35:06.996180+0000","last_undegraded":"2024-04-24T13:35:06.996180+0000","last_fullsized":"2024-04-24T13:35:06.996180+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:06.995954+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:06.995954+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.995954+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:01.656475+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.3a","version":"150'60","reported_seq":338,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:17.401276+0000","last_change":"2024-04-24T13:35:17.401276+0000","last_active":"2024-04-24T13:35:17.401276+0000","last_peered":"2024-04-24T13:35:17.401276+0000","last_clean":"2024-04-24T13:35:17.401276+0000","last_became_active":"2024-04-24T13:30:21.219338+0000","last_became_peered":"2024-04-24T13:30:21.219338+0000","last_unstale":"2024-04-24T13:35:17.401276+0000","last_undegraded":"2024-04-24T13:35:17.401276+0000","last_fullsized":"2024-04-24T13:35:17.401276+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'60","last_scrub_stamp":"2024-04-24T13:35:17.400913+0000","last_deep_scrub":"150'60","last_deep_scrub_stamp":"2024-04-24T13:35:17.400913+0000","last_clean_scrub_stamp":"2024-04-24T13:35:17.400913+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:10:27.949582+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.3d","version":"82'4","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.563925+0000","last_change":"2024-04-24T13:35:09.563988+0000","last_active":"2024-04-24T13:35:09.563925+0000","last_peered":"2024-04-24T13:35:09.563925+0000","last_clean":"2024-04-24T13:35:09.563925+0000","last_became_active":"2024-04-24T13:30:23.221948+0000","last_became_peered":"2024-04-24T13:30:23.221948+0000","last_unstale":"2024-04-24T13:35:09.563925+0000","last_undegraded":"2024-04-24T13:35:09.563925+0000","last_fullsized":"2024-04-24T13:35:09.563925+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:35:09.563714+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:35:09.563714+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.563714+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:44.889708+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.39","version":"150'58","reported_seq":147,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.219206+0000","last_change":"2024-04-24T13:34:58.219270+0000","last_active":"2024-04-24T13:34:58.219206+0000","last_peered":"2024-04-24T13:34:58.219206+0000","last_clean":"2024-04-24T13:34:58.219206+0000","last_became_active":"2024-04-24T13:33:49.287926+0000","last_became_peered":"2024-04-24T13:33:49.287926+0000","last_unstale":"2024-04-24T13:34:58.219206+0000","last_undegraded":"2024-04-24T13:34:58.219206+0000","last_fullsized":"2024-04-24T13:34:58.219206+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'58","last_scrub_stamp":"2024-04-24T13:34:58.218984+0000","last_deep_scrub":"150'58","last_deep_scrub_stamp":"2024-04-24T13:34:58.218984+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.218984+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:57:51.387743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":21,"num_bytes_recovered":88080384,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.3e","version":"82'2","reported_seq":116,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.366691+0000","last_change":"2024-04-24T13:35:10.366691+0000","last_active":"2024-04-24T13:35:10.366691+0000","last_peered":"2024-04-24T13:35:10.366691+0000","last_clean":"2024-04-24T13:35:10.366691+0000","last_became_active":"2024-04-24T13:33:08.725324+0000","last_became_peered":"2024-04-24T13:33:08.725324+0000","last_unstale":"2024-04-24T13:35:10.366691+0000","last_undegraded":"2024-04-24T13:35:10.366691+0000","last_fullsized":"2024-04-24T13:35:10.366691+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:10.366411+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:10.366411+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.366411+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:41:47.193558+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.38","version":"150'36","reported_seq":330,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.450367+0000","last_change":"2024-04-24T13:34:54.450367+0000","last_active":"2024-04-24T13:34:54.450367+0000","last_peered":"2024-04-24T13:34:54.450367+0000","last_clean":"2024-04-24T13:34:54.450367+0000","last_became_active":"2024-04-24T13:33:08.720200+0000","last_became_peered":"2024-04-24T13:33:08.720200+0000","last_unstale":"2024-04-24T13:34:54.450367+0000","last_undegraded":"2024-04-24T13:34:54.450367+0000","last_fullsized":"2024-04-24T13:34:54.450367+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'36","last_scrub_stamp":"2024-04-24T13:34:54.449991+0000","last_deep_scrub":"150'36","last_deep_scrub_stamp":"2024-04-24T13:34:54.449991+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.449991+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:40.899372+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":12582912,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3f","version":"82'6","reported_seq":294,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.925183+0000","last_change":"2024-04-24T13:35:00.925256+0000","last_active":"2024-04-24T13:35:00.925183+0000","last_peered":"2024-04-24T13:35:00.925183+0000","last_clean":"2024-04-24T13:35:00.925183+0000","last_became_active":"2024-04-24T13:30:23.221622+0000","last_became_peered":"2024-04-24T13:30:23.221622+0000","last_unstale":"2024-04-24T13:35:00.925183+0000","last_undegraded":"2024-04-24T13:35:00.925183+0000","last_fullsized":"2024-04-24T13:35:00.925183+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-24T13:35:00.924973+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-24T13:35:00.924973+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.924973+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:50.727839+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"86'4","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:18.569769+0000","last_change":"2024-04-24T13:35:18.569840+0000","last_active":"2024-04-24T13:35:18.569769+0000","last_peered":"2024-04-24T13:35:18.569769+0000","last_clean":"2024-04-24T13:35:18.569769+0000","last_became_active":"2024-04-24T13:30:23.222006+0000","last_became_peered":"2024-04-24T13:30:23.222006+0000","last_unstale":"2024-04-24T13:35:18.569769+0000","last_undegraded":"2024-04-24T13:35:18.569769+0000","last_fullsized":"2024-04-24T13:35:18.569769+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'4","last_scrub_stamp":"2024-04-24T13:35:18.569525+0000","last_deep_scrub":"86'4","last_deep_scrub_stamp":"2024-04-24T13:35:18.569525+0000","last_clean_scrub_stamp":"2024-04-24T13:35:18.569525+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:58.696240+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.37","version":"150'48","reported_seq":134,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.174566+0000","last_change":"2024-04-24T13:34:57.174625+0000","last_active":"2024-04-24T13:34:57.174566+0000","last_peered":"2024-04-24T13:34:57.174566+0000","last_clean":"2024-04-24T13:34:57.174566+0000","last_became_active":"2024-04-24T13:33:49.287950+0000","last_became_peered":"2024-04-24T13:33:49.287950+0000","last_unstale":"2024-04-24T13:34:57.174566+0000","last_undegraded":"2024-04-24T13:34:57.174566+0000","last_fullsized":"2024-04-24T13:34:57.174566+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'48","last_scrub_stamp":"2024-04-24T13:34:57.174382+0000","last_deep_scrub":"150'48","last_deep_scrub_stamp":"2024-04-24T13:34:57.174382+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.174382+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:16.992330+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.31","version":"82'4","reported_seq":72,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.176987+0000","last_change":"2024-04-24T13:34:55.177051+0000","last_active":"2024-04-24T13:34:55.176987+0000","last_peered":"2024-04-24T13:34:55.176987+0000","last_clean":"2024-04-24T13:34:55.176987+0000","last_became_active":"2024-04-24T13:33:49.294597+0000","last_became_peered":"2024-04-24T13:33:49.294597+0000","last_unstale":"2024-04-24T13:34:55.176987+0000","last_undegraded":"2024-04-24T13:34:55.176987+0000","last_fullsized":"2024-04-24T13:34:55.176987+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:34:55.176787+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:34:55.176787+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.176787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:35:03.816222+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.36","version":"150'54","reported_seq":355,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:14.010972+0000","last_change":"2024-04-24T13:35:14.011039+0000","last_active":"2024-04-24T13:35:14.010972+0000","last_peered":"2024-04-24T13:35:14.010972+0000","last_clean":"2024-04-24T13:35:14.010972+0000","last_became_active":"2024-04-24T13:33:08.726581+0000","last_became_peered":"2024-04-24T13:33:08.726581+0000","last_unstale":"2024-04-24T13:35:14.010972+0000","last_undegraded":"2024-04-24T13:35:14.010972+0000","last_fullsized":"2024-04-24T13:35:14.010972+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'54","last_scrub_stamp":"2024-04-24T13:35:14.010774+0000","last_deep_scrub":"150'54","last_deep_scrub_stamp":"2024-04-24T13:35:14.010774+0000","last_clean_scrub_stamp":"2024-04-24T13:35:14.010774+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:26:28.459997+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.32","version":"86'6","reported_seq":120,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.331568+0000","last_change":"2024-04-24T13:35:04.331568+0000","last_active":"2024-04-24T13:35:04.331568+0000","last_peered":"2024-04-24T13:35:04.331568+0000","last_clean":"2024-04-24T13:35:04.331568+0000","last_became_active":"2024-04-24T13:33:08.719391+0000","last_became_peered":"2024-04-24T13:33:08.719391+0000","last_unstale":"2024-04-24T13:35:04.331568+0000","last_undegraded":"2024-04-24T13:35:04.331568+0000","last_fullsized":"2024-04-24T13:35:04.331568+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'6","last_scrub_stamp":"2024-04-24T13:35:04.331308+0000","last_deep_scrub":"86'6","last_deep_scrub_stamp":"2024-04-24T13:35:04.331308+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.331308+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:35:23.731759+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.35","version":"150'44","reported_seq":338,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:15.049898+0000","last_change":"2024-04-24T13:35:15.049962+0000","last_active":"2024-04-24T13:35:15.049898+0000","last_peered":"2024-04-24T13:35:15.049898+0000","last_clean":"2024-04-24T13:35:15.049898+0000","last_became_active":"2024-04-24T13:33:08.737789+0000","last_became_peered":"2024-04-24T13:33:08.737789+0000","last_unstale":"2024-04-24T13:35:15.049898+0000","last_undegraded":"2024-04-24T13:35:15.049898+0000","last_fullsized":"2024-04-24T13:35:15.049898+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'44","last_scrub_stamp":"2024-04-24T13:35:15.049694+0000","last_deep_scrub":"150'44","last_deep_scrub_stamp":"2024-04-24T13:35:15.049694+0000","last_clean_scrub_stamp":"2024-04-24T13:35:15.049694+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:01.499075+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":20971520,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.33","version":"0'0","reported_seq":269,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.871846+0000","last_change":"2024-04-24T13:34:58.871846+0000","last_active":"2024-04-24T13:34:58.871846+0000","last_peered":"2024-04-24T13:34:58.871846+0000","last_clean":"2024-04-24T13:34:58.871846+0000","last_became_active":"2024-04-24T13:30:23.213246+0000","last_became_peered":"2024-04-24T13:30:23.213246+0000","last_unstale":"2024-04-24T13:34:58.871846+0000","last_undegraded":"2024-04-24T13:34:58.871846+0000","last_fullsized":"2024-04-24T13:34:58.871846+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:58.871425+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:58.871425+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.871425+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:41:50.511735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.34","version":"150'48","reported_seq":322,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:14.585719+0000","last_change":"2024-04-24T13:35:14.585789+0000","last_active":"2024-04-24T13:35:14.585719+0000","last_peered":"2024-04-24T13:35:14.585719+0000","last_clean":"2024-04-24T13:35:14.585719+0000","last_became_active":"2024-04-24T13:30:21.227602+0000","last_became_peered":"2024-04-24T13:30:21.227602+0000","last_unstale":"2024-04-24T13:35:14.585719+0000","last_undegraded":"2024-04-24T13:35:14.585719+0000","last_fullsized":"2024-04-24T13:35:14.585719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'48","last_scrub_stamp":"2024-04-24T13:35:14.585504+0000","last_deep_scrub":"150'48","last_deep_scrub_stamp":"2024-04-24T13:35:14.585504+0000","last_clean_scrub_stamp":"2024-04-24T13:35:14.585504+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:17:45.036132+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.34","version":"132'6","reported_seq":295,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.945654+0000","last_change":"2024-04-24T13:35:01.945654+0000","last_active":"2024-04-24T13:35:01.945654+0000","last_peered":"2024-04-24T13:35:01.945654+0000","last_clean":"2024-04-24T13:35:01.945654+0000","last_became_active":"2024-04-24T13:30:23.223442+0000","last_became_peered":"2024-04-24T13:30:23.223442+0000","last_unstale":"2024-04-24T13:35:01.945654+0000","last_undegraded":"2024-04-24T13:35:01.945654+0000","last_fullsized":"2024-04-24T13:35:01.945654+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'6","last_scrub_stamp":"2024-04-24T13:35:01.945211+0000","last_deep_scrub":"132'6","last_deep_scrub_stamp":"2024-04-24T13:35:01.945211+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.945211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:16.094866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"150'46","reported_seq":322,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:19.506755+0000","last_change":"2024-04-24T13:35:19.506813+0000","last_active":"2024-04-24T13:35:19.506755+0000","last_peered":"2024-04-24T13:35:19.506755+0000","last_clean":"2024-04-24T13:35:19.506755+0000","last_became_active":"2024-04-24T13:30:21.225080+0000","last_became_peered":"2024-04-24T13:30:21.225080+0000","last_unstale":"2024-04-24T13:35:19.506755+0000","last_undegraded":"2024-04-24T13:35:19.506755+0000","last_fullsized":"2024-04-24T13:35:19.506755+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'46","last_scrub_stamp":"2024-04-24T13:35:19.506559+0000","last_deep_scrub":"150'46","last_deep_scrub_stamp":"2024-04-24T13:35:19.506559+0000","last_clean_scrub_stamp":"2024-04-24T13:35:19.506559+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:47:12.663610+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.35","version":"82'2","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.482405+0000","last_change":"2024-04-24T13:35:05.482405+0000","last_active":"2024-04-24T13:35:05.482405+0000","last_peered":"2024-04-24T13:35:05.482405+0000","last_clean":"2024-04-24T13:35:05.482405+0000","last_became_active":"2024-04-24T13:30:23.224638+0000","last_became_peered":"2024-04-24T13:30:23.224638+0000","last_unstale":"2024-04-24T13:35:05.482405+0000","last_undegraded":"2024-04-24T13:35:05.482405+0000","last_fullsized":"2024-04-24T13:35:05.482405+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:05.482094+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:05.482094+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.482094+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:56:49.483878+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.32","version":"150'50","reported_seq":324,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:18.525183+0000","last_change":"2024-04-24T13:35:18.525246+0000","last_active":"2024-04-24T13:35:18.525183+0000","last_peered":"2024-04-24T13:35:18.525183+0000","last_clean":"2024-04-24T13:35:18.525183+0000","last_became_active":"2024-04-24T13:30:21.215502+0000","last_became_peered":"2024-04-24T13:30:21.215502+0000","last_unstale":"2024-04-24T13:35:18.525183+0000","last_undegraded":"2024-04-24T13:35:18.525183+0000","last_fullsized":"2024-04-24T13:35:18.525183+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'50","last_scrub_stamp":"2024-04-24T13:35:18.524943+0000","last_deep_scrub":"150'50","last_deep_scrub_stamp":"2024-04-24T13:35:18.524943+0000","last_clean_scrub_stamp":"2024-04-24T13:35:18.524943+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:44:59.366281+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.18","version":"0'0","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.373644+0000","last_change":"2024-04-24T13:34:54.373644+0000","last_active":"2024-04-24T13:34:54.373644+0000","last_peered":"2024-04-24T13:34:54.373644+0000","last_clean":"2024-04-24T13:34:54.373644+0000","last_became_active":"2024-04-24T13:30:31.267999+0000","last_became_peered":"2024-04-24T13:30:31.267999+0000","last_unstale":"2024-04-24T13:34:54.373644+0000","last_undegraded":"2024-04-24T13:34:54.373644+0000","last_fullsized":"2024-04-24T13:34:54.373644+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:54.373367+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:54.373367+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.373367+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:01.234065+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.14","version":"82'2","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.474127+0000","last_change":"2024-04-24T13:35:07.474185+0000","last_active":"2024-04-24T13:35:07.474127+0000","last_peered":"2024-04-24T13:35:07.474127+0000","last_clean":"2024-04-24T13:35:07.474127+0000","last_became_active":"2024-04-24T13:30:23.227271+0000","last_became_peered":"2024-04-24T13:30:23.227271+0000","last_unstale":"2024-04-24T13:35:07.474127+0000","last_undegraded":"2024-04-24T13:35:07.474127+0000","last_fullsized":"2024-04-24T13:35:07.474127+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:07.473931+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:07.473931+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.473931+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:17:10.253234+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"150'52","reported_seq":139,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.280361+0000","last_change":"2024-04-24T13:35:06.280420+0000","last_active":"2024-04-24T13:35:06.280361+0000","last_peered":"2024-04-24T13:35:06.280361+0000","last_clean":"2024-04-24T13:35:06.280361+0000","last_became_active":"2024-04-24T13:33:49.282849+0000","last_became_peered":"2024-04-24T13:33:49.282849+0000","last_unstale":"2024-04-24T13:35:06.280361+0000","last_undegraded":"2024-04-24T13:35:06.280361+0000","last_fullsized":"2024-04-24T13:35:06.280361+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'52","last_scrub_stamp":"2024-04-24T13:35:06.280140+0000","last_deep_scrub":"150'52","last_deep_scrub_stamp":"2024-04-24T13:35:06.280140+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.280140+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:45:34.024975+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":20,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.15","version":"150'2","reported_seq":138,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.482658+0000","last_change":"2024-04-24T13:34:53.482789+0000","last_active":"2024-04-24T13:34:53.482658+0000","last_peered":"2024-04-24T13:34:53.482658+0000","last_clean":"2024-04-24T13:34:53.482658+0000","last_became_active":"2024-04-24T13:33:08.736087+0000","last_became_peered":"2024-04-24T13:33:08.736087+0000","last_unstale":"2024-04-24T13:34:53.482658+0000","last_undegraded":"2024-04-24T13:34:53.482658+0000","last_fullsized":"2024-04-24T13:34:53.482658+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2024-04-24T13:34:53.482424+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2024-04-24T13:34:53.482424+0000","last_clean_scrub_stamp":"2024-04-24T13:34:53.482424+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:29:02.989111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":993,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.16","version":"150'24","reported_seq":327,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:28.434638+0000","last_change":"2024-04-24T13:35:28.434711+0000","last_active":"2024-04-24T13:35:28.434638+0000","last_peered":"2024-04-24T13:35:28.434638+0000","last_clean":"2024-04-24T13:35:28.434638+0000","last_became_active":"2024-04-24T13:33:49.295172+0000","last_became_peered":"2024-04-24T13:33:49.295172+0000","last_unstale":"2024-04-24T13:35:28.434638+0000","last_undegraded":"2024-04-24T13:35:28.434638+0000","last_fullsized":"2024-04-24T13:35:28.434638+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'24","last_scrub_stamp":"2024-04-24T13:35:28.434452+0000","last_deep_scrub":"150'24","last_deep_scrub_stamp":"2024-04-24T13:35:28.434452+0000","last_clean_scrub_stamp":"2024-04-24T13:35:28.434452+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:40:25.402229+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:17.332097+0000","last_change":"2024-04-24T13:35:17.332153+0000","last_active":"2024-04-24T13:35:17.332097+0000","last_peered":"2024-04-24T13:35:17.332097+0000","last_clean":"2024-04-24T13:35:17.332097+0000","last_became_active":"2024-04-24T13:33:49.292611+0000","last_became_peered":"2024-04-24T13:33:49.292611+0000","last_unstale":"2024-04-24T13:35:17.332097+0000","last_undegraded":"2024-04-24T13:35:17.332097+0000","last_fullsized":"2024-04-24T13:35:17.332097+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:17.331865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:17.331865+0000","last_clean_scrub_stamp":"2024-04-24T13:35:17.331865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:43:38.847832+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.19","version":"150'49","reported_seq":132,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.364455+0000","last_change":"2024-04-24T13:35:05.364524+0000","last_active":"2024-04-24T13:35:05.364455+0000","last_peered":"2024-04-24T13:35:05.364455+0000","last_clean":"2024-04-24T13:35:05.364455+0000","last_became_active":"2024-04-24T13:33:08.709158+0000","last_became_peered":"2024-04-24T13:33:08.709158+0000","last_unstale":"2024-04-24T13:35:05.364455+0000","last_undegraded":"2024-04-24T13:35:05.364455+0000","last_fullsized":"2024-04-24T13:35:05.364455+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'49","last_scrub_stamp":"2024-04-24T13:35:05.364256+0000","last_deep_scrub":"150'49","last_deep_scrub_stamp":"2024-04-24T13:35:05.364256+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.364256+0000","objects_scrubbed":1,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:17:55.215315+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":113,"num_read_kb":113,"num_write":96,"num_write_kb":36,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.15","version":"82'4","reported_seq":128,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:30.480075+0000","last_change":"2024-04-24T13:35:30.480135+0000","last_active":"2024-04-24T13:35:30.480075+0000","last_peered":"2024-04-24T13:35:30.480075+0000","last_clean":"2024-04-24T13:35:30.480075+0000","last_became_active":"2024-04-24T13:33:49.302172+0000","last_became_peered":"2024-04-24T13:33:49.302172+0000","last_unstale":"2024-04-24T13:35:30.480075+0000","last_undegraded":"2024-04-24T13:35:30.480075+0000","last_fullsized":"2024-04-24T13:35:30.480075+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:35:30.479835+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:35:30.479835+0000","last_clean_scrub_stamp":"2024-04-24T13:35:30.479835+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:40:54.167215+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.12","version":"150'38","reported_seq":352,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:25.409928+0000","last_change":"2024-04-24T13:35:25.410059+0000","last_active":"2024-04-24T13:35:25.409928+0000","last_peered":"2024-04-24T13:35:25.409928+0000","last_clean":"2024-04-24T13:35:25.409928+0000","last_became_active":"2024-04-24T13:33:49.283461+0000","last_became_peered":"2024-04-24T13:33:49.283461+0000","last_unstale":"2024-04-24T13:35:25.409928+0000","last_undegraded":"2024-04-24T13:35:25.409928+0000","last_fullsized":"2024-04-24T13:35:25.409928+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'38","last_scrub_stamp":"2024-04-24T13:35:25.409632+0000","last_deep_scrub":"150'38","last_deep_scrub_stamp":"2024-04-24T13:35:25.409632+0000","last_clean_scrub_stamp":"2024-04-24T13:35:25.409632+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:57:02.590981+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":58720256,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:25.566072+0000","last_change":"2024-04-24T13:35:25.566124+0000","last_active":"2024-04-24T13:35:25.566072+0000","last_peered":"2024-04-24T13:35:25.566072+0000","last_clean":"2024-04-24T13:35:25.566072+0000","last_became_active":"2024-04-24T13:33:49.300648+0000","last_became_peered":"2024-04-24T13:33:49.300648+0000","last_unstale":"2024-04-24T13:35:25.566072+0000","last_undegraded":"2024-04-24T13:35:25.566072+0000","last_fullsized":"2024-04-24T13:35:25.566072+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:25.565879+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:25.565879+0000","last_clean_scrub_stamp":"2024-04-24T13:35:25.565879+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:10:36.114548+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.17","version":"150'9","reported_seq":274,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.555594+0000","last_change":"2024-04-24T13:35:08.555594+0000","last_active":"2024-04-24T13:35:08.555594+0000","last_peered":"2024-04-24T13:35:08.555594+0000","last_clean":"2024-04-24T13:35:08.555594+0000","last_became_active":"2024-04-24T13:30:27.245973+0000","last_became_peered":"2024-04-24T13:30:27.245973+0000","last_unstale":"2024-04-24T13:35:08.555594+0000","last_undegraded":"2024-04-24T13:35:08.555594+0000","last_fullsized":"2024-04-24T13:35:08.555594+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'9","last_scrub_stamp":"2024-04-24T13:35:08.555322+0000","last_deep_scrub":"150'9","last_deep_scrub_stamp":"2024-04-24T13:35:08.555322+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.555322+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:55.004703+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:20.562434+0000","last_change":"2024-04-24T13:35:20.562434+0000","last_active":"2024-04-24T13:35:20.562434+0000","last_peered":"2024-04-24T13:35:20.562434+0000","last_clean":"2024-04-24T13:35:20.562434+0000","last_became_active":"2024-04-24T13:30:29.266740+0000","last_became_peered":"2024-04-24T13:30:29.266740+0000","last_unstale":"2024-04-24T13:35:20.562434+0000","last_undegraded":"2024-04-24T13:35:20.562434+0000","last_fullsized":"2024-04-24T13:35:20.562434+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:20.562143+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:20.562143+0000","last_clean_scrub_stamp":"2024-04-24T13:35:20.562143+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:40:36.892066+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.1a","version":"0'0","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:12.585437+0000","last_change":"2024-04-24T13:35:12.585437+0000","last_active":"2024-04-24T13:35:12.585437+0000","last_peered":"2024-04-24T13:35:12.585437+0000","last_clean":"2024-04-24T13:35:12.585437+0000","last_became_active":"2024-04-24T13:30:31.263069+0000","last_became_peered":"2024-04-24T13:30:31.263069+0000","last_unstale":"2024-04-24T13:35:12.585437+0000","last_undegraded":"2024-04-24T13:35:12.585437+0000","last_fullsized":"2024-04-24T13:35:12.585437+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:12.585161+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:12.585161+0000","last_clean_scrub_stamp":"2024-04-24T13:35:12.585161+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:49.785431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"86'10","reported_seq":301,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:21.458461+0000","last_change":"2024-04-24T13:35:21.458527+0000","last_active":"2024-04-24T13:35:21.458461+0000","last_peered":"2024-04-24T13:35:21.458461+0000","last_clean":"2024-04-24T13:35:21.458461+0000","last_became_active":"2024-04-24T13:30:23.218944+0000","last_became_peered":"2024-04-24T13:30:23.218944+0000","last_unstale":"2024-04-24T13:35:21.458461+0000","last_undegraded":"2024-04-24T13:35:21.458461+0000","last_fullsized":"2024-04-24T13:35:21.458461+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'10","last_scrub_stamp":"2024-04-24T13:35:21.458263+0000","last_deep_scrub":"86'10","last_deep_scrub_stamp":"2024-04-24T13:35:21.458263+0000","last_clean_scrub_stamp":"2024-04-24T13:35:21.458263+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:29:17.394617+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.11","version":"150'48","reported_seq":135,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.237654+0000","last_change":"2024-04-24T13:35:04.237722+0000","last_active":"2024-04-24T13:35:04.237654+0000","last_peered":"2024-04-24T13:35:04.237654+0000","last_clean":"2024-04-24T13:35:04.237654+0000","last_became_active":"2024-04-24T13:33:49.286157+0000","last_became_peered":"2024-04-24T13:33:49.286157+0000","last_unstale":"2024-04-24T13:35:04.237654+0000","last_undegraded":"2024-04-24T13:35:04.237654+0000","last_fullsized":"2024-04-24T13:35:04.237654+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'48","last_scrub_stamp":"2024-04-24T13:35:04.237448+0000","last_deep_scrub":"150'48","last_deep_scrub_stamp":"2024-04-24T13:35:04.237448+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.237448+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:50.686829+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":79691776,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.495104+0000","last_change":"2024-04-24T13:35:05.495104+0000","last_active":"2024-04-24T13:35:05.495104+0000","last_peered":"2024-04-24T13:35:05.495104+0000","last_clean":"2024-04-24T13:35:05.495104+0000","last_became_active":"2024-04-24T13:30:25.231147+0000","last_became_peered":"2024-04-24T13:30:25.231147+0000","last_unstale":"2024-04-24T13:35:05.495104+0000","last_undegraded":"2024-04-24T13:35:05.495104+0000","last_fullsized":"2024-04-24T13:35:05.495104+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:05.494837+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:05.494837+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.494837+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:41.461732+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.14","version":"150'15","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.920434+0000","last_change":"2024-04-24T13:34:52.920434+0000","last_active":"2024-04-24T13:34:52.920434+0000","last_peered":"2024-04-24T13:34:52.920434+0000","last_clean":"2024-04-24T13:34:52.920434+0000","last_became_active":"2024-04-24T13:30:27.248260+0000","last_became_peered":"2024-04-24T13:30:27.248260+0000","last_unstale":"2024-04-24T13:34:52.920434+0000","last_undegraded":"2024-04-24T13:34:52.920434+0000","last_fullsized":"2024-04-24T13:34:52.920434+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'15","last_scrub_stamp":"2024-04-24T13:34:52.920291+0000","last_deep_scrub":"150'15","last_deep_scrub_stamp":"2024-04-24T13:34:52.920291+0000","last_clean_scrub_stamp":"2024-04-24T13:34:52.920291+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:42:41.154537+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"150'142","reported_seq":438,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.224437+0000","last_change":"2024-04-24T13:35:03.224501+0000","last_active":"2024-04-24T13:35:03.224437+0000","last_peered":"2024-04-24T13:35:03.224437+0000","last_clean":"2024-04-24T13:35:03.224437+0000","last_became_active":"2024-04-24T13:33:52.550123+0000","last_became_peered":"2024-04-24T13:33:52.550123+0000","last_unstale":"2024-04-24T13:35:03.224437+0000","last_undegraded":"2024-04-24T13:35:03.224437+0000","last_fullsized":"2024-04-24T13:35:03.224437+0000","mapping_epoch":127,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'142","last_scrub_stamp":"2024-04-24T13:35:03.224232+0000","last_deep_scrub":"150'142","last_deep_scrub_stamp":"2024-04-24T13:35:03.224232+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.224232+0000","objects_scrubbed":1,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:04:58.780867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1b","version":"105'8","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:23.599998+0000","last_change":"2024-04-24T13:35:23.599998+0000","last_active":"2024-04-24T13:35:23.599998+0000","last_peered":"2024-04-24T13:35:23.599998+0000","last_clean":"2024-04-24T13:35:23.599998+0000","last_became_active":"2024-04-24T13:30:31.995435+0000","last_became_peered":"2024-04-24T13:30:31.995435+0000","last_unstale":"2024-04-24T13:35:23.599998+0000","last_undegraded":"2024-04-24T13:35:23.599998+0000","last_fullsized":"2024-04-24T13:35:23.599998+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'8","last_scrub_stamp":"2024-04-24T13:35:23.599739+0000","last_deep_scrub":"105'8","last_deep_scrub_stamp":"2024-04-24T13:35:23.599739+0000","last_clean_scrub_stamp":"2024-04-24T13:35:23.599739+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:54:12.860541+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":20,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.17","version":"132'4","reported_seq":303,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:29.538696+0000","last_change":"2024-04-24T13:35:29.538758+0000","last_active":"2024-04-24T13:35:29.538696+0000","last_peered":"2024-04-24T13:35:29.538696+0000","last_clean":"2024-04-24T13:35:29.538696+0000","last_became_active":"2024-04-24T13:33:49.301591+0000","last_became_peered":"2024-04-24T13:33:49.301591+0000","last_unstale":"2024-04-24T13:35:29.538696+0000","last_undegraded":"2024-04-24T13:35:29.538696+0000","last_fullsized":"2024-04-24T13:35:29.538696+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'4","last_scrub_stamp":"2024-04-24T13:35:29.538496+0000","last_deep_scrub":"132'4","last_deep_scrub_stamp":"2024-04-24T13:35:29.538496+0000","last_clean_scrub_stamp":"2024-04-24T13:35:29.538496+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:48:16.087992+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.10","version":"150'54","reported_seq":326,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.061881+0000","last_change":"2024-04-24T13:35:04.061947+0000","last_active":"2024-04-24T13:35:04.061881+0000","last_peered":"2024-04-24T13:35:04.061881+0000","last_clean":"2024-04-24T13:35:04.061881+0000","last_became_active":"2024-04-24T13:30:21.220466+0000","last_became_peered":"2024-04-24T13:30:21.220466+0000","last_unstale":"2024-04-24T13:35:04.061881+0000","last_undegraded":"2024-04-24T13:35:04.061881+0000","last_fullsized":"2024-04-24T13:35:04.061881+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'54","last_scrub_stamp":"2024-04-24T13:35:04.061683+0000","last_deep_scrub":"150'54","last_deep_scrub_stamp":"2024-04-24T13:35:04.061683+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.061683+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:02:33.883567+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:13.406323+0000","last_change":"2024-04-24T13:35:13.406389+0000","last_active":"2024-04-24T13:35:13.406323+0000","last_peered":"2024-04-24T13:35:13.406323+0000","last_clean":"2024-04-24T13:35:13.406323+0000","last_became_active":"2024-04-24T13:33:08.716072+0000","last_became_peered":"2024-04-24T13:33:08.716072+0000","last_unstale":"2024-04-24T13:35:13.406323+0000","last_undegraded":"2024-04-24T13:35:13.406323+0000","last_fullsized":"2024-04-24T13:35:13.406323+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:13.406096+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:13.406096+0000","last_clean_scrub_stamp":"2024-04-24T13:35:13.406096+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:23:18.582864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.15","version":"150'23","reported_seq":87,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.334809+0000","last_change":"2024-04-24T13:35:11.334883+0000","last_active":"2024-04-24T13:35:11.334809+0000","last_peered":"2024-04-24T13:35:11.334809+0000","last_clean":"2024-04-24T13:35:11.334809+0000","last_became_active":"2024-04-24T13:33:49.294133+0000","last_became_peered":"2024-04-24T13:33:49.294133+0000","last_unstale":"2024-04-24T13:35:11.334809+0000","last_undegraded":"2024-04-24T13:35:11.334809+0000","last_fullsized":"2024-04-24T13:35:11.334809+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'23","last_scrub_stamp":"2024-04-24T13:35:11.334595+0000","last_deep_scrub":"150'23","last_deep_scrub_stamp":"2024-04-24T13:35:11.334595+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.334595+0000","objects_scrubbed":4,"log_size":23,"log_dups_size":0,"ondisk_log_size":23,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:31:57.453297+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.14","version":"150'139","reported_seq":479,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:24.585056+0000","last_change":"2024-04-24T13:35:24.585135+0000","last_active":"2024-04-24T13:35:24.585056+0000","last_peered":"2024-04-24T13:35:24.585056+0000","last_clean":"2024-04-24T13:35:24.585056+0000","last_became_active":"2024-04-24T13:30:29.278843+0000","last_became_peered":"2024-04-24T13:30:29.278843+0000","last_unstale":"2024-04-24T13:35:24.585056+0000","last_undegraded":"2024-04-24T13:35:24.585056+0000","last_fullsized":"2024-04-24T13:35:24.585056+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'139","last_scrub_stamp":"2024-04-24T13:35:24.584845+0000","last_deep_scrub":"150'139","last_deep_scrub_stamp":"2024-04-24T13:35:24.584845+0000","last_clean_scrub_stamp":"2024-04-24T13:35:24.584845+0000","objects_scrubbed":1,"log_size":139,"log_dups_size":0,"ondisk_log_size":139,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:06:13.406854+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.8","version":"82'2","reported_seq":125,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.312045+0000","last_change":"2024-04-24T13:35:03.312045+0000","last_active":"2024-04-24T13:35:03.312045+0000","last_peered":"2024-04-24T13:35:03.312045+0000","last_clean":"2024-04-24T13:35:03.312045+0000","last_became_active":"2024-04-24T13:33:49.278105+0000","last_became_peered":"2024-04-24T13:33:49.278105+0000","last_unstale":"2024-04-24T13:35:03.312045+0000","last_undegraded":"2024-04-24T13:35:03.312045+0000","last_fullsized":"2024-04-24T13:35:03.312045+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:03.311781+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:03.311781+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.311781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:02:38.151508+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.f","version":"150'50","reported_seq":131,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.191586+0000","last_change":"2024-04-24T13:34:54.191722+0000","last_active":"2024-04-24T13:34:54.191586+0000","last_peered":"2024-04-24T13:34:54.191586+0000","last_clean":"2024-04-24T13:34:54.191586+0000","last_became_active":"2024-04-24T13:33:49.297787+0000","last_became_peered":"2024-04-24T13:33:49.297787+0000","last_unstale":"2024-04-24T13:34:54.191586+0000","last_undegraded":"2024-04-24T13:34:54.191586+0000","last_fullsized":"2024-04-24T13:34:54.191586+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'50","last_scrub_stamp":"2024-04-24T13:34:54.191263+0000","last_deep_scrub":"150'50","last_deep_scrub_stamp":"2024-04-24T13:34:54.191263+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.191263+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:21:16.096435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":54525952,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:12.301062+0000","last_change":"2024-04-24T13:35:12.301121+0000","last_active":"2024-04-24T13:35:12.301062+0000","last_peered":"2024-04-24T13:35:12.301062+0000","last_clean":"2024-04-24T13:35:12.301062+0000","last_became_active":"2024-04-24T13:33:49.294593+0000","last_became_peered":"2024-04-24T13:33:49.294593+0000","last_unstale":"2024-04-24T13:35:12.301062+0000","last_undegraded":"2024-04-24T13:35:12.301062+0000","last_fullsized":"2024-04-24T13:35:12.301062+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:12.300862+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:12.300862+0000","last_clean_scrub_stamp":"2024-04-24T13:35:12.300862+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:29:21.807549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.a","version":"150'39","reported_seq":151,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.453689+0000","last_change":"2024-04-24T13:34:56.453689+0000","last_active":"2024-04-24T13:34:56.453689+0000","last_peered":"2024-04-24T13:34:56.453689+0000","last_clean":"2024-04-24T13:34:56.453689+0000","last_became_active":"2024-04-24T13:33:08.733302+0000","last_became_peered":"2024-04-24T13:33:08.733302+0000","last_unstale":"2024-04-24T13:34:56.453689+0000","last_undegraded":"2024-04-24T13:34:56.453689+0000","last_fullsized":"2024-04-24T13:34:56.453689+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'39","last_scrub_stamp":"2024-04-24T13:34:56.453395+0000","last_deep_scrub":"150'39","last_deep_scrub_stamp":"2024-04-24T13:34:56.453395+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.453395+0000","objects_scrubbed":9,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:36.580110+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":37,"num_read_kb":26,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,6],"acting":[5,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:15.061591+0000","last_change":"2024-04-24T13:35:15.061698+0000","last_active":"2024-04-24T13:35:15.061591+0000","last_peered":"2024-04-24T13:35:15.061591+0000","last_clean":"2024-04-24T13:35:15.061591+0000","last_became_active":"2024-04-24T13:33:08.726787+0000","last_became_peered":"2024-04-24T13:33:08.726787+0000","last_unstale":"2024-04-24T13:35:15.061591+0000","last_undegraded":"2024-04-24T13:35:15.061591+0000","last_fullsized":"2024-04-24T13:35:15.061591+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:15.061330+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:15.061330+0000","last_clean_scrub_stamp":"2024-04-24T13:35:15.061330+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:07:36.616678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.4","version":"86'7","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:20.480864+0000","last_change":"2024-04-24T13:35:20.480932+0000","last_active":"2024-04-24T13:35:20.480864+0000","last_peered":"2024-04-24T13:35:20.480864+0000","last_clean":"2024-04-24T13:35:20.480864+0000","last_became_active":"2024-04-24T13:30:31.267935+0000","last_became_peered":"2024-04-24T13:30:31.267935+0000","last_unstale":"2024-04-24T13:35:20.480864+0000","last_undegraded":"2024-04-24T13:35:20.480864+0000","last_fullsized":"2024-04-24T13:35:20.480864+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'7","last_scrub_stamp":"2024-04-24T13:35:20.480649+0000","last_deep_scrub":"86'7","last_deep_scrub_stamp":"2024-04-24T13:35:20.480649+0000","last_clean_scrub_stamp":"2024-04-24T13:35:20.480649+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:52:55.023532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":16,"num_write":22,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.9","version":"132'4","reported_seq":286,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:15.543964+0000","last_change":"2024-04-24T13:35:15.544024+0000","last_active":"2024-04-24T13:35:15.543964+0000","last_peered":"2024-04-24T13:35:15.543964+0000","last_clean":"2024-04-24T13:35:15.543964+0000","last_became_active":"2024-04-24T13:30:23.218241+0000","last_became_peered":"2024-04-24T13:30:23.218241+0000","last_unstale":"2024-04-24T13:35:15.543964+0000","last_undegraded":"2024-04-24T13:35:15.543964+0000","last_fullsized":"2024-04-24T13:35:15.543964+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'4","last_scrub_stamp":"2024-04-24T13:35:15.543722+0000","last_deep_scrub":"132'4","last_deep_scrub_stamp":"2024-04-24T13:35:15.543722+0000","last_clean_scrub_stamp":"2024-04-24T13:35:15.543722+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:32:01.662424+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.e","version":"150'34","reported_seq":112,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.179354+0000","last_change":"2024-04-24T13:35:02.179420+0000","last_active":"2024-04-24T13:35:02.179354+0000","last_peered":"2024-04-24T13:35:02.179354+0000","last_clean":"2024-04-24T13:35:02.179354+0000","last_became_active":"2024-04-24T13:33:49.284576+0000","last_became_peered":"2024-04-24T13:33:49.284576+0000","last_unstale":"2024-04-24T13:35:02.179354+0000","last_undegraded":"2024-04-24T13:35:02.179354+0000","last_fullsized":"2024-04-24T13:35:02.179354+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'34","last_scrub_stamp":"2024-04-24T13:35:02.179133+0000","last_deep_scrub":"150'34","last_deep_scrub_stamp":"2024-04-24T13:35:02.179133+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.179133+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:07:09.767658+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":265,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.865276+0000","last_change":"2024-04-24T13:34:55.865333+0000","last_active":"2024-04-24T13:34:55.865276+0000","last_peered":"2024-04-24T13:34:55.865276+0000","last_clean":"2024-04-24T13:34:55.865276+0000","last_became_active":"2024-04-24T13:30:25.232419+0000","last_became_peered":"2024-04-24T13:30:25.232419+0000","last_unstale":"2024-04-24T13:34:55.865276+0000","last_undegraded":"2024-04-24T13:34:55.865276+0000","last_fullsized":"2024-04-24T13:34:55.865276+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:55.865060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:55.865060+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.865060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:49.890422+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.b","version":"150'25","reported_seq":330,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:31.534134+0000","last_change":"2024-04-24T13:35:31.534222+0000","last_active":"2024-04-24T13:35:31.534134+0000","last_peered":"2024-04-24T13:35:31.534134+0000","last_clean":"2024-04-24T13:35:31.534134+0000","last_became_active":"2024-04-24T13:33:49.308018+0000","last_became_peered":"2024-04-24T13:33:49.308018+0000","last_unstale":"2024-04-24T13:35:31.534134+0000","last_undegraded":"2024-04-24T13:35:31.534134+0000","last_fullsized":"2024-04-24T13:35:31.534134+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'25","last_scrub_stamp":"2024-04-24T13:35:31.533924+0000","last_deep_scrub":"150'25","last_deep_scrub_stamp":"2024-04-24T13:35:31.533924+0000","last_clean_scrub_stamp":"2024-04-24T13:35:31.533924+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:35.965111+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:14.484635+0000","last_change":"2024-04-24T13:35:14.484690+0000","last_active":"2024-04-24T13:35:14.484635+0000","last_peered":"2024-04-24T13:35:14.484635+0000","last_clean":"2024-04-24T13:35:14.484635+0000","last_became_active":"2024-04-24T13:30:29.275081+0000","last_became_peered":"2024-04-24T13:30:29.275081+0000","last_unstale":"2024-04-24T13:35:14.484635+0000","last_undegraded":"2024-04-24T13:35:14.484635+0000","last_fullsized":"2024-04-24T13:35:14.484635+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:14.484444+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:14.484444+0000","last_clean_scrub_stamp":"2024-04-24T13:35:14.484444+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:38:50.953807+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.5","version":"0'0","reported_seq":252,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.042192+0000","last_change":"2024-04-24T13:34:58.042253+0000","last_active":"2024-04-24T13:34:58.042192+0000","last_peered":"2024-04-24T13:34:58.042192+0000","last_clean":"2024-04-24T13:34:58.042192+0000","last_became_active":"2024-04-24T13:30:31.283129+0000","last_became_peered":"2024-04-24T13:30:31.283129+0000","last_unstale":"2024-04-24T13:34:58.042192+0000","last_undegraded":"2024-04-24T13:34:58.042192+0000","last_fullsized":"2024-04-24T13:34:58.042192+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:58.042001+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:58.042001+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.042001+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:14:48.178406+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.a","version":"82'4","reported_seq":291,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.053295+0000","last_change":"2024-04-24T13:35:02.053359+0000","last_active":"2024-04-24T13:35:02.053295+0000","last_peered":"2024-04-24T13:35:02.053295+0000","last_clean":"2024-04-24T13:35:02.053295+0000","last_became_active":"2024-04-24T13:32:01.548259+0000","last_became_peered":"2024-04-24T13:32:01.548259+0000","last_unstale":"2024-04-24T13:35:02.053295+0000","last_undegraded":"2024-04-24T13:35:02.053295+0000","last_fullsized":"2024-04-24T13:35:02.053295+0000","mapping_epoch":75,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":76,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:35:02.053096+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:35:02.053096+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.053096+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:16.202751+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.d","version":"150'50","reported_seq":135,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.261907+0000","last_change":"2024-04-24T13:35:05.261976+0000","last_active":"2024-04-24T13:35:05.261907+0000","last_peered":"2024-04-24T13:35:05.261907+0000","last_clean":"2024-04-24T13:35:05.261907+0000","last_became_active":"2024-04-24T13:33:49.293373+0000","last_became_peered":"2024-04-24T13:33:49.293373+0000","last_unstale":"2024-04-24T13:35:05.261907+0000","last_undegraded":"2024-04-24T13:35:05.261907+0000","last_fullsized":"2024-04-24T13:35:05.261907+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'50","last_scrub_stamp":"2024-04-24T13:35:05.261684+0000","last_deep_scrub":"150'50","last_deep_scrub_stamp":"2024-04-24T13:35:05.261684+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.261684+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:40.587678+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":3,"num_write":60,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":27,"num_bytes_recovered":109051904,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":265,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.872381+0000","last_change":"2024-04-24T13:34:53.872381+0000","last_active":"2024-04-24T13:34:53.872381+0000","last_peered":"2024-04-24T13:34:53.872381+0000","last_clean":"2024-04-24T13:34:53.872381+0000","last_became_active":"2024-04-24T13:30:25.236109+0000","last_became_peered":"2024-04-24T13:30:25.236109+0000","last_unstale":"2024-04-24T13:34:53.872381+0000","last_undegraded":"2024-04-24T13:34:53.872381+0000","last_fullsized":"2024-04-24T13:34:53.872381+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:53.872137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:53.872137+0000","last_clean_scrub_stamp":"2024-04-24T13:34:53.872137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:05:02.126405+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.8","version":"150'33","reported_seq":97,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:23.290147+0000","last_change":"2024-04-24T13:35:23.290231+0000","last_active":"2024-04-24T13:35:23.290147+0000","last_peered":"2024-04-24T13:35:23.290147+0000","last_clean":"2024-04-24T13:35:23.290147+0000","last_became_active":"2024-04-24T13:33:49.302140+0000","last_became_peered":"2024-04-24T13:33:49.302140+0000","last_unstale":"2024-04-24T13:35:23.290147+0000","last_undegraded":"2024-04-24T13:35:23.290147+0000","last_fullsized":"2024-04-24T13:35:23.290147+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'33","last_scrub_stamp":"2024-04-24T13:35:23.289935+0000","last_deep_scrub":"150'33","last_deep_scrub_stamp":"2024-04-24T13:35:23.289935+0000","last_clean_scrub_stamp":"2024-04-24T13:35:23.289935+0000","objects_scrubbed":7,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:07:18.372960+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.9","version":"150'138","reported_seq":527,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.525227+0000","last_change":"2024-04-24T13:35:08.525370+0000","last_active":"2024-04-24T13:35:08.525227+0000","last_peered":"2024-04-24T13:35:08.525227+0000","last_clean":"2024-04-24T13:35:08.525227+0000","last_became_active":"2024-04-24T13:30:29.281034+0000","last_became_peered":"2024-04-24T13:30:29.281034+0000","last_unstale":"2024-04-24T13:35:08.525227+0000","last_undegraded":"2024-04-24T13:35:08.525227+0000","last_fullsized":"2024-04-24T13:35:08.525227+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'138","last_scrub_stamp":"2024-04-24T13:35:08.524900+0000","last_deep_scrub":"150'138","last_deep_scrub_stamp":"2024-04-24T13:35:08.524900+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.524900+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:43:30.040867+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"82'3","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:22.472418+0000","last_change":"2024-04-24T13:35:22.472481+0000","last_active":"2024-04-24T13:35:22.472418+0000","last_peered":"2024-04-24T13:35:22.472418+0000","last_clean":"2024-04-24T13:35:22.472418+0000","last_became_active":"2024-04-24T13:30:31.270304+0000","last_became_peered":"2024-04-24T13:30:31.270304+0000","last_unstale":"2024-04-24T13:35:22.472418+0000","last_undegraded":"2024-04-24T13:35:22.472418+0000","last_fullsized":"2024-04-24T13:35:22.472418+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'3","last_scrub_stamp":"2024-04-24T13:35:22.472205+0000","last_deep_scrub":"82'3","last_deep_scrub_stamp":"2024-04-24T13:35:22.472205+0000","last_clean_scrub_stamp":"2024-04-24T13:35:22.472205+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:32:55.492716+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":6,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"132'10","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.541420+0000","last_change":"2024-04-24T13:35:05.541542+0000","last_active":"2024-04-24T13:35:05.541420+0000","last_peered":"2024-04-24T13:35:05.541420+0000","last_clean":"2024-04-24T13:35:05.541420+0000","last_became_active":"2024-04-24T13:30:23.224851+0000","last_became_peered":"2024-04-24T13:30:23.224851+0000","last_unstale":"2024-04-24T13:35:05.541420+0000","last_undegraded":"2024-04-24T13:35:05.541420+0000","last_fullsized":"2024-04-24T13:35:05.541420+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'10","last_scrub_stamp":"2024-04-24T13:35:05.541126+0000","last_deep_scrub":"132'10","last_deep_scrub_stamp":"2024-04-24T13:35:05.541126+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.541126+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:10:26.314414+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":52,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.c","version":"150'46","reported_seq":168,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.458681+0000","last_change":"2024-04-24T13:34:55.458681+0000","last_active":"2024-04-24T13:34:55.458681+0000","last_peered":"2024-04-24T13:34:55.458681+0000","last_clean":"2024-04-24T13:34:55.458681+0000","last_became_active":"2024-04-24T13:33:08.718332+0000","last_became_peered":"2024-04-24T13:33:08.718332+0000","last_unstale":"2024-04-24T13:34:55.458681+0000","last_undegraded":"2024-04-24T13:34:55.458681+0000","last_fullsized":"2024-04-24T13:34:55.458681+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'46","last_scrub_stamp":"2024-04-24T13:34:55.458413+0000","last_deep_scrub":"150'46","last_deep_scrub_stamp":"2024-04-24T13:34:55.458413+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.458413+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:58:21.930554+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":265,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.970774+0000","last_change":"2024-04-24T13:35:03.970894+0000","last_active":"2024-04-24T13:35:03.970774+0000","last_peered":"2024-04-24T13:35:03.970774+0000","last_clean":"2024-04-24T13:35:03.970774+0000","last_became_active":"2024-04-24T13:30:25.228056+0000","last_became_peered":"2024-04-24T13:30:25.228056+0000","last_unstale":"2024-04-24T13:35:03.970774+0000","last_undegraded":"2024-04-24T13:35:03.970774+0000","last_fullsized":"2024-04-24T13:35:03.970774+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:03.970457+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:03.970457+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.970457+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:02:33.792341+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,4],"acting":[2,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.9","version":"150'39","reported_seq":354,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:27.411469+0000","last_change":"2024-04-24T13:35:27.411554+0000","last_active":"2024-04-24T13:35:27.411469+0000","last_peered":"2024-04-24T13:35:27.411469+0000","last_clean":"2024-04-24T13:35:27.411469+0000","last_became_active":"2024-04-24T13:33:49.292150+0000","last_became_peered":"2024-04-24T13:33:49.292150+0000","last_unstale":"2024-04-24T13:35:27.411469+0000","last_undegraded":"2024-04-24T13:35:27.411469+0000","last_fullsized":"2024-04-24T13:35:27.411469+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'39","last_scrub_stamp":"2024-04-24T13:35:27.411272+0000","last_deep_scrub":"150'39","last_deep_scrub_stamp":"2024-04-24T13:35:27.411272+0000","last_clean_scrub_stamp":"2024-04-24T13:35:27.411272+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:57:08.110134+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":37,"num_read_kb":28,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":440,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":267,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.036896+0000","last_change":"2024-04-24T13:35:09.036952+0000","last_active":"2024-04-24T13:35:09.036896+0000","last_peered":"2024-04-24T13:35:09.036896+0000","last_clean":"2024-04-24T13:35:09.036896+0000","last_became_active":"2024-04-24T13:33:49.305572+0000","last_became_peered":"2024-04-24T13:33:49.305572+0000","last_unstale":"2024-04-24T13:35:09.036896+0000","last_undegraded":"2024-04-24T13:35:09.036896+0000","last_fullsized":"2024-04-24T13:35:09.036896+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:09.036734+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:09.036734+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.036734+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:13:25.204430+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.7","version":"150'12","reported_seq":297,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.825991+0000","last_change":"2024-04-24T13:35:01.826057+0000","last_active":"2024-04-24T13:35:01.825991+0000","last_peered":"2024-04-24T13:35:01.825991+0000","last_clean":"2024-04-24T13:35:01.825991+0000","last_became_active":"2024-04-24T13:30:31.255087+0000","last_became_peered":"2024-04-24T13:30:31.255087+0000","last_unstale":"2024-04-24T13:35:01.825991+0000","last_undegraded":"2024-04-24T13:35:01.825991+0000","last_fullsized":"2024-04-24T13:35:01.825991+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'12","last_scrub_stamp":"2024-04-24T13:35:01.825796+0000","last_deep_scrub":"150'12","last_deep_scrub_stamp":"2024-04-24T13:35:01.825796+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.825796+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:11:04.528658+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":392,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":88,"num_read_kb":88,"num_write":26,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.c","version":"132'8","reported_seq":290,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.530146+0000","last_change":"2024-04-24T13:35:07.530337+0000","last_active":"2024-04-24T13:35:07.530146+0000","last_peered":"2024-04-24T13:35:07.530146+0000","last_clean":"2024-04-24T13:35:07.530146+0000","last_became_active":"2024-04-24T13:30:23.224790+0000","last_became_peered":"2024-04-24T13:30:23.224790+0000","last_unstale":"2024-04-24T13:35:07.530146+0000","last_undegraded":"2024-04-24T13:35:07.530146+0000","last_fullsized":"2024-04-24T13:35:07.530146+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'8","last_scrub_stamp":"2024-04-24T13:35:07.529907+0000","last_deep_scrub":"132'8","last_deep_scrub_stamp":"2024-04-24T13:35:07.529907+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.529907+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:05:03.086542+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.b","version":"150'58","reported_seq":334,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:20.547604+0000","last_change":"2024-04-24T13:35:20.547666+0000","last_active":"2024-04-24T13:35:20.547604+0000","last_peered":"2024-04-24T13:35:20.547604+0000","last_clean":"2024-04-24T13:35:20.547604+0000","last_became_active":"2024-04-24T13:30:21.225923+0000","last_became_peered":"2024-04-24T13:30:21.225923+0000","last_unstale":"2024-04-24T13:35:20.547604+0000","last_undegraded":"2024-04-24T13:35:20.547604+0000","last_fullsized":"2024-04-24T13:35:20.547604+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'58","last_scrub_stamp":"2024-04-24T13:35:20.547410+0000","last_deep_scrub":"150'58","last_deep_scrub_stamp":"2024-04-24T13:35:20.547410+0000","last_clean_scrub_stamp":"2024-04-24T13:35:20.547410+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:26:45.565421+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.989794+0000","last_change":"2024-04-24T13:35:07.989847+0000","last_active":"2024-04-24T13:35:07.989794+0000","last_peered":"2024-04-24T13:35:07.989794+0000","last_clean":"2024-04-24T13:35:07.989794+0000","last_became_active":"2024-04-24T13:33:49.300030+0000","last_became_peered":"2024-04-24T13:33:49.300030+0000","last_unstale":"2024-04-24T13:35:07.989794+0000","last_undegraded":"2024-04-24T13:35:07.989794+0000","last_fullsized":"2024-04-24T13:35:07.989794+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:07.989597+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:07.989597+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.989597+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:55:05.869969+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"150'26","reported_seq":300,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.595999+0000","last_change":"2024-04-24T13:35:10.596075+0000","last_active":"2024-04-24T13:35:10.595999+0000","last_peered":"2024-04-24T13:35:10.595999+0000","last_clean":"2024-04-24T13:35:10.595999+0000","last_became_active":"2024-04-24T13:30:27.246898+0000","last_became_peered":"2024-04-24T13:30:27.246898+0000","last_unstale":"2024-04-24T13:35:10.595999+0000","last_undegraded":"2024-04-24T13:35:10.595999+0000","last_fullsized":"2024-04-24T13:35:10.595999+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'26","last_scrub_stamp":"2024-04-24T13:35:10.595769+0000","last_deep_scrub":"150'26","last_deep_scrub_stamp":"2024-04-24T13:35:10.595769+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.595769+0000","objects_scrubbed":5,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:45:38.340604+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.581368+0000","last_change":"2024-04-24T13:35:06.581435+0000","last_active":"2024-04-24T13:35:06.581368+0000","last_peered":"2024-04-24T13:35:06.581368+0000","last_clean":"2024-04-24T13:35:06.581368+0000","last_became_active":"2024-04-24T13:30:29.271101+0000","last_became_peered":"2024-04-24T13:30:29.271101+0000","last_unstale":"2024-04-24T13:35:06.581368+0000","last_undegraded":"2024-04-24T13:35:06.581368+0000","last_fullsized":"2024-04-24T13:35:06.581368+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:06.581152+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:06.581152+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.581152+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:26:18.081319+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.0","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.529344+0000","last_change":"2024-04-24T13:34:52.529402+0000","last_active":"2024-04-24T13:34:52.529344+0000","last_peered":"2024-04-24T13:34:52.529344+0000","last_clean":"2024-04-24T13:34:52.529344+0000","last_became_active":"2024-04-24T13:33:08.720133+0000","last_became_peered":"2024-04-24T13:33:08.720133+0000","last_unstale":"2024-04-24T13:34:52.529344+0000","last_undegraded":"2024-04-24T13:34:52.529344+0000","last_fullsized":"2024-04-24T13:34:52.529344+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:52.529140+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:52.529140+0000","last_clean_scrub_stamp":"2024-04-24T13:34:52.529140+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:07:00.117664+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":270,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:19.545111+0000","last_change":"2024-04-24T13:35:19.545173+0000","last_active":"2024-04-24T13:35:19.545111+0000","last_peered":"2024-04-24T13:35:19.545111+0000","last_clean":"2024-04-24T13:35:19.545111+0000","last_became_active":"2024-04-24T13:30:23.221112+0000","last_became_peered":"2024-04-24T13:30:23.221112+0000","last_unstale":"2024-04-24T13:35:19.545111+0000","last_undegraded":"2024-04-24T13:35:19.545111+0000","last_fullsized":"2024-04-24T13:35:19.545111+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:19.544913+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:19.544913+0000","last_clean_scrub_stamp":"2024-04-24T13:35:19.544913+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:55.511808+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.a","version":"150'66","reported_seq":343,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.053745+0000","last_change":"2024-04-24T13:35:00.053810+0000","last_active":"2024-04-24T13:35:00.053745+0000","last_peered":"2024-04-24T13:35:00.053745+0000","last_clean":"2024-04-24T13:35:00.053745+0000","last_became_active":"2024-04-24T13:31:00.985630+0000","last_became_peered":"2024-04-24T13:31:00.985630+0000","last_unstale":"2024-04-24T13:35:00.053745+0000","last_undegraded":"2024-04-24T13:35:00.053745+0000","last_fullsized":"2024-04-24T13:35:00.053745+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'66","last_scrub_stamp":"2024-04-24T13:35:00.053542+0000","last_deep_scrub":"150'66","last_deep_scrub_stamp":"2024-04-24T13:35:00.053542+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.053542+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:53:01.309050+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.724260+0000","last_change":"2024-04-24T13:34:52.724260+0000","last_active":"2024-04-24T13:34:52.724260+0000","last_peered":"2024-04-24T13:34:52.724260+0000","last_clean":"2024-04-24T13:34:52.724260+0000","last_became_active":"2024-04-24T13:30:25.232755+0000","last_became_peered":"2024-04-24T13:30:25.232755+0000","last_unstale":"2024-04-24T13:34:52.724260+0000","last_undegraded":"2024-04-24T13:34:52.724260+0000","last_fullsized":"2024-04-24T13:34:52.724260+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:52.724169+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:52.724169+0000","last_clean_scrub_stamp":"2024-04-24T13:34:52.724169+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:46.749531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.f","version":"150'35","reported_seq":310,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.956366+0000","last_change":"2024-04-24T13:34:51.956366+0000","last_active":"2024-04-24T13:34:51.956366+0000","last_peered":"2024-04-24T13:34:51.956366+0000","last_clean":"2024-04-24T13:34:51.956366+0000","last_became_active":"2024-04-24T13:30:27.243651+0000","last_became_peered":"2024-04-24T13:30:27.243651+0000","last_unstale":"2024-04-24T13:34:51.956366+0000","last_undegraded":"2024-04-24T13:34:51.956366+0000","last_fullsized":"2024-04-24T13:34:51.956366+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'35","last_scrub_stamp":"2024-04-24T13:34:51.955957+0000","last_deep_scrub":"150'35","last_deep_scrub_stamp":"2024-04-24T13:34:51.955957+0000","last_clean_scrub_stamp":"2024-04-24T13:34:51.955957+0000","objects_scrubbed":7,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:48:38.690221+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":37,"num_read_kb":34,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"150'142","reported_seq":483,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.007620+0000","last_change":"2024-04-24T13:35:07.007712+0000","last_active":"2024-04-24T13:35:07.007620+0000","last_peered":"2024-04-24T13:35:07.007620+0000","last_clean":"2024-04-24T13:35:07.007620+0000","last_became_active":"2024-04-24T13:33:11.709412+0000","last_became_peered":"2024-04-24T13:33:11.709412+0000","last_unstale":"2024-04-24T13:35:07.007620+0000","last_undegraded":"2024-04-24T13:35:07.007620+0000","last_fullsized":"2024-04-24T13:35:07.007620+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'142","last_scrub_stamp":"2024-04-24T13:35:07.007403+0000","last_deep_scrub":"150'142","last_deep_scrub_stamp":"2024-04-24T13:35:07.007403+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.007403+0000","objects_scrubbed":1,"log_size":142,"log_dups_size":0,"ondisk_log_size":142,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:12:01.667924+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.875369+0000","last_change":"2024-04-24T13:35:03.875427+0000","last_active":"2024-04-24T13:35:03.875369+0000","last_peered":"2024-04-24T13:35:03.875369+0000","last_clean":"2024-04-24T13:35:03.875369+0000","last_became_active":"2024-04-24T13:30:31.263619+0000","last_became_peered":"2024-04-24T13:30:31.263619+0000","last_unstale":"2024-04-24T13:35:03.875369+0000","last_undegraded":"2024-04-24T13:35:03.875369+0000","last_fullsized":"2024-04-24T13:35:03.875369+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:03.875179+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:03.875179+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.875179+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:58.535700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.e","version":"114'2","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.396583+0000","last_change":"2024-04-24T13:34:57.396728+0000","last_active":"2024-04-24T13:34:57.396583+0000","last_peered":"2024-04-24T13:34:57.396583+0000","last_clean":"2024-04-24T13:34:57.396583+0000","last_became_active":"2024-04-24T13:30:23.246285+0000","last_became_peered":"2024-04-24T13:30:23.246285+0000","last_unstale":"2024-04-24T13:34:57.396583+0000","last_undegraded":"2024-04-24T13:34:57.396583+0000","last_fullsized":"2024-04-24T13:34:57.396583+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'2","last_scrub_stamp":"2024-04-24T13:34:57.396321+0000","last_deep_scrub":"114'2","last_deep_scrub_stamp":"2024-04-24T13:34:57.396321+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.396321+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:34:21.101552+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.9","version":"150'52","reported_seq":326,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:12.531446+0000","last_change":"2024-04-24T13:35:12.531510+0000","last_active":"2024-04-24T13:35:12.531446+0000","last_peered":"2024-04-24T13:35:12.531446+0000","last_clean":"2024-04-24T13:35:12.531446+0000","last_became_active":"2024-04-24T13:30:21.211848+0000","last_became_peered":"2024-04-24T13:30:21.211848+0000","last_unstale":"2024-04-24T13:35:12.531446+0000","last_undegraded":"2024-04-24T13:35:12.531446+0000","last_fullsized":"2024-04-24T13:35:12.531446+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'52","last_scrub_stamp":"2024-04-24T13:35:12.531241+0000","last_deep_scrub":"150'52","last_deep_scrub_stamp":"2024-04-24T13:35:12.531241+0000","last_clean_scrub_stamp":"2024-04-24T13:35:12.531241+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:07:34.086589+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":0,"num_write":52,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.f","version":"150'4","reported_seq":164,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:12.362381+0000","last_change":"2024-04-24T13:35:12.362381+0000","last_active":"2024-04-24T13:35:12.362381+0000","last_peered":"2024-04-24T13:35:12.362381+0000","last_clean":"2024-04-24T13:35:12.362381+0000","last_became_active":"2024-04-24T13:33:08.724858+0000","last_became_peered":"2024-04-24T13:33:08.724858+0000","last_unstale":"2024-04-24T13:35:12.362381+0000","last_undegraded":"2024-04-24T13:35:12.362381+0000","last_fullsized":"2024-04-24T13:35:12.362381+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'4","last_scrub_stamp":"2024-04-24T13:35:12.362097+0000","last_deep_scrub":"150'4","last_deep_scrub_stamp":"2024-04-24T13:35:12.362097+0000","last_clean_scrub_stamp":"2024-04-24T13:35:12.362097+0000","objects_scrubbed":2,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:26:37.380109+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":180,"num_read_kb":180,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":184,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.c","version":"150'16","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.509175+0000","last_change":"2024-04-24T13:35:04.509328+0000","last_active":"2024-04-24T13:35:04.509175+0000","last_peered":"2024-04-24T13:35:04.509175+0000","last_clean":"2024-04-24T13:35:04.509175+0000","last_became_active":"2024-04-24T13:30:27.242594+0000","last_became_peered":"2024-04-24T13:30:27.242594+0000","last_unstale":"2024-04-24T13:35:04.509175+0000","last_undegraded":"2024-04-24T13:35:04.509175+0000","last_fullsized":"2024-04-24T13:35:04.509175+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'16","last_scrub_stamp":"2024-04-24T13:35:04.508930+0000","last_deep_scrub":"150'16","last_deep_scrub_stamp":"2024-04-24T13:35:04.508930+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.508930+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:44.635645+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"150'138","reported_seq":492,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.075907+0000","last_change":"2024-04-24T13:34:56.075907+0000","last_active":"2024-04-24T13:34:56.075907+0000","last_peered":"2024-04-24T13:34:56.075907+0000","last_clean":"2024-04-24T13:34:56.075907+0000","last_became_active":"2024-04-24T13:30:29.285002+0000","last_became_peered":"2024-04-24T13:30:29.285002+0000","last_unstale":"2024-04-24T13:34:56.075907+0000","last_undegraded":"2024-04-24T13:34:56.075907+0000","last_fullsized":"2024-04-24T13:34:56.075907+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'138","last_scrub_stamp":"2024-04-24T13:34:56.075651+0000","last_deep_scrub":"150'138","last_deep_scrub_stamp":"2024-04-24T13:34:56.075651+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.075651+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:39:50.101013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,1],"acting":[6,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.2","version":"132'4","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:21.607361+0000","last_change":"2024-04-24T13:35:21.607427+0000","last_active":"2024-04-24T13:35:21.607361+0000","last_peered":"2024-04-24T13:35:21.607361+0000","last_clean":"2024-04-24T13:35:21.607361+0000","last_became_active":"2024-04-24T13:30:31.281356+0000","last_became_peered":"2024-04-24T13:30:31.281356+0000","last_unstale":"2024-04-24T13:35:21.607361+0000","last_undegraded":"2024-04-24T13:35:21.607361+0000","last_fullsized":"2024-04-24T13:35:21.607361+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'4","last_scrub_stamp":"2024-04-24T13:35:21.607161+0000","last_deep_scrub":"132'4","last_deep_scrub_stamp":"2024-04-24T13:35:21.607161+0000","last_clean_scrub_stamp":"2024-04-24T13:35:21.607161+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:17:24.386464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.f","version":"86'4","reported_seq":290,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.822023+0000","last_change":"2024-04-24T13:35:00.822081+0000","last_active":"2024-04-24T13:35:00.822023+0000","last_peered":"2024-04-24T13:35:00.822023+0000","last_clean":"2024-04-24T13:35:00.822023+0000","last_became_active":"2024-04-24T13:30:23.222093+0000","last_became_peered":"2024-04-24T13:30:23.222093+0000","last_unstale":"2024-04-24T13:35:00.822023+0000","last_undegraded":"2024-04-24T13:35:00.822023+0000","last_fullsized":"2024-04-24T13:35:00.822023+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'4","last_scrub_stamp":"2024-04-24T13:35:00.821825+0000","last_deep_scrub":"86'4","last_deep_scrub_stamp":"2024-04-24T13:35:00.821825+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.821825+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:02:30.643710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"150'70","reported_seq":346,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:16.512361+0000","last_change":"2024-04-24T13:35:16.512424+0000","last_active":"2024-04-24T13:35:16.512361+0000","last_peered":"2024-04-24T13:35:16.512361+0000","last_clean":"2024-04-24T13:35:16.512361+0000","last_became_active":"2024-04-24T13:30:21.218999+0000","last_became_peered":"2024-04-24T13:30:21.218999+0000","last_unstale":"2024-04-24T13:35:16.512361+0000","last_undegraded":"2024-04-24T13:35:16.512361+0000","last_fullsized":"2024-04-24T13:35:16.512361+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'70","last_scrub_stamp":"2024-04-24T13:35:16.512163+0000","last_deep_scrub":"150'70","last_deep_scrub_stamp":"2024-04-24T13:35:16.512163+0000","last_clean_scrub_stamp":"2024-04-24T13:35:16.512163+0000","objects_scrubbed":0,"log_size":70,"log_dups_size":0,"ondisk_log_size":70,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:42:17.226786+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":35,"num_read_kb":0,"num_write":70,"num_write_kb":143360,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"0'0","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:25.617722+0000","last_change":"2024-04-24T13:35:25.617780+0000","last_active":"2024-04-24T13:35:25.617722+0000","last_peered":"2024-04-24T13:35:25.617722+0000","last_clean":"2024-04-24T13:35:25.617722+0000","last_became_active":"2024-04-24T13:33:08.716585+0000","last_became_peered":"2024-04-24T13:33:08.716585+0000","last_unstale":"2024-04-24T13:35:25.617722+0000","last_undegraded":"2024-04-24T13:35:25.617722+0000","last_fullsized":"2024-04-24T13:35:25.617722+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:25.617525+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:25.617525+0000","last_clean_scrub_stamp":"2024-04-24T13:35:25.617525+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:48:02.817795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.d","version":"150'35","reported_seq":147,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.473126+0000","last_change":"2024-04-24T13:34:54.473126+0000","last_active":"2024-04-24T13:34:54.473126+0000","last_peered":"2024-04-24T13:34:54.473126+0000","last_clean":"2024-04-24T13:34:54.473126+0000","last_became_active":"2024-04-24T13:33:08.736280+0000","last_became_peered":"2024-04-24T13:33:08.736280+0000","last_unstale":"2024-04-24T13:34:54.473126+0000","last_undegraded":"2024-04-24T13:34:54.473126+0000","last_fullsized":"2024-04-24T13:34:54.473126+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":106,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'35","last_scrub_stamp":"2024-04-24T13:34:54.472852+0000","last_deep_scrub":"150'35","last_deep_scrub_stamp":"2024-04-24T13:34:54.472852+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.472852+0000","objects_scrubbed":8,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:41:06.902987+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":34,"num_read_kb":24,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":110,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.089719+0000","last_change":"2024-04-24T13:34:54.089719+0000","last_active":"2024-04-24T13:34:54.089719+0000","last_peered":"2024-04-24T13:34:54.089719+0000","last_clean":"2024-04-24T13:34:54.089719+0000","last_became_active":"2024-04-24T13:30:29.274974+0000","last_became_peered":"2024-04-24T13:30:29.274974+0000","last_unstale":"2024-04-24T13:34:54.089719+0000","last_undegraded":"2024-04-24T13:34:54.089719+0000","last_fullsized":"2024-04-24T13:34:54.089719+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:54.089378+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:54.089378+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.089378+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:05:02.343646+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,3],"acting":[6,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.3","version":"82'2","reported_seq":274,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:19.112861+0000","last_change":"2024-04-24T13:35:19.112926+0000","last_active":"2024-04-24T13:35:19.112861+0000","last_peered":"2024-04-24T13:35:19.112861+0000","last_clean":"2024-04-24T13:35:19.112861+0000","last_became_active":"2024-04-24T13:33:08.727402+0000","last_became_peered":"2024-04-24T13:33:08.727402+0000","last_unstale":"2024-04-24T13:35:19.112861+0000","last_undegraded":"2024-04-24T13:35:19.112861+0000","last_fullsized":"2024-04-24T13:35:19.112861+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:19.112657+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:19.112657+0000","last_clean_scrub_stamp":"2024-04-24T13:35:19.112657+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:29:28.619344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"105'4","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.982042+0000","last_change":"2024-04-24T13:35:09.982102+0000","last_active":"2024-04-24T13:35:09.982042+0000","last_peered":"2024-04-24T13:35:09.982042+0000","last_clean":"2024-04-24T13:35:09.982042+0000","last_became_active":"2024-04-24T13:30:23.244323+0000","last_became_peered":"2024-04-24T13:30:23.244323+0000","last_unstale":"2024-04-24T13:35:09.982042+0000","last_undegraded":"2024-04-24T13:35:09.982042+0000","last_fullsized":"2024-04-24T13:35:09.982042+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'4","last_scrub_stamp":"2024-04-24T13:35:09.981844+0000","last_deep_scrub":"105'4","last_deep_scrub_stamp":"2024-04-24T13:35:09.981844+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.981844+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:57.175965+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"1.0","version":"150'119","reported_seq":399,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:27.366186+0000","last_change":"2024-04-24T13:35:27.366266+0000","last_active":"2024-04-24T13:35:27.366186+0000","last_peered":"2024-04-24T13:35:27.366186+0000","last_clean":"2024-04-24T13:35:27.366186+0000","last_became_active":"2024-04-24T13:33:54.557258+0000","last_became_peered":"2024-04-24T13:33:54.557258+0000","last_unstale":"2024-04-24T13:35:27.366186+0000","last_undegraded":"2024-04-24T13:35:27.366186+0000","last_fullsized":"2024-04-24T13:35:27.366186+0000","mapping_epoch":129,"log_start":"0'0","ondisk_log_start":"0'0","created":14,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'119","last_scrub_stamp":"2024-04-24T13:35:27.365956+0000","last_deep_scrub":"150'119","last_deep_scrub_stamp":"2024-04-24T13:35:27.365956+0000","last_clean_scrub_stamp":"2024-04-24T13:35:27.365956+0000","objects_scrubbed":2,"log_size":119,"log_dups_size":0,"ondisk_log_size":119,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:45:08.207294+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"2.3","version":"0'0","reported_seq":112,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.405021+0000","last_change":"2024-04-24T13:35:11.405021+0000","last_active":"2024-04-24T13:35:11.405021+0000","last_peered":"2024-04-24T13:35:11.405021+0000","last_clean":"2024-04-24T13:35:11.405021+0000","last_became_active":"2024-04-24T13:33:08.715914+0000","last_became_peered":"2024-04-24T13:33:08.715914+0000","last_unstale":"2024-04-24T13:35:11.405021+0000","last_undegraded":"2024-04-24T13:35:11.405021+0000","last_fullsized":"2024-04-24T13:35:11.405021+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:11.404742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:11.404742+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.404742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:47:04.561793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.2","version":"150'56","reported_seq":360,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.514338+0000","last_change":"2024-04-24T13:34:58.514492+0000","last_active":"2024-04-24T13:34:58.514338+0000","last_peered":"2024-04-24T13:34:58.514338+0000","last_clean":"2024-04-24T13:34:58.514338+0000","last_became_active":"2024-04-24T13:33:08.725348+0000","last_became_peered":"2024-04-24T13:33:08.725348+0000","last_unstale":"2024-04-24T13:34:58.514338+0000","last_undegraded":"2024-04-24T13:34:58.514338+0000","last_fullsized":"2024-04-24T13:34:58.514338+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'56","last_scrub_stamp":"2024-04-24T13:34:58.514107+0000","last_deep_scrub":"150'56","last_deep_scrub_stamp":"2024-04-24T13:34:58.514107+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.514107+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:09.146766+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,5],"acting":[3,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:18.313471+0000","last_change":"2024-04-24T13:35:18.313530+0000","last_active":"2024-04-24T13:35:18.313471+0000","last_peered":"2024-04-24T13:35:18.313471+0000","last_clean":"2024-04-24T13:35:18.313471+0000","last_became_active":"2024-04-24T13:33:49.293916+0000","last_became_peered":"2024-04-24T13:33:49.293916+0000","last_unstale":"2024-04-24T13:35:18.313471+0000","last_undegraded":"2024-04-24T13:35:18.313471+0000","last_fullsized":"2024-04-24T13:35:18.313471+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:18.313272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:18.313272+0000","last_clean_scrub_stamp":"2024-04-24T13:35:18.313272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:40:11.434160+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.7","version":"150'53","reported_seq":158,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.445502+0000","last_change":"2024-04-24T13:35:08.445502+0000","last_active":"2024-04-24T13:35:08.445502+0000","last_peered":"2024-04-24T13:35:08.445502+0000","last_clean":"2024-04-24T13:35:08.445502+0000","last_became_active":"2024-04-24T13:33:08.719950+0000","last_became_peered":"2024-04-24T13:33:08.719950+0000","last_unstale":"2024-04-24T13:35:08.445502+0000","last_undegraded":"2024-04-24T13:35:08.445502+0000","last_fullsized":"2024-04-24T13:35:08.445502+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'53","last_scrub_stamp":"2024-04-24T13:35:08.445233+0000","last_deep_scrub":"150'53","last_deep_scrub_stamp":"2024-04-24T13:35:08.445233+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.445233+0000","objects_scrubbed":5,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:42:09.159856+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4316,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":56,"num_read_kb":397,"num_write":30,"num_write_kb":179,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":58868,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:23.451560+0000","last_change":"2024-04-24T13:35:23.451620+0000","last_active":"2024-04-24T13:35:23.451560+0000","last_peered":"2024-04-24T13:35:23.451560+0000","last_clean":"2024-04-24T13:35:23.451560+0000","last_became_active":"2024-04-24T13:33:49.294098+0000","last_became_peered":"2024-04-24T13:33:49.294098+0000","last_unstale":"2024-04-24T13:35:23.451560+0000","last_undegraded":"2024-04-24T13:35:23.451560+0000","last_fullsized":"2024-04-24T13:35:23.451560+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:23.451370+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:23.451370+0000","last_clean_scrub_stamp":"2024-04-24T13:35:23.451370+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:54:03.505587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"0'0","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:13.012718+0000","last_change":"2024-04-24T13:35:13.012779+0000","last_active":"2024-04-24T13:35:13.012718+0000","last_peered":"2024-04-24T13:35:13.012718+0000","last_clean":"2024-04-24T13:35:13.012718+0000","last_became_active":"2024-04-24T13:33:08.726216+0000","last_became_peered":"2024-04-24T13:33:08.726216+0000","last_unstale":"2024-04-24T13:35:13.012718+0000","last_undegraded":"2024-04-24T13:35:13.012718+0000","last_fullsized":"2024-04-24T13:35:13.012718+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:13.012518+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:13.012518+0000","last_clean_scrub_stamp":"2024-04-24T13:35:13.012518+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:23:44.385990+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.6","version":"105'6","reported_seq":297,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:13.592032+0000","last_change":"2024-04-24T13:35:13.592099+0000","last_active":"2024-04-24T13:35:13.592032+0000","last_peered":"2024-04-24T13:35:13.592032+0000","last_clean":"2024-04-24T13:35:13.592032+0000","last_became_active":"2024-04-24T13:30:23.219297+0000","last_became_peered":"2024-04-24T13:30:23.219297+0000","last_unstale":"2024-04-24T13:35:13.592032+0000","last_undegraded":"2024-04-24T13:35:13.592032+0000","last_fullsized":"2024-04-24T13:35:13.592032+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'6","last_scrub_stamp":"2024-04-24T13:35:13.591772+0000","last_deep_scrub":"105'6","last_deep_scrub_stamp":"2024-04-24T13:35:13.591772+0000","last_clean_scrub_stamp":"2024-04-24T13:35:13.591772+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:59.612972+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":33,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:13.317794+0000","last_change":"2024-04-24T13:35:13.317907+0000","last_active":"2024-04-24T13:35:13.317794+0000","last_peered":"2024-04-24T13:35:13.317794+0000","last_clean":"2024-04-24T13:35:13.317794+0000","last_became_active":"2024-04-24T13:33:49.282517+0000","last_became_peered":"2024-04-24T13:33:49.282517+0000","last_unstale":"2024-04-24T13:35:13.317794+0000","last_undegraded":"2024-04-24T13:35:13.317794+0000","last_fullsized":"2024-04-24T13:35:13.317794+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:13.317563+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:13.317563+0000","last_clean_scrub_stamp":"2024-04-24T13:35:13.317563+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:58:39.789704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.1","version":"150'48","reported_seq":322,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:16.578773+0000","last_change":"2024-04-24T13:35:16.578896+0000","last_active":"2024-04-24T13:35:16.578773+0000","last_peered":"2024-04-24T13:35:16.578773+0000","last_clean":"2024-04-24T13:35:16.578773+0000","last_became_active":"2024-04-24T13:30:21.212985+0000","last_became_peered":"2024-04-24T13:30:21.212985+0000","last_unstale":"2024-04-24T13:35:16.578773+0000","last_undegraded":"2024-04-24T13:35:16.578773+0000","last_fullsized":"2024-04-24T13:35:16.578773+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'48","last_scrub_stamp":"2024-04-24T13:35:16.578534+0000","last_deep_scrub":"150'48","last_deep_scrub_stamp":"2024-04-24T13:35:16.578534+0000","last_clean_scrub_stamp":"2024-04-24T13:35:16.578534+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:43:06.160253+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":112,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.400000+0000","last_change":"2024-04-24T13:35:07.400000+0000","last_active":"2024-04-24T13:35:07.400000+0000","last_peered":"2024-04-24T13:35:07.400000+0000","last_clean":"2024-04-24T13:35:07.400000+0000","last_became_active":"2024-04-24T13:33:08.728126+0000","last_became_peered":"2024-04-24T13:33:08.728126+0000","last_unstale":"2024-04-24T13:35:07.400000+0000","last_undegraded":"2024-04-24T13:35:07.400000+0000","last_fullsized":"2024-04-24T13:35:07.400000+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:07.399742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:07.399742+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.399742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:01:11.989434+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.4","version":"150'155","reported_seq":544,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.793736+0000","last_change":"2024-04-24T13:34:55.793825+0000","last_active":"2024-04-24T13:34:55.793736+0000","last_peered":"2024-04-24T13:34:55.793736+0000","last_clean":"2024-04-24T13:34:55.793736+0000","last_became_active":"2024-04-24T13:30:27.257532+0000","last_became_peered":"2024-04-24T13:30:27.257532+0000","last_unstale":"2024-04-24T13:34:55.793736+0000","last_undegraded":"2024-04-24T13:34:55.793736+0000","last_fullsized":"2024-04-24T13:34:55.793736+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'155","last_scrub_stamp":"2024-04-24T13:34:55.793548+0000","last_deep_scrub":"150'155","last_deep_scrub_stamp":"2024-04-24T13:34:55.793548+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.793548+0000","objects_scrubbed":10,"log_size":155,"log_dups_size":0,"ondisk_log_size":155,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:41:47.433857+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4344,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":200,"num_read_kb":417,"num_write":36,"num_write_kb":120,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:20.249047+0000","last_change":"2024-04-24T13:35:20.249101+0000","last_active":"2024-04-24T13:35:20.249047+0000","last_peered":"2024-04-24T13:35:20.249047+0000","last_clean":"2024-04-24T13:35:20.249047+0000","last_became_active":"2024-04-24T13:33:49.297450+0000","last_became_peered":"2024-04-24T13:33:49.297450+0000","last_unstale":"2024-04-24T13:35:20.249047+0000","last_undegraded":"2024-04-24T13:35:20.249047+0000","last_fullsized":"2024-04-24T13:35:20.249047+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:20.248851+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:20.248851+0000","last_clean_scrub_stamp":"2024-04-24T13:35:20.248851+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:29.016643+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.a","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:14.064863+0000","last_change":"2024-04-24T13:35:14.064993+0000","last_active":"2024-04-24T13:35:14.064863+0000","last_peered":"2024-04-24T13:35:14.064863+0000","last_clean":"2024-04-24T13:35:14.064863+0000","last_became_active":"2024-04-24T13:30:31.990888+0000","last_became_peered":"2024-04-24T13:30:31.990888+0000","last_unstale":"2024-04-24T13:35:14.064863+0000","last_undegraded":"2024-04-24T13:35:14.064863+0000","last_fullsized":"2024-04-24T13:35:14.064863+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:14.064628+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:14.064628+0000","last_clean_scrub_stamp":"2024-04-24T13:35:14.064628+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:32:03.714655+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"132'2","reported_seq":290,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:17.034210+0000","last_change":"2024-04-24T13:35:17.034353+0000","last_active":"2024-04-24T13:35:17.034210+0000","last_peered":"2024-04-24T13:35:17.034210+0000","last_clean":"2024-04-24T13:35:17.034210+0000","last_became_active":"2024-04-24T13:33:08.745363+0000","last_became_peered":"2024-04-24T13:33:08.745363+0000","last_unstale":"2024-04-24T13:35:17.034210+0000","last_undegraded":"2024-04-24T13:35:17.034210+0000","last_fullsized":"2024-04-24T13:35:17.034210+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'2","last_scrub_stamp":"2024-04-24T13:35:17.033960+0000","last_deep_scrub":"132'2","last_deep_scrub_stamp":"2024-04-24T13:35:17.033960+0000","last_clean_scrub_stamp":"2024-04-24T13:35:17.033960+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:17:47.484588+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.818246+0000","last_change":"2024-04-24T13:34:56.818315+0000","last_active":"2024-04-24T13:34:56.818246+0000","last_peered":"2024-04-24T13:34:56.818246+0000","last_clean":"2024-04-24T13:34:56.818246+0000","last_became_active":"2024-04-24T13:30:15.234813+0000","last_became_peered":"2024-04-24T13:30:15.234813+0000","last_unstale":"2024-04-24T13:34:56.818246+0000","last_undegraded":"2024-04-24T13:34:56.818246+0000","last_fullsized":"2024-04-24T13:34:56.818246+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:56.817999+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:56.817999+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.817999+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:09:42.991381+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"150'46","reported_seq":322,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.004311+0000","last_change":"2024-04-24T13:35:08.004373+0000","last_active":"2024-04-24T13:35:08.004311+0000","last_peered":"2024-04-24T13:35:08.004311+0000","last_clean":"2024-04-24T13:35:08.004311+0000","last_became_active":"2024-04-24T13:30:21.206129+0000","last_became_peered":"2024-04-24T13:30:21.206129+0000","last_unstale":"2024-04-24T13:35:08.004311+0000","last_undegraded":"2024-04-24T13:35:08.004311+0000","last_fullsized":"2024-04-24T13:35:08.004311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'46","last_scrub_stamp":"2024-04-24T13:35:08.004122+0000","last_deep_scrub":"150'46","last_deep_scrub_stamp":"2024-04-24T13:35:08.004122+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.004122+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:56:52.005906+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.6","version":"150'2","reported_seq":285,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.967504+0000","last_change":"2024-04-24T13:35:05.967567+0000","last_active":"2024-04-24T13:35:05.967504+0000","last_peered":"2024-04-24T13:35:05.967504+0000","last_clean":"2024-04-24T13:35:05.967504+0000","last_became_active":"2024-04-24T13:33:08.726022+0000","last_became_peered":"2024-04-24T13:33:08.726022+0000","last_unstale":"2024-04-24T13:35:05.967504+0000","last_undegraded":"2024-04-24T13:35:05.967504+0000","last_fullsized":"2024-04-24T13:35:05.967504+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2024-04-24T13:35:05.967287+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2024-04-24T13:35:05.967287+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.967287+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:14.865880+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"150'26","reported_seq":103,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.210343+0000","last_change":"2024-04-24T13:34:56.210432+0000","last_active":"2024-04-24T13:34:56.210343+0000","last_peered":"2024-04-24T13:34:56.210343+0000","last_clean":"2024-04-24T13:34:56.210343+0000","last_became_active":"2024-04-24T13:33:49.297296+0000","last_became_peered":"2024-04-24T13:33:49.297296+0000","last_unstale":"2024-04-24T13:34:56.210343+0000","last_undegraded":"2024-04-24T13:34:56.210343+0000","last_fullsized":"2024-04-24T13:34:56.210343+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'26","last_scrub_stamp":"2024-04-24T13:34:56.210139+0000","last_deep_scrub":"150'26","last_deep_scrub_stamp":"2024-04-24T13:34:56.210139+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.210139+0000","objects_scrubbed":8,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:24:45.836243+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":20,"num_read_kb":12,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":154,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.496972+0000","last_change":"2024-04-24T13:35:04.497029+0000","last_active":"2024-04-24T13:35:04.496972+0000","last_peered":"2024-04-24T13:35:04.496972+0000","last_clean":"2024-04-24T13:35:04.496972+0000","last_became_active":"2024-04-24T13:30:29.264706+0000","last_became_peered":"2024-04-24T13:30:29.264706+0000","last_unstale":"2024-04-24T13:35:04.496972+0000","last_undegraded":"2024-04-24T13:35:04.496972+0000","last_fullsized":"2024-04-24T13:35:04.496972+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:04.496766+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:04.496766+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.496766+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:06:32.875137+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.505656+0000","last_change":"2024-04-24T13:34:57.505656+0000","last_active":"2024-04-24T13:34:57.505656+0000","last_peered":"2024-04-24T13:34:57.505656+0000","last_clean":"2024-04-24T13:34:57.505656+0000","last_became_active":"2024-04-24T13:30:31.265635+0000","last_became_peered":"2024-04-24T13:30:31.265635+0000","last_unstale":"2024-04-24T13:34:57.505656+0000","last_undegraded":"2024-04-24T13:34:57.505656+0000","last_fullsized":"2024-04-24T13:34:57.505656+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:57.505376+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:57.505376+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.505376+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:07:19.060724+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"132'4","reported_seq":289,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.891458+0000","last_change":"2024-04-24T13:35:04.891517+0000","last_active":"2024-04-24T13:35:04.891458+0000","last_peered":"2024-04-24T13:35:04.891458+0000","last_clean":"2024-04-24T13:35:04.891458+0000","last_became_active":"2024-04-24T13:30:23.218502+0000","last_became_peered":"2024-04-24T13:30:23.218502+0000","last_unstale":"2024-04-24T13:35:04.891458+0000","last_undegraded":"2024-04-24T13:35:04.891458+0000","last_fullsized":"2024-04-24T13:35:04.891458+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'4","last_scrub_stamp":"2024-04-24T13:35:04.891253+0000","last_deep_scrub":"132'4","last_deep_scrub_stamp":"2024-04-24T13:35:04.891253+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.891253+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:57:58.060012+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.2","version":"0'0","reported_seq":112,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.412422+0000","last_change":"2024-04-24T13:35:09.412422+0000","last_active":"2024-04-24T13:35:09.412422+0000","last_peered":"2024-04-24T13:35:09.412422+0000","last_clean":"2024-04-24T13:35:09.412422+0000","last_became_active":"2024-04-24T13:33:08.727324+0000","last_became_peered":"2024-04-24T13:33:08.727324+0000","last_unstale":"2024-04-24T13:35:09.412422+0000","last_undegraded":"2024-04-24T13:35:09.412422+0000","last_fullsized":"2024-04-24T13:35:09.412422+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:09.412260+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:09.412260+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.412260+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:26.690128+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.3","version":"150'44","reported_seq":323,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:24.582644+0000","last_change":"2024-04-24T13:35:24.582704+0000","last_active":"2024-04-24T13:35:24.582644+0000","last_peered":"2024-04-24T13:35:24.582644+0000","last_clean":"2024-04-24T13:35:24.582644+0000","last_became_active":"2024-04-24T13:31:00.987421+0000","last_became_peered":"2024-04-24T13:31:00.987421+0000","last_unstale":"2024-04-24T13:35:24.582644+0000","last_undegraded":"2024-04-24T13:35:24.582644+0000","last_fullsized":"2024-04-24T13:35:24.582644+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'44","last_scrub_stamp":"2024-04-24T13:35:24.582425+0000","last_deep_scrub":"150'44","last_deep_scrub_stamp":"2024-04-24T13:35:24.582425+0000","last_clean_scrub_stamp":"2024-04-24T13:35:24.582425+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:37.866804+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.5","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.487882+0000","last_change":"2024-04-24T13:35:03.487940+0000","last_active":"2024-04-24T13:35:03.487882+0000","last_peered":"2024-04-24T13:35:03.487882+0000","last_clean":"2024-04-24T13:35:03.487882+0000","last_became_active":"2024-04-24T13:30:25.231517+0000","last_became_peered":"2024-04-24T13:30:25.231517+0000","last_unstale":"2024-04-24T13:35:03.487882+0000","last_undegraded":"2024-04-24T13:35:03.487882+0000","last_fullsized":"2024-04-24T13:35:03.487882+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:03.487639+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:03.487639+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.487639+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:41:15.917774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"150'18","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.440119+0000","last_change":"2024-04-24T13:35:08.440236+0000","last_active":"2024-04-24T13:35:08.440119+0000","last_peered":"2024-04-24T13:35:08.440119+0000","last_clean":"2024-04-24T13:35:08.440119+0000","last_became_active":"2024-04-24T13:30:27.249298+0000","last_became_peered":"2024-04-24T13:30:27.249298+0000","last_unstale":"2024-04-24T13:35:08.440119+0000","last_undegraded":"2024-04-24T13:35:08.440119+0000","last_fullsized":"2024-04-24T13:35:08.440119+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'18","last_scrub_stamp":"2024-04-24T13:35:08.439912+0000","last_deep_scrub":"150'18","last_deep_scrub_stamp":"2024-04-24T13:35:08.439912+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.439912+0000","objects_scrubbed":6,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:41:16.442413+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":18,"num_read_kb":12,"num_write":12,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.063220+0000","last_change":"2024-04-24T13:34:57.063281+0000","last_active":"2024-04-24T13:34:57.063220+0000","last_peered":"2024-04-24T13:34:57.063220+0000","last_clean":"2024-04-24T13:34:57.063220+0000","last_became_active":"2024-04-24T13:30:29.264546+0000","last_became_peered":"2024-04-24T13:30:29.264546+0000","last_unstale":"2024-04-24T13:34:57.063220+0000","last_undegraded":"2024-04-24T13:34:57.063220+0000","last_fullsized":"2024-04-24T13:34:57.063220+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:57.063010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:57.063010+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.063010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:09:43.236392+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.8","version":"81'4","reported_seq":116,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.309202+0000","last_change":"2024-04-24T13:35:02.309202+0000","last_active":"2024-04-24T13:35:02.309202+0000","last_peered":"2024-04-24T13:35:02.309202+0000","last_clean":"2024-04-24T13:35:02.309202+0000","last_became_active":"2024-04-24T13:33:08.717929+0000","last_became_peered":"2024-04-24T13:33:08.717929+0000","last_unstale":"2024-04-24T13:35:02.309202+0000","last_undegraded":"2024-04-24T13:35:02.309202+0000","last_fullsized":"2024-04-24T13:35:02.309202+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-04-24T13:35:02.308927+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-04-24T13:35:02.308927+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.308927+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:50:41.219735+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2","version":"0'0","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:16.037173+0000","last_change":"2024-04-24T13:35:16.037228+0000","last_active":"2024-04-24T13:35:16.037173+0000","last_peered":"2024-04-24T13:35:16.037173+0000","last_clean":"2024-04-24T13:35:16.037173+0000","last_became_active":"2024-04-24T13:33:08.738109+0000","last_became_peered":"2024-04-24T13:33:08.738109+0000","last_unstale":"2024-04-24T13:35:16.037173+0000","last_undegraded":"2024-04-24T13:35:16.037173+0000","last_fullsized":"2024-04-24T13:35:16.037173+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:16.036980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:16.036980+0000","last_clean_scrub_stamp":"2024-04-24T13:35:16.036980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:57:27.218453+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"150'52","reported_seq":172,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.413346+0000","last_change":"2024-04-24T13:34:59.413346+0000","last_active":"2024-04-24T13:34:59.413346+0000","last_peered":"2024-04-24T13:34:59.413346+0000","last_clean":"2024-04-24T13:34:59.413346+0000","last_became_active":"2024-04-24T13:33:08.716808+0000","last_became_peered":"2024-04-24T13:33:08.716808+0000","last_unstale":"2024-04-24T13:34:59.413346+0000","last_undegraded":"2024-04-24T13:34:59.413346+0000","last_fullsized":"2024-04-24T13:34:59.413346+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'52","last_scrub_stamp":"2024-04-24T13:34:59.413060+0000","last_deep_scrub":"150'52","last_deep_scrub_stamp":"2024-04-24T13:34:59.413060+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.413060+0000","objects_scrubbed":0,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:17:02.192363+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":3,"num_write":62,"num_write_kb":106496,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":25165824,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.987772+0000","last_change":"2024-04-24T13:35:06.987831+0000","last_active":"2024-04-24T13:35:06.987772+0000","last_peered":"2024-04-24T13:35:06.987772+0000","last_clean":"2024-04-24T13:35:06.987772+0000","last_became_active":"2024-04-24T13:30:16.056694+0000","last_became_peered":"2024-04-24T13:30:16.056694+0000","last_unstale":"2024-04-24T13:35:06.987772+0000","last_undegraded":"2024-04-24T13:35:06.987772+0000","last_fullsized":"2024-04-24T13:35:06.987772+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:06.987542+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:06.987542+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.987542+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:21:53.605786+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.3","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.513869+0000","last_change":"2024-04-24T13:35:01.514001+0000","last_active":"2024-04-24T13:35:01.513869+0000","last_peered":"2024-04-24T13:35:01.513869+0000","last_clean":"2024-04-24T13:35:01.513869+0000","last_became_active":"2024-04-24T13:30:25.234907+0000","last_became_peered":"2024-04-24T13:30:25.234907+0000","last_unstale":"2024-04-24T13:35:01.513869+0000","last_undegraded":"2024-04-24T13:35:01.513869+0000","last_fullsized":"2024-04-24T13:35:01.513869+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:01.513635+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:01.513635+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.513635+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:31:47.632337+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"150'46","reported_seq":330,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.563440+0000","last_change":"2024-04-24T13:34:59.563542+0000","last_active":"2024-04-24T13:34:59.563440+0000","last_peered":"2024-04-24T13:34:59.563440+0000","last_clean":"2024-04-24T13:34:59.563440+0000","last_became_active":"2024-04-24T13:30:27.243467+0000","last_became_peered":"2024-04-24T13:30:27.243467+0000","last_unstale":"2024-04-24T13:34:59.563440+0000","last_undegraded":"2024-04-24T13:34:59.563440+0000","last_fullsized":"2024-04-24T13:34:59.563440+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'46","last_scrub_stamp":"2024-04-24T13:34:59.563228+0000","last_deep_scrub":"150'46","last_deep_scrub_stamp":"2024-04-24T13:34:59.563228+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.563228+0000","objects_scrubbed":8,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:23:10.195887+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":46,"num_read_kb":34,"num_write":24,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.343986+0000","last_change":"2024-04-24T13:34:55.344039+0000","last_active":"2024-04-24T13:34:55.343986+0000","last_peered":"2024-04-24T13:34:55.343986+0000","last_clean":"2024-04-24T13:34:55.343986+0000","last_became_active":"2024-04-24T13:30:29.276857+0000","last_became_peered":"2024-04-24T13:30:29.276857+0000","last_unstale":"2024-04-24T13:34:55.343986+0000","last_undegraded":"2024-04-24T13:34:55.343986+0000","last_fullsized":"2024-04-24T13:34:55.343986+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:55.343785+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:55.343785+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.343785+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:46.236531+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.e","version":"0'0","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.523529+0000","last_change":"2024-04-24T13:34:55.523529+0000","last_active":"2024-04-24T13:34:55.523529+0000","last_peered":"2024-04-24T13:34:55.523529+0000","last_clean":"2024-04-24T13:34:55.523529+0000","last_became_active":"2024-04-24T13:30:31.992746+0000","last_became_peered":"2024-04-24T13:30:31.992746+0000","last_unstale":"2024-04-24T13:34:55.523529+0000","last_undegraded":"2024-04-24T13:34:55.523529+0000","last_fullsized":"2024-04-24T13:34:55.523529+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:55.523244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:55.523244+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.523244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:30.849238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"114'18","reported_seq":360,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.592088+0000","last_change":"2024-04-24T13:34:53.592138+0000","last_active":"2024-04-24T13:34:53.592088+0000","last_peered":"2024-04-24T13:34:53.592088+0000","last_clean":"2024-04-24T13:34:53.592088+0000","last_became_active":"2024-04-24T13:33:08.705853+0000","last_became_peered":"2024-04-24T13:33:08.705853+0000","last_unstale":"2024-04-24T13:34:53.592088+0000","last_undegraded":"2024-04-24T13:34:53.592088+0000","last_fullsized":"2024-04-24T13:34:53.592088+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'18","last_scrub_stamp":"2024-04-24T13:34:53.591991+0000","last_deep_scrub":"114'18","last_deep_scrub_stamp":"2024-04-24T13:34:53.591991+0000","last_clean_scrub_stamp":"2024-04-24T13:34:53.591991+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:04:49.148626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":90,"num_read_kb":86,"num_write":20,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.4","version":"150'28","reported_seq":304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.038597+0000","last_change":"2024-04-24T13:35:09.038663+0000","last_active":"2024-04-24T13:35:09.038597+0000","last_peered":"2024-04-24T13:35:09.038597+0000","last_clean":"2024-04-24T13:35:09.038597+0000","last_became_active":"2024-04-24T13:30:21.208002+0000","last_became_peered":"2024-04-24T13:30:21.208002+0000","last_unstale":"2024-04-24T13:35:09.038597+0000","last_undegraded":"2024-04-24T13:35:09.038597+0000","last_fullsized":"2024-04-24T13:35:09.038597+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'28","last_scrub_stamp":"2024-04-24T13:35:09.038390+0000","last_deep_scrub":"150'28","last_deep_scrub_stamp":"2024-04-24T13:35:09.038390+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.038390+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:07:16.626915+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:16.317952+0000","last_change":"2024-04-24T13:35:16.318009+0000","last_active":"2024-04-24T13:35:16.317952+0000","last_peered":"2024-04-24T13:35:16.317952+0000","last_clean":"2024-04-24T13:35:16.317952+0000","last_became_active":"2024-04-24T13:33:49.287893+0000","last_became_peered":"2024-04-24T13:33:49.287893+0000","last_unstale":"2024-04-24T13:35:16.317952+0000","last_undegraded":"2024-04-24T13:35:16.317952+0000","last_fullsized":"2024-04-24T13:35:16.317952+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:16.317753+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:16.317753+0000","last_clean_scrub_stamp":"2024-04-24T13:35:16.317753+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:30:06.733851+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":264,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.987492+0000","last_change":"2024-04-24T13:35:10.987544+0000","last_active":"2024-04-24T13:35:10.987492+0000","last_peered":"2024-04-24T13:35:10.987492+0000","last_clean":"2024-04-24T13:35:10.987492+0000","last_became_active":"2024-04-24T13:30:25.233867+0000","last_became_peered":"2024-04-24T13:30:25.233867+0000","last_unstale":"2024-04-24T13:35:10.987492+0000","last_undegraded":"2024-04-24T13:35:10.987492+0000","last_fullsized":"2024-04-24T13:35:10.987492+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:10.987298+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:10.987298+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.987298+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:34:04.146616+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1","version":"150'22","reported_seq":293,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.680269+0000","last_change":"2024-04-24T13:34:51.680325+0000","last_active":"2024-04-24T13:34:51.680269+0000","last_peered":"2024-04-24T13:34:51.680269+0000","last_clean":"2024-04-24T13:34:51.680269+0000","last_became_active":"2024-04-24T13:30:27.228280+0000","last_became_peered":"2024-04-24T13:30:27.228280+0000","last_unstale":"2024-04-24T13:34:51.680269+0000","last_undegraded":"2024-04-24T13:34:51.680269+0000","last_fullsized":"2024-04-24T13:34:51.680269+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'22","last_scrub_stamp":"2024-04-24T13:34:51.680185+0000","last_deep_scrub":"150'22","last_deep_scrub_stamp":"2024-04-24T13:34:51.680185+0000","last_clean_scrub_stamp":"2024-04-24T13:34:51.680185+0000","objects_scrubbed":7,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:20:50.188444+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"150'141","reported_seq":364,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.414116+0000","last_change":"2024-04-24T13:34:58.414116+0000","last_active":"2024-04-24T13:34:58.414116+0000","last_peered":"2024-04-24T13:34:58.414116+0000","last_clean":"2024-04-24T13:34:58.414116+0000","last_became_active":"2024-04-24T13:33:11.710310+0000","last_became_peered":"2024-04-24T13:33:11.710310+0000","last_unstale":"2024-04-24T13:34:58.414116+0000","last_undegraded":"2024-04-24T13:34:58.414116+0000","last_fullsized":"2024-04-24T13:34:58.414116+0000","mapping_epoch":106,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":107,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'141","last_scrub_stamp":"2024-04-24T13:34:58.413723+0000","last_deep_scrub":"150'141","last_deep_scrub_stamp":"2024-04-24T13:34:58.413723+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.413723+0000","objects_scrubbed":1,"log_size":141,"log_dups_size":0,"ondisk_log_size":141,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:48.829821+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.f","version":"150'4","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.499881+0000","last_change":"2024-04-24T13:34:55.499881+0000","last_active":"2024-04-24T13:34:55.499881+0000","last_peered":"2024-04-24T13:34:55.499881+0000","last_clean":"2024-04-24T13:34:55.499881+0000","last_became_active":"2024-04-24T13:30:31.990935+0000","last_became_peered":"2024-04-24T13:30:31.990935+0000","last_unstale":"2024-04-24T13:34:55.499881+0000","last_undegraded":"2024-04-24T13:34:55.499881+0000","last_fullsized":"2024-04-24T13:34:55.499881+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'4","last_scrub_stamp":"2024-04-24T13:34:55.499435+0000","last_deep_scrub":"150'4","last_deep_scrub_stamp":"2024-04-24T13:34:55.499435+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.499435+0000","objects_scrubbed":1,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:45:23.244270+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":11,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":5,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"82'2","reported_seq":238,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.015563+0000","last_change":"2024-04-24T13:35:10.015633+0000","last_active":"2024-04-24T13:35:10.015563+0000","last_peered":"2024-04-24T13:35:10.015563+0000","last_clean":"2024-04-24T13:35:10.015563+0000","last_became_active":"2024-04-24T13:33:49.296844+0000","last_became_peered":"2024-04-24T13:33:49.296844+0000","last_unstale":"2024-04-24T13:35:10.015563+0000","last_undegraded":"2024-04-24T13:35:10.015563+0000","last_fullsized":"2024-04-24T13:35:10.015563+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:10.015340+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:10.015340+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.015340+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:02:57.209461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"150'48","reported_seq":368,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:28.575593+0000","last_change":"2024-04-24T13:35:28.575664+0000","last_active":"2024-04-24T13:35:28.575593+0000","last_peered":"2024-04-24T13:35:28.575593+0000","last_clean":"2024-04-24T13:35:28.575593+0000","last_became_active":"2024-04-24T13:33:49.300149+0000","last_became_peered":"2024-04-24T13:33:49.300149+0000","last_unstale":"2024-04-24T13:35:28.575593+0000","last_undegraded":"2024-04-24T13:35:28.575593+0000","last_fullsized":"2024-04-24T13:35:28.575593+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'48","last_scrub_stamp":"2024-04-24T13:35:28.575399+0000","last_deep_scrub":"150'48","last_deep_scrub_stamp":"2024-04-24T13:35:28.575399+0000","last_clean_scrub_stamp":"2024-04-24T13:35:28.575399+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:40:25.543176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":16,"num_bytes_recovered":65011712,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.939023+0000","last_change":"2024-04-24T13:35:05.939144+0000","last_active":"2024-04-24T13:35:05.939023+0000","last_peered":"2024-04-24T13:35:05.939023+0000","last_clean":"2024-04-24T13:35:05.939023+0000","last_became_active":"2024-04-24T13:30:15.154357+0000","last_became_peered":"2024-04-24T13:30:15.154357+0000","last_unstale":"2024-04-24T13:35:05.939023+0000","last_undegraded":"2024-04-24T13:35:05.939023+0000","last_fullsized":"2024-04-24T13:35:05.939023+0000","mapping_epoch":17,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":18,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:05.938783+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:05.938783+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.938783+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:47:06.383645+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.453880+0000","last_change":"2024-04-24T13:35:02.453935+0000","last_active":"2024-04-24T13:35:02.453880+0000","last_peered":"2024-04-24T13:35:02.453880+0000","last_clean":"2024-04-24T13:35:02.453880+0000","last_became_active":"2024-04-24T13:30:25.231574+0000","last_became_peered":"2024-04-24T13:30:25.231574+0000","last_unstale":"2024-04-24T13:35:02.453880+0000","last_undegraded":"2024-04-24T13:35:02.453880+0000","last_fullsized":"2024-04-24T13:35:02.453880+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:02.453679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:02.453679+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.453679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:57:55.622438+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.2","version":"150'15","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.505466+0000","last_change":"2024-04-24T13:35:06.505545+0000","last_active":"2024-04-24T13:35:06.505466+0000","last_peered":"2024-04-24T13:35:06.505466+0000","last_clean":"2024-04-24T13:35:06.505466+0000","last_became_active":"2024-04-24T13:30:27.245504+0000","last_became_peered":"2024-04-24T13:30:27.245504+0000","last_unstale":"2024-04-24T13:35:06.505466+0000","last_undegraded":"2024-04-24T13:35:06.505466+0000","last_fullsized":"2024-04-24T13:35:06.505466+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'15","last_scrub_stamp":"2024-04-24T13:35:06.505272+0000","last_deep_scrub":"150'15","last_deep_scrub_stamp":"2024-04-24T13:35:06.505272+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.505272+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:07:14.093797+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.3","version":"150'138","reported_seq":448,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:12.387654+0000","last_change":"2024-04-24T13:35:12.387811+0000","last_active":"2024-04-24T13:35:12.387654+0000","last_peered":"2024-04-24T13:35:12.387654+0000","last_clean":"2024-04-24T13:35:12.387654+0000","last_became_active":"2024-04-24T13:30:29.271368+0000","last_became_peered":"2024-04-24T13:30:29.271368+0000","last_unstale":"2024-04-24T13:35:12.387654+0000","last_undegraded":"2024-04-24T13:35:12.387654+0000","last_fullsized":"2024-04-24T13:35:12.387654+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'138","last_scrub_stamp":"2024-04-24T13:35:12.387362+0000","last_deep_scrub":"150'138","last_deep_scrub_stamp":"2024-04-24T13:35:12.387362+0000","last_clean_scrub_stamp":"2024-04-24T13:35:12.387362+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:24:58.408562+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.c","version":"82'6","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.567149+0000","last_change":"2024-04-24T13:35:10.567221+0000","last_active":"2024-04-24T13:35:10.567149+0000","last_peered":"2024-04-24T13:35:10.567149+0000","last_clean":"2024-04-24T13:35:10.567149+0000","last_became_active":"2024-04-24T13:30:31.261723+0000","last_became_peered":"2024-04-24T13:30:31.261723+0000","last_unstale":"2024-04-24T13:35:10.567149+0000","last_undegraded":"2024-04-24T13:35:10.567149+0000","last_fullsized":"2024-04-24T13:35:10.567149+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-24T13:35:10.566935+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-24T13:35:10.566935+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.566935+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:23.851314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":12,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1","version":"114'6","reported_seq":311,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:26.600157+0000","last_change":"2024-04-24T13:35:26.600262+0000","last_active":"2024-04-24T13:35:26.600157+0000","last_peered":"2024-04-24T13:35:26.600157+0000","last_clean":"2024-04-24T13:35:26.600157+0000","last_became_active":"2024-04-24T13:33:08.707993+0000","last_became_peered":"2024-04-24T13:33:08.707993+0000","last_unstale":"2024-04-24T13:35:26.600157+0000","last_undegraded":"2024-04-24T13:35:26.600157+0000","last_fullsized":"2024-04-24T13:35:26.600157+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'6","last_scrub_stamp":"2024-04-24T13:35:26.599833+0000","last_deep_scrub":"114'6","last_deep_scrub_stamp":"2024-04-24T13:35:26.599833+0000","last_clean_scrub_stamp":"2024-04-24T13:35:26.599833+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:25:12.621034+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.6","version":"150'44","reported_seq":318,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:15.548042+0000","last_change":"2024-04-24T13:35:15.548104+0000","last_active":"2024-04-24T13:35:15.548042+0000","last_peered":"2024-04-24T13:35:15.548042+0000","last_clean":"2024-04-24T13:35:15.548042+0000","last_became_active":"2024-04-24T13:30:21.212007+0000","last_became_peered":"2024-04-24T13:30:21.212007+0000","last_unstale":"2024-04-24T13:35:15.548042+0000","last_undegraded":"2024-04-24T13:35:15.548042+0000","last_fullsized":"2024-04-24T13:35:15.548042+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'44","last_scrub_stamp":"2024-04-24T13:35:15.547806+0000","last_deep_scrub":"150'44","last_deep_scrub_stamp":"2024-04-24T13:35:15.547806+0000","last_clean_scrub_stamp":"2024-04-24T13:35:15.547806+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:38:52.017169+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:16.065369+0000","last_change":"2024-04-24T13:35:16.065431+0000","last_active":"2024-04-24T13:35:16.065369+0000","last_peered":"2024-04-24T13:35:16.065369+0000","last_clean":"2024-04-24T13:35:16.065369+0000","last_became_active":"2024-04-24T13:33:49.288766+0000","last_became_peered":"2024-04-24T13:33:49.288766+0000","last_unstale":"2024-04-24T13:35:16.065369+0000","last_undegraded":"2024-04-24T13:35:16.065369+0000","last_fullsized":"2024-04-24T13:35:16.065369+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":17,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:16.065170+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:16.065170+0000","last_clean_scrub_stamp":"2024-04-24T13:35:16.065170+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:51.391164+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.459164+0000","last_change":"2024-04-24T13:35:03.459222+0000","last_active":"2024-04-24T13:35:03.459164+0000","last_peered":"2024-04-24T13:35:03.459164+0000","last_clean":"2024-04-24T13:35:03.459164+0000","last_became_active":"2024-04-24T13:30:25.230984+0000","last_became_peered":"2024-04-24T13:30:25.230984+0000","last_unstale":"2024-04-24T13:35:03.459164+0000","last_undegraded":"2024-04-24T13:35:03.459164+0000","last_fullsized":"2024-04-24T13:35:03.459164+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:03.458957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:03.458957+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.458957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:58:29.931099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"150'57","reported_seq":113,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.358823+0000","last_change":"2024-04-24T13:35:09.358982+0000","last_active":"2024-04-24T13:35:09.358823+0000","last_peered":"2024-04-24T13:35:09.358823+0000","last_clean":"2024-04-24T13:35:09.358823+0000","last_became_active":"2024-04-24T13:33:49.295935+0000","last_became_peered":"2024-04-24T13:33:49.295935+0000","last_unstale":"2024-04-24T13:35:09.358823+0000","last_undegraded":"2024-04-24T13:35:09.358823+0000","last_fullsized":"2024-04-24T13:35:09.358823+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'57","last_scrub_stamp":"2024-04-24T13:35:09.358537+0000","last_deep_scrub":"150'57","last_deep_scrub_stamp":"2024-04-24T13:35:09.358537+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.358537+0000","objects_scrubbed":8,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:57:20.540010+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":56,"num_read_kb":42,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.558215+0000","last_change":"2024-04-24T13:34:59.558322+0000","last_active":"2024-04-24T13:34:59.558215+0000","last_peered":"2024-04-24T13:34:59.558215+0000","last_clean":"2024-04-24T13:34:59.558215+0000","last_became_active":"2024-04-24T13:30:29.282678+0000","last_became_peered":"2024-04-24T13:30:29.282678+0000","last_unstale":"2024-04-24T13:34:59.558215+0000","last_undegraded":"2024-04-24T13:34:59.558215+0000","last_fullsized":"2024-04-24T13:34:59.558215+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:59.557910+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:59.557910+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.557910+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:08:52.507873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.d","version":"105'6","reported_seq":130,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:26.450700+0000","last_change":"2024-04-24T13:35:26.450700+0000","last_active":"2024-04-24T13:35:26.450700+0000","last_peered":"2024-04-24T13:35:26.450700+0000","last_clean":"2024-04-24T13:35:26.450700+0000","last_became_active":"2024-04-24T13:33:49.289035+0000","last_became_peered":"2024-04-24T13:33:49.289035+0000","last_unstale":"2024-04-24T13:35:26.450700+0000","last_undegraded":"2024-04-24T13:35:26.450700+0000","last_fullsized":"2024-04-24T13:35:26.450700+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'6","last_scrub_stamp":"2024-04-24T13:35:26.450436+0000","last_deep_scrub":"105'6","last_deep_scrub_stamp":"2024-04-24T13:35:26.450436+0000","last_clean_scrub_stamp":"2024-04-24T13:35:26.450436+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:53:48.241120+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":194,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.1f","version":"82'2","reported_seq":272,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.566308+0000","last_change":"2024-04-24T13:34:54.566446+0000","last_active":"2024-04-24T13:34:54.566308+0000","last_peered":"2024-04-24T13:34:54.566308+0000","last_clean":"2024-04-24T13:34:54.566308+0000","last_became_active":"2024-04-24T13:33:08.705821+0000","last_became_peered":"2024-04-24T13:33:08.705821+0000","last_unstale":"2024-04-24T13:34:54.566308+0000","last_undegraded":"2024-04-24T13:34:54.566308+0000","last_fullsized":"2024-04-24T13:34:54.566308+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:34:54.566075+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:34:54.566075+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.566075+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:41.015456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.13","version":"82'2","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.363507+0000","last_change":"2024-04-24T13:34:56.363507+0000","last_active":"2024-04-24T13:34:56.363507+0000","last_peered":"2024-04-24T13:34:56.363507+0000","last_clean":"2024-04-24T13:34:56.363507+0000","last_became_active":"2024-04-24T13:30:23.248564+0000","last_became_peered":"2024-04-24T13:30:23.248564+0000","last_unstale":"2024-04-24T13:34:56.363507+0000","last_undegraded":"2024-04-24T13:34:56.363507+0000","last_fullsized":"2024-04-24T13:34:56.363507+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:34:56.363214+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:34:56.363214+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.363214+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:21:00.255439+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.14","version":"150'66","reported_seq":340,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.992029+0000","last_change":"2024-04-24T13:35:10.992095+0000","last_active":"2024-04-24T13:35:10.992029+0000","last_peered":"2024-04-24T13:35:10.992029+0000","last_clean":"2024-04-24T13:35:10.992029+0000","last_became_active":"2024-04-24T13:33:49.297002+0000","last_became_peered":"2024-04-24T13:33:49.297002+0000","last_unstale":"2024-04-24T13:35:10.992029+0000","last_undegraded":"2024-04-24T13:35:10.992029+0000","last_fullsized":"2024-04-24T13:35:10.992029+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'66","last_scrub_stamp":"2024-04-24T13:35:10.991829+0000","last_deep_scrub":"150'66","last_deep_scrub_stamp":"2024-04-24T13:35:10.991829+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.991829+0000","objects_scrubbed":0,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:34:04.151147+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":0,"num_write":66,"num_write_kb":135168,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":24,"num_bytes_recovered":100663296,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.12","version":"150'2","reported_seq":379,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:20.136065+0000","last_change":"2024-04-24T13:35:20.136139+0000","last_active":"2024-04-24T13:35:20.136065+0000","last_peered":"2024-04-24T13:35:20.136065+0000","last_clean":"2024-04-24T13:35:20.136065+0000","last_became_active":"2024-04-24T13:33:08.738276+0000","last_became_peered":"2024-04-24T13:33:08.738276+0000","last_unstale":"2024-04-24T13:35:20.136065+0000","last_undegraded":"2024-04-24T13:35:20.136065+0000","last_fullsized":"2024-04-24T13:35:20.136065+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2024-04-24T13:35:20.135858+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2024-04-24T13:35:20.135858+0000","last_clean_scrub_stamp":"2024-04-24T13:35:20.135858+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:16:16.260789+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":136,"num_read_kb":136,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":872,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"150'28","reported_seq":304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.531587+0000","last_change":"2024-04-24T13:35:00.531587+0000","last_active":"2024-04-24T13:35:00.531587+0000","last_peered":"2024-04-24T13:35:00.531587+0000","last_clean":"2024-04-24T13:35:00.531587+0000","last_became_active":"2024-04-24T13:30:27.240525+0000","last_became_peered":"2024-04-24T13:30:27.240525+0000","last_unstale":"2024-04-24T13:35:00.531587+0000","last_undegraded":"2024-04-24T13:35:00.531587+0000","last_fullsized":"2024-04-24T13:35:00.531587+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'28","last_scrub_stamp":"2024-04-24T13:35:00.531426+0000","last_deep_scrub":"150'28","last_deep_scrub_stamp":"2024-04-24T13:35:00.531426+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.531426+0000","objects_scrubbed":5,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:17:09.593271+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":31,"num_read_kb":30,"num_write":18,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.389820+0000","last_change":"2024-04-24T13:35:10.389820+0000","last_active":"2024-04-24T13:35:10.389820+0000","last_peered":"2024-04-24T13:35:10.389820+0000","last_clean":"2024-04-24T13:35:10.389820+0000","last_became_active":"2024-04-24T13:30:29.268866+0000","last_became_peered":"2024-04-24T13:30:29.268866+0000","last_unstale":"2024-04-24T13:35:10.389820+0000","last_undegraded":"2024-04-24T13:35:10.389820+0000","last_fullsized":"2024-04-24T13:35:10.389820+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:10.389571+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:10.389571+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.389571+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:23.673949+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:26.553747+0000","last_change":"2024-04-24T13:35:26.553800+0000","last_active":"2024-04-24T13:35:26.553747+0000","last_peered":"2024-04-24T13:35:26.553747+0000","last_clean":"2024-04-24T13:35:26.553747+0000","last_became_active":"2024-04-24T13:33:49.302201+0000","last_became_peered":"2024-04-24T13:33:49.302201+0000","last_unstale":"2024-04-24T13:35:26.553747+0000","last_undegraded":"2024-04-24T13:35:26.553747+0000","last_fullsized":"2024-04-24T13:35:26.553747+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:26.553553+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:26.553553+0000","last_clean_scrub_stamp":"2024-04-24T13:35:26.553553+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:46:49.756082+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.12","version":"0'0","reported_seq":272,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.851700+0000","last_change":"2024-04-24T13:34:58.851700+0000","last_active":"2024-04-24T13:34:58.851700+0000","last_peered":"2024-04-24T13:34:58.851700+0000","last_clean":"2024-04-24T13:34:58.851700+0000","last_became_active":"2024-04-24T13:30:23.236979+0000","last_became_peered":"2024-04-24T13:30:23.236979+0000","last_unstale":"2024-04-24T13:34:58.851700+0000","last_undegraded":"2024-04-24T13:34:58.851700+0000","last_fullsized":"2024-04-24T13:34:58.851700+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:58.851267+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:58.851267+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.851267+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:51:13.000922+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"150'40","reported_seq":117,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:24.320425+0000","last_change":"2024-04-24T13:35:24.320485+0000","last_active":"2024-04-24T13:35:24.320425+0000","last_peered":"2024-04-24T13:35:24.320425+0000","last_clean":"2024-04-24T13:35:24.320425+0000","last_became_active":"2024-04-24T13:33:49.299864+0000","last_became_peered":"2024-04-24T13:33:49.299864+0000","last_unstale":"2024-04-24T13:35:24.320425+0000","last_undegraded":"2024-04-24T13:35:24.320425+0000","last_fullsized":"2024-04-24T13:35:24.320425+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'40","last_scrub_stamp":"2024-04-24T13:35:24.320226+0000","last_deep_scrub":"150'40","last_deep_scrub_stamp":"2024-04-24T13:35:24.320226+0000","last_clean_scrub_stamp":"2024-04-24T13:35:24.320226+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:39:00.789589+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.527935+0000","last_change":"2024-04-24T13:35:01.527935+0000","last_active":"2024-04-24T13:35:01.527935+0000","last_peered":"2024-04-24T13:35:01.527935+0000","last_clean":"2024-04-24T13:35:01.527935+0000","last_became_active":"2024-04-24T13:30:25.235504+0000","last_became_peered":"2024-04-24T13:30:25.235504+0000","last_unstale":"2024-04-24T13:35:01.527935+0000","last_undegraded":"2024-04-24T13:35:01.527935+0000","last_fullsized":"2024-04-24T13:35:01.527935+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:01.527643+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:01.527643+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.527643+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:29:11.034330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"150'12","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:51.596038+0000","last_change":"2024-04-24T13:34:51.596038+0000","last_active":"2024-04-24T13:34:51.596038+0000","last_peered":"2024-04-24T13:34:51.596038+0000","last_clean":"2024-04-24T13:34:51.596038+0000","last_became_active":"2024-04-24T13:33:08.721855+0000","last_became_peered":"2024-04-24T13:33:08.721855+0000","last_unstale":"2024-04-24T13:34:51.596038+0000","last_undegraded":"2024-04-24T13:34:51.596038+0000","last_fullsized":"2024-04-24T13:34:51.596038+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'12","last_scrub_stamp":"2024-04-24T13:34:51.595741+0000","last_deep_scrub":"150'12","last_deep_scrub_stamp":"2024-04-24T13:34:51.595741+0000","last_clean_scrub_stamp":"2024-04-24T13:34:51.595741+0000","objects_scrubbed":3,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:00:07.543976+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":22,"num_read_kb":20,"num_write":36,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.301941+0000","last_change":"2024-04-24T13:35:08.301996+0000","last_active":"2024-04-24T13:35:08.301941+0000","last_peered":"2024-04-24T13:35:08.301941+0000","last_clean":"2024-04-24T13:35:08.301941+0000","last_became_active":"2024-04-24T13:33:49.297478+0000","last_became_peered":"2024-04-24T13:33:49.297478+0000","last_unstale":"2024-04-24T13:35:08.301941+0000","last_undegraded":"2024-04-24T13:35:08.301941+0000","last_fullsized":"2024-04-24T13:35:08.301941+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:08.301731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:08.301731+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.301731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:07:29.857080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,6],"acting":[7,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"8.1d","version":"132'6","reported_seq":264,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.490640+0000","last_change":"2024-04-24T13:34:57.490640+0000","last_active":"2024-04-24T13:34:57.490640+0000","last_peered":"2024-04-24T13:34:57.490640+0000","last_clean":"2024-04-24T13:34:57.490640+0000","last_became_active":"2024-04-24T13:30:31.271064+0000","last_became_peered":"2024-04-24T13:30:31.271064+0000","last_unstale":"2024-04-24T13:34:57.490640+0000","last_undegraded":"2024-04-24T13:34:57.490640+0000","last_fullsized":"2024-04-24T13:34:57.490640+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'6","last_scrub_stamp":"2024-04-24T13:34:57.490383+0000","last_deep_scrub":"132'6","last_deep_scrub_stamp":"2024-04-24T13:34:57.490383+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.490383+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:25:17.653873+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":15,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"82'4","reported_seq":304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:27.576453+0000","last_change":"2024-04-24T13:35:27.576512+0000","last_active":"2024-04-24T13:35:27.576453+0000","last_peered":"2024-04-24T13:35:27.576453+0000","last_clean":"2024-04-24T13:35:27.576453+0000","last_became_active":"2024-04-24T13:33:49.292866+0000","last_became_peered":"2024-04-24T13:33:49.292866+0000","last_unstale":"2024-04-24T13:35:27.576453+0000","last_undegraded":"2024-04-24T13:35:27.576453+0000","last_fullsized":"2024-04-24T13:35:27.576453+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:35:27.576254+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:35:27.576254+0000","last_clean_scrub_stamp":"2024-04-24T13:35:27.576254+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:49:25.649793+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.16","version":"150'44","reported_seq":203,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:28.518902+0000","last_change":"2024-04-24T13:35:28.519078+0000","last_active":"2024-04-24T13:35:28.518902+0000","last_peered":"2024-04-24T13:35:28.518902+0000","last_clean":"2024-04-24T13:35:28.518902+0000","last_became_active":"2024-04-24T13:33:49.289650+0000","last_became_peered":"2024-04-24T13:33:49.289650+0000","last_unstale":"2024-04-24T13:35:28.518902+0000","last_undegraded":"2024-04-24T13:35:28.518902+0000","last_fullsized":"2024-04-24T13:35:28.518902+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'44","last_scrub_stamp":"2024-04-24T13:35:28.518660+0000","last_deep_scrub":"150'44","last_deep_scrub_stamp":"2024-04-24T13:35:28.518660+0000","last_clean_scrub_stamp":"2024-04-24T13:35:28.518660+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:03:45.758853+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":22,"num_bytes_recovered":92274688,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:15.267496+0000","last_change":"2024-04-24T13:35:15.267554+0000","last_active":"2024-04-24T13:35:15.267496+0000","last_peered":"2024-04-24T13:35:15.267496+0000","last_clean":"2024-04-24T13:35:15.267496+0000","last_became_active":"2024-04-24T13:33:49.283342+0000","last_became_peered":"2024-04-24T13:33:49.283342+0000","last_unstale":"2024-04-24T13:35:15.267496+0000","last_undegraded":"2024-04-24T13:35:15.267496+0000","last_fullsized":"2024-04-24T13:35:15.267496+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:15.267270+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:15.267270+0000","last_clean_scrub_stamp":"2024-04-24T13:35:15.267270+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:51.234165+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.13","version":"150'27","reported_seq":303,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.490715+0000","last_change":"2024-04-24T13:35:02.490715+0000","last_active":"2024-04-24T13:35:02.490715+0000","last_peered":"2024-04-24T13:35:02.490715+0000","last_clean":"2024-04-24T13:35:02.490715+0000","last_became_active":"2024-04-24T13:30:27.242066+0000","last_became_peered":"2024-04-24T13:30:27.242066+0000","last_unstale":"2024-04-24T13:35:02.490715+0000","last_undegraded":"2024-04-24T13:35:02.490715+0000","last_fullsized":"2024-04-24T13:35:02.490715+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'27","last_scrub_stamp":"2024-04-24T13:35:02.490330+0000","last_deep_scrub":"150'27","last_deep_scrub_stamp":"2024-04-24T13:35:02.490330+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.490330+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:41:14.920465+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:55.093548+0000","last_change":"2024-04-24T13:34:55.093548+0000","last_active":"2024-04-24T13:34:55.093548+0000","last_peered":"2024-04-24T13:34:55.093548+0000","last_clean":"2024-04-24T13:34:55.093548+0000","last_became_active":"2024-04-24T13:30:29.264677+0000","last_became_peered":"2024-04-24T13:30:29.264677+0000","last_unstale":"2024-04-24T13:34:55.093548+0000","last_undegraded":"2024-04-24T13:34:55.093548+0000","last_fullsized":"2024-04-24T13:34:55.093548+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:55.093265+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:55.093265+0000","last_clean_scrub_stamp":"2024-04-24T13:34:55.093265+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:18:51.443013+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.1c","version":"114'4","reported_seq":126,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:25.405074+0000","last_change":"2024-04-24T13:35:25.405143+0000","last_active":"2024-04-24T13:35:25.405074+0000","last_peered":"2024-04-24T13:35:25.405074+0000","last_clean":"2024-04-24T13:35:25.405074+0000","last_became_active":"2024-04-24T13:33:49.288852+0000","last_became_peered":"2024-04-24T13:33:49.288852+0000","last_unstale":"2024-04-24T13:35:25.405074+0000","last_undegraded":"2024-04-24T13:35:25.405074+0000","last_fullsized":"2024-04-24T13:35:25.405074+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'4","last_scrub_stamp":"2024-04-24T13:35:25.404862+0000","last_deep_scrub":"114'4","last_deep_scrub_stamp":"2024-04-24T13:35:25.404862+0000","last_clean_scrub_stamp":"2024-04-24T13:35:25.404862+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:37:57.992415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.10","version":"81'2","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.399852+0000","last_change":"2024-04-24T13:35:11.399915+0000","last_active":"2024-04-24T13:35:11.399852+0000","last_peered":"2024-04-24T13:35:11.399852+0000","last_clean":"2024-04-24T13:35:11.399852+0000","last_became_active":"2024-04-24T13:30:23.224149+0000","last_became_peered":"2024-04-24T13:30:23.224149+0000","last_unstale":"2024-04-24T13:35:11.399852+0000","last_undegraded":"2024-04-24T13:35:11.399852+0000","last_fullsized":"2024-04-24T13:35:11.399852+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-04-24T13:35:11.399622+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-04-24T13:35:11.399622+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.399622+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:48.599892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"150'40","reported_seq":342,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:52.626761+0000","last_change":"2024-04-24T13:34:52.626761+0000","last_active":"2024-04-24T13:34:52.626761+0000","last_peered":"2024-04-24T13:34:52.626761+0000","last_clean":"2024-04-24T13:34:52.626761+0000","last_became_active":"2024-04-24T13:33:08.722546+0000","last_became_peered":"2024-04-24T13:33:08.722546+0000","last_unstale":"2024-04-24T13:34:52.626761+0000","last_undegraded":"2024-04-24T13:34:52.626761+0000","last_fullsized":"2024-04-24T13:34:52.626761+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'40","last_scrub_stamp":"2024-04-24T13:34:52.626581+0000","last_deep_scrub":"150'40","last_deep_scrub_stamp":"2024-04-24T13:34:52.626581+0000","last_clean_scrub_stamp":"2024-04-24T13:34:52.626581+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:07:00.215106+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":33554432,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,5],"acting":[0,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":264,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.016018+0000","last_change":"2024-04-24T13:35:03.016018+0000","last_active":"2024-04-24T13:35:03.016018+0000","last_peered":"2024-04-24T13:35:03.016018+0000","last_clean":"2024-04-24T13:35:03.016018+0000","last_became_active":"2024-04-24T13:30:25.235999+0000","last_became_peered":"2024-04-24T13:30:25.235999+0000","last_unstale":"2024-04-24T13:35:03.016018+0000","last_undegraded":"2024-04-24T13:35:03.016018+0000","last_fullsized":"2024-04-24T13:35:03.016018+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:03.015761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:03.015761+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.015761+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:31:59.660728+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.12","version":"150'25","reported_seq":88,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:21.267905+0000","last_change":"2024-04-24T13:35:21.268055+0000","last_active":"2024-04-24T13:35:21.267905+0000","last_peered":"2024-04-24T13:35:21.267905+0000","last_clean":"2024-04-24T13:35:21.267905+0000","last_became_active":"2024-04-24T13:33:49.297667+0000","last_became_peered":"2024-04-24T13:33:49.297667+0000","last_unstale":"2024-04-24T13:35:21.267905+0000","last_undegraded":"2024-04-24T13:35:21.267905+0000","last_fullsized":"2024-04-24T13:35:21.267905+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'25","last_scrub_stamp":"2024-04-24T13:35:21.267686+0000","last_deep_scrub":"150'25","last_deep_scrub_stamp":"2024-04-24T13:35:21.267686+0000","last_clean_scrub_stamp":"2024-04-24T13:35:21.267686+0000","objects_scrubbed":4,"log_size":25,"log_dups_size":0,"ondisk_log_size":25,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:35:40.668138+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":22,"num_read_kb":16,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.527318+0000","last_change":"2024-04-24T13:34:56.527318+0000","last_active":"2024-04-24T13:34:56.527318+0000","last_peered":"2024-04-24T13:34:56.527318+0000","last_clean":"2024-04-24T13:34:56.527318+0000","last_became_active":"2024-04-24T13:33:49.285495+0000","last_became_peered":"2024-04-24T13:33:49.285495+0000","last_unstale":"2024-04-24T13:34:56.527318+0000","last_undegraded":"2024-04-24T13:34:56.527318+0000","last_fullsized":"2024-04-24T13:34:56.527318+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:56.527057+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:56.527057+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.527057+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:45:24.271892+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1f","version":"82'8","reported_seq":304,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:08.017013+0000","last_change":"2024-04-24T13:35:08.017080+0000","last_active":"2024-04-24T13:35:08.017013+0000","last_peered":"2024-04-24T13:35:08.017013+0000","last_clean":"2024-04-24T13:35:08.017013+0000","last_became_active":"2024-04-24T13:30:23.242394+0000","last_became_peered":"2024-04-24T13:30:23.242394+0000","last_unstale":"2024-04-24T13:35:08.017013+0000","last_undegraded":"2024-04-24T13:35:08.017013+0000","last_fullsized":"2024-04-24T13:35:08.017013+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'8","last_scrub_stamp":"2024-04-24T13:35:08.016746+0000","last_deep_scrub":"82'8","last_deep_scrub_stamp":"2024-04-24T13:35:08.016746+0000","last_clean_scrub_stamp":"2024-04-24T13:35:08.016746+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:55:05.897118+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":44,"num_read_kb":44,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,5],"acting":[6,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.18","version":"150'54","reported_seq":330,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:17.489825+0000","last_change":"2024-04-24T13:35:17.489910+0000","last_active":"2024-04-24T13:35:17.489825+0000","last_peered":"2024-04-24T13:35:17.489825+0000","last_clean":"2024-04-24T13:35:17.489825+0000","last_became_active":"2024-04-24T13:30:21.224253+0000","last_became_peered":"2024-04-24T13:30:21.224253+0000","last_unstale":"2024-04-24T13:35:17.489825+0000","last_undegraded":"2024-04-24T13:35:17.489825+0000","last_fullsized":"2024-04-24T13:35:17.489825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'54","last_scrub_stamp":"2024-04-24T13:35:17.489598+0000","last_deep_scrub":"150'54","last_deep_scrub_stamp":"2024-04-24T13:35:17.489598+0000","last_clean_scrub_stamp":"2024-04-24T13:35:17.489598+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:16:34.767467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":0,"num_write":54,"num_write_kb":110592,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":276,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:24.408948+0000","last_change":"2024-04-24T13:35:24.409003+0000","last_active":"2024-04-24T13:35:24.408948+0000","last_peered":"2024-04-24T13:35:24.408948+0000","last_clean":"2024-04-24T13:35:24.408948+0000","last_became_active":"2024-04-24T13:33:49.295933+0000","last_became_peered":"2024-04-24T13:33:49.295933+0000","last_unstale":"2024-04-24T13:35:24.408948+0000","last_undegraded":"2024-04-24T13:35:24.408948+0000","last_fullsized":"2024-04-24T13:35:24.408948+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:24.408742+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:24.408742+0000","last_clean_scrub_stamp":"2024-04-24T13:35:24.408742+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:57:57.757140+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"150'39","reported_seq":322,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.784866+0000","last_change":"2024-04-24T13:34:53.784866+0000","last_active":"2024-04-24T13:34:53.784866+0000","last_peered":"2024-04-24T13:34:53.784866+0000","last_clean":"2024-04-24T13:34:53.784866+0000","last_became_active":"2024-04-24T13:30:27.257205+0000","last_became_peered":"2024-04-24T13:30:27.257205+0000","last_unstale":"2024-04-24T13:34:53.784866+0000","last_undegraded":"2024-04-24T13:34:53.784866+0000","last_fullsized":"2024-04-24T13:34:53.784866+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'39","last_scrub_stamp":"2024-04-24T13:34:53.784486+0000","last_deep_scrub":"150'39","last_deep_scrub_stamp":"2024-04-24T13:34:53.784486+0000","last_clean_scrub_stamp":"2024-04-24T13:34:53.784486+0000","objects_scrubbed":5,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:09:39.957868+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":42,"num_read_kb":151,"num_write":22,"num_write_kb":61,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:15.463261+0000","last_change":"2024-04-24T13:35:15.463316+0000","last_active":"2024-04-24T13:35:15.463261+0000","last_peered":"2024-04-24T13:35:15.463261+0000","last_clean":"2024-04-24T13:35:15.463261+0000","last_became_active":"2024-04-24T13:33:08.716627+0000","last_became_peered":"2024-04-24T13:33:08.716627+0000","last_unstale":"2024-04-24T13:35:15.463261+0000","last_undegraded":"2024-04-24T13:35:15.463261+0000","last_fullsized":"2024-04-24T13:35:15.463261+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:15.463056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:15.463056+0000","last_clean_scrub_stamp":"2024-04-24T13:35:15.463056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:53:55.517272+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"8.13","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.501822+0000","last_change":"2024-04-24T13:34:56.501822+0000","last_active":"2024-04-24T13:34:56.501822+0000","last_peered":"2024-04-24T13:34:56.501822+0000","last_clean":"2024-04-24T13:34:56.501822+0000","last_became_active":"2024-04-24T13:30:31.990725+0000","last_became_peered":"2024-04-24T13:30:31.990725+0000","last_unstale":"2024-04-24T13:34:56.501822+0000","last_undegraded":"2024-04-24T13:34:56.501822+0000","last_fullsized":"2024-04-24T13:34:56.501822+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:56.501492+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:56.501492+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.501492+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:25:16.664982+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1e","version":"114'10","reported_seq":333,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:26.416803+0000","last_change":"2024-04-24T13:35:26.416863+0000","last_active":"2024-04-24T13:35:26.416803+0000","last_peered":"2024-04-24T13:35:26.416803+0000","last_clean":"2024-04-24T13:35:26.416803+0000","last_became_active":"2024-04-24T13:33:49.285680+0000","last_became_peered":"2024-04-24T13:33:49.285680+0000","last_unstale":"2024-04-24T13:35:26.416803+0000","last_undegraded":"2024-04-24T13:35:26.416803+0000","last_fullsized":"2024-04-24T13:35:26.416803+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'10","last_scrub_stamp":"2024-04-24T13:35:26.416569+0000","last_deep_scrub":"114'10","last_deep_scrub_stamp":"2024-04-24T13:35:26.416569+0000","last_clean_scrub_stamp":"2024-04-24T13:35:26.416569+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:06:34.639029+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":51,"num_read_kb":51,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":5,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"150'40","reported_seq":316,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:13.027557+0000","last_change":"2024-04-24T13:35:13.027625+0000","last_active":"2024-04-24T13:35:13.027557+0000","last_peered":"2024-04-24T13:35:13.027557+0000","last_clean":"2024-04-24T13:35:13.027557+0000","last_became_active":"2024-04-24T13:30:21.230304+0000","last_became_peered":"2024-04-24T13:30:21.230304+0000","last_unstale":"2024-04-24T13:35:13.027557+0000","last_undegraded":"2024-04-24T13:35:13.027557+0000","last_fullsized":"2024-04-24T13:35:13.027557+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'40","last_scrub_stamp":"2024-04-24T13:35:13.027364+0000","last_deep_scrub":"150'40","last_deep_scrub_stamp":"2024-04-24T13:35:13.027364+0000","last_clean_scrub_stamp":"2024-04-24T13:35:13.027364+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:45:40.772199+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":0,"num_write":40,"num_write_kb":81920,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":264,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.022881+0000","last_change":"2024-04-24T13:35:01.022947+0000","last_active":"2024-04-24T13:35:01.022881+0000","last_peered":"2024-04-24T13:35:01.022881+0000","last_clean":"2024-04-24T13:35:01.022881+0000","last_became_active":"2024-04-24T13:30:25.236838+0000","last_became_peered":"2024-04-24T13:30:25.236838+0000","last_unstale":"2024-04-24T13:35:01.022881+0000","last_undegraded":"2024-04-24T13:35:01.022881+0000","last_fullsized":"2024-04-24T13:35:01.022881+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:01.022634+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:01.022634+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.022634+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:45:50.825500+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"6.1c","version":"150'32","reported_seq":96,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.216934+0000","last_change":"2024-04-24T13:34:59.217022+0000","last_active":"2024-04-24T13:34:59.216934+0000","last_peered":"2024-04-24T13:34:59.216934+0000","last_clean":"2024-04-24T13:34:59.216934+0000","last_became_active":"2024-04-24T13:33:49.291994+0000","last_became_peered":"2024-04-24T13:33:49.291994+0000","last_unstale":"2024-04-24T13:34:59.216934+0000","last_undegraded":"2024-04-24T13:34:59.216934+0000","last_fullsized":"2024-04-24T13:34:59.216934+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'32","last_scrub_stamp":"2024-04-24T13:34:59.216747+0000","last_deep_scrub":"150'32","last_deep_scrub_stamp":"2024-04-24T13:34:59.216747+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.216747+0000","objects_scrubbed":7,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:46:59.661609+0000","scrub_duration":11,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":31,"num_read_kb":22,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.853257+0000","last_change":"2024-04-24T13:34:57.853257+0000","last_active":"2024-04-24T13:34:57.853257+0000","last_peered":"2024-04-24T13:34:57.853257+0000","last_clean":"2024-04-24T13:34:57.853257+0000","last_became_active":"2024-04-24T13:30:29.280506+0000","last_became_peered":"2024-04-24T13:30:29.280506+0000","last_unstale":"2024-04-24T13:34:57.853257+0000","last_undegraded":"2024-04-24T13:34:57.853257+0000","last_fullsized":"2024-04-24T13:34:57.853257+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:57.852957+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:57.852957+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.852957+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:41:48.745703+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":262,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:18.057390+0000","last_change":"2024-04-24T13:35:18.057506+0000","last_active":"2024-04-24T13:35:18.057390+0000","last_peered":"2024-04-24T13:35:18.057390+0000","last_clean":"2024-04-24T13:35:18.057390+0000","last_became_active":"2024-04-24T13:33:49.288760+0000","last_became_peered":"2024-04-24T13:33:49.288760+0000","last_unstale":"2024-04-24T13:35:18.057390+0000","last_undegraded":"2024-04-24T13:35:18.057390+0000","last_fullsized":"2024-04-24T13:35:18.057390+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:18.057115+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:18.057115+0000","last_clean_scrub_stamp":"2024-04-24T13:35:18.057115+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:32:07.707142+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.1d","version":"0'0","reported_seq":272,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.405901+0000","last_change":"2024-04-24T13:35:09.405901+0000","last_active":"2024-04-24T13:35:09.405901+0000","last_peered":"2024-04-24T13:35:09.405901+0000","last_clean":"2024-04-24T13:35:09.405901+0000","last_became_active":"2024-04-24T13:30:23.224127+0000","last_became_peered":"2024-04-24T13:30:23.224127+0000","last_unstale":"2024-04-24T13:35:09.405901+0000","last_undegraded":"2024-04-24T13:35:09.405901+0000","last_fullsized":"2024-04-24T13:35:09.405901+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:09.405654+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:09.405654+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.405654+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:53:58.666456+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"150'34","reported_seq":308,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:13.550266+0000","last_change":"2024-04-24T13:35:13.550266+0000","last_active":"2024-04-24T13:35:13.550266+0000","last_peered":"2024-04-24T13:35:13.550266+0000","last_clean":"2024-04-24T13:35:13.550266+0000","last_became_active":"2024-04-24T13:30:21.215861+0000","last_became_peered":"2024-04-24T13:30:21.215861+0000","last_unstale":"2024-04-24T13:35:13.550266+0000","last_undegraded":"2024-04-24T13:35:13.550266+0000","last_fullsized":"2024-04-24T13:35:13.550266+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'34","last_scrub_stamp":"2024-04-24T13:35:13.549990+0000","last_deep_scrub":"150'34","last_deep_scrub_stamp":"2024-04-24T13:35:13.549990+0000","last_clean_scrub_stamp":"2024-04-24T13:35:13.549990+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:57:24.731463+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,1],"acting":[4,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.455345+0000","last_change":"2024-04-24T13:35:00.455345+0000","last_active":"2024-04-24T13:35:00.455345+0000","last_peered":"2024-04-24T13:35:00.455345+0000","last_clean":"2024-04-24T13:35:00.455345+0000","last_became_active":"2024-04-24T13:30:25.230393+0000","last_became_peered":"2024-04-24T13:30:25.230393+0000","last_unstale":"2024-04-24T13:35:00.455345+0000","last_undegraded":"2024-04-24T13:35:00.455345+0000","last_fullsized":"2024-04-24T13:35:00.455345+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:00.455056+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:00.455056+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.455056+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:24:50.081161+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1f","version":"150'27","reported_seq":303,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.453442+0000","last_change":"2024-04-24T13:35:06.453519+0000","last_active":"2024-04-24T13:35:06.453442+0000","last_peered":"2024-04-24T13:35:06.453442+0000","last_clean":"2024-04-24T13:35:06.453442+0000","last_became_active":"2024-04-24T13:30:27.242552+0000","last_became_peered":"2024-04-24T13:30:27.242552+0000","last_unstale":"2024-04-24T13:35:06.453442+0000","last_undegraded":"2024-04-24T13:35:06.453442+0000","last_fullsized":"2024-04-24T13:35:06.453442+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'27","last_scrub_stamp":"2024-04-24T13:35:06.453263+0000","last_deep_scrub":"150'27","last_deep_scrub_stamp":"2024-04-24T13:35:06.453263+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.453263+0000","objects_scrubbed":5,"log_size":27,"log_dups_size":0,"ondisk_log_size":27,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:40:22.783186+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":26,"num_read_kb":19,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":260,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.868233+0000","last_change":"2024-04-24T13:34:59.868294+0000","last_active":"2024-04-24T13:34:59.868233+0000","last_peered":"2024-04-24T13:34:59.868233+0000","last_clean":"2024-04-24T13:34:59.868233+0000","last_became_active":"2024-04-24T13:30:29.281238+0000","last_became_peered":"2024-04-24T13:30:29.281238+0000","last_unstale":"2024-04-24T13:34:59.868233+0000","last_undegraded":"2024-04-24T13:34:59.868233+0000","last_fullsized":"2024-04-24T13:34:59.868233+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:59.868034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:59.868034+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.868034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:31:56.513000+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.11","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:21.485558+0000","last_change":"2024-04-24T13:35:21.485620+0000","last_active":"2024-04-24T13:35:21.485558+0000","last_peered":"2024-04-24T13:35:21.485558+0000","last_clean":"2024-04-24T13:35:21.485558+0000","last_became_active":"2024-04-24T13:33:49.289412+0000","last_became_peered":"2024-04-24T13:33:49.289412+0000","last_unstale":"2024-04-24T13:35:21.485558+0000","last_undegraded":"2024-04-24T13:35:21.485558+0000","last_fullsized":"2024-04-24T13:35:21.485558+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:21.485354+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:21.485354+0000","last_clean_scrub_stamp":"2024-04-24T13:35:21.485354+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:48:08.034850+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.1c","version":"114'2","reported_seq":277,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.892339+0000","last_change":"2024-04-24T13:34:59.892339+0000","last_active":"2024-04-24T13:34:59.892339+0000","last_peered":"2024-04-24T13:34:59.892339+0000","last_clean":"2024-04-24T13:34:59.892339+0000","last_became_active":"2024-04-24T13:30:23.218880+0000","last_became_peered":"2024-04-24T13:30:23.218880+0000","last_unstale":"2024-04-24T13:34:59.892339+0000","last_undegraded":"2024-04-24T13:34:59.892339+0000","last_fullsized":"2024-04-24T13:34:59.892339+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'2","last_scrub_stamp":"2024-04-24T13:34:59.892059+0000","last_deep_scrub":"114'2","last_deep_scrub_stamp":"2024-04-24T13:34:59.892059+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.892059+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:53:01.147568+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1b","version":"150'56","reported_seq":330,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:17.532719+0000","last_change":"2024-04-24T13:35:17.532719+0000","last_active":"2024-04-24T13:35:17.532719+0000","last_peered":"2024-04-24T13:35:17.532719+0000","last_clean":"2024-04-24T13:35:17.532719+0000","last_became_active":"2024-04-24T13:30:21.214749+0000","last_became_peered":"2024-04-24T13:30:21.214749+0000","last_unstale":"2024-04-24T13:35:17.532719+0000","last_undegraded":"2024-04-24T13:35:17.532719+0000","last_fullsized":"2024-04-24T13:35:17.532719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'56","last_scrub_stamp":"2024-04-24T13:35:17.532464+0000","last_deep_scrub":"150'56","last_deep_scrub_stamp":"2024-04-24T13:35:17.532464+0000","last_clean_scrub_stamp":"2024-04-24T13:35:17.532464+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:06:33.586344+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,4],"acting":[0,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.752402+0000","last_change":"2024-04-24T13:34:54.752402+0000","last_active":"2024-04-24T13:34:54.752402+0000","last_peered":"2024-04-24T13:34:54.752402+0000","last_clean":"2024-04-24T13:34:54.752402+0000","last_became_active":"2024-04-24T13:30:25.230054+0000","last_became_peered":"2024-04-24T13:30:25.230054+0000","last_unstale":"2024-04-24T13:34:54.752402+0000","last_undegraded":"2024-04-24T13:34:54.752402+0000","last_fullsized":"2024-04-24T13:34:54.752402+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:54.752034+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:54.752034+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.752034+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:09:52.135595+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"150'15","reported_seq":282,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:04.470026+0000","last_change":"2024-04-24T13:35:04.470107+0000","last_active":"2024-04-24T13:35:04.470026+0000","last_peered":"2024-04-24T13:35:04.470026+0000","last_clean":"2024-04-24T13:35:04.470026+0000","last_became_active":"2024-04-24T13:30:27.245237+0000","last_became_peered":"2024-04-24T13:30:27.245237+0000","last_unstale":"2024-04-24T13:35:04.470026+0000","last_undegraded":"2024-04-24T13:35:04.470026+0000","last_fullsized":"2024-04-24T13:35:04.470026+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'15","last_scrub_stamp":"2024-04-24T13:35:04.469827+0000","last_deep_scrub":"150'15","last_deep_scrub_stamp":"2024-04-24T13:35:04.469827+0000","last_clean_scrub_stamp":"2024-04-24T13:35:04.469827+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:21:51.088071+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1f","version":"150'138","reported_seq":444,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.051522+0000","last_change":"2024-04-24T13:34:59.051583+0000","last_active":"2024-04-24T13:34:59.051522+0000","last_peered":"2024-04-24T13:34:59.051522+0000","last_clean":"2024-04-24T13:34:59.051522+0000","last_became_active":"2024-04-24T13:30:29.264128+0000","last_became_peered":"2024-04-24T13:30:29.264128+0000","last_unstale":"2024-04-24T13:34:59.051522+0000","last_undegraded":"2024-04-24T13:34:59.051522+0000","last_fullsized":"2024-04-24T13:34:59.051522+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'138","last_scrub_stamp":"2024-04-24T13:34:59.051338+0000","last_deep_scrub":"150'138","last_deep_scrub_stamp":"2024-04-24T13:34:59.051338+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.051338+0000","objects_scrubbed":1,"log_size":138,"log_dups_size":0,"ondisk_log_size":138,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:41:50.691647+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.10","version":"82'6","reported_seq":70,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.221035+0000","last_change":"2024-04-24T13:35:00.221206+0000","last_active":"2024-04-24T13:35:00.221035+0000","last_peered":"2024-04-24T13:35:00.221035+0000","last_clean":"2024-04-24T13:35:00.221035+0000","last_became_active":"2024-04-24T13:33:49.285594+0000","last_became_peered":"2024-04-24T13:33:49.285594+0000","last_unstale":"2024-04-24T13:35:00.221035+0000","last_undegraded":"2024-04-24T13:35:00.221035+0000","last_fullsized":"2024-04-24T13:35:00.221035+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-24T13:35:00.220755+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-24T13:35:00.220755+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.220755+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:21:46.838999+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,5],"acting":[7,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1b","version":"86'4","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.541391+0000","last_change":"2024-04-24T13:35:11.541391+0000","last_active":"2024-04-24T13:35:11.541391+0000","last_peered":"2024-04-24T13:35:11.541391+0000","last_clean":"2024-04-24T13:35:11.541391+0000","last_became_active":"2024-04-24T13:30:23.224030+0000","last_became_peered":"2024-04-24T13:30:23.224030+0000","last_unstale":"2024-04-24T13:35:11.541391+0000","last_undegraded":"2024-04-24T13:35:11.541391+0000","last_fullsized":"2024-04-24T13:35:11.541391+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"86'4","last_scrub_stamp":"2024-04-24T13:35:11.541122+0000","last_deep_scrub":"86'4","last_deep_scrub_stamp":"2024-04-24T13:35:11.541122+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.541122+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:32:01.191149+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,3],"acting":[4,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1c","version":"150'54","reported_seq":178,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.334196+0000","last_change":"2024-04-24T13:35:01.334253+0000","last_active":"2024-04-24T13:35:01.334196+0000","last_peered":"2024-04-24T13:35:01.334196+0000","last_clean":"2024-04-24T13:35:01.334196+0000","last_became_active":"2024-04-24T13:33:08.708911+0000","last_became_peered":"2024-04-24T13:33:08.708911+0000","last_unstale":"2024-04-24T13:35:01.334196+0000","last_undegraded":"2024-04-24T13:35:01.334196+0000","last_fullsized":"2024-04-24T13:35:01.334196+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'54","last_scrub_stamp":"2024-04-24T13:35:01.334022+0000","last_deep_scrub":"150'54","last_deep_scrub_stamp":"2024-04-24T13:35:01.334022+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.334022+0000","objects_scrubbed":0,"log_size":54,"log_dups_size":0,"ondisk_log_size":54,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T18:56:08.367748+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":3,"num_write":64,"num_write_kb":108544,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":39845888,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:14.278641+0000","last_change":"2024-04-24T13:35:14.278698+0000","last_active":"2024-04-24T13:35:14.278641+0000","last_peered":"2024-04-24T13:35:14.278641+0000","last_clean":"2024-04-24T13:35:14.278641+0000","last_became_active":"2024-04-24T13:33:49.282772+0000","last_became_peered":"2024-04-24T13:33:49.282772+0000","last_unstale":"2024-04-24T13:35:14.278641+0000","last_undegraded":"2024-04-24T13:35:14.278641+0000","last_fullsized":"2024-04-24T13:35:14.278641+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:14.278419+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:14.278419+0000","last_clean_scrub_stamp":"2024-04-24T13:35:14.278419+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:37:54.405134+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,4],"acting":[7,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"6.19","version":"150'36","reported_seq":145,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:24.416511+0000","last_change":"2024-04-24T13:35:24.416595+0000","last_active":"2024-04-24T13:35:24.416511+0000","last_peered":"2024-04-24T13:35:24.416511+0000","last_clean":"2024-04-24T13:35:24.416511+0000","last_became_active":"2024-04-24T13:33:08.732254+0000","last_became_peered":"2024-04-24T13:33:08.732254+0000","last_unstale":"2024-04-24T13:35:24.416511+0000","last_undegraded":"2024-04-24T13:35:24.416511+0000","last_fullsized":"2024-04-24T13:35:24.416511+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'36","last_scrub_stamp":"2024-04-24T13:35:24.416326+0000","last_deep_scrub":"150'36","last_deep_scrub_stamp":"2024-04-24T13:35:24.416326+0000","last_clean_scrub_stamp":"2024-04-24T13:35:24.416326+0000","objects_scrubbed":7,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:28:58.381340+0000","scrub_duration":15,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4096,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":36,"num_read_kb":33,"num_write":22,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":14,"num_bytes_recovered":777,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,1],"acting":[5,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.502612+0000","last_change":"2024-04-24T13:35:02.502612+0000","last_active":"2024-04-24T13:35:02.502612+0000","last_peered":"2024-04-24T13:35:02.502612+0000","last_clean":"2024-04-24T13:35:02.502612+0000","last_became_active":"2024-04-24T13:30:29.264482+0000","last_became_peered":"2024-04-24T13:30:29.264482+0000","last_unstale":"2024-04-24T13:35:02.502612+0000","last_undegraded":"2024-04-24T13:35:02.502612+0000","last_fullsized":"2024-04-24T13:35:02.502612+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:02.502212+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:02.502212+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.502212+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:29:12.008899+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,6],"acting":[0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:19.271913+0000","last_change":"2024-04-24T13:35:19.271986+0000","last_active":"2024-04-24T13:35:19.271913+0000","last_peered":"2024-04-24T13:35:19.271913+0000","last_clean":"2024-04-24T13:35:19.271913+0000","last_became_active":"2024-04-24T13:33:49.294486+0000","last_became_peered":"2024-04-24T13:33:49.294486+0000","last_unstale":"2024-04-24T13:35:19.271913+0000","last_undegraded":"2024-04-24T13:35:19.271913+0000","last_fullsized":"2024-04-24T13:35:19.271913+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:19.271687+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:19.271687+0000","last_clean_scrub_stamp":"2024-04-24T13:35:19.271687+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:30:32.556066+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0],"acting":[7,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.1a","version":"105'6","reported_seq":157,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:12.019390+0000","last_change":"2024-04-24T13:35:12.019530+0000","last_active":"2024-04-24T13:35:12.019390+0000","last_peered":"2024-04-24T13:35:12.019390+0000","last_clean":"2024-04-24T13:35:12.019390+0000","last_became_active":"2024-04-24T13:32:32.741990+0000","last_became_peered":"2024-04-24T13:32:32.741990+0000","last_unstale":"2024-04-24T13:35:12.019390+0000","last_undegraded":"2024-04-24T13:35:12.019390+0000","last_fullsized":"2024-04-24T13:35:12.019390+0000","mapping_epoch":87,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":88,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'6","last_scrub_stamp":"2024-04-24T13:35:12.019073+0000","last_deep_scrub":"105'6","last_deep_scrub_stamp":"2024-04-24T13:35:12.019073+0000","last_clean_scrub_stamp":"2024-04-24T13:35:12.019073+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:06.320220+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.1d","version":"150'46","reported_seq":324,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:16.432364+0000","last_change":"2024-04-24T13:35:16.432364+0000","last_active":"2024-04-24T13:35:16.432364+0000","last_peered":"2024-04-24T13:35:16.432364+0000","last_clean":"2024-04-24T13:35:16.432364+0000","last_became_active":"2024-04-24T13:30:21.216207+0000","last_became_peered":"2024-04-24T13:30:21.216207+0000","last_unstale":"2024-04-24T13:35:16.432364+0000","last_undegraded":"2024-04-24T13:35:16.432364+0000","last_fullsized":"2024-04-24T13:35:16.432364+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'46","last_scrub_stamp":"2024-04-24T13:35:16.432103+0000","last_deep_scrub":"150'46","last_deep_scrub_stamp":"2024-04-24T13:35:16.432103+0000","last_clean_scrub_stamp":"2024-04-24T13:35:16.432103+0000","objects_scrubbed":0,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:06:05.254111+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":0,"num_write":46,"num_write_kb":94208,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,4],"acting":[5,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":111,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:23.451377+0000","last_change":"2024-04-24T13:35:23.451503+0000","last_active":"2024-04-24T13:35:23.451377+0000","last_peered":"2024-04-24T13:35:23.451377+0000","last_clean":"2024-04-24T13:35:23.451377+0000","last_became_active":"2024-04-24T13:33:08.704735+0000","last_became_peered":"2024-04-24T13:33:08.704735+0000","last_unstale":"2024-04-24T13:35:23.451377+0000","last_undegraded":"2024-04-24T13:35:23.451377+0000","last_fullsized":"2024-04-24T13:35:23.451377+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:23.451153+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:23.451153+0000","last_clean_scrub_stamp":"2024-04-24T13:35:23.451153+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:27.882340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"6.18","version":"150'24","reported_seq":297,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.525879+0000","last_change":"2024-04-24T13:34:58.525879+0000","last_active":"2024-04-24T13:34:58.525879+0000","last_peered":"2024-04-24T13:34:58.525879+0000","last_clean":"2024-04-24T13:34:58.525879+0000","last_became_active":"2024-04-24T13:30:27.245805+0000","last_became_peered":"2024-04-24T13:30:27.245805+0000","last_unstale":"2024-04-24T13:34:58.525879+0000","last_undegraded":"2024-04-24T13:34:58.525879+0000","last_fullsized":"2024-04-24T13:34:58.525879+0000","mapping_epoch":26,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":27,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'24","last_scrub_stamp":"2024-04-24T13:34:58.525589+0000","last_deep_scrub":"150'24","last_deep_scrub_stamp":"2024-04-24T13:34:58.525589+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.525589+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:07:20.080937+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:17.104535+0000","last_change":"2024-04-24T13:35:17.104535+0000","last_active":"2024-04-24T13:35:17.104535+0000","last_peered":"2024-04-24T13:35:17.104535+0000","last_clean":"2024-04-24T13:35:17.104535+0000","last_became_active":"2024-04-24T13:33:49.288970+0000","last_became_peered":"2024-04-24T13:33:49.288970+0000","last_unstale":"2024-04-24T13:35:17.104535+0000","last_undegraded":"2024-04-24T13:35:17.104535+0000","last_fullsized":"2024-04-24T13:35:17.104535+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:17.104269+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:17.104269+0000","last_clean_scrub_stamp":"2024-04-24T13:35:17.104269+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T13:45:44.849104+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"8.16","version":"0'0","reported_seq":256,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.485376+0000","last_change":"2024-04-24T13:34:53.485376+0000","last_active":"2024-04-24T13:34:53.485376+0000","last_peered":"2024-04-24T13:34:53.485376+0000","last_clean":"2024-04-24T13:34:53.485376+0000","last_became_active":"2024-04-24T13:30:31.993375+0000","last_became_peered":"2024-04-24T13:30:31.993375+0000","last_unstale":"2024-04-24T13:34:53.485376+0000","last_undegraded":"2024-04-24T13:34:53.485376+0000","last_fullsized":"2024-04-24T13:34:53.485376+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:53.485251+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:53.485251+0000","last_clean_scrub_stamp":"2024-04-24T13:34:53.485251+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:26:07.934474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"105'10","reported_seq":253,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:22.468923+0000","last_change":"2024-04-24T13:35:22.468987+0000","last_active":"2024-04-24T13:35:22.468923+0000","last_peered":"2024-04-24T13:35:22.468923+0000","last_clean":"2024-04-24T13:35:22.468923+0000","last_became_active":"2024-04-24T13:31:00.982139+0000","last_became_peered":"2024-04-24T13:31:00.982139+0000","last_unstale":"2024-04-24T13:35:22.468923+0000","last_undegraded":"2024-04-24T13:35:22.468923+0000","last_fullsized":"2024-04-24T13:35:22.468923+0000","mapping_epoch":48,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":49,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'10","last_scrub_stamp":"2024-04-24T13:35:22.468712+0000","last_deep_scrub":"105'10","last_deep_scrub_stamp":"2024-04-24T13:35:22.468712+0000","last_clean_scrub_stamp":"2024-04-24T13:35:22.468712+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:51:46.058581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,2],"acting":[5,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.1e","version":"150'38","reported_seq":314,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:18.527526+0000","last_change":"2024-04-24T13:35:18.527594+0000","last_active":"2024-04-24T13:35:18.527526+0000","last_peered":"2024-04-24T13:35:18.527526+0000","last_clean":"2024-04-24T13:35:18.527526+0000","last_became_active":"2024-04-24T13:30:21.224211+0000","last_became_peered":"2024-04-24T13:30:21.224211+0000","last_unstale":"2024-04-24T13:35:18.527526+0000","last_undegraded":"2024-04-24T13:35:18.527526+0000","last_fullsized":"2024-04-24T13:35:18.527526+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'38","last_scrub_stamp":"2024-04-24T13:35:18.527334+0000","last_deep_scrub":"150'38","last_deep_scrub_stamp":"2024-04-24T13:35:18.527334+0000","last_clean_scrub_stamp":"2024-04-24T13:35:18.527334+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:41:55.354482+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":19,"num_read_kb":0,"num_write":38,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,6],"acting":[3,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":266,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:58.409201+0000","last_change":"2024-04-24T13:34:58.409201+0000","last_active":"2024-04-24T13:34:58.409201+0000","last_peered":"2024-04-24T13:34:58.409201+0000","last_clean":"2024-04-24T13:34:58.409201+0000","last_became_active":"2024-04-24T13:30:25.230586+0000","last_became_peered":"2024-04-24T13:30:25.230586+0000","last_unstale":"2024-04-24T13:34:58.409201+0000","last_undegraded":"2024-04-24T13:34:58.409201+0000","last_fullsized":"2024-04-24T13:34:58.409201+0000","mapping_epoch":24,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":25,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:58.408926+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:58.408926+0000","last_clean_scrub_stamp":"2024-04-24T13:34:58.408926+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:21:20.314097+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"6.1b","version":"150'17","reported_seq":198,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.959012+0000","last_change":"2024-04-24T13:35:11.959089+0000","last_active":"2024-04-24T13:35:11.959012+0000","last_peered":"2024-04-24T13:35:11.959012+0000","last_clean":"2024-04-24T13:35:11.959012+0000","last_became_active":"2024-04-24T13:33:49.302159+0000","last_became_peered":"2024-04-24T13:33:49.302159+0000","last_unstale":"2024-04-24T13:35:11.959012+0000","last_undegraded":"2024-04-24T13:35:11.959012+0000","last_fullsized":"2024-04-24T13:35:11.959012+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":126,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'17","last_scrub_stamp":"2024-04-24T13:35:11.958799+0000","last_deep_scrub":"150'17","last_deep_scrub_stamp":"2024-04-24T13:35:11.958799+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.958799+0000","objects_scrubbed":2,"log_size":17,"log_dups_size":0,"ondisk_log_size":17,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:47:06.259946+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":17,"num_read_kb":13,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":330,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,7],"acting":[2,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:53.352817+0000","last_change":"2024-04-24T13:34:53.352817+0000","last_active":"2024-04-24T13:34:53.352817+0000","last_peered":"2024-04-24T13:34:53.352817+0000","last_clean":"2024-04-24T13:34:53.352817+0000","last_became_active":"2024-04-24T13:30:29.279260+0000","last_became_peered":"2024-04-24T13:30:29.279260+0000","last_unstale":"2024-04-24T13:34:53.352817+0000","last_undegraded":"2024-04-24T13:34:53.352817+0000","last_fullsized":"2024-04-24T13:34:53.352817+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:34:53.352544+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:34:53.352544+0000","last_clean_scrub_stamp":"2024-04-24T13:34:53.352544+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:01:40.724213+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"8.15","version":"82'2","reported_seq":70,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:28.382676+0000","last_change":"2024-04-24T13:35:28.382735+0000","last_active":"2024-04-24T13:35:28.382676+0000","last_peered":"2024-04-24T13:35:28.382676+0000","last_clean":"2024-04-24T13:35:28.382676+0000","last_became_active":"2024-04-24T13:33:49.303239+0000","last_became_peered":"2024-04-24T13:33:49.303239+0000","last_unstale":"2024-04-24T13:35:28.382676+0000","last_undegraded":"2024-04-24T13:35:28.382676+0000","last_fullsized":"2024-04-24T13:35:28.382676+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":130,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:28.382473+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:28.382473+0000","last_clean_scrub_stamp":"2024-04-24T13:35:28.382473+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:36:20.723978+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":3,"num_read_kb":3,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,1],"acting":[7,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.18","version":"82'4","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:03.471851+0000","last_change":"2024-04-24T13:35:03.471851+0000","last_active":"2024-04-24T13:35:03.471851+0000","last_peered":"2024-04-24T13:35:03.471851+0000","last_clean":"2024-04-24T13:35:03.471851+0000","last_became_active":"2024-04-24T13:30:23.237030+0000","last_became_peered":"2024-04-24T13:30:23.237030+0000","last_unstale":"2024-04-24T13:35:03.471851+0000","last_undegraded":"2024-04-24T13:35:03.471851+0000","last_fullsized":"2024-04-24T13:35:03.471851+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:35:03.471604+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:35:03.471604+0000","last_clean_scrub_stamp":"2024-04-24T13:35:03.471604+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:47:03.916467+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.1f","version":"150'42","reported_seq":224,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:54.912368+0000","last_change":"2024-04-24T13:34:54.912368+0000","last_active":"2024-04-24T13:34:54.912368+0000","last_peered":"2024-04-24T13:34:54.912368+0000","last_clean":"2024-04-24T13:34:54.912368+0000","last_became_active":"2024-04-24T13:33:08.725822+0000","last_became_peered":"2024-04-24T13:33:08.725822+0000","last_unstale":"2024-04-24T13:34:54.912368+0000","last_undegraded":"2024-04-24T13:34:54.912368+0000","last_fullsized":"2024-04-24T13:34:54.912368+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'42","last_scrub_stamp":"2024-04-24T13:34:54.911965+0000","last_deep_scrub":"150'42","last_deep_scrub_stamp":"2024-04-24T13:34:54.911965+0000","last_clean_scrub_stamp":"2024-04-24T13:34:54.911965+0000","objects_scrubbed":0,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:18:51.261713+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":0,"num_write":42,"num_write_kb":86016,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":16777216,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.19","version":"150'2","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:18.074462+0000","last_change":"2024-04-24T13:35:18.074528+0000","last_active":"2024-04-24T13:35:18.074462+0000","last_peered":"2024-04-24T13:35:18.074462+0000","last_clean":"2024-04-24T13:35:18.074462+0000","last_became_active":"2024-04-24T13:33:08.726873+0000","last_became_peered":"2024-04-24T13:33:08.726873+0000","last_unstale":"2024-04-24T13:35:18.074462+0000","last_undegraded":"2024-04-24T13:35:18.074462+0000","last_fullsized":"2024-04-24T13:35:18.074462+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":24,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'2","last_scrub_stamp":"2024-04-24T13:35:18.074268+0000","last_deep_scrub":"150'2","last_deep_scrub_stamp":"2024-04-24T13:35:18.074268+0000","last_clean_scrub_stamp":"2024-04-24T13:35:18.074268+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:32:04.192970+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":92,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,5],"acting":[1,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"150'24","reported_seq":327,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:27.619145+0000","last_change":"2024-04-24T13:35:27.619145+0000","last_active":"2024-04-24T13:35:27.619145+0000","last_peered":"2024-04-24T13:35:27.619145+0000","last_clean":"2024-04-24T13:35:27.619145+0000","last_became_active":"2024-04-24T13:33:08.726347+0000","last_became_peered":"2024-04-24T13:33:08.726347+0000","last_unstale":"2024-04-24T13:35:27.619145+0000","last_undegraded":"2024-04-24T13:35:27.619145+0000","last_fullsized":"2024-04-24T13:35:27.619145+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":26,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'24","last_scrub_stamp":"2024-04-24T13:35:27.618662+0000","last_deep_scrub":"150'24","last_deep_scrub_stamp":"2024-04-24T13:35:27.618662+0000","last_clean_scrub_stamp":"2024-04-24T13:35:27.618662+0000","objects_scrubbed":4,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:18:17.469721+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":23,"num_read_kb":17,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":8,"num_bytes_recovered":220,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,5],"acting":[4,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":258,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.527005+0000","last_change":"2024-04-24T13:35:00.527005+0000","last_active":"2024-04-24T13:35:00.527005+0000","last_peered":"2024-04-24T13:35:00.527005+0000","last_clean":"2024-04-24T13:35:00.527005+0000","last_became_active":"2024-04-24T13:30:29.258292+0000","last_became_peered":"2024-04-24T13:30:29.258292+0000","last_unstale":"2024-04-24T13:35:00.527005+0000","last_undegraded":"2024-04-24T13:35:00.527005+0000","last_fullsized":"2024-04-24T13:35:00.527005+0000","mapping_epoch":28,"log_start":"0'0","ondisk_log_start":"0'0","created":28,"last_epoch_clean":29,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:00.526778+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:00.526778+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.526778+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:08:53.476741+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"0'0","reported_seq":254,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:22.623085+0000","last_change":"2024-04-24T13:35:22.623141+0000","last_active":"2024-04-24T13:35:22.623085+0000","last_peered":"2024-04-24T13:35:22.623085+0000","last_clean":"2024-04-24T13:35:22.623085+0000","last_became_active":"2024-04-24T13:30:31.281287+0000","last_became_peered":"2024-04-24T13:30:31.281287+0000","last_unstale":"2024-04-24T13:35:22.623085+0000","last_undegraded":"2024-04-24T13:35:22.623085+0000","last_fullsized":"2024-04-24T13:35:22.623085+0000","mapping_epoch":30,"log_start":"0'0","ondisk_log_start":"0'0","created":30,"last_epoch_clean":31,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:22.622872+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:22.622872+0000","last_clean_scrub_stamp":"2024-04-24T13:35:22.622872+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:41:30.625372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,0],"acting":[4,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"4.27","version":"132'10","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:56.810472+0000","last_change":"2024-04-24T13:34:56.810533+0000","last_active":"2024-04-24T13:34:56.810472+0000","last_peered":"2024-04-24T13:34:56.810472+0000","last_clean":"2024-04-24T13:34:56.810472+0000","last_became_active":"2024-04-24T13:30:23.239108+0000","last_became_peered":"2024-04-24T13:30:23.239108+0000","last_unstale":"2024-04-24T13:34:56.810472+0000","last_undegraded":"2024-04-24T13:34:56.810472+0000","last_fullsized":"2024-04-24T13:34:56.810472+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'10","last_scrub_stamp":"2024-04-24T13:34:56.810265+0000","last_deep_scrub":"132'10","last_deep_scrub_stamp":"2024-04-24T13:34:56.810265+0000","last_clean_scrub_stamp":"2024-04-24T13:34:56.810265+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:54:03.670963+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":50,"num_read_kb":50,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,6],"acting":[1,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"150'28","reported_seq":300,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.987843+0000","last_change":"2024-04-24T13:35:05.987906+0000","last_active":"2024-04-24T13:35:05.987843+0000","last_peered":"2024-04-24T13:35:05.987843+0000","last_clean":"2024-04-24T13:35:05.987843+0000","last_became_active":"2024-04-24T13:30:21.220983+0000","last_became_peered":"2024-04-24T13:30:21.220983+0000","last_unstale":"2024-04-24T13:35:05.987843+0000","last_undegraded":"2024-04-24T13:35:05.987843+0000","last_fullsized":"2024-04-24T13:35:05.987843+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'28","last_scrub_stamp":"2024-04-24T13:35:05.987646+0000","last_deep_scrub":"150'28","last_deep_scrub_stamp":"2024-04-24T13:35:05.987646+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.987646+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:14.886239+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":0,"num_write":28,"num_write_kb":57344,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,0],"acting":[6,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.26","version":"105'12","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.867022+0000","last_change":"2024-04-24T13:35:02.867086+0000","last_active":"2024-04-24T13:35:02.867022+0000","last_peered":"2024-04-24T13:35:02.867022+0000","last_clean":"2024-04-24T13:35:02.867022+0000","last_became_active":"2024-04-24T13:30:23.218654+0000","last_became_peered":"2024-04-24T13:30:23.218654+0000","last_unstale":"2024-04-24T13:35:02.867022+0000","last_undegraded":"2024-04-24T13:35:02.867022+0000","last_fullsized":"2024-04-24T13:35:02.867022+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'12","last_scrub_stamp":"2024-04-24T13:35:02.866811+0000","last_deep_scrub":"105'12","last_deep_scrub_stamp":"2024-04-24T13:35:02.866811+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.866811+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:32:11.765404+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":58,"num_read_kb":54,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.21","version":"150'38","reported_seq":338,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.013467+0000","last_change":"2024-04-24T13:35:05.013527+0000","last_active":"2024-04-24T13:35:05.013467+0000","last_peered":"2024-04-24T13:35:05.013467+0000","last_clean":"2024-04-24T13:35:05.013467+0000","last_became_active":"2024-04-24T13:33:08.725876+0000","last_became_peered":"2024-04-24T13:33:08.725876+0000","last_unstale":"2024-04-24T13:35:05.013467+0000","last_undegraded":"2024-04-24T13:35:05.013467+0000","last_fullsized":"2024-04-24T13:35:05.013467+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'38","last_scrub_stamp":"2024-04-24T13:35:05.013276+0000","last_deep_scrub":"150'38","last_deep_scrub_stamp":"2024-04-24T13:35:05.013276+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.013276+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:17:06.405155+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":3,"num_write":48,"num_write_kb":77824,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":29360128,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,5],"acting":[2,5],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.25","version":"82'2","reported_seq":125,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:31.443034+0000","last_change":"2024-04-24T13:35:31.443117+0000","last_active":"2024-04-24T13:35:31.443034+0000","last_peered":"2024-04-24T13:35:31.443034+0000","last_clean":"2024-04-24T13:35:31.443034+0000","last_became_active":"2024-04-24T13:33:49.302722+0000","last_became_peered":"2024-04-24T13:33:49.302722+0000","last_unstale":"2024-04-24T13:35:31.443034+0000","last_undegraded":"2024-04-24T13:35:31.443034+0000","last_fullsized":"2024-04-24T13:35:31.443034+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:31.442788+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:31.442788+0000","last_clean_scrub_stamp":"2024-04-24T13:35:31.442788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:01:32.580008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.22","version":"150'56","reported_seq":181,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:06.391204+0000","last_change":"2024-04-24T13:35:06.391204+0000","last_active":"2024-04-24T13:35:06.391204+0000","last_peered":"2024-04-24T13:35:06.391204+0000","last_clean":"2024-04-24T13:35:06.391204+0000","last_became_active":"2024-04-24T13:33:08.720010+0000","last_became_peered":"2024-04-24T13:33:08.720010+0000","last_unstale":"2024-04-24T13:35:06.391204+0000","last_undegraded":"2024-04-24T13:35:06.391204+0000","last_fullsized":"2024-04-24T13:35:06.391204+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'56","last_scrub_stamp":"2024-04-24T13:35:06.390920+0000","last_deep_scrub":"150'56","last_deep_scrub_stamp":"2024-04-24T13:35:06.390920+0000","last_clean_scrub_stamp":"2024-04-24T13:35:06.390920+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:18:22.659835+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":46137344,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.24","version":"114'12","reported_seq":329,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:21.171856+0000","last_change":"2024-04-24T13:35:21.171918+0000","last_active":"2024-04-24T13:35:21.171856+0000","last_peered":"2024-04-24T13:35:21.171856+0000","last_clean":"2024-04-24T13:35:21.171856+0000","last_became_active":"2024-04-24T13:33:49.289642+0000","last_became_peered":"2024-04-24T13:33:49.289642+0000","last_unstale":"2024-04-24T13:35:21.171856+0000","last_undegraded":"2024-04-24T13:35:21.171856+0000","last_fullsized":"2024-04-24T13:35:21.171856+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"114'12","last_scrub_stamp":"2024-04-24T13:35:21.171620+0000","last_deep_scrub":"114'12","last_deep_scrub_stamp":"2024-04-24T13:35:21.171620+0000","last_clean_scrub_stamp":"2024-04-24T13:35:21.171620+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T23:38:01.298335+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,7],"acting":[1,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.23","version":"150'62","reported_seq":336,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:19.532943+0000","last_change":"2024-04-24T13:35:19.533012+0000","last_active":"2024-04-24T13:35:19.532943+0000","last_peered":"2024-04-24T13:35:19.532943+0000","last_clean":"2024-04-24T13:35:19.532943+0000","last_became_active":"2024-04-24T13:30:21.230256+0000","last_became_peered":"2024-04-24T13:30:21.230256+0000","last_unstale":"2024-04-24T13:35:19.532943+0000","last_undegraded":"2024-04-24T13:35:19.532943+0000","last_fullsized":"2024-04-24T13:35:19.532943+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'62","last_scrub_stamp":"2024-04-24T13:35:19.532748+0000","last_deep_scrub":"150'62","last_deep_scrub_stamp":"2024-04-24T13:35:19.532748+0000","last_clean_scrub_stamp":"2024-04-24T13:35:19.532748+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:20:12.777492+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":0,"num_write":62,"num_write_kb":126976,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"132'4","reported_seq":302,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:30.520294+0000","last_change":"2024-04-24T13:35:30.520424+0000","last_active":"2024-04-24T13:35:30.520294+0000","last_peered":"2024-04-24T13:35:30.520294+0000","last_clean":"2024-04-24T13:35:30.520294+0000","last_became_active":"2024-04-24T13:33:49.304888+0000","last_became_peered":"2024-04-24T13:33:49.304888+0000","last_unstale":"2024-04-24T13:35:30.520294+0000","last_undegraded":"2024-04-24T13:35:30.520294+0000","last_fullsized":"2024-04-24T13:35:30.520294+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'4","last_scrub_stamp":"2024-04-24T13:35:30.520059+0000","last_deep_scrub":"132'4","last_deep_scrub_stamp":"2024-04-24T13:35:30.520059+0000","last_clean_scrub_stamp":"2024-04-24T13:35:30.520059+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:19:33.123415+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,7],"acting":[3,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.24","version":"150'44","reported_seq":320,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:23.551825+0000","last_change":"2024-04-24T13:35:23.551887+0000","last_active":"2024-04-24T13:35:23.551825+0000","last_peered":"2024-04-24T13:35:23.551825+0000","last_clean":"2024-04-24T13:35:23.551825+0000","last_became_active":"2024-04-24T13:30:21.233403+0000","last_became_peered":"2024-04-24T13:30:21.233403+0000","last_unstale":"2024-04-24T13:35:23.551825+0000","last_undegraded":"2024-04-24T13:35:23.551825+0000","last_fullsized":"2024-04-24T13:35:23.551825+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'44","last_scrub_stamp":"2024-04-24T13:35:23.551616+0000","last_deep_scrub":"150'44","last_deep_scrub_stamp":"2024-04-24T13:35:23.551616+0000","last_clean_scrub_stamp":"2024-04-24T13:35:23.551616+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:29:25.893238+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":0,"num_write":44,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.22","version":"81'2","reported_seq":279,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:59.417354+0000","last_change":"2024-04-24T13:34:59.417419+0000","last_active":"2024-04-24T13:34:59.417354+0000","last_peered":"2024-04-24T13:34:59.417354+0000","last_clean":"2024-04-24T13:34:59.417354+0000","last_became_active":"2024-04-24T13:30:23.240376+0000","last_became_peered":"2024-04-24T13:30:23.240376+0000","last_unstale":"2024-04-24T13:34:59.417354+0000","last_undegraded":"2024-04-24T13:34:59.417354+0000","last_fullsized":"2024-04-24T13:34:59.417354+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'2","last_scrub_stamp":"2024-04-24T13:34:59.417126+0000","last_deep_scrub":"81'2","last_deep_scrub_stamp":"2024-04-24T13:34:59.417126+0000","last_clean_scrub_stamp":"2024-04-24T13:34:59.417126+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:35:08.056561+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.25","version":"150'36","reported_seq":312,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.985072+0000","last_change":"2024-04-24T13:35:11.985132+0000","last_active":"2024-04-24T13:35:11.985072+0000","last_peered":"2024-04-24T13:35:11.985072+0000","last_clean":"2024-04-24T13:35:11.985072+0000","last_became_active":"2024-04-24T13:30:21.225653+0000","last_became_peered":"2024-04-24T13:30:21.225653+0000","last_unstale":"2024-04-24T13:35:11.985072+0000","last_undegraded":"2024-04-24T13:35:11.985072+0000","last_fullsized":"2024-04-24T13:35:11.985072+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'36","last_scrub_stamp":"2024-04-24T13:35:11.984874+0000","last_deep_scrub":"150'36","last_deep_scrub_stamp":"2024-04-24T13:35:11.984874+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.984874+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:50:47.310868+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"132'12","reported_seq":310,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:13.434729+0000","last_change":"2024-04-24T13:35:13.434787+0000","last_active":"2024-04-24T13:35:13.434729+0000","last_peered":"2024-04-24T13:35:13.434729+0000","last_clean":"2024-04-24T13:35:13.434729+0000","last_became_active":"2024-04-24T13:30:23.223945+0000","last_became_peered":"2024-04-24T13:30:23.223945+0000","last_unstale":"2024-04-24T13:35:13.434729+0000","last_undegraded":"2024-04-24T13:35:13.434729+0000","last_fullsized":"2024-04-24T13:35:13.434729+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"132'12","last_scrub_stamp":"2024-04-24T13:35:13.434509+0000","last_deep_scrub":"132'12","last_deep_scrub_stamp":"2024-04-24T13:35:13.434509+0000","last_clean_scrub_stamp":"2024-04-24T13:35:13.434509+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:18:03.285568+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.26","version":"150'58","reported_seq":378,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:19.075408+0000","last_change":"2024-04-24T13:35:19.075544+0000","last_active":"2024-04-24T13:35:19.075408+0000","last_peered":"2024-04-24T13:35:19.075408+0000","last_clean":"2024-04-24T13:35:19.075408+0000","last_became_active":"2024-04-24T13:33:49.301145+0000","last_became_peered":"2024-04-24T13:33:49.301145+0000","last_unstale":"2024-04-24T13:35:19.075408+0000","last_undegraded":"2024-04-24T13:35:19.075408+0000","last_fullsized":"2024-04-24T13:35:19.075408+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'58","last_scrub_stamp":"2024-04-24T13:35:19.075182+0000","last_deep_scrub":"150'58","last_deep_scrub_stamp":"2024-04-24T13:35:19.075182+0000","last_clean_scrub_stamp":"2024-04-24T13:35:19.075182+0000","objects_scrubbed":0,"log_size":58,"log_dups_size":0,"ondisk_log_size":58,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:07:40.630530+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":0,"num_write":58,"num_write_kb":118784,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":18,"num_bytes_recovered":75497472,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,7],"acting":[6,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.20","version":"0'0","reported_seq":268,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.026788+0000","last_change":"2024-04-24T13:35:09.026842+0000","last_active":"2024-04-24T13:35:09.026788+0000","last_peered":"2024-04-24T13:35:09.026788+0000","last_clean":"2024-04-24T13:35:09.026788+0000","last_became_active":"2024-04-24T13:30:23.242989+0000","last_became_peered":"2024-04-24T13:30:23.242989+0000","last_unstale":"2024-04-24T13:35:09.026788+0000","last_undegraded":"2024-04-24T13:35:09.026788+0000","last_fullsized":"2024-04-24T13:35:09.026788+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:09.026590+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:09.026590+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.026590+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T17:13:25.194287+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,2],"acting":[6,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"3.27","version":"150'32","reported_seq":308,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:22.514620+0000","last_change":"2024-04-24T13:35:22.514682+0000","last_active":"2024-04-24T13:35:22.514620+0000","last_peered":"2024-04-24T13:35:22.514620+0000","last_clean":"2024-04-24T13:35:22.514620+0000","last_became_active":"2024-04-24T13:30:21.229168+0000","last_became_peered":"2024-04-24T13:30:21.229168+0000","last_unstale":"2024-04-24T13:35:22.514620+0000","last_undegraded":"2024-04-24T13:35:22.514620+0000","last_fullsized":"2024-04-24T13:35:22.514620+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'32","last_scrub_stamp":"2024-04-24T13:35:22.514403+0000","last_deep_scrub":"150'32","last_deep_scrub_stamp":"2024-04-24T13:35:22.514403+0000","last_clean_scrub_stamp":"2024-04-24T13:35:22.514403+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:34:11.571626+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":0,"num_write":32,"num_write_kb":65536,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2f","version":"105'8","reported_seq":305,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:09.544556+0000","last_change":"2024-04-24T13:35:09.544616+0000","last_active":"2024-04-24T13:35:09.544556+0000","last_peered":"2024-04-24T13:35:09.544556+0000","last_clean":"2024-04-24T13:35:09.544556+0000","last_became_active":"2024-04-24T13:30:23.222297+0000","last_became_peered":"2024-04-24T13:30:23.222297+0000","last_unstale":"2024-04-24T13:35:09.544556+0000","last_undegraded":"2024-04-24T13:35:09.544556+0000","last_fullsized":"2024-04-24T13:35:09.544556+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"105'8","last_scrub_stamp":"2024-04-24T13:35:09.544356+0000","last_deep_scrub":"105'8","last_deep_scrub_stamp":"2024-04-24T13:35:09.544356+0000","last_clean_scrub_stamp":"2024-04-24T13:35:09.544356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:53:58.805158+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":43,"num_read_kb":43,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.28","version":"150'56","reported_seq":179,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:00.383434+0000","last_change":"2024-04-24T13:35:00.383434+0000","last_active":"2024-04-24T13:35:00.383434+0000","last_peered":"2024-04-24T13:35:00.383434+0000","last_clean":"2024-04-24T13:35:00.383434+0000","last_became_active":"2024-04-24T13:33:08.716282+0000","last_became_peered":"2024-04-24T13:33:08.716282+0000","last_unstale":"2024-04-24T13:35:00.383434+0000","last_undegraded":"2024-04-24T13:35:00.383434+0000","last_fullsized":"2024-04-24T13:35:00.383434+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":104,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'56","last_scrub_stamp":"2024-04-24T13:35:00.383169+0000","last_deep_scrub":"150'56","last_deep_scrub_stamp":"2024-04-24T13:35:00.383169+0000","last_clean_scrub_stamp":"2024-04-24T13:35:00.383169+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:39:53.504058+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":9,"num_bytes_recovered":37748736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,3],"acting":[5,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2e","version":"81'4","reported_seq":288,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:16.531858+0000","last_change":"2024-04-24T13:35:16.531921+0000","last_active":"2024-04-24T13:35:16.531858+0000","last_peered":"2024-04-24T13:35:16.531858+0000","last_clean":"2024-04-24T13:35:16.531858+0000","last_became_active":"2024-04-24T13:30:23.218473+0000","last_became_peered":"2024-04-24T13:30:23.218473+0000","last_unstale":"2024-04-24T13:35:16.531858+0000","last_undegraded":"2024-04-24T13:35:16.531858+0000","last_fullsized":"2024-04-24T13:35:16.531858+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"81'4","last_scrub_stamp":"2024-04-24T13:35:16.531640+0000","last_deep_scrub":"81'4","last_deep_scrub_stamp":"2024-04-24T13:35:16.531640+0000","last_clean_scrub_stamp":"2024-04-24T13:35:16.531640+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:29:26.038327+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":22,"num_read_kb":22,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,2],"acting":[4,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.29","version":"150'56","reported_seq":332,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:21.518311+0000","last_change":"2024-04-24T13:35:21.518376+0000","last_active":"2024-04-24T13:35:21.518311+0000","last_peered":"2024-04-24T13:35:21.518311+0000","last_clean":"2024-04-24T13:35:21.518311+0000","last_became_active":"2024-04-24T13:30:21.228299+0000","last_became_peered":"2024-04-24T13:30:21.228299+0000","last_unstale":"2024-04-24T13:35:21.518311+0000","last_undegraded":"2024-04-24T13:35:21.518311+0000","last_fullsized":"2024-04-24T13:35:21.518311+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'56","last_scrub_stamp":"2024-04-24T13:35:21.518121+0000","last_deep_scrub":"150'56","last_deep_scrub_stamp":"2024-04-24T13:35:21.518121+0000","last_clean_scrub_stamp":"2024-04-24T13:35:21.518121+0000","objects_scrubbed":0,"log_size":56,"log_dups_size":0,"ondisk_log_size":56,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:23:26.694889+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":0,"num_write":56,"num_write_kb":114688,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,4],"acting":[3,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2d","version":"0'0","reported_seq":269,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:02.952879+0000","last_change":"2024-04-24T13:35:02.952936+0000","last_active":"2024-04-24T13:35:02.952879+0000","last_peered":"2024-04-24T13:35:02.952879+0000","last_clean":"2024-04-24T13:35:02.952879+0000","last_became_active":"2024-04-24T13:30:23.236793+0000","last_became_peered":"2024-04-24T13:30:23.236793+0000","last_unstale":"2024-04-24T13:35:02.952879+0000","last_undegraded":"2024-04-24T13:35:02.952879+0000","last_fullsized":"2024-04-24T13:35:02.952879+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:02.952675+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:02.952675+0000","last_clean_scrub_stamp":"2024-04-24T13:35:02.952675+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:31:59.597641+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.2a","version":"150'44","reported_seq":196,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:27.483496+0000","last_change":"2024-04-24T13:35:27.483496+0000","last_active":"2024-04-24T13:35:27.483496+0000","last_peered":"2024-04-24T13:35:27.483496+0000","last_clean":"2024-04-24T13:35:27.483496+0000","last_became_active":"2024-04-24T13:33:49.289463+0000","last_became_peered":"2024-04-24T13:33:49.289463+0000","last_unstale":"2024-04-24T13:35:27.483496+0000","last_undegraded":"2024-04-24T13:35:27.483496+0000","last_fullsized":"2024-04-24T13:35:27.483496+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":127,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'44","last_scrub_stamp":"2024-04-24T13:35:27.483207+0000","last_deep_scrub":"150'44","last_deep_scrub_stamp":"2024-04-24T13:35:27.483207+0000","last_clean_scrub_stamp":"2024-04-24T13:35:27.483207+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T20:51:22.294382+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":3,"num_write":54,"num_write_kb":90112,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":19,"num_bytes_recovered":71303168,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.2c","version":"82'6","reported_seq":296,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:01.470726+0000","last_change":"2024-04-24T13:35:01.470796+0000","last_active":"2024-04-24T13:35:01.470726+0000","last_peered":"2024-04-24T13:35:01.470726+0000","last_clean":"2024-04-24T13:35:01.470726+0000","last_became_active":"2024-04-24T13:30:23.240127+0000","last_became_peered":"2024-04-24T13:30:23.240127+0000","last_unstale":"2024-04-24T13:35:01.470726+0000","last_undegraded":"2024-04-24T13:35:01.470726+0000","last_fullsized":"2024-04-24T13:35:01.470726+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-24T13:35:01.470497+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-24T13:35:01.470497+0000","last_clean_scrub_stamp":"2024-04-24T13:35:01.470497+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:29:21.288445+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":32,"num_read_kb":32,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[4,6],"acting":[4,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":4,"acting_primary":4,"purged_snaps":[]},{"pgid":"3.2b","version":"150'48","reported_seq":368,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:29.436884+0000","last_change":"2024-04-24T13:35:29.436947+0000","last_active":"2024-04-24T13:35:29.436884+0000","last_peered":"2024-04-24T13:35:29.436884+0000","last_clean":"2024-04-24T13:35:29.436884+0000","last_became_active":"2024-04-24T13:33:49.302184+0000","last_became_peered":"2024-04-24T13:33:49.302184+0000","last_unstale":"2024-04-24T13:35:29.436884+0000","last_undegraded":"2024-04-24T13:35:29.436884+0000","last_fullsized":"2024-04-24T13:35:29.436884+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'48","last_scrub_stamp":"2024-04-24T13:35:29.436681+0000","last_deep_scrub":"150'48","last_deep_scrub_stamp":"2024-04-24T13:35:29.436681+0000","last_clean_scrub_stamp":"2024-04-24T13:35:29.436681+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T16:44:52.311908+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":96256,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":17,"num_bytes_recovered":69206016,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,7],"acting":[0,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2b","version":"82'2","reported_seq":70,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:25.289019+0000","last_change":"2024-04-24T13:35:25.289107+0000","last_active":"2024-04-24T13:35:25.289019+0000","last_peered":"2024-04-24T13:35:25.289019+0000","last_clean":"2024-04-24T13:35:25.289019+0000","last_became_active":"2024-04-24T13:33:49.300182+0000","last_became_peered":"2024-04-24T13:33:49.300182+0000","last_unstale":"2024-04-24T13:35:25.289019+0000","last_undegraded":"2024-04-24T13:35:25.289019+0000","last_fullsized":"2024-04-24T13:35:25.289019+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:25.288781+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:25.288781+0000","last_clean_scrub_stamp":"2024-04-24T13:35:25.288781+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:43:14.870499+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2c","version":"150'60","reported_seq":332,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:05.029060+0000","last_change":"2024-04-24T13:35:05.029124+0000","last_active":"2024-04-24T13:35:05.029060+0000","last_peered":"2024-04-24T13:35:05.029060+0000","last_clean":"2024-04-24T13:35:05.029060+0000","last_became_active":"2024-04-24T13:30:21.234017+0000","last_became_peered":"2024-04-24T13:30:21.234017+0000","last_unstale":"2024-04-24T13:35:05.029060+0000","last_undegraded":"2024-04-24T13:35:05.029060+0000","last_fullsized":"2024-04-24T13:35:05.029060+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'60","last_scrub_stamp":"2024-04-24T13:35:05.028864+0000","last_deep_scrub":"150'60","last_deep_scrub_stamp":"2024-04-24T13:35:05.028864+0000","last_clean_scrub_stamp":"2024-04-24T13:35:05.028864+0000","objects_scrubbed":0,"log_size":60,"log_dups_size":0,"ondisk_log_size":60,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:17:06.420743+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":0,"num_write":60,"num_write_kb":122880,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[6,4],"acting":[6,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":6,"acting_primary":6,"purged_snaps":[]},{"pgid":"4.2a","version":"82'4","reported_seq":287,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:07.572499+0000","last_change":"2024-04-24T13:35:07.572562+0000","last_active":"2024-04-24T13:35:07.572499+0000","last_peered":"2024-04-24T13:35:07.572499+0000","last_clean":"2024-04-24T13:35:07.572499+0000","last_became_active":"2024-04-24T13:30:23.223801+0000","last_became_peered":"2024-04-24T13:30:23.223801+0000","last_unstale":"2024-04-24T13:35:07.572499+0000","last_undegraded":"2024-04-24T13:35:07.572499+0000","last_fullsized":"2024-04-24T13:35:07.572499+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'4","last_scrub_stamp":"2024-04-24T13:35:07.572291+0000","last_deep_scrub":"82'4","last_deep_scrub_stamp":"2024-04-24T13:35:07.572291+0000","last_clean_scrub_stamp":"2024-04-24T13:35:07.572291+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:29:57.988388+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":21,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2d","version":"150'34","reported_seq":115,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:26.318792+0000","last_change":"2024-04-24T13:35:26.318855+0000","last_active":"2024-04-24T13:35:26.318792+0000","last_peered":"2024-04-24T13:35:26.318792+0000","last_clean":"2024-04-24T13:35:26.318792+0000","last_became_active":"2024-04-24T13:33:49.299554+0000","last_became_peered":"2024-04-24T13:33:49.299554+0000","last_unstale":"2024-04-24T13:35:26.318792+0000","last_undegraded":"2024-04-24T13:35:26.318792+0000","last_fullsized":"2024-04-24T13:35:26.318792+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":129,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'34","last_scrub_stamp":"2024-04-24T13:35:26.318603+0000","last_deep_scrub":"150'34","last_deep_scrub_stamp":"2024-04-24T13:35:26.318603+0000","last_clean_scrub_stamp":"2024-04-24T13:35:26.318603+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T21:42:27.033226+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":67584,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":13,"num_bytes_recovered":52428800,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,2],"acting":[7,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"4.29","version":"82'2","reported_seq":281,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:15.503319+0000","last_change":"2024-04-24T13:35:15.503386+0000","last_active":"2024-04-24T13:35:15.503319+0000","last_peered":"2024-04-24T13:35:15.503319+0000","last_clean":"2024-04-24T13:35:15.503319+0000","last_became_active":"2024-04-24T13:30:23.213048+0000","last_became_peered":"2024-04-24T13:30:23.213048+0000","last_unstale":"2024-04-24T13:35:15.503319+0000","last_undegraded":"2024-04-24T13:35:15.503319+0000","last_fullsized":"2024-04-24T13:35:15.503319+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:15.503085+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:15.503085+0000","last_clean_scrub_stamp":"2024-04-24T13:35:15.503085+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T15:43:05.084803+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"150'36","reported_seq":309,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.852719+0000","last_change":"2024-04-24T13:34:57.852719+0000","last_active":"2024-04-24T13:34:57.852719+0000","last_peered":"2024-04-24T13:34:57.852719+0000","last_clean":"2024-04-24T13:34:57.852719+0000","last_became_active":"2024-04-24T13:30:21.215442+0000","last_became_peered":"2024-04-24T13:30:21.215442+0000","last_unstale":"2024-04-24T13:34:57.852719+0000","last_undegraded":"2024-04-24T13:34:57.852719+0000","last_fullsized":"2024-04-24T13:34:57.852719+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'36","last_scrub_stamp":"2024-04-24T13:34:57.852461+0000","last_deep_scrub":"150'36","last_deep_scrub_stamp":"2024-04-24T13:34:57.852461+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.852461+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T19:14:47.988866+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":0,"num_write":36,"num_write_kb":73728,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,6],"acting":[2,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"0'0","reported_seq":66,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.370227+0000","last_change":"2024-04-24T13:35:10.370291+0000","last_active":"2024-04-24T13:35:10.370227+0000","last_peered":"2024-04-24T13:35:10.370227+0000","last_clean":"2024-04-24T13:35:10.370227+0000","last_became_active":"2024-04-24T13:33:49.300135+0000","last_became_peered":"2024-04-24T13:33:49.300135+0000","last_unstale":"2024-04-24T13:35:10.370227+0000","last_undegraded":"2024-04-24T13:35:10.370227+0000","last_fullsized":"2024-04-24T13:35:10.370227+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":125,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-04-24T13:35:10.370024+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-04-24T13:35:10.370024+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.370024+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T22:17:40.820652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,3],"acting":[7,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]},{"pgid":"3.2f","version":"150'48","reported_seq":211,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:29.481695+0000","last_change":"2024-04-24T13:35:29.481695+0000","last_active":"2024-04-24T13:35:29.481695+0000","last_peered":"2024-04-24T13:35:29.481695+0000","last_clean":"2024-04-24T13:35:29.481695+0000","last_became_active":"2024-04-24T13:33:49.292734+0000","last_became_peered":"2024-04-24T13:33:49.292734+0000","last_unstale":"2024-04-24T13:35:29.481695+0000","last_undegraded":"2024-04-24T13:35:29.481695+0000","last_fullsized":"2024-04-24T13:35:29.481695+0000","mapping_epoch":124,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":128,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'48","last_scrub_stamp":"2024-04-24T13:35:29.481280+0000","last_deep_scrub":"150'48","last_deep_scrub_stamp":"2024-04-24T13:35:29.481280+0000","last_clean_scrub_stamp":"2024-04-24T13:35:29.481280+0000","objects_scrubbed":0,"log_size":48,"log_dups_size":0,"ondisk_log_size":48,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:24:49.404012+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":0,"num_write":48,"num_write_kb":98304,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":25,"num_bytes_recovered":104857600,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,7],"acting":[5,7],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"3.30","version":"150'50","reported_seq":174,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:34:57.431582+0000","last_change":"2024-04-24T13:34:57.431582+0000","last_active":"2024-04-24T13:34:57.431582+0000","last_peered":"2024-04-24T13:34:57.431582+0000","last_clean":"2024-04-24T13:34:57.431582+0000","last_became_active":"2024-04-24T13:33:08.735696+0000","last_became_peered":"2024-04-24T13:33:08.735696+0000","last_unstale":"2024-04-24T13:34:57.431582+0000","last_undegraded":"2024-04-24T13:34:57.431582+0000","last_fullsized":"2024-04-24T13:34:57.431582+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'50","last_scrub_stamp":"2024-04-24T13:34:57.431130+0000","last_deep_scrub":"150'50","last_deep_scrub_stamp":"2024-04-24T13:34:57.431130+0000","last_clean_scrub_stamp":"2024-04-24T13:34:57.431130+0000","objects_scrubbed":0,"log_size":50,"log_dups_size":0,"ondisk_log_size":50,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T00:38:33.398026+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":0,"num_write":50,"num_write_kb":102400,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":10,"num_bytes_recovered":41943040,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]},{"pgid":"4.37","version":"82'2","reported_seq":278,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:11.594971+0000","last_change":"2024-04-24T13:35:11.594971+0000","last_active":"2024-04-24T13:35:11.594971+0000","last_peered":"2024-04-24T13:35:11.594971+0000","last_clean":"2024-04-24T13:35:11.594971+0000","last_became_active":"2024-04-24T13:30:23.221631+0000","last_became_peered":"2024-04-24T13:30:23.221631+0000","last_unstale":"2024-04-24T13:35:11.594971+0000","last_undegraded":"2024-04-24T13:35:11.594971+0000","last_fullsized":"2024-04-24T13:35:11.594971+0000","mapping_epoch":22,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":23,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'2","last_scrub_stamp":"2024-04-24T13:35:11.594694+0000","last_deep_scrub":"82'2","last_deep_scrub_stamp":"2024-04-24T13:35:11.594694+0000","last_clean_scrub_stamp":"2024-04-24T13:35:11.594694+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:47:20.362486+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"150'34","reported_seq":310,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:10.966613+0000","last_change":"2024-04-24T13:35:10.966745+0000","last_active":"2024-04-24T13:35:10.966613+0000","last_peered":"2024-04-24T13:35:10.966613+0000","last_clean":"2024-04-24T13:35:10.966613+0000","last_became_active":"2024-04-24T13:30:21.216947+0000","last_became_peered":"2024-04-24T13:30:21.216947+0000","last_unstale":"2024-04-24T13:35:10.966613+0000","last_undegraded":"2024-04-24T13:35:10.966613+0000","last_fullsized":"2024-04-24T13:35:10.966613+0000","mapping_epoch":20,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":21,"parent":"0.0","parent_split_bits":0,"last_scrub":"150'34","last_scrub_stamp":"2024-04-24T13:35:10.966383+0000","last_deep_scrub":"150'34","last_deep_scrub_stamp":"2024-04-24T13:35:10.966383+0000","last_clean_scrub_stamp":"2024-04-24T13:35:10.966383+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-04-26T01:11:57.415764+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":17,"num_read_kb":0,"num_write":34,"num_write_kb":69632,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,4],"acting":[1,4],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.36","version":"82'6","reported_seq":119,"reported_epoch":150,"state":"active+clean","last_fresh":"2024-04-24T13:35:14.430056+0000","last_change":"2024-04-24T13:35:14.430129+0000","last_active":"2024-04-24T13:35:14.430056+0000","last_peered":"2024-04-24T13:35:14.430056+0000","last_clean":"2024-04-24T13:35:14.430056+0000","last_became_active":"2024-04-24T13:33:08.732489+0000","last_became_peered":"2024-04-24T13:33:08.732489+0000","last_unstale":"2024-04-24T13:35:14.430056+0000","last_undegraded":"2024-04-24T13:35:14.430056+0000","last_fullsized":"2024-04-24T13:35:14.430056+0000","mapping_epoch":103,"log_start":"0'0","ondisk_log_start":"0'0","created":22,"last_epoch_clean":105,"parent":"0.0","parent_split_bits":0,"last_scrub":"82'6","last_scrub_stamp":"2024-04-24T13:35:14.429857+0000","last_deep_scrub":"82'6","last_deep_scrub_stamp":"2024-04-24T13:35:14.429857+0000","last_clean_scrub_stamp":"2024-04-24T13:35:14.429857+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-04-25T14:34:03.487079+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":30,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":3,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[5,0],"acting":[5,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":5,"acting_primary":5,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":403,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":362,"num_read_kb":342,"num_write":299,"num_write_kb":86,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":194,"num_keys_recovered":1,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":806,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":125,"ondisk_log_size":125,"up":64,"acting":64,"num_store_stats":8},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1116,"ondisk_log_size":1116,"up":64,"acting":64,"num_store_stats":8},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":27618,"num_objects":179,"num_object_clones":0,"num_object_copies":358,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":179,"num_whiteouts":0,"num_read":1055,"num_read_kb":1534,"num_write":541,"num_write_kb":426,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":143,"num_bytes_recovered":62549,"num_keys_recovered":20,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":6040,"num_omap_keys":22,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1017,"ondisk_log_size":1017,"up":64,"acting":64,"num_store_stats":8},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1613,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":349,"num_read_kb":349,"num_write":10,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":11,"num_bytes_recovered":2233,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":49152,"data_stored":3226,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":8},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1458,"num_read_kb":1426,"num_write":312,"num_write_kb":24,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":45,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":296,"ondisk_log_size":296,"up":128,"acting":128,"num_store_stats":8},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1536,"num_read_kb":24,"num_write":3104,"num_write_kb":6184960,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":449,"num_bytes_recovered":1849688064,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3024,"ondisk_log_size":3024,"up":128,"acting":128,"num_store_stats":8},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":16,"acting":16,"num_store_stats":8},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":116,"num_read_kb":100,"num_write":159,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":4,"num_bytes_recovered":1180736,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1781760,"data_stored":1771104,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":119,"ondisk_log_size":119,"up":2,"acting":2,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":13,"seq":55834574917,"num_pgs":69,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":41888,"kb_used_data":2392,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94329952,"statfs":{"total":96636764160,"available":96593870848,"internally_reserved":0,"allocated":2449408,"data_stored":1687559,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1590,"internal_metadata":40434122},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":6,"up_from":13,"seq":55834574917,"num_pgs":57,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37124,"kb_used_data":1788,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334716,"statfs":{"total":96636764160,"available":96598749184,"internally_reserved":0,"allocated":1830912,"data_stored":1096531,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":5,"up_from":13,"seq":55834574918,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37176,"kb_used_data":1840,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334664,"statfs":{"total":96636764160,"available":96598695936,"internally_reserved":0,"allocated":1884160,"data_stored":1098788,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]},{"osd":4,"up_from":13,"seq":55834574918,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37112,"kb_used_data":1776,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334728,"statfs":{"total":96636764160,"available":96598761472,"internally_reserved":0,"allocated":1818624,"data_stored":1096029,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":3,"up_from":13,"seq":55834574917,"num_pgs":77,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37144,"kb_used_data":1808,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334696,"statfs":{"total":96636764160,"available":96598728704,"internally_reserved":0,"allocated":1851392,"data_stored":1097220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":13,"seq":55834574918,"num_pgs":55,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37120,"kb_used_data":1784,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334720,"statfs":{"total":96636764160,"available":96598753280,"internally_reserved":0,"allocated":1826816,"data_stored":1096214,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1594,"internal_metadata":36174278},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":13,"seq":55834574919,"num_pgs":66,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37152,"kb_used_data":1816,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334688,"statfs":{"total":96636764160,"available":96598720512,"internally_reserved":0,"allocated":1859584,"data_stored":1098602,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":13,"seq":55834574918,"num_pgs":70,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":37708,"kb_used_data":2372,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94334132,"statfs":{"total":96636764160,"available":96598151168,"internally_reserved":0,"allocated":2428928,"data_stored":1686965,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":1475,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":46,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":92,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":24576,"data_stored":1613,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":32768,"data_stored":880,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1018,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":440,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":40960,"data_stored":1100,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":220,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1458,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":28672,"data_stored":814,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":53248,"data_stored":1474,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":392,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":11,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":403,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":4,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":5,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-04-24T13:35:35.084 DEBUG:teuthology.orchestra.run.smithi071:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-04-24T13:35:35.446 INFO:teuthology.misc:Shutting down mds daemons... 2024-04-24T13:35:35.446 INFO:teuthology.misc:Shutting down osd daemons... 2024-04-24T13:35:35.446 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-04-24T13:35:35.446 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:35:35.516 INFO:tasks.ceph.osd.0:Stopped 2024-04-24T13:35:35.517 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-04-24T13:35:35.517 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:35:35.612 INFO:tasks.ceph.osd.1:Stopped 2024-04-24T13:35:35.612 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-04-24T13:35:35.612 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:35:35.702 INFO:tasks.ceph.osd.2:Stopped 2024-04-24T13:35:35.702 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-04-24T13:35:35.702 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:35:38.365 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 is failed for ~0s 2024-04-24T13:35:41.804 INFO:tasks.ceph.osd.3:Stopped 2024-04-24T13:35:41.805 DEBUG:tasks.ceph.osd.4:waiting for process to exit 2024-04-24T13:35:41.805 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:35:41.866 INFO:tasks.ceph.osd.4:Stopped 2024-04-24T13:35:41.866 DEBUG:tasks.ceph.osd.5:waiting for process to exit 2024-04-24T13:35:41.866 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:35:41.967 INFO:tasks.ceph.osd.5:Stopped 2024-04-24T13:35:41.967 DEBUG:tasks.ceph.osd.6:waiting for process to exit 2024-04-24T13:35:41.967 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:35:43.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 is failed for ~0s 2024-04-24T13:35:43.971 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.3 has been restored 2024-04-24T13:35:48.069 INFO:tasks.ceph.osd.6:Stopped 2024-04-24T13:35:48.070 DEBUG:tasks.ceph.osd.7:waiting for process to exit 2024-04-24T13:35:48.070 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:35:48.153 INFO:tasks.ceph.osd.7:Stopped 2024-04-24T13:35:48.153 INFO:teuthology.misc:Shutting down mgr daemons... 2024-04-24T13:35:48.154 DEBUG:tasks.ceph.mgr.y:waiting for process to exit 2024-04-24T13:35:48.154 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:35:48.181 INFO:tasks.ceph.mgr.y:Stopped 2024-04-24T13:35:48.182 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-04-24T13:35:48.182 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:35:48.212 INFO:tasks.ceph.mgr.x:Stopped 2024-04-24T13:35:48.212 INFO:teuthology.misc:Shutting down mon daemons... 2024-04-24T13:35:48.212 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-04-24T13:35:48.212 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:35:48.240 INFO:tasks.ceph.mon.a:Stopped 2024-04-24T13:35:48.240 DEBUG:tasks.ceph.mon.c:waiting for process to exit 2024-04-24T13:35:48.241 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:35:48.298 INFO:tasks.ceph.mon.c:Stopped 2024-04-24T13:35:48.298 DEBUG:tasks.ceph.mon.b:waiting for process to exit 2024-04-24T13:35:48.299 INFO:teuthology.orchestra.run:waiting for 300 2024-04-24T13:35:48.317 INFO:tasks.ceph.mon.b:Stopped 2024-04-24T13:35:48.318 INFO:tasks.ceph:Checking cluster log for badness... 2024-04-24T13:35:48.318 DEBUG:teuthology.orchestra.run.smithi071:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | egrep -v 'overall HEALTH_' | egrep -v '\(OSDMAP_FLAGS\)' | egrep -v '\(OSD_' | egrep -v '\(PG_' | egrep -v '\(POOL_' | egrep -v '\(CACHE_POOL_' | egrep -v '\(SMALLER_PGP_NUM\)' | egrep -v '\(OBJECT_' | egrep -v '\(SLOW_OPS\)' | egrep -v '\(REQUEST_SLOW\)' | egrep -v '\(TOO_FEW_PGS\)' | egrep -v 'slow request' | egrep -v 'timeout on replica' | egrep -v 'late reservation from' | egrep -v MON_DOWN | egrep -v OSDMAP_FLAGS | egrep -v OSD_DOWN | egrep -v PG_DEGRADED | egrep -v PG_AVAILABILITY | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'mons down' | egrep -v 'mon down' | egrep -v 'out of quorum' | head -n 1 2024-04-24T13:35:48.359 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-24T13:35:48.359 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-04-24T13:35:48.666 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-24T13:35:48.666 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-04-24T13:35:48.862 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-24T13:35:48.863 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-04-24T13:35:48.972 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.osd.6 has been restored 2024-04-24T13:35:49.020 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi071.front.sepia.ceph.com 2024-04-24T13:35:49.020 DEBUG:teuthology.orchestra.run.smithi071:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-04-24T13:35:49.188 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-4 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-24T13:35:49.188 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-4 2024-04-24T13:35:49.453 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-5 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-24T13:35:49.454 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-5 2024-04-24T13:35:49.622 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-6 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-24T13:35:49.623 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-6 2024-04-24T13:35:49.816 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-7 on ubuntu@smithi138.front.sepia.ceph.com 2024-04-24T13:35:49.816 DEBUG:teuthology.orchestra.run.smithi138:> sync && sudo umount -f /var/lib/ceph/osd/ceph-7 2024-04-24T13:35:50.026 INFO:tasks.ceph:Archiving mon data... 2024-04-24T13:35:50.027 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434/data/mon.a.tgz 2024-04-24T13:35:50.027 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-04-24T13:35:50.033 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.RPGbQzfs1U 2024-04-24T13:35:50.034 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.RPGbQzfs1U 2024-04-24T13:35:50.225 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.RPGbQzfs1U 2024-04-24T13:35:50.290 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.RPGbQzfs1U is 650KB 2024-04-24T13:35:50.356 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.RPGbQzfs1U 2024-04-24T13:35:50.362 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/mon/ceph-c to /home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434/data/mon.c.tgz 2024-04-24T13:35:50.362 DEBUG:teuthology.orchestra.run.smithi071:> mktemp 2024-04-24T13:35:50.411 INFO:teuthology.orchestra.run.smithi071.stdout:/tmp/tmp.RL02eKFZin 2024-04-24T13:35:50.411 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-c -- . > /tmp/tmp.RL02eKFZin 2024-04-24T13:35:50.646 DEBUG:teuthology.orchestra.run.smithi071:> sudo chmod 0666 /tmp/tmp.RL02eKFZin 2024-04-24T13:35:50.709 DEBUG:teuthology.orchestra.remote:smithi071:/tmp/tmp.RL02eKFZin is 838KB 2024-04-24T13:35:50.777 DEBUG:teuthology.orchestra.run.smithi071:> rm -fr /tmp/tmp.RL02eKFZin 2024-04-24T13:35:50.783 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/mon/ceph-b to /home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434/data/mon.b.tgz 2024-04-24T13:35:50.783 DEBUG:teuthology.orchestra.run.smithi138:> mktemp 2024-04-24T13:35:50.789 INFO:teuthology.orchestra.run.smithi138.stdout:/tmp/tmp.kTsVU4ba46 2024-04-24T13:35:50.790 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-b -- . > /tmp/tmp.kTsVU4ba46 2024-04-24T13:35:51.028 DEBUG:teuthology.orchestra.run.smithi138:> sudo chmod 0666 /tmp/tmp.kTsVU4ba46 2024-04-24T13:35:51.094 DEBUG:teuthology.orchestra.remote:smithi138:/tmp/tmp.kTsVU4ba46 is 838KB 2024-04-24T13:35:51.159 DEBUG:teuthology.orchestra.run.smithi138:> rm -fr /tmp/tmp.kTsVU4ba46 2024-04-24T13:35:51.165 INFO:tasks.ceph:Cleaning ceph cluster... 2024-04-24T13:35:51.165 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T13:35:51.167 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-04-24T13:35:51.227 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T13:35:51.270 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-04-24T13:35:51.270 INFO:tasks.ceph:Archiving crash dumps... 2024-04-24T13:35:51.271 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434/remote/smithi071/crash 2024-04-24T13:35:51.272 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T13:35:51.288 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/lib/ceph/crash to /home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434/remote/smithi138/crash 2024-04-24T13:35:51.289 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-04-24T13:35:51.324 INFO:tasks.ceph:Compressing logs... 2024-04-24T13:35:51.325 DEBUG:teuthology.orchestra.run.smithi071:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T13:35:51.331 DEBUG:teuthology.orchestra.run.smithi138:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-04-24T13:35:51.360 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31434.log 2024-04-24T13:35:51.361 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68481.log 2024-04-24T13:35:51.361 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31434.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62369.log 0.0% 2024-04-24T13:35:51.361 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.31434.log.gz 2024-04-24T13:35:51.362 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68481.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69705.log 2024-04-24T13:35:51.362 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68481.log.gz 2024-04-24T13:35:51.362 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.62369.log: gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-04-24T13:35:51.362 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62369.log.gz 2024-04-24T13:35:51.362 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69705.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69705.log.gz 2024-04-24T13:35:51.363 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66409.log 2024-04-24T13:35:51.365 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68016.log 2024-04-24T13:35:51.365 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/rgw.ceph.client.0.log: /var/log/ceph/ceph-client.admin.66409.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62274.log 2024-04-24T13:35:51.365 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66409.log.gz 2024-04-24T13:35:51.365 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68016.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62238.log 2024-04-24T13:35:51.365 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68016.log.gz 2024-04-24T13:35:51.365 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.62274.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67648.log 2024-04-24T13:35:51.365 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62274.log.gz 2024-04-24T13:35:51.365 INFO:teuthology.orchestra.run.smithi071.stderr: 87.5% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-04-24T13:35:51.365 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60208.log 2024-04-24T13:35:51.366 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.62238.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62238.log.gz 2024-04-24T13:35:51.366 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67648.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69622.log 2024-04-24T13:35:51.366 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67648.log.gz 2024-04-24T13:35:51.366 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.60208.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.60208.log.gz 2024-04-24T13:35:51.366 INFO:teuthology.orchestra.run.smithi071.stderr: -5 --verbose -- /var/log/ceph/ceph-mgr.y.log 2024-04-24T13:35:51.372 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67622.log 2024-04-24T13:35:51.372 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69622.log.gz 2024-04-24T13:35:51.372 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58364.log 2024-04-24T13:35:51.372 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mgr.y.log: /var/log/ceph/ceph-client.admin.67622.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55706.log 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67622.log.gz 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31767.log 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58364.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58364.log.gz 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55706.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63774.log 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55706.log.gz 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31767.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40330.log 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31767.log.gz 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36296.log 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63774.log.gz 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40330.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43314.log 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40330.log.gz 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36296.log: gzip 0.0% -5 -- replaced with /var/log/ceph/ceph-client.admin.36296.log.gz --verbose 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr: -- /var/log/ceph/ceph-client.admin.68240.log 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36096.log 2024-04-24T13:35:51.373 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43314.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43314.log.gz 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68240.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67700.log 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68240.log.gz 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36096.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55393.log 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36096.log.gz 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67700.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58825.log 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67700.log.gz 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55393.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68039.log 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55393.log.gz 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60216.log 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58825.log.gz 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68039.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68039.log.gz 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67830.log 2024-04-24T13:35:51.374 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.60216.log: 93.8% -- replaced with /var/log/ceph/ceph-mgr.y.log.gz 2024-04-24T13:35:51.375 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60216.log.gz 2024-04-24T13:35:51.375 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59019.log 2024-04-24T13:35:51.375 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67830.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36223.log 2024-04-24T13:35:51.375 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67830.log.gz 2024-04-24T13:35:51.396 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.59019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33360.log 2024-04-24T13:35:51.396 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59019.log.gz 2024-04-24T13:35:51.396 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36223.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36223.log.gz 2024-04-24T13:35:51.396 INFO:teuthology.orchestra.run.smithi071.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.59069.log 2024-04-24T13:35:51.396 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63321.log 2024-04-24T13:35:51.396 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33360.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33360.log.gz 2024-04-24T13:35:51.396 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.59069.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67305.log 2024-04-24T13:35:51.396 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59069.log.gz 2024-04-24T13:35:51.396 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63321.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68220.log 2024-04-24T13:35:51.396 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63321.log.gz 2024-04-24T13:35:51.396 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32821.log 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67305.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67305.log.gz 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68220.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55479.log 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68220.log.gz 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32821.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30887.log 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32821.log.gz 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55479.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30939.log 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55479.log.gz 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58729.log 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30887.log.gz 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30939.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31433.log 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30939.log.gz 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36147.log 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58729.log.gz 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58546.log 2024-04-24T13:35:51.397 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31433.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31433.log.gz 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36147.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54204.log 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36147.log.gz 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59015.log 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58546.log.gz 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31215.log 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54204.log.gz 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.59015.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55735.log 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59015.log.gz 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31215.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33143.log 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31215.log.gz 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36535.log 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55735.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55735.log.gz 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33143.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31008.log 2024-04-24T13:35:51.398 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33143.log.gz 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36535.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33488.log 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36535.log.gz 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31008.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48111.log 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31008.log.gz 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33488.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33856.log 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33488.log.gz 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.48111.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32498.log 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48111.log.gz 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33856.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35443.log 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33856.log.gz 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32498.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32498.log.gz 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58661.log 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35443.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67253.log 2024-04-24T13:35:51.399 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35443.log.gz 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63489.log 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58661.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58661.log.gz 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67253.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36034.log 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67253.log.gz 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63489.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32789.log 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63489.log.gz 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36066.log 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36034.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36034.log.gz 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32789.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69180.log 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32789.log.gz 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36066.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36490.log 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36066.log.gz 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59067.log 2024-04-24T13:35:51.400 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69180.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69180.log.gz 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36490.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31009.log 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36490.log.gz 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.59067.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34960.log 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59067.log.gz 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31009.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31009.log.gz 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68023.log 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34960.log.gz 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31015.log 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34919.log 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68023.log.gz 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31015.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31015.log.gz 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59812.log 2024-04-24T13:35:51.401 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34919.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34919.log.gz 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31691.log 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.59812.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35183.log 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59812.log.gz 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31691.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31691.log.gz 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32446.log 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35183.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33169.log 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35183.log.gz 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32446.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32446.log.gz 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33223.log 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33169.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31216.log 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33169.log.gz 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33223.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33223.log.gz 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68248.log 2024-04-24T13:35:51.402 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31216.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32917.log 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31216.log.gz 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68248.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68248.log.gz 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68027.log 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31717.log 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32917.log.gz 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68027.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68027.log.gz 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69648.log 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31717.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32883.log 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31717.log.gz 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69648.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69648.log.gz 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69154.log 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32883.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32883.log.gz 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69154.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69154.log.gz 2024-04-24T13:35:51.403 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68239.log 2024-04-24T13:35:51.404 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58616.log 2024-04-24T13:35:51.404 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68239.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68239.log.gz 2024-04-24T13:35:51.404 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31407.log 2024-04-24T13:35:51.404 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35699.log 2024-04-24T13:35:51.404 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58616.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58616.log.gz 2024-04-24T13:35:51.404 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31407.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54466.log 2024-04-24T13:35:51.404 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31407.log.gz 2024-04-24T13:35:51.404 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35699.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35699.log.gz 2024-04-24T13:35:51.404 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50483.log 2024-04-24T13:35:51.404 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34750.log 2024-04-24T13:35:51.404 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54466.log.gz 2024-04-24T13:35:51.404 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.50483.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34162.log 2024-04-24T13:35:51.404 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50483.log.gz 2024-04-24T13:35:51.414 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25189.log 2024-04-24T13:35:51.414 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25062.log 2024-04-24T13:35:51.414 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25189.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25086.log 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25189.log.gz 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25062.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25165.log 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25062.log.gz 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25086.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25086.log.gz 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.7.log 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.6.log 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25165.log: gzip/var/log/ceph/ceph-osd.7.log: -5 --verbose -- /var/log/ceph/ceph-osd.5.log 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25165.log.gz 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25213.log 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.5.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25038.log 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25213.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25213.log.gz 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log/var/log/ceph/ceph-client.admin.25038.log: 2024-04-24T13:35:51.415 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25038.log.gz 2024-04-24T13:35:51.416 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25110.log 2024-04-24T13:35:51.416 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T13:35:51.416 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25110.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.b.log 2024-04-24T13:35:51.416 INFO:teuthology.orchestra.run.smithi138.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25110.log.gz 2024-04-24T13:35:51.416 INFO:teuthology.orchestra.run.smithi138.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.4.log 2024-04-24T13:35:51.416 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph.audit.log: /var/log/ceph/ceph-mon.b.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25134.log 2024-04-24T13:35:51.416 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-osd.4.log: 86.2% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-24T13:35:51.416 INFO:teuthology.orchestra.run.smithi138.stderr:/var/log/ceph/ceph-client.admin.25134.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25134.log.gz 2024-04-24T13:35:51.416 INFO:teuthology.orchestra.run.smithi138.stderr: 89.6% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T13:35:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35150.log 2024-04-24T13:35:51.461 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34750.log.gz 2024-04-24T13:35:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34162.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.40920.log 2024-04-24T13:35:51.461 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34162.log.gz 2024-04-24T13:35:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35150.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35150.log.gz 2024-04-24T13:35:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58981.log 2024-04-24T13:35:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35355.log 2024-04-24T13:35:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.40920.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.40920.log.gz 2024-04-24T13:35:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58981.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58981.log.gzgzip 2024-04-24T13:35:51.461 INFO:teuthology.orchestra.run.smithi071.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.69440.log 2024-04-24T13:35:51.461 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67570.log 2024-04-24T13:35:51.461 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35355.log.gz 2024-04-24T13:35:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69440.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.69440.log.gz 2024-04-24T13:35:51.462 INFO:teuthology.orchestra.run.smithi071.stderr: /var/log/ceph/ceph-client.admin.63535.log 2024-04-24T13:35:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67570.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67570.log.gz 2024-04-24T13:35:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34465.log 2024-04-24T13:35:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52317.log 2024-04-24T13:35:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63535.log.gz 2024-04-24T13:35:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34465.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32472.log 2024-04-24T13:35:51.462 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34465.log.gz 2024-04-24T13:35:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52317.log: gzip -5 0.0% --verbose -- -- replaced with /var/log/ceph/ceph-client.admin.52317.log.gz 2024-04-24T13:35:51.462 INFO:teuthology.orchestra.run.smithi071.stderr: /var/log/ceph/ceph-client.admin.68247.log 2024-04-24T13:35:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32472.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32472.log.gz 2024-04-24T13:35:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69596.log 2024-04-24T13:35:51.462 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68013.log 2024-04-24T13:35:51.463 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68247.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68247.log.gz 2024-04-24T13:35:51.463 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69596.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34399.log 2024-04-24T13:35:51.463 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69596.log.gz 2024-04-24T13:35:51.463 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68013.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58406.log 2024-04-24T13:35:51.463 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68013.log.gz 2024-04-24T13:35:51.463 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34399.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34399.log.gz 2024-04-24T13:35:51.463 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58755.log 2024-04-24T13:35:51.463 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69258.log 2024-04-24T13:35:51.463 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58406.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58406.log.gz 2024-04-24T13:35:51.463 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58755.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65502.log 2024-04-24T13:35:51.463 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58755.log.gz 2024-04-24T13:35:51.463 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69258.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69336.log 2024-04-24T13:35:51.463 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69258.log.gz 2024-04-24T13:35:51.464 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.65502.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65502.log.gz 2024-04-24T13:35:51.464 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60060.log 2024-04-24T13:35:51.464 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55599.log 2024-04-24T13:35:51.464 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69336.log.gz 2024-04-24T13:35:51.464 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.60060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.38559.log 2024-04-24T13:35:51.464 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60060.log.gz 2024-04-24T13:35:51.464 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67829.log 2024-04-24T13:35:51.464 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55599.log.gz 2024-04-24T13:35:51.464 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.38559.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66642.log 2024-04-24T13:35:51.464 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.38559.log.gz 2024-04-24T13:35:51.464 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67829.log.gz 2024-04-24T13:35:51.464 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60299.log 2024-04-24T13:35:51.464 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36407.log 2024-04-24T13:35:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.66642.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66642.log.gz 2024-04-24T13:35:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.60299.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36567.log 2024-04-24T13:35:51.465 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60299.log.gz 2024-04-24T13:35:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36407.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.36407.log.gz 2024-04-24T13:35:51.465 INFO:teuthology.orchestra.run.smithi071.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34989.log 2024-04-24T13:35:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36567.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54500.log 2024-04-24T13:35:51.465 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36567.log.gz 2024-04-24T13:35:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34989.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69388.log 2024-04-24T13:35:51.465 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34989.log.gz 2024-04-24T13:35:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54500.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31226.log 2024-04-24T13:35:51.465 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54500.log.gz 2024-04-24T13:35:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69388.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69388.log.gz 2024-04-24T13:35:51.465 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51105.log 2024-04-24T13:35:51.466 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35865.log 2024-04-24T13:35:51.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31226.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31226.log.gz 2024-04-24T13:35:51.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.51105.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62134.log 2024-04-24T13:35:51.466 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51105.log.gz 2024-04-24T13:35:51.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35865.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65649.log 2024-04-24T13:35:51.466 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35865.log.gz 2024-04-24T13:35:51.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.62134.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34807.log 2024-04-24T13:35:51.466 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62134.log.gz 2024-04-24T13:35:51.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.65649.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65649.log.gz 2024-04-24T13:35:51.466 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35937.log 2024-04-24T13:35:51.466 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63312.log 2024-04-24T13:35:51.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34807.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34807.log.gz 2024-04-24T13:35:51.466 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60137.log 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35937.log.gz 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63312.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67674.log 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63312.log.gz 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.60137.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34309.log 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60137.log.gz 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67674.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67674.log.gz 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34309.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51708.log 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34309.log.gz 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69206.log 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.51708.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39150.log 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51708.log.gz 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69206.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54361.log 2024-04-24T13:35:51.467 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69206.log.gz 2024-04-24T13:35:51.468 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39150.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69518.log 2024-04-24T13:35:51.468 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39150.log.gz 2024-04-24T13:35:51.468 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54361.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32945.log 2024-04-24T13:35:51.468 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54361.log.gz 2024-04-24T13:35:51.468 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69518.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43916.log 2024-04-24T13:35:51.468 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69518.log.gz 2024-04-24T13:35:51.468 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32945.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35063.log 2024-04-24T13:35:51.468 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32945.log.gz 2024-04-24T13:35:51.468 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43916.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67544.log 2024-04-24T13:35:51.468 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43916.log.gz 2024-04-24T13:35:51.468 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63750.log 2024-04-24T13:35:51.468 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35063.log.gz 2024-04-24T13:35:51.468 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67544.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.65040.log 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67544.log.gz 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60166.log 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63750.log.gz 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.65040.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33674.log 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.65040.log.gz 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.60166.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60166.log.gz 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58452.log 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose --/var/log/ceph/ceph-client.admin.33674.log: /var/log/ceph/ceph-client.admin.34709.log 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33674.log.gz 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58452.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55887.log 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58452.log.gz 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34709.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37367.log 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34709.log.gz 2024-04-24T13:35:51.469 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55887.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55845.log 2024-04-24T13:35:51.470 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55887.log.gz 2024-04-24T13:35:51.470 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37367.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59985.log 2024-04-24T13:35:51.470 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37367.log.gz 2024-04-24T13:35:51.470 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55845.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69128.log 2024-04-24T13:35:51.470 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55845.log.gz 2024-04-24T13:35:51.470 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.59985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54245.log 2024-04-24T13:35:51.470 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59985.log.gz 2024-04-24T13:35:51.470 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69128.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67831.log 2024-04-24T13:35:51.470 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69128.log.gz 2024-04-24T13:35:51.470 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54245.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32524.log 2024-04-24T13:35:51.470 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54245.log.gz 2024-04-24T13:35:51.470 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67831.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68238.log 2024-04-24T13:35:51.470 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67831.log.gz 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32524.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69232.log 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32524.log.gz 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68238.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63800.log 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68238.log.gz 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32755.log 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69232.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69232.log.gz 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67362.log 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63800.log.gz 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62093.log 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32755.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32755.log.gz 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67362.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32704.log 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67362.log.gz 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.62093.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30774.log 2024-04-24T13:35:51.471 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62093.log.gz 2024-04-24T13:35:51.472 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32704.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31016.log 2024-04-24T13:35:51.472 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32704.log.gz 2024-04-24T13:35:51.472 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66359.log 2024-04-24T13:35:51.472 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30774.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30774.log.gz 2024-04-24T13:35:51.472 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31016.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-04-24T13:35:51.472 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31016.log.gz 2024-04-24T13:35:51.472 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46927.log 2024-04-24T13:35:51.472 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.66359.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66359.log.gz 2024-04-24T13:35:51.472 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35790.log 2024-04-24T13:35:51.472 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.46927.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69492.log 2024-04-24T13:35:51.472 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46927.log.gz 2024-04-24T13:35:51.472 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54428.log 2024-04-24T13:35:51.472 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35790.log.gz 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69492.log.gz 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35302.log 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54428.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67819.log 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54428.log.gz 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35302.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31204.log 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35302.log.gz 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67819.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63591.log 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67819.log.gz 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31204.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31204.log.gz 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31010.log 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63591.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59203.log 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63591.log.gz 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31419.log 2024-04-24T13:35:51.473 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31010.log.gz 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35655.log 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.59203.log: /var/log/ceph/ceph-client.admin.31419.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45144.log 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59203.log.gz 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31419.log.gz 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35655.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35655.log.gz 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67816.log 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63271.log 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.45144.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45144.log.gz 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67816.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69729.log 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67816.log.gz 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63169.log 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63271.log: /var/log/ceph/ceph-client.admin.69729.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33011.log 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63271.log.gz 2024-04-24T13:35:51.474 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69729.log.gz 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63169.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63169.log.gz 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63063.log 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25022.log 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33011.log: /var/log/ceph/ceph-client.admin.63063.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31219.log 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33011.log.gz 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63063.log.gz/var/log/ceph/ceph-client.admin.25022.log: 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.25022.log.gz -5 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr: --verbose -- /var/log/ceph/ceph-client.admin.67818.log 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67596.log 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31219.log: /var/log/ceph/ceph-client.admin.67818.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31741.log 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31219.log.gz 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67818.log.gz 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67596.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67596.log.gz 2024-04-24T13:35:51.475 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67414.log 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25279.log 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31741.log: /var/log/ceph/ceph-client.admin.67414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31741.log.gz 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34271.log 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67414.log.gz 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.25279.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41510.log 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25279.log.gz 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67492.log 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34271.log: /var/log/ceph/ceph-client.admin.41510.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35625.log 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34271.log.gz 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41510.log.gz 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67492.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67492.log.gz 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67336.log 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35963.log 2024-04-24T13:35:51.476 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35625.log: /var/log/ceph/ceph-client.admin.67336.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34358.log 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35625.log.gz 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67336.log.gz 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35963.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35963.log.gz 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67778.log 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.61489.log 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34358.log: /var/log/ceph/ceph-client.admin.67778.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63841.log 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34358.log.gz 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67778.log.gz 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.61489.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55319.log 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.61489.log.gz 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63841.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63841.log.gz 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68233.log 2024-04-24T13:35:51.477 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55319.log: /var/log/ceph/ceph.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35101.log 2024-04-24T13:35:51.478 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55319.log.gz 2024-04-24T13:35:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68233.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.46332.log 2024-04-24T13:35:51.478 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.68233.log.gz 2024-04-24T13:35:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35101.log.gz 2024-04-24T13:35:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37969.log 2024-04-24T13:35:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60892.log 2024-04-24T13:35:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.46332.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.46332.log.gz 2024-04-24T13:35:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37969.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63245.log 2024-04-24T13:35:51.478 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37969.log.gz 2024-04-24T13:35:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.60892.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60892.log.gz 2024-04-24T13:35:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35504.log 2024-04-24T13:35:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58612.log 2024-04-24T13:35:51.478 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63245.log: /var/log/ceph/ceph-client.admin.35504.log: 92.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63245.log.gz 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35504.log.gz 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69679.log 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.60026.log 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58612.log: /var/log/ceph/ceph-client.admin.69679.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.52907.log 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58612.log.gz 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69679.log.gz/var/log/ceph/ceph-client.admin.60026.log: 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.60026.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69570.log 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.52907.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.52907.log.gz 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67752.log 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68507.log 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69570.log: /var/log/ceph/ceph-client.admin.67752.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63203.log 2024-04-24T13:35:51.479 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69570.log.gz 2024-04-24T13:35:51.480 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67752.log.gz 2024-04-24T13:35:51.480 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68507.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30861.log 2024-04-24T13:35:51.480 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68507.log.gz 2024-04-24T13:35:51.480 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54386.log 2024-04-24T13:35:51.480 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63203.log: /var/log/ceph/ceph-client.admin.30861.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62320.log 2024-04-24T13:35:51.480 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63203.log.gz 2024-04-24T13:35:51.480 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30861.log.gz 2024-04-24T13:35:51.480 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54386.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54386.log.gz 2024-04-24T13:35:51.480 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.48705.log 2024-04-24T13:35:51.480 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.41646.log 2024-04-24T13:35:51.480 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.62320.log: /var/log/ceph/ceph-client.admin.48705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54530.log 2024-04-24T13:35:51.480 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.48705.log.gz 2024-04-24T13:35:51.480 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62320.log.gz 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.41646.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.41646.log.gz 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63682.log 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58894.log 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54530.log.gz 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63682.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31435.log 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63682.log.gz 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58894.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31615.log 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58894.log.gz 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32599.log 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31435.log: /var/log/ceph/ceph-client.admin.31615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68029.log 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31435.log.gz 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31615.log.gz 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32599.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35651.log 2024-04-24T13:35:51.481 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32599.log.gz 2024-04-24T13:35:51.482 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31423.log 2024-04-24T13:35:51.482 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68029.log: /var/log/ceph/ceph-client.admin.35651.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.c.log 2024-04-24T13:35:51.482 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68029.log.gz 2024-04-24T13:35:51.482 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35651.log.gz 2024-04-24T13:35:51.482 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31423.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31423.log.gz 2024-04-24T13:35:51.482 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59915.log 2024-04-24T13:35:51.482 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.20245.log 2024-04-24T13:35:51.482 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-mon.c.log: /var/log/ceph/ceph-client.admin.59915.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33012.log 2024-04-24T13:35:51.482 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59915.log.gz 2024-04-24T13:35:51.482 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.tmp-client.admin.20245.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.20245.log.gz 2024-04-24T13:35:51.513 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54300.log 2024-04-24T13:35:51.514 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33431.log 2024-04-24T13:35:51.514 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33012.log.gz 2024-04-24T13:35:51.514 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54300.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54300.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57657.log 2024-04-24T13:35:51.514 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.514 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33431.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.37281.log 2024-04-24T13:35:51.514 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0%/var/log/ceph/ceph-client.admin.57657.log: -- replaced with /var/log/ceph/ceph-client.admin.33431.log.gz 2024-04-24T13:35:51.514 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57657.log.gz 2024-04-24T13:35:51.514 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34127.log 2024-04-24T13:35:51.514 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35748.log 2024-04-24T13:35:51.514 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.37281.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.37281.log.gz 2024-04-24T13:35:51.514 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34127.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34127.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33265.log 2024-04-24T13:35:51.514 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35748.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35748.log.gz 2024-04-24T13:35:51.515 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66243.log 2024-04-24T13:35:51.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33265.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55550.log 2024-04-24T13:35:51.515 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33265.log.gz 2024-04-24T13:35:51.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.66243.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66243.log.gz 2024-04-24T13:35:51.515 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67828.log 2024-04-24T13:35:51.515 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63093.log 2024-04-24T13:35:51.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55550.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55550.log.gz 2024-04-24T13:35:51.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67828.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67828.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33575.log 2024-04-24T13:35:51.515 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.515 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63093.log.gz 2024-04-24T13:35:51.515 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68040.log 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35967.log 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33575.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33575.log.gz 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68040.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68040.log.gzgzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35967.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35967.log.gz 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54105.log 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34808.log 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ops-log-ceph-client.0.log: /var/log/ceph/ceph-client.admin.54105.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54105.log.gz 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr: 92.1% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66588.log 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66318.log 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34808.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34808.log.gz 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.66588.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66588.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34210.log 2024-04-24T13:35:51.516 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.66318.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66318.log.gz 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34210.log.gz 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31019.log 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph.audit.log: 94.0% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.54158.log 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31019.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.64447.log 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31019.log.gz 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35417.log 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.54158.log: /var/log/ceph/ceph-client.admin.64447.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.54158.log.gz 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.64447.log.gz 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66500.log 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33921.log 2024-04-24T13:35:51.517 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35417.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35417.log.gz 2024-04-24T13:35:51.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.66500.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66500.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31641.log 2024-04-24T13:35:51.518 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33921.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33921.log.gz 2024-04-24T13:35:51.518 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49889.log 2024-04-24T13:35:51.518 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69284.log 2024-04-24T13:35:51.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31641.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31641.log.gz 2024-04-24T13:35:51.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.49889.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49889.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30965.log 2024-04-24T13:35:51.518 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69284.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69284.log.gz 2024-04-24T13:35:51.518 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32597.log 2024-04-24T13:35:51.518 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35827.log 2024-04-24T13:35:51.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30965.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30965.log.gz 2024-04-24T13:35:51.518 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32597.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32597.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35261.log 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35827.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35827.log.gz 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42720.log 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.57067.log 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35261.log.gz 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.42720.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42720.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34621.log 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.57067.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.57067.log.gz 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33336.log 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55120.log 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34621.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34621.log.gz 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33336.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33336.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30836.log 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.519 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55120.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55120.log.gz 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63716.log 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69466.log 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30836.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30836.log.gz 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63716.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62164.log 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69466.log.gz 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.44554.log 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32795.log 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.62164.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62164.log.gz 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.44554.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31014.log 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.44554.log.gz 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32795.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32795.log.gz 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34564.log 2024-04-24T13:35:51.520 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68535.log 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31014.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31014.log.gz 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34564.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55177.log 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.34564.log.gz 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.0.68535.log: 0.0% -- replaced with /var/log/ceph/ceph-client.0.68535.log.gz 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.50481.log 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36667.log 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55177.log: /var/log/ceph/ceph-client.admin.50481.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55177.log.gz 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.50481.log.gz 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33698.log 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36330.log 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36667.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36667.log.gz 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33698.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33698.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33830.log 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.521 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36330.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36330.log.gz 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63464.log 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59716.log 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33830.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33830.log.gz 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63464.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63464.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62431.log 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.59716.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59716.log.gz 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33780.log 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66470.log 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.62431.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62431.log.gz 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33780.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.42125.log 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.66470.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66470.log.gz 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68429.log 2024-04-24T13:35:51.522 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63531.log 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.42125.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.42125.log.gz 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68429.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68429.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34045.log 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63531.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63531.log.gz 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35537.log 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69362.log 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34045.log: /var/log/ceph/ceph-client.admin.35537.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34045.log.gz 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35537.log.gz 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31422.log 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31667.log 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69362.log: /var/log/ceph/ceph-client.admin.31422.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69362.log.gz 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31422.log.gz 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55212.log 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.66549.log 2024-04-24T13:35:51.523 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31667.log: /var/log/ceph/ceph-client.admin.55212.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31667.log.gz 2024-04-24T13:35:51.524 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55212.log.gz 2024-04-24T13:35:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.25176.log 2024-04-24T13:35:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36748.log 2024-04-24T13:35:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.66549.log: /var/log/ceph/ceph-client.admin.25176.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.66549.log.gz 2024-04-24T13:35:51.524 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.25176.log.gz 2024-04-24T13:35:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59779.log 2024-04-24T13:35:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.53501.log 2024-04-24T13:35:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.36748.log: /var/log/ceph/ceph-client.admin.59779.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36748.log.gz 2024-04-24T13:35:51.524 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59779.log.gz 2024-04-24T13:35:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58264.log 2024-04-24T13:35:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.59870.log 2024-04-24T13:35:51.524 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.53501.log: /var/log/ceph/ceph-client.admin.58264.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.53501.log.gz 2024-04-24T13:35:51.524 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58264.log.gz 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67832.log 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34647.log 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67832.log: /var/log/ceph/ceph-client.admin.59870.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.59870.log.gz 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67832.log.gz 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36197.log 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.47521.log 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34647.log: /var/log/ceph/ceph-client.admin.36197.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34647.log.gz 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36197.log.gz 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58931.log 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31203.log 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.47521.log: /var/log/ceph/ceph-client.admin.58931.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.47521.log.gz 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58931.log.gz 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55261.log 2024-04-24T13:35:51.525 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68455.log 2024-04-24T13:35:51.526 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31203.log: /var/log/ceph/ceph-client.admin.55261.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31203.log.gz 2024-04-24T13:35:51.526 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55261.log.gz 2024-04-24T13:35:51.526 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69414.log 2024-04-24T13:35:51.526 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33518.log 2024-04-24T13:35:51.533 INFO:teuthology.orchestra.run.smithi138.stderr: 92.0% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-04-24T13:35:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68455.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68455.log.gz 2024-04-24T13:35:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69414.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69414.log.gz 2024-04-24T13:35:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33620.log 2024-04-24T13:35:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33518.log.gz 2024-04-24T13:35:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58780.log 2024-04-24T13:35:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.39740.log 2024-04-24T13:35:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33620.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33620.log.gz 2024-04-24T13:35:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58780.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58780.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.51093.log 2024-04-24T13:35:51.544 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.544 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.39740.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.39740.log.gz 2024-04-24T13:35:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33195.log 2024-04-24T13:35:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67279.log 2024-04-24T13:35:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.51093.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.51093.log.gz 2024-04-24T13:35:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33195.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33195.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67388.log 2024-04-24T13:35:51.545 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67279.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67279.log.gz 2024-04-24T13:35:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58521.log 2024-04-24T13:35:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58265.log 2024-04-24T13:35:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67388.log: /var/log/ceph/ceph-client.admin.58521.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67388.log.gz 2024-04-24T13:35:51.545 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58521.log.gz 2024-04-24T13:35:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55821.log 2024-04-24T13:35:51.545 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31210.log 2024-04-24T13:35:51.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58265.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58265.log.gz 2024-04-24T13:35:51.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55821.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55821.log.gzgzip 2024-04-24T13:35:51.546 INFO:teuthology.orchestra.run.smithi071.stderr: -5 --verbose -- /var/log/ceph/ceph-client.admin.34500.log 2024-04-24T13:35:51.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31210.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31210.log.gz 2024-04-24T13:35:51.546 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.49299.log 2024-04-24T13:35:51.546 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33971.log 2024-04-24T13:35:51.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34500.log: /var/log/ceph/ceph-client.admin.49299.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34500.log.gz 2024-04-24T13:35:51.546 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.49299.log.gz 2024-04-24T13:35:51.546 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.36379.log 2024-04-24T13:35:51.546 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69544.log 2024-04-24T13:35:51.546 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33971.log: /var/log/ceph/ceph-client.admin.36379.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33971.log.gz 2024-04-24T13:35:51.546 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.36379.log.gz 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67466.log 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30913.log 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69544.log: /var/log/ceph/ceph-client.admin.67466.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69544.log.gz 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67466.log.gz 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68032.log 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31012.log 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.30913.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.30913.log.gz 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68032.log: 0.0%gzip -- replaced with /var/log/ceph/ceph-client.admin.68032.log.gz -5 --verbose -- /var/log/ceph/ceph-client.admin.63632.log 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31012.log.gz 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55665.log 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.34012.log 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63632.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63632.log.gz 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55665.log: 0.0%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.43911.log 2024-04-24T13:35:51.547 INFO:teuthology.orchestra.run.smithi071.stderr: -- replaced with /var/log/ceph/ceph-client.admin.55665.log.gz 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.34012.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.34012.log.gz 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31227.log 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.62462.log 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.43911.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.43911.log.gz 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.31227.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31227.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32554.log 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.62462.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.62462.log.gz 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63317.log 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67726.log 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32554.log: /var/log/ceph/ceph-client.admin.63317.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32554.log.gz 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63317.log.gz 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.56477.log 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67518.log 2024-04-24T13:35:51.548 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67726.log: /var/log/ceph/ceph-client.admin.56477.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67726.log.gz 2024-04-24T13:35:51.549 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.56477.log.gz 2024-04-24T13:35:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.67440.log 2024-04-24T13:35:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33076.log 2024-04-24T13:35:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67518.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67518.log.gz 2024-04-24T13:35:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.67440.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.67440.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.69310.log 2024-04-24T13:35:51.549 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33076.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33076.log.gz 2024-04-24T13:35:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31415.log 2024-04-24T13:35:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.63430.log 2024-04-24T13:35:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.69310.log: /var/log/ceph/ceph-client.admin.31415.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.69310.log.gz 2024-04-24T13:35:51.549 INFO:teuthology.orchestra.run.smithi071.stderr: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.31415.log.gz 2024-04-24T13:35:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.33101.log 2024-04-24T13:35:51.549 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.58829.log 2024-04-24T13:35:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.63430.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.63430.log.gz 2024-04-24T13:35:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.33101.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.33101.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35565.log 2024-04-24T13:35:51.550 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.58829.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.58829.log.gz 2024-04-24T13:35:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55487.log 2024-04-24T13:35:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32595.log 2024-04-24T13:35:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35565.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35565.log.gz 2024-04-24T13:35:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55487.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55487.log.gz 2024-04-24T13:35:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.68231.log 2024-04-24T13:35:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.32595.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.32595.log.gz 2024-04-24T13:35:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.45738.log 2024-04-24T13:35:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35875.log 2024-04-24T13:35:51.550 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.68231.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.68231.log.gz 2024-04-24T13:35:51.551 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.45738.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.45738.log.gz 2024-04-24T13:35:51.551 INFO:teuthology.orchestra.run.smithi071.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.55368.log 2024-04-24T13:35:51.551 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.35875.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.35875.log.gz 2024-04-24T13:35:51.551 INFO:teuthology.orchestra.run.smithi071.stderr:/var/log/ceph/ceph-client.admin.55368.log: 0.0% -- replaced with /var/log/ceph/ceph-client.admin.55368.log.gz 2024-04-24T13:35:51.654 INFO:teuthology.orchestra.run.smithi138.stderr: 91.7% -- replaced with /var/log/ceph/ceph-mon.b.log.gz 2024-04-24T13:35:51.676 INFO:teuthology.orchestra.run.smithi071.stderr: 91.6% -- replaced with /var/log/ceph/ceph-mon.c.log.gz 2024-04-24T13:35:51.777 INFO:teuthology.orchestra.run.smithi071.stderr: 91.1% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-04-24T13:35:52.192 INFO:teuthology.orchestra.run.smithi138.stderr: 94.4% -- replaced with /var/log/ceph/ceph-osd.7.log.gz 2024-04-24T13:35:52.234 INFO:teuthology.orchestra.run.smithi071.stderr: 93.8% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-04-24T13:35:52.284 INFO:teuthology.orchestra.run.smithi138.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.6.log.gz 2024-04-24T13:35:52.376 INFO:teuthology.orchestra.run.smithi138.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.4.log.gz 2024-04-24T13:35:52.484 INFO:teuthology.orchestra.run.smithi138.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.5.log.gz 2024-04-24T13:35:52.485 INFO:teuthology.orchestra.run.smithi138.stderr: 2024-04-24T13:35:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:real 0m1.107s 2024-04-24T13:35:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:user 0m3.941s 2024-04-24T13:35:52.485 INFO:teuthology.orchestra.run.smithi138.stderr:sys 0m0.165s 2024-04-24T13:35:52.504 INFO:teuthology.orchestra.run.smithi071.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-04-24T13:35:52.548 INFO:teuthology.orchestra.run.smithi071.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-04-24T13:35:52.652 INFO:teuthology.orchestra.run.smithi071.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-04-24T13:35:52.653 INFO:teuthology.orchestra.run.smithi071.stderr: 2024-04-24T13:35:52.653 INFO:teuthology.orchestra.run.smithi071.stderr:real 0m1.320s 2024-04-24T13:35:52.653 INFO:teuthology.orchestra.run.smithi071.stderr:user 0m5.033s 2024-04-24T13:35:52.653 INFO:teuthology.orchestra.run.smithi071.stderr:sys 0m0.291s 2024-04-24T13:35:52.654 INFO:tasks.ceph:Archiving logs... 2024-04-24T13:35:52.654 DEBUG:teuthology.misc:Transferring archived files from smithi071:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434/remote/smithi071/log 2024-04-24T13:35:52.656 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T13:35:53.555 DEBUG:teuthology.misc:Transferring archived files from smithi138:/var/log/ceph to /home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434/remote/smithi138/log 2024-04-24T13:35:53.556 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /var/log/ceph -- . 2024-04-24T13:35:54.062 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-04-24T13:35:54.076 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-04-24T13:35:54.077 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T13:35:54.080 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-04-24T13:35:54.146 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-04-24T13:35:54.158 INFO:teuthology.task.clock:Checking final clock skew... 2024-04-24T13:35:54.158 DEBUG:teuthology.orchestra.run.smithi071:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T13:35:54.160 DEBUG:teuthology.orchestra.run.smithi138:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-04-24T13:35:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T13:35:54.172 INFO:teuthology.orchestra.run.smithi071.stdout:============================================================================== 2024-04-24T13:35:54.172 INFO:teuthology.orchestra.run.smithi071.stdout:*hv01.front.sepi 44.4.53.2 2 u 57 64 377 0.076 -0.865 0.505 2024-04-24T13:35:54.172 INFO:teuthology.orchestra.run.smithi071.stdout:+hv02.front.sepi 63.231.80.2 3 u 66 64 377 0.079 -0.495 0.383 2024-04-24T13:35:54.172 INFO:teuthology.orchestra.run.smithi071.stdout:+hv03.front.sepi 74.6.168.72 3 u 63 64 377 0.073 -0.874 0.425 2024-04-24T13:35:54.172 INFO:teuthology.orchestra.run.smithi071.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T13:35:54.175 INFO:teuthology.orchestra.run.smithi138.stdout: remote refid st t when poll reach delay offset jitter 2024-04-24T13:35:54.175 INFO:teuthology.orchestra.run.smithi138.stdout:============================================================================== 2024-04-24T13:35:54.175 INFO:teuthology.orchestra.run.smithi138.stdout:*hv01.front.sepi 44.4.53.2 2 u 60 64 377 0.070 -1.058 0.966 2024-04-24T13:35:54.175 INFO:teuthology.orchestra.run.smithi138.stdout:+hv02.front.sepi 63.231.80.2 3 u 60 64 377 0.071 -0.464 0.949 2024-04-24T13:35:54.175 INFO:teuthology.orchestra.run.smithi138.stdout:+hv03.front.sepi 74.6.168.72 3 u 64 64 377 0.080 -1.591 0.837 2024-04-24T13:35:54.175 INFO:teuthology.orchestra.run.smithi138.stdout: hv04.front.sepi .INIT. 16 u - 64 0 0.000 +0.000 0.000 2024-04-24T13:35:54.176 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-04-24T13:35:54.194 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-04-24T13:35:54.194 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-04-24T13:35:54.227 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-04-24T13:35:54.259 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-04-24T13:35:54.294 INFO:teuthology.task.internal:Duration was 947.603593 seconds 2024-04-24T13:35:54.295 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-04-24T13:35:54.366 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-04-24T13:35:54.366 DEBUG:teuthology.orchestra.run.smithi071:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T13:35:54.369 DEBUG:teuthology.orchestra.run.smithi138:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-04-24T13:35:54.409 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-04-24T13:35:54.409 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi071.front.sepia.ceph.com 2024-04-24T13:35:54.410 DEBUG:teuthology.orchestra.run.smithi071:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T13:35:54.455 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi138.front.sepia.ceph.com 2024-04-24T13:35:54.455 DEBUG:teuthology.orchestra.run.smithi138:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-04-24T13:35:54.464 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-04-24T13:35:54.465 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T13:35:54.499 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-04-24T13:35:54.535 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-04-24T13:35:54.535 DEBUG:teuthology.orchestra.run.smithi071:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T13:35:54.571 DEBUG:teuthology.orchestra.run.smithi138:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-04-24T13:35:54.642 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-04-24T13:35:54.653 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-04-24T13:35:54.653 DEBUG:teuthology.orchestra.run.smithi071:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T13:35:54.664 DEBUG:teuthology.orchestra.run.smithi138:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-04-24T13:35:54.674 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-04-24T13:35:54.696 DEBUG:teuthology.orchestra.run.smithi071:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T13:35:54.707 DEBUG:teuthology.orchestra.run.smithi138:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-04-24T13:35:54.715 INFO:teuthology.orchestra.run.smithi071.stdout:kernel.core_pattern = core 2024-04-24T13:35:54.725 INFO:teuthology.orchestra.run.smithi138.stdout:kernel.core_pattern = core 2024-04-24T13:35:54.743 DEBUG:teuthology.orchestra.run.smithi071:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T13:35:54.773 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T13:35:54.774 DEBUG:teuthology.orchestra.run.smithi138:> test -e /home/ubuntu/cephtest/archive/coredump 2024-04-24T13:35:54.788 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-04-24T13:35:54.788 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-04-24T13:35:54.798 INFO:teuthology.task.internal:Transferring archived files... 2024-04-24T13:35:54.799 DEBUG:teuthology.misc:Transferring archived files from smithi071:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434/remote/smithi071 2024-04-24T13:35:54.799 DEBUG:teuthology.orchestra.run.smithi071:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T13:35:54.842 DEBUG:teuthology.misc:Transferring archived files from smithi138:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/cbodley-2024-04-24_12:59:55-rgw-wip-cbodley-testing-distro-default-smithi/7671434/remote/smithi138 2024-04-24T13:35:54.842 DEBUG:teuthology.orchestra.run.smithi138:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-04-24T13:35:54.862 INFO:teuthology.task.internal:Removing archive directory... 2024-04-24T13:35:54.862 DEBUG:teuthology.orchestra.run.smithi071:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T13:35:54.879 DEBUG:teuthology.orchestra.run.smithi138:> rm -rf -- /home/ubuntu/cephtest/archive 2024-04-24T13:35:54.909 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-04-24T13:35:54.922 INFO:teuthology.task.internal:Not uploading archives. 2024-04-24T13:35:54.922 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-04-24T13:35:54.952 INFO:teuthology.task.internal:Tidying up after the test... 2024-04-24T13:35:54.952 DEBUG:teuthology.orchestra.run.smithi071:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T13:35:54.955 DEBUG:teuthology.orchestra.run.smithi138:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-04-24T13:35:54.958 INFO:teuthology.orchestra.run.smithi071.stdout: 658614 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 13:35 /home/ubuntu/cephtest 2024-04-24T13:35:54.962 INFO:teuthology.orchestra.run.smithi138.stdout: 658462 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Apr 24 13:35 /home/ubuntu/cephtest 2024-04-24T13:35:54.962 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-04-24T13:35:54.986 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-04-24T13:35:55.055 INFO:teuthology.run:Summary data: description: rgw/thrash/{clusters/fixed-2 frontend/beast ignore-pg-availability install objectstore/bluestore-bitmap s3tests-branch thrasher/default thrashosds-health ubuntu_latest workload/rgw_bucket_quota} duration: 947.6035931110382 flavor: default owner: scheduled_cbodley@teuthology success: true 2024-04-24T13:35:55.055 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-04-24T13:35:55.131 INFO:teuthology.run:pass